P supported_codecs: CODEC_LZOP
2025-09-30T14:57:26.819522Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:26.819545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:26.819548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:26.819550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:26.819559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896504173690172:11716]
2025-09-30T14:57:26.819563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896504173690172:11716]
2025-09-30T14:57:26.819568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896504173690172:11716]
2025-09-30T14:57:26.819605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:26.819612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.819615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:26.819621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:26.819636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:26.819641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:26.819760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:26.820837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0] Write session: try to update token
2025-09-30T14:57:26.820860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:26.842559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2561 sessionId: src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:26.845417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:26.846565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896504263481756:10873]
2025-09-30T14:57:26.846750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2560, pipe: [1:7555896504263481756:10873]
2025-09-30T14:57:26.948699Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:26.949170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.949187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.949208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481756:10873], now have 1 active actors on pipe
2025-09-30T14:57:26.949483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:26.949546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:26.949604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:26.949680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2561 reason: status is not ok: tablet will be restarted right now sessionId: src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0
2025-09-30T14:57:26.949883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2561 sessionId: src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0 is DEAD
2025-09-30T14:57:26.950009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896504263481756:10873]
2025-09-30T14:57:26.951349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:26.951364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0] Write session will restart in 0.007102s
2025-09-30T14:57:26.951392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0] Write session: Do CDS request
2025-09-30T14:57:26.951398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:26.963922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:26.964008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:26.964035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2562
2025-09-30T14:57:26.964258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2562 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:26.964295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2562 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:26.964305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2562 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:26.964310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:26.965000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2562 sessionId:  describe result for acl check
2025-09-30T14:57:26.965046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:26.965049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:26.965054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:26.965060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896504263481823:11225] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:26.965624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896504263481823:11225] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:26.967934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896504263481823:11225] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:26.968799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:26.972135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:26.972352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:26.972366Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:26.972378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:26.972433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:26.972475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896504173690329:11718]
2025-09-30T14:57:26.973169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:26.973599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:26.973667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:26.973790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896504263481823:11225] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:26.973808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896504263481823:11225] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:26.973811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896504263481823:11225] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:26.973820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2562 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:26.974027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:26.974095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.974102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.974103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.974105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.974106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.974107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.974108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.974109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.974111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.974112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.974113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.974114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.974115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.974117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.974117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.974123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.974134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.974139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.974143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.974147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.974152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.974156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.974160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.974165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.974171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.974176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.974181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.974185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.974189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.974193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.974201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.974210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:26.974216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.974222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:26.974233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.974239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:26.974243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.974250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:26.974259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.974265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:26.974276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.974282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:26.974293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.974299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:26.974310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.974320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:26.974325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.974336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:26.974340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.974351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:26.974365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.974376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.974382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.974392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.974397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.974406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.974410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.974420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:26.974426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.974437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:26.974485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:26.979915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:26.980816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:26.980832Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:26.980835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:26.980839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:26.980846Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2561 [2:7555896504173690329:11718]
2025-09-30T14:57:26.980864Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:26.980879Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:26.980888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:26.980891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:26.980894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:26.980910Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:26.980918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:26.980926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:26.980988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.981000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.981003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.981006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:26.981010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:26.981270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2561
2025-09-30T14:57:26.981272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2561
2025-09-30T14:57:26.981328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:26.981338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:26.981353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:26.981375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:26.981400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:26.981425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481907:11225], now have 1 active actors on pipe
2025-09-30T14:57:26.981433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896504263481758:2454], now have 1 active actors on pipe
2025-09-30T14:57:26.981450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.981455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.981480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896504173690324:11718]
2025-09-30T14:57:26.981487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896504173690324:11718]
2025-09-30T14:57:26.981489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896504173690324:11718]
2025-09-30T14:57:26.981504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:26.981522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:26.981520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:26.981524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:26.981526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:26.981539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:26.981546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:26.981563Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d423fa6b-884c7b30-22016819-1d916575_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:26.981580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:26.981584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:26.981587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:26.981597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:26.981611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:26.981654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896504173690324:11718]
2025-09-30T14:57:26.981667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:26.981673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:26.981683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:26.981854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:26.981863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:26.981878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:26.981989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2562 partition: 0 MaxSeqNo: 42 sessionId: src_id|d423fa6b-884c7b30-22016819-1d916575_0
2025-09-30T14:57:26.982423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcfbdf08-1fb35d7b-e4e62661-72a94eeb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d423fa6b-884c7b30-22016819-1d916575_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:26.985274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d423fa6b-884c7b30-22016819-1d916575_0] Write session: try to update token
2025-09-30T14:57:26.985292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d423fa6b-884c7b30-22016819-1d916575_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:26.998408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:26.998426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:26.998437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896504173690324:11718]
2025-09-30T14:57:26.998480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:26.998481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:26.998655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:26.998802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:26.998957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:26.999096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:26.999324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:26.999390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:27.004948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2562 sessionId: src_id|d423fa6b-884c7b30-22016819-1d916575_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:27.009832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:27.010086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.010114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.010152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:27.010286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:27.011885Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:27.011908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:27.011911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:27.011913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:27.011922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896504173690324:11718]
2025-09-30T14:57:27.011926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896504173690324:11718]
2025-09-30T14:57:27.011930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896504173690324:11718]
2025-09-30T14:57:27.011970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:27.011974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:27.011977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:27.011981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.011982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:27.011984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:27.012133Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:27.051382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896508558449213:10873]
2025-09-30T14:57:27.051753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2561, pipe: [1:7555896508558449213:10873]
2025-09-30T14:57:27.129130Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:27.137988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.138017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.138200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.138272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.138348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.138418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.138792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.138807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.138881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.138951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.139022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.139093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.139146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.139156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.139226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.139308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.139380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.139449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.139505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.139513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.139589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.139657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.139726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.139800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.139851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.139859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.139929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.139995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.140068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.140138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.140190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.140198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.140269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.140334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.140402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.140473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.140544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.140552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.140622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.140691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.140764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.140826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.140878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.140888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.140958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.141028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.141112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.141182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.141235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.141242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.141315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.141381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.141451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.141521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.141595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.141604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.141673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.141738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.141804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.141872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.141940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.141948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.142026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449213:10873], now have 1 active actors on pipe
2025-09-30T14:57:27.142740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d423fa6b-884c7b30-22016819-1d916575_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:27.142755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d423fa6b-884c7b30-22016819-1d916575_0] Write session will restart in 0.008584s
2025-09-30T14:57:27.142780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d423fa6b-884c7b30-22016819-1d916575_0] Write session: Do CDS request
2025-09-30T14:57:27.142786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d423fa6b-884c7b30-22016819-1d916575_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:27.142957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:27.142305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:27.142325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:27.142331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896508558449213:10873]
2025-09-30T14:57:27.142357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2562 reason: error at write: Disconnected sessionId: src_id|d423fa6b-884c7b30-22016819-1d916575_0
2025-09-30T14:57:27.142374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:27.142587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2562 sessionId: src_id|d423fa6b-884c7b30-22016819-1d916575_0 is DEAD
2025-09-30T14:57:27.152785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d423fa6b-884c7b30-22016819-1d916575_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:27.153162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:27.153180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2563
2025-09-30T14:57:27.153413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2563 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:27.153446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2563 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:27.153452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2563 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:27.153463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:27.153890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2563 sessionId:  describe result for acl check
2025-09-30T14:57:27.153925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:27.153932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:27.153934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:27.153940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896508558449326:11229] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:27.154490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896508558449326:11229] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:27.155358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:27.157256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896508558449326:11229] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:27.157703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:27.157925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:27.157936Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:27.157946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:27.158004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:27.158041Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896508468657791:11722]
2025-09-30T14:57:27.158721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:27.159004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:27.159048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:27.159412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:27.159491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.159499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.159500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.159501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.159502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.159503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.159505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.159506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.159507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.159508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.159509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.159510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.159511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.159512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.159513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.159519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.159529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.159533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.159536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.159540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.159543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.159546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.159549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.159553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.159556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.159559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.159563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.159566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.159570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.159573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.159582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.159591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.159598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.159603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.159608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.159614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.159619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.159624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.159629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.159635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.159640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.159646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.159651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.159656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.159661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.159666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.159670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.159675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.159679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.159684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.159692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.159698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.159702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.159706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.159711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.159715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.159719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.159724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.159728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.159733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.159774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:27.160420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896508558449326:11229] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:27.160438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896508558449326:11229] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:27.160442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896508558449326:11229] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:27.160454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2563 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:27.165578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:27.166694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:27.166710Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:27.166713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:27.166717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:27.166724Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2562 [2:7555896508468657791:11722]
2025-09-30T14:57:27.166743Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:27.166760Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:27.166764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:27.166777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:27.166780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:27.166798Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:27.166810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:27.166817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:27.166880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.166888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.166890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.166894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:27.166897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:27.166975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:27.166984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.166995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.167006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.167022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:27.167053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896508468657786:11722]
2025-09-30T14:57:27.167061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896508468657786:11722]
2025-09-30T14:57:27.167064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896508468657786:11722]
2025-09-30T14:57:27.167077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:27.167095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:27.167115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:27.167122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:27.167128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:27.167151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:27.167153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:27.167158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896508468657786:11722]
2025-09-30T14:57:27.167161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:27.167234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:27.167371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2562
2025-09-30T14:57:27.167409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2562
2025-09-30T14:57:27.167454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449368:11229], now have 1 active actors on pipe
2025-09-30T14:57:27.167467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449215:2454], now have 1 active actors on pipe
2025-09-30T14:57:27.167483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.167491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.167514Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa091e45-48412a2f-26870562-93240ef1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:27.167522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:27.167526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:27.167528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:27.167540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:27.167552Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:27.167567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:27.167978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.167995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.168019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:27.168155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2563 partition: 0 MaxSeqNo: 42 sessionId: src_id|aa091e45-48412a2f-26870562-93240ef1_0
2025-09-30T14:57:27.168625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d423fa6b-884c7b30-22016819-1d916575_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aa091e45-48412a2f-26870562-93240ef1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:27.171500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa091e45-48412a2f-26870562-93240ef1_0] Write session: try to update token
2025-09-30T14:57:27.171522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa091e45-48412a2f-26870562-93240ef1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:27.188223Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2563 sessionId: src_id|aa091e45-48412a2f-26870562-93240ef1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:27.189204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:27.189228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:27.189239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896508468657786:11722]
2025-09-30T14:57:27.189290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:27.189487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:27.189499Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:27.189654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:27.189802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:27.189956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:27.190159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:27.190196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:27.191075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:27.191327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.191346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.191380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:27.191741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:27.195115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:27.195135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:27.195138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:27.195140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:27.195154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896508468657786:11722]
2025-09-30T14:57:27.195158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896508468657786:11722]
2025-09-30T14:57:27.195161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896508468657786:11722]
2025-09-30T14:57:27.195195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:27.195201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.195204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:27.195207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:27.195214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:27.195219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:27.195357Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:27.247699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896508558449387:10873]
2025-09-30T14:57:27.248522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2562, pipe: [1:7555896508558449387:10873]
2025-09-30T14:57:27.307989Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:27.315750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.315775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.315911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.315969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.316033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.316089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.316271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.316274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.316340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.316396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.316451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.316508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.316549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.316550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.316620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.316687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.316748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.316811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.316851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.316854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.316920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.316973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.317033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.317117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.317158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.317160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.317221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.317272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.317327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.317392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.317435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.317438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.317515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.317580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.317643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.317711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.318046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.318050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.318113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.318173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.318238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.318290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.318328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.318330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.318389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.318440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.318503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.318570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.318616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.318619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.318690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.318755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.318819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.318885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.318930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.318933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.319009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:27.319066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:27.319138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:27.319205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:27.319500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:27.319511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:27.319573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449387:10873], now have 1 active actors on pipe
2025-09-30T14:57:27.323919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:27.324436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa091e45-48412a2f-26870562-93240ef1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:27.324447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa091e45-48412a2f-26870562-93240ef1_0] Write session will restart in 0.007201s
2025-09-30T14:57:27.324472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa091e45-48412a2f-26870562-93240ef1_0] Write session: Do CDS request
2025-09-30T14:57:27.324477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa091e45-48412a2f-26870562-93240ef1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:27.323598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:27.324000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2563 reason: status is not ok: tablet will be restarted right now sessionId: src_id|aa091e45-48412a2f-26870562-93240ef1_0
2025-09-30T14:57:27.324267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2563 sessionId: src_id|aa091e45-48412a2f-26870562-93240ef1_0 is DEAD
2025-09-30T14:57:27.324546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:27.324606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896508558449387:10873]
2025-09-30T14:57:27.332777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa091e45-48412a2f-26870562-93240ef1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:27.332883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:27.332903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2564
2025-09-30T14:57:27.333023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2564 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:27.333054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2564 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:27.333075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2564 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:27.333079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:27.333791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2564 sessionId:  describe result for acl check
2025-09-30T14:57:27.333822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:27.333824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:27.333826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:27.333834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896508558449440:11241] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:27.334362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896508558449440:11241] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:27.345455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896508558449440:11241] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:27.349434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896508558449440:11241] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:27.349462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896508558449440:11241] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:27.349467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896508558449440:11241] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:27.349480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2564 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:27.348411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:27.351464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:27.351764Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:27.351770Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:27.351785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:27.351863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:27.351912Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896508468657958:11730]
2025-09-30T14:57:27.352695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:27.353538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:27.353625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:27.354052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:27.354144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.354146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.354147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.354149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.354151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.354152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.354154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.354156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.354158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.354160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.354162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.354163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.354165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.354166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.354168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.354175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.354187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.354192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.354197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.354202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.354207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.354212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.354216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.354221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.354226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.354230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.354234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.354238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.354242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.354246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.354256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.354265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.354273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.354279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.354285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.354292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.354298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.354304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.354310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.354317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.354322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.354329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.354335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.354341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.354348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.354354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.354361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.354368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.354376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.354382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.354388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.354394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.354400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.354406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.354413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.354418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.354423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.354429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.354440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.354445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.354504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:27.367881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2563
2025-09-30T14:57:27.367942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2563
2025-09-30T14:57:27.365463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:27.366939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:27.366947Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:27.366950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:27.366954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:27.366964Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2563 [2:7555896508468657958:11730]
2025-09-30T14:57:27.366983Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:27.367004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:27.367009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:27.367013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:27.367016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:27.367039Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:27.367048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:27.367057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:27.367151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.367154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.367158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.367162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:27.367165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:27.367282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:27.367286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.367304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.367315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.367330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:27.367355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896508468657952:11730]
2025-09-30T14:57:27.367358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896508468657952:11730]
2025-09-30T14:57:27.367361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896508468657952:11730]
2025-09-30T14:57:27.367370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:27.367387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:27.367401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:27.367405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:27.367446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:27.367448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:27.367450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:27.367458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896508468657952:11730]
2025-09-30T14:57:27.367462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:27.367496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:27.367561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449415:2454], now have 1 active actors on pipe
2025-09-30T14:57:27.367564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449561:11241], now have 1 active actors on pipe
2025-09-30T14:57:27.369117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.369138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.369175Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81ddb218-55474300-f28ee631-82065f63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:27.369188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:27.369193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:27.369196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:27.369210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:27.369227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:27.369249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:27.372884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.372914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.372953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:27.373470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2564 partition: 0 MaxSeqNo: 42 sessionId: src_id|81ddb218-55474300-f28ee631-82065f63_0
2025-09-30T14:57:27.373938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa091e45-48412a2f-26870562-93240ef1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|81ddb218-55474300-f28ee631-82065f63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:27.376749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81ddb218-55474300-f28ee631-82065f63_0] Write session: try to update token
2025-09-30T14:57:27.376770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81ddb218-55474300-f28ee631-82065f63_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:27.385174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:27.385196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:27.385200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:27.385202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:27.385212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896508468657952:11730]
2025-09-30T14:57:27.385217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896508468657952:11730]
2025-09-30T14:57:27.385222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896508468657952:11730]
2025-09-30T14:57:27.385264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:27.385273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:27.385276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.385280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:27.385282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:27.385286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:27.385425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:27.393367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2564 sessionId: src_id|81ddb218-55474300-f28ee631-82065f63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:27.396827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:27.424728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896508558449583:10873]
2025-09-30T14:57:27.425184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2563, pipe: [1:7555896508558449583:10873]
2025-09-30T14:57:27.509761Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:27.510155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.510175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.510222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449583:10873], now have 1 active actors on pipe
2025-09-30T14:57:27.511280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ddb218-55474300-f28ee631-82065f63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:27.511293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ddb218-55474300-f28ee631-82065f63_0] Write session will restart in 0.006547s
2025-09-30T14:57:27.511319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ddb218-55474300-f28ee631-82065f63_0] Write session: Do CDS request
2025-09-30T14:57:27.511325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ddb218-55474300-f28ee631-82065f63_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:27.510562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:27.510664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896508558449583:10873]
2025-09-30T14:57:27.510702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:27.510706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:27.510808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2564 reason: error at write: Disconnected sessionId: src_id|81ddb218-55474300-f28ee631-82065f63_0
2025-09-30T14:57:27.511085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2564 sessionId: src_id|81ddb218-55474300-f28ee631-82065f63_0 is DEAD
2025-09-30T14:57:27.511485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:27.518835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81ddb218-55474300-f28ee631-82065f63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:27.518900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:27.518920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2565
2025-09-30T14:57:27.519084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2565 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:27.519118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2565 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:27.519123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2565 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:27.519127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:27.519586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2565 sessionId:  describe result for acl check
2025-09-30T14:57:27.519624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:27.519639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:27.519647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:27.519653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896508558449597:11246] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:27.520427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896508558449597:11246] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:27.522924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896508558449597:11246] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:27.526181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896508558449597:11246] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:27.526198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896508558449597:11246] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:27.526202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896508558449597:11246] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:27.526210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2565 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:27.531260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:27.534009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:27.534237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:27.534249Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:27.534260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:27.534327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:27.534369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896508468658137:11738]
2025-09-30T14:57:27.535028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:27.535405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:27.535451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:27.535784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:27.535865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.535873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.535874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.535875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.535877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.535877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.535878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.535880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.535881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.535882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.535883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.535884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.535885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.535886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.535887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.535892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.535902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.535906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.535910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.535914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.535918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.535922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.535926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.535930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.535935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.535939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.535943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.535946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.535950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.535954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.535962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.535970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.535975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.535980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.535985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.535990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.535994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.535998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.536005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.536010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.536014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.536020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.536024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.536029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.536032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.536037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.536042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.536046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.536051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.536056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.536060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.536066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.536070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.536076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.536083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.536088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.536092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.536097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.536100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.536105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.536147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:27.545397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2564
2025-09-30T14:57:27.545458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2564
2025-09-30T14:57:27.545847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2565 partition: 0 MaxSeqNo: 42 sessionId: src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0
2025-09-30T14:57:27.546234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81ddb218-55474300-f28ee631-82065f63_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:27.543808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:27.544868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:27.544877Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:27.544882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:27.544888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:27.544897Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2564 [2:7555896508468658137:11738]
2025-09-30T14:57:27.544918Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:27.544942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:27.544945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:27.544949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:27.544953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:27.544976Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:27.544985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:27.544996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:27.545104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.545108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.545111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.545116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:27.545120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:27.545244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:27.545249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.545270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.545281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.545296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:27.545317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449654:11246], now have 1 active actors on pipe
2025-09-30T14:57:27.545321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449585:2454], now have 1 active actors on pipe
2025-09-30T14:57:27.545328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896508468658130:11738]
2025-09-30T14:57:27.545331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896508468658130:11738]
2025-09-30T14:57:27.545334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896508468658130:11738]
2025-09-30T14:57:27.545351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:27.545364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:27.545367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:27.545368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:27.545371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:27.545382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:27.545387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:27.545432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896508468658130:11738]
2025-09-30T14:57:27.545436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:27.545439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:27.545454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.545460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.545512Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:27.545520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:27.545525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:27.545528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:27.545538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:27.545548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:27.545577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:27.545725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.545730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.545755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:27.549029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0] Write session: try to update token
2025-09-30T14:57:27.549049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:27.560599Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:27.560623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:27.560626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:27.560629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:27.560638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896508468658130:11738]
2025-09-30T14:57:27.560642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896508468658130:11738]
2025-09-30T14:57:27.560646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896508468658130:11738]
2025-09-30T14:57:27.560680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:27.560687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.560691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:27.560825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:27.563326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:27.563335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:27.563345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:27.565193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2565 sessionId: src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:27.567918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:27.611034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896508558449748:10873]
2025-09-30T14:57:27.615685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2564, pipe: [1:7555896508558449748:10873]
2025-09-30T14:57:27.674905Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:27.675407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.675426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.675468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449748:10873], now have 1 active actors on pipe
2025-09-30T14:57:27.675689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:27.676168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:27.676180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0] Write session will restart in 0.009286s
2025-09-30T14:57:27.676202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0] Write session: Do CDS request
2025-09-30T14:57:27.676207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:27.675701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:27.675729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:27.675793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2565 reason: error at write: Disconnected sessionId: src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0
2025-09-30T14:57:27.676005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2565 sessionId: src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0 is DEAD
2025-09-30T14:57:27.676018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:27.676061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896508558449748:10873]
2025-09-30T14:57:27.686817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:27.686905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:27.686922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2566
2025-09-30T14:57:27.687048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2566 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:27.687079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2566 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:27.687089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2566 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:27.687093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:27.688138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:27.687538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2566 sessionId:  describe result for acl check
2025-09-30T14:57:27.687572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:27.687574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:27.687576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:27.687582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896508558449865:11250] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:27.688099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896508558449865:11250] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:27.690030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:27.690194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:27.690202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:27.690210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:27.690245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:27.690273Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896508468658291:11741]
2025-09-30T14:57:27.690129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896508558449865:11250] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:27.690884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:27.691140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:27.691182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:27.691511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:27.691558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.691563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.691564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.691564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.691565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.691566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.691566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.691568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.691568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.691569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.691570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.691570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.691571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.691572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.691573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.691576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.691583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.691585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.691588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.691590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.691593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.691595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.691597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.691601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.691606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.691610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.691614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.691617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.691621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.691625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.691632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.691637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.691642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.691645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.691648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.691651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.691653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.691656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.691659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.691662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.691665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.691668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.691670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.691673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.691676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.691679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.691682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.691685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.691688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.691690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.691693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.691696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.691698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.691701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.691704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.691707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.691709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.691712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.691714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.691717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.691741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:27.692083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896508558449865:11250] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:27.692094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896508558449865:11250] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:27.692096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896508558449865:11250] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:27.692104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2566 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:27.697260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:27.698422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:27.698438Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:27.698440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:27.698444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:27.698451Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2565 [2:7555896508468658291:11741]
2025-09-30T14:57:27.698466Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:27.698482Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:27.698486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:27.698489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:27.698492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:27.698507Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:27.698519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:27.698525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:27.698597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.698604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.698607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.698610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:27.698613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:27.698684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:27.698693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.698705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.698723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.698746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:27.698768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449906:11250], now have 1 active actors on pipe
2025-09-30T14:57:27.698776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449749:2454], now have 1 active actors on pipe
2025-09-30T14:57:27.698782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896508468658286:11741]
2025-09-30T14:57:27.698789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896508468658286:11741]
2025-09-30T14:57:27.698792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896508468658286:11741]
2025-09-30T14:57:27.698807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:27.698822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:27.698827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:27.698831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:27.698834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:27.698844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:27.698848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:27.698882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896508468658286:11741]
2025-09-30T14:57:27.698890Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:27.698892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:27.698854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2565
2025-09-30T14:57:27.698854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2565
2025-09-30T14:57:27.698917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.698926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.698961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2853b009-19941190-a8c92460-da8594fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:27.698975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:27.698979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:27.698981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:27.698990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:27.698999Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:27.699024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:27.699146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.699154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.699166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:27.699232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2566 partition: 0 MaxSeqNo: 42 sessionId: src_id|2853b009-19941190-a8c92460-da8594fb_0
2025-09-30T14:57:27.699689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|931ea728-b2871e99-5f505d4f-6d8cd6d9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2853b009-19941190-a8c92460-da8594fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:27.702573Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2853b009-19941190-a8c92460-da8594fb_0] Write session: try to update token
2025-09-30T14:57:27.702593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2853b009-19941190-a8c92460-da8594fb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:27.711347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:27.711369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:27.711371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:27.711374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:27.711385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896508468658286:11741]
2025-09-30T14:57:27.711390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896508468658286:11741]
2025-09-30T14:57:27.711394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896508468658286:11741]
2025-09-30T14:57:27.711433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:27.711446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.711449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:27.711601Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:27.714632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:27.714652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:27.714657Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:27.722105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2566 sessionId: src_id|2853b009-19941190-a8c92460-da8594fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:27.724967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:27.775953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896508558449916:10873]
2025-09-30T14:57:27.776281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2565, pipe: [1:7555896508558449916:10873]
2025-09-30T14:57:27.825548Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:27.825968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.825982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.826003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449916:10873], now have 1 active actors on pipe
2025-09-30T14:57:27.826232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:27.826294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:27.826310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:27.826314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:27.826365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896508558449916:10873]
2025-09-30T14:57:27.826375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2566 reason: error at write: Disconnected sessionId: src_id|2853b009-19941190-a8c92460-da8594fb_0
2025-09-30T14:57:27.826556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2566 sessionId: src_id|2853b009-19941190-a8c92460-da8594fb_0 is DEAD
2025-09-30T14:57:27.827446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2853b009-19941190-a8c92460-da8594fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:27.827459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2853b009-19941190-a8c92460-da8594fb_0] Write session will restart in 0.006162s
2025-09-30T14:57:27.827482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2853b009-19941190-a8c92460-da8594fb_0] Write session: Do CDS request
2025-09-30T14:57:27.827491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2853b009-19941190-a8c92460-da8594fb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:27.834749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2853b009-19941190-a8c92460-da8594fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:27.835144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:27.835163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2567
2025-09-30T14:57:27.835348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2567 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:27.835396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2567 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:27.835416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2567 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:27.835422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:27.836110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2567 sessionId:  describe result for acl check
2025-09-30T14:57:27.836154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:27.836156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:27.836157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:27.836165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896508558449950:11255] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:27.836715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896508558449950:11255] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:27.839556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896508558449950:11255] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:27.842618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:27.842717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896508558449950:11255] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:27.842732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896508558449950:11255] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:27.842736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896508558449950:11255] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:27.842744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2567 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:27.845162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:27.845377Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:27.845387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:27.845399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:27.845463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:27.845498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896508468658448:11743]
2025-09-30T14:57:27.846131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:27.846433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:27.846481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:27.846807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:27.846881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.846889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.846890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.846891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.846892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.846894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.846895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.846896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.846897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.846898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.846899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.846900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.846902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.846903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.846904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.846909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.846919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.846922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.846926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.846930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.846934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.846937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.846941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.846945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.846949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.846952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.846956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.846959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.846963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.846966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.846974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.846982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:27.846987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.846992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:27.846996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.847000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:27.847004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.847009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:27.847014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.847018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:27.847022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.847027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:27.847033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.847038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:27.847042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.847046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:27.847051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.847056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:27.847060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.847066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:27.847070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.847075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.847080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.847084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.847088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.847093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.847097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.847102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:27.847106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.847111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:27.847151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:27.852659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:27.853785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:27.853805Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:27.853808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:27.853812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:27.853818Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2566 [2:7555896508468658448:11743]
2025-09-30T14:57:27.853833Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:27.853846Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:27.853854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:27.853857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:27.853859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:27.853874Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:27.853886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:27.853892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:27.853958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.853965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.853968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.853972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:27.853974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:27.854043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:27.854050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.854065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:27.854082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:27.854104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:27.854125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558450069:11255], now have 1 active actors on pipe
2025-09-30T14:57:27.854133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558449917:2454], now have 1 active actors on pipe
2025-09-30T14:57:27.854139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896508468658442:11743]
2025-09-30T14:57:27.854141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896508468658442:11743]
2025-09-30T14:57:27.854143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896508468658442:11743]
2025-09-30T14:57:27.854155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:27.854171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:27.854190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:27.854197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:27.854202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2566
2025-09-30T14:57:27.854208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2566
2025-09-30T14:57:27.854220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:27.854225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896508468658442:11743]
2025-09-30T14:57:27.854228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:27.854231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:27.854234Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:27.854241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:27.854302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.854307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.854335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:27.854343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:27.854347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:27.854350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:27.854358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:27.854367Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:27.854382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:27.854525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.854533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.854546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:27.854663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2567 partition: 0 MaxSeqNo: 42 sessionId: src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0
2025-09-30T14:57:27.855004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2853b009-19941190-a8c92460-da8594fb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:27.857791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0] Write session: try to update token
2025-09-30T14:57:27.857815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:27.866510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:27.866535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:27.866547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896508468658442:11743]
2025-09-30T14:57:27.866592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:27.866596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:27.866775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:27.866922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:27.867066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:27.867213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:27.867477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:27.867514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:27.876891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2567 sessionId: src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:27.879571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:27.879805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:27.879829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:27.879867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:27.880009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:27.881205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:27.881219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:27.881222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:27.881224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:27.881238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896508468658442:11743]
2025-09-30T14:57:27.881242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896508468658442:11743]
2025-09-30T14:57:27.881246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896508468658442:11743]
2025-09-30T14:57:27.881284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:27.881291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:27.881295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:27.881297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:27.881304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:27.881309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:27.881446Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:27.925358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896508558450082:10873]
2025-09-30T14:57:27.925697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2566, pipe: [1:7555896508558450082:10873]
2025-09-30T14:57:27.999403Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:28.007932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.007964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.008142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:28.008199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:28.008265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:28.008331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:28.008536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:28.008542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:28.008618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:28.008676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:28.008746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:28.008815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:28.008856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:28.008862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:28.008940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:28.009002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:28.009086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:28.009148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:28.009190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:28.009193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:28.009269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:28.009339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:28.009411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:28.009478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:28.009515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:28.009521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:28.009591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:28.009649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:28.009712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:28.009772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:28.009814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:28.009817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:28.009889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:28.009949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:28.010011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:28.010072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:28.010116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:28.010122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:28.010202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:28.010266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:28.010334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:28.010398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:28.010447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:28.010451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:28.010526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:28.010590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:28.010651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:28.010714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:28.010756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:28.010759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:28.010844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:28.010906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:28.010967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:28.011030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:28.011071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:28.011074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:28.011146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:28.011206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:28.011364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:28.011435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:28.011483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:28.011486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:28.014469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:28.014486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:28.014527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2567 reason: error at write: Disconnected sessionId: src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0
2025-09-30T14:57:28.014707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2567 sessionId: src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0 is DEAD
2025-09-30T14:57:28.014774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896508558450082:10873]
2025-09-30T14:57:28.014807Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:28.014863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:28.014874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0] Write session will restart in 0.005553s
2025-09-30T14:57:28.014900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0] Write session: Do CDS request
2025-09-30T14:57:28.014905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:28.011561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896508558450082:10873], now have 1 active actors on pipe
2025-09-30T14:57:28.014427Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:28.022822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:28.025357Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:28.025379Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2568
2025-09-30T14:57:28.025577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2568 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:28.025625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2568 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:28.025631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2568 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:28.025635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:28.026220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2568 sessionId:  describe result for acl check
2025-09-30T14:57:28.026252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:28.026257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:28.026259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:28.026265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896512853417388:11259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:28.026807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896512853417388:11259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:28.030451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896512853417388:11259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:28.033246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896512853417388:11259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:28.033262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896512853417388:11259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:28.033265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896512853417388:11259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:28.033273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2568 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:28.043330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:28.046673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:28.046884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:28.046888Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:28.046899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:28.046959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:28.046997Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896512763625903:11746]
2025-09-30T14:57:28.047703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:28.048043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:28.048086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:28.048437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:28.048497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.048498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.048500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.048501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.048502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.048504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.048506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.048507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.048508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.048510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.048511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.048513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.048514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.048516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.048517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.048523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.048534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.048539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.048544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.048549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.048553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.048558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.048562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.048566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.048571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.048576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.048580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.048585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.048589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.048594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.048604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.048613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.048621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.048627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.048633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.048639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.048644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.048650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.048655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.048661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.048665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.048671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.048677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.048683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.048688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.048695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.048700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.048706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.048711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.048719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.048726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.048732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.048737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.048742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.048747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.048753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.048758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.048763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.048768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.048774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.048820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:28.055022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:28.056728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2567
2025-09-30T14:57:28.056761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2567
2025-09-30T14:57:28.057716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2568 partition: 0 MaxSeqNo: 42 sessionId: src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0
2025-09-30T14:57:28.056288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:28.056306Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:28.056309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:28.056313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:28.056320Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2567 [2:7555896512763625903:11746]
2025-09-30T14:57:28.056338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:28.056354Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:28.056358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:28.056361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:28.056364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:28.056380Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:28.056387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:28.056394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:28.056450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.056453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.056455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.056458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:28.056461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:28.056537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:28.056541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.056555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.056569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.056588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:28.056607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853417429:11259], now have 1 active actors on pipe
2025-09-30T14:57:28.059376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54a5ad21-840fd060-c428667b-19cc2ce8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:28.062203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0] Write session: try to update token
2025-09-30T14:57:28.062221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:28.056612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853417380:2454], now have 1 active actors on pipe
2025-09-30T14:57:28.056618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896512763625898:11746]
2025-09-30T14:57:28.056620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896512763625898:11746]
2025-09-30T14:57:28.056622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896512763625898:11746]
2025-09-30T14:57:28.056638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:28.056652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:28.056667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:28.056671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:28.056703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896512763625898:11746]
2025-09-30T14:57:28.056707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:28.056982Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:28.056985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:28.056987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:28.056993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:28.057126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.057132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.057172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:28.057183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:28.057187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:28.057190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:28.057200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:28.057212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:28.057226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:28.057464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.057468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.057481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:28.071968Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:28.071993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:28.071996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:28.071998Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:28.072006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896512763625898:11746]
2025-09-30T14:57:28.072010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896512763625898:11746]
2025-09-30T14:57:28.072015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896512763625898:11746]
2025-09-30T14:57:28.072053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:28.072063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.072064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:28.072066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:28.072069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:28.072073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:28.072202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:28.084173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2568 sessionId: src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:28.086880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:28.114894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896512853417546:10873]
2025-09-30T14:57:28.115319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2567, pipe: [1:7555896512853417546:10873]
2025-09-30T14:57:28.204722Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:28.205129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.205146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.205168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853417546:10873], now have 1 active actors on pipe
2025-09-30T14:57:28.205409Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:28.205400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896512853417546:10873]
2025-09-30T14:57:28.205418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:28.205423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:28.205444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:28.205497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2568 reason: error at write: Disconnected sessionId: src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0
2025-09-30T14:57:28.205691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2568 sessionId: src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0 is DEAD
2025-09-30T14:57:28.207555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:28.207567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0] Write session will restart in 0.005442s
2025-09-30T14:57:28.207590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0] Write session: Do CDS request
2025-09-30T14:57:28.207599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:28.216255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:28.216437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:28.216455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2569
2025-09-30T14:57:28.216566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2569 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:28.216598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2569 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:28.216609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2569 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:28.216619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:28.217158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2569 sessionId:  describe result for acl check
2025-09-30T14:57:28.217195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:28.217198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:28.217200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:28.217207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896512853417671:11266] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:28.217754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896512853417671:11266] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:28.218351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:28.219653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896512853417671:11266] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:28.220652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:28.220850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:28.220861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:28.220871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:28.220920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:28.220958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896512763626072:11749]
2025-09-30T14:57:28.221529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:28.221838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:28.221881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:28.222141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:28.222200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.222209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.222211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.222212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.222213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.222215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.222216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.222217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.222219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.222220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.222221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.222223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.222224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.222225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.222227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.222232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.222243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.222247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.222252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.222256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.222260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.222265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.222269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.222273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.222276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.222278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.222280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.222283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.222285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.222287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.222292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.222297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.222302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.222305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.222308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.222311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.222314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.222317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.222321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.222325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.222329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.222332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.222335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.222338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.222340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.222343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.222346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.222350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.222354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.222359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.222364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.222368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.222371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.222376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.222380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.222385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.222388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.222393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.222397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.222401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.222440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:28.222652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896512853417671:11266] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:28.222669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896512853417671:11266] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:28.222673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896512853417671:11266] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:28.222681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2569 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:28.227803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:28.229023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:28.229042Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:28.229045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:28.229050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:28.229057Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2568 [2:7555896512763626072:11749]
2025-09-30T14:57:28.229088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:28.229105Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:28.229113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:28.229116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:28.229119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:28.229134Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:28.229146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:28.229153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:28.229213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.229220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.229225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.229228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:28.229231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:28.229302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:28.229313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.229325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.229335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.229351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:28.229370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853417712:11266], now have 1 active actors on pipe
2025-09-30T14:57:28.229382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853417553:2454], now have 1 active actors on pipe
2025-09-30T14:57:28.229389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896512763626067:11749]
2025-09-30T14:57:28.229391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896512763626067:11749]
2025-09-30T14:57:28.229393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896512763626067:11749]
2025-09-30T14:57:28.229407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:28.229418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:28.229421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:28.229428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:28.229430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:28.229434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:28.229439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:28.229467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2568
2025-09-30T14:57:28.229470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2568
2025-09-30T14:57:28.229475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896512763626067:11749]
2025-09-30T14:57:28.229487Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:28.229520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:28.230095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2569 partition: 0 MaxSeqNo: 42 sessionId: src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0
2025-09-30T14:57:28.230522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c977f250-b9e2fe4f-350cea58-99dfcb12_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:28.229623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.229638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.229667Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:28.229674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:28.229678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:28.229680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:28.229694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:28.229704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:28.229719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:28.229907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.229913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.229935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:28.233375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0] Write session: try to update token
2025-09-30T14:57:28.233393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:28.243153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:28.243172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:28.243181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896512763626067:11749]
2025-09-30T14:57:28.243227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:28.243234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:28.243412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:28.243542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:28.243682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:28.243824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:28.244037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:28.244078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:28.254468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:28.254487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:28.254489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:28.254491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:28.254504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896512763626067:11749]
2025-09-30T14:57:28.254508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896512763626067:11749]
2025-09-30T14:57:28.254512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896512763626067:11749]
2025-09-30T14:57:28.254549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:28.254560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:28.254566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.254568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:28.254573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:28.254577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:28.254722Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:28.253694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2569 sessionId: src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:28.256518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:28.305338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896512853417735:10873]
2025-09-30T14:57:28.305822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2568, pipe: [1:7555896512853417735:10873]
2025-09-30T14:57:28.380970Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:28.381294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.381303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.381322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853417735:10873], now have 1 active actors on pipe
2025-09-30T14:57:28.381680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:28.381701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:28.381775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2569 reason: error at write: Disconnected sessionId: src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0
2025-09-30T14:57:28.381789Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:28.381966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2569 sessionId: src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0 is DEAD
2025-09-30T14:57:28.382131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896512853417735:10873]
2025-09-30T14:57:28.382145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:28.387555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:28.387568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0] Write session will restart in 0.009578s
2025-09-30T14:57:28.387590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0] Write session: Do CDS request
2025-09-30T14:57:28.387596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:28.398763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:28.398897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:28.398917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2570
2025-09-30T14:57:28.399444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2570 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:28.399489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2570 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:28.399494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2570 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:28.399498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:28.399984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2570 sessionId:  describe result for acl check
2025-09-30T14:57:28.400020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:28.400023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:28.400024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:28.400030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896512853417770:11277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:28.400564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896512853417770:11277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:28.408048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896512853417770:11277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:28.414013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896512853417770:11277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:28.414041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896512853417770:11277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:28.414045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896512853417770:11277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:28.414055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2570 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:28.414470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:28.416667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:28.416920Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:28.416930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:28.416940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:28.416998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:28.417030Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896512763626245:11757]
2025-09-30T14:57:28.417534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:28.417922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:28.417994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:28.418381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:28.418462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.418469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.418471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.418472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.418474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.418475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.418477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.418478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.418480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.418481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.418482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.418484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.418485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.418487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.418488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.418495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.418506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.418511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.418516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.418521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.418526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.418530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.418535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.418540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.418548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.418553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.418557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.418562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.418566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.418570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.418579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.418587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.418626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.418639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.418644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.418651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.418656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.418662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.418675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.418686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.418691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.418700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.418711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.418718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.418722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.418729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.418740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.418746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.418753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.418760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.418765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.418771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.418777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.418783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.418788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.418802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.418807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.418813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.418818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.418824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.418874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:28.428553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:28.429636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:28.429652Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:28.429655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:28.429660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:28.429667Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2569 [2:7555896512763626245:11757]
2025-09-30T14:57:28.429682Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:28.429697Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:28.429701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:28.429704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:28.429707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:28.429724Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:28.429731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:28.429743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:28.429802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.429810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.429812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.429816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:28.429818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:28.429885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:28.429894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.429908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.430009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2569
2025-09-30T14:57:28.429927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.429951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:28.429971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853417908:11277], now have 1 active actors on pipe
2025-09-30T14:57:28.429976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853417753:2454], now have 1 active actors on pipe
2025-09-30T14:57:28.429983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896512763626239:11757]
2025-09-30T14:57:28.429985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896512763626239:11757]
2025-09-30T14:57:28.429987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896512763626239:11757]
2025-09-30T14:57:28.430001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:28.430014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:28.430014Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:28.430017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:28.430019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:28.430029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:28.430032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:28.430070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896512763626239:11757]
2025-09-30T14:57:28.430073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:28.430075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:28.430090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.430094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.430141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eab41318-3015ed94-e752546c-4f59c78c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:28.430149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:28.430155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:28.430158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:28.430168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:28.430177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:28.430194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:28.430479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2569
2025-09-30T14:57:28.430558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.430572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.430592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:28.430654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2570 partition: 0 MaxSeqNo: 42 sessionId: src_id|eab41318-3015ed94-e752546c-4f59c78c_0
2025-09-30T14:57:28.431009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c1b6fa4-d2c2d465-469ca42e-35c18412_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eab41318-3015ed94-e752546c-4f59c78c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:28.433835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab41318-3015ed94-e752546c-4f59c78c_0] Write session: try to update token
2025-09-30T14:57:28.433855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab41318-3015ed94-e752546c-4f59c78c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:28.444048Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:28.444066Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:28.444068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:28.444070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:28.444080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896512763626239:11757]
2025-09-30T14:57:28.444084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896512763626239:11757]
2025-09-30T14:57:28.444089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896512763626239:11757]
2025-09-30T14:57:28.444129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:28.444137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:28.444139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.444142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:28.444144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:28.444149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:28.444279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:28.452208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2570 sessionId: src_id|eab41318-3015ed94-e752546c-4f59c78c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:28.455203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:28.482020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896512853417930:10873]
2025-09-30T14:57:28.482315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2569, pipe: [1:7555896512853417930:10873]
2025-09-30T14:57:28.560757Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:28.561189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.561210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.561256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853417930:10873], now have 1 active actors on pipe
2025-09-30T14:57:28.561624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:28.561639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:28.561644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:28.561684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896512853417930:10873]
2025-09-30T14:57:28.561709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2570 reason: error at write: Disconnected sessionId: src_id|eab41318-3015ed94-e752546c-4f59c78c_0
2025-09-30T14:57:28.561886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2570 sessionId: src_id|eab41318-3015ed94-e752546c-4f59c78c_0 is DEAD
2025-09-30T14:57:28.562040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab41318-3015ed94-e752546c-4f59c78c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:28.562051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab41318-3015ed94-e752546c-4f59c78c_0] Write session will restart in 0.005972s
2025-09-30T14:57:28.562076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab41318-3015ed94-e752546c-4f59c78c_0] Write session: Do CDS request
2025-09-30T14:57:28.562081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab41318-3015ed94-e752546c-4f59c78c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:28.562101Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:28.571760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab41318-3015ed94-e752546c-4f59c78c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:28.571904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:28.571923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2571
2025-09-30T14:57:28.572077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2571 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:28.572108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2571 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:28.572113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2571 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:28.572117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:28.572582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2571 sessionId:  describe result for acl check
2025-09-30T14:57:28.572623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:28.572625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:28.572628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:28.572633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896512853417962:11282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:28.573205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896512853417962:11282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:28.576692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896512853417962:11282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:28.577780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:28.580112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:28.580317Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:28.580329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:28.580340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:28.580394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:28.580449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896512763626428:11766]
2025-09-30T14:57:28.580576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896512853417962:11282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:28.580608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896512853417962:11282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:28.580612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896512853417962:11282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:28.580621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2571 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:28.581135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:28.581464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:28.581523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:28.581889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:28.581976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.581978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.581979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.581980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.581981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.581982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.581983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.581984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.581985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.581987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.581988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.581989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.581990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.581991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.581993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.581999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.582008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.582012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.582016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.582020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.582024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.582028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.582031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.582035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.582039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.582042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.582046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.582049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.582054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.582058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.582068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.582077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.582083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.582089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.582093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.582098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.582103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.582109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.582118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.582123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.582128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.582134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.582139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.582145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.582164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.582169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.582174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.582179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.582183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.582189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.582193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.582204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.582208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.582213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.582218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.582227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.582232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.582237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.582242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.582247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.582295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:28.587984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:28.588893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:28.588908Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:28.588911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:28.588915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:28.588922Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2570 [2:7555896512763626428:11766]
2025-09-30T14:57:28.588939Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:28.588954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:28.588962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:28.588965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:28.588967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:28.588984Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:28.588991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:28.588999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:28.589081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.589090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.589093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.589097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:28.589099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:28.589166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:28.589174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.589187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.589204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.589230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:28.589253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853417932:2454], now have 1 active actors on pipe
2025-09-30T14:57:28.589264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853418090:11282], now have 1 active actors on pipe
2025-09-30T14:57:28.589270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896512763626423:11766]
2025-09-30T14:57:28.589272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896512763626423:11766]
2025-09-30T14:57:28.589275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896512763626423:11766]
2025-09-30T14:57:28.589289Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:28.589303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:28.589317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:28.589317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:28.589321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:28.589323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:28.589325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:28.589363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896512763626423:11766]
2025-09-30T14:57:28.589366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:28.589371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:28.589342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2570
2025-09-30T14:57:28.589396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2570
2025-09-30T14:57:28.589502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.589518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.589547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:28.589561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:28.589565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:28.589568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:28.589580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:28.589597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:28.589617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:28.589790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.589799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.589822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:28.589923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2571 partition: 0 MaxSeqNo: 42 sessionId: src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0
2025-09-30T14:57:28.590311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab41318-3015ed94-e752546c-4f59c78c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:28.593170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0] Write session: try to update token
2025-09-30T14:57:28.593190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:28.601701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:28.601725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:28.601735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896512763626423:11766]
2025-09-30T14:57:28.601780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:28.601781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:28.601958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:28.602097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:28.602229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:28.602363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:28.602548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:28.602587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:28.609535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2571 sessionId: src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:28.612206Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:28.614003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.614027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.614047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:28.614050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:28.614052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:28.614054Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:28.614064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896512763626423:11766]
2025-09-30T14:57:28.614067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896512763626423:11766]
2025-09-30T14:57:28.614074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896512763626423:11766]
2025-09-30T14:57:28.614122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:28.614130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:28.614133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.614136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:28.614137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:28.614140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:28.614280Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:28.661688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896512853418101:10873]
2025-09-30T14:57:28.662011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2570, pipe: [1:7555896512853418101:10873]
2025-09-30T14:57:28.732774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:28.733235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:28.733275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853418101:10873], now have 1 active actors on pipe
2025-09-30T14:57:28.733388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:28.733705Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:28.733751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896512853418101:10873]
2025-09-30T14:57:28.747123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:28.747139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0] Write session will restart in 0.009606s
2025-09-30T14:57:28.747173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0] Write session: Do CDS request
2025-09-30T14:57:28.747179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:28.746782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:28.746797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:28.746825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2571 reason: error at write: Disconnected sessionId: src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0
2025-09-30T14:57:28.746973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2571 sessionId: src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0 is DEAD
2025-09-30T14:57:28.757942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:28.758055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:28.758076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2572
2025-09-30T14:57:28.759451Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2572 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:28.759493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2572 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:28.759499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2572 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:28.759504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:28.759909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2572 sessionId:  describe result for acl check
2025-09-30T14:57:28.759945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:28.759949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:28.759953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:28.759958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896512853418217:11287] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:28.760497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896512853418217:11287] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:28.762245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:28.763852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896512853418217:11287] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:28.764311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:28.764493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:28.764503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:28.764512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:28.764559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:28.764590Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896512763626589:11768]
2025-09-30T14:57:28.765257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:28.765590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:28.765637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:28.765964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:28.766026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.766033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.766035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.766036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.766038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.766039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.766041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.766042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.766043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.766045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.766046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.766047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.766049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.766050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.766051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.766057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.766068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.766073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.766078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.766082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.766087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.766091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.766096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.766100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.766105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.766110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.766114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.766118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.766122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.766127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.766136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.766145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.766152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.766158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.766163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.766169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.766179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.766184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.766194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.766200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.766209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.766214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.766224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.766229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.766239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.766245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.766250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.766260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.766271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.766277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.766282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.766288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.766293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.766299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.766308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.766314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.766323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.766329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.766340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.766345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.766394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:28.767131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896512853418217:11287] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:28.767147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896512853418217:11287] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:28.767150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896512853418217:11287] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:28.767159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2572 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:28.771898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:28.772849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:28.772866Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:28.772869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:28.772874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:28.772881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2571 [2:7555896512763626589:11768]
2025-09-30T14:57:28.772897Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:28.772928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:28.772935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:28.772939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:28.772942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:28.772958Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:28.772965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:28.772973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:28.773039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.773048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.773051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.773067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:28.773070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:28.773367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:28.773378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.773392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.773407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.773432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:28.773454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896512763626584:11768]
2025-09-30T14:57:28.773461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896512763626584:11768]
2025-09-30T14:57:28.773464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896512763626584:11768]
2025-09-30T14:57:28.773480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:28.773499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:28.773519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:28.773527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:28.773538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:28.773549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:28.773555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:28.773557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896512763626584:11768]
2025-09-30T14:57:28.773561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:28.773630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:28.773730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2571
2025-09-30T14:57:28.773761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2571
2025-09-30T14:57:28.773831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853418267:11287], now have 1 active actors on pipe
2025-09-30T14:57:28.773842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853418105:2454], now have 1 active actors on pipe
2025-09-30T14:57:28.773861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.773872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.773900Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:28.773912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:28.773921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:28.773923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:28.773935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:28.773950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:28.773970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:28.774276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.774285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.774301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:28.774406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2572 partition: 0 MaxSeqNo: 42 sessionId: src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0
2025-09-30T14:57:28.774811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d4aa23-c71ea2b8-4ff428e-226aa115_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:28.777618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0] Write session: try to update token
2025-09-30T14:57:28.777637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:28.787110Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:28.787133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:28.787135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:28.787138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:28.787149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896512763626584:11768]
2025-09-30T14:57:28.787154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896512763626584:11768]
2025-09-30T14:57:28.787158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896512763626584:11768]
2025-09-30T14:57:28.787202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:28.787210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.787213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:28.787220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:28.787237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:28.787257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:28.787381Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:28.801041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2572 sessionId: src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:28.803812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:28.833737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896512853418275:10873]
2025-09-30T14:57:28.834001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2571, pipe: [1:7555896512853418275:10873]
2025-09-30T14:57:28.914420Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:28.914853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.914863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.914883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853418275:10873], now have 1 active actors on pipe
2025-09-30T14:57:28.915115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:28.915334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896512853418275:10873]
2025-09-30T14:57:28.915373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:28.915443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2572 reason: status is not ok: tablet will be restarted right now sessionId: src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0
2025-09-30T14:57:28.915504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:28.915604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2572 sessionId: src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0 is DEAD
2025-09-30T14:57:28.915953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:28.915965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0] Write session will restart in 0.008998s
2025-09-30T14:57:28.915987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0] Write session: Do CDS request
2025-09-30T14:57:28.915993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:28.927694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:28.928030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:28.928046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2573
2025-09-30T14:57:28.931447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2573 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:28.931506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2573 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:28.931511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2573 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:28.931517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:28.931940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2573 sessionId:  describe result for acl check
2025-09-30T14:57:28.931966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:28.931968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:28.931970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:28.931975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896512853418288:11291] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:28.932518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896512853418288:11291] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:28.939460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896512853418288:11291] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:28.943316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896512853418288:11291] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:28.943333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896512853418288:11291] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:28.943337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896512853418288:11291] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:28.943346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2573 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:28.964410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:28.966319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:28.966551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:28.966554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:28.966565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:28.966612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:28.966656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896512763626751:11770]
2025-09-30T14:57:28.967234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:28.967578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:28.967624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:28.967935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:28.968010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.968016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.968017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.968018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.968020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.968021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.968023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.968024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.968025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.968026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.968027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.968028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.968030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.968031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.968032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.968039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.968051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.968056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.968061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.968066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.968070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.968075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.968079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.968084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.968089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.968093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.968098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.968102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.968111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.968115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.968124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.968136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:28.968144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.968150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:28.968158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.968163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:28.968167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.968172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:28.968176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.968182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:28.968187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.968192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:28.968197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.968202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:28.968207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.968213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:28.968219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.968225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:28.968230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.968236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:28.968259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.968271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.968278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.968284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.968289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.968294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.968298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.968303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:28.968307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.968312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:28.968357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:28.973730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:28.974745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:28.974766Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:28.974768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:28.974772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:28.974778Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2572 [2:7555896512763626751:11770]
2025-09-30T14:57:28.974795Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:28.974810Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:28.974819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:28.974822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:28.974825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:28.974841Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:28.974852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:28.974868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:28.974933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.974940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.974942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.974945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:28.974948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:28.975448Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2572
2025-09-30T14:57:28.975467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2572
2025-09-30T14:57:28.975015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:28.975022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.975034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:28.975046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:28.975061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:28.975079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896512763626745:11770]
2025-09-30T14:57:28.975081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896512763626745:11770]
2025-09-30T14:57:28.975083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896512763626745:11770]
2025-09-30T14:57:28.975094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:28.975104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:28.975107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:28.975109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:28.975109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853418277:2454], now have 1 active actors on pipe
2025-09-30T14:57:28.975115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:28.975127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:28.975130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:28.975136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896512853418323:11291], now have 1 active actors on pipe
2025-09-30T14:57:28.975164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896512763626745:11770]
2025-09-30T14:57:28.975172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:28.975182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:28.975616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.975622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.975648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:28.975656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:28.975661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:28.975672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:28.975683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:28.975694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:28.975709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:28.975934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:28.975943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:28.975957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:28.976058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2573 partition: 0 MaxSeqNo: 42 sessionId: src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0
2025-09-30T14:57:28.976425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|692ea0ed-10c8663b-ac49d53d-89cd8cf2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:28.979152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0] Write session: try to update token
2025-09-30T14:57:28.979167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:28.987684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:28.987709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:28.987712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:28.987714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:28.987724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896512763626745:11770]
2025-09-30T14:57:28.987732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896512763626745:11770]
2025-09-30T14:57:28.987736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896512763626745:11770]
2025-09-30T14:57:28.987783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:28.987791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:28.987794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:28.987797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:28.987803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:28.987807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:28.987929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:29.005359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2573 sessionId: src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:29.008073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:29.014965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896517148385744:10873]
2025-09-30T14:57:29.015591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2572, pipe: [1:7555896517148385744:10873]
2025-09-30T14:57:29.103777Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:29.104155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.104169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.104207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148385744:10873], now have 1 active actors on pipe
2025-09-30T14:57:29.104442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:29.104482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:29.104547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:29.104549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:29.104622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2573 reason: error at write: Disconnected sessionId: src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0
2025-09-30T14:57:29.104804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2573 sessionId: src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0 is DEAD
2025-09-30T14:57:29.104839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896517148385744:10873]
2025-09-30T14:57:29.107446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:29.107458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0] Write session will restart in 0.005464s
2025-09-30T14:57:29.107483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0] Write session: Do CDS request
2025-09-30T14:57:29.107492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:29.113778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:29.115387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:29.115408Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2574
2025-09-30T14:57:29.115558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2574 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:29.115584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2574 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:29.115589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2574 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:29.115594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:29.115997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2574 sessionId:  describe result for acl check
2025-09-30T14:57:29.116022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:29.116024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:29.116026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:29.116032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896517148385814:11295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:29.116573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896517148385814:11295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:29.120693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896517148385814:11295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:29.123661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896517148385814:11295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:29.123677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896517148385814:11295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:29.123681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896517148385814:11295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:29.123690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2574 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:29.132757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:29.139731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:29.140048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:29.140064Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:29.140076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:29.140141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:29.140186Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896517058594223:11774]
2025-09-30T14:57:29.140851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:29.141273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:29.141311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:29.141636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:29.141694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.141696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.141698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.141699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.141701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.141702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.141703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.141705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.141706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.141708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.141709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.141711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.141712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.141713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.141714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.141720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.141731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.141737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.141741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.141746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.141751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.141755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.141760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.141764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.141769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.141774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.141778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.141783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.141787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.141791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.141800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.141809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.141816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.141822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.141827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.141833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.141838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.141844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.141850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.141855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.141860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.141866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.141872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.141878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.141883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.141889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.141895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.141901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.141916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.141922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.141927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.141933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.141937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.141943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.141948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.141953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.141958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.141964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.141970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.141976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.142027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:29.149487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:29.150546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:29.150562Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:29.150565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:29.150569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:29.150576Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2573 [2:7555896517058594223:11774]
2025-09-30T14:57:29.150594Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:29.150609Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:29.150614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:29.150618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:29.150620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:29.150636Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:29.150642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:29.150649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:29.150712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.150715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.150717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.150721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:29.150724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:29.150797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:29.150809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.150824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.150842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.150866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:29.150888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896517058594217:11774]
2025-09-30T14:57:29.150890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896517058594217:11774]
2025-09-30T14:57:29.150892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896517058594217:11774]
2025-09-30T14:57:29.150906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:29.150920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:29.150936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:29.150939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:29.150978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896517058594217:11774]
2025-09-30T14:57:29.150980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:29.151073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:29.151080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:29.151082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:29.151087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:29.151537Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2573
2025-09-30T14:57:29.151587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2573
2025-09-30T14:57:29.152566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148385747:2454], now have 1 active actors on pipe
2025-09-30T14:57:29.152582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148385898:11295], now have 1 active actors on pipe
2025-09-30T14:57:29.152597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.152604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.152634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:29.152644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:29.152657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:29.152664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:29.152676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:29.152690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:29.152706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:29.153158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.153170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.153187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:29.153339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2574 partition: 0 MaxSeqNo: 42 sessionId: src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0
2025-09-30T14:57:29.153711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d62eed4a-8702bce6-c70d4c87-efb378d3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:29.156591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0] Write session: try to update token
2025-09-30T14:57:29.156609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:29.168191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:29.168214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:29.168216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:29.168219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:29.168228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896517058594217:11774]
2025-09-30T14:57:29.168234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896517058594217:11774]
2025-09-30T14:57:29.168239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896517058594217:11774]
2025-09-30T14:57:29.168282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:29.168290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.168293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:29.168435Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:29.172551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:29.172570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:29.172575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:29.176224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2574 sessionId: src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:29.178856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:29.205011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896517148385920:10873]
2025-09-30T14:57:29.206352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2573, pipe: [1:7555896517148385920:10873]
2025-09-30T14:57:29.301488Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:29.301881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.301898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.301940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148385920:10873], now have 1 active actors on pipe
2025-09-30T14:57:29.302221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:29.302250Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896517148385920:10873]
2025-09-30T14:57:29.302266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:29.302298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:29.302301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:29.302373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2574 reason: error at write: Disconnected sessionId: src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0
2025-09-30T14:57:29.302549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2574 sessionId: src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0 is DEAD
2025-09-30T14:57:29.302696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:29.302711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0] Write session will restart in 0.007171s
2025-09-30T14:57:29.302735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0] Write session: Do CDS request
2025-09-30T14:57:29.302744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:29.313958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:29.314191Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:29.314211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2575
2025-09-30T14:57:29.314497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2575 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:29.314530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2575 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:29.314541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2575 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:29.314546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:29.314962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2575 sessionId:  describe result for acl check
2025-09-30T14:57:29.314999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:29.315001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:29.315002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:29.315009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896517148385996:11301] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:29.315575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896517148385996:11301] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:29.319867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896517148385996:11301] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:29.323074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896517148385996:11301] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:29.323092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896517148385996:11301] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:29.323096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896517148385996:11301] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:29.323105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2575 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:29.324161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:29.324677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:29.324964Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:29.324970Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:29.324980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:29.325038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:29.325088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896517058594386:11776]
2025-09-30T14:57:29.325766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:29.327093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:29.327156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:29.327541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:29.327618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.327625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.327626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.327627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.327629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.327630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.327631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.327632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.327633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.327634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.327636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.327637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.327638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.327639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.327640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.327647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.327657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.327661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.327666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.327669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.327673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.327676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.327679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.327683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.327687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.327690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.327693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.327697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.327700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.327703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.327713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.327722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.327728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.327733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.327739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.327743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.327749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.327754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.327759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.327763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.327769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.327773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.327778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.327783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.327789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.327793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.327799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.327803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.327807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.327811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.327816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.327820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.327823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.327827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.327837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.327843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.327853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.327858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.327863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.327867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.327908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:29.334177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:29.335290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:29.335312Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:29.335315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:29.335320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:29.335329Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2574 [2:7555896517058594386:11776]
2025-09-30T14:57:29.335349Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:29.335367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:29.335377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:29.335381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:29.335384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:29.335401Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:29.335412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:29.335423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:29.335487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.335494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.335497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.335500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:29.335503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:29.335580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:29.335587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.335600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.335616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.335638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:29.335661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148385938:2454], now have 1 active actors on pipe
2025-09-30T14:57:29.335669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148386099:11301], now have 1 active actors on pipe
2025-09-30T14:57:29.335676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896517058594381:11776]
2025-09-30T14:57:29.335682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896517058594381:11776]
2025-09-30T14:57:29.335685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896517058594381:11776]
2025-09-30T14:57:29.335699Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:29.335717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:29.335725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:29.335735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:29.335739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:29.335739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:29.335741Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:29.335798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896517058594381:11776]
2025-09-30T14:57:29.335813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:29.335854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:29.335821Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2574
2025-09-30T14:57:29.335823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2574
2025-09-30T14:57:29.335998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.336008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.336035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:29.336047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:29.336051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:29.336053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:29.336063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:29.336078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:29.336092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:29.336816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.336840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.336865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:29.337160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2575 partition: 0 MaxSeqNo: 42 sessionId: src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0
2025-09-30T14:57:29.337600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acc3d044-8cf36d38-b154067c-ba4d1ec4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:29.340548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0] Write session: try to update token
2025-09-30T14:57:29.340570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:29.352689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:29.352712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:29.352714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:29.352717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:29.352729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896517058594381:11776]
2025-09-30T14:57:29.352737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896517058594381:11776]
2025-09-30T14:57:29.352742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896517058594381:11776]
2025-09-30T14:57:29.352784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:29.352792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.352793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:29.352795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:29.352800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:29.352804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:29.352939Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:29.358095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2575 sessionId: src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:29.361115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:29.402554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896517148386114:10873]
2025-09-30T14:57:29.402983Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2574, pipe: [1:7555896517148386114:10873]
2025-09-30T14:57:29.470240Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:29.470917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.470938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.470976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148386114:10873], now have 1 active actors on pipe
2025-09-30T14:57:29.471173Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:29.471336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:29.471435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2575 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0
2025-09-30T14:57:29.471616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2575 sessionId: src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0 is DEAD
2025-09-30T14:57:29.471761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896517148386114:10873]
2025-09-30T14:57:29.471774Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:29.472031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:29.472039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0] Write session will restart in 0.006296s
2025-09-30T14:57:29.472062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0] Write session: Do CDS request
2025-09-30T14:57:29.472067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:29.479714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:29.480036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:29.480053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2576
2025-09-30T14:57:29.480279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2576 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:29.480321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2576 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:29.480325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2576 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:29.480329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:29.481143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2576 sessionId:  describe result for acl check
2025-09-30T14:57:29.481171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:29.481280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:29.481289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:29.481307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896517148386180:11311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:29.481782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896517148386180:11311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:29.483738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896517148386180:11311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:29.486049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896517148386180:11311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:29.486064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896517148386180:11311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:29.486067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896517148386180:11311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:29.486075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2576 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:29.486587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:29.488614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:29.488870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:29.488880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:29.488901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:29.488958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:29.488992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896517058594587:11784]
2025-09-30T14:57:29.489651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:29.489891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:29.489930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:29.490262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:29.490318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.490324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.490325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.490326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.490328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.490329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.490330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.490331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.490333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.490334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.490335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.490336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.490338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.490339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.490340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.490345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.490357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.490361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.490365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.490369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.490373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.490377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.490381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.490385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.490395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.490404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.490408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.490412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.490420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.490424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.490431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.490438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.490444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.490455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.490460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.490464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.490469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.490475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.490480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.490485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.490490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.490495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.490504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.490510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.490514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.490523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.490529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.490534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.490538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.490544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.490554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.490560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.490569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.490575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.490584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.490589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.490598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.490603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.490610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.490615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.490662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:29.495890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:29.496904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:29.496916Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:29.496919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:29.496922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:29.496929Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2575 [2:7555896517058594587:11784]
2025-09-30T14:57:29.496945Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:29.496962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:29.496965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:29.496968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:29.496971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:29.496985Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:29.497000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:29.497007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:29.497079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.497087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.497089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.497093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:29.497096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:29.497160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:29.497169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.497181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.497194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.497217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:29.497233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896517058594582:11784]
2025-09-30T14:57:29.497242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896517058594582:11784]
2025-09-30T14:57:29.497245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896517058594582:11784]
2025-09-30T14:57:29.497257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:29.497275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:29.497293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:29.497296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:29.497314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:29.497318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:29.497321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:29.497324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896517058594582:11784]
2025-09-30T14:57:29.497327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:29.497395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:29.497517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148386128:2454], now have 1 active actors on pipe
2025-09-30T14:57:29.497527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148386296:11311], now have 1 active actors on pipe
2025-09-30T14:57:29.497652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2575
2025-09-30T14:57:29.497673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2575
2025-09-30T14:57:29.497778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.497801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.497826Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:29.497838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:29.497842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:29.497850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:29.497860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:29.497872Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:29.497890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:29.498065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.498072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.498094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:29.498174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2576 partition: 0 MaxSeqNo: 42 sessionId: src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0
2025-09-30T14:57:29.498493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8656c11-52db86a7-2c71ee94-b0b61d68_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:29.501358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0] Write session: try to update token
2025-09-30T14:57:29.501375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:29.510316Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:29.510340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:29.510342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:29.510344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:29.510353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896517058594582:11784]
2025-09-30T14:57:29.510358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896517058594582:11784]
2025-09-30T14:57:29.510362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896517058594582:11784]
2025-09-30T14:57:29.510409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:29.510417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.510419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:29.510431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:29.510438Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:29.510442Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:29.510563Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:29.516881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2576 sessionId: src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:29.519748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:29.572045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896517148386310:10873]
2025-09-30T14:57:29.572495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2575, pipe: [1:7555896517148386310:10873]
2025-09-30T14:57:29.626170Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:29.626710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.626726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.626771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148386310:10873], now have 1 active actors on pipe
2025-09-30T14:57:29.627094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896517148386310:10873]
2025-09-30T14:57:29.627198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:29.627211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:29.627177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:29.627240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:29.627295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2576 reason: error at write: Disconnected sessionId: src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0
2025-09-30T14:57:29.627459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2576 sessionId: src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0 is DEAD
2025-09-30T14:57:29.627580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:29.627590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0] Write session will restart in 0.009972s
2025-09-30T14:57:29.627615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0] Write session: Do CDS request
2025-09-30T14:57:29.627621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:29.638762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:29.638981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:29.639003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2577
2025-09-30T14:57:29.639188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2577 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:29.639232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2577 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:29.639257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2577 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:29.639263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:29.639780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2577 sessionId:  describe result for acl check
2025-09-30T14:57:29.639821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:29.639829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:29.639831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:29.639838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896517148386413:11316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:29.642423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:29.640394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896517148386413:11316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:29.643538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896517148386413:11316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:29.644998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:29.645299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:29.645313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:29.645327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:29.645395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:29.645449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896517058594753:11793]
2025-09-30T14:57:29.646197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:29.646220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896517148386413:11316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:29.646239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896517148386413:11316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:29.646244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896517148386413:11316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:29.646254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2577 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:29.646665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:29.646725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:29.647088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:29.647157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.647162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.647163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.647164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.647165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.647166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.647167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.647168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.647169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.647170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.647171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.647172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.647172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.647173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.647174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.647179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.647187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.647189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.647192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.647194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.647197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.647200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.647203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.647205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.647208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.647210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.647213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.647215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.647218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.647220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.647228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.647233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.647238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.647261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.647266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.647273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.647278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.647281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.647284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.647288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.647290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.647294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.647297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.647301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.647306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.647309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.647312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.647315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.647318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.647320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.647323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.647326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.647329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.647333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.647336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.647339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.647341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.647344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.647347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.647350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.647375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:29.653957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:29.655440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:29.655461Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:29.655464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:29.655469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:29.655476Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2576 [2:7555896517058594753:11793]
2025-09-30T14:57:29.655494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:29.655509Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:29.655512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:29.655515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:29.655517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:29.655539Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:29.655549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:29.655558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:29.655636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.655642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.655644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.655648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:29.655649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:29.655718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:29.655724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.655734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.655745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.655763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:29.655794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896517058594748:11793]
2025-09-30T14:57:29.655803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896517058594748:11793]
2025-09-30T14:57:29.655805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896517058594748:11793]
2025-09-30T14:57:29.655817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:29.655828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:29.655832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:29.655835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:29.655836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:29.655851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:29.655854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:29.655866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148386478:11316], now have 1 active actors on pipe
2025-09-30T14:57:29.655876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148386311:2454], now have 1 active actors on pipe
2025-09-30T14:57:29.655918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896517058594748:11793]
2025-09-30T14:57:29.655933Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:29.655953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:29.655944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2576
2025-09-30T14:57:29.655954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2576
2025-09-30T14:57:29.656189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.656206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.656238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45557879-f615727b-d64a6691-7d017d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:29.656252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:29.656260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:29.656263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:29.656275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:29.656292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:29.656317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:29.656506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.656515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.656533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:29.656659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2577 partition: 0 MaxSeqNo: 42 sessionId: src_id|45557879-f615727b-d64a6691-7d017d7_0
2025-09-30T14:57:29.657186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39b4a6f9-e6b429bb-26cc8321-5d4c1dcc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|45557879-f615727b-d64a6691-7d017d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:29.660677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45557879-f615727b-d64a6691-7d017d7_0] Write session: try to update token
2025-09-30T14:57:29.660700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45557879-f615727b-d64a6691-7d017d7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:29.674952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:29.674981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:29.674991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896517058594748:11793]
2025-09-30T14:57:29.675053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:29.675073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:29.675281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:29.675450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:29.675603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:29.675763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:29.675986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:29.676032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:29.680135Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:29.680157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:29.680160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:29.680162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:29.680175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896517058594748:11793]
2025-09-30T14:57:29.680179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896517058594748:11793]
2025-09-30T14:57:29.680183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896517058594748:11793]
2025-09-30T14:57:29.680223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:29.680230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.680233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:29.680243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:29.680252Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:29.680258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:29.680380Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:29.681156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2577 sessionId: src_id|45557879-f615727b-d64a6691-7d017d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:29.684399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:29.727217Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896517148386496:10873]
2025-09-30T14:57:29.727612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2576, pipe: [1:7555896517148386496:10873]
2025-09-30T14:57:29.796849Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:29.797246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.797268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.797291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148386496:10873], now have 1 active actors on pipe
2025-09-30T14:57:29.797755Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:29.797852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:29.797871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:29.797883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896517148386496:10873]
2025-09-30T14:57:29.797910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:29.797982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2577 reason: error at write: Disconnected sessionId: src_id|45557879-f615727b-d64a6691-7d017d7_0
2025-09-30T14:57:29.798195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2577 sessionId: src_id|45557879-f615727b-d64a6691-7d017d7_0 is DEAD
2025-09-30T14:57:29.798707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45557879-f615727b-d64a6691-7d017d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:29.798719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45557879-f615727b-d64a6691-7d017d7_0] Write session will restart in 0.008248s
2025-09-30T14:57:29.798751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45557879-f615727b-d64a6691-7d017d7_0] Write session: Do CDS request
2025-09-30T14:57:29.798762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45557879-f615727b-d64a6691-7d017d7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:29.807701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45557879-f615727b-d64a6691-7d017d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:29.808058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:29.808078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2578
2025-09-30T14:57:29.808311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2578 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:29.808354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2578 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:29.808372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2578 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:29.808377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:29.808923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2578 sessionId:  describe result for acl check
2025-09-30T14:57:29.808978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:29.808988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:29.808991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:29.808998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896517148386512:11321] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:29.809670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896517148386512:11321] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:29.814073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896517148386512:11321] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:29.818333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896517148386512:11321] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:29.818356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896517148386512:11321] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:29.818363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896517148386512:11321] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:29.818373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2578 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:29.824436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:29.829801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:29.830089Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:29.830099Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:29.830110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:29.830172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:29.830227Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896517058594922:11795]
2025-09-30T14:57:29.830903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:29.831445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:29.831497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:29.831835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:29.831900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.831906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.831907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.831908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.831910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.831911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.831913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.831914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.831915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.831916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.831918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.831920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.831921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.831922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.831924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.831930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.831939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.831943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.831947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.831951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.831955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.831959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.831963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.831967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.831971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.831975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.831979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.831983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.831987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.831991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.831999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.832009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:29.832014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.832019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:29.832023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.832031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:29.832036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.832041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:29.832045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.832051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:29.832055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.832060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:29.832065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.832070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:29.832074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.832079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:29.832084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.832089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:29.832093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.832099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:29.832103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.832109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.832112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.832118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.832122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.832127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.832132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.832142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:29.832147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.832151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:29.832194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:29.838658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:29.839609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:29.839627Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:29.839629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:29.839632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:29.839638Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2577 [2:7555896517058594922:11795]
2025-09-30T14:57:29.839652Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:29.839669Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:29.839672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:29.839674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:29.839676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:29.839690Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:29.839697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:29.839702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:29.839749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.839751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.839752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.839755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:29.839757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:29.839819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:29.839826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.839835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:29.839842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:29.839856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:29.839873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896517058594916:11795]
2025-09-30T14:57:29.839878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896517058594916:11795]
2025-09-30T14:57:29.839879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896517058594916:11795]
2025-09-30T14:57:29.839891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:29.839906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:29.839920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:29.839926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:29.839958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896517058594916:11795]
2025-09-30T14:57:29.839966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:29.840046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:29.840064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:29.840067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:29.840077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:29.840314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148386632:11321], now have 1 active actors on pipe
2025-09-30T14:57:29.840331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148386497:2454], now have 1 active actors on pipe
2025-09-30T14:57:29.840573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2577
2025-09-30T14:57:29.840620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2577
2025-09-30T14:57:29.840672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.840685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.840728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:29.840740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:29.840749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:29.840751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:29.840764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:29.840779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:29.840802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:29.840994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.841006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.841023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:29.841113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2578 partition: 0 MaxSeqNo: 42 sessionId: src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0
2025-09-30T14:57:29.841515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45557879-f615727b-d64a6691-7d017d7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:29.844751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0] Write session: try to update token
2025-09-30T14:57:29.844772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:29.856243Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:29.856267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:29.856278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896517058594916:11795]
2025-09-30T14:57:29.856322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:29.856477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:29.856616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:29.856744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:29.856877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:29.857291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:29.857344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:29.857524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:29.866268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2578 sessionId: src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:29.869688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:29.870309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:29.870336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:29.870371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:29.870542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:29.872087Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:29.872105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:29.872107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:29.872109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:29.872117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896517058594916:11795]
2025-09-30T14:57:29.872121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896517058594916:11795]
2025-09-30T14:57:29.872125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896517058594916:11795]
2025-09-30T14:57:29.872158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:29.872168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:29.872170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:29.872327Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:29.874683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:29.874691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:29.874696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:29.898195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896517148386673:10873]
2025-09-30T14:57:29.898542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2577, pipe: [1:7555896517148386673:10873]
2025-09-30T14:57:29.999158Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:29.999743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896517148386673:10873], now have 1 active actors on pipe
2025-09-30T14:57:30.010035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.010067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.010286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:30.010365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:30.010445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:30.010525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:30.011204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:30.011234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:30.011346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:30.011421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:30.011494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:30.011897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:30.011951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:30.011961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:30.012039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:30.012117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:30.012198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:30.012283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:30.012401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:30.012414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:30.012497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:30.012577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:30.012652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:30.012733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:30.012792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:30.012802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:30.012884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:30.012957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:30.013038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:30.013130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:30.013185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:30.013195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:30.013273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:30.013347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:30.013431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:30.013508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:30.013563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:30.013572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:30.013650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:30.013724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:30.013806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:30.013894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:30.013950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:30.013957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:30.014035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:30.014101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:30.014174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:30.014245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:30.014295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:30.014298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:30.014375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:30.014440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:30.014505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:30.014577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:30.014629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:30.014632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:30.014707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:30.014777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:30.014846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:30.014919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:30.014964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:30.014967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:30.015733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:30.015754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:30.015785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2578 reason: error at write: Disconnected sessionId: src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0
2025-09-30T14:57:30.015908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896517148386673:10873]
2025-09-30T14:57:30.015943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:30.015999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2578 sessionId: src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0 is DEAD
2025-09-30T14:57:30.015759Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:30.016419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:30.016432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0] Write session will restart in 0.007162s
2025-09-30T14:57:30.016458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0] Write session: Do CDS request
2025-09-30T14:57:30.016465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:30.027842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:30.031640Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:30.031662Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2579
2025-09-30T14:57:30.031868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2579 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:30.031916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2579 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:30.031928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2579 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:30.031934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:30.032542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2579 sessionId:  describe result for acl check
2025-09-30T14:57:30.032590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:30.032611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:30.032618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:30.032625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896521443353998:11325] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:30.033254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896521443353998:11325] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:30.038423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896521443353998:11325] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:30.045753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896521443353998:11325] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:30.045774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896521443353998:11325] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:30.045777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896521443353998:11325] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:30.045786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2579 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:30.050901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:30.053089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:30.053314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:30.053328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:30.053340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:30.053395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:30.053436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896521353562388:11798]
2025-09-30T14:57:30.054132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:30.054825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:30.054874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:30.055217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:30.055298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.055299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.055300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.055301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.055302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.055303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.055305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.055306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.055308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.055309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.055310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.055311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.055313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.055315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.055316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.055323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.055335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.055340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.055345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.055349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.055354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.055358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.055374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.055378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.055385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.055389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.055393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.055398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.055402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.055407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.055416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.055425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.055432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.055438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.055443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.055449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.055454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.055460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.055466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.055472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.055478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.055484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.055489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.055495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.055500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.055506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.055512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.055518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.055522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.055528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.055534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.055539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.055544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.055550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.055555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.055561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.055565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.055571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.055576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.055584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.055631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:30.061796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:30.062804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:30.062810Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:30.062813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:30.062817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:30.062824Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2578 [2:7555896521353562388:11798]
2025-09-30T14:57:30.062841Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:30.062858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:30.062862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:30.062864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:30.062866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:30.062883Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:30.062891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:30.062898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:30.062958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.062960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.062962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.062966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:30.062969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:30.063041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:30.063045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.063058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.063073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.063091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:30.063107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896521353562383:11798]
2025-09-30T14:57:30.063110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896521353562383:11798]
2025-09-30T14:57:30.063112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896521353562383:11798]
2025-09-30T14:57:30.063124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:30.063138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:30.063154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:30.063158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:30.063186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896521353562383:11798]
2025-09-30T14:57:30.063188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:30.063506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:30.063515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:30.063517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:30.063523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:30.064778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354131:11325], now have 1 active actors on pipe
2025-09-30T14:57:30.064792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443353974:2454], now have 1 active actors on pipe
2025-09-30T14:57:30.064810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.064816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.064846Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:30.064874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:30.064881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:30.064884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:30.064896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:30.064910Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:30.064925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:30.065370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.065388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.065410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:30.064241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2578
2025-09-30T14:57:30.064285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2578
2025-09-30T14:57:30.065534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2579 partition: 0 MaxSeqNo: 42 sessionId: src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0
2025-09-30T14:57:30.066022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdfd5546-88f1da19-e10783ae-4d73bcea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:30.068826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0] Write session: try to update token
2025-09-30T14:57:30.068847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:30.076187Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:30.076208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:30.076210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:30.076212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:30.076221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896521353562383:11798]
2025-09-30T14:57:30.076225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896521353562383:11798]
2025-09-30T14:57:30.076229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896521353562383:11798]
2025-09-30T14:57:30.076269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:30.076276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.076278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:30.076415Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:30.079296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:30.079313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:30.079317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:30.087040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2579 sessionId: src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:30.089707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:30.115260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896521443354147:10873]
2025-09-30T14:57:30.115559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2578, pipe: [1:7555896521443354147:10873]
2025-09-30T14:57:30.201017Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:30.201453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.201469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.201490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354147:10873], now have 1 active actors on pipe
2025-09-30T14:57:30.201786Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:30.201803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:30.201858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:30.201912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2579 reason: error at write: Disconnected sessionId: src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0
2025-09-30T14:57:30.201950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896521443354147:10873]
2025-09-30T14:57:30.202092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2579 sessionId: src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0 is DEAD
2025-09-30T14:57:30.202249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:30.202257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0] Write session will restart in 0.009200s
2025-09-30T14:57:30.202259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:30.202296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0] Write session: Do CDS request
2025-09-30T14:57:30.202306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:30.214454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:30.214575Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:30.214594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2580
2025-09-30T14:57:30.215462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2580 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:30.215503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2580 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:30.215521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2580 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:30.215526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:30.215880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2580 sessionId:  describe result for acl check
2025-09-30T14:57:30.215914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:30.215920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:30.215922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:30.215928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896521443354283:11330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:30.216024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:30.216378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896521443354283:11330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:30.218360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896521443354283:11330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:30.218508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:30.218735Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:30.218748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:30.218760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:30.218819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:30.218861Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896521353562568:11801]
2025-09-30T14:57:30.219560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:30.219938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:30.219988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:30.220344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:30.220410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.220417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.220418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.220420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.220421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.220423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.220424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.220425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.220427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.220428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.220430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.220431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.220433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.220434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.220436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.220441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.220453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.220458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.220462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.220473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.220478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.220486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.220491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.220500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.220505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.220509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.220514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.220519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.220530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.220535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.220543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.220551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.220558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.220565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.220571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.220583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.220593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.220603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.220613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.220620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.220630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.220641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.220651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.220658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.220663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.220673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.220683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.220696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.220701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.220706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.220712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.220718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.220724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.220730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.220735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.220741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.220751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.220761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.220766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.220772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.220823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:30.221586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896521443354283:11330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:30.221602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896521443354283:11330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:30.221607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896521443354283:11330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:30.221614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2580 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:30.226314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:30.227504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:30.227524Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:30.227538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:30.227543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:30.227550Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2579 [2:7555896521353562568:11801]
2025-09-30T14:57:30.227567Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:30.227584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:30.227588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:30.227591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:30.227594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:30.227610Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:30.227623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:30.227631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:30.227693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.227700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.227703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.227707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:30.227710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:30.227783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:30.227793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.227808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.227821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.227846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:30.227871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354322:11330], now have 1 active actors on pipe
2025-09-30T14:57:30.227879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354150:2454], now have 1 active actors on pipe
2025-09-30T14:57:30.227886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896521353562563:11801]
2025-09-30T14:57:30.227889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896521353562563:11801]
2025-09-30T14:57:30.227891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896521353562563:11801]
2025-09-30T14:57:30.227904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:30.227922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:30.227931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:30.227935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:30.227938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:30.227943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:30.227947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:30.227946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2579
2025-09-30T14:57:30.227955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2579
2025-09-30T14:57:30.227983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896521353562563:11801]
2025-09-30T14:57:30.227994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:30.228003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:30.228023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.228033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.228074Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:30.228086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:30.228095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:30.228097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:30.228107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:30.228121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:30.228143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:30.228310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.228318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.228332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:30.228429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2580 partition: 0 MaxSeqNo: 42 sessionId: src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0
2025-09-30T14:57:30.228761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fe8197-d0ed72fc-70595506-b5a9822f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:30.231580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0] Write session: try to update token
2025-09-30T14:57:30.231599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:30.240179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:30.240202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:30.240205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:30.240207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:30.240217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896521353562563:11801]
2025-09-30T14:57:30.240222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896521353562563:11801]
2025-09-30T14:57:30.240226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896521353562563:11801]
2025-09-30T14:57:30.240274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:30.240286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.240290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:30.240441Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:30.243308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:30.243331Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:30.243336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:30.245942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2580 sessionId: src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:30.248729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:30.302132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896521443354344:10873]
2025-09-30T14:57:30.302399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2579, pipe: [1:7555896521443354344:10873]
2025-09-30T14:57:30.362168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:30.362430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.362453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.362498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354344:10873], now have 1 active actors on pipe
2025-09-30T14:57:30.362737Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:30.363337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:30.363352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0] Write session will restart in 0.009850s
2025-09-30T14:57:30.363378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0] Write session: Do CDS request
2025-09-30T14:57:30.363385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:30.362819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:30.362851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:30.362925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2580 reason: error at write: Disconnected sessionId: src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0
2025-09-30T14:57:30.363130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2580 sessionId: src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0 is DEAD
2025-09-30T14:57:30.363406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:30.363408Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896521443354344:10873]
2025-09-30T14:57:30.381178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:30.381248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:30.381264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2581
2025-09-30T14:57:30.381413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2581 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:30.381457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2581 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:30.381467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2581 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:30.381471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:30.382153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2581 sessionId:  describe result for acl check
2025-09-30T14:57:30.382207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:30.382214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:30.382216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:30.382225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896521443354365:11335] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:30.382786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896521443354365:11335] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:30.386356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896521443354365:11335] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:30.390216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896521443354365:11335] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:30.390235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896521443354365:11335] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:30.390239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896521443354365:11335] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:30.390247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2581 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:30.394888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:30.397300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:30.397543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:30.397554Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:30.397565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:30.397633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:30.397696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896521353562739:11803]
2025-09-30T14:57:30.398412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:30.398858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:30.398925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:30.399312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:30.399456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.399463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.399465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.399467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.399468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.399470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.399472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.399473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.399475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.399476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.399478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.399479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.399481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.399482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.399484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.399491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.399503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.399508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.399513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.399518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.399523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.399527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.399532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.399537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.399542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.399546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.399561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.399566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.399570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.399575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.399584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.399592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.399600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.399607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.399613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.399619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.399624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.399629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.399634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.399641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.399646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.399652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.399658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.399665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.399678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.399685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.399692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.399698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.399704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.399710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.399716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.399723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.399727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.399734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.399740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.399747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.399752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.399758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.399763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.399770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.399830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:30.405688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:30.406837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:30.406862Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:30.406865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:30.406869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:30.406892Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2580 [2:7555896521353562739:11803]
2025-09-30T14:57:30.406909Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:30.406928Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:30.406937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:30.406941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:30.406943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:30.406959Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:30.406971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:30.406979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:30.407034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.407040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.407042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.407044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:30.407046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:30.407119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:30.407129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.407142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.407153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.407175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:30.407202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354349:2454], now have 1 active actors on pipe
2025-09-30T14:57:30.407206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354488:11335], now have 1 active actors on pipe
2025-09-30T14:57:30.407213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896521353562734:11803]
2025-09-30T14:57:30.407215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896521353562734:11803]
2025-09-30T14:57:30.407217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896521353562734:11803]
2025-09-30T14:57:30.407228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:30.407257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:30.407257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:30.407260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:30.407262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:30.407272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:30.407275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:30.407312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896521353562734:11803]
2025-09-30T14:57:30.407323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:30.407324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2580
2025-09-30T14:57:30.407430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:30.407454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2580
2025-09-30T14:57:30.407519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.407535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.407565Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4e10722-d4026637-605d1df7-6bf386b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:30.407579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:30.407601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:30.407604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:30.407616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:30.407633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:30.407663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:30.408111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2581 partition: 0 MaxSeqNo: 42 sessionId: src_id|e4e10722-d4026637-605d1df7-6bf386b0_0
2025-09-30T14:57:30.408536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c32018d8-c68a0092-b36ffbcb-2bdb6a2e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e4e10722-d4026637-605d1df7-6bf386b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:30.407938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.407954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.407996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:30.411530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e10722-d4026637-605d1df7-6bf386b0_0] Write session: try to update token
2025-09-30T14:57:30.411553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e10722-d4026637-605d1df7-6bf386b0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:30.424021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:30.424046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:30.424050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:30.424052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:30.424061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896521353562734:11803]
2025-09-30T14:57:30.424066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896521353562734:11803]
2025-09-30T14:57:30.424071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896521353562734:11803]
2025-09-30T14:57:30.424113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:30.424121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.424121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:30.424124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:30.424129Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:30.424134Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:30.424273Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:30.431106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2581 sessionId: src_id|e4e10722-d4026637-605d1df7-6bf386b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:30.434262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:30.463412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896521443354528:10873]
2025-09-30T14:57:30.463721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2580, pipe: [1:7555896521443354528:10873]
2025-09-30T14:57:30.541890Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:30.542204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.542224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.542264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354528:10873], now have 1 active actors on pipe
2025-09-30T14:57:30.542590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:30.542595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896521443354528:10873]
2025-09-30T14:57:30.542626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:30.542655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:30.542659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:30.542728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2581 reason: error at write: Disconnected sessionId: src_id|e4e10722-d4026637-605d1df7-6bf386b0_0
2025-09-30T14:57:30.542903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2581 sessionId: src_id|e4e10722-d4026637-605d1df7-6bf386b0_0 is DEAD
2025-09-30T14:57:30.543453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e10722-d4026637-605d1df7-6bf386b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:30.543464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e10722-d4026637-605d1df7-6bf386b0_0] Write session will restart in 0.009998s
2025-09-30T14:57:30.543485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e10722-d4026637-605d1df7-6bf386b0_0] Write session: Do CDS request
2025-09-30T14:57:30.543493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e10722-d4026637-605d1df7-6bf386b0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:30.554770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e10722-d4026637-605d1df7-6bf386b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:30.554850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:30.554868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2582
2025-09-30T14:57:30.554991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2582 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:30.555026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2582 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:30.555037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2582 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:30.555042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:30.555578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2582 sessionId:  describe result for acl check
2025-09-30T14:57:30.555630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:30.555637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:30.555639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:30.555644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896521443354622:11346] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:30.556241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896521443354622:11346] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:30.558818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896521443354622:11346] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:30.559561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:30.561632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:30.561837Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:30.561847Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:30.561856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:30.561903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:30.561943Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896521353562947:11818]
2025-09-30T14:57:30.562212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896521443354622:11346] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:30.562229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896521443354622:11346] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:30.562233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896521443354622:11346] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:30.562242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2582 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:30.562548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:30.562898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:30.562958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:30.563288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:30.563351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.563358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.563359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.563360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.563362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.563363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.563365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.563366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.563368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.563369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.563371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.563372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.563374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.563375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.563376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.563381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.563391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.563395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.563399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.563402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.563406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.563409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.563413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.563416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.563420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.563423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.563426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.563430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.563433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.563436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.563444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.563451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.563457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.563461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.563467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.563472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.563476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.563480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.563484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.563489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.563493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.563498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.563502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.563507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.563511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.563515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.563519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.563523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.563529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.563533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.563538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.563542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.563546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.563550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.563554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.563558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.563566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.563570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.563573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.563577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.563615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:30.570879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2581
2025-09-30T14:57:30.570892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2581
2025-09-30T14:57:30.569421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:30.570459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:30.570465Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:30.570468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:30.570471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:30.570479Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2581 [2:7555896521353562947:11818]
2025-09-30T14:57:30.570495Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:30.570511Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:30.570515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:30.570519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:30.570521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:30.570537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:30.570543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:30.570550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:30.570615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.570617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.570619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.570622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:30.570625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:30.570694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:30.570696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.570710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.570722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.570740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:30.570758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354720:11346], now have 1 active actors on pipe
2025-09-30T14:57:30.570762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354555:2454], now have 1 active actors on pipe
2025-09-30T14:57:30.570768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896521353562942:11818]
2025-09-30T14:57:30.570770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896521353562942:11818]
2025-09-30T14:57:30.570773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896521353562942:11818]
2025-09-30T14:57:30.570786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:30.570799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:30.570811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:30.570815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:30.570815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:30.570818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:30.570829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:30.570855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896521353562942:11818]
2025-09-30T14:57:30.570861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:30.570868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:30.571092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.571101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.571128Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:30.571137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:30.571141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:30.571143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:30.571154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:30.571169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:30.571184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:30.571761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.571778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.571797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:30.571907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2582 partition: 0 MaxSeqNo: 42 sessionId: src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0
2025-09-30T14:57:30.572331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4e10722-d4026637-605d1df7-6bf386b0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:30.575501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0] Write session: try to update token
2025-09-30T14:57:30.575522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:30.590743Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:30.590765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:30.590775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896521353562942:11818]
2025-09-30T14:57:30.590827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:30.590839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:30.591022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:30.591186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:30.591355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:30.591502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:30.591710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:30.591762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:30.595790Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:30.595808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:30.595811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:30.595812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:30.595821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896521353562942:11818]
2025-09-30T14:57:30.595826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896521353562942:11818]
2025-09-30T14:57:30.595831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896521353562942:11818]
2025-09-30T14:57:30.595867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:30.595878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.595880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:30.595881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:30.595886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:30.595890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:30.596020Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:30.596830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2582 sessionId: src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:30.599689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:30.642651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896521443354731:10873]
2025-09-30T14:57:30.642987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2581, pipe: [1:7555896521443354731:10873]
2025-09-30T14:57:30.711796Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:30.712195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.712212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.712232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354731:10873], now have 1 active actors on pipe
2025-09-30T14:57:30.712433Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:30.712970Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896521443354731:10873]
2025-09-30T14:57:30.713000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:30.713137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:30.713246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2582 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0
2025-09-30T14:57:30.713417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2582 sessionId: src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0 is DEAD
2025-09-30T14:57:30.715546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:30.715559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0] Write session will restart in 0.008602s
2025-09-30T14:57:30.715594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0] Write session: Do CDS request
2025-09-30T14:57:30.715600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:30.730012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:30.730295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:30.730719Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:30.730736Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2583
2025-09-30T14:57:30.732999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:30.733375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:30.733380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:30.733392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:30.733454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:30.733490Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896521353563119:11820]
2025-09-30T14:57:30.734169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:30.731139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2583 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:30.731193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2583 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:30.731200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2583 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:30.731204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:30.732927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2583 sessionId:  describe result for acl check
2025-09-30T14:57:30.732962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:30.732964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:30.732969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:30.732975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896521443354871:11351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:30.733540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896521443354871:11351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:30.736309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896521443354871:11351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:30.737727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:30.737815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:30.738250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:30.738326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.738333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.738335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.738337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.738338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.738340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.738341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.738343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.738344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.738346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.738347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.738351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.738352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.738354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.738355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.738362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.738374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.738378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.738383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.738388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.738393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.738398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.738403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.738408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.738413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.738417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.738422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.738426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.738430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.738434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.738442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.738452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.738458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.738464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.738486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.738499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.738506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.738512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.738517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.738525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.738534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.738540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.738550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.738561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.738567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.738573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.738583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.738589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.738594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.738605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.738609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.738620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.738625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.738635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.738641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.738650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.738655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.738666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.738671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.738681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.738730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:30.739425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896521443354871:11351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:30.739442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896521443354871:11351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:30.739445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896521443354871:11351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:30.739453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2583 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:30.745481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:30.747358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2582
2025-09-30T14:57:30.747405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2582
2025-09-30T14:57:30.746567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:30.746588Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:30.746591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:30.746596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:30.746603Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2582 [2:7555896521353563119:11820]
2025-09-30T14:57:30.746621Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:30.746639Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:30.746643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:30.746646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:30.746649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:30.746672Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:30.746680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:30.746686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:30.746759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.746761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.746763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.746769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:30.746772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:30.746849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:30.746852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.746864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.746874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.746891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:30.746909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896521353563113:11820]
2025-09-30T14:57:30.746911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896521353563113:11820]
2025-09-30T14:57:30.746913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896521353563113:11820]
2025-09-30T14:57:30.746924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:30.746938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:30.746948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:30.746953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:30.746953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:30.746956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:30.746956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:30.746996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896521353563113:11820]
2025-09-30T14:57:30.747006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:30.747016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354734:2454], now have 1 active actors on pipe
2025-09-30T14:57:30.747020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354909:11351], now have 1 active actors on pipe
2025-09-30T14:57:30.747214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:30.747576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.747582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.747610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:30.747620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:30.747624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:30.747626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:30.747636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:30.747648Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:30.747675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:30.749776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.749788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.749814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:30.750381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1af99a41-a084ecd3-8d59f126-dcf9de62_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:30.749969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2583 partition: 0 MaxSeqNo: 42 sessionId: src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0
2025-09-30T14:57:30.753895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0] Write session: try to update token
2025-09-30T14:57:30.753915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:30.764039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:30.764064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:30.764067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:30.764070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:30.764080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896521353563113:11820]
2025-09-30T14:57:30.764084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896521353563113:11820]
2025-09-30T14:57:30.764088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896521353563113:11820]
2025-09-30T14:57:30.764132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:30.764138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.764141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:30.764194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:30.764207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:30.764220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:30.764296Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:30.784845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2583 sessionId: src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:30.787405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:30.813095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896521443354916:10873]
2025-09-30T14:57:30.813761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2582, pipe: [1:7555896521443354916:10873]
2025-09-30T14:57:30.893457Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:30.894179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.894198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.894220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354916:10873], now have 1 active actors on pipe
2025-09-30T14:57:30.894669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:30.894692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896521443354916:10873]
2025-09-30T14:57:30.894723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:30.894725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:30.894791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2583 reason: error at write: Disconnected sessionId: src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0
2025-09-30T14:57:30.894935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2583 sessionId: src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0 is DEAD
2025-09-30T14:57:30.894543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:30.895615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:30.895636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0] Write session will restart in 0.009553s
2025-09-30T14:57:30.895667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0] Write session: Do CDS request
2025-09-30T14:57:30.895677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:30.906816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:30.907585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:30.907603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2584
2025-09-30T14:57:30.907758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2584 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:30.907797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2584 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:30.907802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2584 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:30.907806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:30.908710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2584 sessionId:  describe result for acl check
2025-09-30T14:57:30.908742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:30.908745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:30.908747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:30.908753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896521443354962:11355] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:30.909333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896521443354962:11355] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:30.911145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896521443354962:11355] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:30.914866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:30.913813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896521443354962:11355] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:30.913834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896521443354962:11355] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:30.913840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896521443354962:11355] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:30.913849Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2584 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:30.917014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:30.917403Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:30.917413Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:30.917435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:30.917511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:30.917559Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896521353563293:11822]
2025-09-30T14:57:30.918209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:30.918552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:30.918629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:30.918977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:30.919036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.919042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.919043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.919044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.919046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.919047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.919048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.919049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.919050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.919051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.919053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.919054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.919055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.919056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.919057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.919063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.919072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.919076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.919079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.919082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.919086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.919089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.919093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.919096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.919100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.919103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.919106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.919109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.919112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.919115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.919122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.919130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:30.919137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.919143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:30.919147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.919152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:30.919156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.919161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:30.919166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.919171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:30.919175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.919180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:30.919185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.919190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:30.919194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.919199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:30.919203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.919207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:30.919212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.919216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:30.919221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.919225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.919234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.919240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.919262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.919267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.919276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.919280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:30.919289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.919294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:30.919331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:30.925133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:30.926542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:30.926559Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:30.926562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:30.926566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:30.926573Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2583 [2:7555896521353563293:11822]
2025-09-30T14:57:30.926591Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:30.926605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:30.926608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:30.926611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:30.926613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:30.926627Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:30.926635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:30.926642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:30.926712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.926714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.926715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.926719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:30.926722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:30.926792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:30.926795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.926807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:30.926817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:30.926833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:30.926848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896521353563288:11822]
2025-09-30T14:57:30.926850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896521353563288:11822]
2025-09-30T14:57:30.926852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896521353563288:11822]
2025-09-30T14:57:30.926859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:30.926873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:30.926875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:30.926879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:30.926881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:30.926886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:30.926889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:30.926898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443355086:11355], now have 1 active actors on pipe
2025-09-30T14:57:30.926932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443354918:2454], now have 1 active actors on pipe
2025-09-30T14:57:30.926935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896521353563288:11822]
2025-09-30T14:57:30.926944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:30.927021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:30.927201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.927212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.927309Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d3908ba-7556acb9-13270314-e8061a25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:30.927318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:30.927322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:30.927325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:30.927337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:30.927350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:30.927367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:30.927534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:30.927539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:30.927558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:30.927082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2583
2025-09-30T14:57:30.927127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2583
2025-09-30T14:57:30.927668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2584 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d3908ba-7556acb9-13270314-e8061a25_0
2025-09-30T14:57:30.931418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2fa482-a3d722b3-a6ea2ac0-279fe4d6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d3908ba-7556acb9-13270314-e8061a25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:30.937178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d3908ba-7556acb9-13270314-e8061a25_0] Write session: try to update token
2025-09-30T14:57:30.937201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d3908ba-7556acb9-13270314-e8061a25_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:30.949570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:30.949590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:30.949592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:30.949594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:30.949607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896521353563288:11822]
2025-09-30T14:57:30.949610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896521353563288:11822]
2025-09-30T14:57:30.949615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896521353563288:11822]
2025-09-30T14:57:30.949647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:30.949652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:30.949654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:30.949678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:30.949688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:30.949695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:30.949947Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:30.961543Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2584 sessionId: src_id|7d3908ba-7556acb9-13270314-e8061a25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:30.964342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:30.994855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896521443355102:10873]
2025-09-30T14:57:30.995598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2583, pipe: [1:7555896521443355102:10873]
2025-09-30T14:57:31.063656Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:31.064072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.064094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.064114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896521443355102:10873], now have 1 active actors on pipe
2025-09-30T14:57:31.064356Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:31.064378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:31.064396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:31.064467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2584 reason: error at write: Disconnected sessionId: src_id|7d3908ba-7556acb9-13270314-e8061a25_0
2025-09-30T14:57:31.064638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2584 sessionId: src_id|7d3908ba-7556acb9-13270314-e8061a25_0 is DEAD
2025-09-30T14:57:31.064770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d3908ba-7556acb9-13270314-e8061a25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:31.064782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d3908ba-7556acb9-13270314-e8061a25_0] Write session will restart in 0.006001s
2025-09-30T14:57:31.064805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d3908ba-7556acb9-13270314-e8061a25_0] Write session: Do CDS request
2025-09-30T14:57:31.064811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d3908ba-7556acb9-13270314-e8061a25_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:31.064820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896521443355102:10873]
2025-09-30T14:57:31.064839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:31.071715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d3908ba-7556acb9-13270314-e8061a25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:31.073317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:31.073334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2585
2025-09-30T14:57:31.073466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2585 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:31.073504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2585 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:31.073510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2585 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:31.073513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:31.073976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2585 sessionId:  describe result for acl check
2025-09-30T14:57:31.074025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:31.074032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:31.074034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:31.074040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896525738322456:11359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:31.074592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896525738322456:11359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:31.077161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896525738322456:11359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:31.079485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:31.081870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:31.082124Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:31.082134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:31.082145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:31.082204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896525738322456:11359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:31.082222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896525738322456:11359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:31.082228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896525738322456:11359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:31.082237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2585 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:31.082210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:31.082253Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896525648530776:11825]
2025-09-30T14:57:31.082948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:31.083285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:31.083350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:31.083718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:31.083822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.083829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.083830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.083831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.083832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.083834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.083835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.083836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.083838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.083839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.083840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.083841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.083843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.083845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.083846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.083853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.083863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.083867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.083871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.083875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.083880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.083884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.083888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.083893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.083898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.083902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.083906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.083909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.083913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.083918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.083926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.083934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.083940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.083946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.083952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.083957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.083962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.083967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.083972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.083977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.083981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.083988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.083992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.083999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.084003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.084008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.084021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.084027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.084032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.084038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.084046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.084052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.084057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.084063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.084068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.084073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.084077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.084082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.084088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.084099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.084149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:31.089793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:31.090724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:31.090747Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:31.090750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:31.090755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:31.090762Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2584 [2:7555896525648530776:11825]
2025-09-30T14:57:31.090778Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:31.090796Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:31.090799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:31.090803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:31.090805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:31.090821Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:31.090829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:31.090836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:31.090908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.090919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.090922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.090925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:31.090928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:31.091137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:31.091148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.091165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.091185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.091212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:31.091236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896525648530760:11825]
2025-09-30T14:57:31.091266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896525648530760:11825]
2025-09-30T14:57:31.091268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896525648530760:11825]
2025-09-30T14:57:31.091287Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:31.091308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:31.091329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:31.091338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:31.091340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:31.091342Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:31.091342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:31.091376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896525648530760:11825]
2025-09-30T14:57:31.091385Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:31.091409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:31.091433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738322573:11359], now have 1 active actors on pipe
2025-09-30T14:57:31.091445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738322402:2454], now have 1 active actors on pipe
2025-09-30T14:57:31.091551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2584
2025-09-30T14:57:31.091588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2584
2025-09-30T14:57:31.091646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.091658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.091685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:31.091698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:31.091702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:31.091709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:31.091720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:31.091735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:31.091756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:31.092106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.092115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.092131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:31.092242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2585 partition: 0 MaxSeqNo: 42 sessionId: src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0
2025-09-30T14:57:31.093400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d3908ba-7556acb9-13270314-e8061a25_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:31.096238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0] Write session: try to update token
2025-09-30T14:57:31.096256Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:31.109030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:31.109069Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:31.109071Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:31.109072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:31.109080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896525648530760:11825]
2025-09-30T14:57:31.109086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896525648530760:11825]
2025-09-30T14:57:31.109089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896525648530760:11825]
2025-09-30T14:57:31.109121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:31.109126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.109127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:31.109276Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:31.109947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:31.109963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:31.109978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:31.122938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2585 sessionId: src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:31.125587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:31.165358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896525738322586:10873]
2025-09-30T14:57:31.166088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2584, pipe: [1:7555896525738322586:10873]
2025-09-30T14:57:31.236581Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:31.237070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.237093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.237116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738322586:10873], now have 1 active actors on pipe
2025-09-30T14:57:31.240142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:31.240937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:31.240954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:31.241012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2585 reason: error at write: Disconnected sessionId: src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0
2025-09-30T14:57:31.241190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2585 sessionId: src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0 is DEAD
2025-09-30T14:57:31.241332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:31.241375Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896525738322586:10873]
2025-09-30T14:57:31.241595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:31.241617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0] Write session will restart in 0.005913s
2025-09-30T14:57:31.241644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0] Write session: Do CDS request
2025-09-30T14:57:31.241653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:31.248756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:31.249109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:31.249129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2586
2025-09-30T14:57:31.249328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2586 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:31.249359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2586 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:31.249364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2586 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:31.249369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:31.249756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2586 sessionId:  describe result for acl check
2025-09-30T14:57:31.249781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:31.249783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:31.249784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:31.249790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896525738322608:11364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:31.250322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896525738322608:11364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:31.253698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896525738322608:11364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:31.260945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896525738322608:11364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:31.260967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896525738322608:11364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:31.260971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896525738322608:11364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:31.260980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2586 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:31.268020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:31.270347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:31.270588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:31.270598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:31.270610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:31.270686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:31.270730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896525648530955:11828]
2025-09-30T14:57:31.271422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:31.271804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:31.271870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:31.272255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:31.272331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.272338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.272339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.272340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.272342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.272344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.272345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.272347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.272349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.272350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.272351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.272353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.272354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.272355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.272356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.272363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.272374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.272390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.272395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.272400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.272404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.272409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.272413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.272418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.272424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.272429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.272433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.272438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.272443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.272448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.272457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.272465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.272473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.272480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.272484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.272490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.272502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.272508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.272514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.272521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.272526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.272531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.272542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.272553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.272560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.272571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.272576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.272582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.272603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.272613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.272619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.272629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.272635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.272641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.272651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.272657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.272666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.272672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.272677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.272685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.272739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:31.279555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:31.280963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:31.280984Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:31.280987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:31.280992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:31.281000Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2585 [2:7555896525648530955:11828]
2025-09-30T14:57:31.281020Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:31.281040Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:31.281043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:31.281067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:31.281070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:31.281089Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:31.281099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:31.281107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:31.281186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.281196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.281198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.281202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:31.281205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:31.281288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:31.281297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.281313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.281332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.281354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:31.281377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896525648530950:11828]
2025-09-30T14:57:31.281386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896525648530950:11828]
2025-09-30T14:57:31.281389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896525648530950:11828]
2025-09-30T14:57:31.281405Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:31.281426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:31.281450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:31.281458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:31.281503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896525648530950:11828]
2025-09-30T14:57:31.281510Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:31.282821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:31.282841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:31.282843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:31.282850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:31.283028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738322589:2454], now have 1 active actors on pipe
2025-09-30T14:57:31.283046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738322769:11364], now have 1 active actors on pipe
2025-09-30T14:57:31.283311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2585
2025-09-30T14:57:31.283361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2585
2025-09-30T14:57:31.283912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.283930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.283962Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|23563065-46c444b5-906d1461-5c7723e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:31.283973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:31.283977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:31.283980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:31.283994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:31.284010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:31.284027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:31.284707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.284716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.284743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:31.289627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2586 partition: 0 MaxSeqNo: 42 sessionId: src_id|23563065-46c444b5-906d1461-5c7723e8_0
2025-09-30T14:57:31.290009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|923b2b2a-9ab6d062-364ab88b-9d59a082_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|23563065-46c444b5-906d1461-5c7723e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:31.292742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23563065-46c444b5-906d1461-5c7723e8_0] Write session: try to update token
2025-09-30T14:57:31.292763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23563065-46c444b5-906d1461-5c7723e8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:31.304408Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:31.304427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:31.304429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:31.304431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:31.304441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896525648530950:11828]
2025-09-30T14:57:31.304445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896525648530950:11828]
2025-09-30T14:57:31.304454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896525648530950:11828]
2025-09-30T14:57:31.304499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:31.304506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.304509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:31.304661Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:31.307301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:31.307322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:31.307327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:31.312300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2586 sessionId: src_id|23563065-46c444b5-906d1461-5c7723e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:31.315086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:31.341494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896525738322792:10873]
2025-09-30T14:57:31.341888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2585, pipe: [1:7555896525738322792:10873]
2025-09-30T14:57:31.421667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:31.422001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.422020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.422058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738322792:10873], now have 1 active actors on pipe
2025-09-30T14:57:31.422316Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:31.422727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23563065-46c444b5-906d1461-5c7723e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:31.422738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23563065-46c444b5-906d1461-5c7723e8_0] Write session will restart in 0.007417s
2025-09-30T14:57:31.422763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23563065-46c444b5-906d1461-5c7723e8_0] Write session: Do CDS request
2025-09-30T14:57:31.422771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23563065-46c444b5-906d1461-5c7723e8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:31.422305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:31.422362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896525738322792:10873]
2025-09-30T14:57:31.422380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:31.422383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:31.422445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2586 reason: error at write: Disconnected sessionId: src_id|23563065-46c444b5-906d1461-5c7723e8_0
2025-09-30T14:57:31.422609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2586 sessionId: src_id|23563065-46c444b5-906d1461-5c7723e8_0 is DEAD
2025-09-30T14:57:31.435761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|23563065-46c444b5-906d1461-5c7723e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:31.435941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:31.435962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2587
2025-09-30T14:57:31.436061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2587 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:31.436094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2587 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:31.436108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2587 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:31.436115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:31.436567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2587 sessionId:  describe result for acl check
2025-09-30T14:57:31.436607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:31.436616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:31.436618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:31.436625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896525738322931:11369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:31.437134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896525738322931:11369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:31.437182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:31.439106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896525738322931:11369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:31.439568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:31.439875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:31.439887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:31.439899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:31.439959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:31.439997Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896525648531130:11830]
2025-09-30T14:57:31.440592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:31.440886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:31.440922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:31.441253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:31.441325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.441331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.441332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.441334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.441335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.441336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.441337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.441338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.441339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.441340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.441341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.441342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.441343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.441344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.441345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.441350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.441360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.441365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.441368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.441372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.441376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.441379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.441383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.441387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.441391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.441395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.441398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.441402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.441406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.441409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.441416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.441423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.441428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.441435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.441440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.441445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.441450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.441455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.441461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.441466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.441469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.441474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.441479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.441483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.441487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.441492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.441496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.441501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.441505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.441510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.441514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.441518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.441523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.441528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.441532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.441537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.441541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.441546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.441551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.441556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.441608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:31.442123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896525738322931:11369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:31.442138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896525738322931:11369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:31.442142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896525738322931:11369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:31.442150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2587 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:31.447008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:31.448207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:31.448221Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:31.448228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:31.448233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:31.448239Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2586 [2:7555896525648531130:11830]
2025-09-30T14:57:31.448258Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:31.448278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:31.448285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:31.448289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:31.448291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:31.448306Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:31.448312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:31.448319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:31.448371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.448379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.448381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.448383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:31.448385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:31.448437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:31.448446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.448453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.448460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.448469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:31.448482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896525648531125:11830]
2025-09-30T14:57:31.448483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896525648531125:11830]
2025-09-30T14:57:31.448485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896525648531125:11830]
2025-09-30T14:57:31.448495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:31.448508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:31.448517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:31.448520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:31.448520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:31.448523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:31.448524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:31.448533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738322971:11369], now have 1 active actors on pipe
2025-09-30T14:57:31.448536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738322794:2454], now have 1 active actors on pipe
2025-09-30T14:57:31.448568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896525648531125:11830]
2025-09-30T14:57:31.448581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:31.448607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:31.448606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2586
2025-09-30T14:57:31.448635Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2586
2025-09-30T14:57:31.448681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.448688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.448716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:31.448728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:31.448735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:31.448737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:31.448747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:31.448756Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:31.448776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:31.448896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.448903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.448916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:31.448988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2587 partition: 0 MaxSeqNo: 42 sessionId: src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0
2025-09-30T14:57:31.449392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|23563065-46c444b5-906d1461-5c7723e8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:31.452360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0] Write session: try to update token
2025-09-30T14:57:31.452382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:31.467058Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:31.467089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:31.467103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896525648531125:11830]
2025-09-30T14:57:31.467163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:31.467175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:31.467395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:31.467571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:31.467726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:31.467874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:31.468087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:31.468141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:31.472019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:31.472035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:31.472037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:31.472038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:31.472046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896525648531125:11830]
2025-09-30T14:57:31.472049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896525648531125:11830]
2025-09-30T14:57:31.472052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896525648531125:11830]
2025-09-30T14:57:31.472081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:31.472086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.472085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:31.472088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:31.472093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:31.472098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:31.472213Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:31.473771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2587 sessionId: src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:31.476327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:31.522766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896525738322979:10873]
2025-09-30T14:57:31.523085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2586, pipe: [1:7555896525738322979:10873]
2025-09-30T14:57:31.589478Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:31.590891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.590911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.590931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738322979:10873], now have 1 active actors on pipe
2025-09-30T14:57:31.591196Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:31.591197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:31.591214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:31.591234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896525738322979:10873]
2025-09-30T14:57:31.591309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2587 reason: error at write: Disconnected sessionId: src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0
2025-09-30T14:57:31.591501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2587 sessionId: src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0 is DEAD
2025-09-30T14:57:31.591684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:31.591695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0] Write session will restart in 0.008054s
2025-09-30T14:57:31.591727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0] Write session: Do CDS request
2025-09-30T14:57:31.591733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:31.591385Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:31.600794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:31.601057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:31.601077Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2588
2025-09-30T14:57:31.601222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2588 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:31.601268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2588 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:31.601281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2588 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:31.601285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:31.602196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2588 sessionId:  describe result for acl check
2025-09-30T14:57:31.602251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:31.602258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:31.602260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:31.602267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896525738323060:11380] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:31.602836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896525738323060:11380] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:31.605232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896525738323060:11380] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:31.608521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896525738323060:11380] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:31.608539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896525738323060:11380] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:31.608543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896525738323060:11380] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:31.608551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2588 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:31.608237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:31.610933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:31.611301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:31.611306Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:31.611318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:31.611398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:31.611433Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896525648531346:11842]
2025-09-30T14:57:31.612084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:31.612532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:31.612601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:31.612989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:31.613091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.613098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.613100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.613102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.613104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.613105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.613107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.613109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.613111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.613112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.613113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.613115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.613116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.613117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.613119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.613124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.613136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.613140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.613145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.613149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.613153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.613158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.613162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.613166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.613171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.613174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.613179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.613183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.613187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.613191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.613200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.613208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.613215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.613221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.613229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.613234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.613238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.613242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.613248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.613254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.613258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.613263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.613268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.613272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.613277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.613282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.613287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.613292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.613296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.613301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.613306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.613311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.613314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.613319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.613324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.613342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.613347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.613352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.613356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.613361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.613402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:31.619122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:31.620083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:31.620103Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:31.620107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:31.620112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:31.620120Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2587 [2:7555896525648531346:11842]
2025-09-30T14:57:31.620142Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:31.620168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:31.620176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:31.620180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:31.620184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:31.620201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:31.620216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:31.620223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:31.620314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.620576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.620585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.620589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:31.620592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:31.620665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:31.620673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.620686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.620702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.620726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:31.620751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738323005:2454], now have 1 active actors on pipe
2025-09-30T14:57:31.620761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738323176:11380], now have 1 active actors on pipe
2025-09-30T14:57:31.620767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896525648531339:11842]
2025-09-30T14:57:31.620770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896525648531339:11842]
2025-09-30T14:57:31.620772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896525648531339:11842]
2025-09-30T14:57:31.620785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:31.620799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:31.620799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:31.620802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:31.620804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:31.620815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:31.620819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:31.620810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2587
2025-09-30T14:57:31.620840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2587
2025-09-30T14:57:31.620853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896525648531339:11842]
2025-09-30T14:57:31.620870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:31.620874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:31.620916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.620921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.620946Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9cf049d-654585e5-fa450b84-4488e074_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:31.620953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:31.620957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:31.620959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:31.620968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:31.620979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:31.620993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:31.621282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.621285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.621300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:31.621432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2588 partition: 0 MaxSeqNo: 42 sessionId: src_id|d9cf049d-654585e5-fa450b84-4488e074_0
2025-09-30T14:57:31.621846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d8f3dfa-12810e91-f0ff1327-14c739dd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d9cf049d-654585e5-fa450b84-4488e074_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:31.624785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cf049d-654585e5-fa450b84-4488e074_0] Write session: try to update token
2025-09-30T14:57:31.624806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cf049d-654585e5-fa450b84-4488e074_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:31.633020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:31.633056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:31.633059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:31.633062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:31.633072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896525648531339:11842]
2025-09-30T14:57:31.633082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896525648531339:11842]
2025-09-30T14:57:31.633086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896525648531339:11842]
2025-09-30T14:57:31.633130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:31.633143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.633150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:31.633155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:31.633162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:31.633166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:31.633285Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:31.645036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2588 sessionId: src_id|d9cf049d-654585e5-fa450b84-4488e074_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:31.647809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:31.691319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896525738323189:10873]
2025-09-30T14:57:31.691639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2587, pipe: [1:7555896525738323189:10873]
2025-09-30T14:57:31.755652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:31.756105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.756128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.756148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738323189:10873], now have 1 active actors on pipe
2025-09-30T14:57:31.757992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:31.758012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:31.758017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:31.758056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896525738323189:10873]
2025-09-30T14:57:31.758093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2588 reason: error at write: Disconnected sessionId: src_id|d9cf049d-654585e5-fa450b84-4488e074_0
2025-09-30T14:57:31.758124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:31.758270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2588 sessionId: src_id|d9cf049d-654585e5-fa450b84-4488e074_0 is DEAD
2025-09-30T14:57:31.758445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cf049d-654585e5-fa450b84-4488e074_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:31.758455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cf049d-654585e5-fa450b84-4488e074_0] Write session will restart in 0.005619s
2025-09-30T14:57:31.758479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cf049d-654585e5-fa450b84-4488e074_0] Write session: Do CDS request
2025-09-30T14:57:31.758489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cf049d-654585e5-fa450b84-4488e074_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:31.766833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cf049d-654585e5-fa450b84-4488e074_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:31.766901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:31.766920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2589
2025-09-30T14:57:31.767018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2589 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:31.767045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2589 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:31.767051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2589 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:31.767055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:31.767444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2589 sessionId:  describe result for acl check
2025-09-30T14:57:31.767470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:31.767472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:31.767473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:31.767481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896525738323208:11385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:31.767994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896525738323208:11385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:31.770061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896525738323208:11385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:31.773925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896525738323208:11385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:31.773945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896525738323208:11385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:31.773949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896525738323208:11385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:31.773957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2589 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:31.776654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:31.778620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:31.778820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:31.778834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:31.778845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:31.778907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:31.778950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896525648531524:11847]
2025-09-30T14:57:31.779586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:31.779955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:31.780015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:31.780366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:31.780443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.780449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.780451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.780452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.780453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.780455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.780456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.780458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.780459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.780461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.780462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.780463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.780464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.780466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.780467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.780472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.780482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.780486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.780491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.780494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.780498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.780502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.780506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.780511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.780516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.780521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.780525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.780530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.780535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.780539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.780548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.780573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:31.780579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.780586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:31.780592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.780598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:31.780603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.780609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:31.780620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.780626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:31.780631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.780637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:31.780642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.780662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:31.780672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.780678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:31.780683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.780689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:31.780694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.780699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:31.780709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.780715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.780725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.780732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.780741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.780747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.780758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.780763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:31.780770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.780780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:31.780825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:31.786541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:31.787627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:31.787641Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:31.787643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:31.787646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:31.787652Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2588 [2:7555896525648531524:11847]
2025-09-30T14:57:31.787663Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:31.787676Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:31.787679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:31.787681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:31.787682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:31.787695Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:31.787700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:31.787705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:31.787768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.787777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.787780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.787783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:31.787786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:31.787861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:31.787869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.787882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:31.787895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:31.787916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:31.787933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738323193:2454], now have 1 active actors on pipe
2025-09-30T14:57:31.787937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738323359:11385], now have 1 active actors on pipe
2025-09-30T14:57:31.787943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896525648531519:11847]
2025-09-30T14:57:31.787945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896525648531519:11847]
2025-09-30T14:57:31.787948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896525648531519:11847]
2025-09-30T14:57:31.787962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:31.787975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:31.787989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:31.787994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:31.787996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:31.787997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:31.787998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:31.788038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896525648531519:11847]
2025-09-30T14:57:31.788050Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:31.788092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2588
2025-09-30T14:57:31.788135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2588
2025-09-30T14:57:31.788082Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:31.788195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.788204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.788229Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:31.788237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:31.788240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:31.788242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:31.788251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:31.788261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:31.788275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:31.788719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.788734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.788758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:31.788862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2589 partition: 0 MaxSeqNo: 42 sessionId: src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0
2025-09-30T14:57:31.790055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9cf049d-654585e5-fa450b84-4488e074_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:31.792907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0] Write session: try to update token
2025-09-30T14:57:31.792926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:31.809606Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:31.809642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:31.809645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:31.809648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:31.809662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896525648531519:11847]
2025-09-30T14:57:31.809669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896525648531519:11847]
2025-09-30T14:57:31.809680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896525648531519:11847]
2025-09-30T14:57:31.809739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:31.809759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:31.809762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:31.809945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:31.809989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:31.810010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:31.810020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:31.811458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2589 sessionId: src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:31.814465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:31.858071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896525738323387:10873]
2025-09-30T14:57:31.858393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2588, pipe: [1:7555896525738323387:10873]
2025-09-30T14:57:31.945787Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:31.946252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:31.946267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:31.946321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738323387:10873], now have 1 active actors on pipe
2025-09-30T14:57:31.947599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:31.947613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0] Write session will restart in 0.005894s
2025-09-30T14:57:31.947640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0] Write session: Do CDS request
2025-09-30T14:57:31.947646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:31.947017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896525738323387:10873]
2025-09-30T14:57:31.947059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:31.947063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:31.947145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2589 reason: error at write: Disconnected sessionId: src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0
2025-09-30T14:57:31.947378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2589 sessionId: src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0 is DEAD
2025-09-30T14:57:31.947668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:31.953463Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:31.954799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:31.954884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:31.954905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2590
2025-09-30T14:57:31.955080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2590 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:31.955142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2590 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:31.955152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2590 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:31.955158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:31.956167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2590 sessionId:  describe result for acl check
2025-09-30T14:57:31.956238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:31.956240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:31.956242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:31.956250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896525738323405:11389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:31.956980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896525738323405:11389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:31.974947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896525738323405:11389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:31.984408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896525738323405:11389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:31.984443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896525738323405:11389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:31.984447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896525738323405:11389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:31.984459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2590 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:32.003112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:32.004019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:32.004274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:32.004279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:32.004293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:32.004363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:32.004414Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896529943499000:11849]
2025-09-30T14:57:32.005220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:32.005763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:32.005830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:32.006238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:32.006331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.006333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.006335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.006336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.006338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.006340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.006342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.006344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.006346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.006348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.006350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.006352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.006354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.006355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.006357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.006365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.006377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.006382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.006387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.006392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.006397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.006403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.006408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.006413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.006418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.006423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.006427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.006432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.006437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.006441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.006453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.006464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.006471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.006478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.006484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.006492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.006498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.006504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.006511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.006517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.006523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.006529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.006535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.006541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.006546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.006552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.006559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.006566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.006572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.006581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.006587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.006594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.006599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.006605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.006612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.006618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.006624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.006630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.006637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.006644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.006700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:32.017568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:32.018677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:32.018686Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:32.018689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:32.018694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:32.018705Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2589 [2:7555896529943499000:11849]
2025-09-30T14:57:32.018730Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:32.018751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:32.018756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:32.018760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:32.018763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:32.018786Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:32.018796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:32.018806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:32.018908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.018912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.018915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.018919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:32.018922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:32.019023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:32.019027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.019045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.019061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.019080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:32.019103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896529943498995:11849]
2025-09-30T14:57:32.019106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896529943498995:11849]
2025-09-30T14:57:32.019109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896529943498995:11849]
2025-09-30T14:57:32.019126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:32.019147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:32.019167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:32.019171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:32.019222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896529943498995:11849]
2025-09-30T14:57:32.019226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:32.019538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:32.019554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:32.019556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:32.019563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:32.020085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2589
2025-09-30T14:57:32.020134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2589
2025-09-30T14:57:32.022915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738323518:11389], now have 1 active actors on pipe
2025-09-30T14:57:32.022944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896525738323389:2454], now have 1 active actors on pipe
2025-09-30T14:57:32.022981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.022991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.023049Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:32.023064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:32.023071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:32.023074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:32.023092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:32.023115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:32.023158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:32.025218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.025243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.025285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:32.025983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a26e08f2-19c67cb4-dc24b09e-9dcca5af_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:32.025500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2590 partition: 0 MaxSeqNo: 42 sessionId: src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0
2025-09-30T14:57:32.028689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0] Write session: try to update token
2025-09-30T14:57:32.028706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:32.042093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:32.042126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:32.042130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:32.042133Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:32.042144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896529943498995:11849]
2025-09-30T14:57:32.042150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896529943498995:11849]
2025-09-30T14:57:32.042156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896529943498995:11849]
2025-09-30T14:57:32.042209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:32.042214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:32.042222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:32.042224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.042227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:32.042228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:32.042549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:32.047008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896530033290871:10873]
2025-09-30T14:57:32.047555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2589, pipe: [1:7555896530033290871:10873]
2025-09-30T14:57:32.056584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2590 sessionId: src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:32.059390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:32.165741Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:32.166354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033290871:10873], now have 1 active actors on pipe
2025-09-30T14:57:32.166384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.166390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.166923Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:32.167882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:32.167899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0] Write session will restart in 0.005230s
2025-09-30T14:57:32.167930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0] Write session: Do CDS request
2025-09-30T14:57:32.167941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:32.167356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:32.167385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:32.167470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2590 reason: error at write: Disconnected sessionId: src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0
2025-09-30T14:57:32.167682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2590 sessionId: src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0 is DEAD
2025-09-30T14:57:32.167995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:32.168039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896530033290871:10873]
2025-09-30T14:57:32.174935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:32.177718Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:32.177748Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2591
2025-09-30T14:57:32.179114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2591 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:32.179178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2591 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:32.179194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2591 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:32.179199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:32.180543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2591 sessionId:  describe result for acl check
2025-09-30T14:57:32.180593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:32.180596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:32.180599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:32.180607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896530033290891:11393] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:32.181293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896530033290891:11393] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:32.186624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896530033290891:11393] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:32.191409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:32.191799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896530033290891:11393] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:32.191834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896530033290891:11393] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:32.191842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896530033290891:11393] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:32.191855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2591 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:32.196497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:32.196815Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:32.196832Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:32.196845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:32.196907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:32.196962Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896529943499194:11853]
2025-09-30T14:57:32.197752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:32.198234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:32.198285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:32.198649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:32.199065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.199067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.199068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.199070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.199071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.199073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.199074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.199076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.199077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.199079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.199081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.199083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.199084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.199085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.199087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.199094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.199105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.199109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.199113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.199117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.199121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.199126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.199130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.199133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.199138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.199142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.199146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.199150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.199154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.199158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.199168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.199177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.199184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.199190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.199196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.199201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.199205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.199210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.199215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.199222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.199227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.199232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.199237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.199264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.199270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.199275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.199282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.199287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.199292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.199297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.199301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.199306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.199312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.199316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.199322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.199327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.199332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.199337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.199345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.199351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.199393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:32.215671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:32.216603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:32.216624Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:32.216628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:32.216633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:32.216641Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2590 [2:7555896529943499194:11853]
2025-09-30T14:57:32.216661Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:32.216682Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:32.216692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:32.216696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:32.216699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:32.216716Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:32.216730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:32.216738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:32.216807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.216816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.216818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.216823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:32.216826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:32.216910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:32.216919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.216938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.216958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.216982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:32.217006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896529943499188:11853]
2025-09-30T14:57:32.217016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896529943499188:11853]
2025-09-30T14:57:32.217018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896529943499188:11853]
2025-09-30T14:57:32.217035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:32.217069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:32.217090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:32.217099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:32.217137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:32.217146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896529943499188:11853]
2025-09-30T14:57:32.217149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:32.217153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:32.217157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:32.217166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:32.217294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033291051:11393], now have 1 active actors on pipe
2025-09-30T14:57:32.217321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033290876:2454], now have 1 active actors on pipe
2025-09-30T14:57:32.217708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2590
2025-09-30T14:57:32.217749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2590
2025-09-30T14:57:32.218094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.218112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.218142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91ecad0c-27a83613-d242a10-fc131f17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:32.218153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:32.218164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:32.218167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:32.218177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:32.218190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:32.218207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:32.218600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.218611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.218630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:32.218775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2591 partition: 0 MaxSeqNo: 42 sessionId: src_id|91ecad0c-27a83613-d242a10-fc131f17_0
2025-09-30T14:57:32.219216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb49c2b4-fbb96fc5-21f28c28-a7cd4cf0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|91ecad0c-27a83613-d242a10-fc131f17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:32.223511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ecad0c-27a83613-d242a10-fc131f17_0] Write session: try to update token
2025-09-30T14:57:32.223539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ecad0c-27a83613-d242a10-fc131f17_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:32.243547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:32.243572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:32.243575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:32.243577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:32.243592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896529943499188:11853]
2025-09-30T14:57:32.243597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896529943499188:11853]
2025-09-30T14:57:32.243602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896529943499188:11853]
2025-09-30T14:57:32.243647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:32.243653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.243656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:32.243663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:32.243671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:32.243675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:32.243798Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:32.249218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2591 sessionId: src_id|91ecad0c-27a83613-d242a10-fc131f17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:32.252232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:32.270363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896530033291071:10873]
2025-09-30T14:57:32.272200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2590, pipe: [1:7555896530033291071:10873]
2025-09-30T14:57:32.360149Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:32.360605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.360618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.360666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033291071:10873], now have 1 active actors on pipe
2025-09-30T14:57:32.361160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896530033291071:10873]
2025-09-30T14:57:32.361209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:32.361212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:32.361273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2591 reason: error at write: Disconnected sessionId: src_id|91ecad0c-27a83613-d242a10-fc131f17_0
2025-09-30T14:57:32.361469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2591 sessionId: src_id|91ecad0c-27a83613-d242a10-fc131f17_0 is DEAD
2025-09-30T14:57:32.361612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:32.361203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:32.364678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ecad0c-27a83613-d242a10-fc131f17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:32.364693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ecad0c-27a83613-d242a10-fc131f17_0] Write session will restart in 0.006162s
2025-09-30T14:57:32.364718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ecad0c-27a83613-d242a10-fc131f17_0] Write session: Do CDS request
2025-09-30T14:57:32.364741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ecad0c-27a83613-d242a10-fc131f17_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:32.375725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91ecad0c-27a83613-d242a10-fc131f17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:32.379646Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:32.379667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2592
2025-09-30T14:57:32.379852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2592 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:32.379886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2592 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:32.379892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2592 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:32.379896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:32.380882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2592 sessionId:  describe result for acl check
2025-09-30T14:57:32.380929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:32.380939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:32.380941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:32.380948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896530033291157:11399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:32.381482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896530033291157:11399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:32.386735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896530033291157:11399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:32.392487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896530033291157:11399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:32.392512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896530033291157:11399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:32.392515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896530033291157:11399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:32.392525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2592 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:32.392586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:32.395913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:32.396145Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:32.396155Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:32.396167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:32.396222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:32.396280Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896529943499375:11855]
2025-09-30T14:57:32.396865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:32.397245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:32.397318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:32.397655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:32.397730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.397731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.397733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.397734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.397735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.397737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.397738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.397739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.397741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.397742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.397744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.397745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.397746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.397748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.397749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.397755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.397765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.397769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.397773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.397777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.397781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.397785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.397788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.397793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.397797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.397802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.397806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.397811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.397815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.397819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.397827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.397835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.397842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.397848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.397853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.397859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.397864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.397870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.397875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.397881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.397885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.397891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.397896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.397901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.397906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.397911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.397916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.397922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.397927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.397932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.397939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.397945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.397950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.397955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.397961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.397964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.397967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.397970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.397973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.397976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.398001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:32.405809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:32.407065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:32.407072Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:32.407074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:32.407078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:32.407084Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2591 [2:7555896529943499375:11855]
2025-09-30T14:57:32.407098Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:32.407113Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:32.407116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:32.407118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:32.407119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:32.407133Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:32.407139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:32.407144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:32.407204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.407206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.407209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.407213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:32.407216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:32.407309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:32.407312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.407326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.407337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.407354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:32.407374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033291265:11399], now have 1 active actors on pipe
2025-09-30T14:57:32.407377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033291089:2454], now have 1 active actors on pipe
2025-09-30T14:57:32.407385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896529943499369:11855]
2025-09-30T14:57:32.407388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896529943499369:11855]
2025-09-30T14:57:32.407390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896529943499369:11855]
2025-09-30T14:57:32.407400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:32.407413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:32.407415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:32.407418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:32.407420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:32.407430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:32.407433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:32.407472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896529943499369:11855]
2025-09-30T14:57:32.407483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:32.407707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:32.407724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2591
2025-09-30T14:57:32.407761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2591
2025-09-30T14:57:32.407941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.407952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.407982Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:32.407991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:32.407995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:32.407997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:32.408009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:32.408021Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:32.408038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:32.415375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.415409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.415456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:32.416075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2592 partition: 0 MaxSeqNo: 42 sessionId: src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0
2025-09-30T14:57:32.419545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91ecad0c-27a83613-d242a10-fc131f17_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:32.422577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0] Write session: try to update token
2025-09-30T14:57:32.422598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:32.423269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:32.423289Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:32.423292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:32.423294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:32.423302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896529943499369:11855]
2025-09-30T14:57:32.423308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896529943499369:11855]
2025-09-30T14:57:32.423313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896529943499369:11855]
2025-09-30T14:57:32.423354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:32.423359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.423361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:32.423374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:32.423390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:32.423394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:32.423499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:32.446671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2592 sessionId: src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:32.449444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:32.461214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896530033291278:10873]
2025-09-30T14:57:32.461540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2591, pipe: [1:7555896530033291278:10873]
2025-09-30T14:57:32.545147Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:32.545695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.545719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.545738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033291278:10873], now have 1 active actors on pipe
2025-09-30T14:57:32.546035Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:32.546065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896530033291278:10873]
2025-09-30T14:57:32.546095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:32.546098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:32.546172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2592 reason: error at write: Disconnected sessionId: src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0
2025-09-30T14:57:32.546012Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:32.546388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2592 sessionId: src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0 is DEAD
2025-09-30T14:57:32.546603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:32.546615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0] Write session will restart in 0.009048s
2025-09-30T14:57:32.546650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0] Write session: Do CDS request
2025-09-30T14:57:32.546659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:32.557738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:32.557877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:32.557900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2593
2025-09-30T14:57:32.558162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2593 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:32.558211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2593 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:32.558222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2593 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:32.558227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:32.558806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2593 sessionId:  describe result for acl check
2025-09-30T14:57:32.558847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:32.558854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:32.558857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:32.558863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896530033291344:11403] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:32.559447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896530033291344:11403] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:32.561901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896530033291344:11403] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:32.566269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896530033291344:11403] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:32.566287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896530033291344:11403] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:32.566291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896530033291344:11403] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:32.566299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2593 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:32.566879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:32.570143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:32.570634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:32.570649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:32.570663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:32.570750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:32.570798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896529943499559:11858]
2025-09-30T14:57:32.571524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:32.571902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:32.571957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:32.572327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:32.572395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.572402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.572403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.572405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.572406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.572408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.572410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.572411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.572413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.572414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.572416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.572417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.572419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.572420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.572422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.572427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.572438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.572443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.572447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.572451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.572456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.572459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.572463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.572467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.572471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.572474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.572478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.572482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.572486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.572489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.572498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.572506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.572515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.572520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.572525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.572530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.572534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.572539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.572543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.572549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.572554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.572559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.572565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.572570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.572578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.572584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.572589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.572593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.572598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.572603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.572607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.572612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.572616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.572621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.572625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.572630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.572634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.572639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.572644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.572650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.572716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:32.579537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:32.580438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:32.580446Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:32.580449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:32.580453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:32.580461Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2592 [2:7555896529943499559:11858]
2025-09-30T14:57:32.580479Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:32.580497Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:32.580500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:32.580504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:32.580507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:32.580523Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:32.580530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:32.580537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:32.580604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.580606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.580608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.580612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:32.580615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:32.580686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:32.580689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.580702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.580715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.580733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:32.580749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896529943499552:11858]
2025-09-30T14:57:32.580752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896529943499552:11858]
2025-09-30T14:57:32.580755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896529943499552:11858]
2025-09-30T14:57:32.580771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:32.580786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:32.580803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:32.580807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:32.580836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:32.580839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896529943499552:11858]
2025-09-30T14:57:32.580841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:32.580842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:32.580844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:32.580851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:32.581163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033291459:11403], now have 1 active actors on pipe
2025-09-30T14:57:32.581191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033291280:2454], now have 1 active actors on pipe
2025-09-30T14:57:32.581228Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2592
2025-09-30T14:57:32.581242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2592
2025-09-30T14:57:32.581350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.581371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.581405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5abdb681-592e3059-4e905738-40f76ded_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:32.581423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:32.581428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:32.581431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:32.581442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:32.581460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:32.581486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:32.583504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.583522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.583548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:32.583649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2593 partition: 0 MaxSeqNo: 42 sessionId: src_id|5abdb681-592e3059-4e905738-40f76ded_0
2025-09-30T14:57:32.584032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1918189-6dbdbf6-cd9aa391-3819dc98_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5abdb681-592e3059-4e905738-40f76ded_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:32.586849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdb681-592e3059-4e905738-40f76ded_0] Write session: try to update token
2025-09-30T14:57:32.586869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdb681-592e3059-4e905738-40f76ded_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:32.596493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:32.596521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:32.596524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:32.596526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:32.596537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896529943499552:11858]
2025-09-30T14:57:32.596543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896529943499552:11858]
2025-09-30T14:57:32.596548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896529943499552:11858]
2025-09-30T14:57:32.596590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:32.596597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.596600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:32.596609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:32.596617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:32.596622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:32.596759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:32.608385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2593 sessionId: src_id|5abdb681-592e3059-4e905738-40f76ded_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:32.611350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:32.646540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896530033291484:10873]
2025-09-30T14:57:32.647405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2592, pipe: [1:7555896530033291484:10873]
2025-09-30T14:57:32.729406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:32.730021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.730032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.730052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033291484:10873], now have 1 active actors on pipe
2025-09-30T14:57:32.730288Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:32.730312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:32.730330Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:32.730347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896530033291484:10873]
2025-09-30T14:57:32.730374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:32.730394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2593 reason: error at write: Disconnected sessionId: src_id|5abdb681-592e3059-4e905738-40f76ded_0
2025-09-30T14:57:32.730751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdb681-592e3059-4e905738-40f76ded_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:32.730761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdb681-592e3059-4e905738-40f76ded_0] Write session will restart in 0.005779s
2025-09-30T14:57:32.730784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdb681-592e3059-4e905738-40f76ded_0] Write session: Do CDS request
2025-09-30T14:57:32.730789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdb681-592e3059-4e905738-40f76ded_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:32.730593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2593 sessionId: src_id|5abdb681-592e3059-4e905738-40f76ded_0 is DEAD
2025-09-30T14:57:32.738364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdb681-592e3059-4e905738-40f76ded_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:32.738469Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:32.738489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2594
2025-09-30T14:57:32.738625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2594 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:32.738661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2594 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:32.738673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2594 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:32.738678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:32.739223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2594 sessionId:  describe result for acl check
2025-09-30T14:57:32.739284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:32.739292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:32.739294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:32.739299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896530033291506:11415] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:32.739913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896530033291506:11415] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:32.743784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896530033291506:11415] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:32.752121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896530033291506:11415] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:32.752143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896530033291506:11415] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:32.752147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896530033291506:11415] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:32.752157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2594 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:32.768113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:32.771166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:32.771391Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:32.771400Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:32.771408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:32.771481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:32.771528Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896529943499778:11872]
2025-09-30T14:57:32.772026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:32.773245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:32.773307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:32.773694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:32.773765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.773767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.773768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.773770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.773771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.773772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.773774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.773775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.773776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.773778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.773779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.773780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.773781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.773783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.773784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.773790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.773800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.773805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.773809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.773813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.773818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.773822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.773826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.773831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.773835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.773839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.773843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.773847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.773851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.773855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.773867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.773875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.773881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.773887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.773891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.773898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.773902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.773910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.773915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.773920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.773924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.773930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.773934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.773939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.773943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.773948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.773953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.773958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.773963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.773968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.773973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.773979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.773983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.773989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.773993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.773999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.774003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.774008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.774012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.774018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.774062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:32.779982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:32.781199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:32.781207Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:32.781210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:32.781214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:32.781222Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2593 [2:7555896529943499778:11872]
2025-09-30T14:57:32.781239Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:32.781258Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:32.781261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:32.781266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:32.781268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:32.781289Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:32.781297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:32.781306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:32.781373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.781376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.781379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.781382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:32.781385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:32.781461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:32.781466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.781480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.781494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.781515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:32.781532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896529943499773:11872]
2025-09-30T14:57:32.781535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896529943499773:11872]
2025-09-30T14:57:32.781537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896529943499773:11872]
2025-09-30T14:57:32.781545Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:32.781561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:32.781563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:32.781565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:32.781567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:32.781579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:32.781582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:32.781592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033291498:2454], now have 1 active actors on pipe
2025-09-30T14:57:32.781627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033291546:11415], now have 1 active actors on pipe
2025-09-30T14:57:32.781629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896529943499773:11872]
2025-09-30T14:57:32.781644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:32.781672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:32.781918Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2593
2025-09-30T14:57:32.781959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2593
2025-09-30T14:57:32.785862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.785888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.785925Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79700739-2006e583-2c113fae-218f1479_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:32.785939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:32.785944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:32.785947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:32.785961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:32.785980Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:32.785999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:32.786345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.786366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.786386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:32.786507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2594 partition: 0 MaxSeqNo: 42 sessionId: src_id|79700739-2006e583-2c113fae-218f1479_0
2025-09-30T14:57:32.786931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5abdb681-592e3059-4e905738-40f76ded_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|79700739-2006e583-2c113fae-218f1479_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:32.789915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79700739-2006e583-2c113fae-218f1479_0] Write session: try to update token
2025-09-30T14:57:32.789936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79700739-2006e583-2c113fae-218f1479_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:32.801513Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:32.801540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:32.801551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896529943499773:11872]
2025-09-30T14:57:32.801604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:32.801819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:32.801977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:32.802125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:32.802276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:32.802480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:32.802520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:32.802659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:32.805672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:32.805691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:32.805693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:32.805694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:32.805701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896529943499773:11872]
2025-09-30T14:57:32.805705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896529943499773:11872]
2025-09-30T14:57:32.805708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896529943499773:11872]
2025-09-30T14:57:32.805743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:32.805750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.805752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:32.805752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:32.805757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:32.805771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:32.805893Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:32.807018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2594 sessionId: src_id|79700739-2006e583-2c113fae-218f1479_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:32.809795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:32.830409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896530033291689:10873]
2025-09-30T14:57:32.830627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2593, pipe: [1:7555896530033291689:10873]
2025-09-30T14:57:32.925112Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:32.925584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.925604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.925625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033291689:10873], now have 1 active actors on pipe
2025-09-30T14:57:32.925990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:32.927749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79700739-2006e583-2c113fae-218f1479_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:32.927769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79700739-2006e583-2c113fae-218f1479_0] Write session will restart in 0.009915s
2025-09-30T14:57:32.927321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:32.927407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2594 reason: status is not ok: tablet will be restarted right now sessionId: src_id|79700739-2006e583-2c113fae-218f1479_0
2025-09-30T14:57:32.927567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2594 sessionId: src_id|79700739-2006e583-2c113fae-218f1479_0 is DEAD
2025-09-30T14:57:32.927731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:32.927796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79700739-2006e583-2c113fae-218f1479_0] Write session: Do CDS request
2025-09-30T14:57:32.927834Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79700739-2006e583-2c113fae-218f1479_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:32.928092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896530033291689:10873]
2025-09-30T14:57:32.939726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79700739-2006e583-2c113fae-218f1479_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:32.939855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:32.939873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2595
2025-09-30T14:57:32.939992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2595 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:32.940018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2595 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:32.940023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2595 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:32.940028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:32.940796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2595 sessionId:  describe result for acl check
2025-09-30T14:57:32.940845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:32.940851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:32.940853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:32.940858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896530033291713:11419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:32.941389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896530033291713:11419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:32.945167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896530033291713:11419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:32.951031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896530033291713:11419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:32.951051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896530033291713:11419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:32.951053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896530033291713:11419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:32.951061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2595 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:32.954602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:32.956757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:32.956980Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:32.956984Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:32.956997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:32.957077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:32.957114Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896529943499962:11874]
2025-09-30T14:57:32.957721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:32.958095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:32.958157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:32.958482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:32.958575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.958583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.958584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.958585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.958586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.958587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.958589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.958591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.958592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.958593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.958594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.958595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.958596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.958598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.958599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.958604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.958615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.958619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.958623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.958627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.958632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.958636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.958641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.958645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.958649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.958653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.958657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.958661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.958666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.958669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.958677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.958685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:32.958691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.958697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:32.958702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.958707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:32.958712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.958718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:32.958723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.958728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:32.958732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.958737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:32.958741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.958746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:32.958758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.958763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:32.958768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.958773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:32.958778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.958783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:32.958796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.958807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.958811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.958820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.958826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.958836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.958841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.958847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:32.958851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.958856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:32.958897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:32.964419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:32.965421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:32.965435Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:32.965437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:32.965440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:32.965445Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2594 [2:7555896529943499962:11874]
2025-09-30T14:57:32.965459Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:32.965473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:32.965477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:32.965480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:32.965482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:32.965498Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:32.965518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:32.965531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:32.965593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.965600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.965602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.965604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:32.965606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:32.965662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:32.965670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.965679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:32.965685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:32.965695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:32.965708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896529943499957:11874]
2025-09-30T14:57:32.965710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896529943499957:11874]
2025-09-30T14:57:32.966216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2594
2025-09-30T14:57:32.965711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896529943499957:11874]
2025-09-30T14:57:32.965717Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:32.965729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:32.966252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2594
2025-09-30T14:57:32.965742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:32.965745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:32.965745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:32.965747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:32.965747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:32.965992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033291867:11419], now have 1 active actors on pipe
2025-09-30T14:57:32.965997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896530033291691:2454], now have 1 active actors on pipe
2025-09-30T14:57:32.966000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896529943499957:11874]
2025-09-30T14:57:32.966010Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:32.966103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:32.966658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.966667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.966690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:32.966696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:32.966699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:32.966701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:32.966709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:32.966718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:32.966730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:32.969404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:32.969416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:32.969436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:32.969589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2595 partition: 0 MaxSeqNo: 42 sessionId: src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0
2025-09-30T14:57:32.969963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79700739-2006e583-2c113fae-218f1479_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:32.972808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0] Write session: try to update token
2025-09-30T14:57:32.972828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:32.981264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:32.981287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:32.981290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:32.981292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:32.981302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896529943499957:11874]
2025-09-30T14:57:32.981307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896529943499957:11874]
2025-09-30T14:57:32.981311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896529943499957:11874]
2025-09-30T14:57:32.981352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:32.981352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:32.981359Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:32.981360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:32.981363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:32.981368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:32.981503Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:32.997413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2595 sessionId: src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:33.000254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:33.028554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896534328259179:10873]
2025-09-30T14:57:33.028838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2594, pipe: [1:7555896534328259179:10873]
2025-09-30T14:57:33.096873Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:33.097213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.097225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.097241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328259179:10873], now have 1 active actors on pipe
2025-09-30T14:57:33.097569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:33.097923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:33.098004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2595 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0
2025-09-30T14:57:33.098182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896534328259179:10873]
2025-09-30T14:57:33.098182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2595 sessionId: src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0 is DEAD
2025-09-30T14:57:33.098198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:33.099447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:33.099457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0] Write session will restart in 0.005692s
2025-09-30T14:57:33.099486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0] Write session: Do CDS request
2025-09-30T14:57:33.099492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:33.106842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:33.106944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:33.106963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2596
2025-09-30T14:57:33.107415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2596 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:33.107446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2596 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:33.107451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2596 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:33.107455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:33.107897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2596 sessionId:  describe result for acl check
2025-09-30T14:57:33.107925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:33.107927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:33.107929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:33.107935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896534328259206:11423] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:33.108472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896534328259206:11423] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:33.111758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896534328259206:11423] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:33.114658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896534328259206:11423] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:33.114686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896534328259206:11423] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:33.114690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896534328259206:11423] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:33.114699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2596 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:33.115345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:33.118376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:33.118628Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:33.118639Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:33.118651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:33.118719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:33.118770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896534238467457:11878]
2025-09-30T14:57:33.119495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:33.119875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:33.119929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:33.120289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:33.120358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.120366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.120367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.120369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.120370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.120371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.120373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.120374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.120376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.120377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.120378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.120380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.120381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.120383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.120384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.120390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.120401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.120406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.120410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.120415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.120419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.120424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.120429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.120433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.120438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.120443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.120447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.120452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.120456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.120461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.120469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.120477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.120485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.120495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.120500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.120506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.120511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.120518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.120523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.120530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.120536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.120542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.120548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.120554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.120559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.120566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.120573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.120579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.120586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.120591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.120596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.120602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.120612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.120618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.120628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.120634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.120643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.120649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.120660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.120666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.120720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:33.127715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:33.128608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:33.128625Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:33.128629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:33.128633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:33.128640Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2595 [2:7555896534238467457:11878]
2025-09-30T14:57:33.128658Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:33.128675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:33.128678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:33.128681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:33.128684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:33.128700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:33.128712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:33.128719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:33.128799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.128806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.128809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.128813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:33.128816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:33.129171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:33.129180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.129194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.129207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.129228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:33.129251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896534238467452:11878]
2025-09-30T14:57:33.129258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896534238467452:11878]
2025-09-30T14:57:33.129260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896534238467452:11878]
2025-09-30T14:57:33.129274Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:33.129298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:33.129315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:33.129319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:33.129354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896534238467452:11878]
2025-09-30T14:57:33.129371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:33.129515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:33.129522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:33.129524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:33.129529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:33.130167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328259363:11423], now have 1 active actors on pipe
2025-09-30T14:57:33.130180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328259182:2454], now have 1 active actors on pipe
2025-09-30T14:57:33.130710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.130724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.130755Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:33.130773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:33.130782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:33.130788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:33.130801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:33.130818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:33.130842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:33.131080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.131089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.131103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:33.131643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9510c932-260fb16f-dd8b2dd9-46384f5e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:33.130012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2595
2025-09-30T14:57:33.130047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2595
2025-09-30T14:57:33.131194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2596 partition: 0 MaxSeqNo: 42 sessionId: src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0
2025-09-30T14:57:33.134562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0] Write session: try to update token
2025-09-30T14:57:33.134582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:33.155015Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:33.155041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:33.155043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:33.155046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:33.155055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896534238467452:11878]
2025-09-30T14:57:33.155060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896534238467452:11878]
2025-09-30T14:57:33.155064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896534238467452:11878]
2025-09-30T14:57:33.155104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:33.155111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.155114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:33.155307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:33.156740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:33.156758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:33.156762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:33.159879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2596 sessionId: src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:33.162628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:33.198549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896534328259380:10873]
2025-09-30T14:57:33.198868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2595, pipe: [1:7555896534328259380:10873]
2025-09-30T14:57:33.274383Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:33.274668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.274684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.274727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328259380:10873], now have 1 active actors on pipe
2025-09-30T14:57:33.274986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896534328259380:10873]
2025-09-30T14:57:33.275029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:33.275032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:33.275092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2596 reason: error at write: Disconnected sessionId: src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0
2025-09-30T14:57:33.275288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2596 sessionId: src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0 is DEAD
2025-09-30T14:57:33.275345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:33.275523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:33.279360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:33.279378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0] Write session will restart in 0.005257s
2025-09-30T14:57:33.279407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0] Write session: Do CDS request
2025-09-30T14:57:33.279417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:33.287768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:33.287871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:33.287890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2597
2025-09-30T14:57:33.288800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2597 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:33.288856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2597 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:33.288862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2597 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:33.288866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:33.289265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2597 sessionId:  describe result for acl check
2025-09-30T14:57:33.289304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:33.289306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:33.289310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:33.289318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896534328259421:11431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:33.289874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896534328259421:11431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:33.292908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896534328259421:11431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:33.298716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896534328259421:11431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:33.298742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896534328259421:11431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:33.298745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896534328259421:11431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:33.298754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2597 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:33.304109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:33.306739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:33.307005Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:33.307009Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:33.307035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:33.307096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:33.307141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896534238467643:11880]
2025-09-30T14:57:33.307863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:33.308219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:33.308262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:33.308621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:33.308679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.308680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.308682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.308683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.308685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.308687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.308688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.308690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.308691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.308693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.308694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.308696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.308697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.308699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.308700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.308706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.308717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.308721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.308725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.308730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.308734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.308739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.308743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.308748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.308754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.308758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.308762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.308766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.308770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.308775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.308783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.308792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.308798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.308804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.308809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.308816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.308821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.308827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.308833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.308839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.308844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.308850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.308858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.308864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.308870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.308876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.308881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.308888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.308892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.308900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.308905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.308911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.308917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.308923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.308928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.308934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.308941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.308946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.308951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.308956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.309006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:33.315826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:33.317087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:33.317112Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:33.317115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:33.317121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:33.317128Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2596 [2:7555896534238467643:11880]
2025-09-30T14:57:33.317147Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:33.317164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:33.317174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:33.317176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:33.317179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:33.317197Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:33.317211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:33.317219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:33.317289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.317300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.317303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.317307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:33.317310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:33.317379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:33.317387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.317403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.317417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.317444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:33.317465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896534238467637:11880]
2025-09-30T14:57:33.317473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896534238467637:11880]
2025-09-30T14:57:33.317475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896534238467637:11880]
2025-09-30T14:57:33.317485Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:33.317496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:33.317499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:33.317500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:33.317502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:33.317518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:33.317526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:33.317537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328259388:2454], now have 1 active actors on pipe
2025-09-30T14:57:33.317546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328259550:11431], now have 1 active actors on pipe
2025-09-30T14:57:33.317580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896534238467637:11880]
2025-09-30T14:57:33.317594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:33.317645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:33.318151Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2596
2025-09-30T14:57:33.318205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2596
2025-09-30T14:57:33.321191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.321214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.321249Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fee6ae69-85cdc8df-85906995-d383c744_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:33.321263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:33.321278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:33.321281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:33.321294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:33.321310Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:33.321332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:33.321856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.321868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.321886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:33.322013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2597 partition: 0 MaxSeqNo: 42 sessionId: src_id|fee6ae69-85cdc8df-85906995-d383c744_0
2025-09-30T14:57:33.322442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be53dea0-3209ef68-63511ac5-ffa0c1db_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fee6ae69-85cdc8df-85906995-d383c744_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:33.325341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fee6ae69-85cdc8df-85906995-d383c744_0] Write session: try to update token
2025-09-30T14:57:33.325365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fee6ae69-85cdc8df-85906995-d383c744_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:33.339437Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:33.339458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:33.339461Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:33.339463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:33.339472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896534238467637:11880]
2025-09-30T14:57:33.339477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896534238467637:11880]
2025-09-30T14:57:33.339482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896534238467637:11880]
2025-09-30T14:57:33.339521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:33.339528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.339531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:33.339693Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:33.342330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:33.342351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:33.342356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:33.360162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2597 sessionId: src_id|fee6ae69-85cdc8df-85906995-d383c744_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:33.362949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:33.375149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896534328259599:10873]
2025-09-30T14:57:33.375625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2596, pipe: [1:7555896534328259599:10873]
2025-09-30T14:57:33.460972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:33.461486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.461510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.461531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328259599:10873], now have 1 active actors on pipe
2025-09-30T14:57:33.461788Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:33.465061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:33.465078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896534328259599:10873]
2025-09-30T14:57:33.465118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:33.465192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2597 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fee6ae69-85cdc8df-85906995-d383c744_0
2025-09-30T14:57:33.465370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2597 sessionId: src_id|fee6ae69-85cdc8df-85906995-d383c744_0 is DEAD
2025-09-30T14:57:33.465500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee6ae69-85cdc8df-85906995-d383c744_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:33.465507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee6ae69-85cdc8df-85906995-d383c744_0] Write session will restart in 0.008362s
2025-09-30T14:57:33.465530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee6ae69-85cdc8df-85906995-d383c744_0] Write session: Do CDS request
2025-09-30T14:57:33.465535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee6ae69-85cdc8df-85906995-d383c744_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:33.475122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fee6ae69-85cdc8df-85906995-d383c744_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:33.475232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:33.475259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2598
2025-09-30T14:57:33.475393Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2598 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:33.475425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2598 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:33.475436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2598 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:33.475440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:33.475889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2598 sessionId:  describe result for acl check
2025-09-30T14:57:33.475912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:33.475914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:33.475916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:33.475922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896534328259696:11435] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:33.476433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896534328259696:11435] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:33.479499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:33.478745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896534328259696:11435] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:33.481858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:33.482063Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:33.482072Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:33.482083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:33.482133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:33.482177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896534238467829:11882]
2025-09-30T14:57:33.482836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:33.483073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:33.483114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:33.483453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:33.483527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.483534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.483535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.483536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.483537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.483539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.483540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.483541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.483542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.483544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.483545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.483546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.483547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.483549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.483550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.483555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.483565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.483568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.483572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.483575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.483579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.483583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.483587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.483590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.483594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.483597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.483618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.483623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.483626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.483629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.483637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.483647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.483652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.483658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.483663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.483668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.483672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.483685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.483689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.483695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.483700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.483705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.483709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.483713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.483717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.483721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.483725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.483730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.483734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.483745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.483750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.483760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.483764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.483770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.483781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.483786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.483791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.483797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.483802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.483807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.483859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:33.484112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896534328259696:11435] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:33.484132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896534328259696:11435] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:33.484136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896534328259696:11435] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:33.484145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2598 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:33.489271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:33.490491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:33.490509Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:33.490512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:33.490516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:33.490524Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2597 [2:7555896534238467829:11882]
2025-09-30T14:57:33.490541Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:33.490557Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:33.490560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:33.490563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:33.490566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:33.490581Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:33.490588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:33.490595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:33.490653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.490663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.490665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.490668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:33.490671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:33.490723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:33.490730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.490739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.490745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.490759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:33.490775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896534238467824:11882]
2025-09-30T14:57:33.490777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896534238467824:11882]
2025-09-30T14:57:33.490779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896534238467824:11882]
2025-09-30T14:57:33.490788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:33.490799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:33.490801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:33.490802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:33.490805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:33.490814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:33.490817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:33.490827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328259790:11435], now have 1 active actors on pipe
2025-09-30T14:57:33.490837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328259601:2454], now have 1 active actors on pipe
2025-09-30T14:57:33.490867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896534238467824:11882]
2025-09-30T14:57:33.490879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:33.490887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:33.490893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2597
2025-09-30T14:57:33.491068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2597
2025-09-30T14:57:33.491205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.491239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.491308Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:33.491325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:33.491330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:33.491332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:33.491345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:33.491357Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:33.491375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:33.491659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.491671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.491691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:33.491788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2598 partition: 0 MaxSeqNo: 42 sessionId: src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0
2025-09-30T14:57:33.492161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fee6ae69-85cdc8df-85906995-d383c744_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:33.494897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0] Write session: try to update token
2025-09-30T14:57:33.494914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:33.509769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2598 sessionId: src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:33.510858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:33.510886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:33.510895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896534238467824:11882]
2025-09-30T14:57:33.510944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:33.510960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:33.511117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:33.511283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:33.511432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:33.511581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:33.511779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:33.511824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:33.512616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:33.512827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.512859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.512889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:33.512975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:33.517536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:33.517557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:33.517559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:33.517561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:33.517571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896534238467824:11882]
2025-09-30T14:57:33.517575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896534238467824:11882]
2025-09-30T14:57:33.517579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896534238467824:11882]
2025-09-30T14:57:33.517616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:33.517622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.517625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:33.517632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:33.517650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:33.517655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:33.517761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:33.565140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896534328259797:10873]
2025-09-30T14:57:33.565417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2597, pipe: [1:7555896534328259797:10873]
2025-09-30T14:57:33.638441Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:33.651658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:33.651677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:33.651706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2598 reason: error at write: Disconnected sessionId: src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0
2025-09-30T14:57:33.651886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2598 sessionId: src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0 is DEAD
2025-09-30T14:57:33.651957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896534328259797:10873]
2025-09-30T14:57:33.651983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:33.647336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.647367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.647544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:33.647607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:33.647671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:33.647734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:33.647776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:33.647782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:33.647858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:33.647915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:33.647981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:33.648047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:33.648156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:33.648160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:33.648228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:33.648288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:33.648353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:33.648412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:33.648454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:33.648461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:33.648531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:33.648595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:33.648660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:33.648721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:33.649236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:33.649240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:33.649312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:33.649370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:33.649430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:33.649493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:33.649534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:33.649537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:33.649606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:33.649665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:33.649737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:33.649799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:33.649842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:33.649845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:33.649913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:33.649973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:33.650038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:33.650098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:33.650140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:33.650143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:33.650212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:33.650269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:33.650328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:33.650391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:33.650433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:33.650436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:33.650524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:33.650585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:33.650646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:33.650710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:33.650754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:33.650758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:33.650830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:33.650889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:33.650951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:33.651014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:33.651076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:33.651079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:33.651159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328259797:10873], now have 1 active actors on pipe
2025-09-30T14:57:33.651670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:33.652262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:33.652275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0] Write session will restart in 0.007290s
2025-09-30T14:57:33.652300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0] Write session: Do CDS request
2025-09-30T14:57:33.652305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:33.660837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:33.660976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:33.660990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2599
2025-09-30T14:57:33.663349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2599 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:33.663396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2599 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:33.663402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2599 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:33.663406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:33.663891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2599 sessionId:  describe result for acl check
2025-09-30T14:57:33.663925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:33.663927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:33.663929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:33.663935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896534328259819:11439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:33.664385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896534328259819:11439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:33.671944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896534328259819:11439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:33.675170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896534328259819:11439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:33.675192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896534328259819:11439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:33.675195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896534328259819:11439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:33.675202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2599 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:33.675403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:33.678093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:33.678396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:33.678408Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:33.678420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:33.678487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:33.678541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896534238468034:11887]
2025-09-30T14:57:33.679204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:33.683657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:33.683738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:33.684125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:33.684188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.684189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.684190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.684192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.684193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.684199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.684200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.684201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.684203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.684204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.684206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.684207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.684208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.684210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.684211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.684217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.684227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.684230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.684234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.684239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.684243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.684248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.684252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.684256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.684261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.684265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.684269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.684273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.684277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.684281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.684288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.684297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.684302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.684308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.684315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.684320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.684327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.684332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.684337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.684342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.684347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.684352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.684357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.684362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.684369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.684374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.684378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.684384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.684388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.684393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.684398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.684404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.684409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.684414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.684419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.684424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.684429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.684435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.684439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.684445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.684490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:33.693493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:33.694470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:33.694492Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:33.694494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:33.694499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:33.694505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2598 [2:7555896534238468034:11887]
2025-09-30T14:57:33.694523Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:33.694549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:33.694553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:33.694556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:33.694559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:33.694574Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:33.694581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:33.694594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:33.694657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.694669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.694671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.694674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:33.694676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:33.694758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:33.694765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.694778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.694794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.694816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:33.694843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328259800:2454], now have 1 active actors on pipe
2025-09-30T14:57:33.694847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328259996:11439], now have 1 active actors on pipe
2025-09-30T14:57:33.694853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896534238468028:11887]
2025-09-30T14:57:33.694855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896534238468028:11887]
2025-09-30T14:57:33.694857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896534238468028:11887]
2025-09-30T14:57:33.694870Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:33.694882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:33.694885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:33.694886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:33.694888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:33.694902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:33.694910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:33.694948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896534238468028:11887]
2025-09-30T14:57:33.694959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:33.694968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:33.695517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2598
2025-09-30T14:57:33.695558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2598
2025-09-30T14:57:33.695661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.695676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.695704Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:33.695719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:33.695723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:33.695726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:33.695736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:33.695747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:33.695764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:33.695962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.695969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.695982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:33.696087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2599 partition: 0 MaxSeqNo: 42 sessionId: src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0
2025-09-30T14:57:33.696487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7dfa3787-5f2c0556-26d58c4f-1ecc2961_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:33.699358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0] Write session: try to update token
2025-09-30T14:57:33.699380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:33.708467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:33.708496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:33.708505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896534238468028:11887]
2025-09-30T14:57:33.708551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:33.708561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:33.708728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:33.708873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:33.709019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:33.709188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:33.709392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:33.709426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:33.718542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2599 sessionId: src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:33.720528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:33.720550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:33.720553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:33.720555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:33.720564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896534238468028:11887]
2025-09-30T14:57:33.720569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896534238468028:11887]
2025-09-30T14:57:33.720573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896534238468028:11887]
2025-09-30T14:57:33.720613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:33.720622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.720632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:33.720637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:33.720644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:33.720648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:33.720788Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:33.721377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:33.752011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896534328260020:10873]
2025-09-30T14:57:33.754407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2598, pipe: [1:7555896534328260020:10873]
2025-09-30T14:57:33.832686Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:33.833408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.833426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.833447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328260020:10873], now have 1 active actors on pipe
2025-09-30T14:57:33.833698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896534328260020:10873]
2025-09-30T14:57:33.833734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:33.833779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:33.833866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2599 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0
2025-09-30T14:57:33.834053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2599 sessionId: src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0 is DEAD
2025-09-30T14:57:33.834214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:33.834226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0] Write session will restart in 0.007605s
2025-09-30T14:57:33.833667Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:33.834265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0] Write session: Do CDS request
2025-09-30T14:57:33.834271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:33.842744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:33.842936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:33.842964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2600
2025-09-30T14:57:33.843083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2600 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:33.843117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2600 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:33.843127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2600 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:33.843131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:33.843594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2600 sessionId:  describe result for acl check
2025-09-30T14:57:33.843632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:33.843639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:33.843641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:33.843648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896534328260102:11451] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:33.844177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896534328260102:11451] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:33.846628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896534328260102:11451] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:33.847927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:33.850049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:33.850269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:33.850284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:33.850297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:33.850350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:33.850389Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896534238468244:11899]
2025-09-30T14:57:33.850413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896534328260102:11451] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:33.850430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896534328260102:11451] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:33.850434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896534328260102:11451] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:33.850441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2600 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:33.851045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:33.851355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:33.851403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:33.851728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:33.851801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.851808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.851809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.851810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.851811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.851812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.851813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.851814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.851816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.851817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.851818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.851819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.851821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.851822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.851823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.851829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.851839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.851844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.851848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.851853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.851857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.851861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.851865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.851869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.851872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.851876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.851880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.851885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.851889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.851893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.851900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.851908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:33.851914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.851920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:33.851924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.851930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:33.851934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.851944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:33.851949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.851955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:33.851964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.851970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:33.851979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.851984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:33.851989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.851994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:33.852003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.852008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:33.852017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.852023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:33.852030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.852035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.852040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.852045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.852050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.852060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.852064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.852074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:33.852081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.852093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:33.852137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:33.857839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:33.858815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:33.858838Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:33.858841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:33.858845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:33.858852Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2599 [2:7555896534238468244:11899]
2025-09-30T14:57:33.858868Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:33.858887Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:33.858895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:33.858899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:33.858901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:33.858919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:33.858926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:33.858939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:33.859013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.859021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.859024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.859027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:33.859030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:33.859104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:33.859113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.859127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:33.859140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:33.859156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:33.859177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896534238468239:11899]
2025-09-30T14:57:33.859190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896534238468239:11899]
2025-09-30T14:57:33.859192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896534238468239:11899]
2025-09-30T14:57:33.859202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:33.859221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:33.859225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:33.859229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:33.859231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:33.859235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:33.859239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:33.859293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328260209:11451], now have 1 active actors on pipe
2025-09-30T14:57:33.859304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328260023:2454], now have 1 active actors on pipe
2025-09-30T14:57:33.859319Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2599
2025-09-30T14:57:33.859344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896534238468239:11899]
2025-09-30T14:57:33.859363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:33.859402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:33.859402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2599
2025-09-30T14:57:33.859563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.859574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.859602Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:33.859614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:33.859618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:33.859625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:33.859636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:33.859653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:33.859668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:33.859899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:33.859909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:33.859924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:33.860063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2600 partition: 0 MaxSeqNo: 42 sessionId: src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0
2025-09-30T14:57:33.860497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3b2702d-28ddaf54-c25294d3-b437ddfa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:33.863567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0] Write session: try to update token
2025-09-30T14:57:33.863591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:33.876604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:33.876631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:33.876642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896534238468239:11899]
2025-09-30T14:57:33.876685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:33.876880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:33.877055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:33.877202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:33.877347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:33.877539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:33.877574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:33.879330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:33.888313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:33.888336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:33.888339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:33.888341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:33.888351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896534238468239:11899]
2025-09-30T14:57:33.888355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896534238468239:11899]
2025-09-30T14:57:33.888360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896534238468239:11899]
2025-09-30T14:57:33.888403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:33.888409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:33.888412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:33.888423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:33.888430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:33.888445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:33.888556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:33.892525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2600 sessionId: src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:33.895319Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:33.933783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896534328260220:10873]
2025-09-30T14:57:33.934069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2599, pipe: [1:7555896534328260220:10873]
2025-09-30T14:57:34.007847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:34.008362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.008383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.008409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896534328260220:10873], now have 1 active actors on pipe
2025-09-30T14:57:34.008666Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:34.008718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:34.008729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896534328260220:10873]
2025-09-30T14:57:34.008759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:34.008762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:34.008835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2600 reason: error at write: Disconnected sessionId: src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0
2025-09-30T14:57:34.009059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2600 sessionId: src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0 is DEAD
2025-09-30T14:57:34.011344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:34.011358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0] Write session will restart in 0.008796s
2025-09-30T14:57:34.011384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0] Write session: Do CDS request
2025-09-30T14:57:34.011394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:34.023795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:34.024207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:34.024225Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2601
2025-09-30T14:57:34.024421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2601 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:34.024471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2601 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:34.024482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2601 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:34.024487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:34.024991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2601 sessionId:  describe result for acl check
2025-09-30T14:57:34.025050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:34.025058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:34.025060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:34.025066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896538623227638:11455] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:34.025684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896538623227638:11455] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:34.027807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896538623227638:11455] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:34.028728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:34.031137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:34.031355Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:34.031359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:34.031371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:34.031436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:34.031475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896538533435731:11902]
2025-09-30T14:57:34.031740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896538623227638:11455] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:34.031758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896538623227638:11455] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:34.031761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896538623227638:11455] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:34.031769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2601 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:34.032143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:34.032506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:34.032573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:34.032928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:34.032989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.032995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.032996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.032998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.032999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.033000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.033001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.033002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.033003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.033004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.033005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.033006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.033007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.033008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.033009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.033014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.033024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.033027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.033031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.033052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.033056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.033059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.033063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.033066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.033070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.033073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.033077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.033080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.033084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.033087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.033094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.033102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.033108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.033113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.033117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.033123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.033127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.033132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.033137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.033142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.033146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.033151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.033156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.033160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.033164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.033169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.033174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.033178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.033183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.033187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.033192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.033196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.033200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.033205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.033209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.033213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.033222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.033226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.033231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.033236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.033274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:34.040964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:34.042212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:34.042234Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:34.042236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:34.042240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:34.042247Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2600 [2:7555896538533435731:11902]
2025-09-30T14:57:34.042263Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:34.042278Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:34.042282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:34.042284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:34.042287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:34.042303Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:34.042309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:34.042322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:34.042384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.042394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.042397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.042400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:34.042403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:34.042469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:34.042476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.042489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.042506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.042527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:34.042551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623227706:11455], now have 1 active actors on pipe
2025-09-30T14:57:34.042559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623227518:2454], now have 1 active actors on pipe
2025-09-30T14:57:34.042566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896538533435726:11902]
2025-09-30T14:57:34.042567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896538533435726:11902]
2025-09-30T14:57:34.042570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896538533435726:11902]
2025-09-30T14:57:34.042584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:34.042598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:34.042599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:34.042603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:34.042605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:34.042612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:34.042616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:34.042673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2600
2025-09-30T14:57:34.042678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2600
2025-09-30T14:57:34.042650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896538533435726:11902]
2025-09-30T14:57:34.042666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:34.042679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:34.043072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.043090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.043125Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:34.043141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:34.043145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:34.043148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:34.043161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:34.043179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:34.043204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:34.043463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.043476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.043493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:34.043612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2601 partition: 0 MaxSeqNo: 42 sessionId: src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0
2025-09-30T14:57:34.047371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66238b4-651a339d-9a65ee19-ccc49c4a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:34.050147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0] Write session: try to update token
2025-09-30T14:57:34.050167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:34.060566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:34.060592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:34.060602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896538533435726:11902]
2025-09-30T14:57:34.060646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:34.060652Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:34.060816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:34.060962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:34.061128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:34.061273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:34.061471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:34.061505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:34.072060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:34.072087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:34.072090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:34.072092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:34.072102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896538533435726:11902]
2025-09-30T14:57:34.072106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896538533435726:11902]
2025-09-30T14:57:34.072110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896538533435726:11902]
2025-09-30T14:57:34.072155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:34.072162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.072165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:34.072178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:34.072185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:34.072189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:34.072292Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:34.079315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2601 sessionId: src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:34.082171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:34.108872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896538623227717:10873]
2025-09-30T14:57:34.109181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2600, pipe: [1:7555896538623227717:10873]
2025-09-30T14:57:34.184834Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:34.185142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.185154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.185172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623227717:10873], now have 1 active actors on pipe
2025-09-30T14:57:34.186577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:34.187079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896538623227717:10873]
2025-09-30T14:57:34.187118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:34.187184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2601 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0
2025-09-30T14:57:34.187375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2601 sessionId: src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0 is DEAD
2025-09-30T14:57:34.187494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:34.187516Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:57:34.187593Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 26 consumer shared/user session shared/user_1_26_18204771942114758210_v1 is DEAD
2025-09-30T14:57:34.188312Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896461313800452:10870] disconnected; active server actors: 1
2025-09-30T14:57:34.188323Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896461313800452:10870] client user disconnected session shared/user_1_26_18204771942114758210_v1
2025-09-30T14:57:34.189210Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:57:34.189331Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:57:34.189335Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:57:34.189342Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.005295s
2025-09-30T14:57:34.191356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:34.191368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0] Write session will restart in 0.007983s
2025-09-30T14:57:34.191394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0] Write session: Do CDS request
2025-09-30T14:57:34.191400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:34.195716Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:57:34.199421Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:57:34.199438Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 27
2025-09-30T14:57:34.200885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:34.203559Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 27 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:57:34.203576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:34.203583Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2602
2025-09-30T14:57:34.203637Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:57:34.203732Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2602 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:34.203750Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 auth for : user
2025-09-30T14:57:34.203768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2602 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:34.203789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2602 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:34.203797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:34.203909Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 Handle describe topics response
2025-09-30T14:57:34.203950Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 auth is DEAD
2025-09-30T14:57:34.203976Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:57:34.204129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2602 sessionId:  describe result for acl check
2025-09-30T14:57:34.204170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:34.204178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:34.204182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:34.204188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896538623227820:11460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:34.204277Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:57:34.204399Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_27_8830425810218950589_v1
2025-09-30T14:57:34.204623Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896538623227825:11459] connected; active server actors: 1
2025-09-30T14:57:34.204655Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896538623227825:11459] session shared/user_1_27_8830425810218950589_v1
2025-09-30T14:57:34.204664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:57:34.204682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:57:34.204701Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_27_8830425810218950589_v1" (Sender=[1:7555896538623227749:11459], Pipe=[1:7555896538623227825:11459], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:57:34.204710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:57:34.204721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:57:34.204729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896538623227820:11460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:34.204730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_27_8830425810218950589_v1" (Sender=[1:7555896538623227749:11459], Pipe=[1:7555896538623227825:11459], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:57:34.204742Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_27_8830425810218950589_v1" sender [1:7555896538623227749:11459] lock partition 0 for ReadingSession "shared/user_1_27_8830425810218950589_v1" (Sender=[1:7555896538623227749:11459], Pipe=[1:7555896538623227825:11459], Partitions=[], ActiveFamilyCount=1) generation 1 step 27
2025-09-30T14:57:34.204751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:57:34.204760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000036s
2025-09-30T14:57:34.204968Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 27 Session: "shared/user_1_27_8830425810218950589_v1" ClientId: "user" PipeClient { RawX1: 7555896538623227825 RawX2: 4503603922349251 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:57:34.205005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:57:34.208250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896538623227820:11460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:34.209846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:34.213092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:34.213356Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:34.213368Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:34.213380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:34.213437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:34.213737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896538533435934:11905]
2025-09-30T14:57:34.213731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896538623227820:11460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:34.213757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896538623227820:11460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:34.213760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896538623227820:11460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:34.213770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2602 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:34.214445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:34.214838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:34.214892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:34.215346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:34.215428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.215429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.215430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.215431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.215433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.215434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.215436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.215437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.215438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.215440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.215441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.215443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.215444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.215445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.215446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.215454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.215466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.215471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.215476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.215481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.215486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.215491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.215495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.215500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.215504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.215508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.215511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.215516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.215520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.215525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.215534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.215544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.215551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.215559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.215565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.215570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.215575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.215580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.215586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.215592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.215597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.215603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.215610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.215616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.215620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.215626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.215630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.215637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.215643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.215650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.215655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.215662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.215666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.215672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.215680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.215686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.215691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.215696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.215700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.215705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.215752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:34.221771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:34.222767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:34.222782Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:34.222784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:34.222787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:34.222792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2601 [2:7555896538533435934:11905]
2025-09-30T14:57:34.222805Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:34.222818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:34.222820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:34.222822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:34.222824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:34.222836Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:34.222841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:34.222846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:34.222897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.222903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.222904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.222907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:34.222909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:34.222964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:34.222971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.222979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.222985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.222995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:34.223007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896538533435929:11905]
2025-09-30T14:57:34.223009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896538533435929:11905]
2025-09-30T14:57:34.223010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896538533435929:11905]
2025-09-30T14:57:34.223017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:34.223028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:34.223036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:34.223038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:34.223068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896538533435929:11905]
2025-09-30T14:57:34.223073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:34.223074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:34.223077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:34.223080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:34.223086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:34.223102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623227836:11465], now have 1 active actors on pipe
2025-09-30T14:57:34.223110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623227721:2454], now have 1 active actors on pipe
2025-09-30T14:57:34.223112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623227916:11460], now have 1 active actors on pipe
2025-09-30T14:57:34.223273Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2601, pipe: [1:7555896538623227836:11465]
2025-09-30T14:57:34.223307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2601
2025-09-30T14:57:34.223311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2601
2025-09-30T14:57:34.223633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.223652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.223666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_27_8830425810218950589_v1 on pipe: [1:7555896538623227836:11465]
2025-09-30T14:57:34.223699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.223706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.223720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:34.223732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:34.223734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:34.223756Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_27_8830425810218950589_v1
2025-09-30T14:57:34.223763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:34.223801Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:34.223813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:57:34.223818Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:57:34.223953Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_27_8830425810218950589_v1:1 with generation 2601
2025-09-30T14:57:34.227824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:57:34.227869Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:57:34.227878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:34.227886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:34.227889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:34.227910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:34.227926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:34.227935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:57:34.227952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:57:34.227972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:34.228154Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244254222 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:57:34.228189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:57:34.228253Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 sending to client partition status
2025-09-30T14:57:34.228692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.228707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.228732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:34.228862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2602 partition: 0 MaxSeqNo: 42 sessionId: src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0
2025-09-30T14:57:34.230550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d2b250-8f4bc3fb-1c49954d-211f7ccf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:34.233409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0] Write session: try to update token
2025-09-30T14:57:34.233427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:34.243132Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:34.243155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:34.243158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:34.243159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:34.243169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896538533435929:11905]
2025-09-30T14:57:34.243177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896538533435929:11905]
2025-09-30T14:57:34.243180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896538533435929:11905]
2025-09-30T14:57:34.243225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:34.243232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.243234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:34.243237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:34.243286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:34.243290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:34.243805Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:34.262797Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2602 sessionId: src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:34.265738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:34.360158Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:34.360577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.360593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.360835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_27_8830425810218950589_v1
2025-09-30T14:57:34.360857Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:34.360879Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_27_8830425810218950589_v1
2025-09-30T14:57:34.363964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:34.363979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0] Write session will restart in 0.006114s
2025-09-30T14:57:34.364005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0] Write session: Do CDS request
2025-09-30T14:57:34.364011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:34.363406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:34.363428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896538623227836:11465]
2025-09-30T14:57:34.363469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:34.363573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2602 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0
2025-09-30T14:57:34.363870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2602 sessionId: src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0 is DEAD
2025-09-30T14:57:34.371802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:34.375815Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:34.375838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2603
2025-09-30T14:57:34.376308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2603 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:34.376343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2603 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:34.376349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2603 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:34.376353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:34.377329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2603 sessionId:  describe result for acl check
2025-09-30T14:57:34.377366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:34.377368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:34.377370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:34.377378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896538623227955:11469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:34.377930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896538623227955:11469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:34.389381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896538623227955:11469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:34.404382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896538623227955:11469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:34.404401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896538623227955:11469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:34.404405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896538623227955:11469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:34.404415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2603 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:34.430592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:34.434571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:34.434816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:34.434829Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:34.434841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:34.434897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:34.434941Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896538533436128:11907]
2025-09-30T14:57:34.435674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:34.444112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:34.444231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:34.444679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:34.444770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.444778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.444780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.444781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.444783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.444785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.444787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.444789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.444790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.444792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.444794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.444795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.444797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.444799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.444800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.444808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.444820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.444825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.444830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.444835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.444839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.444845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.444850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.444856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.444861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.444866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.444871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.444876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.444881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.444886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.444899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.444916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.444925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.444932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.444939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.444946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.444950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.444957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.444964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.444970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.444976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.444983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.444989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.444994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.445000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.445006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.445011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.445016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.445022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.445030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.445049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.445054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.445059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.445067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.445072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.445078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.445082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.445088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.445095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.445107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.445155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:34.454343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:34.455557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:34.455579Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:34.455583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:34.455587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:34.455594Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2602 [2:7555896538533436128:11907]
2025-09-30T14:57:34.455612Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:34.455634Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:34.455638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:34.455642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:34.455643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:34.455662Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:34.455669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:34.455678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:34.455749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.455751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.455754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.455757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:34.455760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:34.455836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:34.455839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.455856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.455870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.455891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:34.455910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896538533436123:11907]
2025-09-30T14:57:34.455913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896538533436123:11907]
2025-09-30T14:57:34.455916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896538533436123:11907]
2025-09-30T14:57:34.455925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:34.455939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:34.455956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:34.455959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:34.455996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896538533436123:11907]
2025-09-30T14:57:34.455999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:34.456020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:34.456034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:34.456036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:34.456043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:34.456261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623227947:2454], now have 1 active actors on pipe
2025-09-30T14:57:34.456266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623227997:11469], now have 1 active actors on pipe
2025-09-30T14:57:34.456627Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2602
2025-09-30T14:57:34.456670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2602
2025-09-30T14:57:34.457978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.457997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.458029Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:34.458040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:34.458045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:34.458048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:34.458064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:34.458078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:34.458095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:34.463732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.463767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.463803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:34.463926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896538623228146:11465]
2025-09-30T14:57:34.463992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2603 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0
2025-09-30T14:57:34.464375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8ffa55a-e843d909-a7b3ac81-89ceb9b3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:34.464645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623228146:11465], now have 1 active actors on pipe
2025-09-30T14:57:34.464727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2602, pipe: [1:7555896538623228146:11465]
2025-09-30T14:57:34.467266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0] Write session: try to update token
2025-09-30T14:57:34.467290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:34.471405Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:34.471426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:34.471429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:34.471431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:34.471442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896538533436123:11907]
2025-09-30T14:57:34.471449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896538533436123:11907]
2025-09-30T14:57:34.471454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896538533436123:11907]
2025-09-30T14:57:34.471495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:34.471502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.471505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:34.471659Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:34.473584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:34.473599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:34.473620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:34.489803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2603 sessionId: src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:34.492678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:34.592008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:34.592617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.592629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.594227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:34.594241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0] Write session will restart in 0.007117s
2025-09-30T14:57:34.594265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0] Write session: Do CDS request
2025-09-30T14:57:34.594271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:34.593278Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:34.593727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:34.593787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896538623228146:11465]
2025-09-30T14:57:34.593810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:34.593813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:34.593863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2603 reason: error at write: Disconnected sessionId: src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0
2025-09-30T14:57:34.594039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2603 sessionId: src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0 is DEAD
2025-09-30T14:57:34.602774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:34.603333Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:34.603355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2604
2025-09-30T14:57:34.603563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2604 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:34.603599Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2604 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:34.603604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2604 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:34.603608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:34.604036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2604 sessionId:  describe result for acl check
2025-09-30T14:57:34.604075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:34.604080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:34.604082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:34.604089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896538623228164:11473] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:34.604690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896538623228164:11473] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:34.610933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896538623228164:11473] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:34.615707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896538623228164:11473] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:34.615734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896538623228164:11473] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:34.615738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896538623228164:11473] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:34.615747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2604 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:34.618762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:34.621969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:34.622225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:34.622230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:34.622242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:34.622320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:34.622369Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896538533436322:11910]
2025-09-30T14:57:34.623079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:34.623464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:34.623520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:34.623880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:34.623951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.623953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.623955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.623957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.623958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.623960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.623962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.623964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.623965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.623967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.623968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.623970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.623971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.623972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.623974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.623980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.623992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.623997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.624002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.624007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.624012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.624017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.624022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.624027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.624034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.624039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.624043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.624046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.624050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.624053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.624061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.624073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.624079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.624096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.624102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.624108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.624113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.624119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.624125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.624132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.624137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.624144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.624156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.624168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.624173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.624179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.624185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.624196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.624201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.624208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.624218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.624225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.624235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.624241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.624253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.624264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.624269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.624275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.624280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.624286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.624346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:34.632107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:34.633463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:34.633483Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:34.633486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:34.633490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:34.633497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2603 [2:7555896538533436322:11910]
2025-09-30T14:57:34.633515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:34.633535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:34.633544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:34.633548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:34.633551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:34.633570Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:34.633579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:34.633592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:34.633662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.633671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.633673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.633676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:34.633679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:34.633756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:34.633771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.633786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.633800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.633820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:34.633840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623228151:2454], now have 1 active actors on pipe
2025-09-30T14:57:34.633845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623228312:11473], now have 1 active actors on pipe
2025-09-30T14:57:34.633853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896538533436317:11910]
2025-09-30T14:57:34.633856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896538533436317:11910]
2025-09-30T14:57:34.633859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896538533436317:11910]
2025-09-30T14:57:34.633874Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:34.633888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:34.633910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:34.633911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:34.633915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:34.633917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:34.633918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:34.633957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896538533436317:11910]
2025-09-30T14:57:34.633971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:34.633987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:34.634007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.634012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.634045Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:34.634062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:34.634066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:34.634069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:34.634079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:34.634092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:34.634111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:34.634305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.634316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.634333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:34.633958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2603
2025-09-30T14:57:34.633988Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2603
2025-09-30T14:57:34.634471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2604 partition: 0 MaxSeqNo: 42 sessionId: src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0
2025-09-30T14:57:34.635486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d5d1f03-fdee75f7-2a9dd207-8a66c723_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:34.638499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0] Write session: try to update token
2025-09-30T14:57:34.638521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:34.648957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:34.648984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:34.648994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896538533436317:11910]
2025-09-30T14:57:34.649055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:34.649061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:34.649239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:34.649394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:34.649544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:34.649694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:34.649923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:34.649965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:34.659579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2604 sessionId: src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:34.664182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:34.664210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:34.664213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:34.664215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:34.664226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896538533436317:11910]
2025-09-30T14:57:34.664231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896538533436317:11910]
2025-09-30T14:57:34.664235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896538533436317:11910]
2025-09-30T14:57:34.664282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:34.664296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.664298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:34.664452Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:34.662801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:34.667335Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:34.667358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:34.667363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:34.693589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896538623228353:11465]
2025-09-30T14:57:34.693892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2603, pipe: [1:7555896538623228353:11465]
2025-09-30T14:57:34.778812Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:34.779823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.779842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.779865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623228353:11465], now have 1 active actors on pipe
2025-09-30T14:57:34.780102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:34.781003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896538623228353:11465]
2025-09-30T14:57:34.781049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:34.781078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:34.781145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2604 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0
2025-09-30T14:57:34.781330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2604 sessionId: src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0 is DEAD
2025-09-30T14:57:34.781814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:34.781822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0] Write session will restart in 0.006491s
2025-09-30T14:57:34.781844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0] Write session: Do CDS request
2025-09-30T14:57:34.781850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:34.791742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:34.792066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:34.792083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2605
2025-09-30T14:57:34.792203Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2605 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:34.792229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2605 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:34.792233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2605 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:34.792238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:34.792617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2605 sessionId:  describe result for acl check
2025-09-30T14:57:34.792642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:34.792644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:34.792646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:34.792651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896538623228398:11485] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:34.793164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896538623228398:11485] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:34.800110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896538623228398:11485] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:34.803120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896538623228398:11485] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:34.803140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896538623228398:11485] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:34.803145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896538623228398:11485] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:34.803154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2605 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:34.802924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:34.806227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:34.806447Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:34.806458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:34.806469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:34.806529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:34.806574Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896538533436552:11918]
2025-09-30T14:57:34.807108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:34.807556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:34.807612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:34.807900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:34.807965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.807972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.807974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.807975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.807976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.807978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.807979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.807980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.807982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.807983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.807984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.807986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.807987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.807989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.807990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.807996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.808008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.808013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.808017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.808022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.808026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.808031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.808036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.808040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.808045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.808054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.808058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.808062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.808066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.808070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.808078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.808085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:34.808092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.808098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:34.808105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.808111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:34.808120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.808125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:34.808130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.808137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:34.808142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.808152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:34.808158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.808167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:34.808171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.808177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:34.808182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.808192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:34.808198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.808208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:34.808213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.808222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.808241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.808250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.808259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.808265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.808276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.808284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:34.808289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.808294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:34.808335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:34.815077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:34.816233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:34.816254Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:34.816256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:34.816260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:34.816269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2604 [2:7555896538533436552:11918]
2025-09-30T14:57:34.816285Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:34.816302Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:34.816307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:34.816311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:34.816313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:34.816331Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:34.816344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:34.816352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:34.816415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.816422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.816424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.816427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:34.816430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:34.816502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:34.816510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.816525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:34.816543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:34.816565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:34.816586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896538533436545:11918]
2025-09-30T14:57:34.816592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896538533436545:11918]
2025-09-30T14:57:34.816595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896538533436545:11918]
2025-09-30T14:57:34.816614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:34.816633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:34.816651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:34.816658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:34.816696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896538533436545:11918]
2025-09-30T14:57:34.816703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:34.816853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:34.816861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:34.816864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:34.816871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:34.817208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623228371:2454], now have 1 active actors on pipe
2025-09-30T14:57:34.817218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623228569:11485], now have 1 active actors on pipe
2025-09-30T14:57:34.819890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.819916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.819948Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d40031ae-640ee5e7-20f524ae-817f417f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:34.819958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:34.819962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:34.819964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:34.819977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:34.819991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:34.819763Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2604
2025-09-30T14:57:34.819818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2604
2025-09-30T14:57:34.820745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2605 partition: 0 MaxSeqNo: 42 sessionId: src_id|d40031ae-640ee5e7-20f524ae-817f417f_0
2025-09-30T14:57:34.820005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:34.820267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.820273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.820295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:34.823365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9aba912d-9e9a8e3a-3e09445f-a9622c01_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d40031ae-640ee5e7-20f524ae-817f417f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:34.826100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d40031ae-640ee5e7-20f524ae-817f417f_0] Write session: try to update token
2025-09-30T14:57:34.826119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d40031ae-640ee5e7-20f524ae-817f417f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:34.836750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:34.836782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:34.836793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896538533436545:11918]
2025-09-30T14:57:34.836845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:34.836867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:34.837050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:34.837220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:34.837385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:34.837538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:34.837752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:34.837791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:34.850878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:34.850910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:34.850913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:34.850916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:34.850928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896538533436545:11918]
2025-09-30T14:57:34.850934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896538533436545:11918]
2025-09-30T14:57:34.850939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896538533436545:11918]
2025-09-30T14:57:34.850988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:34.851004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:34.851007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:34.850124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2605 sessionId: src_id|d40031ae-640ee5e7-20f524ae-817f417f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:34.853288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:34.851199Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:34.854049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:34.854058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:34.854063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:34.883348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896538623228583:11465]
2025-09-30T14:57:34.887432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2604, pipe: [1:7555896538623228583:11465]
2025-09-30T14:57:34.969164Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:34.969979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:34.969990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:34.970011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623228583:11465], now have 1 active actors on pipe
2025-09-30T14:57:34.970255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:34.970702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:34.970755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896538623228583:11465]
2025-09-30T14:57:34.970773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:34.970775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:34.970821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2605 reason: error at write: Disconnected sessionId: src_id|d40031ae-640ee5e7-20f524ae-817f417f_0
2025-09-30T14:57:34.970979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2605 sessionId: src_id|d40031ae-640ee5e7-20f524ae-817f417f_0 is DEAD
2025-09-30T14:57:34.971393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40031ae-640ee5e7-20f524ae-817f417f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:34.971403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40031ae-640ee5e7-20f524ae-817f417f_0] Write session will restart in 0.005714s
2025-09-30T14:57:34.971426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40031ae-640ee5e7-20f524ae-817f417f_0] Write session: Do CDS request
2025-09-30T14:57:34.971434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40031ae-640ee5e7-20f524ae-817f417f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:34.978735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d40031ae-640ee5e7-20f524ae-817f417f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:34.978882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:34.978902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2606
2025-09-30T14:57:34.979134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2606 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:34.979166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2606 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:34.979171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2606 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:34.979175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:34.979864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2606 sessionId:  describe result for acl check
2025-09-30T14:57:34.979903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:34.979910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:34.979912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:34.980077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896538623228600:11489] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:34.980593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896538623228600:11489] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:34.989102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896538623228600:11489] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:34.997153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896538623228600:11489] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:34.997172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896538623228600:11489] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:34.997174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896538623228600:11489] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:34.997180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2606 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:35.002192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:35.004998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:35.005193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:35.005196Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:35.005203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:35.005241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:35.005269Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896542828404044:11926]
2025-09-30T14:57:35.005724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:35.006217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:35.006256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:35.006493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:35.006541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.006542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.006543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.006543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.006544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.006545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.006546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.006547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.006548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.006549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.006549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.006550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.006551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.006551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.006552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.006556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.006563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.006566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.006569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.006571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.006574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.006576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.006579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.006581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.006584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.006586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.006588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.006591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.006594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.006596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.006602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.006607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.006611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.006614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.006617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.006620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.006622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.006625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.006628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.006631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.006634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.006637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.006640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.006643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.006645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.006648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.006651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.006654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.006658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.006661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.006663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.006667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.006669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.006672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.006675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.006678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.006681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.006684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.006686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.006689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.006715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:35.012777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:35.013798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:35.013817Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:35.013820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:35.013823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:35.013829Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2605 [2:7555896542828404044:11926]
2025-09-30T14:57:35.013842Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:35.013857Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:35.013859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:35.013862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:35.013863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:35.013875Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:35.013880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:35.013887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:35.013949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.013959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.013961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.013964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:35.013967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:35.014037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:35.014046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.014061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.014074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.014091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:35.014108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896542828404038:11926]
2025-09-30T14:57:35.014114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896542828404038:11926]
2025-09-30T14:57:35.014115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896542828404038:11926]
2025-09-30T14:57:35.014128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:35.014143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623228587:2454], now have 1 active actors on pipe
2025-09-30T14:57:35.014151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:35.014153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896538623228741:11489], now have 1 active actors on pipe
2025-09-30T14:57:35.014154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:35.014157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:35.014161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:35.014174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:35.014177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:35.014217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896542828404038:11926]
2025-09-30T14:57:35.014230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:35.014242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:35.014255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2605
2025-09-30T14:57:35.014308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2605
2025-09-30T14:57:35.014511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.014522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.014546Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:35.014555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:35.014559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:35.014562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:35.014573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:35.014583Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:35.014597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:35.014906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.014921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.014947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:35.015043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2606 partition: 0 MaxSeqNo: 42 sessionId: src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0
2025-09-30T14:57:35.015400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40031ae-640ee5e7-20f524ae-817f417f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:35.018134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0] Write session: try to update token
2025-09-30T14:57:35.018153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:35.027931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:35.027947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:35.027950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:35.027952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:35.027962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896542828404038:11926]
2025-09-30T14:57:35.027967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896542828404038:11926]
2025-09-30T14:57:35.027971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896542828404038:11926]
2025-09-30T14:57:35.028010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:35.028017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.028017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:35.028021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:35.028025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:35.028028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:35.028165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:35.037653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2606 sessionId: src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:35.040546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:35.067854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896542918196084:11465]
2025-09-30T14:57:35.068168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2605, pipe: [1:7555896542918196084:11465]
2025-09-30T14:57:35.144984Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:35.145506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.145524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.145546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196084:11465], now have 1 active actors on pipe
2025-09-30T14:57:35.145849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:35.145867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:35.145878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:35.145791Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:35.145931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2606 reason: error at write: Disconnected sessionId: src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0
2025-09-30T14:57:35.145941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896542918196084:11465]
2025-09-30T14:57:35.146287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:35.146297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0] Write session will restart in 0.009432s
2025-09-30T14:57:35.146321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0] Write session: Do CDS request
2025-09-30T14:57:35.146327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:35.146125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2606 sessionId: src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0 is DEAD
2025-09-30T14:57:35.156767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:35.157144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:35.157163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2607
2025-09-30T14:57:35.157314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2607 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:35.157359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2607 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:35.157370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2607 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:35.157375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:35.157804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2607 sessionId:  describe result for acl check
2025-09-30T14:57:35.157839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:35.157841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:35.157846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:35.157854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896542918196177:11493] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:35.158380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896542918196177:11493] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:35.162272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896542918196177:11493] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:35.162539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:35.165665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:35.165879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:35.165887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:35.165896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:35.165954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:35.165996Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896542828404253:11930]
2025-09-30T14:57:35.166087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896542918196177:11493] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:35.166105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896542918196177:11493] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:35.166108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896542918196177:11493] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:35.166117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2607 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:35.166526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:35.166934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:35.166979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:35.167315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:35.167380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.167387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.167388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.167390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.167391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.167393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.167394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.167395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.167397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.167398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.167400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.167401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.167402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.167404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.167405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.167410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.167420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.167425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.167429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.167433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.167437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.167440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.167444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.167447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.167451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.167455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.167458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.167461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.167465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.167468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.167475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.167484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.167489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.167494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.167500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.167504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.167508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.167513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.167518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.167523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.167527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.167532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.167537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.167562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.167567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.167572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.167578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.167589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.167596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.167608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.167619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.167625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.167630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.167636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.167641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.167647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.167652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.167664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.167670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.167676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.167725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:35.173472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:35.174750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:35.174769Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:35.174773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:35.174777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:35.174784Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2606 [2:7555896542828404253:11930]
2025-09-30T14:57:35.174803Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:35.174820Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:35.174823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:35.174827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:35.174829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:35.174846Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:35.174859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:35.174865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:35.174945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.174953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.174955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.174959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:35.174962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:35.175029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:35.175037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.175052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.175068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.175090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:35.175113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196086:2454], now have 1 active actors on pipe
2025-09-30T14:57:35.175121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196280:11493], now have 1 active actors on pipe
2025-09-30T14:57:35.175128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896542828404248:11930]
2025-09-30T14:57:35.175130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896542828404248:11930]
2025-09-30T14:57:35.175132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896542828404248:11930]
2025-09-30T14:57:35.175147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:35.175161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:35.175164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:35.175168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:35.175173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:35.175181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:35.175184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:35.175221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896542828404248:11930]
2025-09-30T14:57:35.175232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:35.175237Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:35.175209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2606
2025-09-30T14:57:35.175222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2606
2025-09-30T14:57:35.175419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.175436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.175470Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:35.175490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:35.175494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:35.175496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:35.175508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:35.175519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:35.175536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:35.176092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.176103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.176122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:35.176212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2607 partition: 0 MaxSeqNo: 42 sessionId: src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0
2025-09-30T14:57:35.176624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36c62793-c864fac9-5abb990b-5bcb9b99_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:35.179397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0] Write session: try to update token
2025-09-30T14:57:35.179415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:35.193572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:35.193596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:35.193606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896542828404248:11930]
2025-09-30T14:57:35.193652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:35.193857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:35.194005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:35.194033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2607 sessionId: src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:35.194160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:35.194302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:35.194805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:35.194851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:35.196837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:35.197843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:35.195101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:35.197081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.197092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.197127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:35.209011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:35.209047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:35.209050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:35.209052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:35.209062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896542828404248:11930]
2025-09-30T14:57:35.209066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896542828404248:11930]
2025-09-30T14:57:35.209070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896542828404248:11930]
2025-09-30T14:57:35.209111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:35.209119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.209122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:35.209125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:35.209133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:35.209137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:35.209269Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:35.246033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896542918196293:11465]
2025-09-30T14:57:35.247230Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2606, pipe: [1:7555896542918196293:11465]
2025-09-30T14:57:35.326971Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:35.339050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:35.339106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:35.339109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:35.339136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2607 reason: error at write: Disconnected sessionId: src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0
2025-09-30T14:57:35.335526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.335548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.335714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:35.335770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:35.335825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:35.335881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:35.336033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:35.336037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:35.336110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:35.336169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:35.336228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:35.336288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:35.336327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:35.336331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:35.336394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:35.336449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:35.336507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:35.336566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:35.336607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:35.336609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:35.336675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:35.336735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:35.336792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:35.336848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:35.336886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:35.336888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:35.336964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:35.337047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:35.337116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:35.337180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:35.337219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:35.337222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:35.337287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:35.337342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:35.337398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:35.337452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:35.337510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:35.337514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:35.337577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:35.337630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:35.337692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:35.337770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:35.337817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:35.337819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:35.337885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:35.337945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:35.338004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:35.338063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:35.338104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:35.338106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:35.338172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:35.338228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:35.338286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:35.338350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:35.338391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:35.338393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:35.338454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:35.338507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:35.338564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:35.338625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:35.338663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:35.338665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:35.338730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196293:11465], now have 1 active actors on pipe
2025-09-30T14:57:35.339226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896542918196293:11465]
2025-09-30T14:57:35.339327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2607 sessionId: src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0 is DEAD
2025-09-30T14:57:35.339629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:35.339642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0] Write session will restart in 0.006290s
2025-09-30T14:57:35.339666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0] Write session: Do CDS request
2025-09-30T14:57:35.339672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:35.339816Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:35.346870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:35.346932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:35.346950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2608
2025-09-30T14:57:35.347084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2608 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:35.347113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2608 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:35.347119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2608 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:35.347124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:35.347552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2608 sessionId:  describe result for acl check
2025-09-30T14:57:35.347591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:35.347596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:35.347598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:35.347605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896542918196329:11499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:35.348118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896542918196329:11499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:35.351160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896542918196329:11499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:35.354384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896542918196329:11499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:35.354408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896542918196329:11499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:35.354412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896542918196329:11499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:35.354420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2608 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:35.357860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:35.360046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:35.360352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:35.360363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:35.360375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:35.360426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:35.360465Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896542828404451:11932]
2025-09-30T14:57:35.361119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:35.361447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:35.361510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:35.361865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:35.361953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.361959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.361961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.361962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.361963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.361964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.361965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.361967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.361968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.361969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.361971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.361972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.361973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.361975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.361976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.361981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.361991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.361995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.361999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.362002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.362006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.362009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.362012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.362016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.362021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.362024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.362028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.362032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.362037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.362041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.362049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.362057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.362063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.362069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.362073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.362078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.362083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.362087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.362094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.362110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.362114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.362119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.362124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.362130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.362141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.362145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.362150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.362154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.362158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.362163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.362168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.362173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.362181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.362186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.362191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.362196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.362205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.362210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.362217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.362226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.362273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:35.369397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:35.370283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:35.370311Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:35.370315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:35.370320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:35.370328Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2607 [2:7555896542828404451:11932]
2025-09-30T14:57:35.370349Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:35.370372Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:35.370380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:35.370384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:35.370387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:35.370407Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:35.370415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:35.370428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:35.370498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.370505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.370508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.370512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:35.370515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:35.370592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:35.370603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.370620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.370630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.370646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:35.370669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196314:2454], now have 1 active actors on pipe
2025-09-30T14:57:35.370677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896542828404446:11932]
2025-09-30T14:57:35.370680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896542828404446:11932]
2025-09-30T14:57:35.370682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896542828404446:11932]
2025-09-30T14:57:35.370696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:35.370709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196482:11499], now have 1 active actors on pipe
2025-09-30T14:57:35.370717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:35.370730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:35.370733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:35.370772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896542828404446:11932]
2025-09-30T14:57:35.370781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:35.370843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2607
2025-09-30T14:57:35.370915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2607
2025-09-30T14:57:35.370836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:35.370847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:35.370850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:35.370857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:35.371066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.371074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.371102Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a484d785-170a8598-7676dc34-97f1eacf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:35.371112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:35.371116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:35.371118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:35.371129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:35.371141Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:35.371157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:35.371344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.371354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.371372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:35.371470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2608 partition: 0 MaxSeqNo: 42 sessionId: src_id|a484d785-170a8598-7676dc34-97f1eacf_0
2025-09-30T14:57:35.371864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e24c8605-658d69d5-4dad550a-8e4773b5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a484d785-170a8598-7676dc34-97f1eacf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:35.374764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a484d785-170a8598-7676dc34-97f1eacf_0] Write session: try to update token
2025-09-30T14:57:35.374786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a484d785-170a8598-7676dc34-97f1eacf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:35.384741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:35.384766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:35.384769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:35.384771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:35.384780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896542828404446:11932]
2025-09-30T14:57:35.384785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896542828404446:11932]
2025-09-30T14:57:35.384789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896542828404446:11932]
2025-09-30T14:57:35.384834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:35.384841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.384842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:35.384844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:35.384849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:35.384853Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:35.385071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:35.389697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2608 sessionId: src_id|a484d785-170a8598-7676dc34-97f1eacf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:35.392538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:35.439538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896542918196519:11465]
2025-09-30T14:57:35.439835Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2607, pipe: [1:7555896542918196519:11465]
2025-09-30T14:57:35.497963Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:35.498701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.498713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.498757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196519:11465], now have 1 active actors on pipe
2025-09-30T14:57:35.499081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:35.499143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896542918196519:11465]
2025-09-30T14:57:35.499184Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:35.499219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:35.499222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:35.499773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a484d785-170a8598-7676dc34-97f1eacf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:35.499786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a484d785-170a8598-7676dc34-97f1eacf_0] Write session will restart in 0.005896s
2025-09-30T14:57:35.499817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a484d785-170a8598-7676dc34-97f1eacf_0] Write session: Do CDS request
2025-09-30T14:57:35.499823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a484d785-170a8598-7676dc34-97f1eacf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:35.499394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2608 reason: error at write: Disconnected sessionId: src_id|a484d785-170a8598-7676dc34-97f1eacf_0
2025-09-30T14:57:35.499606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2608 sessionId: src_id|a484d785-170a8598-7676dc34-97f1eacf_0 is DEAD
2025-09-30T14:57:35.506867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a484d785-170a8598-7676dc34-97f1eacf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:35.506941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:35.506957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2609
2025-09-30T14:57:35.507130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2609 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:35.507159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2609 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:35.507165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2609 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:35.507171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:35.507592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2609 sessionId:  describe result for acl check
2025-09-30T14:57:35.507633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:35.507634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:35.507636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:35.507642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896542918196536:11503] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:35.508226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896542918196536:11503] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:35.511596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896542918196536:11503] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:35.516179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896542918196536:11503] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:35.516199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896542918196536:11503] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:35.516203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896542918196536:11503] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:35.516211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2609 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:35.519416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:35.521497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:35.521691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:35.521700Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:35.521711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:35.521764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:35.521806Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896542828404649:11934]
2025-09-30T14:57:35.522488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:35.522817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:35.522864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:35.523219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:35.523304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.523310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.523311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.523313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.523314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.523315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.523316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.523317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.523319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.523320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.523321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.523323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.523324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.523325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.523326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.523331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.523341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.523345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.523350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.523354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.523359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.523362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.523366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.523371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.523377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.523380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.523383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.523387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.523391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.523395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.523404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.523411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.523417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.523422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.523426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.523432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.523436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.523441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.523462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.523467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.523471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.523476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.523482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.523493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.523500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.523505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.523512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.523517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.523527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.523532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.523538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.523545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.523550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.523555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.523565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.523570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.523575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.523580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.523590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.523595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.523649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:35.529181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:35.530393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:35.530404Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:35.530407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:35.530411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:35.530418Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2608 [2:7555896542828404649:11934]
2025-09-30T14:57:35.530435Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:35.530451Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:35.530458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:35.530460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:35.530462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:35.530475Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:35.530480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:35.530486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:35.530535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.530540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.530542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.530545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:35.530546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:35.530599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:35.530607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.530619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.530634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.530656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:35.530675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896542828404644:11934]
2025-09-30T14:57:35.530681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896542828404644:11934]
2025-09-30T14:57:35.530683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896542828404644:11934]
2025-09-30T14:57:35.530689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:35.530700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196521:2454], now have 1 active actors on pipe
2025-09-30T14:57:35.530701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:35.530705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:35.530707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:35.530712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:35.530720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:35.530722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:35.530726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196687:11503], now have 1 active actors on pipe
2025-09-30T14:57:35.530751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896542828404644:11934]
2025-09-30T14:57:35.530758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:35.530804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:35.530819Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2608
2025-09-30T14:57:35.530836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2608
2025-09-30T14:57:35.530912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.530922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.530948Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:35.530962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:35.530965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:35.530967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:35.530981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:35.530991Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:35.531005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:35.531190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.531199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.531212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:35.531353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2609 partition: 0 MaxSeqNo: 42 sessionId: src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0
2025-09-30T14:57:35.531715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a484d785-170a8598-7676dc34-97f1eacf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:35.534811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0] Write session: try to update token
2025-09-30T14:57:35.534845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:35.543126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:35.543145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:35.543148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:35.543150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:35.543160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896542828404644:11934]
2025-09-30T14:57:35.543165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896542828404644:11934]
2025-09-30T14:57:35.543169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896542828404644:11934]
2025-09-30T14:57:35.543216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:35.543225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.543227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:35.543233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:35.543240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:35.543264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:35.543387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:35.552922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2609 sessionId: src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:35.555723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:35.599361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896542918196727:11465]
2025-09-30T14:57:35.599862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2608, pipe: [1:7555896542918196727:11465]
2025-09-30T14:57:35.656559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:35.656929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.656941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.656959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196727:11465], now have 1 active actors on pipe
2025-09-30T14:57:35.657143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:35.657216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:35.657232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:35.657255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896542918196727:11465]
2025-09-30T14:57:35.657285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:35.657294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2609 reason: error at write: Disconnected sessionId: src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0
2025-09-30T14:57:35.657470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2609 sessionId: src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0 is DEAD
2025-09-30T14:57:35.657702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:35.657711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0] Write session will restart in 0.009396s
2025-09-30T14:57:35.657734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0] Write session: Do CDS request
2025-09-30T14:57:35.657755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:35.668888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:35.668928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:35.668955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2610
2025-09-30T14:57:35.669208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2610 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:35.669264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2610 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:35.669274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2610 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:35.669279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:35.671064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2610 sessionId:  describe result for acl check
2025-09-30T14:57:35.671127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:35.671135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:35.671137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:35.671143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896542918196836:11507] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:35.671653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896542918196836:11507] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:35.674320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896542918196836:11507] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:35.676335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:35.679368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:35.679584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:35.679594Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:35.679605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:35.679658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:35.679699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896542828404849:11937]
2025-09-30T14:57:35.679716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896542918196836:11507] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:35.679734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896542918196836:11507] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:35.679737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896542918196836:11507] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:35.679745Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2610 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:35.680408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:35.680711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:35.680762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:35.681139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:35.681207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.681214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.681216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.681217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.681219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.681220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.681222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.681223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.681224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.681226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.681227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.681229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.681230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.681232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.681233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.681238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.681249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.681254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.681258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.681263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.681268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.681272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.681277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.681282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.681287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.681291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.681296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.681301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.681313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.681318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.681330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.681344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.681354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.681364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.681373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.681382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.681392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.681403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.681413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.681419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.681428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.681438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.681449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.681459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.681467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.681477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.681486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.681496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.681504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.681515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.681525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.681534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.681548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.681558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.681564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.681573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.681582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.681592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.681604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.681614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.681666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:35.687935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:35.688907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:35.689401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2609
2025-09-30T14:57:35.689413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2609
2025-09-30T14:57:35.688924Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:35.688927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:35.688932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:35.688939Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2609 [2:7555896542828404849:11937]
2025-09-30T14:57:35.688956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:35.688972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:35.688975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:35.688979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:35.688981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:35.688997Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:35.689003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:35.689011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:35.689085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.689087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.689089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.689093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:35.689096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:35.689165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:35.689169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.689180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.689193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.689210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:35.689228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196925:11507], now have 1 active actors on pipe
2025-09-30T14:57:35.689232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196728:2454], now have 1 active actors on pipe
2025-09-30T14:57:35.689238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896542828404844:11937]
2025-09-30T14:57:35.689241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896542828404844:11937]
2025-09-30T14:57:35.689243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896542828404844:11937]
2025-09-30T14:57:35.689257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:35.689270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:35.689271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:35.689274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:35.689276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:35.689286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:35.689290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:35.689546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896542828404844:11937]
2025-09-30T14:57:35.689555Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:35.689563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:35.689587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.689592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.689631Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:35.689647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:35.689651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:35.689653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:35.689663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:35.689672Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:35.689688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:35.690015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.690024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.690039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:35.690146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2610 partition: 0 MaxSeqNo: 42 sessionId: src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0
2025-09-30T14:57:35.690621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2f68e42-f31fa53c-55c49f51-8871b167_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:35.693402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0] Write session: try to update token
2025-09-30T14:57:35.693421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:35.701735Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:35.701752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:35.701754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:35.701756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:35.701766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896542828404844:11937]
2025-09-30T14:57:35.701772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896542828404844:11937]
2025-09-30T14:57:35.701777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896542828404844:11937]
2025-09-30T14:57:35.701816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:35.701823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:35.701825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.701828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:35.701829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:35.701835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:35.701992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:35.708160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2610 sessionId: src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:35.711674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:35.757520Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896542918196938:11465]
2025-09-30T14:57:35.757828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2609, pipe: [1:7555896542918196938:11465]
2025-09-30T14:57:35.815376Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:35.815769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.815788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.815808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196938:11465], now have 1 active actors on pipe
2025-09-30T14:57:35.816077Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:35.819863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:35.819877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0] Write session will restart in 0.005565s
2025-09-30T14:57:35.819903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0] Write session: Do CDS request
2025-09-30T14:57:35.819909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:35.819432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:35.819450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:35.819530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2610 reason: error at write: Disconnected sessionId: src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0
2025-09-30T14:57:35.819715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2610 sessionId: src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0 is DEAD
2025-09-30T14:57:35.819910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:35.819952Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896542918196938:11465]
2025-09-30T14:57:35.826718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:35.826829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:35.826849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2611
2025-09-30T14:57:35.829518Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2611 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:35.829569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2611 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:35.829574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2611 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:35.829579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:35.830287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2611 sessionId:  describe result for acl check
2025-09-30T14:57:35.830327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:35.830330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:35.830331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:35.830336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896542918196986:11518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:35.830861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896542918196986:11518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:35.833777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896542918196986:11518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:35.838446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896542918196986:11518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:35.838465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896542918196986:11518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:35.838467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896542918196986:11518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:35.838474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2611 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:35.842784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:35.846561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:35.846844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:35.846857Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:35.846868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:35.846923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:35.846961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896542828405086:11945]
2025-09-30T14:57:35.847627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:35.847983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:35.848036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:35.848368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:35.848433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.848435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.848436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.848437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.848438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.848439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.848440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.848442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.848443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.848444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.848446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.848447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.848448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.848449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.848450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.848455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.848465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.848468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.848472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.848475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.848479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.848482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.848485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.848488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.848492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.848496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.848499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.848503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.848506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.848509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.848517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.848526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:35.848532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.848537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:35.848541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.848546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:35.848550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.848557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:35.848562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.848567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:35.848572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.848576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:35.848581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.848585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:35.848590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.848594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:35.848599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.848603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:35.848607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.848611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:35.848619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.848623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.848629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.848634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.848638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.848643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.848648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.848652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:35.848656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.848660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:35.848700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:35.854349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:35.855216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:35.855233Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:35.855236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:35.855240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:35.855269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2610 [2:7555896542828405086:11945]
2025-09-30T14:57:35.855288Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:35.855307Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:35.855314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:35.855317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:35.855330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:35.855347Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:35.855354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:35.855361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:35.855422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.855430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.855433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.855436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:35.855440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:35.855512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:35.855519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.855531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:35.855548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:35.855570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:35.855594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918197137:11518], now have 1 active actors on pipe
2025-09-30T14:57:35.855602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918196952:2454], now have 1 active actors on pipe
2025-09-30T14:57:35.855609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896542828405069:11945]
2025-09-30T14:57:35.855613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896542828405069:11945]
2025-09-30T14:57:35.855616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896542828405069:11945]
2025-09-30T14:57:35.855629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:35.855643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:35.855645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:35.855649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:35.855654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:35.855659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:35.855669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:35.855708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896542828405069:11945]
2025-09-30T14:57:35.855719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:35.855725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:35.855840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2610
2025-09-30T14:57:35.855874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2610
2025-09-30T14:57:35.856020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.856030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.856060Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:35.856071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:35.856076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:35.856082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:35.856092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:35.856106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:35.856126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:35.856293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.856300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.856317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:35.856408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2611 partition: 0 MaxSeqNo: 42 sessionId: src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0
2025-09-30T14:57:35.858979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b10f4b53-de546bc5-9ec2e046-7a71f42d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:35.861954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0] Write session: try to update token
2025-09-30T14:57:35.861971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:35.874817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:35.874834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:35.874844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896542828405069:11945]
2025-09-30T14:57:35.874895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:35.874898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:35.875056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:35.875196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:35.875369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:35.875522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:35.875728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:35.875770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:35.877984Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2611 sessionId: src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:35.880925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:35.881475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:35.881303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:35.881323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:35.881371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:35.883302Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:35.883315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:35.883317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:35.883323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:35.883335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896542828405069:11945]
2025-09-30T14:57:35.883338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896542828405069:11945]
2025-09-30T14:57:35.883341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896542828405069:11945]
2025-09-30T14:57:35.883379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:35.883386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:35.883388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:35.883536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:35.887636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:35.887649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:35.887653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:35.920339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896542918197170:11465]
2025-09-30T14:57:35.920816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2610, pipe: [1:7555896542918197170:11465]
2025-09-30T14:57:35.999190Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:36.007741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.007767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.007944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:36.008001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:36.008068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:36.008138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:36.008179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:36.008184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:36.008254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:36.008316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:36.008378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:36.008444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:36.008487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:36.008491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:36.008561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:36.008617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:36.008680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:36.008743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:36.008784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:36.008787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:36.008855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:36.008915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:36.008979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:36.009060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:36.009098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:36.009102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:36.009171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:36.009234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:36.009303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:36.009369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:36.009413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:36.009415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:36.009483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:36.009548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:36.009609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:36.009668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:36.009711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:36.009713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:36.009786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:36.009846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:36.009915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:36.009979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:36.010293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:36.010297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:36.010368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:36.010429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:36.010498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:36.010564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:36.010608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:36.010611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:36.010690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:36.010750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:36.010820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:36.010881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:36.010925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:36.010928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:36.011001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:36.011063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:36.011123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:36.011191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:36.011232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:36.011235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:36.011582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896542918197170:11465], now have 1 active actors on pipe
2025-09-30T14:57:36.012682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:36.012723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:36.012726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:36.012735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896542918197170:11465]
2025-09-30T14:57:36.012756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2611 reason: error at write: Disconnected sessionId: src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0
2025-09-30T14:57:36.012946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2611 sessionId: src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0 is DEAD
2025-09-30T14:57:36.013142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:36.013154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0] Write session will restart in 0.005055s
2025-09-30T14:57:36.013176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0] Write session: Do CDS request
2025-09-30T14:57:36.013182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:36.012592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:36.023759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:36.024189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:36.024212Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2612
2025-09-30T14:57:36.024362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2612 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:36.024410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2612 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:36.024421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2612 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:36.024426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:36.024869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2612 sessionId:  describe result for acl check
2025-09-30T14:57:36.024910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:36.024916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:36.024918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:36.024924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896547213164511:11523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:36.025458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896547213164511:11523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:36.028351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896547213164511:11523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:36.031054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896547213164511:11523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:36.031067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896547213164511:11523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:36.031070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896547213164511:11523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:36.031078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2612 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:36.031852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:36.034064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:36.034274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:36.034285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:36.034296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:36.034349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:36.034399Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896547123372585:11954]
2025-09-30T14:57:36.035077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:36.035410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:36.035467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:36.035863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:36.035925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.035930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.035931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.035932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.035933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.035935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.035936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.035937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.035938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.035939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.035940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.035941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.035942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.035943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.035944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.035950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.035961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.035966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.035971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.035975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.035979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.035983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.035987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.035992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.035997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.036002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.036006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.036010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.036014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.036018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.036027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.036035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.036042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.036047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.036053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.036059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.036068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.036073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.036079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.036088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.036093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.036098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.036103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.036109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.036114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.036123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.036129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.036136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.036141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.036150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.036156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.036165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.036170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.036176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.036181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.036194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.036210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.036215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.036220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.036226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.036270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:36.041993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:36.043214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:36.043231Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:36.043235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:36.043239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:36.043316Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2611 [2:7555896547123372585:11954]
2025-09-30T14:57:36.043336Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:36.043358Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:36.043366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:36.043369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:36.043372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:36.043390Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:36.043399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:36.043407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:36.043480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.043489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.043492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.043496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:36.043499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:36.043572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:36.043580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.043594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.043611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.043634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:36.043656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896547123372580:11954]
2025-09-30T14:57:36.043665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896547123372580:11954]
2025-09-30T14:57:36.043667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896547123372580:11954]
2025-09-30T14:57:36.043676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:36.043686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:36.043690Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:36.043692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:36.043696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213164469:2454], now have 1 active actors on pipe
2025-09-30T14:57:36.043703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213164665:11523], now have 1 active actors on pipe
2025-09-30T14:57:36.043709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:36.043722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:36.043725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:36.043761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896547123372580:11954]
2025-09-30T14:57:36.043774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:36.043783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:36.043780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2611
2025-09-30T14:57:36.043831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2611
2025-09-30T14:57:36.043830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.043839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.043864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:36.043876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:36.043880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:36.043886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:36.043895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:36.043904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:36.043927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:36.044076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.044083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.044095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:36.045014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2612 partition: 0 MaxSeqNo: 42 sessionId: src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0
2025-09-30T14:57:36.045467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|629cc714-a527d2a4-eedeb3e3-43b1f44a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:36.048477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0] Write session: try to update token
2025-09-30T14:57:36.048503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:36.056049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:36.056068Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:36.056079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896547123372580:11954]
2025-09-30T14:57:36.056131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:36.056130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:36.056329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:36.056491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:36.056647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:36.056805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:36.057021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:36.057098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:36.063919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2612 sessionId: src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:36.066559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:36.067592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.067616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.067637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:36.067641Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:36.067643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:36.067646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:36.067654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896547123372580:11954]
2025-09-30T14:57:36.067659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896547123372580:11954]
2025-09-30T14:57:36.067663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896547123372580:11954]
2025-09-30T14:57:36.067716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:36.067723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.067726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:36.067792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:36.067808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:36.067812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:36.067864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:36.112857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896547213164678:11465]
2025-09-30T14:57:36.113263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2611, pipe: [1:7555896547213164678:11465]
2025-09-30T14:57:36.190756Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:36.191266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:36.191308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213164678:11465], now have 1 active actors on pipe
2025-09-30T14:57:36.191562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:36.191565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:36.191612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896547213164678:11465]
2025-09-30T14:57:36.191667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:36.191670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:36.191738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2612 reason: error at write: Disconnected sessionId: src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0
2025-09-30T14:57:36.191868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2612 sessionId: src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0 is DEAD
2025-09-30T14:57:36.192304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:36.192314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0] Write session will restart in 0.007582s
2025-09-30T14:57:36.192339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0] Write session: Do CDS request
2025-09-30T14:57:36.192344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:36.200781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:36.200913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:36.200933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2613
2025-09-30T14:57:36.201922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2613 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:36.201978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2613 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:36.201988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2613 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:36.201993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:36.202473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2613 sessionId:  describe result for acl check
2025-09-30T14:57:36.202511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:36.202519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:36.202520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:36.202527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896547213164706:11527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:36.203078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896547213164706:11527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:36.205950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896547213164706:11527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:36.210096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896547213164706:11527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:36.210115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896547213164706:11527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:36.210119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896547213164706:11527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:36.210128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2613 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:36.211471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:36.213939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:36.214158Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:36.214171Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:36.214183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:36.214244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:36.214286Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896547123372799:11957]
2025-09-30T14:57:36.214951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:36.215267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:36.215315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:36.215670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:36.215729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.215734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.215736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.215737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.215739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.215740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.215741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.215743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.215744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.215746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.215747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.215748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.215750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.215751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.215753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.215759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.215770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.215775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.215778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.215783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.215788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.215792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.215797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.215801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.215807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.215812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.215823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.215828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.215832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.215838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.215852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.215866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.215876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.215887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.215897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.215907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.215916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.215926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.215938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.215949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.215955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.215960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.215969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.215978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.215986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.215995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.216000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.216008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.216015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.216024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.216033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.216043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.216052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.216062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.216070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.216076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.216081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.216093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.216107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.216114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.216160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:36.224980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:36.226218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:36.226233Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:36.226237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:36.226242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:36.226249Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2612 [2:7555896547123372799:11957]
2025-09-30T14:57:36.226273Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:36.226297Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:36.226306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:36.226309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:36.226311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:36.226327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:36.226334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:36.226347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:36.226417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.226424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.226425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.226429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:36.226432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:36.226502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:36.226509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.226522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.226538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.226558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:36.226586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213164878:11527], now have 1 active actors on pipe
2025-09-30T14:57:36.226589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213164680:2454], now have 1 active actors on pipe
2025-09-30T14:57:36.226595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896547123372794:11957]
2025-09-30T14:57:36.226597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896547123372794:11957]
2025-09-30T14:57:36.226599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896547123372794:11957]
2025-09-30T14:57:36.226614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:36.226628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:36.226632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:36.226635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:36.226637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:36.226644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:36.226648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:36.226686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896547123372794:11957]
2025-09-30T14:57:36.226698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:36.226736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:36.227345Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2612
2025-09-30T14:57:36.227390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2612
2025-09-30T14:57:36.227507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.227525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.227556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:36.227564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:36.227569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:36.227572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:36.227584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:36.227595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:36.227612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:36.227829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.227843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.227867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:36.227976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2613 partition: 0 MaxSeqNo: 42 sessionId: src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0
2025-09-30T14:57:36.228356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4fb0e1-9722fc85-1e9e2a95-5f09c5ce_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:36.231228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0] Write session: try to update token
2025-09-30T14:57:36.231266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:36.239972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:36.239989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:36.240006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:36.240009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:36.240020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896547123372794:11957]
2025-09-30T14:57:36.240026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896547123372794:11957]
2025-09-30T14:57:36.240030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896547123372794:11957]
2025-09-30T14:57:36.240082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:36.240091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.240093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:36.240264Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:36.243905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:36.243925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:36.243933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:36.253582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2613 sessionId: src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:36.256623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:36.291542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896547213164896:11465]
2025-09-30T14:57:36.291956Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2612, pipe: [1:7555896547213164896:11465]
2025-09-30T14:57:36.373144Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:36.373635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.373652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.373673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213164896:11465], now have 1 active actors on pipe
2025-09-30T14:57:36.374051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896547213164896:11465]
2025-09-30T14:57:36.374084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:36.374114Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:36.374116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:36.374170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2613 reason: error at write: Disconnected sessionId: src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0
2025-09-30T14:57:36.374320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2613 sessionId: src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0 is DEAD
2025-09-30T14:57:36.374129Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:36.374814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:36.374824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0] Write session will restart in 0.005417s
2025-09-30T14:57:36.374848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0] Write session: Do CDS request
2025-09-30T14:57:36.374857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:36.381823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:36.383470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:36.383491Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2614
2025-09-30T14:57:36.383681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2614 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:36.383716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2614 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:36.383723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2614 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:36.383727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:36.386057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2614 sessionId:  describe result for acl check
2025-09-30T14:57:36.386101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:36.386106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:36.386108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:36.386117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896547213164926:11533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:36.386746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896547213164926:11533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:36.389258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896547213164926:11533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:36.395127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896547213164926:11533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:36.395144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896547213164926:11533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:36.395148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896547213164926:11533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:36.395157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2614 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:36.423231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:36.427388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:36.427648Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:36.427652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:36.427664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:36.427724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:36.427783Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896547123373002:11959]
2025-09-30T14:57:36.428508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:36.429180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:36.429231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:36.429549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:36.429596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.429597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.429598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.429599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.429600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.429601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.429602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.429603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.429604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.429605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.429606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.429607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.429608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.429609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.429610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.429615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.429622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.429625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.429628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.429630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.429633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.429636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.429638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.429641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.429644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.429647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.429649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.429652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.429655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.429657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.429664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.429669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.429674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.429678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.429681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.429684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.429688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.429691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.429695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.429698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.429702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.429705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.429710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.429713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.429716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.429719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.429722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.429726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.429732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.429736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.429738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.429742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.429744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.429747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.429750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.429753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.429756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.429759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.429762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.429765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.429791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:36.437210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:36.438174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:36.438183Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:36.438186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:36.438192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:36.438201Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2613 [2:7555896547123373002:11959]
2025-09-30T14:57:36.438221Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:36.438240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:36.438244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:36.438248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:36.438251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:36.438270Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:36.438278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:36.438287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:36.438357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.438361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.438364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.438369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:36.438372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:36.438467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:36.438471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.438487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.438504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.438526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:36.438544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896547123372996:11959]
2025-09-30T14:57:36.438547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896547123372996:11959]
2025-09-30T14:57:36.438550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896547123372996:11959]
2025-09-30T14:57:36.438565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:36.438580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:36.438598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:36.438603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:36.438643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896547123372996:11959]
2025-09-30T14:57:36.438646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:36.439022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:36.439026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:36.439029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:36.439035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:36.439417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213164963:11533], now have 1 active actors on pipe
2025-09-30T14:57:36.439425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213164914:2454], now have 1 active actors on pipe
2025-09-30T14:57:36.439906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2613
2025-09-30T14:57:36.439953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2613
2025-09-30T14:57:36.441160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2614 partition: 0 MaxSeqNo: 42 sessionId: src_id|7125919a-e498a623-7c121ce9-13821c5b_0
2025-09-30T14:57:36.442407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3f50423-1549ae1f-fe7cc93c-c8ed9ea5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7125919a-e498a623-7c121ce9-13821c5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:36.440385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.440398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.440429Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7125919a-e498a623-7c121ce9-13821c5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:36.440440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:36.440445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:36.440448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:36.440465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:36.440478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:36.440500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:36.440987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.440991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.441008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:36.445425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7125919a-e498a623-7c121ce9-13821c5b_0] Write session: try to update token
2025-09-30T14:57:36.445444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7125919a-e498a623-7c121ce9-13821c5b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:36.455156Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:36.455175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:36.455178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:36.455180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:36.455192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896547123372996:11959]
2025-09-30T14:57:36.455197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896547123372996:11959]
2025-09-30T14:57:36.455202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896547123372996:11959]
2025-09-30T14:57:36.455253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:36.455260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:36.455262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:36.455266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:36.455267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.455271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:36.455417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:36.461979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2614 sessionId: src_id|7125919a-e498a623-7c121ce9-13821c5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:36.464848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:36.474293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896547213165125:11465]
2025-09-30T14:57:36.475971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2613, pipe: [1:7555896547213165125:11465]
2025-09-30T14:57:36.571458Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:36.572071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.572091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.572131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213165125:11465], now have 1 active actors on pipe
2025-09-30T14:57:36.572389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:36.573075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:36.573160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2614 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7125919a-e498a623-7c121ce9-13821c5b_0
2025-09-30T14:57:36.573326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2614 sessionId: src_id|7125919a-e498a623-7c121ce9-13821c5b_0 is DEAD
2025-09-30T14:57:36.573447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:36.573450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896547213165125:11465]
2025-09-30T14:57:36.579622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7125919a-e498a623-7c121ce9-13821c5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:36.579642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7125919a-e498a623-7c121ce9-13821c5b_0] Write session will restart in 0.007897s
2025-09-30T14:57:36.579677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7125919a-e498a623-7c121ce9-13821c5b_0] Write session: Do CDS request
2025-09-30T14:57:36.579686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7125919a-e498a623-7c121ce9-13821c5b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:36.590451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:36.594605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7125919a-e498a623-7c121ce9-13821c5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:36.593670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:36.593890Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:36.593894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:36.593903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:36.593956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:36.593995Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896547123373207:11962]
2025-09-30T14:57:36.594664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:36.594973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:36.594989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2615
2025-09-30T14:57:36.595146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2615 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:36.595203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2615 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:36.595208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2615 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:36.595213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:36.594967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:36.595017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:36.595353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:36.595428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.595429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.595431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.595432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.595434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.595436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.595437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.595438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.595439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.595441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.595443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.595444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.595446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.595447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.595448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.595454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.595465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.595470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.595475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.595480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.595484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.595489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.595494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.595499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.595504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.595509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.595514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.595519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.595524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.595529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.595538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.595548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.595554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.595561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.595566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.595572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.595577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.595583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.595589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.595595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.595600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.595607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.595613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.595619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.595624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.595630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.595636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.595642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.595647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.595653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.595659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.595665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.595671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.595677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.595682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.595688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.595693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.595701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.595708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.595714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.595764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:36.595617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2615 sessionId:  describe result for acl check
2025-09-30T14:57:36.595653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:36.595655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:36.595659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:36.595667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896547213165296:11537] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:36.596231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896547213165296:11537] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:36.598929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896547213165296:11537] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:36.605808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:36.606641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:36.606653Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:36.606655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:36.606658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:36.606664Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2614 [2:7555896547123373207:11962]
2025-09-30T14:57:36.606677Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:36.606690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:36.606692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:36.606695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:36.606697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:36.606708Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:36.606713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:36.606720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:36.606775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.606782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.606785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.606788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:36.606791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:36.606842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:36.606848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.606856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.606863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.606872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:36.606885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896547123373201:11962]
2025-09-30T14:57:36.606887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896547123373201:11962]
2025-09-30T14:57:36.606889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896547123373201:11962]
2025-09-30T14:57:36.606896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:36.606908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:36.606911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:36.606911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:36.606913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:36.606925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:36.606928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:36.606938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213165130:2454], now have 1 active actors on pipe
2025-09-30T14:57:36.606973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896547123373201:11962]
2025-09-30T14:57:36.606981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:36.607011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:36.607218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2614
2025-09-30T14:57:36.607532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896547213165296:11537] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:36.607546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896547213165296:11537] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:36.607550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896547213165296:11537] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:36.607558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2615 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:36.607816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213165333:11537], now have 1 active actors on pipe
2025-09-30T14:57:36.607960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2614
2025-09-30T14:57:36.608108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.608116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.608153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36e08c9c-395f6848-91033201-ca1de38a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:36.608162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:36.608166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:36.608168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:36.608178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:36.608191Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:36.608206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:36.610782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.610795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.610816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:36.612853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2615 partition: 0 MaxSeqNo: 42 sessionId: src_id|36e08c9c-395f6848-91033201-ca1de38a_0
2025-09-30T14:57:36.613277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7125919a-e498a623-7c121ce9-13821c5b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|36e08c9c-395f6848-91033201-ca1de38a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:36.616358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36e08c9c-395f6848-91033201-ca1de38a_0] Write session: try to update token
2025-09-30T14:57:36.616380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36e08c9c-395f6848-91033201-ca1de38a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:36.620881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:36.620896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:36.620899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:36.620901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:36.620911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896547123373201:11962]
2025-09-30T14:57:36.620916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896547123373201:11962]
2025-09-30T14:57:36.620921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896547123373201:11962]
2025-09-30T14:57:36.620961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:36.620968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.620970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:36.621126Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:36.621133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:36.621139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:36.621145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:36.640842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2615 sessionId: src_id|36e08c9c-395f6848-91033201-ca1de38a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:36.644218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:36.673453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896547213165340:11465]
2025-09-30T14:57:36.673853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2614, pipe: [1:7555896547213165340:11465]
2025-09-30T14:57:36.731587Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:36.732241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.732251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.732273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213165340:11465], now have 1 active actors on pipe
2025-09-30T14:57:36.732593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:36.732595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896547213165340:11465]
2025-09-30T14:57:36.732611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:36.732617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:36.732674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2615 reason: error at write: Disconnected sessionId: src_id|36e08c9c-395f6848-91033201-ca1de38a_0
2025-09-30T14:57:36.732847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2615 sessionId: src_id|36e08c9c-395f6848-91033201-ca1de38a_0 is DEAD
2025-09-30T14:57:36.733226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36e08c9c-395f6848-91033201-ca1de38a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:36.733233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36e08c9c-395f6848-91033201-ca1de38a_0] Write session will restart in 0.005827s
2025-09-30T14:57:36.733249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36e08c9c-395f6848-91033201-ca1de38a_0] Write session: Do CDS request
2025-09-30T14:57:36.733253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36e08c9c-395f6848-91033201-ca1de38a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:36.732549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:36.739686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36e08c9c-395f6848-91033201-ca1de38a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:36.739827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:36.739843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2616
2025-09-30T14:57:36.739954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2616 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:36.739981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2616 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:36.739987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2616 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:36.739992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:36.740492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2616 sessionId:  describe result for acl check
2025-09-30T14:57:36.740523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:36.740525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:36.740527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:36.740532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896547213165366:11542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:36.741086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896547213165366:11542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:36.752706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:36.755229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:36.755439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:36.755449Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:36.755470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:36.755532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:36.755577Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896547123373413:11964]
2025-09-30T14:57:36.756179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:36.756491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:36.756529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:36.756833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:36.756905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.756906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.756907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.756908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.756909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.756910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.756911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.756912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.756913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.756915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.756991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896547213165366:11542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:36.756916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.756917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.756918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.756919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.756920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.756927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.756937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.756940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.756944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.756947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.756950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.756954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.756957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.756960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.756964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.756967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.756971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.756974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.756977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.756981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.756989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.756997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.757002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.757007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.757011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.757016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.757030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.757035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.757040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.757047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.757051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.757055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.757059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.757063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.757068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.757072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.757077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.757082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.757086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.757090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.757094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.757099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.757103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.757107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.757114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.757118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.757122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.757126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.757131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.757135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.757175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:36.763081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896547213165366:11542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:36.763098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896547213165366:11542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:36.763100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896547213165366:11542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:36.763107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2616 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:36.763352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:36.764303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:36.764319Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:36.764322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:36.764325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:36.764332Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2615 [2:7555896547123373413:11964]
2025-09-30T14:57:36.764347Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:36.764364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:36.764373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:36.764376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:36.764379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:36.764395Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:36.764402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:36.764408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:36.764465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.764468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.764470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.764473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:36.764476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:36.764542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:36.764545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.764559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.764572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.764595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:36.764617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896547123373408:11964]
2025-09-30T14:57:36.764625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896547123373408:11964]
2025-09-30T14:57:36.764627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896547123373408:11964]
2025-09-30T14:57:36.764636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:36.764645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:36.764652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:36.764656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:36.764658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:36.764697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2615
2025-09-30T14:57:36.764701Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2615
2025-09-30T14:57:36.764666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:36.764674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:36.764684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213165343:2454], now have 1 active actors on pipe
2025-09-30T14:57:36.764688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213165548:11542], now have 1 active actors on pipe
2025-09-30T14:57:36.764713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896547123373408:11964]
2025-09-30T14:57:36.764722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:36.764752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:36.764865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.764878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.764905Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:36.764920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:36.764929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:36.764936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:36.764947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:36.764963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:36.764983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:36.765237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.765248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.765270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:36.765356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2616 partition: 0 MaxSeqNo: 42 sessionId: src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0
2025-09-30T14:57:36.765738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36e08c9c-395f6848-91033201-ca1de38a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:36.768532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0] Write session: try to update token
2025-09-30T14:57:36.768553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:36.776926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:36.776951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:36.776961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896547123373408:11964]
2025-09-30T14:57:36.777010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:36.777222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:36.777300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:36.777398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:36.777554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:36.777703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:36.777917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:36.777969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:36.793556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:36.793578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:36.793581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:36.793583Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:36.793596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896547123373408:11964]
2025-09-30T14:57:36.793600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896547123373408:11964]
2025-09-30T14:57:36.793605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896547123373408:11964]
2025-09-30T14:57:36.793646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:36.793653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.793656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:36.793804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:36.794039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:36.794051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:36.794055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:36.796357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2616 sessionId: src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:36.807529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:36.832711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896547213165556:11465]
2025-09-30T14:57:36.833389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2615, pipe: [1:7555896547213165556:11465]
2025-09-30T14:57:36.908514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:36.909452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.909468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.909484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213165556:11465], now have 1 active actors on pipe
2025-09-30T14:57:36.910850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:36.910860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0] Write session will restart in 0.009045s
2025-09-30T14:57:36.910881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0] Write session: Do CDS request
2025-09-30T14:57:36.910887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:36.910807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:36.910238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896547213165556:11465]
2025-09-30T14:57:36.910296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:36.910305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:36.910308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:36.910363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2616 reason: error at write: Disconnected sessionId: src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0
2025-09-30T14:57:36.910539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2616 sessionId: src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0 is DEAD
2025-09-30T14:57:36.923684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:36.923780Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:36.923799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2617
2025-09-30T14:57:36.923977Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2617 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:36.924015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2617 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:36.924021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2617 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:36.924025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:36.924471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2617 sessionId:  describe result for acl check
2025-09-30T14:57:36.924498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:36.924500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:36.924502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:36.924509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896547213165619:11553] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:36.924987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896547213165619:11553] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:36.935811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896547213165619:11553] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:36.944616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:36.944065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896547213165619:11553] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:36.944089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896547213165619:11553] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:36.944092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896547213165619:11553] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:36.944101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2617 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:36.946717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:36.946933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:36.946937Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:36.946947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:36.946997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:36.947038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896547123373656:11978]
2025-09-30T14:57:36.947649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:36.948461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:36.948513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:36.948814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:36.948876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.948881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.948883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.948884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.948885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.948886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.948887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.948888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.948889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.948890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.948891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.948893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.948894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.948895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.948896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.948901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.948910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.948913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.948917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.948920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.948924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.948928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.948931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.948934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.948938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.948941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.948944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.948947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.948950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.948953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.948962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.948969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:36.948974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.948979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:36.948983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.948988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:36.948992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.948996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:36.949001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.949005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:36.949009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.949014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:36.949018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.949035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:36.949039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.949043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:36.949049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.949053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:36.949057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.949062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:36.949066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.949070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.949074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.949078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.949081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.949086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.949089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.949093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:36.949097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.949101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:36.949138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:36.957461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2616
2025-09-30T14:57:36.955929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:36.956945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:36.956950Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:36.956953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:36.956957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:36.956964Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2616 [2:7555896547123373656:11978]
2025-09-30T14:57:36.956980Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:36.956995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:36.956998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:36.957001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:36.957004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:36.957493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2616
2025-09-30T14:57:36.957018Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:36.957042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:36.957050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:36.957109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.957111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.957114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.957117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:36.957121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:36.957194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:36.957197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.957212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:36.957226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:36.957246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:36.957264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213165781:11553], now have 1 active actors on pipe
2025-09-30T14:57:36.957272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896547123373650:11978]
2025-09-30T14:57:36.957275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896547123373650:11978]
2025-09-30T14:57:36.957277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896547123373650:11978]
2025-09-30T14:57:36.957292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:36.957302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896547213165581:2454], now have 1 active actors on pipe
2025-09-30T14:57:36.957309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:36.957316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:36.957320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:36.957323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:36.957326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:36.957329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:36.957553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896547123373650:11978]
2025-09-30T14:57:36.957565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:36.957604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:36.957758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.957766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.957795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:36.957803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:36.957807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:36.957809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:36.957819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:36.957829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:36.957845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:36.958082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.958112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.958142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:36.958237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2617 partition: 0 MaxSeqNo: 42 sessionId: src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0
2025-09-30T14:57:36.958573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|abff2482-6718707e-98f7cfa2-7e56ea34_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:36.961314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0] Write session: try to update token
2025-09-30T14:57:36.961331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:36.974127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:36.974142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:36.974151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896547123373650:11978]
2025-09-30T14:57:36.974198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:36.974314Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:36.974369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:36.974512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:36.974656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:36.974799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:36.974991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:36.975037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:36.980400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2617 sessionId: src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:36.983049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:36.983346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:36.983368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:36.983416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:36.984100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:36.991998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:36.992017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:36.992020Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:36.992022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:36.992034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896547123373650:11978]
2025-09-30T14:57:36.992038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896547123373650:11978]
2025-09-30T14:57:36.992043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896547123373650:11978]
2025-09-30T14:57:36.992087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:36.992100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:36.992103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:36.992242Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:36.995036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:36.995055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:36.995059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:37.010360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896551508133091:11465]
2025-09-30T14:57:37.010661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2616, pipe: [1:7555896551508133091:11465]
2025-09-30T14:57:37.115772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:37.129066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896551508133091:11465]
2025-09-30T14:57:37.129088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:37.129093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:37.129121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2617 reason: error at write: Disconnected sessionId: src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0
2025-09-30T14:57:37.129128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:37.129283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2617 sessionId: src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0 is DEAD
2025-09-30T14:57:37.129443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:37.129454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0] Write session will restart in 0.006863s
2025-09-30T14:57:37.129478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0] Write session: Do CDS request
2025-09-30T14:57:37.129484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:37.124508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.124535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.124714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:37.124772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:37.124831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:37.124891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:37.124934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:37.124939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:37.125006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:37.125086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:37.125142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:37.125205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:37.125244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:37.125248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:37.125315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:37.125372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:37.125430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:37.125491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:37.125533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:37.125537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:37.125603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:37.125658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:37.125718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:37.125778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:37.125816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:37.125820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:37.125887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:37.125945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:37.125999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:37.126057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:37.126101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:37.126105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:37.126170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:37.126225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:37.126282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:37.126349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:37.126388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:37.126391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:37.126460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:37.126519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:37.126580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:37.126650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:37.126691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:37.126694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:37.126759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:37.126821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:37.126878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:37.126939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:37.126979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:37.126982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:37.127051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:37.127106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:37.127165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:37.127227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:37.127558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:37.127563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:37.127632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:37.127690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:37.127749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:37.127806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:37.127846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:37.127849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:37.127919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133091:11465], now have 1 active actors on pipe
2025-09-30T14:57:37.129135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:37.137912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:37.137946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:37.137967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2618
2025-09-30T14:57:37.140340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2618 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:37.140388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2618 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:37.140398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2618 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:37.140404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:37.140861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2618 sessionId:  describe result for acl check
2025-09-30T14:57:37.140901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:37.140909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:37.140913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:37.140920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896551508133138:11557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:37.141451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896551508133138:11557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:37.144135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896551508133138:11557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:37.147583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:37.150386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:37.150728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896551508133138:11557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:37.150750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896551508133138:11557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:37.150754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896551508133138:11557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:37.150763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2618 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:37.150677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:37.150694Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:37.150707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:37.150778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:37.150820Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896551418341173:11982]
2025-09-30T14:57:37.151506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:37.151820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:37.151863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:37.152149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:37.152197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.152201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.152202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.152203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.152204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.152205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.152205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.152206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.152207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.152208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.152208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.152209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.152210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.152211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.152211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.152216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.152222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.152225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.152227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.152230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.152232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.152234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.152237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.152239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.152242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.152244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.152247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.152249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.152251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.152254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.152261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.152266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.152270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.152274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.152277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.152280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.152283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.152286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.152289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.152292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.152295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.152298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.152301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.152304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.152308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.152311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.152314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.152318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.152320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.152324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.152326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.152331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.152333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.152336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.152339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.152342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.152345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.152348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.152351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.152354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.152377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:37.158105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:37.159206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:37.159238Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:37.159258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:37.159263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:37.159269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2617 [2:7555896551418341173:11982]
2025-09-30T14:57:37.159287Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:37.159303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:37.159311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:37.159313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:37.159316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:37.159331Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:37.159338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:37.159349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:37.159411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.159419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.159422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.159426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:37.159428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:37.159494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:37.159502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.159517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.159531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.159555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:37.159575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896551418341168:11982]
2025-09-30T14:57:37.159582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896551418341168:11982]
2025-09-30T14:57:37.159585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896551418341168:11982]
2025-09-30T14:57:37.159594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:37.159610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:37.159614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:37.159621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:37.159623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:37.159630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:37.159634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:37.159644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133093:2454], now have 1 active actors on pipe
2025-09-30T14:57:37.159654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133296:11557], now have 1 active actors on pipe
2025-09-30T14:57:37.159689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896551418341168:11982]
2025-09-30T14:57:37.159703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:37.159707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:37.161371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2617
2025-09-30T14:57:37.161423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2617
2025-09-30T14:57:37.161465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.161482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.161511Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:37.161520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:37.161524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:37.161527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:37.161539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:37.161557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:37.161578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:37.161728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.161737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.161750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:37.161819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2618 partition: 0 MaxSeqNo: 42 sessionId: src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0
2025-09-30T14:57:37.162228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d760693e-f86ce72c-cd1ba455-d12a89a0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:37.165114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0] Write session: try to update token
2025-09-30T14:57:37.165132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:37.177136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:37.177156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:37.177158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:37.177160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:37.177173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896551418341168:11982]
2025-09-30T14:57:37.177177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896551418341168:11982]
2025-09-30T14:57:37.177181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896551418341168:11982]
2025-09-30T14:57:37.177222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:37.177229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.177232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:37.177236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:37.177241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:37.177248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:37.177376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:37.181368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2618 sessionId: src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:37.184052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:37.229475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896551508133311:11465]
2025-09-30T14:57:37.229933Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2617, pipe: [1:7555896551508133311:11465]
2025-09-30T14:57:37.300696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:37.301205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.301222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.301261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133311:11465], now have 1 active actors on pipe
2025-09-30T14:57:37.301423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:37.301479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:37.301530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896551508133311:11465]
2025-09-30T14:57:37.301545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:37.301603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2618 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0
2025-09-30T14:57:37.301796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2618 sessionId: src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0 is DEAD
2025-09-30T14:57:37.303102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:37.303112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0] Write session will restart in 0.005890s
2025-09-30T14:57:37.303135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0] Write session: Do CDS request
2025-09-30T14:57:37.303141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:37.309784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:37.309947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:37.309968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2619
2025-09-30T14:57:37.311955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2619 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:37.312011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2619 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:37.312016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2619 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:37.312022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:37.313307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2619 sessionId:  describe result for acl check
2025-09-30T14:57:37.313358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:37.313367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:37.313369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:37.313375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896551508133338:11563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:37.313941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896551508133338:11563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:37.316158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896551508133338:11563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:37.320587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896551508133338:11563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:37.320614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896551508133338:11563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:37.320618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896551508133338:11563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:37.320626Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2619 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:37.329946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:37.333003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:37.333238Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:37.333248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:37.333259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:37.333314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:37.333373Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896551418341382:11984]
2025-09-30T14:57:37.334059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:37.334609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:37.334670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:37.335046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:37.335123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.335125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.335126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.335128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.335130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.335131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.335133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.335134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.335135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.335137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.335138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.335139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.335141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.335142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.335146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.335152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.335162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.335166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.335170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.335174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.335178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.335183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.335186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.335191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.335196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.335200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.335204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.335208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.335212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.335216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.335225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.335235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.335241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.335264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.335270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.335276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.335280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.335285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.335292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.335297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.335302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.335307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.335322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.335328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.335332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.335337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.335342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.335347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.335352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.335357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.335365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.335369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.335374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.335379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.335383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.335388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.335393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.335398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.335402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.335409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.335461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:37.343539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:37.344836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:37.344843Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:37.344844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:37.344847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:37.344854Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2618 [2:7555896551418341382:11984]
2025-09-30T14:57:37.344867Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:37.344881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:37.344884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:37.344886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:37.344888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:37.344901Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:37.344906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:37.344911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:37.344977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.344981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.344983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.344986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:37.344989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:37.345069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:37.345071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.345081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.345088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.345098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:37.345111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896551418341377:11984]
2025-09-30T14:57:37.345113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896551418341377:11984]
2025-09-30T14:57:37.345114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896551418341377:11984]
2025-09-30T14:57:37.345121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:37.345134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:37.345143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:37.345145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:37.345168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:37.345172Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:37.345174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896551418341377:11984]
2025-09-30T14:57:37.345176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:37.345176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:37.345191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:37.345199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133318:2454], now have 1 active actors on pipe
2025-09-30T14:57:37.345201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133428:11563], now have 1 active actors on pipe
2025-09-30T14:57:37.345788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2618
2025-09-30T14:57:37.345832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2618
2025-09-30T14:57:37.346106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.346122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.346152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:37.346167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:37.346171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:37.346174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:37.346185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:37.346197Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:37.346213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:37.347003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.347014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.347035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:37.347184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2619 partition: 0 MaxSeqNo: 42 sessionId: src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0
2025-09-30T14:57:37.347601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b0a712-99fb5f23-60fe6ebc-24a80efb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:37.350531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0] Write session: try to update token
2025-09-30T14:57:37.350558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:37.363884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:37.363899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:37.363908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896551418341377:11984]
2025-09-30T14:57:37.363942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:37.364098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:37.364223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:37.364354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:37.364475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:37.364644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:37.364671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:37.364944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:37.383321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2619 sessionId: src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:37.386231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:37.387134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.387162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.387183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:37.387186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:37.387189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:37.387191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:37.387200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896551418341377:11984]
2025-09-30T14:57:37.387205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896551418341377:11984]
2025-09-30T14:57:37.387208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896551418341377:11984]
2025-09-30T14:57:37.387276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:37.387281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:37.387289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.387290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:37.387292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:37.387294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:37.387425Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:37.401078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896551508133548:11465]
2025-09-30T14:57:37.401379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2618, pipe: [1:7555896551508133548:11465]
2025-09-30T14:57:37.514145Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:37.514431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:37.514468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133548:11465], now have 1 active actors on pipe
2025-09-30T14:57:37.515122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:37.515144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0] Write session will restart in 0.008293s
2025-09-30T14:57:37.515168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0] Write session: Do CDS request
2025-09-30T14:57:37.515173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:37.514587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:37.514713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:37.514716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:37.514797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2619 reason: error at write: Disconnected sessionId: src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0
2025-09-30T14:57:37.514954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2619 sessionId: src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0 is DEAD
2025-09-30T14:57:37.515309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:37.515316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896551508133548:11465]
2025-09-30T14:57:37.524761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:37.527619Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:37.527637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2620
2025-09-30T14:57:37.527813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2620 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:37.527860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2620 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:37.527871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2620 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:37.527878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:37.528294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2620 sessionId:  describe result for acl check
2025-09-30T14:57:37.528329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:37.528331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:37.528336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:37.528342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896551508133687:11567] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:37.528859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896551508133687:11567] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:37.530715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896551508133687:11567] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:37.531194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:37.533398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:37.533703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:37.533716Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:37.533729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:37.533798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:37.533793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896551508133687:11567] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:37.533806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896551508133687:11567] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:37.533810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896551508133687:11567] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:37.533818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2620 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:37.533841Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896551418341591:11986]
2025-09-30T14:57:37.534489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:37.534798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:37.534841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:37.535156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:37.535220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.535225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.535226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.535227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.535228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.535229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.535230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.535232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.535233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.535234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.535236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.535237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.535238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.535240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.535259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.535266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.535276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.535280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.535285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.535289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.535293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.535297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.535301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.535305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.535309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.535314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.535318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.535322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.535327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.535332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.535340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.535348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.535356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.535363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.535370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.535376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.535385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.535391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.535400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.535405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.535410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.535415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.535420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.535424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.535429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.535435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.535445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.535451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.535459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.535465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.535475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.535481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.535485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.535491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.535499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.535504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.535512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.535518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.535525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.535534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.535579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:37.542156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:37.543131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:37.543150Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:37.543154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:37.543158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:37.543165Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2619 [2:7555896551418341591:11986]
2025-09-30T14:57:37.543184Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:37.543202Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:37.543211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:37.543215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:37.543218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:37.543233Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:37.543260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:37.543268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:37.543331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.543339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.543341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.543345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:37.543348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:37.543417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:37.543426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.543438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.543455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.543476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:37.543595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2619
2025-09-30T14:57:37.543607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2619
2025-09-30T14:57:37.543499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133551:2454], now have 1 active actors on pipe
2025-09-30T14:57:37.543507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133757:11567], now have 1 active actors on pipe
2025-09-30T14:57:37.543514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896551418341586:11986]
2025-09-30T14:57:37.543517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896551418341586:11986]
2025-09-30T14:57:37.543519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896551418341586:11986]
2025-09-30T14:57:37.543533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:37.543548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:37.543557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:37.543560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:37.543563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:37.543564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:37.543567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:37.543602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896551418341586:11986]
2025-09-30T14:57:37.543617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:37.543622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:37.543761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.543767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.543799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|88f04794-6f4738a8-b6882056-2966f52b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:37.543806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:37.543810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:37.543812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:37.543823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:37.543838Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:37.543852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:37.543991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.543999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.544012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:37.544097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2620 partition: 0 MaxSeqNo: 42 sessionId: src_id|88f04794-6f4738a8-b6882056-2966f52b_0
2025-09-30T14:57:37.544480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e622153-9c04413f-a3167ee8-3f0b1ca9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|88f04794-6f4738a8-b6882056-2966f52b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:37.547361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88f04794-6f4738a8-b6882056-2966f52b_0] Write session: try to update token
2025-09-30T14:57:37.547381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88f04794-6f4738a8-b6882056-2966f52b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:37.555946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:37.555962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:37.555976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896551418341586:11986]
2025-09-30T14:57:37.556026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:37.556201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:37.556352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:37.556502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:37.556655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:37.556856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:37.556900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:37.558659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:37.565636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2620 sessionId: src_id|88f04794-6f4738a8-b6882056-2966f52b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:37.567360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:37.567378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:37.567381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:37.567384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:37.567394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896551418341586:11986]
2025-09-30T14:57:37.567400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896551418341586:11986]
2025-09-30T14:57:37.567404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896551418341586:11986]
2025-09-30T14:57:37.567450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:37.567459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.567462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:37.567473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:37.567498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:37.567508Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:37.567609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:37.568400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:37.615553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896551508133768:11465]
2025-09-30T14:57:37.615866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2619, pipe: [1:7555896551508133768:11465]
2025-09-30T14:57:37.684208Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:37.684949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.684962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.684983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133768:11465], now have 1 active actors on pipe
2025-09-30T14:57:37.685258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:37.685279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:37.685292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896551508133768:11465]
2025-09-30T14:57:37.685318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:37.685321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:37.685402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2620 reason: error at write: Disconnected sessionId: src_id|88f04794-6f4738a8-b6882056-2966f52b_0
2025-09-30T14:57:37.685557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2620 sessionId: src_id|88f04794-6f4738a8-b6882056-2966f52b_0 is DEAD
2025-09-30T14:57:37.685985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f04794-6f4738a8-b6882056-2966f52b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:37.685995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f04794-6f4738a8-b6882056-2966f52b_0] Write session will restart in 0.009360s
2025-09-30T14:57:37.686021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f04794-6f4738a8-b6882056-2966f52b_0] Write session: Do CDS request
2025-09-30T14:57:37.686044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f04794-6f4738a8-b6882056-2966f52b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:37.696738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|88f04794-6f4738a8-b6882056-2966f52b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:37.696899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:37.696919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2621
2025-09-30T14:57:37.697061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2621 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:37.697096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2621 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:37.697106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2621 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:37.697110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:37.697810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2621 sessionId:  describe result for acl check
2025-09-30T14:57:37.697846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:37.697848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:37.697850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:37.697856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896551508133805:11571] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:37.698404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896551508133805:11571] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:37.701860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896551508133805:11571] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:37.705368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896551508133805:11571] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:37.705386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896551508133805:11571] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:37.705389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896551508133805:11571] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:37.705398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2621 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:37.706996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:37.709709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:37.709934Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:37.709945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:37.709956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:37.710005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:37.710046Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896551418341804:11989]
2025-09-30T14:57:37.710744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:37.711085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:37.711127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:37.711487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:37.711555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.711561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.711563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.711564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.711566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.711568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.711570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.711571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.711572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.711574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.711575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.711577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.711578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.711580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.711581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.711587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.711597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.711601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.711606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.711609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.711614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.711618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.711622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.711627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.711632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.711636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.711641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.711645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.711650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.711654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.711662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.711671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.711678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.711684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.711690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.711696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.711701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.711706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.711712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.711718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.711723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.711736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.711741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.711747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.711752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.711758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.711764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.711770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.711775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.711780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.711785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.711791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.711798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.711804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.711809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.711815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.711820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.711826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.711831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.711837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.711887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:37.719570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2620
2025-09-30T14:57:37.719599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2620
2025-09-30T14:57:37.717972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:37.719137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:37.719145Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:37.719148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:37.719152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:37.719159Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2620 [2:7555896551418341804:11989]
2025-09-30T14:57:37.719176Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:37.719192Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:37.719195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:37.719199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:37.719201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:37.719221Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:37.719228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:37.719235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:37.719329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.719331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.719334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.719337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:37.719339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:37.719412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:37.719415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.719427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.719438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.719453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:37.719471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133770:2454], now have 1 active actors on pipe
2025-09-30T14:57:37.719475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133975:11571], now have 1 active actors on pipe
2025-09-30T14:57:37.719481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896551418341799:11989]
2025-09-30T14:57:37.719483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896551418341799:11989]
2025-09-30T14:57:37.719485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896551418341799:11989]
2025-09-30T14:57:37.719493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:37.719509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:37.719516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:37.719521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:37.719523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:37.719524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:37.719526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:37.719561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896551418341799:11989]
2025-09-30T14:57:37.719570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:37.719596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:37.719694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.719703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.719733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:37.719741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:37.719745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:37.719748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:37.719760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:37.719772Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:37.719786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:37.720064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.720078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.720099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:37.720216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2621 partition: 0 MaxSeqNo: 42 sessionId: src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0
2025-09-30T14:57:37.720607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|88f04794-6f4738a8-b6882056-2966f52b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:37.723554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0] Write session: try to update token
2025-09-30T14:57:37.723576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:37.733803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:37.733823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:37.733825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:37.733828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:37.733838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896551418341799:11989]
2025-09-30T14:57:37.733843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896551418341799:11989]
2025-09-30T14:57:37.733847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896551418341799:11989]
2025-09-30T14:57:37.733890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:37.733898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.733901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:37.733907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:37.733915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:37.733920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:37.734040Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:37.743590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2621 sessionId: src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:37.746229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:37.785551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896551508133991:11465]
2025-09-30T14:57:37.785868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2620, pipe: [1:7555896551508133991:11465]
2025-09-30T14:57:37.858750Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:37.859365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.859378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.859399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133991:11465], now have 1 active actors on pipe
2025-09-30T14:57:37.859629Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:37.859699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:37.859700Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896551508133991:11465]
2025-09-30T14:57:37.859720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:37.859724Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:37.859788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2621 reason: error at write: Disconnected sessionId: src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0
2025-09-30T14:57:37.859996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2621 sessionId: src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0 is DEAD
2025-09-30T14:57:37.860442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:37.860454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0] Write session will restart in 0.005613s
2025-09-30T14:57:37.860478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0] Write session: Do CDS request
2025-09-30T14:57:37.860483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:37.866920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:37.866980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:37.866997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2622
2025-09-30T14:57:37.867178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2622 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:37.867210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2622 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:37.867215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2622 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:37.867219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:37.867628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2622 sessionId:  describe result for acl check
2025-09-30T14:57:37.867657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:37.867659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:37.867661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:37.867666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896551508134009:11576] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:37.868195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896551508134009:11576] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:37.871106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896551508134009:11576] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:37.874508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896551508134009:11576] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:37.874525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896551508134009:11576] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:37.874528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896551508134009:11576] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:37.874536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2622 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:37.876772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:37.879039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:37.879266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:37.879275Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:37.879286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:37.879338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:37.879384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896551418342015:11991]
2025-09-30T14:57:37.880060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:37.880358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:37.880405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:37.880751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:37.880818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.880825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.880826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.880827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.880828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.880830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.880831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.880832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.880833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.880834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.880836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.880837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.880838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.880839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.880840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.880845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.880856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.880860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.880864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.880868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.880873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.880877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.880881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.880885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.880890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.880894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.880898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.880902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.880917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.880922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.880929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.880937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:37.880943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.880949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:37.880953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.880958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:37.880963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.880968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:37.880973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.880978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:37.880983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.880988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:37.880993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.880998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:37.881002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.881007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:37.881012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.881029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:37.881034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.881039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:37.881044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.881050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.881055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.881060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.881065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.881070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.881075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.881080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:37.881084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.881096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:37.881140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:37.886906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:37.888045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:37.888060Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:37.888063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:37.888067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:37.888074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2621 [2:7555896551418342015:11991]
2025-09-30T14:57:37.888090Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:37.888107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:37.888110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:37.888113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:37.888116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:37.888132Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:37.888142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:37.888149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:37.888218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.888226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.888229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.888233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:37.888236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:37.888303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:37.888311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.888323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:37.888334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:37.888349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:37.888369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896551418342010:11991]
2025-09-30T14:57:37.888377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896551418342010:11991]
2025-09-30T14:57:37.888379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896551418342010:11991]
2025-09-30T14:57:37.888393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:37.888408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508134191:11576], now have 1 active actors on pipe
2025-09-30T14:57:37.888409Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:37.888412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508133993:2454], now have 1 active actors on pipe
2025-09-30T14:57:37.888413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:37.888415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:37.888421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:37.888436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:37.888444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:37.888480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896551418342010:11991]
2025-09-30T14:57:37.888494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:37.888533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:37.888726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2621
2025-09-30T14:57:37.888762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2621
2025-09-30T14:57:37.888824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.888838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.888869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:37.888879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:37.888890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:37.888893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:37.888907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:37.888919Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:37.888941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:37.889170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:37.889183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:37.889215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:37.889306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2622 partition: 0 MaxSeqNo: 42 sessionId: src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0
2025-09-30T14:57:37.889658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8caf7076-c06d0d4-c4b4de8f-6d363708_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:37.892355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0] Write session: try to update token
2025-09-30T14:57:37.892378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:37.902307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:37.902325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:37.902328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:37.902330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:37.902343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896551418342010:11991]
2025-09-30T14:57:37.902348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896551418342010:11991]
2025-09-30T14:57:37.902350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896551418342010:11991]
2025-09-30T14:57:37.902389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:37.902395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:37.902398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:37.902423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:37.902446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:37.902460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:37.902536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:37.906320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2622 sessionId: src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:37.909007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:37.959652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896551508134226:11465]
2025-09-30T14:57:37.959920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2621, pipe: [1:7555896551508134226:11465]
2025-09-30T14:57:38.016185Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:38.016638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.016650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.016682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896551508134226:11465], now have 1 active actors on pipe
2025-09-30T14:57:38.016883Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:38.016973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896551508134226:11465]
2025-09-30T14:57:38.016978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:38.016982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:38.017004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:38.017062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2622 reason: error at write: Disconnected sessionId: src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0
2025-09-30T14:57:38.017235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2622 sessionId: src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0 is DEAD
2025-09-30T14:57:38.017399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:38.017409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0] Write session will restart in 0.005522s
2025-09-30T14:57:38.017432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0] Write session: Do CDS request
2025-09-30T14:57:38.017441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:38.023764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:38.023827Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:38.023845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2623
2025-09-30T14:57:38.024000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2623 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:38.024034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2623 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:38.024045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2623 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:38.024049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:38.024495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2623 sessionId:  describe result for acl check
2025-09-30T14:57:38.024542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:38.024549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:38.024551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:38.024558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896555803101548:11587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:38.025117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896555803101548:11587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:38.028059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896555803101548:11587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:38.031499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896555803101548:11587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:38.031517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896555803101548:11587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:38.031522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896555803101548:11587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:38.031530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2623 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:38.033701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:38.036655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:38.036888Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:38.036898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:38.036909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:38.036969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:38.037013Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896555713309561:12006]
2025-09-30T14:57:38.037718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:38.038042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:38.038082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:38.038418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:38.038486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.038492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.038493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.038495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.038496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.038497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.038498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.038499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.038501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.038502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.038503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.038505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.038506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.038507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.038508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.038513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.038524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.038528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.038533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.038537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.038541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.038545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.038549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.038553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.038557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.038561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.038565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.038569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.038573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.038577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.038584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.038592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.038598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.038604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.038609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.038614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.038619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.038625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.038630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.038635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.038640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.038646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.038652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.038657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.038662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.038667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.038672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.038678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.038684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.038691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.038704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.038709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.038714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.038719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.038724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.038730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.038735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.038740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.038745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.038750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.038795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:38.044399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:38.045301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:38.045314Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:38.045317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:38.045321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:38.045329Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2622 [2:7555896555713309561:12006]
2025-09-30T14:57:38.045343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:38.045356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:38.045358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:38.045360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:38.045362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:38.045376Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:38.045382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:38.045391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:38.045452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.045463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.045466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.045470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:38.045472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:38.045542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:38.045545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.045557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.045573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.045596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:38.045620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803101724:11587], now have 1 active actors on pipe
2025-09-30T14:57:38.045628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803101533:2454], now have 1 active actors on pipe
2025-09-30T14:57:38.045635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896555713309556:12006]
2025-09-30T14:57:38.045638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896555713309556:12006]
2025-09-30T14:57:38.045640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896555713309556:12006]
2025-09-30T14:57:38.045653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:38.045668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:38.045668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:38.045671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:38.045673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:38.045687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:38.045690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:38.045723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2622
2025-09-30T14:57:38.046060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896555713309556:12006]
2025-09-30T14:57:38.046079Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:38.046115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:38.046116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.046122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.046156Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:38.046164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:38.046168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:38.046170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:38.046180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:38.046189Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:38.046170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2622
2025-09-30T14:57:38.046218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:38.046383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.046391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.046405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:38.046506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2623 partition: 0 MaxSeqNo: 42 sessionId: src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0
2025-09-30T14:57:38.046882Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9a6c3ce-236b108a-efc6f9f-d94daafc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:38.049679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0] Write session: try to update token
2025-09-30T14:57:38.049698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:38.061817Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:38.061833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:38.061836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:38.061838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:38.061847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896555713309556:12006]
2025-09-30T14:57:38.061852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896555713309556:12006]
2025-09-30T14:57:38.061857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896555713309556:12006]
2025-09-30T14:57:38.061909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:38.061908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:38.061922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.061924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:38.061929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:38.061935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:38.062068Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:38.064478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2623 sessionId: src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:38.067301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:38.117290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896555803101753:11465]
2025-09-30T14:57:38.117663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2622, pipe: [1:7555896555803101753:11465]
2025-09-30T14:57:38.174853Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:38.175397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.175413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.175450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803101753:11465], now have 1 active actors on pipe
2025-09-30T14:57:38.175669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:38.175652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:38.175672Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:38.175673Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:38.175734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896555803101753:11465]
2025-09-30T14:57:38.175734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2623 reason: error at write: Disconnected sessionId: src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0
2025-09-30T14:57:38.175908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2623 sessionId: src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0 is DEAD
2025-09-30T14:57:38.176053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:38.176065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0] Write session will restart in 0.005504s
2025-09-30T14:57:38.176088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0] Write session: Do CDS request
2025-09-30T14:57:38.176107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:38.182770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:38.182995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:38.183018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2624
2025-09-30T14:57:38.183147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2624 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:38.183190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2624 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:38.183199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2624 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:38.183205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:38.183671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2624 sessionId:  describe result for acl check
2025-09-30T14:57:38.183703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:38.183707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:38.183709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:38.183714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896555803101778:11593] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:38.184265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896555803101778:11593] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:38.187022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896555803101778:11593] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:38.190598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896555803101778:11593] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:38.190615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896555803101778:11593] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:38.190618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896555803101778:11593] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:38.190628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2624 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:38.192307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:38.194875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:38.195224Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:38.195233Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:38.195263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:38.195338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:38.195379Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896555713309786:12009]
2025-09-30T14:57:38.196076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:38.196440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:38.196523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:38.196903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:38.196982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.196989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.196990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.196992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.196993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.196995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.196997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.196998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.197000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.197001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.197002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.197004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.197005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.197006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.197008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.197027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.197039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.197044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.197048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.197053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.197058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.197063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.197067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.197072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.197078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.197082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.197087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.197091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.197096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.197100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.197108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.197117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.197124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.197133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.197146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.197168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.197178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.197185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.197199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.197204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.197209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.197215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.197220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.197231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.197236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.197241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.197249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.197255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.197259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.197265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.197271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.197277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.197288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.197293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.197303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.197309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.197319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.197326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.197336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.197343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.197395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:38.202903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:38.204086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:38.204100Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:38.204102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:38.204107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:38.204114Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2623 [2:7555896555713309786:12009]
2025-09-30T14:57:38.204132Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:38.204147Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:38.204156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:38.204160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:38.204162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:38.204178Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:38.204186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:38.204192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:38.204251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.204259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.204264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.204267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:38.204270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:38.204343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:38.204351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.204364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.204383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.204405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:38.204427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896555713309781:12009]
2025-09-30T14:57:38.204435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896555713309781:12009]
2025-09-30T14:57:38.204437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896555713309781:12009]
2025-09-30T14:57:38.204452Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:38.204471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:38.204476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:38.204481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:38.204484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:38.204491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:38.204495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:38.204528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896555713309781:12009]
2025-09-30T14:57:38.204536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:38.204563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:38.204696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803101964:11593], now have 1 active actors on pipe
2025-09-30T14:57:38.204706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803101758:2454], now have 1 active actors on pipe
2025-09-30T14:57:38.205082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2623
2025-09-30T14:57:38.205116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2623
2025-09-30T14:57:38.205183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.205196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.205224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:38.205236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:38.205241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:38.205246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:38.205258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:38.205275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:38.205289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:38.205495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.205504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.205521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:38.205613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2624 partition: 0 MaxSeqNo: 42 sessionId: src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0
2025-09-30T14:57:38.205959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49e58d48-35ceeda4-5f770a69-957b8ee0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:38.208853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0] Write session: try to update token
2025-09-30T14:57:38.208869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:38.217304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:38.217328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:38.217331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:38.217333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:38.217343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896555713309781:12009]
2025-09-30T14:57:38.217348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896555713309781:12009]
2025-09-30T14:57:38.217353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896555713309781:12009]
2025-09-30T14:57:38.217398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:38.217401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:38.217406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.217409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:38.217409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:38.217414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:38.217552Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:38.228804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2624 sessionId: src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:38.231633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:38.276061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896555803101986:11465]
2025-09-30T14:57:38.276290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2623, pipe: [1:7555896555803101986:11465]
2025-09-30T14:57:38.332772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:38.333180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.333207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.333236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803101986:11465], now have 1 active actors on pipe
2025-09-30T14:57:38.333663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:38.333845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896555803101986:11465]
2025-09-30T14:57:38.333879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:38.333946Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2624 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0
2025-09-30T14:57:38.334249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:38.334261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0] Write session will restart in 0.009457s
2025-09-30T14:57:38.334283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0] Write session: Do CDS request
2025-09-30T14:57:38.334289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:38.334107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2624 sessionId: src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0 is DEAD
2025-09-30T14:57:38.334266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:38.344779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:38.344884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:38.344906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2625
2025-09-30T14:57:38.345098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2625 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:38.345143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2625 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:38.345152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2625 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:38.345156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:38.345711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2625 sessionId:  describe result for acl check
2025-09-30T14:57:38.345746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:38.345751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:38.345754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:38.345760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896555803102026:11599] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:38.346314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896555803102026:11599] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:38.349331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896555803102026:11599] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:38.352445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896555803102026:11599] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:38.352462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896555803102026:11599] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:38.352466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896555803102026:11599] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:38.352475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2625 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:38.354528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:38.357050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:38.357284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:38.357310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:38.357322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:38.357382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:38.357427Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896555713310000:12011]
2025-09-30T14:57:38.358043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:38.358374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:38.358432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:38.358793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:38.358860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.358865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.358867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.358868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.358869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.358870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.358872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.358873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.358875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.358876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.358877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.358879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.358880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.358881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.358883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.358889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.358900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.358904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.358908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.358911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.358916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.358920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.358924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.358928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.358933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.358938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.358942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.358960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.358965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.358968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.358976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.358985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.358991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.359002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.359011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.359017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.359026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.359032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.359041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.359048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.359054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.359070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.359080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.359086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.359091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.359097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.359107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.359115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.359123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.359129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.359134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.359143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.359149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.359158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.359169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.359179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.359183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.359192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.359197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.359203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.359267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:38.366205Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2624
2025-09-30T14:57:38.366255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2624
2025-09-30T14:57:38.364786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:38.365825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:38.365830Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:38.365832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:38.365835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:38.365840Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2624 [2:7555896555713310000:12011]
2025-09-30T14:57:38.365853Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:38.365866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:38.365868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:38.365870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:38.365872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:38.365886Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:38.365894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:38.365902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:38.365957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.365959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.365961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.365964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:38.365966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:38.366030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:38.366033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.366045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.366055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.366072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:38.366098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803102211:11599], now have 1 active actors on pipe
2025-09-30T14:57:38.366104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803102002:2454], now have 1 active actors on pipe
2025-09-30T14:57:38.366113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896555713309995:12011]
2025-09-30T14:57:38.366117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896555713309995:12011]
2025-09-30T14:57:38.366119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896555713309995:12011]
2025-09-30T14:57:38.366139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:38.366151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:38.366155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:38.366156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:38.366158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:38.366180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:38.366185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:38.366236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896555713309995:12011]
2025-09-30T14:57:38.366253Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:38.366313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:38.366530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.366540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.366585Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:38.366595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:38.366599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:38.366602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:38.366613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:38.366626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:38.366642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:38.366990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.367004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.367024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:38.367156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2625 partition: 0 MaxSeqNo: 42 sessionId: src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0
2025-09-30T14:57:38.367558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9fc97-b22ff8f4-a6a363da-91e13c5a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:38.370403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0] Write session: try to update token
2025-09-30T14:57:38.370423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:38.379927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:38.379951Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:38.379953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:38.379955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:38.379969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896555713309995:12011]
2025-09-30T14:57:38.379974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896555713309995:12011]
2025-09-30T14:57:38.379978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896555713309995:12011]
2025-09-30T14:57:38.380019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:38.380026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.380030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:38.380037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:38.380037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:38.380041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:38.380196Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:38.385308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2625 sessionId: src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:38.388097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:38.434267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896555803102225:11465]
2025-09-30T14:57:38.434541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2624, pipe: [1:7555896555803102225:11465]
2025-09-30T14:57:38.491514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:38.491839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.491853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.491895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803102225:11465], now have 1 active actors on pipe
2025-09-30T14:57:38.492123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:38.492171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:38.492189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:38.492209Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:38.492245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2625 reason: error at write: Disconnected sessionId: src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0
2025-09-30T14:57:38.492258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896555803102225:11465]
2025-09-30T14:57:38.492415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2625 sessionId: src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0 is DEAD
2025-09-30T14:57:38.492781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:38.492789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0] Write session will restart in 0.006780s
2025-09-30T14:57:38.492806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0] Write session: Do CDS request
2025-09-30T14:57:38.492816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:38.500751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:38.500877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:38.500896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2626
2025-09-30T14:57:38.501007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2626 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:38.501064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2626 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:38.501075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2626 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:38.501081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:38.501586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2626 sessionId:  describe result for acl check
2025-09-30T14:57:38.501624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:38.501626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:38.501628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:38.501634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896555803102272:11603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:38.502172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896555803102272:11603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:38.504772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896555803102272:11603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:38.507649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896555803102272:11603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:38.507665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896555803102272:11603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:38.507669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896555803102272:11603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:38.507677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2626 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:38.511109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:38.511644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:38.511832Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:38.511840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:38.511848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:38.511892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:38.511931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896555713310215:12013]
2025-09-30T14:57:38.512549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:38.512827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:38.512869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:38.513202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:38.513268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.513273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.513275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.513276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.513277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.513279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.513280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.513281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.513282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.513283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.513285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.513286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.513287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.513288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.513289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.513295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.513302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.513305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.513307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.513310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.513312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.513315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.513317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.513319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.513322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.513324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.513327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.513329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.513331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.513334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.513340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.513344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.513348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.513352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.513354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.513357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.513360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.513363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.513365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.513368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.513371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.513374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.513376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.513379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.513381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.513384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.513388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.513391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.513393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.513396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.513399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.513401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.513404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.513406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.513409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.513411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.513414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.513417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.513421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.513424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.513446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:38.518646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:38.519684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:38.519699Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:38.519702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:38.519707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:38.519714Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2625 [2:7555896555713310215:12013]
2025-09-30T14:57:38.519729Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:38.519744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:38.519748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:38.519751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:38.519754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:38.519770Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:38.519782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:38.519788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:38.519851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.519860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.519863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.519866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:38.519869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:38.519933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:38.519941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.519952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.519965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.519988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:38.520011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803102226:2454], now have 1 active actors on pipe
2025-09-30T14:57:38.520020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803102436:11603], now have 1 active actors on pipe
2025-09-30T14:57:38.520026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896555713310210:12013]
2025-09-30T14:57:38.520034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896555713310210:12013]
2025-09-30T14:57:38.520035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896555713310210:12013]
2025-09-30T14:57:38.520048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:38.520066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:38.520068Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:38.520072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:38.520086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:38.520090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:38.520092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:38.520120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896555713310210:12013]
2025-09-30T14:57:38.520128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:38.520134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:38.520096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2625
2025-09-30T14:57:38.520096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2625
2025-09-30T14:57:38.520153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.520163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.520201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:38.520214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:38.520218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:38.520220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:38.520229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:38.520238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:38.520254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:38.520405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.520412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.520424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:38.520501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2626 partition: 0 MaxSeqNo: 42 sessionId: src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0
2025-09-30T14:57:38.520856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53e377dd-b0e4fde2-fdb61ad5-99bb1bed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:38.523482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0] Write session: try to update token
2025-09-30T14:57:38.523500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:38.532019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:38.532037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:38.532039Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:38.532041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:38.532051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896555713310210:12013]
2025-09-30T14:57:38.532056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896555713310210:12013]
2025-09-30T14:57:38.532060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896555713310210:12013]
2025-09-30T14:57:38.532102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:38.532109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.532108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:38.532112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:38.532115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:38.532119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:38.532248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:38.537302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2626 sessionId: src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:38.540301Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:38.592476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896555803102450:11465]
2025-09-30T14:57:38.592776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2625, pipe: [1:7555896555803102450:11465]
2025-09-30T14:57:38.647412Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:38.647840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.647855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.647894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803102450:11465], now have 1 active actors on pipe
2025-09-30T14:57:38.648116Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:38.648145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:38.648211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896555803102450:11465]
2025-09-30T14:57:38.648230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:38.648325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2626 reason: status is not ok: tablet will be restarted right now sessionId: src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0
2025-09-30T14:57:38.648495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2626 sessionId: src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0 is DEAD
2025-09-30T14:57:38.648678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:38.648688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0] Write session will restart in 0.006215s
2025-09-30T14:57:38.648712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0] Write session: Do CDS request
2025-09-30T14:57:38.648718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:38.655784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:38.655883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:38.655901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2627
2025-09-30T14:57:38.656052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2627 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:38.656100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2627 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:38.656111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2627 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:38.656115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:38.656643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2627 sessionId:  describe result for acl check
2025-09-30T14:57:38.656679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:38.656682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:38.656683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:38.656690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896555803102488:11607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:38.657247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896555803102488:11607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:38.660638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896555803102488:11607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:38.663679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896555803102488:11607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:38.663695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896555803102488:11607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:38.663698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896555803102488:11607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:38.663707Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2627 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:38.667613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:38.670270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:38.670617Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:38.670629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:38.670641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:38.670704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:38.670749Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896555713310432:12016]
2025-09-30T14:57:38.671457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:38.671759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:38.671803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:38.672128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:38.672192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.672199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.672200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.672202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.672203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.672204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.672206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.672207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.672208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.672210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.672211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.672213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.672214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.672215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.672216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.672222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.672233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.672238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.672243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.672247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.672251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.672256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.672260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.672265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.672269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.672274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.672279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.672282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.672287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.672291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.672299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.672308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.672315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.672321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.672326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.672332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.672338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.672344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.672352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.672359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.672367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.672373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.672383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.672389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.672399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.672405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.672416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.672426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.672436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.672442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.672447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.672453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.672458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.672463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.672472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.672478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.672487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.672493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.672502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.672508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.672560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:38.677917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:38.678929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:38.678943Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:38.678946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:38.678951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:38.678958Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2626 [2:7555896555713310432:12016]
2025-09-30T14:57:38.678975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:38.678995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:38.678998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:38.679001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:38.679004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:38.679018Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:38.679025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:38.679038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:38.679099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.679107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.679109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.679112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:38.679115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:38.679178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:38.679186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.679198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.679217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.679239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:38.679283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803102628:11607], now have 1 active actors on pipe
2025-09-30T14:57:38.679287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803102451:2454], now have 1 active actors on pipe
2025-09-30T14:57:38.679293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896555713310427:12016]
2025-09-30T14:57:38.679296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896555713310427:12016]
2025-09-30T14:57:38.679298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896555713310427:12016]
2025-09-30T14:57:38.679316Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:38.679334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:38.679351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:38.679356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:38.679360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:38.679363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:38.679366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:38.679391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896555713310427:12016]
2025-09-30T14:57:38.679395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2626
2025-09-30T14:57:38.679447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2626
2025-09-30T14:57:38.679404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:38.679437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:38.679500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.679505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.679532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f94367c-5a9def96-dde3bad-a604bfa0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:38.679543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:38.679548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:38.679552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:38.679561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:38.679574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:38.679593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:38.679747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.679755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.679768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:38.679844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2627 partition: 0 MaxSeqNo: 42 sessionId: src_id|f94367c-5a9def96-dde3bad-a604bfa0_0
2025-09-30T14:57:38.680219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95335bc9-fb0873a5-ceaf6005-938f78a1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f94367c-5a9def96-dde3bad-a604bfa0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:38.683164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94367c-5a9def96-dde3bad-a604bfa0_0] Write session: try to update token
2025-09-30T14:57:38.683186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94367c-5a9def96-dde3bad-a604bfa0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:38.693108Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:38.693128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:38.693131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:38.693134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:38.693145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896555713310427:12016]
2025-09-30T14:57:38.693150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896555713310427:12016]
2025-09-30T14:57:38.693156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896555713310427:12016]
2025-09-30T14:57:38.693201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:38.693210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.693212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:38.693234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:38.693243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:38.693250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:38.693376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:38.698506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2627 sessionId: src_id|f94367c-5a9def96-dde3bad-a604bfa0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:38.701528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:38.748099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896555803102678:11465]
2025-09-30T14:57:38.749673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2626, pipe: [1:7555896555803102678:11465]
2025-09-30T14:57:38.808278Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:38.808648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.808664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.808707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803102678:11465], now have 1 active actors on pipe
2025-09-30T14:57:38.808982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896555803102678:11465]
2025-09-30T14:57:38.809008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:38.809041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:38.809045Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:38.809189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2627 reason: error at write: Disconnected sessionId: src_id|f94367c-5a9def96-dde3bad-a604bfa0_0
2025-09-30T14:57:38.809003Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:38.809384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2627 sessionId: src_id|f94367c-5a9def96-dde3bad-a604bfa0_0 is DEAD
2025-09-30T14:57:38.811478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94367c-5a9def96-dde3bad-a604bfa0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:38.811492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94367c-5a9def96-dde3bad-a604bfa0_0] Write session will restart in 0.008323s
2025-09-30T14:57:38.811515Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94367c-5a9def96-dde3bad-a604bfa0_0] Write session: Do CDS request
2025-09-30T14:57:38.811524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94367c-5a9def96-dde3bad-a604bfa0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:38.820801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94367c-5a9def96-dde3bad-a604bfa0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:38.820874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:38.820903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2628
2025-09-30T14:57:38.821007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2628 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:38.821044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2628 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:38.821049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2628 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:38.821054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:38.821544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2628 sessionId:  describe result for acl check
2025-09-30T14:57:38.821578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:38.821585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:38.821587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:38.821594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896555803102777:11612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:38.822131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896555803102777:11612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:38.826412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896555803102777:11612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:38.829443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:38.829547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896555803102777:11612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:38.829564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896555803102777:11612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:38.829568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896555803102777:11612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:38.829576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2628 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:38.831537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:38.831855Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:38.831873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:38.831888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:38.831958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:38.832004Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896555713310649:12018]
2025-09-30T14:57:38.832617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:38.832993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:38.833060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:38.833400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:38.833484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.833490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.833491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.833492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.833494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.833495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.833496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.833497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.833498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.833499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.833500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.833502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.833503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.833504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.833505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.833512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.833522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.833525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.833529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.833533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.833537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.833540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.833544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.833547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.833551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.833555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.833559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.833562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.833566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.833570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.833579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.833587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:38.833594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.833599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:38.833604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.833609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:38.833614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.833618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:38.833623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.833628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:38.833632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.833638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:38.833643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.833648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:38.833652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.833657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:38.833664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.833670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:38.833674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.833679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:38.833683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.833688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.833695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.833701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.833705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.833710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.833715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.833719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:38.833724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.833729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:38.833770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:38.839423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:38.840332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:38.840350Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:38.840352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:38.840356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:38.840363Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2627 [2:7555896555713310649:12018]
2025-09-30T14:57:38.840381Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:38.840396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:38.840399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:38.840402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:38.840405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:38.840420Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:38.840427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:38.840441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:38.840507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.840516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.840518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.840521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:38.840524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:38.840737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2627
2025-09-30T14:57:38.840753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2627
2025-09-30T14:57:38.840789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:38.840804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.840817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:38.840831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:38.840854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:38.840882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803102679:2454], now have 1 active actors on pipe
2025-09-30T14:57:38.840890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803102891:11612], now have 1 active actors on pipe
2025-09-30T14:57:38.840911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.840920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.840937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896555713310643:12018]
2025-09-30T14:57:38.840944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896555713310643:12018]
2025-09-30T14:57:38.840946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896555713310643:12018]
2025-09-30T14:57:38.840961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:38.840979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:38.840983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:38.840987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:38.840989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:38.840997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:38.841000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:38.841035Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:38.841047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:38.841051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:38.841053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:38.841063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:38.841078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:38.841124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896555713310643:12018]
2025-09-30T14:57:38.841143Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:38.841160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:38.841165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:38.841510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:38.841522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:38.841540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:38.841643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2628 partition: 0 MaxSeqNo: 42 sessionId: src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0
2025-09-30T14:57:38.843388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94367c-5a9def96-dde3bad-a604bfa0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:38.857135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0] Write session: try to update token
2025-09-30T14:57:38.857166Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:38.863513Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:38.863535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:38.863547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896555713310643:12018]
2025-09-30T14:57:38.863601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:38.863607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:38.863775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:38.863928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:38.864070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:38.864219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:38.864789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:38.864842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:38.868349Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:38.868369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:38.868372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:38.868373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:38.868386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896555713310643:12018]
2025-09-30T14:57:38.868391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896555713310643:12018]
2025-09-30T14:57:38.868395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896555713310643:12018]
2025-09-30T14:57:38.868431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:38.868437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:38.868440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:38.868443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:38.868453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:38.868464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:38.868582Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:38.887961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2628 sessionId: src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:38.890996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:38.908899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896555803102905:11465]
2025-09-30T14:57:38.909278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2627, pipe: [1:7555896555803102905:11465]
2025-09-30T14:57:39.011709Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:39.012167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.012185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.012204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896555803102905:11465], now have 1 active actors on pipe
2025-09-30T14:57:39.012413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:39.013122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:39.013209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2628 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0
2025-09-30T14:57:39.013387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2628 sessionId: src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0 is DEAD
2025-09-30T14:57:39.013610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896555803102905:11465]
2025-09-30T14:57:39.013631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:39.015536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:39.015548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0] Write session will restart in 0.005399s
2025-09-30T14:57:39.015583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0] Write session: Do CDS request
2025-09-30T14:57:39.015590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:39.022846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:39.022945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:39.022961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2629
2025-09-30T14:57:39.023149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2629 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:39.023181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2629 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:39.023185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2629 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:39.023189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:39.024053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2629 sessionId:  describe result for acl check
2025-09-30T14:57:39.024095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:39.024101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:39.024103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:39.024109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896560098070283:11623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:39.024593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896560098070283:11623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:39.027951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896560098070283:11623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:39.031358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896560098070283:11623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:39.031375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896560098070283:11623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:39.031378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896560098070283:11623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:39.031387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2629 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:39.032265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:39.034554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:39.034910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:39.034924Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:39.034938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:39.035010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:39.035052Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896560008278202:12027]
2025-09-30T14:57:39.035790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:39.036100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:39.036157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:39.036541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:39.036621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.036627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.036629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.036630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.036631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.036632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.036634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.036635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.036636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.036638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.036639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.036641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.036642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.036643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.036644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.036650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.036661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.036665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.036670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.036674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.036678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.036682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.036686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.036690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.036696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.036700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.036705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.036709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.036713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.036717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.036726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.036734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.036740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.036747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.036754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.036759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.036764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.036769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.036774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.036779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.036784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.036789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.036794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.036799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.036803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.036809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.036813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.036819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.036825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.036830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.036834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.036839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.036844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.036849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.036854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.036859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.036863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.036869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.036874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.036879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.036923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:39.042979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:39.044037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:39.044054Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:39.044057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:39.044061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:39.044068Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2628 [2:7555896560008278202:12027]
2025-09-30T14:57:39.044085Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:39.044099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:39.044102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:39.044106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:39.044108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:39.044125Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:39.044137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:39.044144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:39.044207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.044215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.044218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.044222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:39.044225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:39.044291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:39.044300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.044313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.044331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.044354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:39.044378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098070221:2454], now have 1 active actors on pipe
2025-09-30T14:57:39.044389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896560008278197:12027]
2025-09-30T14:57:39.044392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896560008278197:12027]
2025-09-30T14:57:39.044394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896560008278197:12027]
2025-09-30T14:57:39.044410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:39.044421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:39.044425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:39.044425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098070437:11623], now have 1 active actors on pipe
2025-09-30T14:57:39.044427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:39.044434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:39.044451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:39.044459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:39.044488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896560008278197:12027]
2025-09-30T14:57:39.044500Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:39.044463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2628
2025-09-30T14:57:39.044505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:39.044472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2628
2025-09-30T14:57:39.044794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.044807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.044831Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:39.044842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:39.044846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:39.044849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:39.044858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:39.044867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:39.044886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:39.045248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.045256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.045271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:39.045394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2629 partition: 0 MaxSeqNo: 42 sessionId: src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0
2025-09-30T14:57:39.045780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b6fb7c1-66a78508-6a2f394a-89c4d890_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:39.048527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0] Write session: try to update token
2025-09-30T14:57:39.048545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:39.057730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:39.057754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:39.057757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:39.057759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:39.057768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896560008278197:12027]
2025-09-30T14:57:39.057773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896560008278197:12027]
2025-09-30T14:57:39.057777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896560008278197:12027]
2025-09-30T14:57:39.057823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:39.057831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.057836Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:39.057837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:39.057842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:39.057847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:39.058008Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:39.069320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2629 sessionId: src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:39.071924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:39.113665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896560098070450:11465]
2025-09-30T14:57:39.114013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2628, pipe: [1:7555896560098070450:11465]
2025-09-30T14:57:39.174354Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:39.174875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.174893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.174914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098070450:11465], now have 1 active actors on pipe
2025-09-30T14:57:39.175172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896560098070450:11465]
2025-09-30T14:57:39.175183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:39.175219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:39.175306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2629 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0
2025-09-30T14:57:39.175522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2629 sessionId: src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0 is DEAD
2025-09-30T14:57:39.175147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:39.175712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:39.175724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0] Write session will restart in 0.009770s
2025-09-30T14:57:39.175747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0] Write session: Do CDS request
2025-09-30T14:57:39.175753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:39.186867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:39.191442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:39.191461Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2630
2025-09-30T14:57:39.191675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2630 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:39.191709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2630 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:39.191714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2630 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:39.191718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:39.192452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2630 sessionId:  describe result for acl check
2025-09-30T14:57:39.192500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:39.192507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:39.192511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:39.192518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896560098070478:11627] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:39.193060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896560098070478:11627] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:39.196130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896560098070478:11627] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:39.202168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896560098070478:11627] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:39.202185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896560098070478:11627] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:39.202191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896560098070478:11627] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:39.202201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2630 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:39.208127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:39.211661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:39.211933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:39.211945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:39.211956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:39.212025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:39.212067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896560008278433:12036]
2025-09-30T14:57:39.212734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:39.213097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:39.213161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:39.213517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:39.213586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.213594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.213596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.213597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.213599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.213600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.213601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.213603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.213604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.213606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.213607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.213609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.213610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.213611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.213612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.213619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.213630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.213634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.213639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.213643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.213648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.213651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.213656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.213661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.213665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.213669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.213673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.213677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.213682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.213686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.213695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.213704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.213709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.213715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.213720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.213726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.213731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.213736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.213741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.213747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.213752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.213757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.213762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.213768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.213773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.213779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.213786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.213791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.213803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.213809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.213815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.213826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.213830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.213835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.213840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.213846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.213850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.213859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.213864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.213869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.213914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:39.220383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:39.221695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:39.221712Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:39.221714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:39.221718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:39.221727Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2629 [2:7555896560008278433:12036]
2025-09-30T14:57:39.221744Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:39.221762Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:39.221765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:39.221768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:39.221770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:39.221787Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:39.221801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:39.221809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:39.221878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.221887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.221889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.221892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:39.221894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:39.221964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:39.221972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.221987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.222000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.222022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:39.222043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896560008278428:12036]
2025-09-30T14:57:39.222046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896560008278428:12036]
2025-09-30T14:57:39.222048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896560008278428:12036]
2025-09-30T14:57:39.222064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:39.222081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:39.222096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:39.222099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:39.222140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896560008278428:12036]
2025-09-30T14:57:39.222141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:39.222142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:39.222143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:39.222146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:39.222152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098070453:2454], now have 1 active actors on pipe
2025-09-30T14:57:39.222152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:39.222259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2629
2025-09-30T14:57:39.222407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098070643:11627], now have 1 active actors on pipe
2025-09-30T14:57:39.222567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2629
2025-09-30T14:57:39.222695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.222707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.222731Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:39.222739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:39.222743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:39.222746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:39.222758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:39.222770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:39.222795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:39.223110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.223126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.223149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:39.223301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2630 partition: 0 MaxSeqNo: 42 sessionId: src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0
2025-09-30T14:57:39.223712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1184442-94326f6a-6cd4d6c5-8c7a124b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:39.226576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0] Write session: try to update token
2025-09-30T14:57:39.226597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:39.237629Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:39.237655Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:39.237658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:39.237660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:39.237670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896560008278428:12036]
2025-09-30T14:57:39.237675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896560008278428:12036]
2025-09-30T14:57:39.237679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896560008278428:12036]
2025-09-30T14:57:39.237721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:39.237728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.237731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:39.237882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:39.243321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:39.243344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:39.243350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:39.246479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2630 sessionId: src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:39.249201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:39.275580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896560098070687:11465]
2025-09-30T14:57:39.275842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2629, pipe: [1:7555896560098070687:11465]
2025-09-30T14:57:39.351175Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:39.351511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.351526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.351566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098070687:11465], now have 1 active actors on pipe
2025-09-30T14:57:39.351798Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:39.351827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:39.351847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:39.351913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2630 reason: error at write: Disconnected sessionId: src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0
2025-09-30T14:57:39.352118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2630 sessionId: src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0 is DEAD
2025-09-30T14:57:39.352310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:39.352360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896560098070687:11465]
2025-09-30T14:57:39.352427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:39.352438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0] Write session will restart in 0.008950s
2025-09-30T14:57:39.352462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0] Write session: Do CDS request
2025-09-30T14:57:39.352471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:39.362787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:39.362888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:39.362908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2631
2025-09-30T14:57:39.363056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2631 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:39.363087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2631 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:39.363098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2631 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:39.363102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:39.363550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2631 sessionId:  describe result for acl check
2025-09-30T14:57:39.363597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:39.363606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:39.363608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:39.363616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896560098070734:11633] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:39.364179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896560098070734:11633] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:39.368237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896560098070734:11633] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:39.371297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896560098070734:11633] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:39.371318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896560098070734:11633] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:39.371322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896560098070734:11633] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:39.371331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2631 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:39.377213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:39.379399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:39.379651Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:39.379656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:39.379668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:39.379730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:39.379771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896560008278653:12038]
2025-09-30T14:57:39.380418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:39.380758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:39.380812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:39.381166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:39.381238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.381244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.381245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.381247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.381248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.381249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.381250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.381251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.381253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.381254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.381255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.381256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.381257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.381258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.381260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.381266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.381276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.381280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.381284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.381288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.381292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.381296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.381299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.381303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.381308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.381312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.381315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.381320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.381323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.381327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.381335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.381343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.381348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.381354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.381358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.381363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.381370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.381375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.381381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.381387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.381391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.381396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.381401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.381406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.381410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.381415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.381420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.381425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.381430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.381436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.381447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.381452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.381457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.381462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.381468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.381473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.381478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.381483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.381488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.381500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.381545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:39.386945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:39.387859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:39.387876Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:39.387879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:39.387883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:39.387891Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2630 [2:7555896560008278653:12038]
2025-09-30T14:57:39.387908Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:39.387924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:39.387938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:39.387941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:39.387944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:39.387961Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:39.387968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:39.387974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:39.388038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.388047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.388049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.388052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:39.388055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:39.388234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:39.388246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.388258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.388270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.388287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:39.388311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098070896:11633], now have 1 active actors on pipe
2025-09-30T14:57:39.388320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098070704:2454], now have 1 active actors on pipe
2025-09-30T14:57:39.388326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896560008278648:12038]
2025-09-30T14:57:39.388294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2630
2025-09-30T14:57:39.388328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896560008278648:12038]
2025-09-30T14:57:39.388295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2630
2025-09-30T14:57:39.388331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896560008278648:12038]
2025-09-30T14:57:39.388339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:39.388353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:39.388357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:39.388360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:39.388363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:39.388367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:39.388370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:39.388415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.388429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.388442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896560008278648:12038]
2025-09-30T14:57:39.388451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:39.388465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:39.388482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b5847edf-623b97c4-451e3297-558d3ebf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:39.388495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:39.388498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:39.388500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:39.388509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:39.388526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:39.388563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:39.388696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.388708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.388730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:39.388843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2631 partition: 0 MaxSeqNo: 42 sessionId: src_id|b5847edf-623b97c4-451e3297-558d3ebf_0
2025-09-30T14:57:39.389202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7bc04ea9-4dc7933e-4e403b39-25c06559_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b5847edf-623b97c4-451e3297-558d3ebf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:39.391929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5847edf-623b97c4-451e3297-558d3ebf_0] Write session: try to update token
2025-09-30T14:57:39.391947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5847edf-623b97c4-451e3297-558d3ebf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:39.401911Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:39.401933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:39.401935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:39.401938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:39.401947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896560008278648:12038]
2025-09-30T14:57:39.401952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896560008278648:12038]
2025-09-30T14:57:39.401957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896560008278648:12038]
2025-09-30T14:57:39.402002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:39.402010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.402015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:39.402015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:39.402019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:39.402023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:39.402163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:39.407335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2631 sessionId: src_id|b5847edf-623b97c4-451e3297-558d3ebf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:39.410086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:39.452637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896560098070933:11465]
2025-09-30T14:57:39.453003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2630, pipe: [1:7555896560098070933:11465]
2025-09-30T14:57:39.516230Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:39.516551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.516569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.516608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098070933:11465], now have 1 active actors on pipe
2025-09-30T14:57:39.516869Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896560098070933:11465]
2025-09-30T14:57:39.516884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:39.516888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:39.516905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:39.516943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2631 reason: error at write: Disconnected sessionId: src_id|b5847edf-623b97c4-451e3297-558d3ebf_0
2025-09-30T14:57:39.516909Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:39.517137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2631 sessionId: src_id|b5847edf-623b97c4-451e3297-558d3ebf_0 is DEAD
2025-09-30T14:57:39.517287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5847edf-623b97c4-451e3297-558d3ebf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:39.517300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5847edf-623b97c4-451e3297-558d3ebf_0] Write session will restart in 0.009821s
2025-09-30T14:57:39.517323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5847edf-623b97c4-451e3297-558d3ebf_0] Write session: Do CDS request
2025-09-30T14:57:39.517329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5847edf-623b97c4-451e3297-558d3ebf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:39.531082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b5847edf-623b97c4-451e3297-558d3ebf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:39.531183Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:39.531202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2632
2025-09-30T14:57:39.531375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2632 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:39.531410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2632 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:39.531415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2632 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:39.531421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:39.532011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2632 sessionId:  describe result for acl check
2025-09-30T14:57:39.532054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:39.532056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:39.532058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:39.532076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896560098071046:11637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:39.532635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896560098071046:11637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:39.535716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896560098071046:11637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:39.537590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:39.540164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:39.540372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:39.540382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:39.540393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:39.540452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:39.540493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896560008278873:12040]
2025-09-30T14:57:39.540726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896560098071046:11637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:39.540745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896560098071046:11637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:39.540748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896560098071046:11637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:39.540758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2632 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:39.541178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:39.541473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:39.541519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:39.541848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:39.541913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.541919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.541920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.541921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.541922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.541924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.541925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.541926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.541927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.541928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.541929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.541930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.541931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.541932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.541933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.541939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.541949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.541954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.541958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.541962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.541966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.541971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.541975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.541978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.541982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.541986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.541990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.541994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.541999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.542003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.542010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.542018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.542024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.542030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.542036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.542041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.542047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.542052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.542061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.542066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.542071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.542076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.542081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.542086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.542092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.542097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.542102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.542108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.542112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.542118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.542123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.542128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.542133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.542138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.542143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.542148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.542153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.542158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.542163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.542168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.542214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:39.547905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:39.549237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:39.549253Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:39.549255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:39.549259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:39.549266Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2631 [2:7555896560008278873:12040]
2025-09-30T14:57:39.549285Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:39.549303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:39.549306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:39.549309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:39.549312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:39.549328Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:39.549335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:39.549342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:39.549409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.549417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.549420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.549423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:39.549426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:39.549492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:39.549500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.549514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.549532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.549554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:39.549573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098071154:11637], now have 1 active actors on pipe
2025-09-30T14:57:39.549584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896560008278868:12040]
2025-09-30T14:57:39.549587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896560008278868:12040]
2025-09-30T14:57:39.549589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896560008278868:12040]
2025-09-30T14:57:39.549603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:39.549613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098070935:2454], now have 1 active actors on pipe
2025-09-30T14:57:39.549620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:39.549623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:39.549627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:39.549630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:39.549640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:39.549643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:39.549677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896560008278868:12040]
2025-09-30T14:57:39.549689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:39.549701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:39.549733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2631
2025-09-30T14:57:39.549755Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2631
2025-09-30T14:57:39.549909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.549922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.549961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:39.549970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:39.549973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:39.549975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:39.549990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:39.550000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:39.550017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:39.550151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.550160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.550178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:39.550630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b5847edf-623b97c4-451e3297-558d3ebf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:39.550277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2632 partition: 0 MaxSeqNo: 42 sessionId: src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0
2025-09-30T14:57:39.553594Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0] Write session: try to update token
2025-09-30T14:57:39.553616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:39.564617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:39.564643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:39.564646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:39.564648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:39.564659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896560008278868:12040]
2025-09-30T14:57:39.564666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896560008278868:12040]
2025-09-30T14:57:39.564673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896560008278868:12040]
2025-09-30T14:57:39.564719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:39.564726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:39.564735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.564737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:39.564742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:39.564747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:39.564923Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:39.571303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2632 sessionId: src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:39.574080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:39.616996Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896560098071165:11465]
2025-09-30T14:57:39.617355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2631, pipe: [1:7555896560098071165:11465]
2025-09-30T14:57:39.682742Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:39.683073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.683084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.683122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098071165:11465], now have 1 active actors on pipe
2025-09-30T14:57:39.683611Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:39.683654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:39.683671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:39.683698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:39.683734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2632 reason: error at write: Disconnected sessionId: src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0
2025-09-30T14:57:39.683741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896560098071165:11465]
2025-09-30T14:57:39.683903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2632 sessionId: src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0 is DEAD
2025-09-30T14:57:39.684069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:39.684080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0] Write session will restart in 0.006615s
2025-09-30T14:57:39.684109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0] Write session: Do CDS request
2025-09-30T14:57:39.684118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:39.691810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:39.691922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:39.691942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2633
2025-09-30T14:57:39.692072Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2633 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:39.692100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2633 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:39.692106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2633 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:39.692112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:39.692532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2633 sessionId:  describe result for acl check
2025-09-30T14:57:39.692567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:39.692573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:39.692575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:39.692581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896560098071192:11641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:39.693141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896560098071192:11641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:39.695650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896560098071192:11641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:39.701600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896560098071192:11641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:39.701623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896560098071192:11641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:39.701627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896560098071192:11641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:39.701637Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2633 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:39.702752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:39.705151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:39.705375Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:39.705386Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:39.705396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:39.705456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:39.705497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896560008279098:12043]
2025-09-30T14:57:39.706175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:39.706505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:39.706551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:39.706882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:39.706940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.706941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.706943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.706944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.706946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.706947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.706949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.706950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.706951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.706952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.706954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.706955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.706956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.706957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.706958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.706964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.706974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.706979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.706984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.706987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.706991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.706997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.707000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.707004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.707011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.707014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.707018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.707022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.707026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.707031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.707038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.707047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.707053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.707059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.707063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.707068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.707072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.707078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.707083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.707087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.707091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.707096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.707100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.707105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.707112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.707117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.707121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.707126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.707131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.707136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.707143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.707148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.707152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.707156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.707161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.707166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.707170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.707175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.707180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.707184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.707230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:39.713312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:39.714596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:39.714613Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:39.714615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:39.714618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:39.714623Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2632 [2:7555896560008279098:12043]
2025-09-30T14:57:39.714637Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:39.714651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:39.714653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:39.714655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:39.714657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:39.714668Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:39.714674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:39.714683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:39.714731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.714738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.714739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.714742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:39.714744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:39.714803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:39.714808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.714819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.714825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.714839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:39.714855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896560008279093:12043]
2025-09-30T14:57:39.714863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896560008279093:12043]
2025-09-30T14:57:39.714865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896560008279093:12043]
2025-09-30T14:57:39.714873Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:39.714883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:39.714886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:39.714894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:39.714896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:39.714899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:39.714902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:39.714912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098071384:11641], now have 1 active actors on pipe
2025-09-30T14:57:39.714915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098071167:2454], now have 1 active actors on pipe
2025-09-30T14:57:39.714949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896560008279093:12043]
2025-09-30T14:57:39.714966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:39.714973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:39.714989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2632
2025-09-30T14:57:39.714995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2632
2025-09-30T14:57:39.715142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.715154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.715180Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:39.715196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:39.715199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:39.715202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:39.715212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:39.715221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:39.715239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:39.715584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.715599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.715621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:39.715733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2633 partition: 0 MaxSeqNo: 42 sessionId: src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0
2025-09-30T14:57:39.716129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3a341f9-e64aa0e5-a368367e-a2f3bf1f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:39.718964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0] Write session: try to update token
2025-09-30T14:57:39.718985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:39.727514Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:39.727536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:39.727539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:39.727540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:39.727550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896560008279093:12043]
2025-09-30T14:57:39.727555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896560008279093:12043]
2025-09-30T14:57:39.727559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896560008279093:12043]
2025-09-30T14:57:39.727600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:39.727609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.727608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:39.727611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:39.727615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:39.727620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:39.727761Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:39.733608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2633 sessionId: src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:39.736639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:39.783988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896560098071399:11465]
2025-09-30T14:57:39.784302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2632, pipe: [1:7555896560098071399:11465]
2025-09-30T14:57:39.842993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:39.843008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0] Write session will restart in 0.009346s
2025-09-30T14:57:39.843038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0] Write session: Do CDS request
2025-09-30T14:57:39.843044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:39.841756Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:39.842082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.842093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.842134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098071399:11465], now have 1 active actors on pipe
2025-09-30T14:57:39.842406Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:39.842411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:39.842418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:39.842429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:39.842462Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896560098071399:11465]
2025-09-30T14:57:39.842500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2633 reason: error at write: Disconnected sessionId: src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0
2025-09-30T14:57:39.842664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2633 sessionId: src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0 is DEAD
2025-09-30T14:57:39.853825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:39.853892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:39.853911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2634
2025-09-30T14:57:39.854037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2634 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:39.854070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2634 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:39.854080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2634 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:39.854084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:39.854482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2634 sessionId:  describe result for acl check
2025-09-30T14:57:39.854517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:39.854523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:39.854526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:39.854532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896560098071448:11646] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:39.855058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896560098071448:11646] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:39.856705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896560098071448:11646] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:39.861026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896560098071448:11646] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:39.861055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896560098071448:11646] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:39.861059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896560098071448:11646] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:39.861068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2634 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:39.867414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:39.869969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:39.870184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:39.870194Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:39.870206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:39.870267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:39.870312Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896560008279321:12045]
2025-09-30T14:57:39.870954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:39.871277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:39.871333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:39.871831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:39.871920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.871931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.871932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.871934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.871935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.871936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.871937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.871938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.871939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.871940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.871941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.871942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.871943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.871944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.871946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.871951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.871961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.871965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.871968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.871972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.871976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.871979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.871983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.871987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.871991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.871994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.871997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.872001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.872005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.872008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.872016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.872024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:39.872030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.872035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:39.872040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.872045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:39.872048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.872053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:39.872057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.872063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:39.872067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.872072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:39.872079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.872084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:39.872088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.872094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:39.872098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.872105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:39.872109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.872113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:39.872119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.872123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.872127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.872131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.872135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.872140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.872145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.872150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:39.872155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.872160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:39.872200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:39.878067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:39.879239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:39.879278Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:39.879281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:39.879285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:39.879291Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2633 [2:7555896560008279321:12045]
2025-09-30T14:57:39.879307Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:39.879322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:39.879326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:39.879329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:39.879332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:39.879348Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:39.879355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:39.879363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:39.879426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.879428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.879430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.879434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:39.879436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:39.879508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:39.879518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.879529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:39.879539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:39.879556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:39.879575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098071401:2454], now have 1 active actors on pipe
2025-09-30T14:57:39.879582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896560008279316:12045]
2025-09-30T14:57:39.879585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896560008279316:12045]
2025-09-30T14:57:39.879587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896560008279316:12045]
2025-09-30T14:57:39.879703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2633
2025-09-30T14:57:39.879721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2633
2025-09-30T14:57:39.879599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:39.879609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098071510:11646], now have 1 active actors on pipe
2025-09-30T14:57:39.879617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:39.879632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:39.879635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:39.879666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896560008279316:12045]
2025-09-30T14:57:39.879668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:39.879711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:39.879715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:39.879718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:39.879724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:39.879834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.879849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.879877Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:39.879890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:39.879894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:39.879896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:39.879908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:39.879921Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:39.879936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:39.880102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:39.880112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:39.880134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:39.880254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2634 partition: 0 MaxSeqNo: 42 sessionId: src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0
2025-09-30T14:57:39.880654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2c93921-7334bed0-3acd407e-e43f6e56_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:39.883376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0] Write session: try to update token
2025-09-30T14:57:39.883397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:39.897494Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:39.897515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:39.897517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:39.897519Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:39.897528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896560008279316:12045]
2025-09-30T14:57:39.897533Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896560008279316:12045]
2025-09-30T14:57:39.897536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896560008279316:12045]
2025-09-30T14:57:39.897578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:39.897587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:39.897590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:39.897604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:39.897612Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:39.897617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:39.897742Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:39.898246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2634 sessionId: src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:39.901271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:39.942615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896560098071632:11465]
2025-09-30T14:57:39.942897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2633, pipe: [1:7555896560098071632:11465]
2025-09-30T14:57:40.013889Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:40.014181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.014200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.014243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896560098071632:11465], now have 1 active actors on pipe
2025-09-30T14:57:40.014520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:40.014605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:40.014623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:40.014685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2634 reason: error at write: Disconnected sessionId: src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0
2025-09-30T14:57:40.015020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:40.015029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0] Write session will restart in 0.009100s
2025-09-30T14:57:40.015051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0] Write session: Do CDS request
2025-09-30T14:57:40.015059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:40.014863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2634 sessionId: src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0 is DEAD
2025-09-30T14:57:40.015044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:40.015077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896560098071632:11465]
2025-09-30T14:57:40.025758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:40.026696Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:40.026715Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2635
2025-09-30T14:57:40.026874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2635 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:40.026905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2635 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:40.026910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2635 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:40.026913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:40.027358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2635 sessionId:  describe result for acl check
2025-09-30T14:57:40.027408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:40.027410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:40.027412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:40.027420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896564393038969:11652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:40.027889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896564393038969:11652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:40.033580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896564393038969:11652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:40.036338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896564393038969:11652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:40.036358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896564393038969:11652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:40.036360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896564393038969:11652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:40.036374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2635 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:40.036840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:40.039553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:40.039793Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:40.039806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:40.039817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:40.039872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:40.039917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896564303246856:12048]
2025-09-30T14:57:40.040618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:40.041035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:40.041096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:40.041462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:40.041529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.041536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.041537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.041539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.041540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.041541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.041542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.041543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.041544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.041545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.041546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.041547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.041548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.041549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.041550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.041557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.041566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.041570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.041574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.041577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.041581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.041585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.041588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.041591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.041596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.041599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.041603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.041606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.041610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.041614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.041624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.041632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.041638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.041643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.041648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.041654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.041658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.041663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.041668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.041673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.041677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.041681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.041686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.041690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.041695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.041700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.041704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.041708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.041712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.041718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.041722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.041727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.041730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.041735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.041740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.041745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.041749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.041754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.041760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.041764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.041804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:40.047412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:40.048464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:40.048481Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:40.048484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:40.048488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:40.048494Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2634 [2:7555896564303246856:12048]
2025-09-30T14:57:40.048511Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:40.048525Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:40.048535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:40.048538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:40.048540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:40.048555Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:40.048566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:40.048573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:40.048640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.048647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.048650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.048653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:40.048656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:40.048723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:40.048731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.048745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.048764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.048782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:40.048805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393039167:11652], now have 1 active actors on pipe
2025-09-30T14:57:40.048817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896564303246850:12048]
2025-09-30T14:57:40.048819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896564303246850:12048]
2025-09-30T14:57:40.048821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896564303246850:12048]
2025-09-30T14:57:40.048835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:40.048852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393038930:2454], now have 1 active actors on pipe
2025-09-30T14:57:40.048861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:40.048864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:40.048876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:40.048876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:40.048879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:40.048880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:40.048911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896564303246850:12048]
2025-09-30T14:57:40.048922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:40.048928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:40.048937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2634
2025-09-30T14:57:40.048996Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2634
2025-09-30T14:57:40.049030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.049040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.049065Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:40.049076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:40.049080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:40.049083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:40.049092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:40.049106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:40.049127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:40.049336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.049344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.049356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:40.049552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2635 partition: 0 MaxSeqNo: 42 sessionId: src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0
2025-09-30T14:57:40.049934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b5a354d-6c3b9f92-9ef97da5-684b63dc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:40.052879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0] Write session: try to update token
2025-09-30T14:57:40.052901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:40.061471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:40.061492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:40.061494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:40.061496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:40.061504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896564303246850:12048]
2025-09-30T14:57:40.061509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896564303246850:12048]
2025-09-30T14:57:40.061513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896564303246850:12048]
2025-09-30T14:57:40.061555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:40.061561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.061561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:40.061564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:40.061567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:40.061571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:40.061706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:40.071905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2635 sessionId: src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:40.074593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:40.115135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896564393039189:11465]
2025-09-30T14:57:40.115430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2634, pipe: [1:7555896564393039189:11465]
2025-09-30T14:57:40.177515Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:40.177935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.177954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.177975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393039189:11465], now have 1 active actors on pipe
2025-09-30T14:57:40.178182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:40.178198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:40.178230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:40.178234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:40.178255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896564393039189:11465]
2025-09-30T14:57:40.178291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2635 reason: error at write: Disconnected sessionId: src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0
2025-09-30T14:57:40.178475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2635 sessionId: src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0 is DEAD
2025-09-30T14:57:40.178614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:40.178622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0] Write session will restart in 0.005103s
2025-09-30T14:57:40.178645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0] Write session: Do CDS request
2025-09-30T14:57:40.178653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:40.184781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:40.184849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:40.184869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2636
2025-09-30T14:57:40.184978Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2636 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:40.185022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2636 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:40.185033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2636 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:40.185040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:40.185423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2636 sessionId:  describe result for acl check
2025-09-30T14:57:40.185455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:40.185459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:40.185461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:40.185466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896564393039205:11661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:40.185997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896564393039205:11661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:40.188744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896564393039205:11661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:40.192200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896564393039205:11661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:40.192216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896564393039205:11661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:40.192219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896564393039205:11661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:40.192227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2636 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:40.194787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:40.197084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:40.197284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:40.197292Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:40.197300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:40.197348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:40.197378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896564303247116:12063]
2025-09-30T14:57:40.197862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:40.198150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:40.198184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:40.198445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:40.198512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.198517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.198518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.198518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.198519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.198520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.198521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.198521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.198522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.198523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.198524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.198524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.198525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.198526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.198527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.198532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.198542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.198546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.198550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.198553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.198557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.198560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.198563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.198566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.198573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.198577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.198581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.198586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.198590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.198594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.198602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.198607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.198611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.198614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.198617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.198620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.198624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.198627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.198630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.198632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.198635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.198638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.198641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.198643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.198646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.198648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.198651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.198654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.198658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.198661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.198663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.198666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.198669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.198672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.198674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.198677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.198681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.198683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.198686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.198689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.198714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:40.204230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:40.205345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:40.205359Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:40.205361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:40.205365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:40.205371Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2635 [2:7555896564303247116:12063]
2025-09-30T14:57:40.205387Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:40.205401Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:40.205404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:40.205406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:40.205407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:40.205420Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:40.205425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:40.205431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:40.205493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.205506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.205508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.205512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:40.205514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:40.205580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:40.205588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.205601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.205612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.205630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:40.205654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393039379:11661], now have 1 active actors on pipe
2025-09-30T14:57:40.205661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896564303247111:12063]
2025-09-30T14:57:40.205669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896564303247111:12063]
2025-09-30T14:57:40.205671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896564303247111:12063]
2025-09-30T14:57:40.205684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:40.205694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393039190:2454], now have 1 active actors on pipe
2025-09-30T14:57:40.205706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:40.205705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:40.205709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:40.205712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:40.205721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:40.205729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:40.205761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896564303247111:12063]
2025-09-30T14:57:40.205776Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:40.205786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:40.205784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2635
2025-09-30T14:57:40.205825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.205836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.205861Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:40.205874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:40.205885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:40.205888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:40.205898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:40.205907Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:40.205923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:40.206233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2635
2025-09-30T14:57:40.206215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.206225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.206243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:40.207347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2636 partition: 0 MaxSeqNo: 42 sessionId: src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0
2025-09-30T14:57:40.207735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|acaf35a8-3db578bf-c310a14a-c9e54679_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:40.210641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0] Write session: try to update token
2025-09-30T14:57:40.210661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:40.224636Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:40.224667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:40.224681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896564303247111:12063]
2025-09-30T14:57:40.224739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:40.224751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:40.225046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:40.225196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:40.225331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:40.225467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:40.225661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:40.225700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:40.230303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2636 sessionId: src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:40.230805Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:40.230826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:40.230829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:40.230831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:40.230841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896564303247111:12063]
2025-09-30T14:57:40.230845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896564303247111:12063]
2025-09-30T14:57:40.230849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896564303247111:12063]
2025-09-30T14:57:40.230886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:40.230893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.230896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:40.230895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:40.230914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:40.230918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:40.231039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:40.233120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:40.278484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896564393039430:11465]
2025-09-30T14:57:40.278896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2635, pipe: [1:7555896564393039430:11465]
2025-09-30T14:57:40.346680Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:40.347153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.347164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.347186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393039430:11465], now have 1 active actors on pipe
2025-09-30T14:57:40.347506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:40.347525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:40.347592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2636 reason: error at write: Disconnected sessionId: src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0
2025-09-30T14:57:40.347755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2636 sessionId: src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0 is DEAD
2025-09-30T14:57:40.347840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896564393039430:11465]
2025-09-30T14:57:40.347864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:40.347994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:40.348005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0] Write session will restart in 0.005705s
2025-09-30T14:57:40.348032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0] Write session: Do CDS request
2025-09-30T14:57:40.348039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:40.347510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:40.354787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:40.354927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:40.354944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2637
2025-09-30T14:57:40.355092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2637 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:40.355142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2637 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:40.355154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2637 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:40.355158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:40.355880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2637 sessionId:  describe result for acl check
2025-09-30T14:57:40.355952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:40.355963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:40.355965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:40.355973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896564393039454:11667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:40.356713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896564393039454:11667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:40.359073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896564393039454:11667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:40.361529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896564393039454:11667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:40.361554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896564393039454:11667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:40.361558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896564393039454:11667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:40.361565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2637 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:40.372967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:40.375099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:40.375387Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:40.375403Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:40.375417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:40.375490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:40.375536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896564303247342:12065]
2025-09-30T14:57:40.376155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:40.376487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:40.376539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:40.376875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:40.376967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.376975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.376977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.376978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.376979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.376981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.376982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.376984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.376985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.376986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.376987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.376988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.376989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.376991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.376992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.376998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.377023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.377028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.377032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.377035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.377039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.377043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.377046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.377050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.377054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.377057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.377061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.377064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.377067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.377071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.377081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.377088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.377094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.377100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.377106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.377111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.377115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.377120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.377125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.377130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.377134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.377139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.377143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.377148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.377152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.377165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.377173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.377183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.377188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.377193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.377203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.377209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.377214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.377219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.377223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.377228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.377233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.377239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.377243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.377254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.377298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:40.382871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:40.383978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:40.383990Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:40.383992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:40.383995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:40.384000Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2636 [2:7555896564303247342:12065]
2025-09-30T14:57:40.384013Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:40.384026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:40.384028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:40.384031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:40.384033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:40.384044Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:40.384049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:40.384054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:40.384101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.384108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.384109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.384112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:40.384114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:40.384165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:40.384172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.384180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.384188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.384201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:40.384217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896564303247337:12065]
2025-09-30T14:57:40.384222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896564303247337:12065]
2025-09-30T14:57:40.384224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896564303247337:12065]
2025-09-30T14:57:40.384231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:40.384242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:40.384244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:40.384253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:40.384255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:40.384262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393039497:11667], now have 1 active actors on pipe
2025-09-30T14:57:40.384265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393039446:2454], now have 1 active actors on pipe
2025-09-30T14:57:40.384266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:40.384268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:40.384294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896564303247337:12065]
2025-09-30T14:57:40.384302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:40.384338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:40.384373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2636
2025-09-30T14:57:40.384383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2636
2025-09-30T14:57:40.384451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.384459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.384483Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|113e6537-249825f3-25d5aa97-9c990bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:40.384492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:40.384494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:40.384496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:40.384503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:40.384521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:40.384536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:40.384715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.384722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.384735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:40.384827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2637 partition: 0 MaxSeqNo: 42 sessionId: src_id|113e6537-249825f3-25d5aa97-9c990bd_0
2025-09-30T14:57:40.385212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f6f0c807-40ae27a0-260cc04-cee2813b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|113e6537-249825f3-25d5aa97-9c990bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:40.388059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|113e6537-249825f3-25d5aa97-9c990bd_0] Write session: try to update token
2025-09-30T14:57:40.388077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|113e6537-249825f3-25d5aa97-9c990bd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:40.396585Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:40.396609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:40.396612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:40.396614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:40.396624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896564303247337:12065]
2025-09-30T14:57:40.396629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896564303247337:12065]
2025-09-30T14:57:40.396634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896564303247337:12065]
2025-09-30T14:57:40.396674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:40.396680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.396686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:40.396694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:40.396701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:40.396706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:40.396825Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:40.403080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2637 sessionId: src_id|113e6537-249825f3-25d5aa97-9c990bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:40.406151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:40.447917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896564393039682:11465]
2025-09-30T14:57:40.448175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2636, pipe: [1:7555896564393039682:11465]
2025-09-30T14:57:40.506339Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:40.506746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.506764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.506800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393039682:11465], now have 1 active actors on pipe
2025-09-30T14:57:40.507000Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:40.507081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896564393039682:11465]
2025-09-30T14:57:40.507132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:40.507203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2637 reason: status is not ok: tablet will be restarted right now sessionId: src_id|113e6537-249825f3-25d5aa97-9c990bd_0
2025-09-30T14:57:40.507371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:40.507393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2637 sessionId: src_id|113e6537-249825f3-25d5aa97-9c990bd_0 is DEAD
2025-09-30T14:57:40.507554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|113e6537-249825f3-25d5aa97-9c990bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:40.507565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|113e6537-249825f3-25d5aa97-9c990bd_0] Write session will restart in 0.007338s
2025-09-30T14:57:40.507588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|113e6537-249825f3-25d5aa97-9c990bd_0] Write session: Do CDS request
2025-09-30T14:57:40.507593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|113e6537-249825f3-25d5aa97-9c990bd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:40.515764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|113e6537-249825f3-25d5aa97-9c990bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:40.515841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:40.515872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2638
2025-09-30T14:57:40.515993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2638 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:40.516026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2638 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:40.516036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2638 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:40.516041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:40.516585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2638 sessionId:  describe result for acl check
2025-09-30T14:57:40.516623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:40.516630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:40.516632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:40.516638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896564393039741:11671] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:40.517264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896564393039741:11671] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:40.519976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896564393039741:11671] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:40.522329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896564393039741:11671] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:40.522349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896564393039741:11671] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:40.522353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896564393039741:11671] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:40.522359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2638 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:40.523073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:40.525407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:40.525580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:40.525588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:40.525598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:40.525646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:40.525692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896564303247569:12067]
2025-09-30T14:57:40.526358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:40.526645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:40.526683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:40.527018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:40.527088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.527094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.527096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.527097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.527098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.527099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.527101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.527102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.527103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.527105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.527106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.527108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.527109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.527110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.527111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.527116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.527128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.527133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.527137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.527141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.527145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.527149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.527153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.527158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.527162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.527166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.527170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.527174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.527178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.527182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.527190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.527198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.527204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.527210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.527218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.527223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.527227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.527231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.527239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.527258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.527262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.527267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.527273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.527278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.527282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.527288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.527293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.527298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.527302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.527308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.527312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.527317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.527321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.527327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.527331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.527337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.527341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.527346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.527359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.527364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.527407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:40.532796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:40.533783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:40.533798Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:40.533800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:40.533804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:40.533808Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2637 [2:7555896564303247569:12067]
2025-09-30T14:57:40.533820Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:40.533833Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:40.533835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:40.533837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:40.533839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:40.533851Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:40.533857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:40.533867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:40.533915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.533923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.533925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.533929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:40.533931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:40.533991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:40.533999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.534007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.534013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.534022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:40.534035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896564303247564:12067]
2025-09-30T14:57:40.534037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896564303247564:12067]
2025-09-30T14:57:40.534039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896564303247564:12067]
2025-09-30T14:57:40.534045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:40.534055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393039904:11671], now have 1 active actors on pipe
2025-09-30T14:57:40.534057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:40.534059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:40.534060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393039683:2454], now have 1 active actors on pipe
2025-09-30T14:57:40.534062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:40.534064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:40.534073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:40.534075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:40.534099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896564303247564:12067]
2025-09-30T14:57:40.534105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:40.534110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:40.534169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2637
2025-09-30T14:57:40.534199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2637
2025-09-30T14:57:40.534321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.534329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.534355Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:40.534365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:40.534368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:40.534369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:40.534376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:40.534384Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:40.534400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:40.534571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.534584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.534609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:40.534690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2638 partition: 0 MaxSeqNo: 42 sessionId: src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0
2025-09-30T14:57:40.535085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|113e6537-249825f3-25d5aa97-9c990bd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:40.537743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0] Write session: try to update token
2025-09-30T14:57:40.537765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:40.546276Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:40.546296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:40.546299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:40.546314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:40.546325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896564303247564:12067]
2025-09-30T14:57:40.546330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896564303247564:12067]
2025-09-30T14:57:40.546335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896564303247564:12067]
2025-09-30T14:57:40.546379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:40.546392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:40.546397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:40.546397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:40.546406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.546417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:40.546588Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:40.552654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2638 sessionId: src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:40.555411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:40.607197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896564393039918:11465]
2025-09-30T14:57:40.607561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2637, pipe: [1:7555896564393039918:11465]
2025-09-30T14:57:40.661275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:40.661717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.661734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.661756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393039918:11465], now have 1 active actors on pipe
2025-09-30T14:57:40.661975Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:40.662037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:40.662041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896564393039918:11465]
2025-09-30T14:57:40.662050Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:40.662169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2638 reason: error at write: Disconnected sessionId: src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0
2025-09-30T14:57:40.662257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:40.662344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2638 sessionId: src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0 is DEAD
2025-09-30T14:57:40.662468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:40.662474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0] Write session will restart in 0.005513s
2025-09-30T14:57:40.662497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0] Write session: Do CDS request
2025-09-30T14:57:40.662505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:40.668792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:40.668902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:40.668919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2639
2025-09-30T14:57:40.669067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2639 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:40.669101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2639 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:40.669106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2639 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:40.669111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:40.669577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2639 sessionId:  describe result for acl check
2025-09-30T14:57:40.669629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:40.669636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:40.669638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:40.669644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896564393039934:11675] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:40.670208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896564393039934:11675] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:40.672536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896564393039934:11675] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:40.675641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896564393039934:11675] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:40.675656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896564393039934:11675] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:40.675659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896564393039934:11675] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:40.675667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2639 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:40.680323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:40.683172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:40.683401Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:40.683414Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:40.683425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:40.683488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:40.683536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896564303247799:12070]
2025-09-30T14:57:40.684099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:40.684422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:40.684458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:40.684737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:40.684787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.684794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.684795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.684795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.684796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.684797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.684798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.684798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.684799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.684800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.684801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.684802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.684802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.684803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.684804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.684807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.684815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.684817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.684820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.684822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.684824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.684827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.684829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.684831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.684834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.684837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.684839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.684841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.684844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.684846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.684852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.684857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.684862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.684866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.684868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.684872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.684874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.684878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.684880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.684884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.684886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.684890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.684892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.684895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.684898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.684901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.684904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.684907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.684909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.684914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.684916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.684920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.684922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.684925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.684929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.684932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.684934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.684937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.684940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.684943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.684966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:40.690521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:40.691984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:40.691999Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:40.692002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:40.692007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:40.692014Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2638 [2:7555896564303247799:12070]
2025-09-30T14:57:40.692029Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:40.692045Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:40.692048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:40.692051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:40.692053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:40.692079Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:40.692086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:40.692093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:40.692153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.692161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.692163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.692166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:40.692169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:40.692238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:40.692245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.692259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.692276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.692346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2638
2025-09-30T14:57:40.692299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:40.692369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2638
2025-09-30T14:57:40.692322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393040051:11675], now have 1 active actors on pipe
2025-09-30T14:57:40.692325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393039919:2454], now have 1 active actors on pipe
2025-09-30T14:57:40.692331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896564303247793:12070]
2025-09-30T14:57:40.692333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896564303247793:12070]
2025-09-30T14:57:40.692335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896564303247793:12070]
2025-09-30T14:57:40.692348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:40.692356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:40.692360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:40.692361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:40.692363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:40.692376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:40.692379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:40.692415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896564303247793:12070]
2025-09-30T14:57:40.692422Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:40.692429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:40.692435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.692440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.692485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e69b19f-821281a8-a9e07953-ade34270_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:40.692496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:40.692501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:40.692503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:40.692513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:40.692526Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:40.692548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:40.692724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.692733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.692746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:40.692837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2639 partition: 0 MaxSeqNo: 42 sessionId: src_id|e69b19f-821281a8-a9e07953-ade34270_0
2025-09-30T14:57:40.693251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0835fac-ac053925-bdf08069-4d70b8e9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e69b19f-821281a8-a9e07953-ade34270_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:40.695896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e69b19f-821281a8-a9e07953-ade34270_0] Write session: try to update token
2025-09-30T14:57:40.695913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e69b19f-821281a8-a9e07953-ade34270_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:40.705154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:40.705172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:40.705175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:40.705177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:40.705187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896564303247793:12070]
2025-09-30T14:57:40.705192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896564303247793:12070]
2025-09-30T14:57:40.705196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896564303247793:12070]
2025-09-30T14:57:40.705240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:40.705248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.705252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:40.705273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:40.705283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:40.705319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:40.705401Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:40.711045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2639 sessionId: src_id|e69b19f-821281a8-a9e07953-ade34270_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:40.714043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:40.763369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896564393040158:11465]
2025-09-30T14:57:40.763699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2638, pipe: [1:7555896564393040158:11465]
2025-09-30T14:57:40.827495Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:40.827813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.827828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.827867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393040158:11465], now have 1 active actors on pipe
2025-09-30T14:57:40.828625Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e69b19f-821281a8-a9e07953-ade34270_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:40.828635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e69b19f-821281a8-a9e07953-ade34270_0] Write session will restart in 0.006204s
2025-09-30T14:57:40.828663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e69b19f-821281a8-a9e07953-ade34270_0] Write session: Do CDS request
2025-09-30T14:57:40.828669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e69b19f-821281a8-a9e07953-ade34270_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:40.829297Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:40.828148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896564393040158:11465]
2025-09-30T14:57:40.828185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:40.828188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:40.828265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2639 reason: error at write: Disconnected sessionId: src_id|e69b19f-821281a8-a9e07953-ade34270_0
2025-09-30T14:57:40.828451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2639 sessionId: src_id|e69b19f-821281a8-a9e07953-ade34270_0 is DEAD
2025-09-30T14:57:40.828596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:40.835827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e69b19f-821281a8-a9e07953-ade34270_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:40.835901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:40.835920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2640
2025-09-30T14:57:40.836075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2640 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:40.836114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2640 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:40.836125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2640 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:40.836129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:40.836627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2640 sessionId:  describe result for acl check
2025-09-30T14:57:40.836674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:40.836676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:40.836678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:40.836684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896564393040174:11680] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:40.837260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896564393040174:11680] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:40.839710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896564393040174:11680] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:40.846385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896564393040174:11680] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:40.846401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896564393040174:11680] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:40.846405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896564393040174:11680] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:40.846412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2640 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:40.860653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:40.866336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:40.866612Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:40.866624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:40.866635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:40.866696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:40.866738Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896564303248028:12072]
2025-09-30T14:57:40.867394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:40.867800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:40.867885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:40.868222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:40.868296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.868300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.868301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.868303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.868304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.868305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.868306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.868307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.868309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.868310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.868311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.868313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.868315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.868316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.868317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.868323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.868335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.868340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.868345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.868349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.868353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.868358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.868361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.868365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.868370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.868374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.868379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.868383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.868387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.868391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.868400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.868408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:40.868414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.868420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:40.868428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.868434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:40.868439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.868444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:40.868450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.868455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:40.868460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.868467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:40.868472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.868478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:40.868483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.868488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:40.868494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.868500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:40.868505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.868510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:40.868515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.868520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.868525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.868530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.868536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.868542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.868546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.868551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:40.868556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.868562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:40.868621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:40.874411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:40.875347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:40.875361Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:40.875364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:40.875369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:40.875377Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2639 [2:7555896564303248028:12072]
2025-09-30T14:57:40.875395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:40.875411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:40.875414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:40.875418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:40.875420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:40.875436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:40.875952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2639
2025-09-30T14:57:40.875993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2639
2025-09-30T14:57:40.875444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:40.875459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:40.875519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.875521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.875523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.875527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:40.875530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:40.875600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:40.875604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.875616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:40.875627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:40.875643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:40.875661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393040159:2454], now have 1 active actors on pipe
2025-09-30T14:57:40.875667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393040293:11680], now have 1 active actors on pipe
2025-09-30T14:57:40.875674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896564303248023:12072]
2025-09-30T14:57:40.875676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896564303248023:12072]
2025-09-30T14:57:40.875678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896564303248023:12072]
2025-09-30T14:57:40.875692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:40.875706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:40.875720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:40.875723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:40.875733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:40.875737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:40.875740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:40.875758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896564303248023:12072]
2025-09-30T14:57:40.875762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:40.875763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:40.876423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.876436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.876466Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:40.876475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:40.876480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:40.876483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:40.876495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:40.876507Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:40.876523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:40.876764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:40.876772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:40.876788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:40.876892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2640 partition: 0 MaxSeqNo: 42 sessionId: src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0
2025-09-30T14:57:40.883387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e69b19f-821281a8-a9e07953-ade34270_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:40.886206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0] Write session: try to update token
2025-09-30T14:57:40.886232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:40.891076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:40.891097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:40.891100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:40.891102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:40.891111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896564303248023:12072]
2025-09-30T14:57:40.891115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896564303248023:12072]
2025-09-30T14:57:40.891120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896564303248023:12072]
2025-09-30T14:57:40.891159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:40.891166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:40.891169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:40.891167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:40.891184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:40.891189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:40.891318Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:40.911311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2640 sessionId: src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:40.914233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:40.931314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896564393040399:11465]
2025-09-30T14:57:40.931635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2639, pipe: [1:7555896564393040399:11465]
2025-09-30T14:57:41.008051Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:41.008709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.008727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.008747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896564393040399:11465], now have 1 active actors on pipe
2025-09-30T14:57:41.009014Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:41.009218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896564393040399:11465]
2025-09-30T14:57:41.009249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:41.009734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:41.009745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0] Write session will restart in 0.009421s
2025-09-30T14:57:41.009337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:41.009422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2640 reason: status is not ok: tablet will be restarted right now sessionId: src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0
2025-09-30T14:57:41.009587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2640 sessionId: src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0 is DEAD
2025-09-30T14:57:41.009785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0] Write session: Do CDS request
2025-09-30T14:57:41.009791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:41.027645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:41.027753Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:41.027772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2641
2025-09-30T14:57:41.027888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2641 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:41.027920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2641 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:41.027931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2641 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:41.027935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:41.028430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2641 sessionId:  describe result for acl check
2025-09-30T14:57:41.028469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:41.028472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:41.028473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:41.028479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896568688007861:11684] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:41.028987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896568688007861:11684] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:41.031215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896568688007861:11684] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:41.032024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:41.034633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:41.034841Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:41.034853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:41.034864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:41.034912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:41.034951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896568598215556:12074]
2025-09-30T14:57:41.034967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896568688007861:11684] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:41.034984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896568688007861:11684] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:41.034988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896568688007861:11684] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:41.034996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2641 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:41.035631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:41.035976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:41.036040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:41.036648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:41.036746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.036757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.036758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.036759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.036760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.036761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.036762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.036764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.036765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.036766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.036767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.036768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.036770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.036771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.036772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.036779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.036790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.036795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.036800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.036804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.036808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.036813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.036817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.036821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.036825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.036829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.036833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.036837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.036841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.036845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.036853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.036861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.036867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.036873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.036877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.036882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.036887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.036892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.036897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.036903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.036907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.036912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.036917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.036923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.036928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.036933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.036940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.036945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.036949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.036954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.036959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.036964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.036975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.036980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.036985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.036990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.037000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.037024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.037034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.037040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.037088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:41.042554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:41.044100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2640
2025-09-30T14:57:41.044101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2640
2025-09-30T14:57:41.043702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:41.043721Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:41.043723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:41.043727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:41.043733Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2640 [2:7555896568598215556:12074]
2025-09-30T14:57:41.043750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:41.043765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:41.043769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:41.043772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:41.043775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:41.043789Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:41.043796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:41.043801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:41.043859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.043861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.043863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.043867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:41.043869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:41.043939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:41.043941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.043953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.043965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.043982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:41.044001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688007926:11684], now have 1 active actors on pipe
2025-09-30T14:57:41.044005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688007700:2454], now have 1 active actors on pipe
2025-09-30T14:57:41.044011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896568598215551:12074]
2025-09-30T14:57:41.044014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896568598215551:12074]
2025-09-30T14:57:41.044016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896568598215551:12074]
2025-09-30T14:57:41.044024Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:41.044034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:41.044037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:41.044038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:41.044040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:41.044052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:41.044055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:41.044088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896568598215551:12074]
2025-09-30T14:57:41.044096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:41.044104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:41.044153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.044158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.044182Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:41.044188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:41.044191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:41.044193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:41.044202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:41.044211Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:41.044224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:41.044870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.044881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.044901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:41.045061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2641 partition: 0 MaxSeqNo: 42 sessionId: src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0
2025-09-30T14:57:41.045441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|150aa6be-e07108ae-8e23e85e-252bcf3d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:41.048499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0] Write session: try to update token
2025-09-30T14:57:41.048518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:41.056997Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:41.057035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:41.057045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896568598215551:12074]
2025-09-30T14:57:41.057095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:41.057112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:41.057277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:41.057422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:41.057629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:41.057777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:41.057967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:41.058004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:41.067898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:41.067919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:41.067921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:41.067923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:41.067932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896568598215551:12074]
2025-09-30T14:57:41.067937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896568598215551:12074]
2025-09-30T14:57:41.067941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896568598215551:12074]
2025-09-30T14:57:41.067979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:41.067993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.068001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:41.068147Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:41.068850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2641 sessionId: src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:41.071303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:41.071321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:41.071326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:41.071436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:41.109435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896568688007955:11465]
2025-09-30T14:57:41.109785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2640, pipe: [1:7555896568688007955:11465]
2025-09-30T14:57:41.186822Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:41.187307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.187322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.187343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688007955:11465], now have 1 active actors on pipe
2025-09-30T14:57:41.187568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:41.187581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:41.187600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:41.187604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:41.187651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896568688007955:11465]
2025-09-30T14:57:41.187669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2641 reason: error at write: Disconnected sessionId: src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0
2025-09-30T14:57:41.187861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2641 sessionId: src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0 is DEAD
2025-09-30T14:57:41.188006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:41.188018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0] Write session will restart in 0.005513s
2025-09-30T14:57:41.188051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0] Write session: Do CDS request
2025-09-30T14:57:41.188065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:41.194737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:41.194851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:41.194867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2642
2025-09-30T14:57:41.194980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2642 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:41.195028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2642 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:41.195038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2642 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:41.195043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:41.195468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2642 sessionId:  describe result for acl check
2025-09-30T14:57:41.195520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:41.195531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:41.195533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:41.195538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896568688007981:11695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:41.196206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896568688007981:11695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:41.199546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896568688007981:11695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:41.203622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896568688007981:11695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:41.203641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896568688007981:11695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:41.203645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896568688007981:11695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:41.203653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2642 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:41.207082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:41.207923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:41.208186Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:41.208193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:41.208206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:41.208269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:41.208311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896568598215836:12090]
2025-09-30T14:57:41.209096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:41.211545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:41.211624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:41.212001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:41.212083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.212091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.212092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.212093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.212094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.212096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.212097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.212098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.212100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.212101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.212102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.212103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.212105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.212107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.212108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.212114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.212125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.212129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.212133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.212138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.212142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.212146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.212150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.212154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.212158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.212161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.212164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.212168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.212171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.212175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.212186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.212194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.212201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.212207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.212214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.212218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.212222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.212227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.212231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.212235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.212240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.212245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.212250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.212264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.212268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.212273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.212279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.212284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.212288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.212294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.212298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.212304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.212308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.212313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.212319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.212330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.212335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.212340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.212344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.212350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.212410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:41.218363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:41.219902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:41.219918Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:41.219921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:41.219925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:41.219931Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2641 [2:7555896568598215836:12090]
2025-09-30T14:57:41.219947Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:41.219962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:41.219965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:41.219968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:41.219970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:41.219985Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:41.219990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:41.219995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:41.220053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.220061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.220064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.220067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:41.220069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:41.220138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:41.220149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.220163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.220176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.220194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:41.220217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688008162:11695], now have 1 active actors on pipe
2025-09-30T14:57:41.220225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688007965:2454], now have 1 active actors on pipe
2025-09-30T14:57:41.220231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896568598215830:12090]
2025-09-30T14:57:41.220233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896568598215830:12090]
2025-09-30T14:57:41.220235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896568598215830:12090]
2025-09-30T14:57:41.220248Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:41.220260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:41.220272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:41.220278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:41.220282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:41.220284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:41.220288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:41.220315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896568598215830:12090]
2025-09-30T14:57:41.220318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:41.220326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:41.220289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2641
2025-09-30T14:57:41.220297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2641
2025-09-30T14:57:41.220354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.220364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.220400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:41.220411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:41.220415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:41.220417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:41.220426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:41.220435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:41.220454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:41.220640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.220651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.220666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:41.220801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2642 partition: 0 MaxSeqNo: 42 sessionId: src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0
2025-09-30T14:57:41.221174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30f381bd-6d87f649-1a5d69c7-6d891627_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:41.224192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0] Write session: try to update token
2025-09-30T14:57:41.224212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:41.232792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:41.232818Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:41.232820Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:41.232823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:41.232833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896568598215830:12090]
2025-09-30T14:57:41.232839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896568598215830:12090]
2025-09-30T14:57:41.232843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896568598215830:12090]
2025-09-30T14:57:41.232885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:41.232898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.232906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:41.233062Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:41.233416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:41.233430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:41.233434Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:41.245082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2642 sessionId: src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:41.248032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:41.287623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896568688008211:11465]
2025-09-30T14:57:41.291007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2641, pipe: [1:7555896568688008211:11465]
2025-09-30T14:57:41.352787Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:41.353127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.353142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.353161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688008211:11465], now have 1 active actors on pipe
2025-09-30T14:57:41.353414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:41.353425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896568688008211:11465]
2025-09-30T14:57:41.353430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:41.353525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:41.353529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2642 reason: error at write: Disconnected sessionId: src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0
2025-09-30T14:57:41.353633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:41.353704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2642 sessionId: src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0 is DEAD
2025-09-30T14:57:41.353881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:41.353893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0] Write session will restart in 0.007576s
2025-09-30T14:57:41.353919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0] Write session: Do CDS request
2025-09-30T14:57:41.353924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:41.362792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:41.362912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:41.362929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2643
2025-09-30T14:57:41.363105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2643 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:41.363160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2643 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:41.363172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2643 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:41.363177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:41.363671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2643 sessionId:  describe result for acl check
2025-09-30T14:57:41.363713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:41.363731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:41.363737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:41.363745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896568688008255:11701] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:41.364289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896568688008255:11701] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:41.369232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896568688008255:11701] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:41.373018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896568688008255:11701] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:41.373038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896568688008255:11701] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:41.373042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896568688008255:11701] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:41.373051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2643 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:41.375717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:41.378891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:41.379240Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:41.379268Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:41.379281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:41.379355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:41.379402Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896568598216068:12092]
2025-09-30T14:57:41.380026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:41.380369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:41.380416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:41.380735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:41.380807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.380814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.380815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.380816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.380817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.380819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.380820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.380821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.380823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.380824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.380825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.380826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.380828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.380829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.380830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.380836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.380845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.380849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.380853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.380856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.380859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.380863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.380866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.380870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.380875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.380879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.380883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.380886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.380890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.380893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.380901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.380909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.380914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.380919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.380924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.380929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.380934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.380938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.380943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.380947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.380952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.380958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.380962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.380966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.380970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.380975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.380989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.380994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.380998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.381019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.381028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.381033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.381036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.381045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.381049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.381054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.381057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.381062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.381067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.381071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.381113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:41.386582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:41.388021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:41.388037Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:41.388040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:41.388043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:41.388049Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2642 [2:7555896568598216068:12092]
2025-09-30T14:57:41.388065Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:41.388082Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:41.388092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:41.388095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:41.388097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:41.388113Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:41.388124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:41.388130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:41.388196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.388203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.388205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.388209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:41.388211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:41.388276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:41.388284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.388297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.388307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.388328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:41.388348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896568598216062:12092]
2025-09-30T14:57:41.388354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896568598216062:12092]
2025-09-30T14:57:41.388356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896568598216062:12092]
2025-09-30T14:57:41.388370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:41.388389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:41.388420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:41.388427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:41.388462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896568598216062:12092]
2025-09-30T14:57:41.388469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:41.388596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:41.388610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:41.388612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:41.388618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:41.388846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688008227:2454], now have 1 active actors on pipe
2025-09-30T14:57:41.388857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688008454:11701], now have 1 active actors on pipe
2025-09-30T14:57:41.388928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2642
2025-09-30T14:57:41.388976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2642
2025-09-30T14:57:41.389076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.389086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.389111Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2e594a4-c05e1811-6868a32a-40feb894_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:41.389122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:41.389125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:41.389129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:41.389140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:41.389153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:41.389171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:41.389385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.389392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.389405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:41.389515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2643 partition: 0 MaxSeqNo: 42 sessionId: src_id|f2e594a4-c05e1811-6868a32a-40feb894_0
2025-09-30T14:57:41.389915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a082588-ef1c0c98-116b4b56-2b719b5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f2e594a4-c05e1811-6868a32a-40feb894_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:41.392700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e594a4-c05e1811-6868a32a-40feb894_0] Write session: try to update token
2025-09-30T14:57:41.392720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e594a4-c05e1811-6868a32a-40feb894_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:41.400732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:41.400758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:41.400761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:41.400763Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:41.400773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896568598216062:12092]
2025-09-30T14:57:41.400778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896568598216062:12092]
2025-09-30T14:57:41.400782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896568598216062:12092]
2025-09-30T14:57:41.400825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:41.400834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.400837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:41.400978Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:41.401586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:41.401601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:41.401610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:41.426836Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2643 sessionId: src_id|f2e594a4-c05e1811-6868a32a-40feb894_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:41.429695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:41.453512Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896568688008469:11465]
2025-09-30T14:57:41.453807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2642, pipe: [1:7555896568688008469:11465]
2025-09-30T14:57:41.516652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:41.517094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.517106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.517122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688008469:11465], now have 1 active actors on pipe
2025-09-30T14:57:41.517303Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:41.517383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896568688008469:11465]
2025-09-30T14:57:41.517405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:41.517408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:41.517411Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:41.517471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2643 reason: error at write: Disconnected sessionId: src_id|f2e594a4-c05e1811-6868a32a-40feb894_0
2025-09-30T14:57:41.517642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2643 sessionId: src_id|f2e594a4-c05e1811-6868a32a-40feb894_0 is DEAD
2025-09-30T14:57:41.517771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e594a4-c05e1811-6868a32a-40feb894_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:41.517781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e594a4-c05e1811-6868a32a-40feb894_0] Write session will restart in 0.009433s
2025-09-30T14:57:41.517804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e594a4-c05e1811-6868a32a-40feb894_0] Write session: Do CDS request
2025-09-30T14:57:41.517811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e594a4-c05e1811-6868a32a-40feb894_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:41.528773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e594a4-c05e1811-6868a32a-40feb894_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:41.528905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:41.528924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2644
2025-09-30T14:57:41.529071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2644 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:41.529125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2644 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:41.529135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2644 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:41.529140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:41.529588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2644 sessionId:  describe result for acl check
2025-09-30T14:57:41.529626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:41.529634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:41.529637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:41.529643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896568688008576:11707] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:41.530175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896568688008576:11707] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:41.532850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896568688008576:11707] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:41.537396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:41.538184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:41.538251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896568688008576:11707] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:41.538270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896568688008576:11707] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:41.538273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896568688008576:11707] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:41.538282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2644 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:41.538376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:41.538387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:41.538397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:41.538446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:41.538481Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896568598216300:12094]
2025-09-30T14:57:41.539173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:41.539496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:41.539545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:41.539844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:41.539906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.539913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.539914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.539915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.539917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.539918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.539919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.539921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.539922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.539923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.539925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.539926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.539927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.539928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.539929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.539934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.539945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.539960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.539964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.539968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.539972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.539975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.539979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.539982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.539987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.539990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.539994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.539997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.540001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.540004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.540011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.540018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.540023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.540028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.540033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.540037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.540041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.540046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.540050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.540055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.540059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.540063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.540068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.540072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.540076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.540081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.540085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.540090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.540094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.540098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.540104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.540113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.540117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.540122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.540126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.540131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.540136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.540141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.540145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.540149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.540189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:41.545699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:41.546884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:41.546906Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:41.546909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:41.546914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:41.546920Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2643 [2:7555896568598216300:12094]
2025-09-30T14:57:41.546942Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:41.546957Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:41.546960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:41.546963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:41.546965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:41.546981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:41.546994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:41.547006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:41.547064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.547074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.547076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.547080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:41.547082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:41.547147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:41.547156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.547170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.547181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.547202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:41.547223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688008703:11707], now have 1 active actors on pipe
2025-09-30T14:57:41.547231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688008473:2454], now have 1 active actors on pipe
2025-09-30T14:57:41.547238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896568598216295:12094]
2025-09-30T14:57:41.547260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896568598216295:12094]
2025-09-30T14:57:41.547263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896568598216295:12094]
2025-09-30T14:57:41.547277Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:41.547299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:41.547313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:41.547315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:41.547349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896568598216295:12094]
2025-09-30T14:57:41.547358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:41.547355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2643
2025-09-30T14:57:41.547374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:41.547361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2643
2025-09-30T14:57:41.547384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:41.547386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:41.547393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:41.547432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.547444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.547476Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:41.547485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:41.547497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:41.547500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:41.547511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:41.547521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:41.547536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:41.547691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.547706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.547728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:41.547831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2644 partition: 0 MaxSeqNo: 42 sessionId: src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0
2025-09-30T14:57:41.548266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2e594a4-c05e1811-6868a32a-40feb894_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:41.550941Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0] Write session: try to update token
2025-09-30T14:57:41.550957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:41.559310Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:41.559331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:41.559341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896568598216295:12094]
2025-09-30T14:57:41.559385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:41.559411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:41.559561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:41.559709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:41.559855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:41.559997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:41.560194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:41.560244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:41.565432Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2644 sessionId: src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:41.568814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:41.570005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.570033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.570054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:41.570056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:41.570059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:41.570061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:41.570071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896568598216295:12094]
2025-09-30T14:57:41.570075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896568598216295:12094]
2025-09-30T14:57:41.570079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896568598216295:12094]
2025-09-30T14:57:41.570131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:41.570131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:41.570137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:41.570138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.570141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:41.570142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:41.570278Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:41.617360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896568688008715:11465]
2025-09-30T14:57:41.617692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2643, pipe: [1:7555896568688008715:11465]
2025-09-30T14:57:41.689878Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:41.690176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:41.690222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688008715:11465], now have 1 active actors on pipe
2025-09-30T14:57:41.690336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:41.690429Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896568688008715:11465]
2025-09-30T14:57:41.690450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:41.690454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:41.690461Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:41.690520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2644 reason: error at write: Disconnected sessionId: src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0
2025-09-30T14:57:41.690663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2644 sessionId: src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0 is DEAD
2025-09-30T14:57:41.690848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:41.690860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0] Write session will restart in 0.009261s
2025-09-30T14:57:41.690883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0] Write session: Do CDS request
2025-09-30T14:57:41.690888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:41.701819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:41.701864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:41.701884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2645
2025-09-30T14:57:41.702060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2645 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:41.702096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2645 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:41.702107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2645 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:41.702111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:41.702723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2645 sessionId:  describe result for acl check
2025-09-30T14:57:41.702762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:41.702769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:41.702771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:41.702777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896568688008809:11711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:41.703343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896568688008809:11711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:41.706941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896568688008809:11711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:41.709088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:41.711598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:41.711747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896568688008809:11711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:41.711764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896568688008809:11711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:41.711768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896568688008809:11711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:41.711776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2645 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:41.711825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:41.711835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:41.711846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:41.711913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:41.711953Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896568598216536:12097]
2025-09-30T14:57:41.712576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:41.712854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:41.712901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:41.713168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:41.713227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.713233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.713235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.713236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.713237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.713238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.713239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.713240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.713241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.713243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.713244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.713245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.713247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.713248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.713249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.713255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.713265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.713270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.713274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.713278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.713282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.713285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.713290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.713294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.713300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.713305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.713309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.713314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.713318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.713323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.713331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.713339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.713349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.713356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.713365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.713371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.713380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.713386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.713395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.713401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.713409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.713415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.713424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.713429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.713435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.713442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.713452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.713462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.713469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.713475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.713484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.713488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.713493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.713500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.713511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.713518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.713526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.713532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.713540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.713546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.713585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:41.719013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:41.720216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:41.720231Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:41.720234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:41.720238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:41.720245Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2644 [2:7555896568598216536:12097]
2025-09-30T14:57:41.720260Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:41.720275Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:41.720281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:41.720288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:41.720290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:41.720305Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:41.720315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:41.720321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:41.720378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.720385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.720387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.720391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:41.720393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:41.720457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:41.720464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.720476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.720487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.720503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:41.720519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896568598216531:12097]
2025-09-30T14:57:41.720525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896568598216531:12097]
2025-09-30T14:57:41.720528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896568598216531:12097]
2025-09-30T14:57:41.720537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:41.720546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:41.720558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688008716:2454], now have 1 active actors on pipe
2025-09-30T14:57:41.720559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:41.720561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:41.720564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:41.720581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:41.720589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:41.720594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688008949:11711], now have 1 active actors on pipe
2025-09-30T14:57:41.720622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896568598216531:12097]
2025-09-30T14:57:41.720629Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:41.720601Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2644
2025-09-30T14:57:41.720625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2644
2025-09-30T14:57:41.720642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:41.720688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.720693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.720719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|285a836-99639ef9-b919d8c6-d2233249_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:41.720732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:41.720735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:41.720738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:41.720748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:41.720760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:41.720772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:41.720917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.720923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.720936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:41.721031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2645 partition: 0 MaxSeqNo: 42 sessionId: src_id|285a836-99639ef9-b919d8c6-d2233249_0
2025-09-30T14:57:41.721376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9144f404-cbf3f8c9-64e40a5c-8342df4a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|285a836-99639ef9-b919d8c6-d2233249_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:41.724220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|285a836-99639ef9-b919d8c6-d2233249_0] Write session: try to update token
2025-09-30T14:57:41.724238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|285a836-99639ef9-b919d8c6-d2233249_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:41.732877Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:41.732896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:41.732900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:41.732902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:41.732911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896568598216531:12097]
2025-09-30T14:57:41.732915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896568598216531:12097]
2025-09-30T14:57:41.732919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896568598216531:12097]
2025-09-30T14:57:41.732960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:41.732970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.732977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:41.732979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:41.732990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:41.732994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:41.733128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:41.740247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2645 sessionId: src_id|285a836-99639ef9-b919d8c6-d2233249_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:41.742992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:41.790404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896568688008962:11465]
2025-09-30T14:57:41.790696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2644, pipe: [1:7555896568688008962:11465]
2025-09-30T14:57:41.845114Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:41.845601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.845617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.845638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688008962:11465], now have 1 active actors on pipe
2025-09-30T14:57:41.845847Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:41.846306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|285a836-99639ef9-b919d8c6-d2233249_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:41.846316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|285a836-99639ef9-b919d8c6-d2233249_0] Write session will restart in 0.008832s
2025-09-30T14:57:41.846339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|285a836-99639ef9-b919d8c6-d2233249_0] Write session: Do CDS request
2025-09-30T14:57:41.846345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|285a836-99639ef9-b919d8c6-d2233249_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:41.845889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:41.845907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:41.845926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896568688008962:11465]
2025-09-30T14:57:41.845947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:41.845968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2645 reason: error at write: Disconnected sessionId: src_id|285a836-99639ef9-b919d8c6-d2233249_0
2025-09-30T14:57:41.846147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2645 sessionId: src_id|285a836-99639ef9-b919d8c6-d2233249_0 is DEAD
2025-09-30T14:57:41.856816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|285a836-99639ef9-b919d8c6-d2233249_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:41.856886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:41.856905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2646
2025-09-30T14:57:41.857075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2646 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:41.857128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2646 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:41.857139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2646 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:41.857143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:41.857758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2646 sessionId:  describe result for acl check
2025-09-30T14:57:41.857791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:41.857798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:41.857800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:41.857806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896568688009037:11716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:41.858359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896568688009037:11716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:41.861030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896568688009037:11716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:41.863852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896568688009037:11716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:41.863866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896568688009037:11716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:41.863873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896568688009037:11716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:41.863880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2646 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:41.863922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:41.866700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:41.866900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:41.866911Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:41.866921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:41.866971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:41.867008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896568598216773:12099]
2025-09-30T14:57:41.867685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:41.868042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:41.868117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:41.868489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:41.868552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.868563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.868564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.868566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.868567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.868568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.868570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.868571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.868572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.868573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.868574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.868576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.868577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.868578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.868579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.868585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.868595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.868599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.868604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.868608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.868613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.868617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.868621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.868625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.868629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.868633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.868637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.868641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.868645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.868649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.868657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.868666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:41.868672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.868679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:41.868684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.868691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:41.868695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.868701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:41.868707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.868721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:41.868726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.868736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:41.868741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.868752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:41.868759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.868775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:41.868781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.868787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:41.868792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.868798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:41.868804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.868811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.868815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.868821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.868827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.868835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.868840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.868845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:41.868850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.868855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:41.868906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:41.874350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:41.875624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:41.875642Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:41.875645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:41.875649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:41.875655Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2645 [2:7555896568598216773:12099]
2025-09-30T14:57:41.875671Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:41.875686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:41.875690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:41.875694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:41.875696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:41.875712Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:41.875719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:41.875736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:41.875798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.875800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.875803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.875806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:41.875809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:41.875876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:41.875885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.875899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:41.875911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:41.875931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:41.875953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688009194:11716], now have 1 active actors on pipe
2025-09-30T14:57:41.875957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688008963:2454], now have 1 active actors on pipe
2025-09-30T14:57:41.875965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896568598216767:12099]
2025-09-30T14:57:41.875968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896568598216767:12099]
2025-09-30T14:57:41.875970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896568598216767:12099]
2025-09-30T14:57:41.875985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:41.875998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:41.876007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:41.876014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:41.876017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:41.876020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:41.876022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:41.876051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896568598216767:12099]
2025-09-30T14:57:41.876032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2645
2025-09-30T14:57:41.876060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:41.876064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:41.876044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2645
2025-09-30T14:57:41.876212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.876228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.876272Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:41.876286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:41.876290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:41.876298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:41.876309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:41.876325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:41.876347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:41.876486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:41.876495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:41.876509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:41.876630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2646 partition: 0 MaxSeqNo: 42 sessionId: src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0
2025-09-30T14:57:41.876990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|285a836-99639ef9-b919d8c6-d2233249_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:41.879879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0] Write session: try to update token
2025-09-30T14:57:41.879902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:41.889088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:41.889109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:41.889111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:41.889113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:41.889121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896568598216767:12099]
2025-09-30T14:57:41.889126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896568598216767:12099]
2025-09-30T14:57:41.889130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896568598216767:12099]
2025-09-30T14:57:41.889168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:41.889174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:41.889178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:41.889204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:41.889232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:41.889239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:41.889314Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:41.894435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2646 sessionId: src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:41.897239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:41.946175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896568688009207:11465]
2025-09-30T14:57:41.947496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2645, pipe: [1:7555896568688009207:11465]
2025-09-30T14:57:42.004005Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:42.004456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.004472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.004507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896568688009207:11465], now have 1 active actors on pipe
2025-09-30T14:57:42.004707Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:42.004788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:42.004805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:42.004833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:42.004865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2646 reason: error at write: Disconnected sessionId: src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0
2025-09-30T14:57:42.004889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896568688009207:11465]
2025-09-30T14:57:42.005050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2646 sessionId: src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0 is DEAD
2025-09-30T14:57:42.005193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:42.005204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0] Write session will restart in 0.009412s
2025-09-30T14:57:42.005226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0] Write session: Do CDS request
2025-09-30T14:57:42.005235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:42.015766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:42.015832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:42.015861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2647
2025-09-30T14:57:42.018033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2647 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:42.018080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2647 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:42.018091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2647 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:42.018095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:42.018586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2647 sessionId:  describe result for acl check
2025-09-30T14:57:42.018622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:42.018630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:42.018632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:42.018638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896572982976585:11720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:42.019133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896572982976585:11720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:42.021573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896572982976585:11720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:42.024724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896572982976585:11720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:42.024745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896572982976585:11720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:42.024748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896572982976585:11720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:42.024756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2647 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:42.024849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:42.027605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:42.027903Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:42.027917Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:42.027930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:42.027991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:42.028224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896572893184307:12101]
2025-09-30T14:57:42.028854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:42.029192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:42.029249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:42.029615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:42.029684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.029693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.029694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.029696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.029697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.029698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.029699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.029700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.029701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.029702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.029704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.029705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.029706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.029707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.029708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.029715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.029725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.029730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.029734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.029738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.029742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.029746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.029750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.029754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.029760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.029764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.029768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.029772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.029776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.029779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.029787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.029796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.029803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.029809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.029815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.029820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.029824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.029830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.029835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.029840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.029845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.029850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.029856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.029861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.029864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.029869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.029873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.029878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.029882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.029886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.029891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.029895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.029900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.029905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.029909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.029913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.029918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.029923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.029936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.029941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.029986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:42.035487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:42.036805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:42.036821Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:42.036824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:42.036828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:42.036834Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2646 [2:7555896572893184307:12101]
2025-09-30T14:57:42.036850Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:42.036865Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:42.036868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:42.036871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:42.036874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:42.036889Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:42.036896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:42.036903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:42.036968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.036986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.037013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.037018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:42.037022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:42.037094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:42.037103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.037118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.037130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.037147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:42.037172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982976737:11720], now have 1 active actors on pipe
2025-09-30T14:57:42.037180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982976505:2454], now have 1 active actors on pipe
2025-09-30T14:57:42.037186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896572893184301:12101]
2025-09-30T14:57:42.037189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896572893184301:12101]
2025-09-30T14:57:42.037191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896572893184301:12101]
2025-09-30T14:57:42.037205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:42.037226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:42.037228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:42.037229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:42.037232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:42.037232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2646
2025-09-30T14:57:42.037242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:42.037245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:42.037273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2646
2025-09-30T14:57:42.037282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896572893184301:12101]
2025-09-30T14:57:42.037291Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:42.037306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:42.037346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.037363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.037397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae3be276-ab97a585-11322611-c25c0b15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:42.037412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:42.037416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:42.037424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:42.037435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:42.037449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:42.037462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:42.037656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.037673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.037696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:42.037804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2647 partition: 0 MaxSeqNo: 42 sessionId: src_id|ae3be276-ab97a585-11322611-c25c0b15_0
2025-09-30T14:57:42.038165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5820dc1e-8c029bdc-b6710036-e2032fd4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ae3be276-ab97a585-11322611-c25c0b15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:42.041045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae3be276-ab97a585-11322611-c25c0b15_0] Write session: try to update token
2025-09-30T14:57:42.041066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae3be276-ab97a585-11322611-c25c0b15_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:42.049987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:42.050014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:42.050017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:42.050019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:42.050028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896572893184301:12101]
2025-09-30T14:57:42.050033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896572893184301:12101]
2025-09-30T14:57:42.050037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896572893184301:12101]
2025-09-30T14:57:42.050078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:42.050085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.050091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:42.050109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:42.050115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:42.050119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:42.050224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:42.061397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2647 sessionId: src_id|ae3be276-ab97a585-11322611-c25c0b15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:42.064187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:42.105279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896572982976750:11465]
2025-09-30T14:57:42.105759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2646, pipe: [1:7555896572982976750:11465]
2025-09-30T14:57:42.167135Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:42.167435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.167450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.167468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982976750:11465], now have 1 active actors on pipe
2025-09-30T14:57:42.167677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:42.167696Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:42.167730Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:42.167750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2647 reason: error at write: Disconnected sessionId: src_id|ae3be276-ab97a585-11322611-c25c0b15_0
2025-09-30T14:57:42.167934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2647 sessionId: src_id|ae3be276-ab97a585-11322611-c25c0b15_0 is DEAD
2025-09-30T14:57:42.168102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae3be276-ab97a585-11322611-c25c0b15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:42.168109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae3be276-ab97a585-11322611-c25c0b15_0] Write session will restart in 0.008611s
2025-09-30T14:57:42.168135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae3be276-ab97a585-11322611-c25c0b15_0] Write session: Do CDS request
2025-09-30T14:57:42.168141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae3be276-ab97a585-11322611-c25c0b15_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:42.168137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896572982976750:11465]
2025-09-30T14:57:42.168170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:42.177837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae3be276-ab97a585-11322611-c25c0b15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:42.177910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:42.177930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2648
2025-09-30T14:57:42.178094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2648 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:42.178141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2648 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:42.178152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2648 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:42.178157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:42.178637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2648 sessionId:  describe result for acl check
2025-09-30T14:57:42.178675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:42.178682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:42.178684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:42.178691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896572982976793:11731] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:42.179222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896572982976793:11731] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:42.181927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896572982976793:11731] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:42.188011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896572982976793:11731] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:42.188031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896572982976793:11731] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:42.188035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896572982976793:11731] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:42.188043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2648 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:42.189815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:42.192539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:42.192879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:42.192892Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:42.192903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:42.192962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:42.193018Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896572893184591:12117]
2025-09-30T14:57:42.193680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:42.194047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:42.194099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:42.194444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:42.194508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.194515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.194516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.194518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.194519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.194520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.194522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.194523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.194524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.194525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.194527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.194528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.194529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.194530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.194531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.194537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.194549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.194553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.194558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.194562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.194566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.194570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.194574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.194579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.194584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.194588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.194593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.194598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.194602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.194606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.194616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.194624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.194631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.194637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.194643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.194648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.194652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.194659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.194664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.194670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.194676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.194681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.194687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.194692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.194696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.194702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.194708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.194714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.194719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.194724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.194729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.194734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.194739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.194753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.194758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.194763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.194768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.194774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.194779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.194784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.194830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:42.201890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2647
2025-09-30T14:57:42.201894Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2647
2025-09-30T14:57:42.200442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:42.201510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:42.201516Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:42.201518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:42.201522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:42.201529Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2647 [2:7555896572893184591:12117]
2025-09-30T14:57:42.201548Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:42.201563Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:42.201567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:42.201570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:42.201572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:42.201588Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:42.201599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:42.201605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:42.201662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.201665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.201666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.201670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:42.201672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:42.201749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:42.201753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.201767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.201780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.201800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:42.201819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982976765:2454], now have 1 active actors on pipe
2025-09-30T14:57:42.201823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982977004:11731], now have 1 active actors on pipe
2025-09-30T14:57:42.201829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896572893184586:12117]
2025-09-30T14:57:42.201832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896572893184586:12117]
2025-09-30T14:57:42.201834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896572893184586:12117]
2025-09-30T14:57:42.201849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:42.201863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:42.201876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:42.201881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:42.201881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:42.201884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:42.201884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:42.201916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896572893184586:12117]
2025-09-30T14:57:42.201919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:42.201928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:42.201958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.201962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.201989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:42.201995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:42.201999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:42.202001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:42.202010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:42.202019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:42.202032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:42.202188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.202196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.202221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:42.202315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2648 partition: 0 MaxSeqNo: 42 sessionId: src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0
2025-09-30T14:57:42.202676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae3be276-ab97a585-11322611-c25c0b15_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:42.205462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0] Write session: try to update token
2025-09-30T14:57:42.205483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:42.214364Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:42.214392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:42.214395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:42.214397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:42.214408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896572893184586:12117]
2025-09-30T14:57:42.214413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896572893184586:12117]
2025-09-30T14:57:42.214418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896572893184586:12117]
2025-09-30T14:57:42.214461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:42.214469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.214474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:42.214482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:42.214490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:42.214494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:42.214619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:42.222137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2648 sessionId: src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:42.224966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:42.268109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896572982977024:11465]
2025-09-30T14:57:42.269266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2647, pipe: [1:7555896572982977024:11465]
2025-09-30T14:57:42.327773Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:42.328065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.328082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.328102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982977024:11465], now have 1 active actors on pipe
2025-09-30T14:57:42.328331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896572982977024:11465]
2025-09-30T14:57:42.328360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:42.328380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:42.328384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:42.328367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:42.328799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:42.328810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0] Write session will restart in 0.007420s
2025-09-30T14:57:42.328833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0] Write session: Do CDS request
2025-09-30T14:57:42.328474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2648 reason: error at write: Disconnected sessionId: src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0
2025-09-30T14:57:42.328839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:42.328659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2648 sessionId: src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0 is DEAD
2025-09-30T14:57:42.337921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:42.337993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:42.338010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2649
2025-09-30T14:57:42.338173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2649 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:42.338215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2649 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:42.338225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2649 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:42.338229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:42.338678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2649 sessionId:  describe result for acl check
2025-09-30T14:57:42.338721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:42.338725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:42.338727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:42.338732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896572982977065:11737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:42.339280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896572982977065:11737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:42.342275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896572982977065:11737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:42.345838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896572982977065:11737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:42.345854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896572982977065:11737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:42.345858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896572982977065:11737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:42.345865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2649 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:42.348394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:42.350871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:42.351086Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:42.351105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:42.351118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:42.351182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:42.351225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896572893184827:12119]
2025-09-30T14:57:42.351910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:42.352302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:42.352364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:42.352712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:42.352787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.352794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.352796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.352797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.352798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.352799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.352801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.352802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.352803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.352805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.352806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.352807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.352809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.352810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.352811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.352817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.352828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.352833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.352838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.352842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.352846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.352851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.352855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.352859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.352865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.352869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.352873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.352877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.352882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.352885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.352894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.352902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.352909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.352914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.352921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.352927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.352932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.352937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.352942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.352947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.352951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.352955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.352959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.352965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.352976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.352982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.352992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.353010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.353019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.353025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.353037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.353042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.353052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.353058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.353068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.353074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.353079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.353085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.353090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.353095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.353142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:42.358773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:42.359962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:42.359980Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:42.359983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:42.359987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:42.359995Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2648 [2:7555896572893184827:12119]
2025-09-30T14:57:42.360014Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:42.360028Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:42.360030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:42.360033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:42.360034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:42.360048Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:42.360056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:42.360063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:42.360124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.360133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.360135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.360139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:42.360141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:42.360208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:42.360216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.360230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.360243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.360265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:42.360285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982977267:11737], now have 1 active actors on pipe
2025-09-30T14:57:42.360293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982977040:2454], now have 1 active actors on pipe
2025-09-30T14:57:42.360300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896572893184822:12119]
2025-09-30T14:57:42.360303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896572893184822:12119]
2025-09-30T14:57:42.360306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896572893184822:12119]
2025-09-30T14:57:42.360320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:42.360337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:42.360356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:42.360358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:42.360362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:42.360363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:42.360364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:42.360364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2648
2025-09-30T14:57:42.360401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896572893184822:12119]
2025-09-30T14:57:42.360378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2648
2025-09-30T14:57:42.360409Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:42.360411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:42.360427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.360438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.360493Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:42.360505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:42.360509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:42.360512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:42.360523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:42.360532Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:42.360555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:42.360778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.360794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.360819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:42.360919Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2649 partition: 0 MaxSeqNo: 42 sessionId: src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0
2025-09-30T14:57:42.361312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c21aa007-1bc7cfdd-62ab082a-7f797424_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:42.364127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0] Write session: try to update token
2025-09-30T14:57:42.364148Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:42.374947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:42.374972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:42.374975Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:42.374977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:42.374987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896572893184822:12119]
2025-09-30T14:57:42.374992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896572893184822:12119]
2025-09-30T14:57:42.374997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896572893184822:12119]
2025-09-30T14:57:42.375042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:42.375050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.375053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:42.375052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:42.375060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:42.375066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:42.375205Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:42.380908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2649 sessionId: src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:42.383810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:42.428364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896572982977288:11465]
2025-09-30T14:57:42.428865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2648, pipe: [1:7555896572982977288:11465]
2025-09-30T14:57:42.489066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:42.489682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.489707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.489748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982977288:11465], now have 1 active actors on pipe
2025-09-30T14:57:42.489957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:42.489984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896572982977288:11465]
2025-09-30T14:57:42.490018Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:42.490021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:42.490025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:42.490105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2649 reason: error at write: Disconnected sessionId: src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0
2025-09-30T14:57:42.490292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2649 sessionId: src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0 is DEAD
2025-09-30T14:57:42.490443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:42.490453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0] Write session will restart in 0.008466s
2025-09-30T14:57:42.490476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0] Write session: Do CDS request
2025-09-30T14:57:42.490482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:42.500149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:42.500233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:42.500253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2650
2025-09-30T14:57:42.500399Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2650 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:42.500432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2650 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:42.500443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2650 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:42.500447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:42.501079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2650 sessionId:  describe result for acl check
2025-09-30T14:57:42.501119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:42.501125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:42.501128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:42.501133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896572982977337:11741] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:42.501678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896572982977337:11741] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:42.505203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896572982977337:11741] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:42.508846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896572982977337:11741] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:42.508878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896572982977337:11741] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:42.508884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896572982977337:11741] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:42.508893Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2650 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:42.510406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:42.513040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:42.513273Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:42.513284Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:42.513295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:42.513348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:42.513391Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896572893185065:12121]
2025-09-30T14:57:42.514101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:42.514411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:42.514458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:42.514833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:42.514903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.514909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.514911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.514912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.514914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.514915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.514916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.514917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.514919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.514920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.514921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.514922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.514924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.514925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.514926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.514933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.514944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.514949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.514953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.514958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.514962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.514966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.514971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.514974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.514979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.514983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.514988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.514992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.514997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.515001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.515008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.515017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.515023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.515029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.515034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.515039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.515045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.515050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.515056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.515062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.515072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.515079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.515084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.515090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.515095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.515100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.515106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.515112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.515122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.515128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.515141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.515152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.515157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.515168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.515174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.515185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.515189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.515195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.515204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.515212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.515280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:42.520866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:42.521798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:42.521823Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:42.521827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:42.521831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:42.521837Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2649 [2:7555896572893185065:12121]
2025-09-30T14:57:42.521856Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:42.521874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:42.521877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:42.521881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:42.521888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:42.521904Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:42.521917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:42.521924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:42.521995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.522003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.522005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.522009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:42.522012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:42.522226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:42.522238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.522253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.522255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2649
2025-09-30T14:57:42.522271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.522289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:42.522310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982977522:11741], now have 1 active actors on pipe
2025-09-30T14:57:42.522314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982977289:2454], now have 1 active actors on pipe
2025-09-30T14:57:42.522265Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2649
2025-09-30T14:57:42.522322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896572893185060:12121]
2025-09-30T14:57:42.522325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896572893185060:12121]
2025-09-30T14:57:42.522327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896572893185060:12121]
2025-09-30T14:57:42.522340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:42.522356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:42.522372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:42.522377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:42.522381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:42.522385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:42.522387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:42.522435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.522445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.522457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896572893185060:12121]
2025-09-30T14:57:42.522465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:42.522485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:42.522498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:42.522506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:42.522510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:42.522512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:42.522522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:42.522533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:42.522564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:42.522743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.522752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.522777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:42.522870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2650 partition: 0 MaxSeqNo: 42 sessionId: src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0
2025-09-30T14:57:42.523236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|777edf3e-974f9d27-89a5e199-7bd82be6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:42.526017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0] Write session: try to update token
2025-09-30T14:57:42.526038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:42.534923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:42.534944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:42.534946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:42.534948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:42.534959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896572893185060:12121]
2025-09-30T14:57:42.534963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896572893185060:12121]
2025-09-30T14:57:42.534967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896572893185060:12121]
2025-09-30T14:57:42.535009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:42.535023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.535026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:42.535025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:42.535032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:42.535036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:42.535177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:42.540656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2650 sessionId: src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:42.543657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:42.590185Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896572982977537:11465]
2025-09-30T14:57:42.590489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2649, pipe: [1:7555896572982977537:11465]
2025-09-30T14:57:42.649995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:42.650676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.650699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.650750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982977537:11465], now have 1 active actors on pipe
2025-09-30T14:57:42.650993Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:42.651016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:42.651459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:42.651469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0] Write session will restart in 0.007003s
2025-09-30T14:57:42.651027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896572982977537:11465]
2025-09-30T14:57:42.651031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:42.651060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:42.651094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2650 reason: error at write: Disconnected sessionId: src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0
2025-09-30T14:57:42.651288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2650 sessionId: src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0 is DEAD
2025-09-30T14:57:42.651493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0] Write session: Do CDS request
2025-09-30T14:57:42.651502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:42.659776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:42.659920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:42.659939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2651
2025-09-30T14:57:42.660056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2651 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:42.660090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2651 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:42.660110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2651 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:42.660115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:42.660526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2651 sessionId:  describe result for acl check
2025-09-30T14:57:42.660568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:42.660570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:42.660572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:42.660578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896572982977550:11745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:42.661160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896572982977550:11745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:42.663406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896572982977550:11745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:42.669923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896572982977550:11745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:42.669943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896572982977550:11745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:42.669947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896572982977550:11745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:42.669956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2651 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:42.675006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:42.677597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:42.677807Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:42.677817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:42.677828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:42.677890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:42.678136Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896572893185306:12124]
2025-09-30T14:57:42.678770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:42.679120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:42.679164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:42.679521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:42.679587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.679592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.679594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.679596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.679597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.679598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.679599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.679600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.679602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.679603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.679604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.679605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.679607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.679608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.679609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.679615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.679625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.679630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.679634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.679638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.679642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.679647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.679651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.679655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.679661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.679665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.679669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.679673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.679677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.679681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.679689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.679698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.679706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.679712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.679717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.679723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.679727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.679733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.679738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.679744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.679749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.679754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.679759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.679765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.679770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.679776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.679781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.679786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.679791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.679802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.679808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.679818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.679823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.679833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.679841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.679851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.679856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.679861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.679869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.679875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.679923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:42.685375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:42.686304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:42.686320Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:42.686322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:42.686325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:42.686331Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2650 [2:7555896572893185306:12124]
2025-09-30T14:57:42.686345Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:42.686360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:42.686362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:42.686364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:42.686367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:42.686380Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:42.686386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:42.686393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:42.686461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.686463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.686465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.686468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:42.686471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:42.686544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:42.686554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.686566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.686583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.686606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:42.686628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982977538:2454], now have 1 active actors on pipe
2025-09-30T14:57:42.686631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982977680:11745], now have 1 active actors on pipe
2025-09-30T14:57:42.686636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896572893185301:12124]
2025-09-30T14:57:42.686638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896572893185301:12124]
2025-09-30T14:57:42.686639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896572893185301:12124]
2025-09-30T14:57:42.686651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:42.686666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:42.686681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:42.686685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:42.686685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:42.686689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:42.686692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:42.686733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.686744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.686756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896572893185301:12124]
2025-09-30T14:57:42.686767Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:42.686781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:42.686803Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:42.686814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:42.686818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:42.686826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:42.686837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:42.686851Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:42.686875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:42.687034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.687042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.687057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:42.686655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2650
2025-09-30T14:57:42.686677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2650
2025-09-30T14:57:42.687177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2651 partition: 0 MaxSeqNo: 42 sessionId: src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0
2025-09-30T14:57:42.687565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bef60ad5-1df79eb8-6e958b4-af9838c2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:42.690358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0] Write session: try to update token
2025-09-30T14:57:42.690377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:42.699047Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:42.699067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:42.699070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:42.699072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:42.699082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896572893185301:12124]
2025-09-30T14:57:42.699086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896572893185301:12124]
2025-09-30T14:57:42.699091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896572893185301:12124]
2025-09-30T14:57:42.699127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:42.699133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:42.699135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.699137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:42.699138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:42.699141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:42.699300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:42.705046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2651 sessionId: src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:42.707896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:42.751452Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896572982977789:11465]
2025-09-30T14:57:42.751747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2650, pipe: [1:7555896572982977789:11465]
2025-09-30T14:57:42.813384Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:42.813953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.813978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.814037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982977789:11465], now have 1 active actors on pipe
2025-09-30T14:57:42.814271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:42.814356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896572982977789:11465]
2025-09-30T14:57:42.814407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:42.814442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:42.814520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2651 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0
2025-09-30T14:57:42.814679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2651 sessionId: src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0 is DEAD
2025-09-30T14:57:42.814848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:42.814859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0] Write session will restart in 0.009498s
2025-09-30T14:57:42.814881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0] Write session: Do CDS request
2025-09-30T14:57:42.814886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:42.825782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:42.825926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:42.825944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2652
2025-09-30T14:57:42.826077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2652 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:42.826119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2652 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:42.826132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2652 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:42.826136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:42.826680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2652 sessionId:  describe result for acl check
2025-09-30T14:57:42.826715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:42.826722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:42.826724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:42.826732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896572982977893:11750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:42.827304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896572982977893:11750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:42.830365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896572982977893:11750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:42.832294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:42.835005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:42.835150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896572982977893:11750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:42.835165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896572982977893:11750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:42.835167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896572982977893:11750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:42.835173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2652 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:42.835212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:42.835224Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:42.835234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:42.835305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:42.835345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896572893185545:12126]
2025-09-30T14:57:42.836012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:42.836333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:42.836374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:42.836699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:42.836764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.836772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.836774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.836775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.836776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.836777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.836779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.836780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.836782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.836783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.836784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.836786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.836787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.836788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.836790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.836795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.836807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.836811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.836816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.836820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.836825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.836830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.836834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.836837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.836842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.836846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.836850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.836855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.836859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.836864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.836871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.836886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:42.836891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.836896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:42.836902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.836908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:42.836914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.836920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:42.836930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.836936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:42.836942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.836951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:42.836956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.836962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:42.836967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.836973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:42.836982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.836988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:42.837010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.837024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:42.837030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.837036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.837042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.837048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.837053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.837059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.837064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.837069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:42.837074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.837080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:42.837128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:42.842655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:42.844091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:42.844113Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:42.844116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:42.844120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:42.844127Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2651 [2:7555896572893185545:12126]
2025-09-30T14:57:42.844144Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:42.844159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:42.844162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:42.844165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:42.844166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:42.844182Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:42.844188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:42.844194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:42.844255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.844257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.844259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.844262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:42.844264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:42.844331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:42.844339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.844353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:42.844369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:42.844384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:42.844407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982977790:2454], now have 1 active actors on pipe
2025-09-30T14:57:42.844415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982978028:11750], now have 1 active actors on pipe
2025-09-30T14:57:42.844422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896572893185540:12126]
2025-09-30T14:57:42.844424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896572893185540:12126]
2025-09-30T14:57:42.844426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896572893185540:12126]
2025-09-30T14:57:42.844440Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:42.844458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:42.844460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:42.844465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:42.844467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:42.844471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:42.844474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:42.844509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896572893185540:12126]
2025-09-30T14:57:42.844522Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:42.844533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:42.844501Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2651
2025-09-30T14:57:42.844553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2651
2025-09-30T14:57:42.844583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.844593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.844621Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:42.844633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:42.844637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:42.844640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:42.844651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:42.844665Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:42.844687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:42.844837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:42.844848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:42.844861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:42.844931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2652 partition: 0 MaxSeqNo: 42 sessionId: src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0
2025-09-30T14:57:42.845346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8eb053-fe29dbde-3664c2b0-8124f30d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:42.848155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0] Write session: try to update token
2025-09-30T14:57:42.848176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:42.857075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:42.857102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:42.857112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896572893185540:12126]
2025-09-30T14:57:42.857158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:42.857182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:42.857347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:42.857507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:42.857658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:42.857806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:42.858003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:42.858050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:42.869427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:42.869453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:42.869456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:42.869458Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:42.869468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896572893185540:12126]
2025-09-30T14:57:42.869473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896572893185540:12126]
2025-09-30T14:57:42.869478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896572893185540:12126]
2025-09-30T14:57:42.869515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:42.869523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:42.869526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:42.869526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:42.869536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:42.869540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:42.869711Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:42.871326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2652 sessionId: src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:42.874258Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:42.914232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896572982978040:11465]
2025-09-30T14:57:42.914541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2651, pipe: [1:7555896572982978040:11465]
2025-09-30T14:57:43.013367Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:43.013700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.013721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.013744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896572982978040:11465], now have 1 active actors on pipe
2025-09-30T14:57:43.014056Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:43.014051Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:43.014074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:43.014080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:43.014126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896572982978040:11465]
2025-09-30T14:57:43.014148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2652 reason: error at write: Disconnected sessionId: src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0
2025-09-30T14:57:43.014307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2652 sessionId: src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0 is DEAD
2025-09-30T14:57:43.015336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:43.015351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0] Write session will restart in 0.008947s
2025-09-30T14:57:43.015375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0] Write session: Do CDS request
2025-09-30T14:57:43.015384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:43.025829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:43.027566Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:43.027587Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2653
2025-09-30T14:57:43.027885Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2653 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:43.027917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2653 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:43.027921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2653 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:43.027925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:43.029250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2653 sessionId:  describe result for acl check
2025-09-30T14:57:43.029280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:43.029282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:43.029283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:43.029288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896577277945365:11754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:43.029742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896577277945365:11754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:43.038269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896577277945365:11754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:43.042968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896577277945365:11754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:43.042989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896577277945365:11754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:43.042992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896577277945365:11754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:43.043001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2653 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:43.049808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:43.051900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:43.052132Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:43.052143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:43.052153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:43.052209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:43.052250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896577188153086:12129]
2025-09-30T14:57:43.052787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:43.053070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:43.053120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:43.053442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:43.053512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.053518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.053520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.053521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.053522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.053523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.053524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.053525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.053526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.053527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.053528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.053530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.053531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.053532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.053533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.053539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.053549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.053553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.053557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.053562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.053568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.053572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.053576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.053580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.053585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.053589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.053593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.053597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.053601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.053605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.053613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.053621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.053627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.053632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.053636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.053641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.053648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.053653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.053658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.053663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.053667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.053672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.053675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.053679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.053682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.053688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.053692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.053696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.053699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.053703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.053709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.053715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.053719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.053729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.053734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.053739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.053748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.053753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.053758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.053763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.053807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:43.059336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:43.060262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:43.060288Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:43.060295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:43.060299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:43.060307Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2652 [2:7555896577188153086:12129]
2025-09-30T14:57:43.060323Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:43.060340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:43.060348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:43.060352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:43.060355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:43.060370Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:43.060383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:43.060395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:43.060457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.060464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.060466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.060471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:43.060474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:43.060534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:43.060541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.060553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.060569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.060587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:43.060609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277945505:11754], now have 1 active actors on pipe
2025-09-30T14:57:43.060620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277945340:2454], now have 1 active actors on pipe
2025-09-30T14:57:43.060627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896577188153081:12129]
2025-09-30T14:57:43.060628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896577188153081:12129]
2025-09-30T14:57:43.060630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896577188153081:12129]
2025-09-30T14:57:43.060642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:43.060654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:43.060727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2652
2025-09-30T14:57:43.060664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:43.060780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2652
2025-09-30T14:57:43.060670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:43.060680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:43.060683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:43.060685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:43.060700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896577188153081:12129]
2025-09-30T14:57:43.060702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:43.060704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:43.060801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.060809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.060847Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4021297c-db77cbd7-31b10d37-8be041c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:43.060855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:43.060859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:43.060861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:43.060872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:43.060883Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:43.060899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:43.061101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.061115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.061137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:43.061233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2653 partition: 0 MaxSeqNo: 42 sessionId: src_id|4021297c-db77cbd7-31b10d37-8be041c_0
2025-09-30T14:57:43.061603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b03a371-1468f8e2-794ee16c-2fc7c464_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4021297c-db77cbd7-31b10d37-8be041c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:43.064469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4021297c-db77cbd7-31b10d37-8be041c_0] Write session: try to update token
2025-09-30T14:57:43.064491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4021297c-db77cbd7-31b10d37-8be041c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:43.076220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:43.076247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:43.076259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896577188153081:12129]
2025-09-30T14:57:43.076306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:43.076316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:43.076520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:43.076684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:43.076844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:43.077017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:43.077231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:43.077280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:43.085420Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2653 sessionId: src_id|4021297c-db77cbd7-31b10d37-8be041c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:43.088565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:43.088584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:43.088589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:43.088587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:43.088589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:43.088599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896577188153081:12129]
2025-09-30T14:57:43.088603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896577188153081:12129]
2025-09-30T14:57:43.088607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896577188153081:12129]
2025-09-30T14:57:43.088646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:43.088653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.088656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:43.088662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:43.088669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:43.088674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:43.088803Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:43.113965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896577277945597:11465]
2025-09-30T14:57:43.114260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2652, pipe: [1:7555896577277945597:11465]
2025-09-30T14:57:43.203356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:43.204802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.204813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.204833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277945597:11465], now have 1 active actors on pipe
2025-09-30T14:57:43.205489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896577277945597:11465]
2025-09-30T14:57:43.205534Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:43.205547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:43.205603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2653 reason: error at write: Disconnected sessionId: src_id|4021297c-db77cbd7-31b10d37-8be041c_0
2025-09-30T14:57:43.205764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2653 sessionId: src_id|4021297c-db77cbd7-31b10d37-8be041c_0 is DEAD
2025-09-30T14:57:43.205890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:43.206222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4021297c-db77cbd7-31b10d37-8be041c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:43.206232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4021297c-db77cbd7-31b10d37-8be041c_0] Write session will restart in 0.006697s
2025-09-30T14:57:43.206256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4021297c-db77cbd7-31b10d37-8be041c_0] Write session: Do CDS request
2025-09-30T14:57:43.206262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4021297c-db77cbd7-31b10d37-8be041c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:43.205567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:43.214571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4021297c-db77cbd7-31b10d37-8be041c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:43.215718Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:43.215736Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2654
2025-09-30T14:57:43.218724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2654 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:43.218767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2654 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:43.218772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2654 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:43.218776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:43.219657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2654 sessionId:  describe result for acl check
2025-09-30T14:57:43.219696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:43.219698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:43.219700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:43.219706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896577277945636:11767] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:43.220230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896577277945636:11767] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:43.225155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896577277945636:11767] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:43.230158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896577277945636:11767] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:43.230178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896577277945636:11767] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:43.230182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896577277945636:11767] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:43.230190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2654 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:43.237665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:43.240627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:43.240875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:43.240885Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:43.240896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:43.240958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:43.241019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896577188153377:12138]
2025-09-30T14:57:43.241688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:43.242072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:43.242123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:43.242497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:43.242559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.242566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.242568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.242569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.242570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.242571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.242573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.242575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.242576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.242577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.242579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.242580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.242582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.242583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.242584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.242590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.242601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.242605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.242609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.242613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.242618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.242622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.242626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.242630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.242635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.242639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.242644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.242648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.242652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.242656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.242664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.242673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.242679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.242685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.242690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.242695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.242700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.242706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.242710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.242715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.242725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.242730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.242735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.242744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.242749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.242752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.242755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.242759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.242761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.242764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.242768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.242771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.242773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.242777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.242779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.242782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.242785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.242788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.242790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.242793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.242816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:43.249343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:43.251161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2653
2025-09-30T14:57:43.251168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2653
2025-09-30T14:57:43.250400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:43.250421Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:43.250423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:43.250428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:43.250434Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2653 [2:7555896577188153377:12138]
2025-09-30T14:57:43.250450Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:43.250466Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:43.250469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:43.250473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:43.250475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:43.250490Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:43.250498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:43.250505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:43.250566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.250569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.250572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.250575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:43.250578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:43.250647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:43.250650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.250663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.250676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.250694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:43.250710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896577188153372:12138]
2025-09-30T14:57:43.250713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896577188153372:12138]
2025-09-30T14:57:43.250715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896577188153372:12138]
2025-09-30T14:57:43.250730Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:43.250745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:43.250760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:43.250762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:43.250796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896577188153372:12138]
2025-09-30T14:57:43.250799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:43.250895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:43.250899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:43.250902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:43.250910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:43.251291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277945750:11767], now have 1 active actors on pipe
2025-09-30T14:57:43.251298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277945615:2454], now have 1 active actors on pipe
2025-09-30T14:57:43.251508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.251523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.251564Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7f62cea-32e91529-53cd04d-27923f62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:43.251583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:43.251587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:43.251589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:43.251601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:43.251621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:43.251643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:43.252028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.252041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.252074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:43.252182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2654 partition: 0 MaxSeqNo: 42 sessionId: src_id|f7f62cea-32e91529-53cd04d-27923f62_0
2025-09-30T14:57:43.252564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4021297c-db77cbd7-31b10d37-8be041c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f7f62cea-32e91529-53cd04d-27923f62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:43.255521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f62cea-32e91529-53cd04d-27923f62_0] Write session: try to update token
2025-09-30T14:57:43.255544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f62cea-32e91529-53cd04d-27923f62_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:43.264439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:43.264466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:43.264469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:43.264472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:43.264482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896577188153372:12138]
2025-09-30T14:57:43.264486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896577188153372:12138]
2025-09-30T14:57:43.264491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896577188153372:12138]
2025-09-30T14:57:43.264535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:43.264543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.264546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:43.264692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:43.267399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:43.267426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:43.267431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:43.277033Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2654 sessionId: src_id|f7f62cea-32e91529-53cd04d-27923f62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:43.280537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:43.302378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896577277945881:11465]
2025-09-30T14:57:43.302960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2653, pipe: [1:7555896577277945881:11465]
2025-09-30T14:57:43.387341Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:43.387906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.387915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.387934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277945881:11465], now have 1 active actors on pipe
2025-09-30T14:57:43.388160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:43.388880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:43.388901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:43.388926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:43.388959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2654 reason: error at write: Disconnected sessionId: src_id|f7f62cea-32e91529-53cd04d-27923f62_0
2025-09-30T14:57:43.388982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896577277945881:11465]
2025-09-30T14:57:43.389149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2654 sessionId: src_id|f7f62cea-32e91529-53cd04d-27923f62_0 is DEAD
2025-09-30T14:57:43.389320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f62cea-32e91529-53cd04d-27923f62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:43.389329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f62cea-32e91529-53cd04d-27923f62_0] Write session will restart in 0.008055s
2025-09-30T14:57:43.389358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f62cea-32e91529-53cd04d-27923f62_0] Write session: Do CDS request
2025-09-30T14:57:43.389364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f62cea-32e91529-53cd04d-27923f62_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:43.398870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f62cea-32e91529-53cd04d-27923f62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:43.398954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:43.398975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2655
2025-09-30T14:57:43.399148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2655 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:43.399202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2655 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:43.399226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2655 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:43.399232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:43.399763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2655 sessionId:  describe result for acl check
2025-09-30T14:57:43.399812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:43.399815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:43.399817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:43.399824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896577277945953:11773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:43.400454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896577277945953:11773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:43.402942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896577277945953:11773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:43.407778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896577277945953:11773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:43.407797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896577277945953:11773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:43.407800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896577277945953:11773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:43.407810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2655 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:43.410304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:43.414894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:43.415130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:43.415140Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:43.415148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:43.415193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:43.415236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896577188153621:12146]
2025-09-30T14:57:43.415914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:43.416321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:43.416390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:43.417188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:43.417292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.417300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.417301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.417303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.417304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.417305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.417306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.417308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.417309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.417310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.417311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.417312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.417314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.417315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.417316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.417323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.417335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.417339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.417343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.417347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.417352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.417356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.417360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.417364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.417368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.417371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.417376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.417380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.417384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.417388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.417398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.417405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.417412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.417418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.417423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.417428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.417433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.417439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.417443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.417448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.417457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.417463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.417468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.417473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.417478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.417484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.417489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.417494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.417499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.417505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.417521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.417526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.417531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.417537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.417543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.417548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.417552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.417557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.417563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.417569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.417609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:43.423325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:43.424458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:43.424482Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:43.424484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:43.424488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:43.424494Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2654 [2:7555896577188153621:12146]
2025-09-30T14:57:43.424513Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:43.424531Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:43.424534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:43.424537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:43.424539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:43.424556Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:43.424570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:43.424577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:43.424648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.424657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.424659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.424663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:43.424665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:43.424733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:43.424742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.424758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.424775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.424793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:43.424814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896577188153616:12146]
2025-09-30T14:57:43.424820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896577188153616:12146]
2025-09-30T14:57:43.424822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896577188153616:12146]
2025-09-30T14:57:43.424830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:43.424842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:43.424844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:43.424855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:43.424858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:43.424859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:43.424862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:43.424872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277946132:11773], now have 1 active actors on pipe
2025-09-30T14:57:43.424879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277945898:2454], now have 1 active actors on pipe
2025-09-30T14:57:43.424912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896577188153616:12146]
2025-09-30T14:57:43.424928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:43.424951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:43.425321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2654
2025-09-30T14:57:43.425358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2654
2025-09-30T14:57:43.425423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.425440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.425473Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:43.425502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:43.425506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:43.425508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:43.425519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:43.425531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:43.425550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:43.426010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.426022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.426041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:43.426149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2655 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0
2025-09-30T14:57:43.426571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7f62cea-32e91529-53cd04d-27923f62_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:43.429551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0] Write session: try to update token
2025-09-30T14:57:43.429574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:43.444476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:43.444502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:43.444512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896577188153616:12146]
2025-09-30T14:57:43.444563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:43.444581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:43.444758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:43.444922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:43.445088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:43.445240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:43.445457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:43.445509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:43.449583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:43.449602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:43.449605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:43.449607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:43.449616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896577188153616:12146]
2025-09-30T14:57:43.449620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896577188153616:12146]
2025-09-30T14:57:43.449625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896577188153616:12146]
2025-09-30T14:57:43.449661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:43.449667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.449671Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:43.449675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:43.449679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:43.449683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:43.449806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:43.454892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2655 sessionId: src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:43.457619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:43.489189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896577277946150:11465]
2025-09-30T14:57:43.489501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2654, pipe: [1:7555896577277946150:11465]
2025-09-30T14:57:43.570833Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:43.571279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.571296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.571318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277946150:11465], now have 1 active actors on pipe
2025-09-30T14:57:43.571561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:43.571553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:43.571573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:43.571607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896577277946150:11465]
2025-09-30T14:57:43.571629Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:43.571659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2655 reason: error at write: Disconnected sessionId: src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0
2025-09-30T14:57:43.571888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2655 sessionId: src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0 is DEAD
2025-09-30T14:57:43.572156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:43.572166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0] Write session will restart in 0.005476s
2025-09-30T14:57:43.572192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0] Write session: Do CDS request
2025-09-30T14:57:43.572201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:43.578895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:43.578969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:43.578989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2656
2025-09-30T14:57:43.581029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2656 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:43.581087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2656 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:43.581115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2656 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:43.581126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:43.581648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2656 sessionId:  describe result for acl check
2025-09-30T14:57:43.581690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:43.581697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:43.581699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:43.581705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896577277946168:11777] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:43.582293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896577277946168:11777] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:43.585147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896577277946168:11777] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:43.589091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896577277946168:11777] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:43.589111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896577277946168:11777] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:43.589115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896577277946168:11777] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:43.589123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2656 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:43.594024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:43.597787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:43.598051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:43.598063Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:43.598074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:43.598135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:43.598181Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896577188153868:12149]
2025-09-30T14:57:43.598866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:43.599292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:43.599356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:43.599700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:43.599771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.599777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.599778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.599780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.599781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.599782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.599784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.599785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.599786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.599787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.599788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.599789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.599791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.599792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.599793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.599798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.599809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.599812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.599816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.599819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.599822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.599826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.599829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.599833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.599837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.599841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.599844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.599848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.599852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.599856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.599867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.599875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.599882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.599888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.599893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.599898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.599903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.599912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.599916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.599922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.599927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.599933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.599938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.599944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.599949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.599955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.599959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.599965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.599970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.599976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.599983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.599994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.599998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.600003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.600014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.600019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.600029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.600035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.600055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.600067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.600114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:43.605925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:43.607298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:43.607313Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:43.607317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:43.607321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:43.607329Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2655 [2:7555896577188153868:12149]
2025-09-30T14:57:43.607345Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:43.607361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:43.607364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:43.607367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:43.607369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:43.607386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:43.607394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:43.607401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:43.607478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.607486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.607488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.607492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:43.607494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:43.607569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:43.607578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.607593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.607609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.607624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:43.607647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896577188153863:12149]
2025-09-30T14:57:43.607654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896577188153863:12149]
2025-09-30T14:57:43.607656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896577188153863:12149]
2025-09-30T14:57:43.607669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:43.607687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:43.607705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:43.607714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:43.607721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:43.607725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:43.607729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:43.607750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896577188153863:12149]
2025-09-30T14:57:43.607758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:43.607814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:43.607857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277946306:11777], now have 1 active actors on pipe
2025-09-30T14:57:43.607874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277946153:2454], now have 1 active actors on pipe
2025-09-30T14:57:43.608434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2655
2025-09-30T14:57:43.608437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2655
2025-09-30T14:57:43.608601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.608618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.608651Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:43.608660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:43.608675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:43.608679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:43.608693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:43.608706Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:43.608726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:43.608921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.608929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.608942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:43.609078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2656 partition: 0 MaxSeqNo: 42 sessionId: src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0
2025-09-30T14:57:43.609481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ff24fe9-6a35cdfc-98e3d6b0-eb772714_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:43.612277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0] Write session: try to update token
2025-09-30T14:57:43.612298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:43.627376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:43.627399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:43.627410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896577188153863:12149]
2025-09-30T14:57:43.627461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:43.627473Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:43.627658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:43.627811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:43.627963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:43.628115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:43.628317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:43.628362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:43.628477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2656 sessionId: src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:43.631579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:43.632432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.632457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.632476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:43.632479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:43.632481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:43.632483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:43.632492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896577188153863:12149]
2025-09-30T14:57:43.632496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896577188153863:12149]
2025-09-30T14:57:43.632500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896577188153863:12149]
2025-09-30T14:57:43.632543Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:43.632549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:43.632555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:43.632556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.632559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:43.632563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:43.632702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:43.672012Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896577277946406:11465]
2025-09-30T14:57:43.672342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2655, pipe: [1:7555896577277946406:11465]
2025-09-30T14:57:43.745244Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:43.745764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:43.745807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277946406:11465], now have 1 active actors on pipe
2025-09-30T14:57:43.746468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:43.746479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0] Write session will restart in 0.006678s
2025-09-30T14:57:43.746504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0] Write session: Do CDS request
2025-09-30T14:57:43.746510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:43.745929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:43.746025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896577277946406:11465]
2025-09-30T14:57:43.746042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:43.746044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:43.746044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:43.746117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2656 reason: error at write: Disconnected sessionId: src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0
2025-09-30T14:57:43.746296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2656 sessionId: src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0 is DEAD
2025-09-30T14:57:43.755792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:43.755937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:43.755959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2657
2025-09-30T14:57:43.756114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2657 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:43.756162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2657 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:43.756167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2657 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:43.756173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:43.758470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2657 sessionId:  describe result for acl check
2025-09-30T14:57:43.758503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:43.758505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:43.758509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:43.758516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896577277946430:11782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:43.759060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896577277946430:11782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:43.768451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896577277946430:11782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:43.771747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896577277946430:11782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:43.771767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896577277946430:11782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:43.771771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896577277946430:11782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:43.771780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2657 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:43.772422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:43.775191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:43.775424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:43.775440Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:43.775453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:43.775513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:43.775550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896577188154114:12151]
2025-09-30T14:57:43.776237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:43.776629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:43.776685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:43.777055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:43.777123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.777130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.777132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.777133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.777135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.777136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.777137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.777139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.777140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.777141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.777142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.777144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.777145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.777147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.777148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.777154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.777165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.777169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.777173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.777178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.777181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.777185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.777189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.777193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.777198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.777202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.777206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.777210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.777213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.777217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.777225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.777233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.777239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.777245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.777250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.777256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.777260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.777266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.777271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.777277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.777282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.777288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.777294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.777306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.777310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.777315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.777325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.777329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.777334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.777344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.777349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.777360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.777364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.777372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.777381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.777388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.777398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.777403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.777409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.777414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.777468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:43.783031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:43.784428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:43.784450Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:43.784453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:43.784456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:43.784463Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2656 [2:7555896577188154114:12151]
2025-09-30T14:57:43.784479Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:43.784496Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:43.784499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:43.784502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:43.784504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:43.784521Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:43.784528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:43.784535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:43.784597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.784607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.784609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.784613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:43.784616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:43.784685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:43.784694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.784707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.784733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.784755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:43.784770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896577188154109:12151]
2025-09-30T14:57:43.784773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896577188154109:12151]
2025-09-30T14:57:43.784775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896577188154109:12151]
2025-09-30T14:57:43.784783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:43.784799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:43.784817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:43.784824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:43.784836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:43.784847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:43.784849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:43.784859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896577188154109:12151]
2025-09-30T14:57:43.784872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:43.784886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:43.784887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277946410:2454], now have 1 active actors on pipe
2025-09-30T14:57:43.784892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277946653:11782], now have 1 active actors on pipe
2025-09-30T14:57:43.784949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2656
2025-09-30T14:57:43.785019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2656
2025-09-30T14:57:43.785084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.785101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.785133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:43.785147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:43.785156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:43.785158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:43.785169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:43.785180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:43.785200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:43.785508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.785523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.785544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:43.785643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2657 partition: 0 MaxSeqNo: 42 sessionId: src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0
2025-09-30T14:57:43.786002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b32547d-ad9668fc-50668e3-f3a6bfe3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:43.788779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0] Write session: try to update token
2025-09-30T14:57:43.788800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:43.797228Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:43.797256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:43.797268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896577188154109:12151]
2025-09-30T14:57:43.797315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:43.797313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:43.797497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:43.797656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:43.797809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:43.797968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:43.798171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:43.798219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:43.805419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2657 sessionId: src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:43.808101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:43.808701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.808732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.808753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:43.808756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:43.808759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:43.808761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:43.808771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896577188154109:12151]
2025-09-30T14:57:43.808775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896577188154109:12151]
2025-09-30T14:57:43.808783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896577188154109:12151]
2025-09-30T14:57:43.808833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:43.808832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:43.808838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:43.808842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:43.808847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.808850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:43.809010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:43.846099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896577277946665:11465]
2025-09-30T14:57:43.846392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2656, pipe: [1:7555896577277946665:11465]
2025-09-30T14:57:43.933070Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:43.933574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:43.933624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277946665:11465], now have 1 active actors on pipe
2025-09-30T14:57:43.933782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:43.933893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:43.933901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:43.933979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2657 reason: error at write: Disconnected sessionId: src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0
2025-09-30T14:57:43.934117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2657 sessionId: src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0 is DEAD
2025-09-30T14:57:43.934248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:43.934269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0] Write session will restart in 0.006014s
2025-09-30T14:57:43.934293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0] Write session: Do CDS request
2025-09-30T14:57:43.934298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:43.934287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896577277946665:11465]
2025-09-30T14:57:43.934307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:43.941897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:43.942044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:43.942066Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2658
2025-09-30T14:57:43.942204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2658 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:43.942238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2658 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:43.942244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2658 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:43.942248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:43.942815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2658 sessionId:  describe result for acl check
2025-09-30T14:57:43.942853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:43.942856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:43.942857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:43.942863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896577277946683:11786] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:43.943453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896577277946683:11786] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:43.948036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896577277946683:11786] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:43.957023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896577277946683:11786] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:43.957044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896577277946683:11786] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:43.957047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896577277946683:11786] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:43.957057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2658 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:43.959115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:43.961835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:43.962067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:43.962082Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:43.962094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:43.962160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:43.962228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896577188154361:12153]
2025-09-30T14:57:43.962922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:43.963293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:43.963363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:43.963715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:43.963809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.963817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.963818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.963819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.963821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.963822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.963824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.963825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.963826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.963828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.963829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.963831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.963832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.963834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.963835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.963842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.963853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.963859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.963862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.963866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.963871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.963875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.963880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.963885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.963890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.963894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.963899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.963903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.963907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.963911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.963920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.963928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:43.963946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.963952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:43.963957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.963963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:43.963969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.963975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:43.963980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.963987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:43.963992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.963997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:43.964003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.964009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:43.964014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.964021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:43.964026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.964032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:43.964037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.964043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:43.964048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.964054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.964058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.964064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.964068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.964074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.964079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.964087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:43.964093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.964099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:43.964148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:43.970010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:43.970914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:43.970939Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:43.970943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:43.970947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:43.970953Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2657 [2:7555896577188154361:12153]
2025-09-30T14:57:43.970970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:43.970987Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:43.970990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:43.970994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:43.970997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:43.971012Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:43.971029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:43.971037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:43.971106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.971116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.971118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.971122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:43.971125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:43.971610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:43.971627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.971642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:43.971657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:43.971681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:43.971709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277946908:11786], now have 1 active actors on pipe
2025-09-30T14:57:43.971718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896577277946668:2454], now have 1 active actors on pipe
2025-09-30T14:57:43.971739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.971749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.971770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896577188154356:12153]
2025-09-30T14:57:43.971777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896577188154356:12153]
2025-09-30T14:57:43.971779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896577188154356:12153]
2025-09-30T14:57:43.971793Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:43.971812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:43.971816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:43.971824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:43.971826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:43.971834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:43.971836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:43.971853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc82f67c-748854d0-babba5f0-4daaa940_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:43.971860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:43.971865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:43.971868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:43.971878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:43.971894Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:43.971942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896577188154356:12153]
2025-09-30T14:57:43.971961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:43.971980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:43.972030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:43.972244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:43.972256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:43.972273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:43.972845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4488308b-61b2ce6c-d77ba0c1-450e611a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bc82f67c-748854d0-babba5f0-4daaa940_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:43.971389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2657
2025-09-30T14:57:43.971428Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2657
2025-09-30T14:57:43.972424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2658 partition: 0 MaxSeqNo: 42 sessionId: src_id|bc82f67c-748854d0-babba5f0-4daaa940_0
2025-09-30T14:57:43.975588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc82f67c-748854d0-babba5f0-4daaa940_0] Write session: try to update token
2025-09-30T14:57:43.975606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc82f67c-748854d0-babba5f0-4daaa940_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:43.984766Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:43.984793Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:43.984797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:43.984799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:43.984809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896577188154356:12153]
2025-09-30T14:57:43.984814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896577188154356:12153]
2025-09-30T14:57:43.984819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896577188154356:12153]
2025-09-30T14:57:43.984863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:43.984872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:43.984883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:43.984897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:43.984925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:43.984929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:43.985050Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:43.990830Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2658 sessionId: src_id|bc82f67c-748854d0-babba5f0-4daaa940_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:43.993825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:44.035508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896581572914219:11465]
2025-09-30T14:57:44.035934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2657, pipe: [1:7555896581572914219:11465]
2025-09-30T14:57:44.104853Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:44.105430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.105454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.105493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572914219:11465], now have 1 active actors on pipe
2025-09-30T14:57:44.107655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:44.107675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:44.107691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:44.107695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:44.107747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896581572914219:11465]
2025-09-30T14:57:44.107763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2658 reason: error at write: Disconnected sessionId: src_id|bc82f67c-748854d0-babba5f0-4daaa940_0
2025-09-30T14:57:44.108128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc82f67c-748854d0-babba5f0-4daaa940_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:44.108137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc82f67c-748854d0-babba5f0-4daaa940_0] Write session will restart in 0.006928s
2025-09-30T14:57:44.108161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc82f67c-748854d0-babba5f0-4daaa940_0] Write session: Do CDS request
2025-09-30T14:57:44.108167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc82f67c-748854d0-babba5f0-4daaa940_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:44.107972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2658 sessionId: src_id|bc82f67c-748854d0-babba5f0-4daaa940_0 is DEAD
2025-09-30T14:57:44.116820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc82f67c-748854d0-babba5f0-4daaa940_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:44.118984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:44.119004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2659
2025-09-30T14:57:44.119154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2659 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:44.119184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2659 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:44.119189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2659 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:44.119195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:44.123686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2659 sessionId:  describe result for acl check
2025-09-30T14:57:44.123735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:44.123737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:44.123739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:44.123745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896581572914338:11790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:44.124330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896581572914338:11790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:44.131039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896581572914338:11790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:44.135034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896581572914338:11790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:44.135055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896581572914338:11790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:44.135059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896581572914338:11790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:44.135067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2659 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:44.135108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:44.139725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:44.139961Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:44.139977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:44.139992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:44.140050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:44.140122Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896581483121919:12156]
2025-09-30T14:57:44.140740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:44.142219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:44.142273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:44.142572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:44.142637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.142646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.142647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.142647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.142648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.142649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.142650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.142651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.142652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.142653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.142654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.142655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.142655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.142656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.142657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.142662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.142669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.142671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.142674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.142676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.142679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.142681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.142683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.142686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.142688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.142691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.142693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.142696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.142698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.142700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.142706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.142712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.142715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.142718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.142721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.142724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.142727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.142730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.142747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.142753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.142758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.142763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.142768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.142773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.142779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.142804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.142810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.142816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.142821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.142826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.142833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.142839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.142844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.142849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.142854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.142859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.142864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.142869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.142873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.142878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.142920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:44.149438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:44.150339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:44.150345Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:44.150348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:44.150353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:44.150361Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2658 [2:7555896581483121919:12156]
2025-09-30T14:57:44.150378Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:44.150396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:44.150400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:44.150404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:44.150406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:44.150424Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:44.150431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:44.150438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:44.150506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.150508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.150510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.150514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:44.150517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:44.150585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:44.150588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.150600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.150610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.150625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:44.150641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896581483121912:12156]
2025-09-30T14:57:44.150643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896581483121912:12156]
2025-09-30T14:57:44.150645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896581483121912:12156]
2025-09-30T14:57:44.150663Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:44.150680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:44.150692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:44.150694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:44.150697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:44.150698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:44.150700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:44.150735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896581483121912:12156]
2025-09-30T14:57:44.150738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:44.150788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:44.150894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572914465:11790], now have 1 active actors on pipe
2025-09-30T14:57:44.150901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572914221:2454], now have 1 active actors on pipe
2025-09-30T14:57:44.150967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2658
2025-09-30T14:57:44.150978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2658
2025-09-30T14:57:44.151310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.151332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.151361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:44.151378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:44.151381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:44.151384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:44.151397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:44.151415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:44.151431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:44.151629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.151642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.151657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:44.151774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2659 partition: 0 MaxSeqNo: 42 sessionId: src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0
2025-09-30T14:57:44.152162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc82f67c-748854d0-babba5f0-4daaa940_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:44.155033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0] Write session: try to update token
2025-09-30T14:57:44.155055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:44.164109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:44.164142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:44.164147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:44.164150Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:44.164160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896581483121912:12156]
2025-09-30T14:57:44.164166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896581483121912:12156]
2025-09-30T14:57:44.164173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896581483121912:12156]
2025-09-30T14:57:44.164230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:44.164232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:44.164237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:44.164241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:44.164253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.164257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:44.164531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:44.170130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2659 sessionId: src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:44.172931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:44.207578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896581572914480:11465]
2025-09-30T14:57:44.207788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2658, pipe: [1:7555896581572914480:11465]
2025-09-30T14:57:44.278505Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:44.278925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.278942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.278960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572914480:11465], now have 1 active actors on pipe
2025-09-30T14:57:44.279155Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:44.279217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:44.279235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:44.279314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2659 reason: error at write: Disconnected sessionId: src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0
2025-09-30T14:57:44.279494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2659 sessionId: src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0 is DEAD
2025-09-30T14:57:44.279551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:44.279602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896581572914480:11465]
2025-09-30T14:57:44.280376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:44.280389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0] Write session will restart in 0.009782s
2025-09-30T14:57:44.280414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0] Write session: Do CDS request
2025-09-30T14:57:44.280424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:44.291775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:44.291846Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:44.291868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2660
2025-09-30T14:57:44.291986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2660 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:44.292019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2660 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:44.292029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2660 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:44.292033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:44.292472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2660 sessionId:  describe result for acl check
2025-09-30T14:57:44.292514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:44.292516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:44.292518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:44.292524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896581572914614:11802] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:44.293059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896581572914614:11802] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:44.295626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896581572914614:11802] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:44.298378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:44.298823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896581572914614:11802] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:44.298844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896581572914614:11802] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:44.298848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896581572914614:11802] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:44.298856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2660 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:44.301440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:44.301648Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:44.301660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:44.301671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:44.301738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:44.301781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896581483122204:12171]
2025-09-30T14:57:44.302517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:44.302828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:44.302888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:44.303219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:44.303303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.303310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.303311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.303312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.303313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.303315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.303316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.303317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.303318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.303319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.303320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.303321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.303322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.303323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.303324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.303329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.303340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.303344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.303347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.303351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.303355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.303359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.303362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.303366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.303370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.303374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.303377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.303381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.303385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.303388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.303397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.303405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.303411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.303417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.303421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.303426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.303430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.303435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.303440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.303444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.303448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.303453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.303458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.303463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.303467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.303472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.303476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.303481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.303486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.303491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.303496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.303501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.303505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.303510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.303514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.303519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.303529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.303533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.303539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.303548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.303588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:44.309011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:44.310001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:44.310020Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:44.310022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:44.310026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:44.310032Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2659 [2:7555896581483122204:12171]
2025-09-30T14:57:44.310049Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:44.310064Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:44.310067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:44.310070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:44.310072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:44.310087Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:44.310099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:44.310106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:44.310173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.310180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.310182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.310185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:44.310188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:44.310251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:44.310259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.310271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.310287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.310302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:44.310320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572914512:2454], now have 1 active actors on pipe
2025-09-30T14:57:44.310329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572914755:11802], now have 1 active actors on pipe
2025-09-30T14:57:44.310335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896581483122198:12171]
2025-09-30T14:57:44.310337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896581483122198:12171]
2025-09-30T14:57:44.310340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896581483122198:12171]
2025-09-30T14:57:44.310353Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:44.310367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:44.310380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:44.310389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:44.310387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2659
2025-09-30T14:57:44.310425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896581483122198:12171]
2025-09-30T14:57:44.310396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2659
2025-09-30T14:57:44.310430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:44.310435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:44.310440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:44.310442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:44.310449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:44.310822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.310834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.310858Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:44.310873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:44.310876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:44.310883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:44.310894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:44.310905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:44.310924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:44.311095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.311104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.311116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:44.311195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2660 partition: 0 MaxSeqNo: 42 sessionId: src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0
2025-09-30T14:57:44.311594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4deb8e71-d7f77ad1-1957fddd-7a341cb7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:44.314528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0] Write session: try to update token
2025-09-30T14:57:44.314549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:44.325065Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:44.325086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:44.325088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:44.325091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:44.325100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896581483122198:12171]
2025-09-30T14:57:44.325105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896581483122198:12171]
2025-09-30T14:57:44.325109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896581483122198:12171]
2025-09-30T14:57:44.325147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:44.325146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:44.325150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:44.325153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:44.325156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.325159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:44.325296Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:44.329093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2660 sessionId: src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:44.331736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:44.379626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896581572914781:11465]
2025-09-30T14:57:44.379943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2659, pipe: [1:7555896581572914781:11465]
2025-09-30T14:57:44.438887Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:44.439398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.439415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.439455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572914781:11465], now have 1 active actors on pipe
2025-09-30T14:57:44.439679Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:44.439714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:44.439723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:44.439728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:44.439780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896581572914781:11465]
2025-09-30T14:57:44.439790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2660 reason: error at write: Disconnected sessionId: src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0
2025-09-30T14:57:44.439952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2660 sessionId: src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0 is DEAD
2025-09-30T14:57:44.440102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:44.440115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0] Write session will restart in 0.005205s
2025-09-30T14:57:44.440137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0] Write session: Do CDS request
2025-09-30T14:57:44.440142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:44.446789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:44.447046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:44.447072Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2661
2025-09-30T14:57:44.447267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2661 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:44.447308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2661 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:44.447319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2661 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:44.447324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:44.447898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2661 sessionId:  describe result for acl check
2025-09-30T14:57:44.447954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:44.447963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:44.447966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:44.447974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896581572914799:11807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:44.448695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896581572914799:11807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:44.452964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896581572914799:11807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:44.456545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896581572914799:11807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:44.456570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896581572914799:11807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:44.456576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896581572914799:11807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:44.456586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2661 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:44.460412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:44.463036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:44.463298Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:44.463310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:44.463321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:44.463385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:44.463429Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896581483122454:12173]
2025-09-30T14:57:44.464035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:44.464411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:44.464471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:44.464818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:44.464911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.464922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.464923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.464924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.464926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.464927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.464928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.464930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.464931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.464932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.464933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.464934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.464936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.464937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.464938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.464944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.464955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.464959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.464963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.464967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.464970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.464974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.464977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.464981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.464984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.464999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.465003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.465007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.465011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.465015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.465024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.465033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.465039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.465045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.465050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.465056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.465060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.465066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.465071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.465077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.465081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.465087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.465092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.465098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.465103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.465107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.465113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.465119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.465129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.465134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.465139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.465145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.465149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.465155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.465160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.465166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.465175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.465181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.465191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.465197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.465243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:44.470752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:44.471669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:44.471698Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:44.471702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:44.471706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:44.471713Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2660 [2:7555896581483122454:12173]
2025-09-30T14:57:44.471730Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:44.471746Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:44.471749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:44.471752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:44.471755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:44.471772Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:44.471778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:44.471785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:44.471848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.471861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.471863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.471867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:44.471870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:44.471936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:44.471946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.471959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.471972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.471996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:44.472020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572914984:11807], now have 1 active actors on pipe
2025-09-30T14:57:44.472030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572914784:2454], now have 1 active actors on pipe
2025-09-30T14:57:44.472037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896581483122449:12173]
2025-09-30T14:57:44.472040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896581483122449:12173]
2025-09-30T14:57:44.472042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896581483122449:12173]
2025-09-30T14:57:44.472056Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:44.472074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:44.472077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:44.472089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:44.472093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:44.472095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:44.472098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:44.472125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896581483122449:12173]
2025-09-30T14:57:44.472133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:44.472100Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2660
2025-09-30T14:57:44.472142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:44.472160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.472134Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2660
2025-09-30T14:57:44.472170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.472205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:44.472216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:44.472221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:44.472229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:44.472239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:44.472252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:44.472274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:44.472414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.472427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.472440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:44.472503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2661 partition: 0 MaxSeqNo: 42 sessionId: src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0
2025-09-30T14:57:44.472850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|679d8922-b203854a-f1ac1ce9-5569cbbd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:44.475707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0] Write session: try to update token
2025-09-30T14:57:44.475725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:44.484301Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:44.484322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:44.484324Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:44.484327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:44.484335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896581483122449:12173]
2025-09-30T14:57:44.484340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896581483122449:12173]
2025-09-30T14:57:44.484345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896581483122449:12173]
2025-09-30T14:57:44.484388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:44.484396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.484399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:44.484400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:44.484407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:44.484412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:44.484547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:44.490441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2661 sessionId: src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:44.493018Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:44.539820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896581572915042:11465]
2025-09-30T14:57:44.540131Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2660, pipe: [1:7555896581572915042:11465]
2025-09-30T14:57:44.598590Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:44.599281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.599301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.599356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572915042:11465], now have 1 active actors on pipe
2025-09-30T14:57:44.599575Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:44.599604Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896581572915042:11465]
2025-09-30T14:57:44.599608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:44.599612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:44.599645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:44.599669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2661 reason: error at write: Disconnected sessionId: src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0
2025-09-30T14:57:44.599837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2661 sessionId: src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0 is DEAD
2025-09-30T14:57:44.600026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:44.600039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0] Write session will restart in 0.007508s
2025-09-30T14:57:44.600064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0] Write session: Do CDS request
2025-09-30T14:57:44.600073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:44.608836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:44.608949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:44.608979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2662
2025-09-30T14:57:44.609109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2662 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:44.609143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2662 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:44.609149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2662 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:44.609158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:44.609752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2662 sessionId:  describe result for acl check
2025-09-30T14:57:44.609793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:44.609797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:44.609799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:44.609805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896581572915083:11811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:44.610363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896581572915083:11811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:44.613823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896581572915083:11811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:44.617402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896581572915083:11811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:44.617422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896581572915083:11811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:44.617425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896581572915083:11811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:44.617435Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2662 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:44.620026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:44.623181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:44.623560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:44.623573Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:44.623584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:44.623649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:44.623691Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896581483122708:12176]
2025-09-30T14:57:44.624368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:44.624724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:44.624784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:44.625209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:44.625283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.625290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.625291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.625292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.625293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.625294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.625295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.625297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.625298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.625299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.625301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.625302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.625303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.625304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.625306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.625311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.625321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.625325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.625328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.625333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.625336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.625340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.625344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.625347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.625352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.625356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.625359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.625363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.625367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.625370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.625380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.625388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.625395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.625400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.625405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.625412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.625415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.625420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.625425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.625430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.625433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.625438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.625442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.625447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.625451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.625456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.625461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.625466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.625470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.625474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.625479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.625483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.625488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.625493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.625497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.625501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.625505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.625510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.625515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.625519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.625559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:44.631117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:44.632396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:44.632417Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:44.632420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:44.632424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:44.632431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2661 [2:7555896581483122708:12176]
2025-09-30T14:57:44.632447Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:44.632462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:44.632465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:44.632468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:44.632470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:44.632488Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:44.632495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:44.632501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:44.632559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.632561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.632565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.632569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:44.632571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:44.632644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:44.632646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.632658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.632669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.632684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:44.632702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572915265:11811], now have 1 active actors on pipe
2025-09-30T14:57:44.632709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572915044:2454], now have 1 active actors on pipe
2025-09-30T14:57:44.632715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896581483122702:12176]
2025-09-30T14:57:44.632717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896581483122702:12176]
2025-09-30T14:57:44.632718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896581483122702:12176]
2025-09-30T14:57:44.632731Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:44.632743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:44.632748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:44.632752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:44.632754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:44.632757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:44.632761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:44.632792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896581483122702:12176]
2025-09-30T14:57:44.632799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:44.632804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:44.635351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2661
2025-09-30T14:57:44.635407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2661
2025-09-30T14:57:44.639351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.639375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.639417Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:44.639430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:44.639434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:44.639437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:44.639449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:44.639464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:44.639482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:44.641628Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:57:44.643125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.643151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.643203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:44.643383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2662 partition: 0 MaxSeqNo: 42 sessionId: src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0
2025-09-30T14:57:44.643748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c751e44-521f7afd-b5c99fd9-70671fd7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:44.646575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0] Write session: try to update token
2025-09-30T14:57:44.646592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:44.647204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:44.647228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:44.647237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896581483122702:12176]
2025-09-30T14:57:44.647304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:44.647487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:44.647643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:44.647796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:44.647863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:44.647940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:44.648138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:44.648179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:44.658331Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:44.658353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:44.658356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:44.658358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:44.658368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896581483122702:12176]
2025-09-30T14:57:44.658372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896581483122702:12176]
2025-09-30T14:57:44.658376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896581483122702:12176]
2025-09-30T14:57:44.658418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:44.658431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.658432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:44.658436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:44.658447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:44.658451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:44.658580Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:44.661800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2662 sessionId: src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:44.664603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:44.699605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896581572915302:11465]
2025-09-30T14:57:44.703505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2661, pipe: [1:7555896581572915302:11465]
2025-09-30T14:57:44.772924Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:44.773426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.773441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.773461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572915302:11465], now have 1 active actors on pipe
2025-09-30T14:57:44.773914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:44.774073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:44.774124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:44.774195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2662 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0
2025-09-30T14:57:44.774381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2662 sessionId: src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0 is DEAD
2025-09-30T14:57:44.774610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:44.774620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0] Write session will restart in 0.005552s
2025-09-30T14:57:44.774615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896581572915302:11465]
2025-09-30T14:57:44.774643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0] Write session: Do CDS request
2025-09-30T14:57:44.774650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:44.781765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:44.781965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:44.781984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2663
2025-09-30T14:57:44.782153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2663 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:44.782188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2663 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:44.782199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2663 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:44.782207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:44.782663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2663 sessionId:  describe result for acl check
2025-09-30T14:57:44.782716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:44.782723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:44.782725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:44.782732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896581572915331:11816] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:44.783285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896581572915331:11816] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:44.787614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896581572915331:11816] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:44.792888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896581572915331:11816] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:44.792907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896581572915331:11816] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:44.792910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896581572915331:11816] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:44.792919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2663 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:44.797434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:44.798179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:44.798384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:44.798395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:44.798405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:44.798456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:44.798498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896581483122960:12178]
2025-09-30T14:57:44.799159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:44.800442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:44.800494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:44.800868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:44.800929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.800936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.800937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.800938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.800939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.800940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.800941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.800943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.800944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.800945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.800947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.800948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.800949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.800950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.800952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.800958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.800968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.800972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.800976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.800980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.800984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.801002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.801007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.801010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.801014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.801019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.801023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.801028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.801032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.801036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.801044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.801053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.801060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.801065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.801070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.801076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.801080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.801086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.801090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.801095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.801100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.801105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.801110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.801115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.801121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.801126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.801131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.801138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.801142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.801147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.801151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.801156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.801160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.801164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.801168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.801172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.801177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.801182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.801187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.801192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.801238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:44.806647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:44.807980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:44.808002Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:44.808004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:44.808008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:44.808014Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2662 [2:7555896581483122960:12178]
2025-09-30T14:57:44.808031Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:44.808047Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:44.808056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:44.808058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:44.808061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:44.808076Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:44.808086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:44.808093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:44.808155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.808164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.808166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.808169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:44.808171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:44.808241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:44.808248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.808260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.808270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.808289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:44.808312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572915516:11816], now have 1 active actors on pipe
2025-09-30T14:57:44.808320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572915306:2454], now have 1 active actors on pipe
2025-09-30T14:57:44.808326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896581483122955:12178]
2025-09-30T14:57:44.808328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896581483122955:12178]
2025-09-30T14:57:44.808330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896581483122955:12178]
2025-09-30T14:57:44.808345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:44.808355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:44.808358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:44.808364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:44.808366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:44.808372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:44.808375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:44.808403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896581483122955:12178]
2025-09-30T14:57:44.808416Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:44.808435Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:44.808401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2662
2025-09-30T14:57:44.808408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2662
2025-09-30T14:57:44.808515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.808524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.808550Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:44.808561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:44.808564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:44.808566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:44.808575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:44.808588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:44.808606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:44.808753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.808761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.808775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:44.808861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2663 partition: 0 MaxSeqNo: 42 sessionId: src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0
2025-09-30T14:57:44.809257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7cfe5f5-88ef377a-3f163cb-76c7166e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:44.812248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0] Write session: try to update token
2025-09-30T14:57:44.812267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:44.820591Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:44.820615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:44.820625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896581483122955:12178]
2025-09-30T14:57:44.820671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:44.820857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:44.821025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:44.821172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:44.821321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:44.821627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:44.821665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:44.821980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:44.827074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2663 sessionId: src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:44.829990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:44.830251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.830291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.830329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:44.830445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:44.833162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:44.833184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:44.833187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:44.833189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:44.833199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896581483122955:12178]
2025-09-30T14:57:44.833203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896581483122955:12178]
2025-09-30T14:57:44.833208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896581483122955:12178]
2025-09-30T14:57:44.833254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:44.833260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.833263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:44.833402Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:44.838847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:44.838887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:44.838892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:44.874472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896581572915567:11465]
2025-09-30T14:57:44.874783Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2662, pipe: [1:7555896581572915567:11465]
2025-09-30T14:57:44.955207Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:44.963859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:44.963888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:44.964073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:44.964142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:44.964213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:44.964288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:44.964525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:44.964536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:44.964615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:44.964678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:44.964751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:44.964821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:44.964870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:44.964878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:44.964944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:44.965019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:44.965091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:44.965158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:44.965207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:44.965215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:44.965291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:44.965361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:44.965438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:44.965515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:44.965571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:44.965582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:44.965656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:44.965721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:44.965789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:44.965864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:44.965914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:44.965916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:44.965993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:44.966059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:44.966131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:44.966197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:44.966243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:44.966246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:44.966327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:44.966389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:44.966459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:44.966532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:44.966584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:44.966587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:44.966661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:44.966726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:44.966798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:44.966870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:44.966917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:44.966920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:44.966996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:44.967058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:44.967130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:44.967199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:44.967405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:44.967417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:44.967496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:44.967563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:44.967633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:44.967703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:44.967743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:44.967746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:44.967815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572915567:11465], now have 1 active actors on pipe
2025-09-30T14:57:44.968602Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:44.968882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:44.968903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:44.968930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2663 reason: error at write: Disconnected sessionId: src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0
2025-09-30T14:57:44.969133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2663 sessionId: src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0 is DEAD
2025-09-30T14:57:44.969283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896581572915567:11465]
2025-09-30T14:57:44.969296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:44.971445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:44.971456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0] Write session will restart in 0.007311s
2025-09-30T14:57:44.971480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0] Write session: Do CDS request
2025-09-30T14:57:44.971486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:44.979780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:44.979888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:44.979908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2664
2025-09-30T14:57:44.980048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2664 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:44.980075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2664 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:44.980081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2664 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:44.980086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:44.980513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2664 sessionId:  describe result for acl check
2025-09-30T14:57:44.980546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:44.980548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:44.980550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:44.980556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896581572915587:11820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:44.981105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896581572915587:11820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:44.984816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896581572915587:11820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:44.989618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896581572915587:11820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:44.989638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896581572915587:11820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:44.989642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896581572915587:11820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:44.989651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2664 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:44.993928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:44.997235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:44.997527Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:44.997538Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:44.997551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:44.997611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:44.997656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896581483123213:12180]
2025-09-30T14:57:44.998344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:44.998710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:44.998751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:44.999163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:44.999224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.999225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.999226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.999228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.999229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.999230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.999232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.999233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.999235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.999236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.999238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.999239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.999240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.999258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.999259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.999265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.999275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.999278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.999283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.999286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.999289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.999293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.999296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.999300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.999306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.999310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.999313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.999317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.999321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.999325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.999335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.999344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:44.999350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.999357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:44.999362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.999367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:44.999371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.999375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:44.999385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.999391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:44.999396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.999401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:44.999406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.999411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:44.999416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.999422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:44.999427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.999434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:44.999439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.999445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:44.999450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.999455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:44.999460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.999465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:44.999471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.999476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:44.999481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.999486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:44.999491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.999496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:44.999534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:45.005808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:45.007171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:45.007191Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:45.007194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:45.007199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:45.007209Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2663 [2:7555896581483123213:12180]
2025-09-30T14:57:45.007226Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:45.007262Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:45.007269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:45.007274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:45.007276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:45.007294Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:45.007301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:45.007309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:45.007374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.007383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.007385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.007389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:45.007392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:45.007460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:45.007469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.007483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.007501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.007524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:45.007545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572915574:2454], now have 1 active actors on pipe
2025-09-30T14:57:45.007549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896581572915761:11820], now have 1 active actors on pipe
2025-09-30T14:57:45.007555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896581483123208:12180]
2025-09-30T14:57:45.007557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896581483123208:12180]
2025-09-30T14:57:45.007560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896581483123208:12180]
2025-09-30T14:57:45.007574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:45.007587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:45.007607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:45.007611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:45.007648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896581483123208:12180]
2025-09-30T14:57:45.007650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:45.007675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2663
2025-09-30T14:57:45.007714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2663
2025-09-30T14:57:45.007715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:45.007729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:45.007732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:45.007739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:45.007867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.007885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.007913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|32360065-e23f6597-33978136-265e9767_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:45.007926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:45.007930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:45.007933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:45.007944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:45.007962Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:45.007982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:45.008190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.008200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.008214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:45.008360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2664 partition: 0 MaxSeqNo: 42 sessionId: src_id|32360065-e23f6597-33978136-265e9767_0
2025-09-30T14:57:45.008762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|163b71dd-7c009ba3-da36ca6-6e166a9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|32360065-e23f6597-33978136-265e9767_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:45.011786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32360065-e23f6597-33978136-265e9767_0] Write session: try to update token
2025-09-30T14:57:45.011809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32360065-e23f6597-33978136-265e9767_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:45.025194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:45.025218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:45.025228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896581483123208:12180]
2025-09-30T14:57:45.025274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:45.025274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:45.025461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:45.025617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:45.025759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:45.025901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:45.026093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:45.026127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:45.030642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2664 sessionId: src_id|32360065-e23f6597-33978136-265e9767_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:45.033524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:45.033776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.033816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.033858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:45.033969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:45.037777Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:45.037801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:45.037804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:45.037806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:45.037816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896581483123208:12180]
2025-09-30T14:57:45.037821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896581483123208:12180]
2025-09-30T14:57:45.037826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896581483123208:12180]
2025-09-30T14:57:45.037865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:45.037873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.037876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:45.037882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:45.037893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:45.037897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:45.038021Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:45.069790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896585867883126:11465]
2025-09-30T14:57:45.070141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2663, pipe: [1:7555896585867883126:11465]
2025-09-30T14:57:45.152008Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:45.162145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.162181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.162376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:45.162446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:45.162521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:45.162591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:45.162637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:45.162645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:45.162714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:45.162781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:45.162857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:45.162924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:45.162977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:45.162985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:45.163063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:45.163127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:45.163192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:45.163278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:45.163324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:45.163342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:45.163420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:45.163488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:45.163572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:45.163642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:45.163698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:45.163706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:45.163783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:45.163854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:45.163933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:45.164029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:45.164087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:45.164097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:45.164180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:45.164254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:45.164330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:45.164405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:45.164465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:45.164475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:45.164553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:45.164628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:45.164706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:45.164787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:45.164838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:45.164849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:45.164929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:45.165022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:45.165098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:45.165170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:45.165220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:45.165233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:45.165308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:45.165376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:45.165446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:45.165521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:45.165568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:45.165577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:45.165653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:45.165723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:45.165797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:45.165869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:45.165919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:45.165929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:45.166007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867883126:11465], now have 1 active actors on pipe
2025-09-30T14:57:45.166317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:45.166321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896585867883126:11465]
2025-09-30T14:57:45.166335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:45.166342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:45.166368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2664 reason: error at write: Disconnected sessionId: src_id|32360065-e23f6597-33978136-265e9767_0
2025-09-30T14:57:45.166635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2664 sessionId: src_id|32360065-e23f6597-33978136-265e9767_0 is DEAD
2025-09-30T14:57:45.167413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:45.167430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32360065-e23f6597-33978136-265e9767_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:45.167470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32360065-e23f6597-33978136-265e9767_0] Write session will restart in 0.006861s
2025-09-30T14:57:45.167498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32360065-e23f6597-33978136-265e9767_0] Write session: Do CDS request
2025-09-30T14:57:45.167504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32360065-e23f6597-33978136-265e9767_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:45.175837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|32360065-e23f6597-33978136-265e9767_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:45.175926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:45.175946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2665
2025-09-30T14:57:45.176125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2665 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:45.176159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2665 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:45.176165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2665 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:45.176170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:45.176645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2665 sessionId:  describe result for acl check
2025-09-30T14:57:45.176682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:45.176700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:45.176707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:45.176714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896585867883160:11824] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:45.177297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896585867883160:11824] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:45.180848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896585867883160:11824] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:45.184976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896585867883160:11824] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:45.185017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896585867883160:11824] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:45.185020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896585867883160:11824] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:45.185028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2665 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:45.190037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:45.192835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:45.193067Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:45.193080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:45.193092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:45.193147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:45.193193Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896585778090777:12184]
2025-09-30T14:57:45.193857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:45.194196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:45.194240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:45.194565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:45.194698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.194706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.194707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.194709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.194710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.194712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.194713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.194714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.194715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.194717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.194718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.194720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.194721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.194722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.194724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.194730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.194742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.194747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.194752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.194757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.194761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.194766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.194770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.194774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.194779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.194784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.194788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.194793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.194797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.194802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.194811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.194821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.194830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.194837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.194842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.194848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.194852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.194859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.194864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.194869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.194874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.194887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.194892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.194898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.194905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.194911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.194922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.194927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.194932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.194938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.194946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.194951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.194956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.194962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.194968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.194973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.194983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.194989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.194994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.195004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.195051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:45.201132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:45.202067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:45.202084Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:45.202088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:45.202092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:45.202100Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2664 [2:7555896585778090777:12184]
2025-09-30T14:57:45.202121Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:45.202139Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:45.202142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:45.202145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:45.202148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:45.202164Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:45.202176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:45.202183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:45.202247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.202255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.202257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.202261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:45.202264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:45.202333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:45.202342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.202353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.202363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.202382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:45.202406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867883128:2454], now have 1 active actors on pipe
2025-09-30T14:57:45.202420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896585778090772:12184]
2025-09-30T14:57:45.202422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896585778090772:12184]
2025-09-30T14:57:45.202424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896585778090772:12184]
2025-09-30T14:57:45.202433Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:45.202444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867883329:11824], now have 1 active actors on pipe
2025-09-30T14:57:45.202444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:45.202448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:45.202450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:45.202451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:45.202467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:45.202470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:45.202505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896585778090772:12184]
2025-09-30T14:57:45.202520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:45.202535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:45.202633Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2664
2025-09-30T14:57:45.202770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2664
2025-09-30T14:57:45.203071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.203088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.203115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:45.203124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:45.203128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:45.203131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:45.203141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:45.203153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:45.203167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:45.204126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.204141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.204161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:45.204305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2665 partition: 0 MaxSeqNo: 42 sessionId: src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0
2025-09-30T14:57:45.204688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|32360065-e23f6597-33978136-265e9767_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:45.207725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0] Write session: try to update token
2025-09-30T14:57:45.207970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:45.216075Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:45.216104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:45.216106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:45.216108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:45.216118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896585778090772:12184]
2025-09-30T14:57:45.216123Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896585778090772:12184]
2025-09-30T14:57:45.216128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896585778090772:12184]
2025-09-30T14:57:45.216175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:45.216184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.216183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:45.216187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:45.216188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:45.216191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:45.216335Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:45.228945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2665 sessionId: src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:45.231723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:45.266406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896585867883398:11465]
2025-09-30T14:57:45.266842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2664, pipe: [1:7555896585867883398:11465]
2025-09-30T14:57:45.331770Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:45.332315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.332332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.332354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867883398:11465], now have 1 active actors on pipe
2025-09-30T14:57:45.332581Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:45.333121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:45.333133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0] Write session will restart in 0.005881s
2025-09-30T14:57:45.333161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0] Write session: Do CDS request
2025-09-30T14:57:45.333167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:45.332619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:45.332640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:45.332705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2665 reason: error at write: Disconnected sessionId: src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0
2025-09-30T14:57:45.332890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2665 sessionId: src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0 is DEAD
2025-09-30T14:57:45.333114Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:45.333280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896585867883398:11465]
2025-09-30T14:57:45.341967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:45.344253Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:45.344273Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2666
2025-09-30T14:57:45.344775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2666 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:45.344814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2666 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:45.344819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2666 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:45.344823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:45.345292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2666 sessionId:  describe result for acl check
2025-09-30T14:57:45.345343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:45.345350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:45.345352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:45.345361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896585867883455:11837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:45.345930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896585867883455:11837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:45.348366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896585867883455:11837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:45.353064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896585867883455:11837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:45.353084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896585867883455:11837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:45.353090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896585867883455:11837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:45.353110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2666 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:45.358329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:45.361586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:45.361834Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:45.361844Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:45.361855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:45.361913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:45.361958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896585778091068:12198]
2025-09-30T14:57:45.362660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:45.363046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:45.363111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:45.363501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:45.363583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.363590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.363591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.363593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.363594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.363596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.363597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.363599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.363600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.363601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.363602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.363603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.363605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.363606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.363607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.363613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.363624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.363628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.363631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.363635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.363639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.363643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.363647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.363651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.363655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.363659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.363662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.363666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.363670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.363674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.363682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.363691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.363697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.363704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.363709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.363715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.363720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.363726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.363732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.363737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.363742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.363748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.363753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.363758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.363764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.363768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.363780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.363786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.363795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.363800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.363805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.363813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.363816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.363822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.363832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.363838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.363843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.363853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.363858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.363868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.363915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:45.369910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:45.371238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:45.371269Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:45.371272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:45.371277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:45.371284Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2665 [2:7555896585778091068:12198]
2025-09-30T14:57:45.371766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2665
2025-09-30T14:57:45.371303Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:45.371782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2665
2025-09-30T14:57:45.371322Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:45.371325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:45.371328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:45.371330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:45.371349Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:45.371356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:45.371363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:45.371440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.371443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.371445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.371449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:45.371451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:45.371528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:45.371531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.371544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.371557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.371574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:45.371591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896585778091063:12198]
2025-09-30T14:57:45.371594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896585778091063:12198]
2025-09-30T14:57:45.371597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896585778091063:12198]
2025-09-30T14:57:45.371607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:45.371621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:45.371632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:45.371636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:45.371637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:45.371638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:45.371640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:45.371652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867883590:11837], now have 1 active actors on pipe
2025-09-30T14:57:45.371657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867883427:2454], now have 1 active actors on pipe
2025-09-30T14:57:45.371693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896585778091063:12198]
2025-09-30T14:57:45.371703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:45.371710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:45.371883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.371889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.371918Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:45.371926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:45.371931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:45.371934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:45.371945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:45.371957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:45.371975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:45.372135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.372148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.372163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:45.372274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2666 partition: 0 MaxSeqNo: 42 sessionId: src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0
2025-09-30T14:57:45.372690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a5e10c-b227781e-94a626ad-5bfb5d65_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:45.375797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0] Write session: try to update token
2025-09-30T14:57:45.375823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:45.384490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:45.384515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:45.384518Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:45.384521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:45.384534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896585778091063:12198]
2025-09-30T14:57:45.384539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896585778091063:12198]
2025-09-30T14:57:45.384543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896585778091063:12198]
2025-09-30T14:57:45.384582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:45.384589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.384591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:45.384610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:45.384635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:45.384642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:45.384741Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:45.391569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2666 sessionId: src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:45.394453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:45.433314Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896585867883700:11465]
2025-09-30T14:57:45.433584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2665, pipe: [1:7555896585867883700:11465]
2025-09-30T14:57:45.499154Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:45.499630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.499648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.499692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867883700:11465], now have 1 active actors on pipe
2025-09-30T14:57:45.499941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:45.499911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:45.499929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:45.499929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896585867883700:11465]
2025-09-30T14:57:45.499949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:45.500350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:45.500365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0] Write session will restart in 0.006461s
2025-09-30T14:57:45.500384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0] Write session: Do CDS request
2025-09-30T14:57:45.500388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:45.499996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2666 reason: error at write: Disconnected sessionId: src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0
2025-09-30T14:57:45.500186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2666 sessionId: src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0 is DEAD
2025-09-30T14:57:45.507755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:45.507842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:45.507867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2667
2025-09-30T14:57:45.507985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2667 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:45.508019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2667 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:45.508029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2667 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:45.508034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:45.508503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2667 sessionId:  describe result for acl check
2025-09-30T14:57:45.508540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:45.508547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:45.508549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:45.508555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896585867883728:11841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:45.509088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896585867883728:11841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:45.512334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896585867883728:11841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:45.515778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896585867883728:11841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:45.515812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896585867883728:11841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:45.515815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896585867883728:11841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:45.515891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2667 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:45.518168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:45.521031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:45.521367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:45.521384Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:45.521398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:45.521475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:45.521520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896585778091324:12200]
2025-09-30T14:57:45.522177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:45.522542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:45.522596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:45.522949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:45.523039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.523047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.523049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.523050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.523051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.523053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.523055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.523057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.523058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.523059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.523061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.523062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.523063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.523064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.523065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.523072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.523083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.523088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.523092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.523097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.523101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.523106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.523110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.523114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.523118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.523122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.523127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.523131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.523135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.523138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.523150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.523157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.523164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.523169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.523174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.523179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.523184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.523189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.523194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.523200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.523205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.523210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.523215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.523220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.523224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.523229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.523237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.523260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.523265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.523277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.523283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.523293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.523299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.523310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.523315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.523320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.523329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.523335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.523340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.523345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.523390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:45.529073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:45.530327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:45.530346Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:45.530350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:45.530354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:45.530361Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2666 [2:7555896585778091324:12200]
2025-09-30T14:57:45.530378Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:45.530394Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:45.530403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:45.530406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:45.530409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:45.530426Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:45.530439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:45.530452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:45.530516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.530524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.530526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.530531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:45.530533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:45.530604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:45.530617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.530633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.530647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.530665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:45.530688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867883929:11841], now have 1 active actors on pipe
2025-09-30T14:57:45.530697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867883702:2454], now have 1 active actors on pipe
2025-09-30T14:57:45.530704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896585778091319:12200]
2025-09-30T14:57:45.530709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896585778091319:12200]
2025-09-30T14:57:45.530712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896585778091319:12200]
2025-09-30T14:57:45.530725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:45.530737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:45.530744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:45.530748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:45.530751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:45.530763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:45.530766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:45.530799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896585778091319:12200]
2025-09-30T14:57:45.530809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:45.530788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2666
2025-09-30T14:57:45.530789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2666
2025-09-30T14:57:45.530845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:45.530846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.530851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.530884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:45.530897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:45.530901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:45.530909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:45.530919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:45.530933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:45.530952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:45.531130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.531162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.531193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:45.531325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2667 partition: 0 MaxSeqNo: 42 sessionId: src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0
2025-09-30T14:57:45.531711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90c9a046-e51f9dba-897f17e3-6a08a53c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:45.534503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0] Write session: try to update token
2025-09-30T14:57:45.534521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:45.543169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:45.543193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:45.543195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:45.543198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:45.543213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896585778091319:12200]
2025-09-30T14:57:45.543217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896585778091319:12200]
2025-09-30T14:57:45.543221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896585778091319:12200]
2025-09-30T14:57:45.543282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:45.543289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.543289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:45.543295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:45.543296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:45.543301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:45.543485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:45.550485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2667 sessionId: src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:45.553404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:45.600198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896585867883967:11465]
2025-09-30T14:57:45.600489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2666, pipe: [1:7555896585867883967:11465]
2025-09-30T14:57:45.660014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:45.660585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.660617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.660638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867883967:11465], now have 1 active actors on pipe
2025-09-30T14:57:45.660858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:45.660893Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896585867883967:11465]
2025-09-30T14:57:45.660900Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:45.660929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:45.661024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2667 reason: status is not ok: tablet will be restarted right now sessionId: src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0
2025-09-30T14:57:45.661211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2667 sessionId: src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0 is DEAD
2025-09-30T14:57:45.661352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:45.661363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0] Write session will restart in 0.008456s
2025-09-30T14:57:45.661390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0] Write session: Do CDS request
2025-09-30T14:57:45.661396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:45.670830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:45.670946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:45.670963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2668
2025-09-30T14:57:45.671097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2668 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:45.671141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2668 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:45.671150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2668 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:45.671154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:45.671614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2668 sessionId:  describe result for acl check
2025-09-30T14:57:45.671658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:45.671661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:45.671663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:45.671669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896585867884001:11845] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:45.672233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896585867884001:11845] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:45.674933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896585867884001:11845] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:45.678300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896585867884001:11845] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:45.678324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896585867884001:11845] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:45.678328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896585867884001:11845] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:45.678336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2668 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:45.681548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:45.684471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:45.684670Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:45.684680Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:45.684691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:45.684737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:45.684780Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896585778091583:12203]
2025-09-30T14:57:45.685465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:45.685805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:45.685859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:45.686136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:45.686193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.686200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.686201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.686202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.686203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.686203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.686204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.686205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.686206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.686207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.686208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.686208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.686209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.686210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.686210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.686215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.686222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.686225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.686227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.686230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.686232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.686235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.686237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.686240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.686243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.686245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.686247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.686249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.686252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.686265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.686274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.686283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.686289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.686294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.686297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.686300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.686302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.686305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.686309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.686312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.686314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.686317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.686320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.686323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.686325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.686329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.686331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.686336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.686339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.686342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.686345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.686347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.686350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.686353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.686356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.686358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.686361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.686364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.686366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.686369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.686399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:45.692067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:45.692999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:45.693019Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:45.693022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:45.693026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:45.693034Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2667 [2:7555896585778091583:12203]
2025-09-30T14:57:45.693052Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:45.693075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:45.693084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:45.693087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:45.693090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:45.693106Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:45.693118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:45.693126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:45.693187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.693202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.693210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.693214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:45.693217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:45.693289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:45.693297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.693311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.693329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.693355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:45.693379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867884174:11845], now have 1 active actors on pipe
2025-09-30T14:57:45.693388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867883968:2454], now have 1 active actors on pipe
2025-09-30T14:57:45.693395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896585778091578:12203]
2025-09-30T14:57:45.693402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896585778091578:12203]
2025-09-30T14:57:45.693406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896585778091578:12203]
2025-09-30T14:57:45.693429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:45.693443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:45.693451Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:45.693463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:45.693464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:45.693434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2667
2025-09-30T14:57:45.693467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:45.693440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2667
2025-09-30T14:57:45.693467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:45.693503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896585778091578:12203]
2025-09-30T14:57:45.693512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:45.693514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:45.693528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.693541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.693591Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:45.693603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:45.693609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:45.693611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:45.693621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:45.693637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:45.694088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:45.694360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.694370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.694387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:45.694455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2668 partition: 0 MaxSeqNo: 42 sessionId: src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0
2025-09-30T14:57:45.694797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81a259a2-eafd2924-5f9f78c7-7620cf7e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:45.697611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0] Write session: try to update token
2025-09-30T14:57:45.697629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:45.705906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:45.705932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:45.705934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:45.705937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:45.705946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896585778091578:12203]
2025-09-30T14:57:45.705951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896585778091578:12203]
2025-09-30T14:57:45.705955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896585778091578:12203]
2025-09-30T14:57:45.705994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:45.705998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:45.706001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.706003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:45.706005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:45.706008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:45.706153Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:45.712099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2668 sessionId: src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:45.715002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:45.760921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896585867884236:11465]
2025-09-30T14:57:45.761253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2667, pipe: [1:7555896585867884236:11465]
2025-09-30T14:57:45.821098Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:45.821422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.821440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.821481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867884236:11465], now have 1 active actors on pipe
2025-09-30T14:57:45.821703Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:45.822039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:45.822143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2668 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0
2025-09-30T14:57:45.822232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896585867884236:11465]
2025-09-30T14:57:45.822272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:45.822339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2668 sessionId: src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0 is DEAD
2025-09-30T14:57:45.822634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:45.822645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0] Write session will restart in 0.005466s
2025-09-30T14:57:45.822668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0] Write session: Do CDS request
2025-09-30T14:57:45.822674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:45.829765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:45.829884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:45.829908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2669
2025-09-30T14:57:45.830058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2669 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:45.830094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2669 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:45.830104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2669 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:45.830109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:45.830568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2669 sessionId:  describe result for acl check
2025-09-30T14:57:45.830616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:45.830624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:45.830626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:45.830633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896585867884255:11850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:45.831228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896585867884255:11850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:45.834561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896585867884255:11850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:45.842121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896585867884255:11850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:45.842145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896585867884255:11850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:45.842149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896585867884255:11850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:45.842158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2669 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:45.846077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:45.849044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:45.849278Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:45.849291Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:45.849304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:45.849371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:45.849411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896585778091841:12205]
2025-09-30T14:57:45.850111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:45.850456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:45.850509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:45.850855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:45.850923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.850930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.850931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.850932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.850933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.850935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.850936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.850937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.850938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.850939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.850941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.850941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.850942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.850943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.850944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.850949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.850959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.850962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.850966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.850969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.850972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.850976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.850979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.850982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.850986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.850989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.850993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.850996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.850999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.851002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.851011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.851018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:45.851023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.851028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:45.851032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.851037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:45.851040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.851045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:45.851049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.851053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:45.851057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.851061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:45.851065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.851069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:45.851073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.851077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:45.851081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.851086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:45.851090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.851094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:45.851099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.851104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.851108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.851112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.851115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.851120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.851123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.851127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:45.851131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.851135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:45.851172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:45.860954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:45.861893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:45.861910Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:45.861913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:45.861918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:45.861926Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2668 [2:7555896585778091841:12205]
2025-09-30T14:57:45.861943Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:45.861960Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:45.861964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:45.861968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:45.861970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:45.861988Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:45.862002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:45.862014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:45.862072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.862079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.862081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.862085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:45.862088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:45.862172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:45.862180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.862192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:45.862210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:45.862228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:45.862256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867884488:11850], now have 1 active actors on pipe
2025-09-30T14:57:45.862265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867884237:2454], now have 1 active actors on pipe
2025-09-30T14:57:45.862271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896585778091836:12205]
2025-09-30T14:57:45.862278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896585778091836:12205]
2025-09-30T14:57:45.862281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896585778091836:12205]
2025-09-30T14:57:45.862293Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:45.862306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:45.862317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:45.862320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:45.862323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:45.862330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:45.862317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2668
2025-09-30T14:57:45.862332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:45.862358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896585778091836:12205]
2025-09-30T14:57:45.862365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:45.862372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:45.862422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2668
2025-09-30T14:57:45.862508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.862519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.862544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4351229f-66f31068-615f26c8-81e53198_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:45.862555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:45.862560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:45.862562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:45.862574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:45.862588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:45.862606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:45.862769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.862777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.862790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:45.862879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2669 partition: 0 MaxSeqNo: 42 sessionId: src_id|4351229f-66f31068-615f26c8-81e53198_0
2025-09-30T14:57:45.863228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f9f81ab-9e0baba3-c6029cf0-8b93dbbf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4351229f-66f31068-615f26c8-81e53198_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:45.866036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4351229f-66f31068-615f26c8-81e53198_0] Write session: try to update token
2025-09-30T14:57:45.866056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4351229f-66f31068-615f26c8-81e53198_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:45.874924Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:45.874946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:45.874956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896585778091836:12205]
2025-09-30T14:57:45.875002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:45.875310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:45.875553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:45.875771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:45.875983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:45.876315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:45.876365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:45.876379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:45.881248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2669 sessionId: src_id|4351229f-66f31068-615f26c8-81e53198_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:45.883954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:45.884341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:45.884364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:45.885499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:45.885528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:45.885530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:45.885532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:45.885533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:45.885541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896585778091836:12205]
2025-09-30T14:57:45.885544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896585778091836:12205]
2025-09-30T14:57:45.885547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896585778091836:12205]
2025-09-30T14:57:45.885573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:45.885578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:45.885580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:45.885586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:45.885592Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:45.885595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:45.885654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:45.885696Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:45.922247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896585867884504:11465]
2025-09-30T14:57:45.922577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2668, pipe: [1:7555896585867884504:11465]
2025-09-30T14:57:46.003784Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:46.012655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.012690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.012872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.012934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.013013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.013074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.013118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.013124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.013194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.013253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.013312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.013378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.013747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.013752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.013821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.013880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.013941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.014002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.014043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.014046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.014116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.014192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.014260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.014324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.014365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.014368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.014440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.014500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.014563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.014627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.014670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.014677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.014748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.014807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.014872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.014933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.014976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.014979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.015048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.015108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.015173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.015236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.017391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896585867884504:11465]
2025-09-30T14:57:46.017440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:46.017444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:46.017475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2669 reason: error at write: Disconnected sessionId: src_id|4351229f-66f31068-615f26c8-81e53198_0
2025-09-30T14:57:46.017660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2669 sessionId: src_id|4351229f-66f31068-615f26c8-81e53198_0 is DEAD
2025-09-30T14:57:46.017823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4351229f-66f31068-615f26c8-81e53198_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:46.017849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4351229f-66f31068-615f26c8-81e53198_0] Write session will restart in 0.009513s
2025-09-30T14:57:46.017872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4351229f-66f31068-615f26c8-81e53198_0] Write session: Do CDS request
2025-09-30T14:57:46.017877Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4351229f-66f31068-615f26c8-81e53198_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:46.015520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.015537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.015614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.015675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.015737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.015804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.015847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.015850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.015922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.015983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.016046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.016110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.016154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.016158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.016229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.016290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.016357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.016420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.016466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.016470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.016599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896585867884504:11465], now have 1 active actors on pipe
2025-09-30T14:57:46.017664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:46.018150Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:46.028761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4351229f-66f31068-615f26c8-81e53198_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:46.028864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:46.028881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2670
2025-09-30T14:57:46.029041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2670 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:46.029074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2670 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:46.029084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2670 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:46.029088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:46.029511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2670 sessionId:  describe result for acl check
2025-09-30T14:57:46.029545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:46.029551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:46.029553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:46.029559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896590162851873:11854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:46.030081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896590162851873:11854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:46.032523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896590162851873:11854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:46.040106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896590162851873:11854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:46.040130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896590162851873:11854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:46.040133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896590162851873:11854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:46.040142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2670 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:46.043461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:46.046907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:46.047148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:46.047160Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:46.047172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:46.047228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:46.047290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896590073059399:12207]
2025-09-30T14:57:46.047909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:46.048299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:46.048376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:46.048761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:46.048878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.048888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.048890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.048891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.048892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.048894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.048896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.048897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.048898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.048900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.048901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.048903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.048904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.048906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.048907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.048914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.048926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.048931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.048935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.048939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.048943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.048948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.048952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.048956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.048960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.048964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.048968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.048972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.048977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.048993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.049003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.049012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.049018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.049025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.049030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.049036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.049040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.049046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.049051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.049057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.049062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.049067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.049073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.049078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.049083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.049089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.049094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.049100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.049106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.049112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.049119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.049125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.049137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.049142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.049147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.049157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.049161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.049168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.049178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.049184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.049257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:46.054780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:46.055651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:46.055674Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:46.055677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:46.055681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:46.055688Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2669 [2:7555896590073059399:12207]
2025-09-30T14:57:46.055705Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:46.055721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:46.055724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:46.055728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:46.055730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:46.055751Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:46.055758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:46.055765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:46.055831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.055844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.055847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.055851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:46.055853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:46.055920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:46.055928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.055939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.055954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.055971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:46.055995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896590073059392:12207]
2025-09-30T14:57:46.055998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896590073059392:12207]
2025-09-30T14:57:46.056012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896590073059392:12207]
2025-09-30T14:57:46.056025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:46.056107Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2669
2025-09-30T14:57:46.056110Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2669
2025-09-30T14:57:46.056038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:46.056040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162851804:2454], now have 1 active actors on pipe
2025-09-30T14:57:46.056044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162852055:11854], now have 1 active actors on pipe
2025-09-30T14:57:46.056050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:46.056052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:46.056052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:46.056069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:46.056073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:46.056104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896590073059392:12207]
2025-09-30T14:57:46.056113Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:46.056148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:46.056248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.056260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.056287Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:46.056305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:46.056309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:46.056312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:46.056322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:46.056332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:46.056345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:46.056655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.056673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.056709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:46.056803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2670 partition: 0 MaxSeqNo: 42 sessionId: src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0
2025-09-30T14:57:46.057185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4351229f-66f31068-615f26c8-81e53198_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:46.059868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0] Write session: try to update token
2025-09-30T14:57:46.059886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:46.068003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:46.068031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:46.068041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896590073059392:12207]
2025-09-30T14:57:46.068087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:46.068088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:46.068268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:46.068413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:46.068556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:46.068696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:46.068898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:46.068945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:46.074586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2670 sessionId: src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:46.077458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:46.078000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.078027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.079296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:46.079334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:46.079337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:46.079339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:46.079341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:46.079352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896590073059392:12207]
2025-09-30T14:57:46.079356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896590073059392:12207]
2025-09-30T14:57:46.079360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896590073059392:12207]
2025-09-30T14:57:46.079388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:46.079391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:46.079398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.079400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:46.079402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:46.079407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:46.079427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:46.079538Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:46.117661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896590162852069:11465]
2025-09-30T14:57:46.117919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2669, pipe: [1:7555896590162852069:11465]
2025-09-30T14:57:46.194076Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:46.202519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.202554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.202726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.202797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.202866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.202928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.202974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.202982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.203049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.203117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.203192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.203279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.203326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.203335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.203401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.203458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.203520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.203583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.203626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.203632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.203698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.203766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.203827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.203888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.203941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.203948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.204015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.204077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.204142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.204216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.204261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.204267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.204332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.204413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.204486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.204546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.204589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.204594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.204658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.204715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.204775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.204846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.204908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.204914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.204977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.205053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.205112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.205184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.205228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.205236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.205303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.205375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.205433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.205494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.205537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.205542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.205606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:46.205665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:46.205726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:46.205796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:46.205845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:46.205853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:46.206039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162852069:11465], now have 1 active actors on pipe
2025-09-30T14:57:46.206292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:46.206324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896590162852069:11465]
2025-09-30T14:57:46.206351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:46.206365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:46.206406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2670 reason: error at write: Disconnected sessionId: src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0
2025-09-30T14:57:46.206582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2670 sessionId: src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0 is DEAD
2025-09-30T14:57:46.206768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:46.206777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0] Write session will restart in 0.009349s
2025-09-30T14:57:46.206811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0] Write session: Do CDS request
2025-09-30T14:57:46.206816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:46.207231Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:46.217754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:46.217855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:46.217877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2671
2025-09-30T14:57:46.218015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2671 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:46.218071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2671 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:46.218081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2671 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:46.218085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:46.218638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2671 sessionId:  describe result for acl check
2025-09-30T14:57:46.218678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:46.218682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:46.218684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:46.218691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896590162852120:11859] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:46.219267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896590162852120:11859] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:46.223572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896590162852120:11859] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:46.230485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896590162852120:11859] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:46.230506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896590162852120:11859] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:46.230511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896590162852120:11859] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:46.230521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2671 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:46.233214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:46.236097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:46.236331Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:46.236341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:46.236351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:46.236410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:46.236464Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896590073059672:12211]
2025-09-30T14:57:46.237170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:46.237533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:46.237579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:46.237931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:46.237991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.237997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.237999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.238000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.238001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.238003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.238004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.238005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.238007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.238009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.238011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.238012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.238013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.238014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.238016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.238021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.238032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.238036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.238041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.238045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.238049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.238053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.238057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.238061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.238066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.238070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.238074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.238078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.238082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.238086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.238095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.238103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.238109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.238115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.238119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.238125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.238130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.238135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.238140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.238145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.238150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.238155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.238160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.238165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.238169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.238175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.238180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.238185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.238198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.238203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.238208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.238214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.238220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.238226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.238230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.238235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.238240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.238245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.238255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.238260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.238303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:46.243891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:46.245121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:46.245148Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:46.245151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:46.245155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:46.245161Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2670 [2:7555896590073059672:12211]
2025-09-30T14:57:46.245177Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:46.245193Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:46.245196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:46.245199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:46.245201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:46.245217Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:46.245225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:46.245239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:46.245305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.245314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.245316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.245319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:46.245322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:46.245391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:46.245400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.245413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.245430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.245450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:46.245473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162852327:11859], now have 1 active actors on pipe
2025-09-30T14:57:46.245477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162852071:2454], now have 1 active actors on pipe
2025-09-30T14:57:46.245492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896590073059667:12211]
2025-09-30T14:57:46.245499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896590073059667:12211]
2025-09-30T14:57:46.245502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896590073059667:12211]
2025-09-30T14:57:46.245516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:46.245528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:46.245530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:46.245540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:46.245543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:46.245546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:46.245550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:46.245580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896590073059667:12211]
2025-09-30T14:57:46.245596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:46.245554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2670
2025-09-30T14:57:46.245583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2670
2025-09-30T14:57:46.245629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:46.245754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.245767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.245794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:46.245817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:46.245823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:46.245826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:46.245836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:46.245847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:46.245862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:46.246051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.246064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.246086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:46.246219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2671 partition: 0 MaxSeqNo: 42 sessionId: src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0
2025-09-30T14:57:46.246689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c81178be-fc0ded03-60351fcb-1aec50a8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:46.249583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0] Write session: try to update token
2025-09-30T14:57:46.249607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:46.258534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:46.258562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:46.258564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:46.258566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:46.258579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896590073059667:12211]
2025-09-30T14:57:46.258584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896590073059667:12211]
2025-09-30T14:57:46.258588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896590073059667:12211]
2025-09-30T14:57:46.258633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:46.258640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.258642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:46.258647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:46.258658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:46.258662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:46.258783Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:46.265778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2671 sessionId: src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:46.268492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:46.306242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896590162852345:11465]
2025-09-30T14:57:46.306534Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2670, pipe: [1:7555896590162852345:11465]
2025-09-30T14:57:46.377395Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:46.378133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:46.378138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:46.378143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:46.378189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896590162852345:11465]
2025-09-30T14:57:46.378209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2671 reason: error at write: Disconnected sessionId: src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0
2025-09-30T14:57:46.378387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2671 sessionId: src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0 is DEAD
2025-09-30T14:57:46.377910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.377931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.377965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162852345:11465], now have 1 active actors on pipe
2025-09-30T14:57:46.378129Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:46.378541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:46.378564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0] Write session will restart in 0.009648s
2025-09-30T14:57:46.378588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0] Write session: Do CDS request
2025-09-30T14:57:46.378594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:46.389779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:46.389853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:46.389875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2672
2025-09-30T14:57:46.389985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2672 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:46.390015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2672 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:46.390033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2672 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:46.390038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:46.390570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2672 sessionId:  describe result for acl check
2025-09-30T14:57:46.390612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:46.390618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:46.390621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:46.390627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896590162852440:11871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:46.391149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896590162852440:11871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:46.393963Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896590162852440:11871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:46.397849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896590162852440:11871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:46.397868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896590162852440:11871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:46.397871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896590162852440:11871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:46.397879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2672 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:46.399557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:46.402349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:46.402543Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:46.402553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:46.402564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:46.402631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:46.402675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896590073059969:12225]
2025-09-30T14:57:46.403338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:46.403736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:46.403788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:46.404089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:46.404170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.404177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.404178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.404180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.404181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.404182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.404184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.404185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.404186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.404188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.404190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.404191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.404192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.404193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.404194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.404200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.404210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.404214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.404217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.404222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.404226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.404230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.404234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.404239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.404243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.404248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.404252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.404256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.404260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.404265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.404273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.404282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.404288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.404295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.404300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.404306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.404312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.404318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.404323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.404330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.404335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.404341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.404346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.404351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.404358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.404364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.404368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.404373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.404378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.404384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.404389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.404392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.404395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.404398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.404401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.404404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.404407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.404411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.404414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.404417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.404460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:46.410255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:46.411307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:46.411328Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:46.411330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:46.411335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:46.411343Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2671 [2:7555896590073059969:12225]
2025-09-30T14:57:46.411362Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:46.411376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:46.411378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:46.411381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:46.411384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:46.411403Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:46.411410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:46.411418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:46.411470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.411477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.411478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.411482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:46.411485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:46.411555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:46.411564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.411578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.411592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.411603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:46.411618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162852386:2454], now have 1 active actors on pipe
2025-09-30T14:57:46.411628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162852638:11871], now have 1 active actors on pipe
2025-09-30T14:57:46.411635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896590073059964:12225]
2025-09-30T14:57:46.411637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896590073059964:12225]
2025-09-30T14:57:46.411639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896590073059964:12225]
2025-09-30T14:57:46.411654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:46.411668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:46.411668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:46.411671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:46.411674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:46.411688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:46.411691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:46.411730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896590073059964:12225]
2025-09-30T14:57:46.411744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:46.411753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:46.411769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2671
2025-09-30T14:57:46.411785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2671
2025-09-30T14:57:46.411816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.411826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.411853Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|688a717a-8c3e47c0-239034db-e5099ef2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:46.411864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:46.411872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:46.411875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:46.411885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:46.411898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:46.411916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:46.412074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.412082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.412095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:46.412185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2672 partition: 0 MaxSeqNo: 42 sessionId: src_id|688a717a-8c3e47c0-239034db-e5099ef2_0
2025-09-30T14:57:46.412534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397f8a30-8d66bb2c-178f6038-c42413e7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|688a717a-8c3e47c0-239034db-e5099ef2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:46.415384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|688a717a-8c3e47c0-239034db-e5099ef2_0] Write session: try to update token
2025-09-30T14:57:46.415413Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|688a717a-8c3e47c0-239034db-e5099ef2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:46.424698Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:46.424727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:46.424731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:46.424733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:46.424744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896590073059964:12225]
2025-09-30T14:57:46.424750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896590073059964:12225]
2025-09-30T14:57:46.424756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896590073059964:12225]
2025-09-30T14:57:46.424797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:46.424809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.424813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:46.424817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:46.424819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:46.424823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:46.424971Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:46.431856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2672 sessionId: src_id|688a717a-8c3e47c0-239034db-e5099ef2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:46.434845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:46.478301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896590162852653:11465]
2025-09-30T14:57:46.478652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2671, pipe: [1:7555896590162852653:11465]
2025-09-30T14:57:46.548539Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:46.548898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.548909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.548930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162852653:11465], now have 1 active actors on pipe
2025-09-30T14:57:46.549254Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:46.549270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:46.549275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:46.549327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896590162852653:11465]
2025-09-30T14:57:46.549351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2672 reason: error at write: Disconnected sessionId: src_id|688a717a-8c3e47c0-239034db-e5099ef2_0
2025-09-30T14:57:46.549226Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:46.549532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2672 sessionId: src_id|688a717a-8c3e47c0-239034db-e5099ef2_0 is DEAD
2025-09-30T14:57:46.549873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688a717a-8c3e47c0-239034db-e5099ef2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:46.549885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688a717a-8c3e47c0-239034db-e5099ef2_0] Write session will restart in 0.006434s
2025-09-30T14:57:46.549918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688a717a-8c3e47c0-239034db-e5099ef2_0] Write session: Do CDS request
2025-09-30T14:57:46.549927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688a717a-8c3e47c0-239034db-e5099ef2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:46.557836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|688a717a-8c3e47c0-239034db-e5099ef2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:46.557937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:46.557957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2673
2025-09-30T14:57:46.558066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2673 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:46.558096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2673 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:46.558107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2673 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:46.558113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:46.558566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2673 sessionId:  describe result for acl check
2025-09-30T14:57:46.558598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:46.558604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:46.558607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:46.558612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896590162852673:11875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:46.559141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896590162852673:11875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:46.563817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896590162852673:11875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:46.568421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896590162852673:11875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:46.568446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896590162852673:11875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:46.568450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896590162852673:11875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:46.568459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2673 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:46.575676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:46.578897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:46.579147Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:46.579151Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:46.579162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:46.579219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:46.579283Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896590073060234:12228]
2025-09-30T14:57:46.579958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:46.580677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:46.580744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:46.581140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:46.581209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.581210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.581212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.581213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.581214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.581216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.581217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.581219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.581220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.581222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.581223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.581224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.581225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.581227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.581228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.581233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.581244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.581248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.581253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.581257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.581262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.581266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.581271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.581275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.581279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.581284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.581288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.581292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.581296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.581300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.581308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.581317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.581323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.581329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.581336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.581342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.581347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.581353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.581359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.581365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.581369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.581377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.581382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.581388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.581392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.581399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.581405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.581411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.581415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.581421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.581426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.581432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.581436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.581442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.581446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.581452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.581457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.581462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.581467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.581471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.581513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:46.587348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:46.588351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:46.588376Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:46.588381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:46.588386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:46.588394Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2672 [2:7555896590073060234:12228]
2025-09-30T14:57:46.588413Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:46.588432Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:46.588438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:46.588442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:46.588446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:46.588462Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:46.588479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:46.588486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:46.588556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.588559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.588562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.588566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:46.588569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:46.588639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:46.588643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.588658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.588671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.588690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:46.588709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896590073060229:12228]
2025-09-30T14:57:46.588715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896590073060229:12228]
2025-09-30T14:57:46.588717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896590073060229:12228]
2025-09-30T14:57:46.588734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:46.588748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:46.588764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:46.588768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:46.588806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896590073060229:12228]
2025-09-30T14:57:46.588809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:46.589065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:46.589079Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:46.589081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:46.589087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:46.589374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162852808:11875], now have 1 active actors on pipe
2025-09-30T14:57:46.589387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162852655:2454], now have 1 active actors on pipe
2025-09-30T14:57:46.589448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2672
2025-09-30T14:57:46.589488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2672
2025-09-30T14:57:46.589571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.589585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.589615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:46.589627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:46.589632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:46.589634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:46.589645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:46.589657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:46.589674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:46.589894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.589907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.589926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:46.590021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2673 partition: 0 MaxSeqNo: 42 sessionId: src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0
2025-09-30T14:57:46.590424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|688a717a-8c3e47c0-239034db-e5099ef2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:46.593546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0] Write session: try to update token
2025-09-30T14:57:46.593569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:46.602754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:46.602782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:46.602785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:46.602788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:46.602799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896590073060229:12228]
2025-09-30T14:57:46.602805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896590073060229:12228]
2025-09-30T14:57:46.602809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896590073060229:12228]
2025-09-30T14:57:46.602855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:46.602863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.602865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:46.602912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:46.602928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:46.602932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:46.603017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:46.619427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2673 sessionId: src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:46.622324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:46.649365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896590162852926:11465]
2025-09-30T14:57:46.649670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2672, pipe: [1:7555896590162852926:11465]
2025-09-30T14:57:46.745580Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:46.746042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.746059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.746080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162852926:11465], now have 1 active actors on pipe
2025-09-30T14:57:46.746359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896590162852926:11465]
2025-09-30T14:57:46.746378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:46.746382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:46.746431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:46.746449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2673 reason: error at write: Disconnected sessionId: src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0
2025-09-30T14:57:46.746538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:46.746674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2673 sessionId: src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0 is DEAD
2025-09-30T14:57:46.747062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:46.747074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0] Write session will restart in 0.008220s
2025-09-30T14:57:46.747098Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0] Write session: Do CDS request
2025-09-30T14:57:46.747108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:46.756781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:46.756871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:46.756892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2674
2025-09-30T14:57:46.757050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2674 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:46.757095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2674 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:46.757102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2674 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:46.757108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:46.757845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2674 sessionId:  describe result for acl check
2025-09-30T14:57:46.757885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:46.757887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:46.757889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:46.757895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896590162852973:11880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:46.758454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896590162852973:11880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:46.761422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896590162852973:11880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:46.765416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896590162852973:11880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:46.765435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896590162852973:11880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:46.765439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896590162852973:11880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:46.765449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2674 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:46.768564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:46.771650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:46.771869Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:46.771873Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:46.771885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:46.771938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:46.771975Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896590073060497:12230]
2025-09-30T14:57:46.772646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:46.773004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:46.773048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:46.773405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:46.773479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.773488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.773489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.773490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.773491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.773493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.773494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.773495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.773497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.773498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.773499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.773500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.773501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.773503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.773504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.773509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.773521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.773525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.773529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.773533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.773538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.773542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.773546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.773550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.773555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.773559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.773563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.773568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.773572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.773576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.773584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.773592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.773598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.773604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.773609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.773615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.773620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.773626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.773631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.773637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.773641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.773646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.773651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.773657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.773662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.773667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.773672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.773678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.773682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.773688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.773700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.773705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.773715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.773721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.773729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.773735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.773744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.773749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.773756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.773766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.773811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:46.779361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:46.780771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:46.780793Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:46.780796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:46.780800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:46.780808Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2673 [2:7555896590073060497:12230]
2025-09-30T14:57:46.780825Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:46.780839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:46.780843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:46.780846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:46.780848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:46.780865Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:46.780872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:46.780879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:46.780942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.780950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.780953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.780956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:46.780959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:46.781051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:46.781058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.781071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.781084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.781105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:46.781125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162852931:2454], now have 1 active actors on pipe
2025-09-30T14:57:46.781131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162853154:11880], now have 1 active actors on pipe
2025-09-30T14:57:46.781137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896590073060492:12230]
2025-09-30T14:57:46.781139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896590073060492:12230]
2025-09-30T14:57:46.781141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896590073060492:12230]
2025-09-30T14:57:46.781155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:46.781169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:46.781173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:46.781182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:46.781184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:46.781186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:46.781189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:46.781226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896590073060492:12230]
2025-09-30T14:57:46.781238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:46.781245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:46.781363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2673
2025-09-30T14:57:46.781392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2673
2025-09-30T14:57:46.781439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.781465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.781495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:46.781508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:46.781512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:46.781515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:46.781525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:46.781556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:46.781575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:46.781725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.781734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.781750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:46.781861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2674 partition: 0 MaxSeqNo: 42 sessionId: src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0
2025-09-30T14:57:46.782286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edfd4f34-998e5732-6df7d2f1-94795a93_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:46.785158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0] Write session: try to update token
2025-09-30T14:57:46.785177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:46.793612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:46.793630Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:46.793640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896590073060492:12230]
2025-09-30T14:57:46.793686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:46.793693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:46.793871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:46.794036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:46.794186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:46.794339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:46.794560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:46.794615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:46.802153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2674 sessionId: src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:46.805025Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:46.805048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:46.805050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:46.805052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:46.805063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896590073060492:12230]
2025-09-30T14:57:46.805067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896590073060492:12230]
2025-09-30T14:57:46.805072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896590073060492:12230]
2025-09-30T14:57:46.805114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:46.805121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.805124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:46.805140Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:46.805147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:46.805156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:46.805227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:46.805276Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:46.819794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:57:46.819833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 15
2025-09-30T14:57:46.846414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896590162853205:11465]
2025-09-30T14:57:46.846749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2673, pipe: [1:7555896590162853205:11465]
2025-09-30T14:57:46.921956Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:46.922290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.922306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.922352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162853205:11465], now have 1 active actors on pipe
2025-09-30T14:57:46.922595Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:46.922600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:46.922620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896590162853205:11465]
2025-09-30T14:57:46.922631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 15
2025-09-30T14:57:46.922652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:46.922664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:46.922730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2674 reason: error at write: Disconnected sessionId: src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0
2025-09-30T14:57:46.922924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2674 sessionId: src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0 is DEAD
2025-09-30T14:57:46.923089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:46.923115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0] Write session will restart in 0.009628s
2025-09-30T14:57:46.923143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0] Write session: Do CDS request
2025-09-30T14:57:46.923148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:46.933809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:46.933916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:46.933936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2675
2025-09-30T14:57:46.934088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2675 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:46.934135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2675 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:46.934146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2675 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:46.934150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:46.934781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2675 sessionId:  describe result for acl check
2025-09-30T14:57:46.934823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:46.934825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:46.934827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:46.934833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896590162853256:11884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:46.935403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896590162853256:11884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:46.937712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896590162853256:11884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:46.941174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896590162853256:11884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:46.941194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896590162853256:11884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:46.941197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896590162853256:11884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:46.941204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2675 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:46.945463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:46.948217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:46.948450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:46.948459Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:46.948471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:46.948534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:46.948580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896590073060762:12233]
2025-09-30T14:57:46.949314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:46.949687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:46.949752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:46.950038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:46.950090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.950095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.950096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.950097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.950099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.950101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.950102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.950104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.950105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.950106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.950108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.950109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.950110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.950111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.950113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.950119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.950130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.950134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.950139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.950143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.950147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.950149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.950152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.950155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.950159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.950164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.950167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.950170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.950174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.950177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.950188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.950197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:46.950204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.950208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:46.950211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.950217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:46.950222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.950228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:46.950233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.950238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:46.950242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.950248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:46.950252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.950257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:46.950261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.950266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:46.950270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.950275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:46.950280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.950284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:46.950289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.950293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.950298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.950303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.950308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.950313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.950317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.950322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:46.950327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.950341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:46.950384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:46.956757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:46.957648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:46.957664Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:46.957667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:46.957672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:46.957682Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2674 [2:7555896590073060762:12233]
2025-09-30T14:57:46.957697Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:46.957718Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:46.957721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:46.957724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:46.957726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:46.957744Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:46.957750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:46.957756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:46.957816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.957828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.957830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.957833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:46.957836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:46.957904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:46.957910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.957922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:46.957942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:46.957960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:46.957985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162853206:2454], now have 1 active actors on pipe
2025-09-30T14:57:46.957993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896590162853428:11884], now have 1 active actors on pipe
2025-09-30T14:57:46.957999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896590073060757:12233]
2025-09-30T14:57:46.958001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896590073060757:12233]
2025-09-30T14:57:46.958004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896590073060757:12233]
2025-09-30T14:57:46.958019Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:46.958033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:46.958052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:46.958059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:46.958081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2674
2025-09-30T14:57:46.958094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896590073060757:12233]
2025-09-30T14:57:46.958103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2674
2025-09-30T14:57:46.958102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:46.958115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:46.958119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:46.958122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:46.958128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:46.958243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.958254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.958316Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:57:46.958347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61e7a421-773e225b-7f63546e-26e29bee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:46.958358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:46.958362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:46.958369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:46.958379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:46.958394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:46.958412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:46.958577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:46.958586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:46.958603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:46.958641Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 19 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:57:46.958679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:57:46.958711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2675 partition: 0 MaxSeqNo: 42 sessionId: src_id|61e7a421-773e225b-7f63546e-26e29bee_0
2025-09-30T14:57:46.959106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7a7edb-75b18e69-d6734485-8e410a1e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|61e7a421-773e225b-7f63546e-26e29bee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:46.962051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61e7a421-773e225b-7f63546e-26e29bee_0] Write session: try to update token
2025-09-30T14:57:46.962072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61e7a421-773e225b-7f63546e-26e29bee_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:46.970674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:46.970692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:46.970702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896590073060757:12233]
2025-09-30T14:57:46.970744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:46.970766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:46.970931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:46.971085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:46.971265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:46.971412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:46.971628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:46.971675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:46.980524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2675 sessionId: src_id|61e7a421-773e225b-7f63546e-26e29bee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:46.982313Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:46.982333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:46.982336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:46.982338Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:46.982350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896590073060757:12233]
2025-09-30T14:57:46.982354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896590073060757:12233]
2025-09-30T14:57:46.982359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896590073060757:12233]
2025-09-30T14:57:46.982399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:46.982408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:46.982410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:46.982423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:46.982436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:46.982441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:46.982565Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:46.983390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:47.023067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896594457820780:11465]
2025-09-30T14:57:47.023378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2674, pipe: [1:7555896594457820780:11465]
2025-09-30T14:57:47.099830Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:47.100626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.100643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.100667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457820780:11465], now have 1 active actors on pipe
2025-09-30T14:57:47.100933Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:47.100966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896594457820780:11465]
2025-09-30T14:57:47.101022Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:47.101062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:47.101137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2675 reason: status is not ok: tablet will be restarted right now sessionId: src_id|61e7a421-773e225b-7f63546e-26e29bee_0
2025-09-30T14:57:47.101308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2675 sessionId: src_id|61e7a421-773e225b-7f63546e-26e29bee_0 is DEAD
2025-09-30T14:57:47.103560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61e7a421-773e225b-7f63546e-26e29bee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:47.103573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61e7a421-773e225b-7f63546e-26e29bee_0] Write session will restart in 0.008219s
2025-09-30T14:57:47.103597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61e7a421-773e225b-7f63546e-26e29bee_0] Write session: Do CDS request
2025-09-30T14:57:47.103603Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61e7a421-773e225b-7f63546e-26e29bee_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:47.112785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61e7a421-773e225b-7f63546e-26e29bee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:47.114942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:47.114959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2676
2025-09-30T14:57:47.115154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2676 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:47.115189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2676 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:47.115203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2676 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:47.115207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:47.115801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2676 sessionId:  describe result for acl check
2025-09-30T14:57:47.115846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:47.115849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:47.115851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:47.115857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896594457820827:11888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:47.116406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896594457820827:11888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:47.119622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896594457820827:11888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:47.122819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896594457820827:11888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:47.122836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896594457820827:11888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:47.122839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896594457820827:11888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:47.122848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2676 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:47.126569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:47.129382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:47.129622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:47.129634Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:47.129646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:47.129706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:47.129748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896594368028326:12237]
2025-09-30T14:57:47.130443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:47.130813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:47.130881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:47.131298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:47.131377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.131383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.131384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.131385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.131387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.131388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.131389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.131390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.131392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.131393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.131395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.131396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.131398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.131399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.131400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.131407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.131419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.131424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.131429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.131433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.131439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.131443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.131460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.131468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.131475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.131483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.131487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.131490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.131495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.131499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.131519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.131533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.131539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.131545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.131550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.131557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.131562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.131567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.131572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.131580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.131584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.131590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.131595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.131601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.131606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.131616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.131622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.131627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.131632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.131637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.131642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.131648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.131657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.131662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.131668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.131674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.131683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.131689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.131700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.131706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.131753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:47.137441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:47.138358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:47.138375Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:47.138378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:47.138383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:47.138389Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2675 [2:7555896594368028326:12237]
2025-09-30T14:57:47.138404Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:47.138421Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:47.138424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:47.138426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:47.138429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:47.138445Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:47.138457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:47.138464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:47.138527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.138533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.138535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.138538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:47.138541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:47.138612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:47.138621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.138632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.138643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.138658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:47.138677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457820784:2454], now have 1 active actors on pipe
2025-09-30T14:57:47.138681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457820998:11888], now have 1 active actors on pipe
2025-09-30T14:57:47.138687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896594368028321:12237]
2025-09-30T14:57:47.138689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896594368028321:12237]
2025-09-30T14:57:47.138692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896594368028321:12237]
2025-09-30T14:57:47.138701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:47.138714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:47.138726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:47.138729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:47.138730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:47.138731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:47.138732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:47.138765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896594368028321:12237]
2025-09-30T14:57:47.138779Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:47.138784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:47.138823Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2675
2025-09-30T14:57:47.138843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2675
2025-09-30T14:57:47.138875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.138886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.138910Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:47.138917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:47.138925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:47.138928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:47.138937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:47.138952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:47.138970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:47.139133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.139145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.139169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:47.139283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2676 partition: 0 MaxSeqNo: 42 sessionId: src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0
2025-09-30T14:57:47.139691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61e7a421-773e225b-7f63546e-26e29bee_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:47.142734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0] Write session: try to update token
2025-09-30T14:57:47.142761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:47.158869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2676 sessionId: src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:47.161874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:47.162083Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:47.162107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:47.162117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896594368028321:12237]
2025-09-30T14:57:47.162153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:47.162165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.162179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.162206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:47.162412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:47.162583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:47.162745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:47.162917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:47.163140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:47.163198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:47.163228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:47.163354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:47.167201Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:47.167214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:47.167216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:47.167217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:47.167224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896594368028321:12237]
2025-09-30T14:57:47.167227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896594368028321:12237]
2025-09-30T14:57:47.167229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896594368028321:12237]
2025-09-30T14:57:47.167283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:47.167285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:47.167289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.167291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:47.167291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:47.167296Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:47.167415Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:47.201224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896594457821059:11465]
2025-09-30T14:57:47.201498Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2675, pipe: [1:7555896594457821059:11465]
2025-09-30T14:57:47.277091Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:47.286058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.286089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.286258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.286323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.286387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.286454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.286872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.286889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.286961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.287023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.287090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.287158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.287204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.287213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.287306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.287375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.287473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.287542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.287589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.287597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.287665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.287729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.287792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.287859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.287904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.287911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.287979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.288048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.288115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.288182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.288230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.288239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.288310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.288379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.288450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.288520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.288566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.288573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.288643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.288711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.288781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.288848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.288894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.288902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.288972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.289052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.289116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.289186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.289234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.289246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.289317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.289380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.289445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.289515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.289562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.289572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.289640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.289704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.289768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.289838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.289882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.289892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.289962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457821059:11465], now have 1 active actors on pipe
2025-09-30T14:57:47.290660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:47.290675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0] Write session will restart in 0.008877s
2025-09-30T14:57:47.290698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0] Write session: Do CDS request
2025-09-30T14:57:47.290703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:47.290227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:47.290245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896594457821059:11465]
2025-09-30T14:57:47.290289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:47.290292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:47.290321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2676 reason: error at write: Disconnected sessionId: src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0
2025-09-30T14:57:47.290529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2676 sessionId: src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0 is DEAD
2025-09-30T14:57:47.290859Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:47.300786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:47.300875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:47.300892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2677
2025-09-30T14:57:47.301426Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2677 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:47.301476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2677 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:47.301487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2677 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:47.301491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:47.302093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2677 sessionId:  describe result for acl check
2025-09-30T14:57:47.302129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:47.302135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:47.302137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:47.302144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896594457821118:11893] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:47.302713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896594457821118:11893] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:47.306498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896594457821118:11893] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:47.309834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896594457821118:11893] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:47.309851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896594457821118:11893] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:47.309854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896594457821118:11893] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:47.309862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2677 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:47.312098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:47.314917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:47.315178Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:47.315189Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:47.315202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:47.315301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:47.315381Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896594368028604:12240]
2025-09-30T14:57:47.316122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:47.316487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:47.316548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:47.316952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:47.317049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.317056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.317057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.317059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.317060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.317061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.317062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.317064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.317065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.317066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.317067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.317069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.317070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.317071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.317072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.317079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.317089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.317093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.317098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.317103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.317107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.317111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.317115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.317119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.317123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.317128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.317132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.317136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.317140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.317144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.317153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.317162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.317168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.317174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.317179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.317185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.317190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.317196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.317200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.317206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.317211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.317217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.317222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.317230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.317235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.317245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.317250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.317258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.317262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.317266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.317273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.317277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.317280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.317283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.317286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.317289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.317292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.317295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.317298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.317301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.317356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:47.322995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:47.323846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:47.323864Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:47.323867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:47.323872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:47.323879Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2676 [2:7555896594368028604:12240]
2025-09-30T14:57:47.323896Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:47.323912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:47.323915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:47.323919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:47.323921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:47.323938Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:47.323945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:47.323953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:47.324023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.324032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.324035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.324039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:47.324042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:47.324231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2676
2025-09-30T14:57:47.324337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2676
2025-09-30T14:57:47.324440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:47.324449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.324463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.324477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.324501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:47.324526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457821326:11893], now have 1 active actors on pipe
2025-09-30T14:57:47.324535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457821066:2454], now have 1 active actors on pipe
2025-09-30T14:57:47.324554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.324563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.324578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896594368028599:12240]
2025-09-30T14:57:47.324585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896594368028599:12240]
2025-09-30T14:57:47.324588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896594368028599:12240]
2025-09-30T14:57:47.324600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:47.324617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:47.324620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:47.324626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:47.324628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:47.324639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:47.324642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:47.324659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:47.324667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:47.324671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:47.324673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:47.324682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:47.324692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:47.324735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896594368028599:12240]
2025-09-30T14:57:47.324747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:47.324753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:47.324762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:47.324921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.324929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.324942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:47.325055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2677 partition: 0 MaxSeqNo: 42 sessionId: src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0
2025-09-30T14:57:47.325442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e3dcd24e-292d0e40-a35ba62a-eda1fb7b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:47.328285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0] Write session: try to update token
2025-09-30T14:57:47.328304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:47.336925Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:47.336941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:47.336944Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:47.336946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:47.336956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896594368028599:12240]
2025-09-30T14:57:47.336961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896594368028599:12240]
2025-09-30T14:57:47.336965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896594368028599:12240]
2025-09-30T14:57:47.337016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:47.337024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.337033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:47.337031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:47.337038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:47.337042Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:47.337164Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:47.343087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2677 sessionId: src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:47.346159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:47.390660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896594457821369:11465]
2025-09-30T14:57:47.390938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2676, pipe: [1:7555896594457821369:11465]
2025-09-30T14:57:47.448786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:47.449470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.449490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.449510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457821369:11465], now have 1 active actors on pipe
2025-09-30T14:57:47.449716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:47.449716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:47.449734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:47.449788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2677 reason: error at write: Disconnected sessionId: src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0
2025-09-30T14:57:47.449979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2677 sessionId: src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0 is DEAD
2025-09-30T14:57:47.450155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:47.450169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0] Write session will restart in 0.007222s
2025-09-30T14:57:47.450158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896594457821369:11465]
2025-09-30T14:57:47.450193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0] Write session: Do CDS request
2025-09-30T14:57:47.450199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:47.450236Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:47.458809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:47.458908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:47.458931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2678
2025-09-30T14:57:47.459051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2678 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:47.459097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2678 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:47.459109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2678 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:47.459115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:47.459596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2678 sessionId:  describe result for acl check
2025-09-30T14:57:47.459647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:47.459657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:47.459658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:47.459664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896594457821397:11905] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:47.460164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896594457821397:11905] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:47.465703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896594457821397:11905] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:47.469154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896594457821397:11905] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:47.469175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896594457821397:11905] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:47.469179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896594457821397:11905] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:47.469187Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2678 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:47.473383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:47.476690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:47.476935Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:47.476946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:47.476958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:47.477049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:47.477096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896594368028906:12254]
2025-09-30T14:57:47.477776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:47.478123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:47.478174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:47.478506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:47.478604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.478605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.478607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.478608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.478609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.478610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.478611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.478612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.478614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.478615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.478616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.478617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.478618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.478619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.478620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.478626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.478635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.478639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.478644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.478647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.478651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.478654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.478658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.478662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.478666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.478669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.478673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.478677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.478680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.478684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.478692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.478699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.478705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.478710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.478715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.478720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.478724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.478729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.478734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.478739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.478743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.478750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.478754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.478759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.478764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.478769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.478774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.478779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.478785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.478790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.478795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.478800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.478804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.478810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.478813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.478818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.478823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.478828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.478833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.478838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.478881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:47.484633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:47.485557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:47.485576Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:47.485579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:47.485583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:47.485591Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2677 [2:7555896594368028906:12254]
2025-09-30T14:57:47.485607Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:47.485623Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:47.485635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:47.485638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:47.485641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:47.485657Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:47.485668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:47.485675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:47.485745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.485753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.485756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.485759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:47.485762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:47.485848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:47.485859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.485872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.485884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.485900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:47.485918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896594368028901:12254]
2025-09-30T14:57:47.485926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896594368028901:12254]
2025-09-30T14:57:47.485928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896594368028901:12254]
2025-09-30T14:57:47.485936Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:47.485946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:47.485952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:47.485955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:47.485958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:47.485966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:47.485969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:47.485980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457821574:11905], now have 1 active actors on pipe
2025-09-30T14:57:47.485985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457821382:2454], now have 1 active actors on pipe
2025-09-30T14:57:47.486019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896594368028901:12254]
2025-09-30T14:57:47.486032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:47.486056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2677
2025-09-30T14:57:47.486061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:47.486185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.486190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.486212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:47.486220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:47.486224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:47.486227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:47.486240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:47.486249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:47.486270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:47.486384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2677
2025-09-30T14:57:47.486460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.486468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.486482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:47.486580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2678 partition: 0 MaxSeqNo: 42 sessionId: src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0
2025-09-30T14:57:47.486967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6b8ca63-3119a787-c9fec46e-fc8bc24a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:47.489992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0] Write session: try to update token
2025-09-30T14:57:47.490014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:47.504793Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:47.504812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:47.504822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896594368028901:12254]
2025-09-30T14:57:47.504874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:47.504889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:47.505069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:47.505228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:47.505379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:47.505537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:47.505756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:47.505800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:47.506874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2678 sessionId: src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:47.509543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:47.510348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.510375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.510397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:47.510400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:47.510402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:47.510405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:47.510415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896594368028901:12254]
2025-09-30T14:57:47.510418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896594368028901:12254]
2025-09-30T14:57:47.510421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896594368028901:12254]
2025-09-30T14:57:47.510460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:47.510472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:47.510472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:47.510476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:47.510479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.510482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:47.510642Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:47.550412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896594457821655:11465]
2025-09-30T14:57:47.550718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2677, pipe: [1:7555896594457821655:11465]
2025-09-30T14:57:47.625959Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:47.626516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:47.626556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457821655:11465], now have 1 active actors on pipe
2025-09-30T14:57:47.626684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:47.626886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:47.626894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:47.626920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896594457821655:11465]
2025-09-30T14:57:47.626963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2678 reason: error at write: Disconnected sessionId: src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0
2025-09-30T14:57:47.626984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:47.627130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2678 sessionId: src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0 is DEAD
2025-09-30T14:57:47.627336Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:47.627348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0] Write session will restart in 0.009800s
2025-09-30T14:57:47.627379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0] Write session: Do CDS request
2025-09-30T14:57:47.627385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:47.638805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:47.638910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:47.638930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2679
2025-09-30T14:57:47.639053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2679 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:47.639085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2679 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:47.639095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2679 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:47.639103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:47.639607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2679 sessionId:  describe result for acl check
2025-09-30T14:57:47.639646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:47.639653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:47.639655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:47.639661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896594457821729:11909] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:47.640197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896594457821729:11909] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:47.643598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896594457821729:11909] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:47.647033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896594457821729:11909] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:47.647051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896594457821729:11909] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:47.647055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896594457821729:11909] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:47.647063Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2679 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:47.648580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:47.651670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:47.652054Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:47.652071Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:47.652087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:47.652163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:47.652223Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896594368029175:12257]
2025-09-30T14:57:47.652944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:47.653289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:47.653324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:47.653581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:47.653628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.653635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.653636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.653636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.653637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.653638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.653639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.653640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.653641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.653642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.653642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.653644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.653644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.653645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.653646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.653649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.653657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.653659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.653662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.653664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.653667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.653669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.653671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.653674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.653676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.653678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.653681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.653683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.653685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.653687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.653693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.653698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.653702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.653706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.653709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.653712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.653715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.653718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.653721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.653725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.653729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.653735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.653740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.653746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.653751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.653755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.653758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.653761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.653764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.653767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.653770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.653774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.653777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.653780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.653783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.653788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.653793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.653799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.653803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.653807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.653854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:47.659400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:47.660225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:47.660239Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:47.660242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:47.660247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:47.660254Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2678 [2:7555896594368029175:12257]
2025-09-30T14:57:47.660271Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:47.660292Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:47.660295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:47.660299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:47.660302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:47.660324Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:47.660336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:47.660348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:47.660411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.660421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.660424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.660427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:47.660430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:47.660607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2678
2025-09-30T14:57:47.660634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2678
2025-09-30T14:57:47.660840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:47.660849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.660862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.660875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.660897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:47.660920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457821657:2454], now have 1 active actors on pipe
2025-09-30T14:57:47.660927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457821919:11909], now have 1 active actors on pipe
2025-09-30T14:57:47.660945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.660953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.660983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896594368029170:12257]
2025-09-30T14:57:47.660990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896594368029170:12257]
2025-09-30T14:57:47.660993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896594368029170:12257]
2025-09-30T14:57:47.661006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:47.661020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:47.661024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:47.661029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:47.661030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:47.661038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:47.661042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:47.661057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:47.661069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:47.661073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:47.661075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:47.661084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:47.661099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:47.661136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896594368029170:12257]
2025-09-30T14:57:47.661147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:47.661153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:47.661158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:47.661323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.661334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.661351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:47.661454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2679 partition: 0 MaxSeqNo: 42 sessionId: src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0
2025-09-30T14:57:47.661787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|617a0d3f-5a89cb41-10d29e46-539f8a53_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:47.664542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0] Write session: try to update token
2025-09-30T14:57:47.664558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:47.672713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:47.672730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:47.672744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896594368029170:12257]
2025-09-30T14:57:47.672787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:47.672795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:47.672962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:47.673116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:47.673254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:47.673393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:47.673586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:47.673626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:47.678288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2679 sessionId: src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:47.681140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:47.681341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.681369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.681404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:47.681483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:47.683370Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:47.683384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:47.683387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:47.683388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:47.683395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896594368029170:12257]
2025-09-30T14:57:47.683398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896594368029170:12257]
2025-09-30T14:57:47.683400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896594368029170:12257]
2025-09-30T14:57:47.683428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:47.683433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.683435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:47.683448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:47.683454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:47.683458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:47.683570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:47.727057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896594457821934:11465]
2025-09-30T14:57:47.727352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2678, pipe: [1:7555896594457821934:11465]
2025-09-30T14:57:47.795476Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:47.804407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.804441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.804637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.804709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.804782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.804853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.804911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.804922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.805015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.805086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.805154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.805231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.805283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.805293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.805369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.805440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.805508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.805592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.805642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.805650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.805733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.805810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.805880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.805950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.805999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.806009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.806089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.806157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.806229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.806301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.806354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.806361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.806434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.806507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.806580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.806653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.806709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.806718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.806787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.806861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.806932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.807000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.807051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.807060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.807133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.807205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.807295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.807371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.807421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.807432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.807509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.807583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.807656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.807731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.807779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.807790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.807861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:47.807934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:47.808008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:47.808084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:47.808141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:47.808152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:47.808225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457821934:11465], now have 1 active actors on pipe
2025-09-30T14:57:47.808483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:47.808490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896594457821934:11465]
2025-09-30T14:57:47.808639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:47.808658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:47.808686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2679 reason: error at write: Disconnected sessionId: src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0
2025-09-30T14:57:47.808894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2679 sessionId: src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0 is DEAD
2025-09-30T14:57:47.809008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:47.809016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0] Write session will restart in 0.006499s
2025-09-30T14:57:47.809043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0] Write session: Do CDS request
2025-09-30T14:57:47.809049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:47.809598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:47.816785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:47.816863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:47.816884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2680
2025-09-30T14:57:47.817269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2680 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:47.817304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2680 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:47.817315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2680 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:47.817320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:47.817762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2680 sessionId:  describe result for acl check
2025-09-30T14:57:47.817806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:47.817813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:47.817814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:47.817820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896594457821965:11914] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:47.818387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896594457821965:11914] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:47.821874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896594457821965:11914] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:47.825253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896594457821965:11914] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:47.825272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896594457821965:11914] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:47.825276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896594457821965:11914] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:47.825284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2680 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:47.829668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:47.832363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:47.832595Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:47.832606Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:47.832620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:47.832699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:47.832745Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896594368029443:12259]
2025-09-30T14:57:47.833396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:47.833728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:47.833780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:47.834112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:47.834185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.834191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.834193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.834194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.834195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.834197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.834198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.834200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.834201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.834202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.834203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.834205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.834206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.834208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.834209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.834217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.834228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.834232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.834237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.834241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.834245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.834248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.834253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.834257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.834262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.834266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.834270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.834273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.834278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.834283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.834291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.834299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:47.834306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.834318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:47.834323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.834333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:47.834339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.834344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:47.834350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.834356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:47.834367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.834373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:47.834383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.834389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:47.834398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.834404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:47.834409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.834416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:47.834420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.834424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:47.834428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.834433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.834444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.834449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.834456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.834465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.834469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.834474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:47.834483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.834487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:47.834531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:47.840119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:47.841639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2679
2025-09-30T14:57:47.841662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2679
2025-09-30T14:57:47.841234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:47.841255Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:47.841258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:47.841262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:47.841270Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2679 [2:7555896594368029443:12259]
2025-09-30T14:57:47.841289Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:47.841304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:47.841308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:47.841311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:47.841313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:47.841330Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:47.841337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:47.841344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:47.841409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.841411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.841414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.841417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:47.841420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:47.841488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:47.841491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.841507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:47.841520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:47.841539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:47.841558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457822136:11914], now have 1 active actors on pipe
2025-09-30T14:57:47.841562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457821938:2454], now have 1 active actors on pipe
2025-09-30T14:57:47.841568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896594368029438:12259]
2025-09-30T14:57:47.841571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896594368029438:12259]
2025-09-30T14:57:47.841573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896594368029438:12259]
2025-09-30T14:57:47.841587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:47.841600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:47.841603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:47.841604Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:47.841607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:47.841620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:47.841623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:47.841672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896594368029438:12259]
2025-09-30T14:57:47.841676Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:47.841679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:47.841697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.841702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.841757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:47.841764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:47.841767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:47.841769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:47.841780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:47.841790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:47.841814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:47.841963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.841972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.841997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:47.842088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2680 partition: 0 MaxSeqNo: 42 sessionId: src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0
2025-09-30T14:57:47.842475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f693db9-4f68fdb1-2d7f7268-8518f274_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:47.845403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0] Write session: try to update token
2025-09-30T14:57:47.845429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:47.854057Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:47.854081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:47.854084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:47.854086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:47.854097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896594368029438:12259]
2025-09-30T14:57:47.854105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896594368029438:12259]
2025-09-30T14:57:47.854109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896594368029438:12259]
2025-09-30T14:57:47.854154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:47.854158Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:47.854161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:47.854164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:47.854169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:47.854172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:47.854331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:47.861057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2680 sessionId: src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:47.863822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:47.908816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896594457822216:11465]
2025-09-30T14:57:47.909114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2679, pipe: [1:7555896594457822216:11465]
2025-09-30T14:57:47.975526Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:47.975867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:47.975882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:47.975908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457822216:11465], now have 1 active actors on pipe
2025-09-30T14:57:47.976411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:47.976259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:47.976269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:47.976277Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:47.976339Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896594457822216:11465]
2025-09-30T14:57:47.976344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2680 reason: error at write: Disconnected sessionId: src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0
2025-09-30T14:57:47.976554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2680 sessionId: src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0 is DEAD
2025-09-30T14:57:47.976997Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:47.977009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0] Write session will restart in 0.006141s
2025-09-30T14:57:47.977034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0] Write session: Do CDS request
2025-09-30T14:57:47.977041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:47.986764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:47.986872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:47.986908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2681
2025-09-30T14:57:47.987037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2681 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:47.987073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2681 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:47.987085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2681 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:47.987089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:47.987806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2681 sessionId:  describe result for acl check
2025-09-30T14:57:47.987854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:47.987863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:47.987865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:47.987871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896594457822267:11918] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:47.988403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896594457822267:11918] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:47.990983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896594457822267:11918] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:47.994011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896594457822267:11918] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:47.994028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896594457822267:11918] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:47.994032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896594457822267:11918] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:47.994048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2681 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:47.998064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:48.000736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:48.000960Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:48.000981Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:48.000993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:48.001043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:48.001084Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896598662997008:12261]
2025-09-30T14:57:48.001792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:48.002472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:48.002520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:48.002850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:48.002913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.002922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.002923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.002924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.002926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.002927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.002929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.002930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.002931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.002932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.002934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.002935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.002936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.002937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.002938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.002944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.002954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.002959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.002963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.002967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.002971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.002976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.002980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.002984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.002989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.002993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.002997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.003000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.003004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.003008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.003016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.003024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.003029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.003036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.003040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.003046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.003050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.003056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.003061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.003067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.003071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.003076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.003086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.003092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.003098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.003108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.003113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.003123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.003128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.003133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.003138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.003145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.003150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.003155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.003164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.003170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.003174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.003184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.003189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.003194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.003260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:48.008577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:48.009602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:48.009613Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:48.009616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:48.009619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:48.009625Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2680 [2:7555896598662997008:12261]
2025-09-30T14:57:48.009642Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:48.009658Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:48.009668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:48.009669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:48.009671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:48.009682Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:48.009687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:48.009692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:48.009736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.009743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.009744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.009746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:48.009749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:48.009799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:48.009806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.009817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.009829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.009851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:48.009873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457822416:11918], now have 1 active actors on pipe
2025-09-30T14:57:48.009880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896594457822220:2454], now have 1 active actors on pipe
2025-09-30T14:57:48.009886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896594368029707:12261]
2025-09-30T14:57:48.009887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896594368029707:12261]
2025-09-30T14:57:48.009889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896594368029707:12261]
2025-09-30T14:57:48.009901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:48.009914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:48.009919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:48.009923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:48.009925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:48.009933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:48.009937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:48.009930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2680
2025-09-30T14:57:48.009962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896594368029707:12261]
2025-09-30T14:57:48.009947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2680
2025-09-30T14:57:48.009970Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:48.009972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:48.009991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.010000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.010038Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:48.010053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:48.010057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:48.010059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:48.010069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:48.010078Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:48.010094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:48.010204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.010213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.010226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:48.010305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2681 partition: 0 MaxSeqNo: 42 sessionId: src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0
2025-09-30T14:57:48.010634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|385bc1c1-f6465141-4224e7ad-7857f1df_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:48.013384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0] Write session: try to update token
2025-09-30T14:57:48.013406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:48.021952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:48.021974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:48.021976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:48.021979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:48.021994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896594368029707:12261]
2025-09-30T14:57:48.021999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896594368029707:12261]
2025-09-30T14:57:48.022003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896594368029707:12261]
2025-09-30T14:57:48.022042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:48.022049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.022051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:48.022053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:48.022061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:48.022065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:48.022191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:48.027148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2681 sessionId: src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:48.029631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:48.076749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896598752789792:11465]
2025-09-30T14:57:48.077047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2680, pipe: [1:7555896598752789792:11465]
2025-09-30T14:57:48.133173Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:48.133777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.133797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.133839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752789792:11465], now have 1 active actors on pipe
2025-09-30T14:57:48.134094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896598752789792:11465]
2025-09-30T14:57:48.134115Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:48.134131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:48.134133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:48.134193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2681 reason: error at write: Disconnected sessionId: src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0
2025-09-30T14:57:48.134354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:48.134551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:48.134562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0] Write session will restart in 0.007200s
2025-09-30T14:57:48.134587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0] Write session: Do CDS request
2025-09-30T14:57:48.134382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2681 sessionId: src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0 is DEAD
2025-09-30T14:57:48.134593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:48.142712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:48.142788Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:48.142822Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2682
2025-09-30T14:57:48.142992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2682 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:48.143050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2682 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:48.143060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2682 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:48.143066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:48.143558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2682 sessionId:  describe result for acl check
2025-09-30T14:57:48.143594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:48.143600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:48.143602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:48.143607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896598752789823:11924] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:48.144124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896598752789823:11924] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:48.147215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896598752789823:11924] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:48.150111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896598752789823:11924] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:48.150126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896598752789823:11924] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:48.150129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896598752789823:11924] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:48.150138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2682 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:48.155639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:48.158825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:48.159048Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:48.159058Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:48.159070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:48.159129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:48.159168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896598662997292:12264]
2025-09-30T14:57:48.159870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:48.160318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:48.160382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:48.160789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:48.160863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.160867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.160869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.160870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.160872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.160873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.160874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.160876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.160877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.160878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.160880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.160881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.160882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.160883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.160884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.160899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.160909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.160914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.160918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.160922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.160926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.160930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.160934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.160938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.160943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.160947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.160950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.160954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.160958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.160962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.160984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.160992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.160999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.161006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.161011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.161017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.161022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.161028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.161045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.161051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.161056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.161060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.161065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.161070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.161073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.161079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.161084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.161090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.161094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.161099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.161105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.161110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.161118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.161124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.161130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.161136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.161140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.161145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.161150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.161155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.161201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:48.166861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:48.168264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:48.168290Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:48.168293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:48.168298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:48.168304Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2681 [2:7555896598662997292:12264]
2025-09-30T14:57:48.168321Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:48.168338Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:48.168342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:48.168345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:48.168347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:48.168362Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:48.168369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:48.168374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:48.168427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.168433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.168435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.168438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:48.168440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:48.168510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:48.168519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.168532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.168544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.168562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:48.168585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752789962:11924], now have 1 active actors on pipe
2025-09-30T14:57:48.168597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752789797:2454], now have 1 active actors on pipe
2025-09-30T14:57:48.168603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896598662997287:12264]
2025-09-30T14:57:48.168605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896598662997287:12264]
2025-09-30T14:57:48.168607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896598662997287:12264]
2025-09-30T14:57:48.168621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:48.168636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:48.168646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:48.168650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:48.168653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:48.168655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:48.168658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:48.168692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896598662997287:12264]
2025-09-30T14:57:48.168702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:48.168709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:48.174834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2681
2025-09-30T14:57:48.174847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2681
2025-09-30T14:57:48.175419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.175440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.175474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:48.175486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:48.175491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:48.175494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:48.175508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:48.175525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:48.175553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:48.175849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.175865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.175889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:48.176023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2682 partition: 0 MaxSeqNo: 42 sessionId: src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0
2025-09-30T14:57:48.176418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7054a7a-29a7241d-3ac20c53-9860bf48_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:48.179217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0] Write session: try to update token
2025-09-30T14:57:48.179233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:48.187994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:48.188019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:48.188028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896598662997287:12264]
2025-09-30T14:57:48.188076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:48.188083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:48.188257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:48.188405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:48.188544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:48.188693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:48.188906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:48.188960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:48.200701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2682 sessionId: src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:48.203496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:48.202615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:48.202637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:48.202640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:48.202642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:48.202653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896598662997287:12264]
2025-09-30T14:57:48.202658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896598662997287:12264]
2025-09-30T14:57:48.202662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896598662997287:12264]
2025-09-30T14:57:48.202701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:48.202708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.202711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:48.202869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:48.203455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:48.203462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:48.203466Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:48.234432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896598752790079:11465]
2025-09-30T14:57:48.234824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2681, pipe: [1:7555896598752790079:11465]
2025-09-30T14:57:48.318731Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:48.319485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.319504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.319526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752790079:11465], now have 1 active actors on pipe
2025-09-30T14:57:48.319785Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:48.319793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:48.319814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:48.319882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2682 reason: error at write: Disconnected sessionId: src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0
2025-09-30T14:57:48.319955Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:48.320000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896598752790079:11465]
2025-09-30T14:57:48.320072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2682 sessionId: src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0 is DEAD
2025-09-30T14:57:48.320343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:48.320355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0] Write session will restart in 0.006599s
2025-09-30T14:57:48.320389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0] Write session: Do CDS request
2025-09-30T14:57:48.320399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:48.329022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:48.329127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:48.329148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2683
2025-09-30T14:57:48.329268Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2683 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:48.329295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2683 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:48.329302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2683 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:48.329306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:48.329788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2683 sessionId:  describe result for acl check
2025-09-30T14:57:48.329816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:48.329818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:48.329820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:48.329826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896598752790113:11929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:48.330369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896598752790113:11929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:48.334452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896598752790113:11929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:48.340541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896598752790113:11929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:48.340563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896598752790113:11929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:48.340567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896598752790113:11929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:48.340577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2683 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:48.346787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:48.349752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:48.349969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:48.349980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:48.349990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:48.350042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:48.350082Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896598662997563:12267]
2025-09-30T14:57:48.350757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:48.351084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:48.351148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:48.351526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:48.351606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.351612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.351613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.351614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.351615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.351616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.351618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.351619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.351620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.351622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.351623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.351625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.351626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.351627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.351628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.351634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.351645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.351649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.351653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.351657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.351661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.351666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.351670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.351674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.351678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.351682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.351697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.351701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.351704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.351708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.351716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.351725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.351731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.351737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.351742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.351748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.351755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.351760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.351765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.351770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.351788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.351798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.351803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.351809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.351818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.351823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.351828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.351838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.351842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.351848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.351858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.351863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.351868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.351877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.351883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.351886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.351888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.351891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.351895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.351900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.351950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:48.357459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:48.358474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:48.358490Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:48.358493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:48.358497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:48.358505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2682 [2:7555896598662997563:12267]
2025-09-30T14:57:48.358522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:48.358539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:48.358546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:48.358550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:48.358553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:48.358569Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:48.358577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:48.358583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:48.358655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.358664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.358666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.358672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:48.358674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:48.358740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:48.358749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.358761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.358777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.358796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:48.358819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752790265:11929], now have 1 active actors on pipe
2025-09-30T14:57:48.358828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752790085:2454], now have 1 active actors on pipe
2025-09-30T14:57:48.358834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896598662997558:12267]
2025-09-30T14:57:48.358837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896598662997558:12267]
2025-09-30T14:57:48.358840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896598662997558:12267]
2025-09-30T14:57:48.358853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:48.358872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:48.358872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:48.358888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:48.358888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:48.358890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:48.358892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:48.358929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896598662997558:12267]
2025-09-30T14:57:48.358941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:48.358949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:48.359016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2682
2025-09-30T14:57:48.359026Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2682
2025-09-30T14:57:48.359094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.359103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.359133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:48.359146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:48.359150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:48.359152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:48.359162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:48.359171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:48.359185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:48.359439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.359447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.359462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:48.360170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2683 partition: 0 MaxSeqNo: 42 sessionId: src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0
2025-09-30T14:57:48.360572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2f2b30-7329dbd5-2754f2ed-9718dce1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:48.363446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0] Write session: try to update token
2025-09-30T14:57:48.363467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:48.371602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:48.371624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:48.371633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896598662997558:12267]
2025-09-30T14:57:48.371682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:48.371883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:48.372040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:48.372193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:48.372341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:48.372565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:48.372613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:48.373523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:48.380145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2683 sessionId: src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:48.382923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:48.382941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:48.382943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:48.382945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:48.382956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896598662997558:12267]
2025-09-30T14:57:48.382961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896598662997558:12267]
2025-09-30T14:57:48.382965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896598662997558:12267]
2025-09-30T14:57:48.383005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:48.383011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:48.383016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.383018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:48.383019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:48.383022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:48.383080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:48.383151Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:48.419941Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896598752790380:11465]
2025-09-30T14:57:48.420291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2682, pipe: [1:7555896598752790380:11465]
2025-09-30T14:57:48.497976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:48.498308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.498324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.498345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752790380:11465], now have 1 active actors on pipe
2025-09-30T14:57:48.498670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896598752790380:11465]
2025-09-30T14:57:48.498712Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:48.498716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:48.498778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2683 reason: error at write: Disconnected sessionId: src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0
2025-09-30T14:57:48.498945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2683 sessionId: src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0 is DEAD
2025-09-30T14:57:48.498945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:48.499365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:48.499374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0] Write session will restart in 0.007045s
2025-09-30T14:57:48.499395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0] Write session: Do CDS request
2025-09-30T14:57:48.499401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:48.498578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:48.508002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:48.508090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:48.508111Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2684
2025-09-30T14:57:48.508286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2684 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:48.508325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2684 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:48.508331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2684 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:48.508336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:48.508858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2684 sessionId:  describe result for acl check
2025-09-30T14:57:48.508890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:48.508892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:48.508894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:48.508910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896598752790426:11941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:48.509497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896598752790426:11941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:48.513142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896598752790426:11941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:48.517574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896598752790426:11941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:48.517597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896598752790426:11941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:48.517601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896598752790426:11941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:48.517609Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2684 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:48.524280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:48.527366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:48.527551Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:48.527562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:48.527574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:48.527624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:48.527664Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896598662997872:12281]
2025-09-30T14:57:48.528246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:48.528602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:48.528649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:48.529016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:48.529087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.529093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.529095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.529096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.529097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.529099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.529100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.529101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.529102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.529104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.529105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.529106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.529107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.529109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.529110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.529115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.529126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.529130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.529135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.529139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.529143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.529147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.529151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.529156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.529161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.529166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.529170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.529186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.529190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.529193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.529202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.529210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.529219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.529224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.529234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.529240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.529246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.529258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.529264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.529273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.529278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.529283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.529289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.529293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.529298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.529303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.529308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.529313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.529318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.529323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.529328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.529332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.529345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.529350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.529355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.529367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.529371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.529377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.529381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.529386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.529430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:48.535585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:48.536769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:48.536786Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:48.536789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:48.536793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:48.536799Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2683 [2:7555896598662997872:12281]
2025-09-30T14:57:48.536823Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:48.536839Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:48.536847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:48.536850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:48.536852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:48.536868Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:48.536879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:48.536886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:48.536949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.536959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.536961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.536966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:48.536982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:48.537053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:48.537060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.537074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.537086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.537104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:48.537123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752790407:2454], now have 1 active actors on pipe
2025-09-30T14:57:48.537127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752790550:11941], now have 1 active actors on pipe
2025-09-30T14:57:48.537133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896598662997867:12281]
2025-09-30T14:57:48.537135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896598662997867:12281]
2025-09-30T14:57:48.537138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896598662997867:12281]
2025-09-30T14:57:48.537151Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:48.537260Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2683
2025-09-30T14:57:48.537360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2683
2025-09-30T14:57:48.537164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:48.537166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:48.537171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:48.537175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:48.537184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:48.537188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:48.537224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896598662997867:12281]
2025-09-30T14:57:48.537232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:48.537309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:48.537562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.537577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.537613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:48.537640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:48.537645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:48.537648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:48.537659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:48.537673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:48.537694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:48.537908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.537923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.537946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:48.538040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2684 partition: 0 MaxSeqNo: 42 sessionId: src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0
2025-09-30T14:57:48.538445Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9fc08973-a3fb84b5-4536b3bb-dff020e7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:48.541271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0] Write session: try to update token
2025-09-30T14:57:48.541292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:48.549927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:48.549945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:48.549947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:48.549949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:48.549958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896598662997867:12281]
2025-09-30T14:57:48.549966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896598662997867:12281]
2025-09-30T14:57:48.549969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896598662997867:12281]
2025-09-30T14:57:48.550007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:48.550009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:48.550014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.550016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:48.550016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:48.550021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:48.550157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:48.555905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2684 sessionId: src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:48.558740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:48.598728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896598752790685:11465]
2025-09-30T14:57:48.599065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2683, pipe: [1:7555896598752790685:11465]
2025-09-30T14:57:48.663583Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:48.664027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.664038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.664078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752790685:11465], now have 1 active actors on pipe
2025-09-30T14:57:48.664319Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:48.664470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:48.664480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896598752790685:11465]
2025-09-30T14:57:48.664513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:48.664587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2684 reason: status is not ok: tablet will be restarted right now sessionId: src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0
2025-09-30T14:57:48.664756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2684 sessionId: src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0 is DEAD
2025-09-30T14:57:48.664914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:48.664925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0] Write session will restart in 0.007442s
2025-09-30T14:57:48.664949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0] Write session: Do CDS request
2025-09-30T14:57:48.664956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:48.673833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:48.673993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:48.674016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2685
2025-09-30T14:57:48.674133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2685 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:48.674168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2685 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:48.674173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2685 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:48.674178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:48.674603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2685 sessionId:  describe result for acl check
2025-09-30T14:57:48.674644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:48.674648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:48.674650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:48.674656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896598752790715:11945] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:48.675195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896598752790715:11945] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:48.678196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896598752790715:11945] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:48.681828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896598752790715:11945] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:48.681845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896598752790715:11945] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:48.681850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896598752790715:11945] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:48.681858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2685 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:48.686705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:48.689491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:48.689903Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:48.689919Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:48.689934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:48.690024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:48.690068Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896598662998148:12284]
2025-09-30T14:57:48.690717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:48.691041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:48.691088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:48.691435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:48.691499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.691505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.691507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.691508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.691509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.691511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.691512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.691513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.691514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.691515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.691516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.691518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.691519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.691520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.691521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.691528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.691538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.691542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.691546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.691550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.691555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.691559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.691563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.691567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.691571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.691574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.691577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.691580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.691583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.691586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.691594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.691602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.691608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.691613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.691619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.691625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.691630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.691635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.691641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.691645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.691650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.691668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.691673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.691678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.691684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.691689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.691693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.691700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.691704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.691709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.691714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.691719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.691723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.691728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.691732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.691736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.691741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.691745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.691750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.691755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.691801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:48.697173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:48.698368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:48.698380Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:48.698382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:48.698387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:48.698395Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2684 [2:7555896598662998148:12284]
2025-09-30T14:57:48.698411Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:48.698426Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:48.698429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:48.698433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:48.698435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:48.698451Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:48.698463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:48.698471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:48.698527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.698533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.698536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.698539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:48.698542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:48.698606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:48.698617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.698629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.698641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.698659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:48.698677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752790688:2454], now have 1 active actors on pipe
2025-09-30T14:57:48.698685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752790882:11945], now have 1 active actors on pipe
2025-09-30T14:57:48.698692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896598662998143:12284]
2025-09-30T14:57:48.698695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896598662998143:12284]
2025-09-30T14:57:48.698697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896598662998143:12284]
2025-09-30T14:57:48.698710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:48.698726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:48.698740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2684
2025-09-30T14:57:48.698779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2684
2025-09-30T14:57:48.698742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:48.698746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:48.698749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:48.698754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:48.698757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:48.698780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896598662998143:12284]
2025-09-30T14:57:48.698783Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:48.698793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:48.698819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.698823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.698849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:48.698856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:48.698859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:48.698861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:48.698871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:48.698879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:48.698890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:48.699083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.699094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.699118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:48.699232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2685 partition: 0 MaxSeqNo: 42 sessionId: src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0
2025-09-30T14:57:48.699617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|54bbea7e-954fb0ea-1e89f8bc-f9bd349e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:48.702253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0] Write session: try to update token
2025-09-30T14:57:48.702271Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:48.710983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:48.711007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:48.711009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:48.711011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:48.711021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896598662998143:12284]
2025-09-30T14:57:48.711025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896598662998143:12284]
2025-09-30T14:57:48.711030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896598662998143:12284]
2025-09-30T14:57:48.711066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:48.711071Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:48.711078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:48.711081Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:48.711081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.711085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:48.711221Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:48.716563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2685 sessionId: src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:48.719429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:48.764883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896598752790972:11465]
2025-09-30T14:57:48.765274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2684, pipe: [1:7555896598752790972:11465]
2025-09-30T14:57:48.826746Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:48.827311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.827343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.827411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752790972:11465], now have 1 active actors on pipe
2025-09-30T14:57:48.827747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:48.827814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:48.827832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:48.827909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2685 reason: error at write: Disconnected sessionId: src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0
2025-09-30T14:57:48.828100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2685 sessionId: src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0 is DEAD
2025-09-30T14:57:48.828301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896598752790972:11465]
2025-09-30T14:57:48.828318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:48.831350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:48.831365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0] Write session will restart in 0.008409s
2025-09-30T14:57:48.831390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0] Write session: Do CDS request
2025-09-30T14:57:48.831396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:48.840808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:48.840892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:48.840913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2686
2025-09-30T14:57:48.841117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2686 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:48.841151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2686 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:48.841157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2686 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:48.841162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:48.841796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2686 sessionId:  describe result for acl check
2025-09-30T14:57:48.841839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:48.841841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:48.841843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:48.841849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896598752791017:11950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:48.842367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896598752791017:11950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:48.847102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896598752791017:11950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:48.851937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896598752791017:11950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:48.851957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896598752791017:11950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:48.851961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896598752791017:11950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:48.851970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2686 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:48.857842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:48.861036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:48.861274Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:48.861285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:48.861297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:48.861351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:48.861395Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896598662998423:12286]
2025-09-30T14:57:48.862057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:48.862470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:48.862528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:48.862903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:48.862981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.862987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.862989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.862990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.862991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.862992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.862994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.862995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.862996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.862997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.862999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.863000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.863002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.863003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.863004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.863010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.863020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.863024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.863028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.863032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.863036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.863040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.863044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.863048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.863052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.863055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.863059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.863062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.863066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.863069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.863077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.863084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:48.863090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.863096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:48.863101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.863107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:48.863112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.863117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:48.863122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.863127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:48.863132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.863137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:48.863142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.863147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:48.863153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.863158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:48.863163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.863169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:48.863175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.863181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:48.863185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.863192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.863198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.863203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.863208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.863213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.863218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.863223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:48.863227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.863233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:48.863322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:48.869262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:48.870738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:48.870755Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:48.870758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:48.870763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:48.870770Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2685 [2:7555896598662998423:12286]
2025-09-30T14:57:48.870786Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:48.870802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:48.870805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:48.870808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:48.870810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:48.870827Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:48.870834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:48.870848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:48.870916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.870923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.870926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.870929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:48.870932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:48.871008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:48.871016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.871031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:48.871048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:48.871071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:48.871094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896598662998418:12286]
2025-09-30T14:57:48.871102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896598662998418:12286]
2025-09-30T14:57:48.871105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896598662998418:12286]
2025-09-30T14:57:48.871114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:48.871125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:48.871127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752790974:2454], now have 1 active actors on pipe
2025-09-30T14:57:48.871130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:48.871133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:48.871134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752791196:11950], now have 1 active actors on pipe
2025-09-30T14:57:48.871140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:48.871155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:48.871164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:48.871202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896598662998418:12286]
2025-09-30T14:57:48.871213Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:48.871220Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:48.871402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.871414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.871448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:48.871462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:48.871471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:48.871474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:48.871484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:48.871494Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:48.871517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:48.871739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:48.871748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:48.871762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:48.871224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2685
2025-09-30T14:57:48.871356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2685
2025-09-30T14:57:48.872463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2686 partition: 0 MaxSeqNo: 42 sessionId: src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0
2025-09-30T14:57:48.875604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|946fb6cd-e3e864cf-7e078b87-ada14bf8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:48.878406Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0] Write session: try to update token
2025-09-30T14:57:48.878428Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:48.883517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:48.883536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:48.883545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896598662998418:12286]
2025-09-30T14:57:48.883588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:48.883616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:48.883769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:48.883918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:48.884065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:48.884210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:48.884414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:48.884457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:48.893775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2686 sessionId: src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:48.894756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:48.894776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:48.894778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:48.894781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:48.894792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896598662998418:12286]
2025-09-30T14:57:48.894797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896598662998418:12286]
2025-09-30T14:57:48.894802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896598662998418:12286]
2025-09-30T14:57:48.894844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:48.894852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:48.894852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:48.894855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:48.894858Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:48.894872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:48.895005Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:48.896692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:48.928716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896598752791258:11465]
2025-09-30T14:57:48.929041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2685, pipe: [1:7555896598752791258:11465]
2025-09-30T14:57:49.009912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:49.010301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.010317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.010339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896598752791258:11465], now have 1 active actors on pipe
2025-09-30T14:57:49.010569Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:49.010602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:49.010649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896598752791258:11465]
2025-09-30T14:57:49.010659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:49.010738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2686 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0
2025-09-30T14:57:49.010940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2686 sessionId: src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0 is DEAD
2025-09-30T14:57:49.011559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:49.011573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0] Write session will restart in 0.009916s
2025-09-30T14:57:49.011598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0] Write session: Do CDS request
2025-09-30T14:57:49.011604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:49.022834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:49.022866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:49.022887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2687
2025-09-30T14:57:49.023104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2687 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:49.023140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2687 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:49.023151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2687 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:49.023155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:49.023715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2687 sessionId:  describe result for acl check
2025-09-30T14:57:49.023754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:49.023762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:49.023763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:49.023770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896603047758625:11954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:49.024328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896603047758625:11954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:49.027906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896603047758625:11954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:49.031642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896603047758625:11954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:49.031663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896603047758625:11954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:49.031667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896603047758625:11954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:49.031676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2687 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:49.033565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:49.036830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:49.037283Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:49.037297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:49.037310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:49.037375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:49.037410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896602957965997:9399]
2025-09-30T14:57:49.038042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:49.038417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:49.038466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:49.038803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:49.038867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.038873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.038875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.038876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.038877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.038878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.038879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.038880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.038881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.038882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.038883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.038884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.038886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.038887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.038887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.038893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.038903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.038906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.038911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.038914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.038918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.038921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.038925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.038929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.038934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.038938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.038942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.038947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.038951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.038956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.038966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.038973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.038979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.038985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.038989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.038995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.039000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.039004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.039009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.039014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.039018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.039022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.039035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.039041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.039045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.039050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.039055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.039059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.039065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.039075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.039080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.039090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.039096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.039105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.039110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.039119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.039124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.039133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.039138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.039147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.039192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:49.044704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:49.046044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:49.046062Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:49.046065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:49.046068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:49.046075Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2686 [2:7555896602957965997:9399]
2025-09-30T14:57:49.046092Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:49.046110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:49.046117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:49.046121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:49.046122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:49.046138Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:49.046145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:49.046153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:49.046219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.046226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.046227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.046230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:49.046234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:49.046304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:49.046313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.046326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.046336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.046357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:49.046380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047758556:2454], now have 1 active actors on pipe
2025-09-30T14:57:49.046388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047758827:11954], now have 1 active actors on pipe
2025-09-30T14:57:49.046395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896602957965992:9399]
2025-09-30T14:57:49.046403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896602957965992:9399]
2025-09-30T14:57:49.046406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896602957965992:9399]
2025-09-30T14:57:49.046419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:49.046433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:49.046436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:49.046436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:49.046438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:49.046451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:49.046455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:49.046492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896602957965992:9399]
2025-09-30T14:57:49.046474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2686
2025-09-30T14:57:49.046507Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:49.046526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2686
2025-09-30T14:57:49.046528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:49.046582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.046591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.046614Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:49.046625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:49.046628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:49.046631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:49.046640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:49.046650Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:49.046667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:49.046828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.046839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.046856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:49.046953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2687 partition: 0 MaxSeqNo: 42 sessionId: src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0
2025-09-30T14:57:49.047925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba844284-8b7fc6d0-c791d82e-1803ad50_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:49.050892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0] Write session: try to update token
2025-09-30T14:57:49.050914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:49.058533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:49.058552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:49.058554Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:49.058556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:49.058566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896602957965992:9399]
2025-09-30T14:57:49.058574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896602957965992:9399]
2025-09-30T14:57:49.058580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896602957965992:9399]
2025-09-30T14:57:49.058621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:49.058628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.058631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:49.058778Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:49.062702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:49.062718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:49.062722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:49.066811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2687 sessionId: src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:49.069605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:49.110999Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896603047758841:11465]
2025-09-30T14:57:49.111326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2686, pipe: [1:7555896603047758841:11465]
2025-09-30T14:57:49.172207Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:49.172557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.172575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.172594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047758841:11465], now have 1 active actors on pipe
2025-09-30T14:57:49.172832Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:49.173382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:49.173404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0] Write session will restart in 0.009138s
2025-09-30T14:57:49.173430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0] Write session: Do CDS request
2025-09-30T14:57:49.173435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:49.172882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896603047758841:11465]
2025-09-30T14:57:49.172926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:49.172928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:49.172929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:49.173005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2687 reason: error at write: Disconnected sessionId: src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0
2025-09-30T14:57:49.173218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2687 sessionId: src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0 is DEAD
2025-09-30T14:57:49.183728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:49.183832Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:49.183854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2688
2025-09-30T14:57:49.184024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2688 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:49.184061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2688 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:49.184071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2688 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:49.184074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:49.184624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2688 sessionId:  describe result for acl check
2025-09-30T14:57:49.184667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:49.184674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:49.184676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:49.184682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896603047758889:11958] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:49.185258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896603047758889:11958] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:49.188826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896603047758889:11958] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:49.192073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896603047758889:11958] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:49.192094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896603047758889:11958] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:49.192098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896603047758889:11958] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:49.192107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2688 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:49.196851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:49.199916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:49.200217Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:49.200228Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:49.200238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:49.200288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:49.200326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896602957966286:9378]
2025-09-30T14:57:49.201004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:49.201305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:49.201347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:49.201676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:49.201735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.201741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.201742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.201744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.201745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.201746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.201747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.201748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.201750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.201751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.201752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.201753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.201755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.201756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.201757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.201762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.201773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.201777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.201781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.201785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.201789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.201793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.201802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.201806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.201811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.201815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.201819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.201827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.201831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.201839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.201848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.201862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.201868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.201874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.201879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.201884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.201888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.201894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.201899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.201904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.201908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.201912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.201917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.201922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.201926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.201930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.201935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.201941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.201947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.201952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.201956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.201961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.201966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.201971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.201978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.201988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.201993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.201998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.202003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.202009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.202056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:49.207520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:49.208690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:49.208703Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:49.208706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:49.208709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:49.208716Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2687 [2:7555896602957966286:9378]
2025-09-30T14:57:49.208732Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:49.208749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:49.208757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:49.208759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:49.208762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:49.208778Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:49.208792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:49.208799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:49.208859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.208869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.208871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.208874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:49.208877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:49.208943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:49.208950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.208964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.208990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.209011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:49.209029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047759039:11958], now have 1 active actors on pipe
2025-09-30T14:57:49.209033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047758843:2454], now have 1 active actors on pipe
2025-09-30T14:57:49.209040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896602957966281:9378]
2025-09-30T14:57:49.209043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896602957966281:9378]
2025-09-30T14:57:49.209045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896602957966281:9378]
2025-09-30T14:57:49.209058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:49.209072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:49.209089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:49.209091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:49.209095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:49.209096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:49.209097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:49.209129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896602957966281:9378]
2025-09-30T14:57:49.209137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:49.209146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:49.209131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2687
2025-09-30T14:57:49.209131Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2687
2025-09-30T14:57:49.209174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.209183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.209209Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:49.209217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:49.209225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:49.209227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:49.209238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:49.209252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:49.209269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:49.209393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.209401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.209415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:49.209496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2688 partition: 0 MaxSeqNo: 42 sessionId: src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0
2025-09-30T14:57:49.209832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44128c39-964c2d97-f386c2d9-c5c1d9e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:49.212804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0] Write session: try to update token
2025-09-30T14:57:49.212826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:49.221662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:49.221680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:49.221682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:49.221685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:49.221697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896602957966281:9378]
2025-09-30T14:57:49.221702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896602957966281:9378]
2025-09-30T14:57:49.221705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896602957966281:9378]
2025-09-30T14:57:49.221746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:49.221752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.221752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:49.221755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:49.221758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:49.221762Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:49.221913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:49.227787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2688 sessionId: src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:49.230458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:49.272801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896603047759133:11465]
2025-09-30T14:57:49.273383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2687, pipe: [1:7555896603047759133:11465]
2025-09-30T14:57:49.340486Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:49.340742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.340750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.340788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047759133:11465], now have 1 active actors on pipe
2025-09-30T14:57:49.341029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:49.342137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:49.342150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0] Write session will restart in 0.008762s
2025-09-30T14:57:49.342173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0] Write session: Do CDS request
2025-09-30T14:57:49.342179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:49.341569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:49.341580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896603047759133:11465]
2025-09-30T14:57:49.341602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:49.341665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2688 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0
2025-09-30T14:57:49.341849Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2688 sessionId: src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0 is DEAD
2025-09-30T14:57:49.355415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:49.355766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:49.355787Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2689
2025-09-30T14:57:49.355931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2689 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:49.355965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2689 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:49.355975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2689 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:49.355979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:49.356581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2689 sessionId:  describe result for acl check
2025-09-30T14:57:49.356627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:49.356640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:49.356643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:49.356650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896603047759237:11963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:49.357207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896603047759237:11963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:49.359940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896603047759237:11963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:49.364252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896603047759237:11963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:49.364287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896603047759237:11963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:49.364291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896603047759237:11963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:49.364300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2689 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:49.367142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:49.370700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:49.370948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:49.370962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:49.370975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:49.371047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:49.371093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896602957966564:9371]
2025-09-30T14:57:49.371801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:49.372210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:49.372265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:49.372623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:49.372719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.372727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.372728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.372730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.372731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.372733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.372734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.372735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.372737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.372738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.372740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.372741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.372742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.372744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.372746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.372752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.372763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.372768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.372772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.372777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.372781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.372785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.372790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.372794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.372800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.372804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.372808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.372812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.372815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.372819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.372829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.372837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.372844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.372857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.372862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.372868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.372874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.372879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.372890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.372894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.372899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.372909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.372914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.372919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.372925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.372935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.372941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.372946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.372951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.372957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.372963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.372986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.372995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.373001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.373006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.373016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.373024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.373034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.373038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.373044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.373092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:49.378852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:49.381268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2688
2025-09-30T14:57:49.381276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2688
2025-09-30T14:57:49.380346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:49.380371Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:49.380374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:49.380378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:49.380386Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2688 [2:7555896602957966564:9371]
2025-09-30T14:57:49.380406Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:49.380423Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:49.380426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:49.380429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:49.380432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:49.380449Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:49.380459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:49.380466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:49.380530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.380532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.380535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.380539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:49.380542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:49.380615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:49.380618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.380636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.380648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.380668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:49.380685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896602957966559:9371]
2025-09-30T14:57:49.380687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896602957966559:9371]
2025-09-30T14:57:49.380690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896602957966559:9371]
2025-09-30T14:57:49.380707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:49.380720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:49.380736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:49.380739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:49.380779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896602957966559:9371]
2025-09-30T14:57:49.380782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:49.380875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:49.380877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:49.380879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:49.380884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:49.381173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047759397:11963], now have 1 active actors on pipe
2025-09-30T14:57:49.382444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2689 partition: 0 MaxSeqNo: 42 sessionId: src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0
2025-09-30T14:57:49.381181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047759138:2454], now have 1 active actors on pipe
2025-09-30T14:57:49.381539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.383182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d40709cd-20fe14c4-8d5c3e2d-88a7227a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:49.381549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.381595Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:49.381608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:49.381613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:49.381615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:49.381627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:49.381641Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:49.381663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:49.382316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.382323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.382346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:49.386221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0] Write session: try to update token
2025-09-30T14:57:49.386241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:49.393935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:49.393960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:49.393962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:49.393965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:49.393974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896602957966559:9371]
2025-09-30T14:57:49.393979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896602957966559:9371]
2025-09-30T14:57:49.393983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896602957966559:9371]
2025-09-30T14:57:49.394024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:49.394032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.394034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:49.394177Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:49.394355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:49.394368Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:49.394373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:49.409466Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2689 sessionId: src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:49.412106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:49.441226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896603047759437:11465]
2025-09-30T14:57:49.441571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2688, pipe: [1:7555896603047759437:11465]
2025-09-30T14:57:49.507347Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:49.507931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.507946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.507966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047759437:11465], now have 1 active actors on pipe
2025-09-30T14:57:49.508193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896603047759437:11465]
2025-09-30T14:57:49.508240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:49.508307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2689 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0
2025-09-30T14:57:49.508162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:49.508504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2689 sessionId: src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0 is DEAD
2025-09-30T14:57:49.508649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:49.508659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0] Write session will restart in 0.005427s
2025-09-30T14:57:49.508684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0] Write session: Do CDS request
2025-09-30T14:57:49.508690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:49.508828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:49.517144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:49.517238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:49.517259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2690
2025-09-30T14:57:49.517384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2690 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:49.517417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2690 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:49.517421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2690 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:49.517425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:49.517964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2690 sessionId:  describe result for acl check
2025-09-30T14:57:49.518007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:49.518009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:49.518011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:49.518018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896603047759480:11974] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:49.518596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896603047759480:11974] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:49.521759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896603047759480:11974] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:49.525448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896603047759480:11974] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:49.525466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896603047759480:11974] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:49.525471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896603047759480:11974] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:49.525478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2690 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:49.532535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:49.535172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:49.535395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:49.535409Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:49.535420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:49.535483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:49.535526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896602957966879:9359]
2025-09-30T14:57:49.536180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:49.536565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:49.536623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:49.536996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:49.537080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.537088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.537089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.537091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.537092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.537093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.537095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.537096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.537097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.537098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.537100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.537101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.537102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.537103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.537104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.537110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.537122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.537126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.537131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.537136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.537140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.537144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.537149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.537153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.537158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.537162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.537167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.537171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.537175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.537180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.537188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.537197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.537204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.537210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.537216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.537221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.537226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.537232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.537237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.537243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.537248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.537254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.537259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.537265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.537270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.537276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.537281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.537287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.537292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.537298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.537311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.537318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.537322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.537328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.537333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.537339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.537344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.537350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.537358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.537364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.537411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:49.542931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:49.544108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:49.544127Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:49.544130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:49.544134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:49.544142Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2689 [2:7555896602957966879:9359]
2025-09-30T14:57:49.544160Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:49.544175Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:49.544185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:49.544188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:49.544191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:49.544211Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:49.544222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:49.544229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:49.544296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.544304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.544308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.544311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:49.544314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:49.544386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:49.544393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.544407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.544420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.544443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:49.544468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047759626:11974], now have 1 active actors on pipe
2025-09-30T14:57:49.544476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047759452:2454], now have 1 active actors on pipe
2025-09-30T14:57:49.544484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896602957966874:9359]
2025-09-30T14:57:49.544491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896602957966874:9359]
2025-09-30T14:57:49.544494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896602957966874:9359]
2025-09-30T14:57:49.544512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:49.544533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:49.544535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:49.544519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2689
2025-09-30T14:57:49.544569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2689
2025-09-30T14:57:49.544538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:49.544542Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:49.544549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:49.544553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:49.544585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896602957966874:9359]
2025-09-30T14:57:49.544589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:49.544591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:49.544620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.544633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.544666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:49.544678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:49.544682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:49.544685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:49.544694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:49.544708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:49.544737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:49.544955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.544983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.545004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:49.545101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2690 partition: 0 MaxSeqNo: 42 sessionId: src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0
2025-09-30T14:57:49.545491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e46f0b14-fa6c8758-4b7d671c-8bd417_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:49.548355Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0] Write session: try to update token
2025-09-30T14:57:49.548376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:49.557106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:49.557125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:49.557128Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:49.557130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:49.557140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896602957966874:9359]
2025-09-30T14:57:49.557145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896602957966874:9359]
2025-09-30T14:57:49.557149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896602957966874:9359]
2025-09-30T14:57:49.557192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:49.557199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.557200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:49.557202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:49.557207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:49.557211Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:49.557419Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:49.562915Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2690 sessionId: src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:49.565777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:49.608190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896603047759748:11465]
2025-09-30T14:57:49.608947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2689, pipe: [1:7555896603047759748:11465]
2025-09-30T14:57:49.674713Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:49.675225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.675264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.675307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047759748:11465], now have 1 active actors on pipe
2025-09-30T14:57:49.675632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:49.675651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:49.675736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2690 reason: error at write: Disconnected sessionId: src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0
2025-09-30T14:57:49.675912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2690 sessionId: src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0 is DEAD
2025-09-30T14:57:49.675548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:49.676090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:49.676137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896603047759748:11465]
2025-09-30T14:57:49.679643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:49.679658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0] Write session will restart in 0.006665s
2025-09-30T14:57:49.679684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0] Write session: Do CDS request
2025-09-30T14:57:49.679690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:49.687765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:49.687838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:49.687860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2691
2025-09-30T14:57:49.688028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2691 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:49.688055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2691 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:49.688061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2691 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:49.688065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:49.688521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2691 sessionId:  describe result for acl check
2025-09-30T14:57:49.688553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:49.688557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:49.688559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:49.688565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896603047759799:11979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:49.689149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896603047759799:11979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:49.691839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896603047759799:11979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:49.696573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896603047759799:11979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:49.696593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896603047759799:11979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:49.696596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896603047759799:11979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:49.696605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2691 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:49.699927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:49.702973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:49.703221Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:49.703234Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:49.703261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:49.703330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:49.703385Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896602957967161:9319]
2025-09-30T14:57:49.704076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:49.704502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:49.704601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:49.705025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:49.705127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.705133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.705135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.705135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.705137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.705138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.705139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.705141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.705143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.705144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.705145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.705146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.705147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.705148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.705149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.705155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.705165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.705169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.705172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.705176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.705180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.705184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.705188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.705192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.705197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.705200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.705204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.705207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.705211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.705214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.705224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.705231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.705236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.705242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.705247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.705251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.705256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.705261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.705267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.705271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.705276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.705281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.705285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.705290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.705302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.705307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.705316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.705322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.705326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.705336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.705342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.705347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.705351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.705356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.705366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.705372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.705397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.705412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.705434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.705448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.705505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:49.711229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:49.712471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:49.712491Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:49.712493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:49.712498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:49.712504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2690 [2:7555896602957967161:9319]
2025-09-30T14:57:49.712520Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:49.712542Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:49.712545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:49.712548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:49.712551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:49.712565Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:49.712577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:49.712584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:49.712650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.712657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.712660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.712664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:49.712667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:49.712735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:49.712742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.712756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.712777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.712793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:49.712811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047759994:11979], now have 1 active actors on pipe
2025-09-30T14:57:49.712820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047759750:2454], now have 1 active actors on pipe
2025-09-30T14:57:49.712826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896602957967156:9319]
2025-09-30T14:57:49.712829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896602957967156:9319]
2025-09-30T14:57:49.712831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896602957967156:9319]
2025-09-30T14:57:49.712842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:49.712856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:49.712856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:49.712859Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:49.712862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:49.712876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:49.712879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:49.712915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896602957967156:9319]
2025-09-30T14:57:49.712932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:49.712917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2690
2025-09-30T14:57:49.712924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2690
2025-09-30T14:57:49.712953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:49.713263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.713275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.713303Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:49.713316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:49.713321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:49.713323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:49.713333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:49.713347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:49.713369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:49.713536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.713546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.713561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:49.713663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2691 partition: 0 MaxSeqNo: 42 sessionId: src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0
2025-09-30T14:57:49.714053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1af1a13-99d928ad-96590b6c-4e8e5b3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:49.716871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0] Write session: try to update token
2025-09-30T14:57:49.716894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:49.725487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:49.725511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:49.725514Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:49.725517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:49.725527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896602957967156:9319]
2025-09-30T14:57:49.725532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896602957967156:9319]
2025-09-30T14:57:49.725536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896602957967156:9319]
2025-09-30T14:57:49.725582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:49.725588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:49.725593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.725595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:49.725597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:49.725599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:49.725746Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:49.732003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2691 sessionId: src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:49.734836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:49.776081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896603047760041:11465]
2025-09-30T14:57:49.776434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2690, pipe: [1:7555896603047760041:11465]
2025-09-30T14:57:49.845890Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:49.846347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.846372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.846431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047760041:11465], now have 1 active actors on pipe
2025-09-30T14:57:49.846689Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:49.846682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:49.846697Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896603047760041:11465]
2025-09-30T14:57:49.846701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:49.846719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:49.846768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2691 reason: error at write: Disconnected sessionId: src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0
2025-09-30T14:57:49.846947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2691 sessionId: src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0 is DEAD
2025-09-30T14:57:49.847100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:49.847112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0] Write session will restart in 0.007946s
2025-09-30T14:57:49.847137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0] Write session: Do CDS request
2025-09-30T14:57:49.847146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:49.856767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:49.856884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:49.856917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2692
2025-09-30T14:57:49.857070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2692 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:49.857101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2692 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:49.857107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2692 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:49.857116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:49.857669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2692 sessionId:  describe result for acl check
2025-09-30T14:57:49.857716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:49.857722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:49.857724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:49.857731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896603047760091:11984] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:49.858252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896603047760091:11984] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:49.861244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896603047760091:11984] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:49.864690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896603047760091:11984] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:49.864709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896603047760091:11984] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:49.864713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896603047760091:11984] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:49.864722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2692 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:49.868454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:49.871186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:49.871435Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:49.871448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:49.871462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:49.871523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:49.871569Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896602957967442:9317]
2025-09-30T14:57:49.872227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:49.877902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:49.878022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:49.878840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:49.879003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.879012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.879015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.879019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.879021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.879025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.879028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.879030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.879031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.879032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.879035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.879039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.879040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.879041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.879044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.879052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.879065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.879069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.879075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.879081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.879088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.879093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.879097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.879103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.879107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.879112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.879115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.879120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.879126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.879131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.879144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.879156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:49.879164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.879171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:49.879176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.879183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:49.879189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.879197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:49.879211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.879216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:49.879221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.879228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:49.879238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.879263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:49.879270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.879276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:49.879284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.879304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:49.879314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.879319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:49.879325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.879330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.879337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.879345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.879373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.879386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.879390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.879400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:49.879405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.879411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:49.879459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:49.886724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:49.888190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:49.888208Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:49.888210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:49.888214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:49.888221Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2691 [2:7555896602957967442:9317]
2025-09-30T14:57:49.888238Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:49.888254Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:49.888257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:49.888261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:49.888264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:49.888279Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:49.888286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:49.888299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:49.888365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.888371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.888372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.888375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:49.888378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:49.888445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:49.888455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.888467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:49.888477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:49.888493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:49.888518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896602957967437:9317]
2025-09-30T14:57:49.888524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896602957967437:9317]
2025-09-30T14:57:49.888526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896602957967437:9317]
2025-09-30T14:57:49.888536Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:49.888554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047760268:11984], now have 1 active actors on pipe
2025-09-30T14:57:49.888561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:49.888566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:49.888570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:49.888570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:49.888583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:49.888586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:49.888592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047760043:2454], now have 1 active actors on pipe
2025-09-30T14:57:49.888635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896602957967437:9317]
2025-09-30T14:57:49.888649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:49.888661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:49.888681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2691
2025-09-30T14:57:49.888703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2691
2025-09-30T14:57:49.888767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.888779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.888807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:49.888819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:49.888823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:49.888825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:49.888835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:49.888844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:49.888862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:49.889046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:49.889054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:49.889068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:49.889187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2692 partition: 0 MaxSeqNo: 42 sessionId: src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0
2025-09-30T14:57:49.889594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|896f69fc-3f4a4cdd-32d7eb77-8ad24bd0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:49.892369Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0] Write session: try to update token
2025-09-30T14:57:49.892385Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:49.902813Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:49.902833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:49.902835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:49.902837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:49.902847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896602957967437:9317]
2025-09-30T14:57:49.902851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896602957967437:9317]
2025-09-30T14:57:49.902876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896602957967437:9317]
2025-09-30T14:57:49.902920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:49.902924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:49.902926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:49.902929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:49.902932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:49.902932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:49.903092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:49.909647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2692 sessionId: src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:49.912614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:49.947094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896603047760333:11465]
2025-09-30T14:57:49.947541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2691, pipe: [1:7555896603047760333:11465]
2025-09-30T14:57:50.018700Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:50.019201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.019217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.019280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896603047760333:11465], now have 1 active actors on pipe
2025-09-30T14:57:50.019538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:50.019526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:50.019540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896603047760333:11465]
2025-09-30T14:57:50.019560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:50.019566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:50.019621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2692 reason: error at write: Disconnected sessionId: src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0
2025-09-30T14:57:50.019793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2692 sessionId: src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0 is DEAD
2025-09-30T14:57:50.019976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:50.019984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0] Write session will restart in 0.009966s
2025-09-30T14:57:50.020003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0] Write session: Do CDS request
2025-09-30T14:57:50.020009Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:50.030879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:50.030973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:50.030994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2693
2025-09-30T14:57:50.031147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2693 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:50.031180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2693 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:50.031194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2693 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:50.031204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:50.031707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2693 sessionId:  describe result for acl check
2025-09-30T14:57:50.031745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:50.031752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:50.031753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:50.031760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896607342727695:11988] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:50.032386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896607342727695:11988] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:50.035282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896607342727695:11988] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:50.038457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896607342727695:11988] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:50.038475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896607342727695:11988] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:50.038478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896607342727695:11988] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:50.038487Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2693 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:50.041227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:50.044593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:50.045119Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:50.045135Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:50.045151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:50.045244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:50.045290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896607252935022:9307]
2025-09-30T14:57:50.046024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:50.046379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:50.046432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:50.046776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:50.046849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.046856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.046857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.046858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.046860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.046861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.046862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.046864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.046865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.046866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.046867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.046869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.046870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.046871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.046872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.046878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.046888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.046892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.046896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.046900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.046904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.046907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.046911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.046914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.046919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.046924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.046944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.046949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.046953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.046957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.046968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.046976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.046984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.046990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.046995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.047002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.047006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.047018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.047024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.047030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.047040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.047046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.047051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.047056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.047060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.047072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.047086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.047098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.047104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.047114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.047119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.047130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.047148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.047158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.047163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.047174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.047178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.047189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.047194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.047200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.047271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:50.054032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:50.055413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:50.055428Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:50.055430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:50.055434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:50.055441Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2692 [2:7555896607252935022:9307]
2025-09-30T14:57:50.055459Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:50.055477Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:50.055487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:50.055490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:50.055493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:50.055509Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:50.055516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:50.055522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:50.055589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.055599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.055601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.055605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:50.055607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:50.055676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:50.055684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.055698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.055714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.055731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:50.055755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342727631:2454], now have 1 active actors on pipe
2025-09-30T14:57:50.055763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342727886:11988], now have 1 active actors on pipe
2025-09-30T14:57:50.055769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896607252935017:9307]
2025-09-30T14:57:50.055773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896607252935017:9307]
2025-09-30T14:57:50.055775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896607252935017:9307]
2025-09-30T14:57:50.055789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:50.055807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:50.055816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:50.055820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:50.055822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:50.055827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:50.055831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:50.055865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896607252935017:9307]
2025-09-30T14:57:50.055872Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:50.055874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:50.055846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2692
2025-09-30T14:57:50.055851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2692
2025-09-30T14:57:50.055901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.055911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.056116Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|529352a6-9bda607e-f2246d48-19e7473e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:50.056129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:50.056134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:50.056136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:50.056146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:50.056161Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:50.056190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:50.056338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.056351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.056375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:50.056544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2693 partition: 0 MaxSeqNo: 42 sessionId: src_id|529352a6-9bda607e-f2246d48-19e7473e_0
2025-09-30T14:57:50.056908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0757108-db80c9d6-8f0e99b3-bbfb6cbb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|529352a6-9bda607e-f2246d48-19e7473e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:50.059757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|529352a6-9bda607e-f2246d48-19e7473e_0] Write session: try to update token
2025-09-30T14:57:50.059776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|529352a6-9bda607e-f2246d48-19e7473e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:50.071451Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:50.071474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:50.071476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:50.071478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:50.071487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896607252935017:9307]
2025-09-30T14:57:50.071492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896607252935017:9307]
2025-09-30T14:57:50.071496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896607252935017:9307]
2025-09-30T14:57:50.071540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:50.071547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.071547Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:50.071550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:50.071557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:50.071571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:50.071704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:50.074603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2693 sessionId: src_id|529352a6-9bda607e-f2246d48-19e7473e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:50.077503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:50.119586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896607342727922:11465]
2025-09-30T14:57:50.119914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2692, pipe: [1:7555896607342727922:11465]
2025-09-30T14:57:50.188546Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:50.188903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.188925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.188980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342727922:11465], now have 1 active actors on pipe
2025-09-30T14:57:50.189237Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:50.189262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:50.189283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:50.189294Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896607342727922:11465]
2025-09-30T14:57:50.189314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:50.189351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2693 reason: error at write: Disconnected sessionId: src_id|529352a6-9bda607e-f2246d48-19e7473e_0
2025-09-30T14:57:50.189541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2693 sessionId: src_id|529352a6-9bda607e-f2246d48-19e7473e_0 is DEAD
2025-09-30T14:57:50.189762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529352a6-9bda607e-f2246d48-19e7473e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:50.189775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529352a6-9bda607e-f2246d48-19e7473e_0] Write session will restart in 0.007943s
2025-09-30T14:57:50.189811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529352a6-9bda607e-f2246d48-19e7473e_0] Write session: Do CDS request
2025-09-30T14:57:50.189823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529352a6-9bda607e-f2246d48-19e7473e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:50.198852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|529352a6-9bda607e-f2246d48-19e7473e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:50.198929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:50.198955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2694
2025-09-30T14:57:50.199095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2694 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:50.199129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2694 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:50.199140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2694 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:50.199144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:50.199836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2694 sessionId:  describe result for acl check
2025-09-30T14:57:50.199874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:50.199881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:50.199883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:50.199904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896607342727960:11992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:50.200491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896607342727960:11992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:50.203953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896607342727960:11992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:50.207525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896607342727960:11992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:50.207543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896607342727960:11992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:50.207545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896607342727960:11992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:50.207551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2694 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:50.213880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:50.217664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:50.218010Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:50.218031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:50.218050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:50.218157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:50.218232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896607252935318:9292]
2025-09-30T14:57:50.219034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:50.219504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:50.219585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:50.220002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:50.220080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.220087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.220088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.220089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.220091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.220093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.220094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.220095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.220097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.220098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.220100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.220101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.220103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.220104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.220105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.220111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.220122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.220127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.220132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.220136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.220140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.220144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.220148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.220153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.220158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.220162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.220166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.220170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.220175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.220179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.220188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.220197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.220203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.220209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.220214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.220220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.220225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.220231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.220235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.220241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.220245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.220251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.220255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.220260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.220268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.220279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.220284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.220290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.220295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.220301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.220307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.220312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.220317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.220331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.220336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.220347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.220352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.220357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.220362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.220373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.220433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:50.228343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:50.229444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:50.229463Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:50.229465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:50.229470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:50.229477Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2693 [2:7555896607252935318:9292]
2025-09-30T14:57:50.229496Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:50.229518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:50.229532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:50.229535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:50.229538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:50.229556Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:50.229564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:50.229572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:50.229640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.229649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.229651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.229656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:50.229658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:50.229735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:50.229743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.229756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.229774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.229795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:50.229824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342728120:11992], now have 1 active actors on pipe
2025-09-30T14:57:50.229832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896607252935312:9292]
2025-09-30T14:57:50.229835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896607252935312:9292]
2025-09-30T14:57:50.229837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896607252935312:9292]
2025-09-30T14:57:50.229851Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:50.229863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342727924:2454], now have 1 active actors on pipe
2025-09-30T14:57:50.229874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:50.229879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:50.229883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:50.229885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:50.229893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:50.229897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:50.229937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896607252935312:9292]
2025-09-30T14:57:50.229951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:50.229958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:50.229960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2693
2025-09-30T14:57:50.230005Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2693
2025-09-30T14:57:50.230462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.230473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.230505Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:50.230519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:50.230528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:50.230530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:50.230541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:50.230553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:50.230573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:50.230795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.230810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.230845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:50.230929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2694 partition: 0 MaxSeqNo: 42 sessionId: src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0
2025-09-30T14:57:50.231331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|529352a6-9bda607e-f2246d48-19e7473e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:50.234338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0] Write session: try to update token
2025-09-30T14:57:50.234358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:50.245404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:50.245427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:50.245429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:50.245431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:50.245442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896607252935312:9292]
2025-09-30T14:57:50.245448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896607252935312:9292]
2025-09-30T14:57:50.245452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896607252935312:9292]
2025-09-30T14:57:50.245493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:50.245500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.245503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:50.245587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:50.245603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:50.245607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:50.245642Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:50.250159Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2694 sessionId: src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:50.253106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:50.290035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896607342728223:11465]
2025-09-30T14:57:50.290358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2693, pipe: [1:7555896607342728223:11465]
2025-09-30T14:57:50.360617Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:50.360954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.360985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.361028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342728223:11465], now have 1 active actors on pipe
2025-09-30T14:57:50.361277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:50.361342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:50.361364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:50.361430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2694 reason: error at write: Disconnected sessionId: src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0
2025-09-30T14:57:50.361642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2694 sessionId: src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0 is DEAD
2025-09-30T14:57:50.361848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:50.361840Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:50.361858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0] Write session will restart in 0.008174s
2025-09-30T14:57:50.361895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0] Write session: Do CDS request
2025-09-30T14:57:50.361902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:50.361889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896607342728223:11465]
2025-09-30T14:57:50.370911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:50.371016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:50.371046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2695
2025-09-30T14:57:50.371220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2695 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:50.371284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2695 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:50.371295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2695 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:50.371300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:50.371895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2695 sessionId:  describe result for acl check
2025-09-30T14:57:50.371932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:50.371940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:50.371942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:50.371948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896607342728258:11997] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:50.372534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896607342728258:11997] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:50.378258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896607342728258:11997] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:50.381177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896607342728258:11997] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:50.381199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896607342728258:11997] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:50.381203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896607342728258:11997] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:50.381211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2695 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:50.385291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:50.388481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:50.388694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:50.388704Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:50.388712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:50.388757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:50.388797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896607252935602:9290]
2025-09-30T14:57:50.389326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:50.389593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:50.389628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:50.389865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:50.389910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.389915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.389916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.389917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.389918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.389919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.389920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.389921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.389922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.389922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.389923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.389924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.389925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.389925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.389926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.389930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.389937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.389941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.389945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.389948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.389952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.389956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.389960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.389963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.389967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.389971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.389975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.389978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.389982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.389986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.389994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.390002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.390007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.390013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.390018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.390023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.390028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.390033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.390038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.390043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.390048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.390054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.390061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.390066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.390070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.390077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.390081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.390087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.390092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.390098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.390103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.390109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.390114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.390120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.390125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.390130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.390145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.390151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.390157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.390162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.390209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:50.399131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:50.400526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:50.400556Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:50.400560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:50.400566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:50.400575Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2694 [2:7555896607252935602:9290]
2025-09-30T14:57:50.400598Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:50.400624Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:50.400637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:50.400642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:50.400645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:50.400668Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:50.400686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:50.400702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:50.400802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.400812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.400814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.400818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:50.400821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:50.400898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:50.400906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.400921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.400941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.400959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:50.400994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896607252935597:9290]
2025-09-30T14:57:50.401003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896607252935597:9290]
2025-09-30T14:57:50.401006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896607252935597:9290]
2025-09-30T14:57:50.401017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:50.401026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:50.401029Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:50.401041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:50.401041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:50.401060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:50.401066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:50.401088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342728449:11997], now have 1 active actors on pipe
2025-09-30T14:57:50.401101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342728228:2454], now have 1 active actors on pipe
2025-09-30T14:57:50.401125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2694
2025-09-30T14:57:50.401164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2694
2025-09-30T14:57:50.401170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896607252935597:9290]
2025-09-30T14:57:50.401190Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:50.401321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:50.401618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.401631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.401664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:50.401673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:50.401679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:50.401681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:50.401694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:50.401708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:50.401727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:50.402081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.402094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.402127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:50.403519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77f3fa32-1306d78e-6fd158a8-10e7c66b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:50.402283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2695 partition: 0 MaxSeqNo: 42 sessionId: src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0
2025-09-30T14:57:50.406398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0] Write session: try to update token
2025-09-30T14:57:50.406418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:50.418026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:50.418050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:50.418060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896607252935597:9290]
2025-09-30T14:57:50.418109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:50.418112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:50.418322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:50.418491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:50.418652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:50.418806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:50.419117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:50.419176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:50.428534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2695 sessionId: src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:50.431746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:50.432389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.432419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.432439Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:50.432441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:50.432443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:50.432444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:50.432451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896607252935597:9290]
2025-09-30T14:57:50.432454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896607252935597:9290]
2025-09-30T14:57:50.432458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896607252935597:9290]
2025-09-30T14:57:50.432499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:50.432509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.432510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:50.432516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:50.432524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:50.432535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:50.432653Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:50.462155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896607342728533:11465]
2025-09-30T14:57:50.462478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2694, pipe: [1:7555896607342728533:11465]
2025-09-30T14:57:50.547971Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:50.548623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:50.548663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342728533:11465], now have 1 active actors on pipe
2025-09-30T14:57:50.548904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:50.549040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:50.549049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:50.549143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2695 reason: error at write: Disconnected sessionId: src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0
2025-09-30T14:57:50.549293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2695 sessionId: src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0 is DEAD
2025-09-30T14:57:50.549426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:50.549435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0] Write session will restart in 0.007353s
2025-09-30T14:57:50.549458Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0] Write session: Do CDS request
2025-09-30T14:57:50.549464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:50.549509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896607342728533:11465]
2025-09-30T14:57:50.549535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:50.557772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:50.559373Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:50.559395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2696
2025-09-30T14:57:50.559912Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2696 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:50.559960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2696 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:50.559970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2696 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:50.559975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:50.564153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2696 sessionId:  describe result for acl check
2025-09-30T14:57:50.564195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:50.564198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:50.564199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:50.564205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896607342728570:12008] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:50.564736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896607342728570:12008] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:50.570166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896607342728570:12008] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:50.577122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896607342728570:12008] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:50.577150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896607342728570:12008] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:50.577154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896607342728570:12008] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:50.577162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2696 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:50.584199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:50.587904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:50.588133Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:50.588143Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:50.588154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:50.588211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:50.588255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896607252935925:9281]
2025-09-30T14:57:50.588922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:50.589283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:50.589346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:50.589903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:50.589985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.589986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.589988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.589989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.589990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.589991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.589992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.589994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.589995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.589996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.589998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.589999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.590000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.590001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.590002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.590009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.590019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.590024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.590028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.590032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.590036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.590040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.590044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.590048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.590052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.590057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.590061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.590065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.590069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.590072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.590080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.590088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.590094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.590099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.590104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.590110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.590114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.590119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.590125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.590130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.590134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.590138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.590141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.590144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.590149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.590154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.590159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.590163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.590168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.590174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.590179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.590185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.590189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.590194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.590199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.590205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.590212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.590217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.590223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.590239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.590286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:50.597140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:50.598336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:50.598349Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:50.598351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:50.598354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:50.598360Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2695 [2:7555896607252935925:9281]
2025-09-30T14:57:50.598373Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:50.598387Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:50.598389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:50.598392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:50.598395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:50.598412Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:50.598419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:50.598426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:50.598496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.598504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.598507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.598510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:50.598513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:50.598786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2695
2025-09-30T14:57:50.598837Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2695
2025-09-30T14:57:50.598584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:50.598595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.598610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.598621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.598637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:50.598656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342728724:12008], now have 1 active actors on pipe
2025-09-30T14:57:50.598660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342728549:2454], now have 1 active actors on pipe
2025-09-30T14:57:50.598667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896607252935920:9281]
2025-09-30T14:57:50.598669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896607252935920:9281]
2025-09-30T14:57:50.598672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896607252935920:9281]
2025-09-30T14:57:50.598687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:50.598699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:50.598709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:50.598714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:50.598714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:50.598716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:50.598718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:50.598762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896607252935920:9281]
2025-09-30T14:57:50.598771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:50.598790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:50.599001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.599014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.599056Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:50.599069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:50.599078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:50.599080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:50.599091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:50.599106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:50.599128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:50.599335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.599343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.599358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:50.599901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2696 partition: 0 MaxSeqNo: 42 sessionId: src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0
2025-09-30T14:57:50.603536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45e56e50-99044af-e0f95ba5-62e9cc65_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:50.606503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0] Write session: try to update token
2025-09-30T14:57:50.606529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:50.621003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:50.621025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:50.621037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896607252935920:9281]
2025-09-30T14:57:50.621095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:50.621103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:50.621288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:50.621461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:50.621617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:50.621775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:50.621996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:50.622051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:50.622903Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2696 sessionId: src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:50.625762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:50.626001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.626020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.626057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:50.626128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:50.628679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:50.628696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:50.628698Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:50.628701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:50.628711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896607252935920:9281]
2025-09-30T14:57:50.628715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896607252935920:9281]
2025-09-30T14:57:50.628719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896607252935920:9281]
2025-09-30T14:57:50.628758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:50.628761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:50.628765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.628768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:50.628768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:50.628773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:50.628915Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:50.647459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896607342728851:11465]
2025-09-30T14:57:50.647814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2695, pipe: [1:7555896607342728851:11465]
2025-09-30T14:57:50.743760Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:50.744236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342728851:11465], now have 1 active actors on pipe
2025-09-30T14:57:50.751597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.751620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.751775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:50.751838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:50.751903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:50.751967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:50.752018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:50.752029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:50.752101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:50.752168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:50.752237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:50.752301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:50.752346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:50.752352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:50.752424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:50.752487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:50.752558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:50.752619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:50.752668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:50.752671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:50.752743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:50.753133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:50.753197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:50.753265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:50.753401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:50.753408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:50.753474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:50.753534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:50.753593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:50.753663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:50.753714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:50.753723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:50.753787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:50.753853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:50.753918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:50.753985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:50.754027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:50.754032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:50.754094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:50.754151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:50.754211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:50.754287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:50.754337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:50.754345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:50.754410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:50.754471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:50.754533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:50.754592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:50.754709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:50.754715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:50.754780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:50.754846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:50.754915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:50.754979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:50.755042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:50.755054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:50.755120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:50.755177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:50.755235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:50.755320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:50.755446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:50.755455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:50.755900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896607342728851:11465]
2025-09-30T14:57:50.755948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:50.755973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:50.756003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2696 reason: error at write: Disconnected sessionId: src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0
2025-09-30T14:57:50.756156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:50.756201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2696 sessionId: src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0 is DEAD
2025-09-30T14:57:50.756189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:50.756353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:50.756366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0] Write session will restart in 0.005548s
2025-09-30T14:57:50.756397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0] Write session: Do CDS request
2025-09-30T14:57:50.756404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:50.762790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:50.762903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:50.762922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2697
2025-09-30T14:57:50.763052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2697 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:50.763083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2697 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:50.763092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2697 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:50.763097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:50.763527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2697 sessionId:  describe result for acl check
2025-09-30T14:57:50.763576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:50.763585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:50.763587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:50.763593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896607342728875:12014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:50.764525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896607342728875:12014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:50.769135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896607342728875:12014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:50.772766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896607342728875:12014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:50.772787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896607342728875:12014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:50.772791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896607342728875:12014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:50.772800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2697 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:50.779402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:50.782432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:50.782685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:50.782699Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:50.782711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:50.782767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:50.782807Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896607252936211:9265]
2025-09-30T14:57:50.783376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:50.783745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:50.783804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:50.784125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:50.784190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.784197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.784198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.784199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.784201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.784202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.784204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.784205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.784206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.784208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.784209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.784211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.784212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.784214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.784215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.784221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.784232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.784237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.784242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.784246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.784250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.784255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.784259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.784263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.784270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.784274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.784278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.784282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.784286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.784289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.784297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.784305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.784311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.784318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.784323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.784329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.784333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.784339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.784345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.784350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.784355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.784360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.784365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.784376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.784380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.784386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.784397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.784402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.784411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.784417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.784431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.784436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.784446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.784451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.784456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.784465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.784470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.784480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.784485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.784490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.784539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:50.790341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:50.791419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:50.791435Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:50.791437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:50.791441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:50.791449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2696 [2:7555896607252936211:9265]
2025-09-30T14:57:50.791467Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:50.791484Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:50.791488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:50.791491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:50.791494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:50.791510Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:50.791522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:50.791530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:50.791598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.791607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.791610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.791614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:50.791616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:50.791850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2696
2025-09-30T14:57:50.791868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2696
2025-09-30T14:57:50.792089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:50.792100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.792115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.792131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.792158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:50.792183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342729016:12014], now have 1 active actors on pipe
2025-09-30T14:57:50.792192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342728856:2454], now have 1 active actors on pipe
2025-09-30T14:57:50.792213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.792220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.792236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896607252936206:9265]
2025-09-30T14:57:50.792245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896607252936206:9265]
2025-09-30T14:57:50.792248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896607252936206:9265]
2025-09-30T14:57:50.792262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:50.792275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:50.792278Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:50.792282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:50.792284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:50.792292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:50.792295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:50.792311Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:50.792324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:50.792332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:50.792334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:50.792345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:50.792355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:50.792391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896607252936206:9265]
2025-09-30T14:57:50.792403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:50.792410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:50.792416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:50.792624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.792632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.792646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:50.792771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2697 partition: 0 MaxSeqNo: 42 sessionId: src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0
2025-09-30T14:57:50.793174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6ca05850-bb3b018c-45967d76-88d42ff5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:50.796055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0] Write session: try to update token
2025-09-30T14:57:50.796076Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:50.804669Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:50.804689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:50.804698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896607252936206:9265]
2025-09-30T14:57:50.804743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:50.804742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:50.804928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:50.805096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:50.805253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:50.805407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:50.805617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:50.805660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:50.815929Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2697 sessionId: src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:50.817632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:50.817657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:50.817660Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:50.817662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:50.817671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896607252936206:9265]
2025-09-30T14:57:50.817676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896607252936206:9265]
2025-09-30T14:57:50.817680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896607252936206:9265]
2025-09-30T14:57:50.817724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:50.817726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:50.817731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:50.817732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.817734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:50.817739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:50.817889Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:50.818731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:50.855865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896607342729150:11465]
2025-09-30T14:57:50.859657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2696, pipe: [1:7555896607342729150:11465]
2025-09-30T14:57:50.935961Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:50.936520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.936538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.936559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342729150:11465], now have 1 active actors on pipe
2025-09-30T14:57:50.936934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:50.936848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896607342729150:11465]
2025-09-30T14:57:50.936850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:50.936855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:50.936902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:50.936933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2697 reason: error at write: Disconnected sessionId: src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0
2025-09-30T14:57:50.937124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2697 sessionId: src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0 is DEAD
2025-09-30T14:57:50.937758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:50.937769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0] Write session will restart in 0.005655s
2025-09-30T14:57:50.937793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0] Write session: Do CDS request
2025-09-30T14:57:50.937802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:50.944796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:50.944931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:50.944952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2698
2025-09-30T14:57:50.945078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2698 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:50.945111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2698 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:50.945122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2698 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:50.945126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:50.945579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2698 sessionId:  describe result for acl check
2025-09-30T14:57:50.945619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:50.945629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:50.945631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:50.945637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896607342729172:12018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:50.946206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896607342729172:12018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:50.949211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896607342729172:12018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:50.953080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896607342729172:12018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:50.953096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896607342729172:12018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:50.953100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896607342729172:12018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:50.953109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2698 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:50.966133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:50.969299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:50.969504Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:50.969508Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:50.969518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:50.969586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:50.969623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896607252936499:9263]
2025-09-30T14:57:50.970312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:50.970605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:50.970652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:50.970991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:50.971054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.971055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.971075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.971076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.971078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.971079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.971080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.971082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.971083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.971085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.971086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.971088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.971090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.971091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.971092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.971098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.971109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.971113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.971118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.971122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.971126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.971131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.971135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.971139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.971144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.971149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.971153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.971157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.971161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.971165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.971174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.971182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:50.971191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.971197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:50.971203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.971209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:50.971214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.971220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:50.971226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.971233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:50.971237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.971266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:50.971272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.971277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:50.971282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.971288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:50.971294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.971299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:50.971304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.971311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:50.971316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.971324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.971329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.971335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.971340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.971346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.971350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.971356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:50.971362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.971368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:50.971420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:50.977001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:50.978012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:50.978028Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:50.978030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:50.978033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:50.978038Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2697 [2:7555896607252936499:9263]
2025-09-30T14:57:50.978051Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:50.978064Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:50.978066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:50.978068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:50.978069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:50.978082Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:50.978087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:50.978092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:50.978422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2697
2025-09-30T14:57:50.978456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2697
2025-09-30T14:57:50.978140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.978147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.978149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.978151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:50.978154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:50.978223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:50.978226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.978238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:50.978250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:50.978269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:50.978287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342729291:12018], now have 1 active actors on pipe
2025-09-30T14:57:50.978291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896607342729153:2454], now have 1 active actors on pipe
2025-09-30T14:57:50.978297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896607252936494:9263]
2025-09-30T14:57:50.978299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896607252936494:9263]
2025-09-30T14:57:50.978301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896607252936494:9263]
2025-09-30T14:57:50.978315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:50.978326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:50.978341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:50.978345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:50.978378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896607252936494:9263]
2025-09-30T14:57:50.978380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:50.978480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:50.978481Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:50.978483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:50.978486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:50.978650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.978659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.978690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:50.978697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:50.978703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:50.978706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:50.978716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:50.978727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:50.978741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:50.979144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:50.979153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:50.979171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:50.979297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2698 partition: 0 MaxSeqNo: 42 sessionId: src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0
2025-09-30T14:57:50.979714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a036cf6-12d59e4c-1b9cf4ff-47727b23_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:50.982769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0] Write session: try to update token
2025-09-30T14:57:50.982791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:50.991399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:50.991420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:50.991423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:50.991425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:50.991438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896607252936494:9263]
2025-09-30T14:57:50.991443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896607252936494:9263]
2025-09-30T14:57:50.991446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896607252936494:9263]
2025-09-30T14:57:50.991488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:50.991495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:50.991498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:50.991504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:50.991511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:50.991516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:50.991637Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:51.001504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2698 sessionId: src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:51.004499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:51.037126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896611637696748:11465]
2025-09-30T14:57:51.037465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2697, pipe: [1:7555896611637696748:11465]
2025-09-30T14:57:51.105720Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:51.106309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.106328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.106352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637696748:11465], now have 1 active actors on pipe
2025-09-30T14:57:51.106542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:51.106595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896611637696748:11465]
2025-09-30T14:57:51.106611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:51.106622Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:51.106704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2698 reason: status is not ok: tablet will be restarted right now sessionId: src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0
2025-09-30T14:57:51.106910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2698 sessionId: src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0 is DEAD
2025-09-30T14:57:51.107038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:51.107047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0] Write session will restart in 0.008205s
2025-09-30T14:57:51.107074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0] Write session: Do CDS request
2025-09-30T14:57:51.107080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:51.116824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:51.116937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:51.116953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2699
2025-09-30T14:57:51.117101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2699 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:51.117144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2699 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:51.117153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2699 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:51.117158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:51.117688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2699 sessionId:  describe result for acl check
2025-09-30T14:57:51.117725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:51.117730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:51.117732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:51.117738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896611637696797:12022] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:51.118280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896611637696797:12022] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:51.121711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896611637696797:12022] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:51.128269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896611637696797:12022] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:51.128286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896611637696797:12022] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:51.128290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896611637696797:12022] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:51.128298Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2699 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:51.129304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:51.132045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:51.132259Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:51.132274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:51.132285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:51.132337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:51.132381Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896611547904086:9245]
2025-09-30T14:57:51.133025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:51.133335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:51.133381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:51.133724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:51.133805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.133817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.133818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.133819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.133820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.133821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.133822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.133824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.133825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.133826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.133827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.133828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.133829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.133831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.133832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.133837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.133847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.133851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.133855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.133859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.133863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.133866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.133869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.133873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.133878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.133881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.133885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.133890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.133894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.133898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.133909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.133917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.133923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.133930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.133940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.133950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.133955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.133962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.133967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.133978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.133987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.133993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.134003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.134014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.134023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.134033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.134043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.134055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.134060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.134065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.134070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.134082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.134086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.134091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.134097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.134103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.134108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.134113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.134119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.134124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.134170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:51.139967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:51.141053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:51.141073Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:51.141076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:51.141080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:51.141087Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2698 [2:7555896611547904086:9245]
2025-09-30T14:57:51.141106Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:51.141121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:51.141124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:51.141128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:51.141130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:51.141146Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:51.141153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:51.141160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:51.141224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.141234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.141236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.141240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:51.141242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:51.141314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:51.141325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.141340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.141353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.141373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:51.141392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637696750:2454], now have 1 active actors on pipe
2025-09-30T14:57:51.141402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637697034:12022], now have 1 active actors on pipe
2025-09-30T14:57:51.141409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896611547904081:9245]
2025-09-30T14:57:51.141412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896611547904081:9245]
2025-09-30T14:57:51.141414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896611547904081:9245]
2025-09-30T14:57:51.141427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:51.141444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:51.141450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:51.141454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:51.141457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:51.141466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:51.141469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:51.141509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896611547904081:9245]
2025-09-30T14:57:51.141526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:51.141508Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2698
2025-09-30T14:57:51.141518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2698
2025-09-30T14:57:51.141545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:51.141592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.141602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.141630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:51.141642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:51.141646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:51.141648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:51.141658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:51.141667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:51.141681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:51.141837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.141845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.141859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:51.141948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2699 partition: 0 MaxSeqNo: 42 sessionId: src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0
2025-09-30T14:57:51.142335Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89ca6ce7-3403b857-ce703801-f8132ed4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:51.145279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0] Write session: try to update token
2025-09-30T14:57:51.145302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:51.153795Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:51.153815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:51.153824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896611547904081:9245]
2025-09-30T14:57:51.153871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:51.153887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:51.154051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:51.154204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:51.154351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:51.154507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:51.154706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:51.154757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:51.160698Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2699 sessionId: src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:51.163436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:51.163629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.163653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.163689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:51.163790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:51.168830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:51.168852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:51.168855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:51.168857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:51.168867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896611547904081:9245]
2025-09-30T14:57:51.168871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896611547904081:9245]
2025-09-30T14:57:51.168875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896611547904081:9245]
2025-09-30T14:57:51.168914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:51.168916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:51.168922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.168922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:51.168924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:51.168927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:51.169085Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:51.207403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896611637697049:11465]
2025-09-30T14:57:51.207698Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2698, pipe: [1:7555896611637697049:11465]
2025-09-30T14:57:51.285852Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:51.295322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.295358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.295547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:51.295618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:51.295685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:51.295752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:51.295796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:51.295817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:51.295894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:51.295964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:51.296034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:51.299117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896611637697049:11465]
2025-09-30T14:57:51.299142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:51.299176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:51.299178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:51.299203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2699 reason: error at write: Disconnected sessionId: src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0
2025-09-30T14:57:51.296107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:51.296163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:51.296167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:51.296239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:51.296302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:51.296371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:51.296441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:51.296485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:51.296489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:51.296570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:51.296635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:51.296705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:51.296769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:51.296812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:51.296815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:51.296892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:51.296953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:51.297037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:51.297101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:51.297147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:51.297150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:51.297222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:51.297281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:51.297346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:51.297425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:51.297477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:51.297480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:51.297552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:51.297614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:51.297682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:51.297749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:51.297811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:51.297814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:51.297886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:51.299403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2699 sessionId: src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0 is DEAD
2025-09-30T14:57:51.299591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:51.299602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0] Write session will restart in 0.007812s
2025-09-30T14:57:51.299626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0] Write session: Do CDS request
2025-09-30T14:57:51.299632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:51.297951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:51.298016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:51.298081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:51.298127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:51.298131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:51.298204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:51.298266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:51.298331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:51.298393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:51.298434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:51.298437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:51.298509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:51.298571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:51.298634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:51.298699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:51.298743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:51.298746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:51.298823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637697049:11465], now have 1 active actors on pipe
2025-09-30T14:57:51.300544Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:51.308816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:51.308926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:51.308944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2700
2025-09-30T14:57:51.309105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2700 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:51.309145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2700 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:51.309158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2700 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:51.309162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:51.309635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2700 sessionId:  describe result for acl check
2025-09-30T14:57:51.309673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:51.309682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:51.309684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:51.309690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896611637697082:12027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:51.310258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896611637697082:12027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:51.314513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896611637697082:12027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:51.321236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896611637697082:12027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:51.321254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896611637697082:12027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:51.321258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896611637697082:12027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:51.321267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2700 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:51.326907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:51.330142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:51.330383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:51.330398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:51.330413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:51.330506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:51.330552Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896611547904388:9238]
2025-09-30T14:57:51.331377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:51.331856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:51.331942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:51.332308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:51.332388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.332389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.332391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.332392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.332393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.332395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.332396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.332398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.332399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.332400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.332402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.332403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.332405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.332406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.332407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.332413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.332425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.332428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.332433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.332437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.332441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.332445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.332449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.332453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.332458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.332462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.332465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.332469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.332473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.332477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.332485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.332494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.332500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.332505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.332511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.332517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.332522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.332527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.332533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.332538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.332542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.332547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.332552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.332558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.332562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.332566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.332571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.332576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.332581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.332587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.332592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.332600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.332604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.332610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.332614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.332620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.332624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.332629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.332634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.332640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.332682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:51.339979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:51.341072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:51.341088Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:51.341090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:51.341095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:51.341102Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2699 [2:7555896611547904388:9238]
2025-09-30T14:57:51.341122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:51.341145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:51.341153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:51.341157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:51.341159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:51.341175Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:51.341193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:51.341200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:51.341268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.341559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2699
2025-09-30T14:57:51.341271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.341574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2699
2025-09-30T14:57:51.341273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.341277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:51.341280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:51.341352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:51.341355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.341369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.341383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.341403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:51.341421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896611547904383:9238]
2025-09-30T14:57:51.341424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896611547904383:9238]
2025-09-30T14:57:51.341426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896611547904383:9238]
2025-09-30T14:57:51.341435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:51.341449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637697058:2454], now have 1 active actors on pipe
2025-09-30T14:57:51.341454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637697268:12027], now have 1 active actors on pipe
2025-09-30T14:57:51.341456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:51.341459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:51.341462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:51.341462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:51.341477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:51.341482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:51.341520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896611547904383:9238]
2025-09-30T14:57:51.341530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:51.341753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:51.341846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.341859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.341893Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:51.341905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:51.341914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:51.341916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:51.341933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:51.341949Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:51.341968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:51.347410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.347436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.347471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:51.347687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2700 partition: 0 MaxSeqNo: 42 sessionId: src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0
2025-09-30T14:57:51.351571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f0d1646e-973425f0-c5e709ff-c4358e26_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:51.354300Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:51.354326Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:51.354328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:51.354331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:51.354341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896611547904383:9238]
2025-09-30T14:57:51.354346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896611547904383:9238]
2025-09-30T14:57:51.354350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896611547904383:9238]
2025-09-30T14:57:51.354397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:51.354405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.354408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:51.354570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:51.354707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0] Write session: try to update token
2025-09-30T14:57:51.354731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:51.359393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:51.359418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:51.359424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:51.384488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2700 sessionId: src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:51.387634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:51.399110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896611637697370:11465]
2025-09-30T14:57:51.402270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2699, pipe: [1:7555896611637697370:11465]
2025-09-30T14:57:51.477746Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:51.478611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.478629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.478652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637697370:11465], now have 1 active actors on pipe
2025-09-30T14:57:51.478896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:51.478914Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:51.478931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:51.478936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:51.478973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896611637697370:11465]
2025-09-30T14:57:51.478997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2700 reason: error at write: Disconnected sessionId: src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0
2025-09-30T14:57:51.479196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2700 sessionId: src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0 is DEAD
2025-09-30T14:57:51.479362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:51.479375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0] Write session will restart in 0.007434s
2025-09-30T14:57:51.479412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0] Write session: Do CDS request
2025-09-30T14:57:51.479420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:51.487819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:51.487915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:51.487934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2701
2025-09-30T14:57:51.488085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2701 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:51.488118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2701 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:51.488129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2701 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:51.488133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:51.488603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2701 sessionId:  describe result for acl check
2025-09-30T14:57:51.488659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:51.488665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:51.488669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:51.488675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896611637697396:12032] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:51.489160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896611637697396:12032] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:51.492727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896611637697396:12032] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:51.496572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896611637697396:12032] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:51.496585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896611637697396:12032] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:51.496589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896611637697396:12032] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:51.496597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2701 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:51.501838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:51.504943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:51.505182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:51.505197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:51.505209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:51.505271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:51.505311Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896611547904678:9235]
2025-09-30T14:57:51.505986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:51.506378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:51.506462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:51.506839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:51.506912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.506913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.506915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.506916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.506917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.506919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.506920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.506922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.506923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.506925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.506926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.506927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.506928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.506930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.506931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.506937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.506949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.506954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.506958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.506963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.506967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.506971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.506975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.506980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.506986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.506990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.506994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.507011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.507015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.507020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.507028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.507038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.507044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.507050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.507056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.507062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.507070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.507076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.507081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.507088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.507092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.507098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.507103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.507107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.507112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.507118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.507124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.507129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.507134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.507139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.507144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.507150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.507156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.507161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.507167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.507172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.507178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.507184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.507190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.507195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.507263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:51.514262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2700
2025-09-30T14:57:51.514278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2700
2025-09-30T14:57:51.512974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:51.513822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:51.513828Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:51.513832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:51.513836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:51.513844Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2700 [2:7555896611547904678:9235]
2025-09-30T14:57:51.513862Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:51.513881Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:51.513884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:51.513888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:51.513890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:51.513908Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:51.513916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:51.513923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:51.513987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.513990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.513992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.513998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:51.514001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:51.514086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:51.514088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.514103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.514116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.514134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:51.514154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637697372:2454], now have 1 active actors on pipe
2025-09-30T14:57:51.514158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637697557:12032], now have 1 active actors on pipe
2025-09-30T14:57:51.514164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896611547904673:9235]
2025-09-30T14:57:51.514167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896611547904673:9235]
2025-09-30T14:57:51.514170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896611547904673:9235]
2025-09-30T14:57:51.514184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:51.514197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:51.514200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:51.514213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:51.514213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:51.514216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:51.514217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:51.514254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896611547904673:9235]
2025-09-30T14:57:51.514262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:51.514282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:51.514499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.514508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.514537Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:51.514546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:51.514550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:51.514553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:51.514566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:51.514578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:51.514596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:51.514754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.514768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.514784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:51.514864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2701 partition: 0 MaxSeqNo: 42 sessionId: src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0
2025-09-30T14:57:51.515288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2d7d9b22-44cc55af-f85cf565-ae3fc347_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:51.518407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0] Write session: try to update token
2025-09-30T14:57:51.518432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:51.526901Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:51.526924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:51.526927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:51.526929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:51.526939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896611547904673:9235]
2025-09-30T14:57:51.526945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896611547904673:9235]
2025-09-30T14:57:51.526949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896611547904673:9235]
2025-09-30T14:57:51.526995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:51.527004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.527007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:51.527021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:51.527030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:51.527034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:51.527155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:51.534303Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2701 sessionId: src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:51.537526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:51.579465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896611637697673:11465]
2025-09-30T14:57:51.582879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2700, pipe: [1:7555896611637697673:11465]
2025-09-30T14:57:51.644275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:51.645107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.645123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.645144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637697673:11465], now have 1 active actors on pipe
2025-09-30T14:57:51.645407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:51.645475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896611637697673:11465]
2025-09-30T14:57:51.645511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:51.645517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:51.645524Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:57:51.645576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2701 reason: error at write: Disconnected sessionId: src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0
2025-09-30T14:57:51.645644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2701 sessionId: src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0 is DEAD
2025-09-30T14:57:51.645799Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 27 consumer shared/user session shared/user_1_27_8830425810218950589_v1 is DEAD
2025-09-30T14:57:51.645386Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:51.645997Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896538623227825:11459] disconnected; active server actors: 1
2025-09-30T14:57:51.646008Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896538623227825:11459] client user disconnected session shared/user_1_27_8830425810218950589_v1
2025-09-30T14:57:51.646036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:51.646059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0] Write session will restart in 0.006091s
2025-09-30T14:57:51.646084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0] Write session: Do CDS request
2025-09-30T14:57:51.646090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:51.647119Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:57:51.647276Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:57:51.647283Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:57:51.647292Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.005594s
2025-09-30T14:57:51.653791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:51.653855Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:57:51.653975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:51.653990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2702
2025-09-30T14:57:51.654020Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:57:51.654025Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 28
2025-09-30T14:57:51.654101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2702 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:51.654139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2702 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:51.654160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2702 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:51.654165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:51.654169Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 28 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:57:51.654213Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:57:51.654284Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 auth for : user
2025-09-30T14:57:51.654489Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 Handle describe topics response
2025-09-30T14:57:51.654530Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 auth is DEAD
2025-09-30T14:57:51.654553Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:57:51.654691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2702 sessionId:  describe result for acl check
2025-09-30T14:57:51.654726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:51.654733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:51.654735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:51.654740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896611637697724:12043] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:51.654830Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:57:51.654931Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_28_10111498465067162831_v1
2025-09-30T14:57:51.654917Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896611637697725:12044] connected; active server actors: 1
2025-09-30T14:57:51.654934Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896611637697725:12044] session shared/user_1_28_10111498465067162831_v1
2025-09-30T14:57:51.654942Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:57:51.654952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:57:51.654958Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_28_10111498465067162831_v1" (Sender=[1:7555896611637697715:12044], Pipe=[1:7555896611637697725:12044], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:57:51.654962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:57:51.654971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:57:51.654979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_28_10111498465067162831_v1" (Sender=[1:7555896611637697715:12044], Pipe=[1:7555896611637697725:12044], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:57:51.654994Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_28_10111498465067162831_v1" sender [1:7555896611637697715:12044] lock partition 0 for ReadingSession "shared/user_1_28_10111498465067162831_v1" (Sender=[1:7555896611637697715:12044], Pipe=[1:7555896611637697725:12044], Partitions=[], ActiveFamilyCount=1) generation 1 step 28
2025-09-30T14:57:51.655007Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:57:51.655011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000037s
2025-09-30T14:57:51.655212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896611637697724:12043] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:51.655257Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 28 Session: "shared/user_1_28_10111498465067162831_v1" ClientId: "user" PipeClient { RawX1: 7555896611637697725 RawX2: 4503603922349836 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:57:51.655277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:57:51.658309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896611637697724:12043] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:51.661929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896611637697724:12043] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:51.661945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896611637697724:12043] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:51.661949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896611637697724:12043] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:51.661958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2702 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:51.670240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:51.673408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:51.673635Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:51.673671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:51.673684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:51.673747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:51.673800Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896611547905008:9215]
2025-09-30T14:57:51.674435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:51.674812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:51.674879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:51.675228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:51.675311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.675317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.675318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.675319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.675321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.675322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.675323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.675324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.675326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.675327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.675328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.675329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.675330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.675331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.675332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.675338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.675347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.675351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.675355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.675358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.675362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.675365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.675369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.675381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.675385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.675388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.675392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.675395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.675399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.675402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.675412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.675419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.675425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.675430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.675434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.675439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.675443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.675448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.675452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.675457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.675460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.675465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.675470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.675475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.675479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.675484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.675489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.675494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.675497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.675502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.675506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.675510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.675514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.675519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.675523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.675528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.675531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.675536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.675540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.675545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.675582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:51.681251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:51.682140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:51.682156Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:51.682159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:51.682164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:51.682171Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2701 [2:7555896611547905008:9215]
2025-09-30T14:57:51.682189Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:51.682204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:51.682210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:51.682212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:51.682225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:51.682243Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:51.682252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:51.682259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:51.682307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.682315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.682317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.682320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:51.682323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:51.682381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:51.682387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.682395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.682401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.682417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:51.682440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896611547905003:9215]
2025-09-30T14:57:51.682447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896611547905003:9215]
2025-09-30T14:57:51.682449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896611547905003:9215]
2025-09-30T14:57:51.682456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:51.682467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:51.682471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:51.682474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:51.682476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:51.682482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:51.682485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:51.682492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637697848:12043], now have 1 active actors on pipe
2025-09-30T14:57:51.682495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637697697:2454], now have 1 active actors on pipe
2025-09-30T14:57:51.682497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637697729:12049], now have 1 active actors on pipe
2025-09-30T14:57:51.682527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896611547905003:9215]
2025-09-30T14:57:51.682540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:51.682574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:51.682599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2701
2025-09-30T14:57:51.682612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2701
2025-09-30T14:57:51.682643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2701, pipe: [1:7555896611637697729:12049]
2025-09-30T14:57:51.682728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.682743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.682765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.682773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.682779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_28_10111498465067162831_v1 on pipe: [1:7555896611637697729:12049]
2025-09-30T14:57:51.682795Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_28_10111498465067162831_v1:1 with generation 2701
2025-09-30T14:57:51.682802Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:51.682810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:51.682821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:51.682828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:51.682841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:51.682857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:51.682875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:51.682884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:51.682886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:51.682902Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_28_10111498465067162831_v1
2025-09-30T14:57:51.682911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:51.682942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:51.682960Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:57:51.683209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2702 partition: 0 MaxSeqNo: 42 sessionId: src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0
2025-09-30T14:57:51.683600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5587849a-6b364a8e-e07bfc01-6642bcec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:51.683116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.683125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.683139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:51.687536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:57:51.687596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:57:51.687610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:51.687613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:51.687616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:51.687628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:57:51.687655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:57:51.687830Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244271682 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:57:51.687859Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:57:51.687902Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 sending to client partition status
2025-09-30T14:57:51.694285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0] Write session: try to update token
2025-09-30T14:57:51.694312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:51.698718Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:51.698737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:51.698740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:51.698742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:51.698752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896611547905003:9215]
2025-09-30T14:57:51.698757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896611547905003:9215]
2025-09-30T14:57:51.698761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896611547905003:9215]
2025-09-30T14:57:51.698804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:51.698811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.698811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:51.698815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:51.698818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:51.698822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:51.698975Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:51.714199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2702 sessionId: src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:51.721580Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:51.810672Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:51.811635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.811652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.811919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_28_10111498465067162831_v1
2025-09-30T14:57:51.811947Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:51.811942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:51.811952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:51.811956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:51.812018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896611637697729:12049]
2025-09-30T14:57:51.812023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2702 reason: error at write: Disconnected sessionId: src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0
2025-09-30T14:57:51.811999Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_28_10111498465067162831_v1
2025-09-30T14:57:51.812238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2702 sessionId: src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0 is DEAD
2025-09-30T14:57:51.812396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:51.812406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0] Write session will restart in 0.009015s
2025-09-30T14:57:51.812433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0] Write session: Do CDS request
2025-09-30T14:57:51.812440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:51.822824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:51.822871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:51.822886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2703
2025-09-30T14:57:51.823066Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2703 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:51.823097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2703 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:51.823106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2703 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:51.823110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:51.823758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2703 sessionId:  describe result for acl check
2025-09-30T14:57:51.823793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:51.823798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:51.823800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:51.823806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896611637698046:12052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:51.824421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896611637698046:12052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:51.827344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896611637698046:12052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:51.831750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896611637698046:12052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:51.831766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896611637698046:12052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:51.831770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896611637698046:12052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:51.831778Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2703 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:51.835691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:51.838973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:51.839194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:51.839204Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:51.839214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:51.839282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:51.839328Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896611547905302:9210]
2025-09-30T14:57:51.840032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:51.840341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:51.840388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:51.840733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:51.840794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.840800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.840801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.840803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.840804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.840805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.840807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.840808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.840809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.840811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.840812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.840813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.840814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.840815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.840816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.840822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.840834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.840838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.840843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.840847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.840851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.840856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.840860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.840864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.840869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.840873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.840878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.840882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.840886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.840890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.840899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.840907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:51.840913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.840919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:51.840923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.840929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:51.840933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.840939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:51.840944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.840950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:51.840965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.840971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:51.840976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.840981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:51.840986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.840992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:51.840999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.841008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:51.841015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.841025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:51.841030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.841040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.841044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.841050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.841054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.841060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.841064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.841069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:51.841075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.841080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:51.841125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:51.846471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:51.847342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:51.847356Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:51.847358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:51.847361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:51.847367Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2702 [2:7555896611547905302:9210]
2025-09-30T14:57:51.847384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:51.847402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:51.847406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:51.847409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:51.847411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:51.847427Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:51.847434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:51.847441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:51.847499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.847506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.847508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.847511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:51.847513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:51.847578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:51.847586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.847599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:51.847616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:51.847639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:51.847658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637698005:2454], now have 1 active actors on pipe
2025-09-30T14:57:51.847662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637698232:12052], now have 1 active actors on pipe
2025-09-30T14:57:51.847669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896611547905297:9210]
2025-09-30T14:57:51.847671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896611547905297:9210]
2025-09-30T14:57:51.847674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896611547905297:9210]
2025-09-30T14:57:51.847687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:51.847703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:51.847705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:51.847712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:51.847714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:51.847723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:51.847726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:51.847706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2702
2025-09-30T14:57:51.847709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2702
2025-09-30T14:57:51.847765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896611547905297:9210]
2025-09-30T14:57:51.847781Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:51.847805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.847813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.847812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:51.848262Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:51.848276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:51.848280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:51.848282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:51.848293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:51.848307Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:51.848336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:51.848507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.848515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.848529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:51.848630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2703 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0
2025-09-30T14:57:51.848995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8aa70c2-5a7ee41f-2a84c03c-5dcf8456_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:51.851802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0] Write session: try to update token
2025-09-30T14:57:51.851826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:51.860269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:51.860288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:51.860290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:51.860293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:51.860318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896611547905297:9210]
2025-09-30T14:57:51.860323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896611547905297:9210]
2025-09-30T14:57:51.860328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896611547905297:9210]
2025-09-30T14:57:51.860370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:51.860378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:51.860379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:51.860381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:51.860385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:51.860391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:51.860526Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:51.866632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2703 sessionId: src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:51.870340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:51.912637Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896611637698306:12049]
2025-09-30T14:57:51.913003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2702, pipe: [1:7555896611637698306:12049]
2025-09-30T14:57:51.974399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:51.974948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:51.974960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:51.974977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637698306:12049], now have 1 active actors on pipe
2025-09-30T14:57:51.975272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896611637698306:12049]
2025-09-30T14:57:51.975275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:51.975310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:51.975312Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:51.975390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2703 reason: error at write: Disconnected sessionId: src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0
2025-09-30T14:57:51.975588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2703 sessionId: src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0 is DEAD
2025-09-30T14:57:51.975776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:51.975784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0] Write session will restart in 0.008428s
2025-09-30T14:57:51.975807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0] Write session: Do CDS request
2025-09-30T14:57:51.975813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:51.975607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:51.985824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:51.985941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:51.985967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2704
2025-09-30T14:57:51.986128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2704 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:51.986168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2704 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:51.986178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2704 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:51.986183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:51.986718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2704 sessionId:  describe result for acl check
2025-09-30T14:57:51.986755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:51.986757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:51.986759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:51.986765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896611637698380:12056] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:51.987368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896611637698380:12056] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:51.990178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896611637698380:12056] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:51.993516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896611637698380:12056] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:51.993530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896611637698380:12056] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:51.993534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896611637698380:12056] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:51.993542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2704 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:51.996121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:51.999061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:51.999300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:51.999311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:51.999324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:51.999388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:51.999432Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896611547905595:9207]
2025-09-30T14:57:52.000078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:52.000445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:52.000499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:52.000860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:52.000945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.000952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.000965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.000966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.000967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.000969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.000970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.000971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.000973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.000974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.000975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.000977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.000978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.000979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.000980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.000987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.000998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.001003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.001007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.001011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.001015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.001019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.001023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.001027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.001031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.001036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.001040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.001044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.001049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.001052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.001063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.001071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.001083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.001088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.001100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.001106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.001114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.001119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.001124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.001130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.001139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.001145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.001150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.001159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.001164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.001169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.001179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.001185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.001194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.001198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.001205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.001214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.001217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.001227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.001235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.001240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.001248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.001254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.001263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.001273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.001323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:52.006820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:52.007771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:52.007793Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:52.007797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:52.007801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:52.007807Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2703 [2:7555896611547905595:9207]
2025-09-30T14:57:52.007823Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:52.007846Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:52.007853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:52.007857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:52.007860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:52.007876Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:52.007889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:52.007896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:52.007966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.007975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.007977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.007982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:52.007984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:52.008052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:52.008061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.008078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.008097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.008121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:52.008145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637698310:2454], now have 1 active actors on pipe
2025-09-30T14:57:52.008155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896611637698571:12056], now have 1 active actors on pipe
2025-09-30T14:57:52.008162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896611547905590:9207]
2025-09-30T14:57:52.008165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896611547905590:9207]
2025-09-30T14:57:52.008167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896611547905590:9207]
2025-09-30T14:57:52.008180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:52.008194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:52.008197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:52.008200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:52.008203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:52.008213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:52.008217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:52.008252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896611547905590:9207]
2025-09-30T14:57:52.008216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2703
2025-09-30T14:57:52.008271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2703
2025-09-30T14:57:52.008266Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:52.008280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:52.008310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.008315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.008351Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:52.008365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:52.008369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:52.008372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:52.008383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:52.008393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:52.008411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:52.008574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.008584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.008602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:52.008694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2704 partition: 0 MaxSeqNo: 42 sessionId: src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0
2025-09-30T14:57:52.009087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f2e1252-d9e0e780-5d32af8d-a37e5674_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:52.011967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0] Write session: try to update token
2025-09-30T14:57:52.011986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:52.021098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:52.021121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:52.021124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:52.021127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:52.021137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896611547905590:9207]
2025-09-30T14:57:52.021142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896611547905590:9207]
2025-09-30T14:57:52.021150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896611547905590:9207]
2025-09-30T14:57:52.021195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:52.021201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.021204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:52.021215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:52.021230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:52.021234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:52.021349Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:52.029670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2704 sessionId: src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:52.032838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:52.075447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896615932665905:12049]
2025-09-30T14:57:52.075735Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2703, pipe: [1:7555896615932665905:12049]
2025-09-30T14:57:52.136775Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:52.137351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.137370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.137391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932665905:12049], now have 1 active actors on pipe
2025-09-30T14:57:52.137653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:52.137666Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:52.137674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896615932665905:12049]
2025-09-30T14:57:52.137703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:52.137781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2704 reason: error at write: Disconnected sessionId: src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0
2025-09-30T14:57:52.137891Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:52.137967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2704 sessionId: src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0 is DEAD
2025-09-30T14:57:52.138113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:52.138124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0] Write session will restart in 0.008865s
2025-09-30T14:57:52.138149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0] Write session: Do CDS request
2025-09-30T14:57:52.138154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:52.147825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:52.147944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:52.147957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2705
2025-09-30T14:57:52.148069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2705 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:52.148101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2705 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:52.148112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2705 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:52.148116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:52.148554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2705 sessionId:  describe result for acl check
2025-09-30T14:57:52.148596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:52.148598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:52.148601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:52.148608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896615932665953:12060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:52.149169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896615932665953:12060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:52.152459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896615932665953:12060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:52.155837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896615932665953:12060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:52.155863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896615932665953:12060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:52.155867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896615932665953:12060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:52.155884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2705 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:52.160467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:52.164167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:52.164417Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:52.164428Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:52.164440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:52.164494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:52.164540Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896615842873199:9194]
2025-09-30T14:57:52.165259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:52.165575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:52.165621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:52.165978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:52.166045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.166051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.166052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.166054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.166056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.166057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.166058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.166060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.166061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.166062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.166064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.166065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.166066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.166068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.166070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.166076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.166089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.166094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.166098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.166102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.166106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.166110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.166114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.166118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.166123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.166128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.166133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.166137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.166141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.166150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.166165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.166177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.166189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.166196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.166205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.166211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.166216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.166222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.166231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.166242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.166257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.166263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.166270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.166276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.166281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.166287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.166293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.166299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.166304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.166310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.166316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.166323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.166328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.166335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.166340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.166351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.166357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.166368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.166373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.166379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.166432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:52.171933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:52.172859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:52.172875Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:52.172878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:52.172882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:52.172889Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2704 [2:7555896615842873199:9194]
2025-09-30T14:57:52.172905Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:52.172921Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:52.172924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:52.172927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:52.172930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:52.172945Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:52.172970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:52.172981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:52.173042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.173050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.173052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.173056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:52.173058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:52.173149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:52.173158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.173172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.173183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.173201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:52.173224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932666117:12060], now have 1 active actors on pipe
2025-09-30T14:57:52.173228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932665907:2454], now have 1 active actors on pipe
2025-09-30T14:57:52.173235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896615842873194:9194]
2025-09-30T14:57:52.173252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896615842873194:9194]
2025-09-30T14:57:52.173259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896615842873194:9194]
2025-09-30T14:57:52.173272Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:52.173286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:52.173287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:52.173291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:52.173293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:52.173303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:52.173307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:52.173292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2704
2025-09-30T14:57:52.173313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2704
2025-09-30T14:57:52.173341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896615842873194:9194]
2025-09-30T14:57:52.173352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:52.173374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.173374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:52.173383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.173427Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:52.173438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:52.173446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:52.173449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:52.173458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:52.173473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:52.173489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:52.173648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.173656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.173669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:52.173765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2705 partition: 0 MaxSeqNo: 42 sessionId: src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0
2025-09-30T14:57:52.174149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6a1ff15-cf3be6e6-29525501-46058ba6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:52.176938Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0] Write session: try to update token
2025-09-30T14:57:52.176971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:52.185943Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:52.185961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:52.185963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:52.185965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:52.185976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896615842873194:9194]
2025-09-30T14:57:52.185981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896615842873194:9194]
2025-09-30T14:57:52.185986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896615842873194:9194]
2025-09-30T14:57:52.186023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:52.186029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.186032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:52.186047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:52.186082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:52.186087Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:52.186160Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:52.192275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2705 sessionId: src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:52.195225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:52.237776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896615932666212:12049]
2025-09-30T14:57:52.238120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2704, pipe: [1:7555896615932666212:12049]
2025-09-30T14:57:52.297690Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:52.298571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.298589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.298631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932666212:12049], now have 1 active actors on pipe
2025-09-30T14:57:52.298860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:52.298934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:52.298945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896615932666212:12049]
2025-09-30T14:57:52.298949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:52.298967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:52.299028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2705 reason: error at write: Disconnected sessionId: src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0
2025-09-30T14:57:52.299210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2705 sessionId: src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0 is DEAD
2025-09-30T14:57:52.299491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:52.299503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0] Write session will restart in 0.006550s
2025-09-30T14:57:52.299528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0] Write session: Do CDS request
2025-09-30T14:57:52.299537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:52.307858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:52.308206Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:52.308234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2706
2025-09-30T14:57:52.308409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2706 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:52.308474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2706 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:52.308497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2706 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:52.308506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:52.309031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2706 sessionId:  describe result for acl check
2025-09-30T14:57:52.309070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:52.309073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:52.309084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:52.309090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896615932666224:12065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:52.309666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896615932666224:12065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:52.311835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896615932666224:12065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:52.314920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896615932666224:12065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:52.314939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896615932666224:12065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:52.314943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896615932666224:12065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:52.314952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2706 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:52.336417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:52.343439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:52.343691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:52.343695Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:52.343707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:52.343765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:52.343799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896615842873494:9203]
2025-09-30T14:57:52.344527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:52.345086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:52.345146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:52.345493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:52.345692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.345694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.345695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.345697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.345699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.345701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.345702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.345703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.345705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.345707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.345708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.345709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.345711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.345713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.345714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.345721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.345733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.345738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.345743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.345747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.345752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.345757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.345762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.345767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.345771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.345776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.345780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.345785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.345789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.345794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.345803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.345812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.345818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.345824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.345830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.345836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.345841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.345848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.345853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.345859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.345863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.345869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.345874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.345881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.345886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.345892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.345897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.345903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.345908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.345914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.345920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.345926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.345931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.345937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.345942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.345948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.345954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.345960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.345966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.345972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.346021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:52.356134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:52.357367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:52.357375Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:52.357379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:52.357383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:52.357390Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2705 [2:7555896615842873494:9203]
2025-09-30T14:57:52.357407Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:52.357428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:52.357432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:52.357435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:52.357438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:52.357456Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:52.357464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:52.357471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:52.357535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.357537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.357539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.357544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:52.357546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:52.357621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:52.357623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.357638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.357650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.357668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:52.357685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896615842873489:9203]
2025-09-30T14:57:52.357687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896615842873489:9203]
2025-09-30T14:57:52.357690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896615842873489:9203]
2025-09-30T14:57:52.357704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:52.357719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:52.357733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:52.357736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:52.357773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896615842873489:9203]
2025-09-30T14:57:52.357775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:52.358428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:52.358438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:52.358440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:52.358446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:52.358766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932666216:2454], now have 1 active actors on pipe
2025-09-30T14:57:52.358770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932666267:12065], now have 1 active actors on pipe
2025-09-30T14:57:52.358939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2705
2025-09-30T14:57:52.358986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2705
2025-09-30T14:57:52.359162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.359171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.359197Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|af649380-cf07decd-d777a5ab-af1a0257_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:52.359206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:52.359210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:52.359213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:52.359225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:52.359237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:52.359270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:52.361354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.361377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.361409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:52.361588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2706 partition: 0 MaxSeqNo: 42 sessionId: src_id|af649380-cf07decd-d777a5ab-af1a0257_0
2025-09-30T14:57:52.361978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63d27ee0-84edd0cd-cddbdf46-f61cebfe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|af649380-cf07decd-d777a5ab-af1a0257_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:52.364933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af649380-cf07decd-d777a5ab-af1a0257_0] Write session: try to update token
2025-09-30T14:57:52.364973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af649380-cf07decd-d777a5ab-af1a0257_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:52.376862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:52.376885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:52.376887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:52.376888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:52.376900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896615842873489:9203]
2025-09-30T14:57:52.376904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896615842873489:9203]
2025-09-30T14:57:52.376907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896615842873489:9203]
2025-09-30T14:57:52.376970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:52.376975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:52.376978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.376980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:52.376981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:52.376984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:52.377130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:52.390160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2706 sessionId: src_id|af649380-cf07decd-d777a5ab-af1a0257_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:52.393132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:52.399068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896615932666535:12049]
2025-09-30T14:57:52.399425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2705, pipe: [1:7555896615932666535:12049]
2025-09-30T14:57:52.493389Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:52.493715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.493730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.493750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932666535:12049], now have 1 active actors on pipe
2025-09-30T14:57:52.494129Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:52.494637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af649380-cf07decd-d777a5ab-af1a0257_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:52.494650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af649380-cf07decd-d777a5ab-af1a0257_0] Write session will restart in 0.005781s
2025-09-30T14:57:52.494674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af649380-cf07decd-d777a5ab-af1a0257_0] Write session: Do CDS request
2025-09-30T14:57:52.494679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af649380-cf07decd-d777a5ab-af1a0257_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:52.493995Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:52.494055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896615932666535:12049]
2025-09-30T14:57:52.494074Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:52.494077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:52.494145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2706 reason: error at write: Disconnected sessionId: src_id|af649380-cf07decd-d777a5ab-af1a0257_0
2025-09-30T14:57:52.494324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2706 sessionId: src_id|af649380-cf07decd-d777a5ab-af1a0257_0 is DEAD
2025-09-30T14:57:52.501785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|af649380-cf07decd-d777a5ab-af1a0257_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:52.502007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:52.502022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2707
2025-09-30T14:57:52.502170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2707 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:52.502202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2707 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:52.502207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2707 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:52.502222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:52.502684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2707 sessionId:  describe result for acl check
2025-09-30T14:57:52.502720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:52.502722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:52.502724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:52.502732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896615932666548:12070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:52.503312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896615932666548:12070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:52.505472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896615932666548:12070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:52.509252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896615932666548:12070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:52.509266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896615932666548:12070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:52.509270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896615932666548:12070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:52.509279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2707 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:52.521138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:52.524713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:52.524970Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:52.524983Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:52.524995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:52.525050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:52.525091Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896615842873790:9201]
2025-09-30T14:57:52.525790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:52.526115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:52.526159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:52.526501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:52.526561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.526567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.526568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.526569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.526570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.526572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.526573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.526575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.526576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.526577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.526579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.526580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.526581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.526583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.526584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.526589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.526599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.526603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.526607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.526610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.526615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.526618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.526622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.526626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.526631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.526635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.526638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.526641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.526645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.526649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.526658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.526666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.526673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.526679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.526685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.526690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.526694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.526699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.526704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.526709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.526713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.526718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.526723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.526728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.526732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.526737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.526742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.526748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.526752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.526758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.526768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.526773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.526782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.526787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.526791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.526796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.526801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.526806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.526811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.526820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.526863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:52.532392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:52.533859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:52.533874Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:52.533876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:52.533880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:52.533888Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2706 [2:7555896615842873790:9201]
2025-09-30T14:57:52.533917Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:52.533932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:52.533935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:52.533938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:52.533940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:52.533956Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:52.533970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:52.533976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:52.534035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.534043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.534045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.534049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:52.534052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:52.534121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:52.534134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.534148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.534160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.534177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:52.534199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932666623:12070], now have 1 active actors on pipe
2025-09-30T14:57:52.534208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932666537:2454], now have 1 active actors on pipe
2025-09-30T14:57:52.534214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896615842873785:9201]
2025-09-30T14:57:52.534216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896615842873785:9201]
2025-09-30T14:57:52.534218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896615842873785:9201]
2025-09-30T14:57:52.534234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:52.534248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:52.534249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:52.534258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:52.534260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:52.534264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:52.534266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:52.534301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896615842873785:9201]
2025-09-30T14:57:52.534309Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:52.534292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2706
2025-09-30T14:57:52.534309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2706
2025-09-30T14:57:52.534343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.534343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:52.534352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.534382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:52.534393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:52.534398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:52.534400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:52.534410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:52.534418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:52.534436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:52.534611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.534623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.534635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:52.534752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2707 partition: 0 MaxSeqNo: 42 sessionId: src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0
2025-09-30T14:57:52.543369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|af649380-cf07decd-d777a5ab-af1a0257_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:52.546264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0] Write session: try to update token
2025-09-30T14:57:52.546287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:52.546652Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:52.546673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:52.546682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896615842873785:9201]
2025-09-30T14:57:52.546729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:52.546733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:52.546916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:52.547070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:52.547218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:52.547391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:52.547696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:52.547736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:52.557536Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:52.557556Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:52.557559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:52.557561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:52.557570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896615842873785:9201]
2025-09-30T14:57:52.557575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896615842873785:9201]
2025-09-30T14:57:52.557580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896615842873785:9201]
2025-09-30T14:57:52.557622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:52.557628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.557631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:52.557773Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:52.560131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:52.560168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:52.560174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:52.561478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2707 sessionId: src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:52.564336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:52.594137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896615932666842:12049]
2025-09-30T14:57:52.594428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2706, pipe: [1:7555896615932666842:12049]
2025-09-30T14:57:52.673571Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:52.674414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.674434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.674453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932666842:12049], now have 1 active actors on pipe
2025-09-30T14:57:52.674677Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:52.674669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:52.674681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:52.674802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2707 reason: error at write: Disconnected sessionId: src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0
2025-09-30T14:57:52.675012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2707 sessionId: src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0 is DEAD
2025-09-30T14:57:52.675154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:52.675166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0] Write session will restart in 0.006677s
2025-09-30T14:57:52.675189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0] Write session: Do CDS request
2025-09-30T14:57:52.675194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:52.675206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:52.675269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896615932666842:12049]
2025-09-30T14:57:52.682810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:52.683094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:52.683118Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2708
2025-09-30T14:57:52.683227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2708 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:52.683279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2708 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:52.683288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2708 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:52.683292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:52.683689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2708 sessionId:  describe result for acl check
2025-09-30T14:57:52.683722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:52.683729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:52.683731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:52.683736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896615932666884:12081] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:52.684273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896615932666884:12081] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:52.688528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896615932666884:12081] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:52.692333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896615932666884:12081] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:52.692348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896615932666884:12081] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:52.692352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896615932666884:12081] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:52.692369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2708 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:52.700801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:52.706373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:52.706591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:52.706602Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:52.706612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:52.706666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:52.706706Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896615842874124:9186]
2025-09-30T14:57:52.707405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:52.707747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:52.707804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:52.708167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:52.708238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.708244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.708245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.708247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.708248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.708249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.708251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.708252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.708253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.708254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.708256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.708257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.708258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.708260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.708261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.708267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.708278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.708282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.708286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.708291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.708295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.708299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.708303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.708307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.708311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.708315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.708320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.708324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.708328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.708332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.708341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.708350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.708356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.708365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.708374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.708384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.708389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.708395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.708400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.708405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.708409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.708415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.708421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.708426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.708431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.708436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.708445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.708451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.708455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.708464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.708473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.708479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.708487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.708491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.708499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.708503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.708512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.708517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.708522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.708526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.708572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:52.714393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:52.715875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:52.715893Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:52.715895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:52.715900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:52.715908Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2707 [2:7555896615842874124:9186]
2025-09-30T14:57:52.715925Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:52.715941Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:52.715945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:52.715948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:52.715950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:52.715967Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:52.715981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:52.715988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:52.716049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.716059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.716062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.716066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:52.716069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:52.716142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:52.716149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.716162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.716175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.716196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:52.716222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932666858:2454], now have 1 active actors on pipe
2025-09-30T14:57:52.716231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932667021:12081], now have 1 active actors on pipe
2025-09-30T14:57:52.716239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896615842874119:9186]
2025-09-30T14:57:52.716241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896615842874119:9186]
2025-09-30T14:57:52.716244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896615842874119:9186]
2025-09-30T14:57:52.716262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:52.716277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:52.716297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:52.716304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:52.716317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2707
2025-09-30T14:57:52.716347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896615842874119:9186]
2025-09-30T14:57:52.716354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:52.716334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2707
2025-09-30T14:57:52.716455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:52.716462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:52.716465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:52.716471Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:52.716582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.716593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.716619Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:52.716631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:52.716636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:52.716638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:52.716649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:52.716659Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:52.716681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:52.716862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.716878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.716914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:52.717021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2708 partition: 0 MaxSeqNo: 42 sessionId: src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0
2025-09-30T14:57:52.717449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c8d1c28-573e7ebc-ace45337-a7edb911_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:52.720625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0] Write session: try to update token
2025-09-30T14:57:52.720646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:52.730884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:52.730908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:52.730919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896615842874119:9186]
2025-09-30T14:57:52.730969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:52.731406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:52.731564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:52.731712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:52.731854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:52.732058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:52.732107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:52.732266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:52.742676Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:52.742702Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:52.742705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:52.742707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:52.742718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896615842874119:9186]
2025-09-30T14:57:52.742723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896615842874119:9186]
2025-09-30T14:57:52.742727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896615842874119:9186]
2025-09-30T14:57:52.742769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:52.742777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.742776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:52.742780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:52.742781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:52.742785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:52.742936Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:52.745258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2708 sessionId: src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:52.748084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:52.775394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896615932667173:12049]
2025-09-30T14:57:52.775754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2707, pipe: [1:7555896615932667173:12049]
2025-09-30T14:57:52.869538Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:52.870301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.870319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.870341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932667173:12049], now have 1 active actors on pipe
2025-09-30T14:57:52.870577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:52.871489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:52.871502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0] Write session will restart in 0.007942s
2025-09-30T14:57:52.871526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0] Write session: Do CDS request
2025-09-30T14:57:52.871533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:52.870668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:52.870733Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896615932667173:12049]
2025-09-30T14:57:52.870761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:52.870826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2708 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0
2025-09-30T14:57:52.871307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2708 sessionId: src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0 is DEAD
2025-09-30T14:57:52.883673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:52.883768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:52.883782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2709
2025-09-30T14:57:52.883909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2709 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:52.883949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2709 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:52.883959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2709 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:52.883963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:52.885171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2709 sessionId:  describe result for acl check
2025-09-30T14:57:52.885201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:52.885203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:52.885204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:52.885208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896615932667219:12086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:52.885658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896615932667219:12086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:52.889914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896615932667219:12086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:52.894318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896615932667219:12086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:52.894334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896615932667219:12086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:52.894338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896615932667219:12086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:52.894347Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2709 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:52.908493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:52.909470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:52.909653Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:52.909664Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:52.909674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:52.909739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:52.909784Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896615842874422:9174]
2025-09-30T14:57:52.910464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:52.912322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:52.912388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:52.912772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:52.912843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.912863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.912865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.912866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.912868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.912869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.912871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.912872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.912873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.912875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.912876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.912877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.912879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.912880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.912881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.912888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.912898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.912902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.912906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.912910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.912914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.912919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.912924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.912928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.912933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.912937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.912942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.912947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.912964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.912969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.912978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.912987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:52.912994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.913000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:52.913005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.913012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:52.913016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.913023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:52.913028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.913034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:52.913039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.913045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:52.913051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.913057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:52.913061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.913067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:52.913073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.913078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:52.913083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.913088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:52.913092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.913097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.913102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.913119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.913125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.913130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.913137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.913143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:52.913150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.913157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:52.913204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:52.918740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:52.919923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:52.919940Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:52.919943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:52.919948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:52.919955Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2708 [2:7555896615842874422:9174]
2025-09-30T14:57:52.919970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:52.919985Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:52.919988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:52.919992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:52.919994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:52.920011Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:52.920023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:52.920030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:52.920089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.920097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.920099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.920102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:52.920105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:52.920170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:52.920179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.920193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:52.920207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:52.920231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:52.920254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932667341:12086], now have 1 active actors on pipe
2025-09-30T14:57:52.920259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932667176:2454], now have 1 active actors on pipe
2025-09-30T14:57:52.920265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896615842874417:9174]
2025-09-30T14:57:52.920268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896615842874417:9174]
2025-09-30T14:57:52.920271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896615842874417:9174]
2025-09-30T14:57:52.920285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:52.920300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:52.920302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:52.920310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:52.920312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:52.920318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:52.920321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:52.920348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896615842874417:9174]
2025-09-30T14:57:52.920356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:52.920358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:52.920390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.920401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.920435Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28188319-cb00d3d7-b4873571-9fe13946_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:52.920446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:52.920450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:52.920452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:52.920461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:52.920474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:52.920500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:52.920636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:52.920647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:52.920659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:52.921118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd2e2-c8d57710-9053f1f1-382f11e9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|28188319-cb00d3d7-b4873571-9fe13946_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:52.920323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2708
2025-09-30T14:57:52.920331Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2708
2025-09-30T14:57:52.920730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2709 partition: 0 MaxSeqNo: 42 sessionId: src_id|28188319-cb00d3d7-b4873571-9fe13946_0
2025-09-30T14:57:52.924113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28188319-cb00d3d7-b4873571-9fe13946_0] Write session: try to update token
2025-09-30T14:57:52.924131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28188319-cb00d3d7-b4873571-9fe13946_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:52.933100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:52.933120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:52.933123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:52.933125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:52.933135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896615842874417:9174]
2025-09-30T14:57:52.933141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896615842874417:9174]
2025-09-30T14:57:52.933145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896615842874417:9174]
2025-09-30T14:57:52.933187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:52.933194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:52.933197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:52.933198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:52.933204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:52.933208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:52.933363Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:52.943529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2709 sessionId: src_id|28188319-cb00d3d7-b4873571-9fe13946_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:52.946589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:52.970988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896615932667482:12049]
2025-09-30T14:57:52.971287Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2708, pipe: [1:7555896615932667482:12049]
2025-09-30T14:57:53.062837Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:53.063150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.063169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.063190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896615932667482:12049], now have 1 active actors on pipe
2025-09-30T14:57:53.063425Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:53.063424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896615932667482:12049]
2025-09-30T14:57:53.063459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:53.063462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:53.063518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:53.063525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2709 reason: error at write: Disconnected sessionId: src_id|28188319-cb00d3d7-b4873571-9fe13946_0
2025-09-30T14:57:53.063684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2709 sessionId: src_id|28188319-cb00d3d7-b4873571-9fe13946_0 is DEAD
2025-09-30T14:57:53.064047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28188319-cb00d3d7-b4873571-9fe13946_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:53.064058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28188319-cb00d3d7-b4873571-9fe13946_0] Write session will restart in 0.007134s
2025-09-30T14:57:53.064080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28188319-cb00d3d7-b4873571-9fe13946_0] Write session: Do CDS request
2025-09-30T14:57:53.064097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28188319-cb00d3d7-b4873571-9fe13946_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:53.072790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28188319-cb00d3d7-b4873571-9fe13946_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:53.072912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:53.072927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2710
2025-09-30T14:57:53.073161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2710 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:53.073197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2710 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:53.073202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2710 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:53.073205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:53.073710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2710 sessionId:  describe result for acl check
2025-09-30T14:57:53.073752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:53.073754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:53.073759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:53.073765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896620227634805:12090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:53.074330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896620227634805:12090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:53.080093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896620227634805:12090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:53.084093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896620227634805:12090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:53.084115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896620227634805:12090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:53.084119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896620227634805:12090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:53.084128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2710 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:53.091434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:53.094851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:53.095104Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:53.095110Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:53.095124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:53.095195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:53.095237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896620137842018:9171]
2025-09-30T14:57:53.095926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:53.096328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:53.096424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:53.096784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:53.096866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.096873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.096874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.096875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.096877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.096878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.096879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.096881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.096882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.096883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.096884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.096886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.096887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.096888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.096889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.096896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.096907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.096912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.096916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.096920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.096925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.096929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.096934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.096938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.096942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.096945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.096964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.096969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.096972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.096976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.096987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.096995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.097001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.097007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.097012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.097017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.097021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.097026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.097031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.097036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.097041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.097046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.097058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.097063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.097068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.097079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.097084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.097098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.097102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.097118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.097123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.097128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.097133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.097138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.097143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.097149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.097153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.097159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.097163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.097169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.097216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:53.102994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:53.104127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:53.104148Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:53.104151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:53.104155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:53.104162Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2709 [2:7555896620137842018:9171]
2025-09-30T14:57:53.104183Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:53.104201Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:53.104204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:53.104207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:53.104222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:53.104240Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:53.104252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:53.104260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:53.104337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.104344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.104346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.104351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:53.104354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:53.104433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:53.104442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.104457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.104474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.104496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:53.104520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896620137842013:9171]
2025-09-30T14:57:53.104528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896620137842013:9171]
2025-09-30T14:57:53.104530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896620137842013:9171]
2025-09-30T14:57:53.104540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:53.104552Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:53.104556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:53.104563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:53.104565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:53.104571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:53.104574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:53.104585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227634969:12090], now have 1 active actors on pipe
2025-09-30T14:57:53.104594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227634781:2454], now have 1 active actors on pipe
2025-09-30T14:57:53.104631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896620137842013:9171]
2025-09-30T14:57:53.104645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:53.104623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2709
2025-09-30T14:57:53.104648Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2709
2025-09-30T14:57:53.104692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:53.104827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.104839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.104864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:53.104872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:53.104876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:53.104879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:53.104890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:53.104900Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:53.104914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:53.105117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.105123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.105137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:53.105270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2710 partition: 0 MaxSeqNo: 42 sessionId: src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0
2025-09-30T14:57:53.107525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28188319-cb00d3d7-b4873571-9fe13946_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:53.110552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0] Write session: try to update token
2025-09-30T14:57:53.110571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:53.121503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:53.121525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:53.121534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896620137842013:9171]
2025-09-30T14:57:53.121588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:53.121591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:53.121784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:53.121953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:53.122107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:53.122267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:53.122503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:53.122558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:53.125913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2710 sessionId: src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:53.129020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:53.132265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.132289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.132307Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:53.132310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:53.132312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:53.132314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:53.132323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896620137842013:9171]
2025-09-30T14:57:53.132327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896620137842013:9171]
2025-09-30T14:57:53.132331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896620137842013:9171]
2025-09-30T14:57:53.132385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:53.132392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.132391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:53.132395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:53.132397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:53.132406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:53.132556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:53.163485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896620227635091:12049]
2025-09-30T14:57:53.163794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2709, pipe: [1:7555896620227635091:12049]
2025-09-30T14:57:53.249326Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:53.249927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:53.249973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227635091:12049], now have 1 active actors on pipe
2025-09-30T14:57:53.250449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:53.250552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:53.250561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:53.250633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2710 reason: error at write: Disconnected sessionId: src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0
2025-09-30T14:57:53.250783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2710 sessionId: src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0 is DEAD
2025-09-30T14:57:53.250923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:53.250935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0] Write session will restart in 0.009036s
2025-09-30T14:57:53.250970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0] Write session: Do CDS request
2025-09-30T14:57:53.250976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:53.250973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896620227635091:12049]
2025-09-30T14:57:53.250993Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:53.260864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:53.260969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:53.260985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2711
2025-09-30T14:57:53.261135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2711 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:53.261169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2711 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:53.261179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2711 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:53.261184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:53.261704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2711 sessionId:  describe result for acl check
2025-09-30T14:57:53.261740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:53.261746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:53.261749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:53.261755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896620227635154:12097] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:53.262310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896620227635154:12097] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:53.265489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896620227635154:12097] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:53.268805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896620227635154:12097] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:53.268826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896620227635154:12097] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:53.268830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896620227635154:12097] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:53.268839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2711 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:53.272770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:53.276253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:53.276485Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:53.276497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:53.276510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:53.276588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:53.276633Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896620137842329:9170]
2025-09-30T14:57:53.277334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:53.277712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:53.277760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:53.278124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:53.278191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.278198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.278199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.278201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.278202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.278204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.278205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.278206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.278208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.278209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.278210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.278212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.278213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.278214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.278215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.278221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.278233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.278237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.278241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.278246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.278250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.278254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.278258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.278263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.278267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.278272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.278276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.278280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.278284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.278288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.278296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.278304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.278310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.278316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.278321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.278327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.278331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.278337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.278342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.278347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.278352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.278357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.278364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.278371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.278381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.278387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.278396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.278401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.278411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.278416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.278425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.278431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.278439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.278445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.278450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.278459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.278464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.278469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.278479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.278485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.278530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:53.284654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:53.285748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:53.285764Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:53.285767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:53.285771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:53.285779Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2710 [2:7555896620137842329:9170]
2025-09-30T14:57:53.285798Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:53.285816Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:53.285829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:53.285833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:53.285836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:53.285852Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:53.285858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:53.285865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:53.285928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.285936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.285938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.285942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:53.285945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:53.286020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:53.286028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.286042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.286060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.286082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:53.286107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227635097:2454], now have 1 active actors on pipe
2025-09-30T14:57:53.286115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227635319:12097], now have 1 active actors on pipe
2025-09-30T14:57:53.286122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896620137842324:9170]
2025-09-30T14:57:53.286129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896620137842324:9170]
2025-09-30T14:57:53.286132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896620137842324:9170]
2025-09-30T14:57:53.286145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:53.286158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:53.286163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:53.286169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:53.286171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:53.286177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:53.286180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:53.286297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2710
2025-09-30T14:57:53.286358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2710
2025-09-30T14:57:53.286221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896620137842324:9170]
2025-09-30T14:57:53.286236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:53.286300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:53.286419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.286423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.286447Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:53.286462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:53.286471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:53.286473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:53.286483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:53.286493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:53.286507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:53.286909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.286923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.286942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:53.287040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2711 partition: 0 MaxSeqNo: 42 sessionId: src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0
2025-09-30T14:57:53.287463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63aa9907-72c1e4bf-e9a0c2f2-1a2be943_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:53.290325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0] Write session: try to update token
2025-09-30T14:57:53.290367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:53.298695Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:53.298713Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:53.298723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896620137842324:9170]
2025-09-30T14:57:53.298771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:53.298778Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:53.298957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:53.299120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:53.299288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:53.299437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:53.299637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:53.299679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:53.306279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2711 sessionId: src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:53.309276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:53.310386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.310415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.310434Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:53.310438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:53.310440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:53.310443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:53.310452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896620137842324:9170]
2025-09-30T14:57:53.310456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896620137842324:9170]
2025-09-30T14:57:53.310460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896620137842324:9170]
2025-09-30T14:57:53.310513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:53.310513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:53.310519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.310520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:53.310522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:53.310525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:53.310698Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:53.351344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896620227635410:12049]
2025-09-30T14:57:53.351675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2710, pipe: [1:7555896620227635410:12049]
2025-09-30T14:57:53.428969Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:53.429991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:53.429763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:53.429798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227635410:12049], now have 1 active actors on pipe
2025-09-30T14:57:53.430121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:53.430129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:53.430200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2711 reason: error at write: Disconnected sessionId: src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0
2025-09-30T14:57:53.430370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896620227635410:12049]
2025-09-30T14:57:53.430376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2711 sessionId: src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0 is DEAD
2025-09-30T14:57:53.430401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:53.430476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:53.430488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0] Write session will restart in 0.008963s
2025-09-30T14:57:53.430511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0] Write session: Do CDS request
2025-09-30T14:57:53.430517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:53.440775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:53.440977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:53.440994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2712
2025-09-30T14:57:53.441150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2712 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:53.441196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2712 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:53.441206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2712 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:53.441212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:53.441697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2712 sessionId:  describe result for acl check
2025-09-30T14:57:53.441737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:53.441745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:53.441747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:53.441753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896620227635458:12102] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:53.442303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896620227635458:12102] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:53.446036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896620227635458:12102] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:53.449948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896620227635458:12102] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:53.449973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896620227635458:12102] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:53.449976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896620227635458:12102] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:53.449986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2712 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:53.455180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:53.458556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:53.458770Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:53.458782Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:53.458793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:53.458849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:53.458887Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896620137842629:9167]
2025-09-30T14:57:53.459581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:53.459916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:53.459970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:53.460337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:53.460412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.460419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.460420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.460421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.460423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.460424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.460425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.460427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.460428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.460429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.460431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.460432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.460433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.460435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.460436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.460442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.460452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.460456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.460460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.460464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.460469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.460473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.460477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.460482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.460487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.460492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.460496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.460499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.460503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.460507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.460515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.460523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.460529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.460541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.460546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.460556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.460561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.460571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.460577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.460582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.460587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.460592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.460601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.460605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.460616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.460622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.460633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.460644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.460650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.460660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.460665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.460674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.460679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.460685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.460693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.460698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.460708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.460713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.460725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.460731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.460778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:53.466421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:53.467379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:53.467399Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:53.467402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:53.467407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:53.467414Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2711 [2:7555896620137842629:9167]
2025-09-30T14:57:53.467432Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:53.467454Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:53.467462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:53.467467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:53.467469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:53.467487Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:53.467501Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:53.467514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:53.467581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.467590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.467593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.467596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:53.467600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:53.467675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:53.467685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.467697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.467710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.467733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:53.467756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227635627:12102], now have 1 active actors on pipe
2025-09-30T14:57:53.467767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896620137842624:9167]
2025-09-30T14:57:53.467771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896620137842624:9167]
2025-09-30T14:57:53.467773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896620137842624:9167]
2025-09-30T14:57:53.467787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:53.467802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227635424:2454], now have 1 active actors on pipe
2025-09-30T14:57:53.467816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:53.467816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:53.467820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:53.467823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:53.467837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:53.467842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:53.467883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896620137842624:9167]
2025-09-30T14:57:53.467896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:53.467910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:53.467880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2711
2025-09-30T14:57:53.467940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.467912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2711
2025-09-30T14:57:53.467950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.467980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64b97572-b1472840-aaf51320-fef8c7fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:53.467993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:53.468002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:53.468005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:53.468017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:53.468028Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:53.468049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:53.468245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.468259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.468298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:53.468394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2712 partition: 0 MaxSeqNo: 42 sessionId: src_id|64b97572-b1472840-aaf51320-fef8c7fb_0
2025-09-30T14:57:53.468749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90f885ce-9cc6124a-647fb377-d41cee5c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|64b97572-b1472840-aaf51320-fef8c7fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:53.471646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b97572-b1472840-aaf51320-fef8c7fb_0] Write session: try to update token
2025-09-30T14:57:53.471665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b97572-b1472840-aaf51320-fef8c7fb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:53.479870Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:53.479894Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:53.479897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:53.479899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:53.479909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896620137842624:9167]
2025-09-30T14:57:53.479914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896620137842624:9167]
2025-09-30T14:57:53.479918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896620137842624:9167]
2025-09-30T14:57:53.479960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:53.479964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:53.479967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.479969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:53.479970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:53.479975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:53.480111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:53.486048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2712 sessionId: src_id|64b97572-b1472840-aaf51320-fef8c7fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:53.488869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:53.530557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896620227635734:12049]
2025-09-30T14:57:53.530839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2711, pipe: [1:7555896620227635734:12049]
2025-09-30T14:57:53.597746Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:53.598521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.598540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.598580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227635734:12049], now have 1 active actors on pipe
2025-09-30T14:57:53.598860Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:53.598830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:53.598843Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:53.598855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896620227635734:12049]
2025-09-30T14:57:53.598893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:53.598926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2712 reason: error at write: Disconnected sessionId: src_id|64b97572-b1472840-aaf51320-fef8c7fb_0
2025-09-30T14:57:53.599123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2712 sessionId: src_id|64b97572-b1472840-aaf51320-fef8c7fb_0 is DEAD
2025-09-30T14:57:53.599289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b97572-b1472840-aaf51320-fef8c7fb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:53.599301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b97572-b1472840-aaf51320-fef8c7fb_0] Write session will restart in 0.009358s
2025-09-30T14:57:53.599325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b97572-b1472840-aaf51320-fef8c7fb_0] Write session: Do CDS request
2025-09-30T14:57:53.599334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b97572-b1472840-aaf51320-fef8c7fb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:53.609812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64b97572-b1472840-aaf51320-fef8c7fb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:53.609910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:53.609925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2713
2025-09-30T14:57:53.610048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2713 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:53.610097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2713 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:53.610108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2713 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:53.610112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:53.610680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2713 sessionId:  describe result for acl check
2025-09-30T14:57:53.610719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:53.610723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:53.610725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:53.610734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896620227635784:12106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:53.611331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896620227635784:12106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:53.614488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896620227635784:12106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:53.617764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896620227635784:12106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:53.617781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896620227635784:12106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:53.617784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896620227635784:12106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:53.617792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2713 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:53.622454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:53.626110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:53.626349Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:53.626359Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:53.626370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:53.626426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:53.626472Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896620137842932:9160]
2025-09-30T14:57:53.627132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:53.627537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:53.627602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:53.627959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:53.628035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.628041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.628042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.628044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.628045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.628046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.628047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.628048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.628050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.628051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.628052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.628053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.628054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.628056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.628057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.628063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.628073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.628077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.628081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.628084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.628088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.628091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.628095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.628099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.628103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.628106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.628110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.628113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.628117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.628120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.628128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.628135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.628142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.628147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.628152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.628158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.628164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.628169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.628174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.628178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.628182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.628187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.628191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.628195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.628199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.628204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.628208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.628213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.628217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.628221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.628227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.628239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.628243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.628250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.628254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.628258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.628263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.628268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.628273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.628277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.628316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:53.633939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:53.634858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:53.634875Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:53.634878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:53.634882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:53.634889Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2712 [2:7555896620137842932:9160]
2025-09-30T14:57:53.634910Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:53.634927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:53.634930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:53.634933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:53.634935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:53.634951Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:53.634959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:53.634966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:53.635025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.635034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.635036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.635040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:53.635043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:53.635107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:53.635115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.635126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.635141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.635156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:53.635178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227635735:2454], now have 1 active actors on pipe
2025-09-30T14:57:53.635182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227635952:12106], now have 1 active actors on pipe
2025-09-30T14:57:53.635194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896620137842927:9160]
2025-09-30T14:57:53.635196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896620137842927:9160]
2025-09-30T14:57:53.635199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896620137842927:9160]
2025-09-30T14:57:53.635211Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:53.635225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:53.635229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:53.635230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:53.635231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:53.635332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2712
2025-09-30T14:57:53.635380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:53.635388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:53.635434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.635443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.635454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896620137842927:9160]
2025-09-30T14:57:53.635466Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:53.635473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:53.635497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:53.635508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:53.635512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:53.635516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:53.635526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:53.635539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:53.635567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:53.635598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2712
2025-09-30T14:57:53.635701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.635708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.635721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:53.635790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2713 partition: 0 MaxSeqNo: 42 sessionId: src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0
2025-09-30T14:57:53.636145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64b97572-b1472840-aaf51320-fef8c7fb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:53.638873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0] Write session: try to update token
2025-09-30T14:57:53.638890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:53.647830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:53.647850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:53.647852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:53.647854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:53.647862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896620137842927:9160]
2025-09-30T14:57:53.647867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896620137842927:9160]
2025-09-30T14:57:53.647869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896620137842927:9160]
2025-09-30T14:57:53.647902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:53.647907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.647909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:53.647926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:53.647943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:53.647947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:53.648067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:53.654338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2713 sessionId: src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:53.657376Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:53.698998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896620227636060:12049]
2025-09-30T14:57:53.699320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2712, pipe: [1:7555896620227636060:12049]
2025-09-30T14:57:53.761774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:53.762124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.762139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.762159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227636060:12049], now have 1 active actors on pipe
2025-09-30T14:57:53.762396Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:53.762479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:53.762537Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896620227636060:12049]
2025-09-30T14:57:53.762556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:53.762629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2713 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0
2025-09-30T14:57:53.762785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2713 sessionId: src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0 is DEAD
2025-09-30T14:57:53.762952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:53.762961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0] Write session will restart in 0.006072s
2025-09-30T14:57:53.762984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0] Write session: Do CDS request
2025-09-30T14:57:53.762990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:53.769790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:53.770146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:53.770161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2714
2025-09-30T14:57:53.770296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2714 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:53.770331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2714 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:53.770339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2714 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:53.770343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:53.770805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2714 sessionId:  describe result for acl check
2025-09-30T14:57:53.770834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:53.770839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:53.770840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:53.770846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896620227636090:12118] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:53.771428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896620227636090:12118] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:53.774616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896620227636090:12118] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:53.778434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896620227636090:12118] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:53.778448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896620227636090:12118] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:53.778454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896620227636090:12118] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:53.778464Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2714 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:53.786865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:53.790035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:53.790376Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:53.790393Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:53.790410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:53.790492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:53.790541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896620137843271:9138]
2025-09-30T14:57:53.791262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:53.791684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:53.791761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:53.792150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:53.792228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.792234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.792236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.792237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.792238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.792240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.792241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.792243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.792245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.792246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.792247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.792249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.792250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.792251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.792253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.792260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.792272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.792276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.792280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.792284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.792288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.792292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.792309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.792312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.792319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.792322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.792325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.792329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.792333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.792336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.792346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.792353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.792360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.792366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.792371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.792375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.792380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.792386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.792392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.792403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.792408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.792413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.792419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.792425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.792435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.792441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.792450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.792456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.792465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.792471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.792481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.792486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.792497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.792501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.792511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.792517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.792522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.792532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.792537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.792542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.792594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:53.798382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:53.799866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:53.799883Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:53.799886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:53.799889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:53.799896Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2713 [2:7555896620137843271:9138]
2025-09-30T14:57:53.799911Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:53.799926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:53.799930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:53.799933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:53.799935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:53.799953Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:53.799961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:53.799968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:53.800030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.800040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.800042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.800046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:53.800049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:53.800117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:53.800138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.800155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.800175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.800193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:53.800212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227636209:12118], now have 1 active actors on pipe
2025-09-30T14:57:53.800223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227636075:2454], now have 1 active actors on pipe
2025-09-30T14:57:53.800229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896620137843266:9138]
2025-09-30T14:57:53.800232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896620137843266:9138]
2025-09-30T14:57:53.800234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896620137843266:9138]
2025-09-30T14:57:53.800245Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:53.800258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:53.800263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:53.800267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:53.800269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:53.800274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:53.800277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:53.800314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896620137843266:9138]
2025-09-30T14:57:53.800323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:53.800307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2713
2025-09-30T14:57:53.800343Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2713
2025-09-30T14:57:53.800337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:53.800361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.800367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.800394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|217a9649-a4654646-a5b5b336-d92dc653_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:53.800407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:53.800412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:53.800414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:53.800426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:53.800440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:53.800465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:53.800624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.800631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.800643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:53.800733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2714 partition: 0 MaxSeqNo: 42 sessionId: src_id|217a9649-a4654646-a5b5b336-d92dc653_0
2025-09-30T14:57:53.801124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5b355ef9-79a9694d-60dff93d-e53b98e6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|217a9649-a4654646-a5b5b336-d92dc653_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:53.804088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|217a9649-a4654646-a5b5b336-d92dc653_0] Write session: try to update token
2025-09-30T14:57:53.804108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|217a9649-a4654646-a5b5b336-d92dc653_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:53.812754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:53.812778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:53.812781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:53.812783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:53.812795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896620137843266:9138]
2025-09-30T14:57:53.812803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896620137843266:9138]
2025-09-30T14:57:53.812808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896620137843266:9138]
2025-09-30T14:57:53.812854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:53.812860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.812863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:53.812864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:53.812872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:53.812877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:53.813031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:53.819135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2714 sessionId: src_id|217a9649-a4654646-a5b5b336-d92dc653_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:53.821873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:53.862842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896620227636384:12049]
2025-09-30T14:57:53.863180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2713, pipe: [1:7555896620227636384:12049]
2025-09-30T14:57:53.933399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:53.933973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.933993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.934031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227636384:12049], now have 1 active actors on pipe
2025-09-30T14:57:53.934275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:53.934292Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:53.934325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896620227636384:12049]
2025-09-30T14:57:53.934346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:53.934349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:53.934425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2714 reason: error at write: Disconnected sessionId: src_id|217a9649-a4654646-a5b5b336-d92dc653_0
2025-09-30T14:57:53.934614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2714 sessionId: src_id|217a9649-a4654646-a5b5b336-d92dc653_0 is DEAD
2025-09-30T14:57:53.934750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|217a9649-a4654646-a5b5b336-d92dc653_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:53.934757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|217a9649-a4654646-a5b5b336-d92dc653_0] Write session will restart in 0.009128s
2025-09-30T14:57:53.934782Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|217a9649-a4654646-a5b5b336-d92dc653_0] Write session: Do CDS request
2025-09-30T14:57:53.934792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|217a9649-a4654646-a5b5b336-d92dc653_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:53.944792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|217a9649-a4654646-a5b5b336-d92dc653_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:53.944874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:53.944891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2715
2025-09-30T14:57:53.945035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2715 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:53.945082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2715 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:53.945092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2715 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:53.945096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:53.945625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2715 sessionId:  describe result for acl check
2025-09-30T14:57:53.945663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:53.945666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:53.945667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:53.945674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896620227636432:12122] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:53.946257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896620227636432:12122] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:53.949546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896620227636432:12122] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:53.953381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896620227636432:12122] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:53.953397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896620227636432:12122] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:53.953401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896620227636432:12122] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:53.953410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2715 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:53.959977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:53.962844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:53.963028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:53.963039Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:53.963048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:53.963097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:53.963138Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896620137843575:9133]
2025-09-30T14:57:53.963855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:53.964139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:53.964178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:53.964502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:53.964557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.964565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.964566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.964567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.964569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.964570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.964571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.964572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.964574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.964575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.964576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.964578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.964579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.964580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.964581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.964586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.964598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.964602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.964607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.964611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.964616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.964620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.964625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.964629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.964634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.964639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.964643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.964647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.964651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.964656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.964664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.964672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:53.964677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.964682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:53.964686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.964692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:53.964696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.964702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:53.964708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.964713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:53.964718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.964724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:53.964728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.964734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:53.964739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.964744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:53.964749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.964757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:53.964762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.964772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:53.964782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.964788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.964797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.964803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.964813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.964818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.964828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.964833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:53.964844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.964854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:53.964900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:53.970379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:53.971342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:53.971359Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:53.971363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:53.971367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:53.971374Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2714 [2:7555896620137843575:9133]
2025-09-30T14:57:53.971392Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:53.971407Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:53.971416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:53.971419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:53.971422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:53.971438Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:53.971450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:53.971457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:53.971519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.971528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.971530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.971534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:53.971537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:53.971605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:53.971614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.971627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:53.971644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:53.971670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:53.971689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227636574:12122], now have 1 active actors on pipe
2025-09-30T14:57:53.971698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896620227636386:2454], now have 1 active actors on pipe
2025-09-30T14:57:53.971705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896620137843570:9133]
2025-09-30T14:57:53.971708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896620137843570:9133]
2025-09-30T14:57:53.971711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896620137843570:9133]
2025-09-30T14:57:53.971724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:53.971739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:53.971761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:53.971772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:53.971764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2714
2025-09-30T14:57:53.971769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2714
2025-09-30T14:57:53.971802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896620137843570:9133]
2025-09-30T14:57:53.971802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:53.971806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:53.971808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:53.971811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:53.971816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:53.972331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.972343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.972369Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|416942b6-1758195d-e8d9f507-13fc5559_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:53.972382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:53.972390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:53.972393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:53.972402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:53.972414Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:53.972427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:53.972593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:53.972600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:53.972615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:53.972742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2715 partition: 0 MaxSeqNo: 42 sessionId: src_id|416942b6-1758195d-e8d9f507-13fc5559_0
2025-09-30T14:57:53.973116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|217a9649-a4654646-a5b5b336-d92dc653_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|416942b6-1758195d-e8d9f507-13fc5559_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:53.975853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|416942b6-1758195d-e8d9f507-13fc5559_0] Write session: try to update token
2025-09-30T14:57:53.975869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|416942b6-1758195d-e8d9f507-13fc5559_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:53.984151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:53.984174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:53.984177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:53.984179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:53.984189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896620137843570:9133]
2025-09-30T14:57:53.984193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896620137843570:9133]
2025-09-30T14:57:53.984198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896620137843570:9133]
2025-09-30T14:57:53.984248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:53.984248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:53.984254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:53.984259Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:53.984260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:53.984262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:53.984404Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:53.990018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2715 sessionId: src_id|416942b6-1758195d-e8d9f507-13fc5559_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:53.992759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:54.034364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896624522603995:12049]
2025-09-30T14:57:54.034678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2714, pipe: [1:7555896624522603995:12049]
2025-09-30T14:57:54.098854Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:54.099276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.099291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.099332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522603995:12049], now have 1 active actors on pipe
2025-09-30T14:57:54.099583Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:54.099612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:54.099613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:54.099627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:54.099646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896624522603995:12049]
2025-09-30T14:57:54.099687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2715 reason: error at write: Disconnected sessionId: src_id|416942b6-1758195d-e8d9f507-13fc5559_0
2025-09-30T14:57:54.099862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2715 sessionId: src_id|416942b6-1758195d-e8d9f507-13fc5559_0 is DEAD
2025-09-30T14:57:54.100020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416942b6-1758195d-e8d9f507-13fc5559_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:54.100032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416942b6-1758195d-e8d9f507-13fc5559_0] Write session will restart in 0.008812s
2025-09-30T14:57:54.100055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416942b6-1758195d-e8d9f507-13fc5559_0] Write session: Do CDS request
2025-09-30T14:57:54.100061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416942b6-1758195d-e8d9f507-13fc5559_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:54.109790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|416942b6-1758195d-e8d9f507-13fc5559_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:54.109883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:54.109898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2716
2025-09-30T14:57:54.110070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2716 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:54.110116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2716 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:54.110127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2716 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:54.110132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:54.110624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2716 sessionId:  describe result for acl check
2025-09-30T14:57:54.110662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:54.110675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:54.110677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:54.110684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896624522604041:12126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:54.111278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896624522604041:12126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:54.114503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896624522604041:12126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:54.119940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896624522604041:12126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:54.119956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896624522604041:12126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:54.119960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896624522604041:12126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:54.119969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2716 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:54.124740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:54.127936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:54.128138Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:54.128152Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:54.128163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:54.128247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:54.128284Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896624432811187:9125]
2025-09-30T14:57:54.128968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:54.129273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:54.129317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:54.129652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:54.129706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.129711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.129712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.129714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.129715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.129716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.129717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.129718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.129719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.129721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.129722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.129723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.129724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.129725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.129726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.129740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.129751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.129755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.129759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.129764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.129768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.129772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.129776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.129780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.129784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.129788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.129792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.129796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.129800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.129804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.129814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.129822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.129833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.129839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.129848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.129853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.129863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.129869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.129878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.129883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.129887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.129897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.129904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.129915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.129924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.129930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.129934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.129939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.129943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.129949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.129953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.129959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.129963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.129970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.129975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.129984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.129989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.129998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.130003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.130008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.130055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:54.135538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:54.136995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:54.137011Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:54.137014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:54.137018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:54.137024Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2715 [2:7555896624432811187:9125]
2025-09-30T14:57:54.137040Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:54.137058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:54.137061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:54.137065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:54.137067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:54.137085Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:54.137096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:54.137103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:54.137162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.137169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.137171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.137174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:54.137177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:54.137242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:54.137251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.137265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.137278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.137306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:54.137330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522603996:2454], now have 1 active actors on pipe
2025-09-30T14:57:54.137334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604219:12126], now have 1 active actors on pipe
2025-09-30T14:57:54.137340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896624432811178:9125]
2025-09-30T14:57:54.137344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896624432811178:9125]
2025-09-30T14:57:54.137346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896624432811178:9125]
2025-09-30T14:57:54.137360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:54.137373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:54.137386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:54.137391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:54.137391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:54.137393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:54.137395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:54.137430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896624432811178:9125]
2025-09-30T14:57:54.137442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:54.137449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:54.137433Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2715
2025-09-30T14:57:54.137479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2715
2025-09-30T14:57:54.137573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.137582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.137606Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:54.137619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:54.137622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:54.137625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:54.137635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:54.137644Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:54.137658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:54.137853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.137862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.137875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:54.137970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2716 partition: 0 MaxSeqNo: 42 sessionId: src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0
2025-09-30T14:57:54.138420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|416942b6-1758195d-e8d9f507-13fc5559_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:54.141175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0] Write session: try to update token
2025-09-30T14:57:54.141194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:54.155665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2716 sessionId: src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:54.155895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:54.155919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:54.155927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896624432811178:9125]
2025-09-30T14:57:54.155970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:54.156145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:54.156147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:54.156294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.156434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.156577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.156776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:54.156814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:54.158492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:54.158653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.158677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.158710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:54.158824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:54.160592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:54.160618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:54.160621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:54.160623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:54.160632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896624432811178:9125]
2025-09-30T14:57:54.160636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896624432811178:9125]
2025-09-30T14:57:54.160640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896624432811178:9125]
2025-09-30T14:57:54.160681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:54.160693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.160700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:54.160829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:54.161604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:54.161621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:54.161626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:54.199747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896624522604313:12049]
2025-09-30T14:57:54.200105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2715, pipe: [1:7555896624522604313:12049]
2025-09-30T14:57:54.274511Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:54.282540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.282572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.282737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.282815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.282887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.282955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.283005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.283015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.283087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.283161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.283265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.283345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.283402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.283405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.283480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.283558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.283634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.283709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.283759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.283766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.283845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.283920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.283995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.284071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.284125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.284135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.284230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.284298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.284368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.284455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.284504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.284512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.284583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.284652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.284719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.284790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.284922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.284932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.285015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.285081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.285151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.285221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.285268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.285276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.285348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.285415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.285483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.285552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.285600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.285607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.285680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.285748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.285818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.285885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.285949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.285958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.286032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.286099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.286174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.286244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.286293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.286301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.286375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604313:12049], now have 1 active actors on pipe
2025-09-30T14:57:54.286632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896624522604313:12049]
2025-09-30T14:57:54.286649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:54.286675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:54.286677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:54.286715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2716 reason: error at write: Disconnected sessionId: src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0
2025-09-30T14:57:54.286945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2716 sessionId: src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0 is DEAD
2025-09-30T14:57:54.287068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:54.287080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0] Write session will restart in 0.008493s
2025-09-30T14:57:54.287104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0] Write session: Do CDS request
2025-09-30T14:57:54.287126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:54.287686Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:54.296416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:54.296799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:54.296853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:54.296870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2717
2025-09-30T14:57:54.297084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2717 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:54.297127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2717 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:54.297138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2717 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:54.297142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:54.297596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2717 sessionId:  describe result for acl check
2025-09-30T14:57:54.297632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:54.297639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:54.297641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:54.297647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896624522604340:12131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:54.298180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896624522604340:12131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:54.300079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:54.300301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:54.300313Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:54.300325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:54.300384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:54.300424Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896624432811257:9109]
2025-09-30T14:57:54.300902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896624522604340:12131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:54.301105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:54.301474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:54.301537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:54.301890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:54.301967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.301972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.301973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.301975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.301976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.301977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.301979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.301980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.301981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.301982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.301983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.301984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.301986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.301987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.301988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.301994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.302004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.302011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.302016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.302020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.302024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.302028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.302032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.302036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.302040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.302044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.302048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.302052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.302056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.302060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.302067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.302075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.302081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.302087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.302092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.302097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.302102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.302107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.302112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.302117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.302121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.302126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.302131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.302136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.302145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.302149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.302153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.302160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.302164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.302169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.302173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.302183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.302187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.302191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.302196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.302200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.302204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.302208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.302213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.302218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.302263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:54.307496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896624522604340:12131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:54.307511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896624522604340:12131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:54.307514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896624522604340:12131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:54.307521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2717 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:54.307658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:54.308617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:54.308635Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:54.308637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:54.308640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:54.308646Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2716 [2:7555896624432811257:9109]
2025-09-30T14:57:54.308659Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:54.308673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:54.308675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:54.308677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:54.308679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:54.308692Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:54.308697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:54.308702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:54.308762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.308770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.308771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.308774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:54.308778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:54.308842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:54.308849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.308862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.308873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.308889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:54.308913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604379:12131], now have 1 active actors on pipe
2025-09-30T14:57:54.308917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604320:2454], now have 1 active actors on pipe
2025-09-30T14:57:54.308923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896624432811251:9109]
2025-09-30T14:57:54.308925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896624432811251:9109]
2025-09-30T14:57:54.308927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896624432811251:9109]
2025-09-30T14:57:54.308939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:54.308962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:54.308964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:54.308973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:54.308974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:54.308975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:54.308976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:54.309002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896624432811251:9109]
2025-09-30T14:57:54.309023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2716
2025-09-30T14:57:54.309034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2716
2025-09-30T14:57:54.309016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:54.309038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:54.309153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.309164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.309194Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:54.309206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:54.309210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:54.309212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:54.309222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:54.309233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:54.309249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:54.309384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.309392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.309404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:54.309484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2717 partition: 0 MaxSeqNo: 42 sessionId: src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0
2025-09-30T14:57:54.309874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc75ca88-bb9ef6e7-a76598b6-f34e8723_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:54.312777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0] Write session: try to update token
2025-09-30T14:57:54.312799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:54.322036Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:54.322064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:54.322074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896624432811251:9109]
2025-09-30T14:57:54.322137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:54.322141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:54.322477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:54.322710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.322908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.323138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.323427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:54.323497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:54.328454Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2717 sessionId: src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:54.331289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:54.331435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.331461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.332875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:54.332921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:54.332925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:54.332928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:54.332930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:54.332940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896624432811251:9109]
2025-09-30T14:57:54.332960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896624432811251:9109]
2025-09-30T14:57:54.332965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896624432811251:9109]
2025-09-30T14:57:54.333007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:54.333008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:54.333014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:54.333019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:54.333020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.333025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:54.333015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:54.333165Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:54.386650Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896624522604390:12049]
2025-09-30T14:57:54.386928Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2716, pipe: [1:7555896624522604390:12049]
2025-09-30T14:57:54.446460Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:54.456127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.456171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.456540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.456758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.456826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.456891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.456940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.456960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.457032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.457110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.457176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.457252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.457311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.457321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.457575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.457655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.457928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.458199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.458248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.458264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.458340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.458410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.458480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.458549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.458601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.458608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.458688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.458773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.458841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.458910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.458965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.458973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.459049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.459118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.459189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.459274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.459323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.459330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.459404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.459502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.459573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.459642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.459712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.459720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.459981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.460245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.460506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.460577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.460631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.460637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.460712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.460782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.460856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.460925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.461010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.461018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.461091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.461157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.461424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.461686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.461823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.461831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.461901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604390:12049], now have 1 active actors on pipe
2025-09-30T14:57:54.462158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896624522604390:12049]
2025-09-30T14:57:54.462179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:54.462184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:54.462196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:54.462218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2717 reason: error at write: Disconnected sessionId: src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0
2025-09-30T14:57:54.462417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2717 sessionId: src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0 is DEAD
2025-09-30T14:57:54.462595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:54.462621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0] Write session will restart in 0.005091s
2025-09-30T14:57:54.462649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0] Write session: Do CDS request
2025-09-30T14:57:54.462655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:54.463294Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:54.468808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:54.468890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:54.468903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2718
2025-09-30T14:57:54.469061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2718 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:54.469103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2718 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:54.469112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2718 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:54.469116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:54.469568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2718 sessionId:  describe result for acl check
2025-09-30T14:57:54.469606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:54.469608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:54.469610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:54.469616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896624522604419:12136] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:54.470233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896624522604419:12136] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:54.472166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:54.472837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896624522604419:12136] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:54.475778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:54.476024Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:54.476038Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:54.476050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:54.476044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896624522604419:12136] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:54.476058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896624522604419:12136] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:54.476062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896624522604419:12136] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:54.476070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2718 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:54.476117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:54.476168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896624432811315:9119]
2025-09-30T14:57:54.476831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:54.477179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:54.477228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:54.477552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:54.477625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.477632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.477633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.477634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.477635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.477636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.477637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.477638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.477639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.477641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.477642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.477643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.477644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.477645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.477646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.477652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.477662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.477666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.477669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.477673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.477677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.477690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.477694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.477698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.477703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.477706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.477710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.477713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.477717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.477720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.477728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.477736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.477742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.477748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.477752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.477757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.477761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.477766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.477779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.477783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.477787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.477792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.477797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.477801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.477805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.477810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.477814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.477818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.477822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.477826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.477830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.477835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.477845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.477850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.477854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.477859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.477863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.477872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.477876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.477881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.477920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:54.483406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:54.484278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:54.484297Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:54.484300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:54.484304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:54.484310Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2717 [2:7555896624432811315:9119]
2025-09-30T14:57:54.484326Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:54.484348Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:54.484350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:54.484353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:54.484355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:54.484371Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:54.484377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:54.484385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:54.484463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.484472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.484474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.484477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:54.484479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:54.484545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:54.484551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.484562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.484576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.484593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:54.484615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604459:12136], now have 1 active actors on pipe
2025-09-30T14:57:54.484623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604403:2454], now have 1 active actors on pipe
2025-09-30T14:57:54.484630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896624432811309:9119]
2025-09-30T14:57:54.484640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896624432811309:9119]
2025-09-30T14:57:54.484641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896624432811309:9119]
2025-09-30T14:57:54.484652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:54.484664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:54.484665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:54.484669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:54.484671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:54.484677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:54.484684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:54.484715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896624432811309:9119]
2025-09-30T14:57:54.484723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:54.484698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2717
2025-09-30T14:57:54.484708Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2717
2025-09-30T14:57:54.484734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:54.484754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.484759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.484786Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:54.484797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:54.484801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:54.484803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:54.484811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:54.484824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:54.484842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:54.485080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.485088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.485100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:54.485181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2718 partition: 0 MaxSeqNo: 42 sessionId: src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0
2025-09-30T14:57:54.485539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef755f9-7b26d1ba-1b2c2b13-910fd2f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:54.488304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0] Write session: try to update token
2025-09-30T14:57:54.488322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:54.497345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:54.497376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:54.497389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896624432811309:9119]
2025-09-30T14:57:54.497443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:54.497445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:54.497705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:54.497898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.498090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.498281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.498547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:54.498606Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:54.506284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2718 sessionId: src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:54.508060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:54.508084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:54.508087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:54.508090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:54.508101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896624432811309:9119]
2025-09-30T14:57:54.508105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896624432811309:9119]
2025-09-30T14:57:54.508110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896624432811309:9119]
2025-09-30T14:57:54.508151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:54.508158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.508161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:54.508160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:54.508168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:54.508172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:54.508310Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:54.509175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:54.562269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896624522604471:12049]
2025-09-30T14:57:54.562571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2717, pipe: [1:7555896624522604471:12049]
2025-09-30T14:57:54.624012Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:54.624568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.624583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.624605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604471:12049], now have 1 active actors on pipe
2025-09-30T14:57:54.624828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:54.624820Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:54.624861Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896624522604471:12049]
2025-09-30T14:57:54.624881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:54.624973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2718 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0
2025-09-30T14:57:54.625178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2718 sessionId: src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0 is DEAD
2025-09-30T14:57:54.625763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:54.625773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0] Write session will restart in 0.007348s
2025-09-30T14:57:54.625794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0] Write session: Do CDS request
2025-09-30T14:57:54.625800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:54.634550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:54.634739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:54.635255Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:54.635270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2719
2025-09-30T14:57:54.635396Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2719 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:54.635433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2719 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:54.635439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2719 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:54.635442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:54.635886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2719 sessionId:  describe result for acl check
2025-09-30T14:57:54.635930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:54.635937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:54.635938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:54.635947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896624522604493:12140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:54.636485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896624522604493:12140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:54.638282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:54.638392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896624522604493:12140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:54.638491Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:54.638502Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:54.638513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:54.638563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:54.638601Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896624432811376:9116]
2025-09-30T14:57:54.639266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:54.639620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:54.639671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:54.640011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:54.640082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.640088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.640090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.640091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.640092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.640093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.640095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.640096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.640097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.640099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.640103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.640104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.640105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.640107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.640108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.640114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.640123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.640127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.640131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.640134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.640137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.640141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.640144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.640148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.640152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.640156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.640159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.640163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.640166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.640170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.640177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.640186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.640192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.640197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.640201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.640205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.640209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.640214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.640219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.640224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.640228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.640234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.640238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.640243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.640246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.640251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.640256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.640260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.640266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.640270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.640275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.640279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.640283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.640287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.640292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.640298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.640303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.640307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.640313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.640318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.640363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:54.641004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896624522604493:12140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:54.641018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896624522604493:12140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:54.641021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896624522604493:12140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:54.641030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2719 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:54.646023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:54.646916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:54.646942Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:54.646946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:54.646950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:54.646957Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2718 [2:7555896624432811376:9116]
2025-09-30T14:57:54.646973Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:54.646990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:54.646999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:54.647002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:54.647004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:54.647027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:54.647038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:54.647045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:54.647112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.647119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.647122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.647125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:54.647128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:54.647199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:54.647207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.647221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.647240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.647279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:54.647304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604472:2454], now have 1 active actors on pipe
2025-09-30T14:57:54.647319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604531:12140], now have 1 active actors on pipe
2025-09-30T14:57:54.647327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896624432811370:9116]
2025-09-30T14:57:54.647329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896624432811370:9116]
2025-09-30T14:57:54.647331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896624432811370:9116]
2025-09-30T14:57:54.647344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:54.647358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:54.647359Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:54.647362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:54.647364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:54.647378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:54.647382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:54.647417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896624432811370:9116]
2025-09-30T14:57:54.647427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:54.647429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:54.647395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2718
2025-09-30T14:57:54.647445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2718
2025-09-30T14:57:54.647551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.647563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.647587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:54.647600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:54.647604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:54.647606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:54.647618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:54.647628Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:54.647649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:54.647844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.647853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.647865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:54.647968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2719 partition: 0 MaxSeqNo: 42 sessionId: src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0
2025-09-30T14:57:54.648315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f40a09d0-9e5a946-4e20bbcc-2ea58273_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:54.651356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0] Write session: try to update token
2025-09-30T14:57:54.651379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:54.663033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:54.663059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:54.663069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896624432811370:9116]
2025-09-30T14:57:54.663119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:54.663122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:54.663305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:54.663457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.663600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.663741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.663934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:54.663979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:54.668437Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2719 sessionId: src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:54.671142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:54.671382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.671412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.671456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:54.671549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:54.673342Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:54.673361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:54.673364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:54.673366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:54.673377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896624432811370:9116]
2025-09-30T14:57:54.673384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896624432811370:9116]
2025-09-30T14:57:54.673388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896624432811370:9116]
2025-09-30T14:57:54.673425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:54.673437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.673437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:54.673440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:54.673443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:54.673448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:54.673617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:54.725110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896624522604540:12049]
2025-09-30T14:57:54.725444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2718, pipe: [1:7555896624522604540:12049]
2025-09-30T14:57:54.787864Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:54.796481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.796509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.796688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.796757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.796829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.796897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.796965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.796976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.797054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.797126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.797200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.797265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.797307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.797310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.797385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.797484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.797559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.797618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.797656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.797658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.797727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.797781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.797868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.797928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.797979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.797982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.798047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.798106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.798166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.798230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.798275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.798278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.798349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.798401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.798462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.798561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.798615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.798617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.798689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.798755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.798829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.798895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.798953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.798955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.799018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.799070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.799126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.799184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.799537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.799553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.799624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.799687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.799756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.799821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.799871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.799877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.799947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:54.800010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:54.800075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:54.800143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:54.800189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:54.800195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:54.800267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604540:12049], now have 1 active actors on pipe
2025-09-30T14:57:54.803486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896624522604540:12049]
2025-09-30T14:57:54.803524Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:54.803491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:54.803523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:54.803525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:54.803553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2719 reason: error at write: Disconnected sessionId: src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0
2025-09-30T14:57:54.803733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2719 sessionId: src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0 is DEAD
2025-09-30T14:57:54.803900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:54.803922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0] Write session will restart in 0.009256s
2025-09-30T14:57:54.803947Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0] Write session: Do CDS request
2025-09-30T14:57:54.803954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:54.813493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:54.814775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:54.815372Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:54.815389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2720
2025-09-30T14:57:54.815527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2720 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:54.815562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2720 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:54.815571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2720 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:54.815576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:54.816022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2720 sessionId:  describe result for acl check
2025-09-30T14:57:54.816061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:54.816062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:54.816064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:54.816070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896624522604591:12152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:54.816632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896624522604591:12152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:54.817166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:54.817391Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:54.817400Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:54.817412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:54.817483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:54.817525Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896624432811472:9095]
2025-09-30T14:57:54.818121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:54.818425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:54.818472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:54.818563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896624522604591:12152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:54.818789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:54.818866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.818872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.818873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.818874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.818875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.818876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.818878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.818879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.818880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.818881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.818883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.818884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.818885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.818886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.818887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.818892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.818901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.818905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.818911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.818915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.818918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.818921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.818925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.818928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.818932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.818936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.818939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.818942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.818946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.818950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.818957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.818965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.818970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.818975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.818979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.818984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.818988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.818993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.818997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.819017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.819027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.819032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.819037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.819046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.819050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.819055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.819059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.819068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.819072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.819078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.819082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.819086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.819090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.819095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.819099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.819104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.819123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.819131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.819135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.819139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.819181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:54.824271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896624522604591:12152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:54.824287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896624522604591:12152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:54.824291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896624522604591:12152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:54.824300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2720 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:54.824583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:54.825489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:54.825507Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:54.825510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:54.825514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:54.825519Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2719 [2:7555896624432811472:9095]
2025-09-30T14:57:54.825537Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:54.825551Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:54.825559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:54.825562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:54.825565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:54.825581Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:54.825592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:54.825598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:54.825659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.825666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.825668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.825671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:54.825674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:54.825736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:54.825743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.825758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.825774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.825796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:54.825819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604626:12152], now have 1 active actors on pipe
2025-09-30T14:57:54.825827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604568:2454], now have 1 active actors on pipe
2025-09-30T14:57:54.825833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896624432811466:9095]
2025-09-30T14:57:54.825835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896624432811466:9095]
2025-09-30T14:57:54.825837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896624432811466:9095]
2025-09-30T14:57:54.825849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:54.825866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:54.825869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:54.825872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:54.825874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:54.825886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:54.825888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:54.825878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2719
2025-09-30T14:57:54.825882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2719
2025-09-30T14:57:54.825920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896624432811466:9095]
2025-09-30T14:57:54.825929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:54.825932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:54.825951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.825955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.825999Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5238ae04-f989522c-1a166177-41c4c95a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:54.826009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:54.826016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:54.826018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:54.826029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:54.826038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:54.826067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:54.826223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.826232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.826245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:54.826321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2720 partition: 0 MaxSeqNo: 42 sessionId: src_id|5238ae04-f989522c-1a166177-41c4c95a_0
2025-09-30T14:57:54.826694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2aef7e7-f835fe5-5afd34b3-c4293268_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5238ae04-f989522c-1a166177-41c4c95a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:54.829512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5238ae04-f989522c-1a166177-41c4c95a_0] Write session: try to update token
2025-09-30T14:57:54.829532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5238ae04-f989522c-1a166177-41c4c95a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:54.838122Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:54.838148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:54.838151Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:54.838153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:54.838163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896624432811466:9095]
2025-09-30T14:57:54.838167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896624432811466:9095]
2025-09-30T14:57:54.838171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896624432811466:9095]
2025-09-30T14:57:54.838211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:54.838218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.838219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:54.838221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:54.838226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:54.838230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:54.838368Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:54.844832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2720 sessionId: src_id|5238ae04-f989522c-1a166177-41c4c95a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:54.847728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:54.903745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896624522604634:12049]
2025-09-30T14:57:54.904021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2719, pipe: [1:7555896624522604634:12049]
2025-09-30T14:57:54.953104Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:54.953816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.953834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.953854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604634:12049], now have 1 active actors on pipe
2025-09-30T14:57:54.954115Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:54.954561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5238ae04-f989522c-1a166177-41c4c95a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:54.954574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5238ae04-f989522c-1a166177-41c4c95a_0] Write session will restart in 0.009332s
2025-09-30T14:57:54.954607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5238ae04-f989522c-1a166177-41c4c95a_0] Write session: Do CDS request
2025-09-30T14:57:54.954612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5238ae04-f989522c-1a166177-41c4c95a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:54.954121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896624522604634:12049]
2025-09-30T14:57:54.954154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:54.954156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:54.954225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2720 reason: error at write: Disconnected sessionId: src_id|5238ae04-f989522c-1a166177-41c4c95a_0
2025-09-30T14:57:54.954432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2720 sessionId: src_id|5238ae04-f989522c-1a166177-41c4c95a_0 is DEAD
2025-09-30T14:57:54.954591Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:54.964928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5238ae04-f989522c-1a166177-41c4c95a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:54.966031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:54.967400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:54.967412Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2721
2025-09-30T14:57:54.967584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2721 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:54.967620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2721 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:54.967630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2721 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:54.967635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:54.968112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2721 sessionId:  describe result for acl check
2025-09-30T14:57:54.968148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:54.968154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:54.968155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:54.968161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896624522604663:12156] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:54.968699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896624522604663:12156] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:54.968462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:54.968674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:54.968679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:54.968689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:54.968744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:54.968778Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896624432811533:9079]
2025-09-30T14:57:54.969485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:54.969732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:54.969782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:54.970112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:54.970177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.970184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.970187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.970189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.970190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.970191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.970192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.970194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.970195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.970196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.970197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.970198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.970199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.970200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.970201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.970207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.970217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.970222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.970227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.970231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.970235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.970240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.970244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.970249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.970253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.970258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.970262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.970266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.970271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.970275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.970282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.970290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:54.970296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.970304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:54.970314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.970319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:54.970324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.970334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:54.970344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.970350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:54.970359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.970364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:54.970376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.970386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:54.970390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.970395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:54.970405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.970411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:54.970420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.970425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:54.970435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.970440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.970449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.970454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.970464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.970469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.970479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.970484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:54.970493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.970499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:54.970554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:54.970626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896624522604663:12156] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:54.975844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896624522604663:12156] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:54.975859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896624522604663:12156] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:54.975863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896624522604663:12156] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:54.975872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2721 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:54.976143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:54.977063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:54.977082Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:54.977084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:54.977088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:54.977099Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2720 [2:7555896624432811533:9079]
2025-09-30T14:57:54.977116Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:54.977131Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:54.977140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:54.977143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:54.977146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:54.977161Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:54.977169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:54.977179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:54.977237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.977244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.977246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.977250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:54.977252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:54.977322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:54.977333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:54.977345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:54.977360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:54.977384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:54.977405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604639:2454], now have 1 active actors on pipe
2025-09-30T14:57:54.977414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896624522604698:12156], now have 1 active actors on pipe
2025-09-30T14:57:54.977423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896624432811527:9079]
2025-09-30T14:57:54.977425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896624432811527:9079]
2025-09-30T14:57:54.977427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896624432811527:9079]
2025-09-30T14:57:54.977443Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:54.977456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:54.977470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:54.977473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:54.977506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896624432811527:9079]
2025-09-30T14:57:54.977514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:54.977567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:54.977583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:54.977585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:54.977592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:54.977851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2720
2025-09-30T14:57:54.977852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2720
2025-09-30T14:57:54.978015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.978030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.978059Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:54.978073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:54.978081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:54.978088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:54.978099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:54.978115Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:54.978159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:54.978389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.978397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.978410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:54.978514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2721 partition: 0 MaxSeqNo: 42 sessionId: src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0
2025-09-30T14:57:54.978891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5238ae04-f989522c-1a166177-41c4c95a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:54.981806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0] Write session: try to update token
2025-09-30T14:57:54.981826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:54.990124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:54.990149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:54.990160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896624432811527:9079]
2025-09-30T14:57:54.990205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:54.990212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:54.990400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:54.990546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.990678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.990811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:54.991008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:54.991045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:54.996358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2721 sessionId: src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:54.999097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:54.999362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:54.999387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:54.999427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:54.999506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:55.001445Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:55.001474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:55.001477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:55.001479Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:55.001489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896624432811527:9079]
2025-09-30T14:57:55.001493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896624432811527:9079]
2025-09-30T14:57:55.001497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896624432811527:9079]
2025-09-30T14:57:55.001539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:55.001551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.001553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:55.001560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:55.001576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:55.001581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:55.001747Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:55.054274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896628817572002:12049]
2025-09-30T14:57:55.054586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2720, pipe: [1:7555896628817572002:12049]
2025-09-30T14:57:55.115087Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:55.123109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.123145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.123344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.123416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.123488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.123556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.123611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.123626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.123702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.123777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.123851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.123932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.123984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.123998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.124079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.124150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.124227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.124301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.124361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.124371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.124449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.124524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.124595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.124667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.124717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.124726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.124842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.124912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.124999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.125071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.125116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.125126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.125197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.125268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.125333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.125407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.125454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.125457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.125530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.125597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.125674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.125748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.125793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.125800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.125869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.125941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.126009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.126078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.126208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.126215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.126284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.126356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.126428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.126492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.126540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.126547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.126621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.126683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.126753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.126822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.126869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.126875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.126943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572002:12049], now have 1 active actors on pipe
2025-09-30T14:57:55.127168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:55.127170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896628817572002:12049]
2025-09-30T14:57:55.127198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:55.127201Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:55.127237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2721 reason: error at write: Disconnected sessionId: src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0
2025-09-30T14:57:55.127440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2721 sessionId: src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0 is DEAD
2025-09-30T14:57:55.127581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:55.127587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0] Write session will restart in 0.008953s
2025-09-30T14:57:55.127612Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0] Write session: Do CDS request
2025-09-30T14:57:55.127617Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:55.128150Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:55.137810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:55.137915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:55.137932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2722
2025-09-30T14:57:55.138084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2722 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:55.138117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2722 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:55.138126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2722 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:55.138130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:55.138586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2722 sessionId:  describe result for acl check
2025-09-30T14:57:55.138623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:55.138629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:55.138630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:55.138637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896628817572027:12160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:55.138939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:55.139626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896628817572027:12160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:55.142181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896628817572027:12160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:55.142384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:55.142567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:55.142576Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:55.142584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:55.142625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:55.142657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896628727778893:9080]
2025-09-30T14:57:55.143133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:55.143448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:55.143486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:55.143735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:55.143803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.143814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.143816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.143817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.143818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.143819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.143821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.143822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.143823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.143824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.143826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.143827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.143828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.143829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.143830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.143835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.143845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.143850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.143854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.143858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.143862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.143866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.143870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.143874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.143879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.143883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.143887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.143893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.143897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.143901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.143909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.143917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.143923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.143929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.143933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.143939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.143941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.143944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.143946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.143949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.143951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.143954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.143957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.143960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.143963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.143966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.143969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.143972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.143974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.143977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.143979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.143982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.143984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.143987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.143990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.143992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.143995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.143999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.144002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.144004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.144034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:55.147500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896628817572027:12160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:55.147514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896628817572027:12160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:55.147517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896628817572027:12160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:55.147525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2722 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:55.149599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:55.150521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:55.150541Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:55.150544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:55.150547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:55.150554Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2721 [2:7555896628727778893:9080]
2025-09-30T14:57:55.150570Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:55.150583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:55.150586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:55.150589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:55.150591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:55.150607Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:55.150619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:55.150626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:55.150683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.150690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.150693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.150696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:55.150699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:55.150769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:55.150777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.150790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.150807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.150829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:55.150851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572067:12160], now have 1 active actors on pipe
2025-09-30T14:57:55.150856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572004:2454], now have 1 active actors on pipe
2025-09-30T14:57:55.150863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896628727778887:9080]
2025-09-30T14:57:55.150865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896628727778887:9080]
2025-09-30T14:57:55.150867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896628727778887:9080]
2025-09-30T14:57:55.150878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:55.150891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:55.150905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:55.150908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:55.150937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896628727778887:9080]
2025-09-30T14:57:55.150939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:55.150976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:55.150979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:55.150981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:55.150986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:55.150960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2721
2025-09-30T14:57:55.150992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2721
2025-09-30T14:57:55.151103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.151117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.151143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:55.151154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:55.151158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:55.151161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:55.151171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:55.151184Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:55.151198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:55.151353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.151361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.151374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:55.151468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2722 partition: 0 MaxSeqNo: 42 sessionId: src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0
2025-09-30T14:57:55.151810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3f0c32-d65ff3fd-fbe6c691-5faa8288_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:55.154674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0] Write session: try to update token
2025-09-30T14:57:55.154693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:55.164615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:55.164638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:55.164646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896628727778887:9080]
2025-09-30T14:57:55.164690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:55.164706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:55.164871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:55.165049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:55.165194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:55.165379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:55.165571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:55.165615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:55.175985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:55.176011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:55.176013Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:55.176016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:55.176026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896628727778887:9080]
2025-09-30T14:57:55.176030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896628727778887:9080]
2025-09-30T14:57:55.176035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896628727778887:9080]
2025-09-30T14:57:55.176078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:55.176090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.176093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:55.176239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:55.176786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2722 sessionId: src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:55.179352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:55.179376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:55.179382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:55.179501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:55.227333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896628817572077:12049]
2025-09-30T14:57:55.227625Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2721, pipe: [1:7555896628817572077:12049]
2025-09-30T14:57:55.297319Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:55.297950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.297960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.297981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572077:12049], now have 1 active actors on pipe
2025-09-30T14:57:55.298261Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896628817572077:12049]
2025-09-30T14:57:55.298285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:55.298289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:55.298289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:55.298357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2722 reason: error at write: Disconnected sessionId: src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0
2025-09-30T14:57:55.298225Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:55.298554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2722 sessionId: src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0 is DEAD
2025-09-30T14:57:55.299002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:55.299012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0] Write session will restart in 0.005642s
2025-09-30T14:57:55.299039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0] Write session: Do CDS request
2025-09-30T14:57:55.299047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:55.305838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:55.305929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:55.305942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2723
2025-09-30T14:57:55.307471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2723 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:55.307522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2723 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:55.307539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2723 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:55.307548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:55.308133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2723 sessionId:  describe result for acl check
2025-09-30T14:57:55.308168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:55.308170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:55.308172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:55.308177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896628817572094:12165] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:55.308763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896628817572094:12165] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:55.310998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896628817572094:12165] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:55.313533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:55.313658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896628817572094:12165] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:55.313672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896628817572094:12165] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:55.313675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896628817572094:12165] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:55.313685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2723 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:55.317357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:55.317616Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:55.317629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:55.317640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:55.317709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:55.317757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896628727778969:9087]
2025-09-30T14:57:55.318450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:55.318799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:55.318864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:55.319265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:55.319349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.319357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.319358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.319359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.319361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.319362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.319363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.319364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.319365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.319367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.319368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.319369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.319370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.319371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.319373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.319379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.319390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.319394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.319398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.319402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.319407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.319411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.319416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.319420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.319425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.319429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.319434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.319439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.319444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.319448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.319457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.319465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.319472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.319478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.319483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.319489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.319494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.319500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.319506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.319511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.319516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.319521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.319527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.319533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.319537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.319543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.319548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.319554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.319559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.319565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.319571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.319576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.319582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.319587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.319595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.319601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.319607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.319613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.319619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.319624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.319674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:55.328202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:55.329111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:55.329132Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:55.329135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:55.329140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:55.329147Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2722 [2:7555896628727778969:9087]
2025-09-30T14:57:55.329167Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:55.329185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:55.329189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:55.329193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:55.329196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:55.329214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:55.329227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:55.329234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:55.329297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.329309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.329311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.329315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:55.329759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2722
2025-09-30T14:57:55.329318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:55.329773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2722
2025-09-30T14:57:55.329396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:55.329399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.329416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.329429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.329447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:55.329465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896628727778963:9087]
2025-09-30T14:57:55.329467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896628727778963:9087]
2025-09-30T14:57:55.329469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896628727778963:9087]
2025-09-30T14:57:55.329484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:55.329500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:55.329516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:55.329519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:55.329533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:55.329537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:55.329539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:55.329554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896628727778963:9087]
2025-09-30T14:57:55.329557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:55.329621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:55.329770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572140:12165], now have 1 active actors on pipe
2025-09-30T14:57:55.329775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572081:2454], now have 1 active actors on pipe
2025-09-30T14:57:55.331726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.331748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.331778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:55.331803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:55.331812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:55.331815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:55.331828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:55.331847Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:55.331881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:55.332113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.332127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.332147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:55.332271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2723 partition: 0 MaxSeqNo: 42 sessionId: src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0
2025-09-30T14:57:55.332669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a44337a5-b3ed4309-b339b55a-21a0b9c4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:55.335456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0] Write session: try to update token
2025-09-30T14:57:55.335474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:55.342277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:55.342308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:55.342319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896628727778963:9087]
2025-09-30T14:57:55.342367Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:55.342375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:55.342607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:55.342772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:55.342930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:55.343090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:55.343321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:55.343364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:55.353182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:55.353209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:55.353212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:55.353214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:55.353224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896628727778963:9087]
2025-09-30T14:57:55.353229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896628727778963:9087]
2025-09-30T14:57:55.353234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896628727778963:9087]
2025-09-30T14:57:55.353276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:55.353284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.353286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:55.353325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:55.353344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:55.353348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:55.353516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:55.363062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2723 sessionId: src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:55.366010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:55.398340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896628817572157:12049]
2025-09-30T14:57:55.398681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2722, pipe: [1:7555896628817572157:12049]
2025-09-30T14:57:55.471976Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:55.472302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.472318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.472338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572157:12049], now have 1 active actors on pipe
2025-09-30T14:57:55.472636Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:55.473150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:55.473161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0] Write session will restart in 0.008596s
2025-09-30T14:57:55.473185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0] Write session: Do CDS request
2025-09-30T14:57:55.473198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:55.472717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:55.472733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:55.472802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2723 reason: error at write: Disconnected sessionId: src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0
2025-09-30T14:57:55.473003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2723 sessionId: src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0 is DEAD
2025-09-30T14:57:55.473098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896628817572157:12049]
2025-09-30T14:57:55.473116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:55.482776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:55.482804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:55.482835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2724
2025-09-30T14:57:55.483000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2724 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:55.483034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2724 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:55.483039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2724 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:55.483044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:55.483498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2724 sessionId:  describe result for acl check
2025-09-30T14:57:55.483530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:55.483532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:55.483536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:55.483541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896628817572179:12170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:55.484073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896628817572179:12170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:55.487560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896628817572179:12170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:55.493077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896628817572179:12170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:55.493094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896628817572179:12170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:55.493097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896628817572179:12170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:55.493105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2724 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:55.492856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:55.495705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:55.495943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:55.495959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:55.495971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:55.496059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:55.496100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896628727779033:9081]
2025-09-30T14:57:55.496715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:55.497045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:55.497098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:55.497422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:55.497504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.497512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.497513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.497514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.497515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.497516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.497517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.497519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.497520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.497521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.497522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.497523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.497524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.497525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.497527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.497532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.497542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.497546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.497549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.497555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.497558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.497562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.497565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.497568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.497574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.497578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.497581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.497584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.497588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.497591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.497599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.497606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.497611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.497615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.497620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.497625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.497629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.497634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.497638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.497644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.497648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.497653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.497657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.497661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.497665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.497670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.497674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.497679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.497683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.497687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.497692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.497717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.497730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.497734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.497739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.497744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.497747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.497752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.497757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.497761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.497804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:55.503666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:55.504620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:55.504637Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:55.504641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:55.504645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:55.504652Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2723 [2:7555896628727779033:9081]
2025-09-30T14:57:55.504671Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:55.504689Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:55.504692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:55.504695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:55.504698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:55.504716Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:55.504729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:55.504736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:55.504800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.504809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.504811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.504815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:55.504818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:55.504885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:55.504892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.504904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.504918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.504937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:55.504971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572170:2454], now have 1 active actors on pipe
2025-09-30T14:57:55.504975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572231:12170], now have 1 active actors on pipe
2025-09-30T14:57:55.504982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896628727779027:9081]
2025-09-30T14:57:55.504985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896628727779027:9081]
2025-09-30T14:57:55.504987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896628727779027:9081]
2025-09-30T14:57:55.505071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2723
2025-09-30T14:57:55.505076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2723
2025-09-30T14:57:55.505001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:55.505023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:55.505039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:55.505043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:55.505078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896628727779027:9081]
2025-09-30T14:57:55.505080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:55.505189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:55.505191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:55.505193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:55.505199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:55.505356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.505368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.505403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e4bc69d-4264927a-bbd11861-da372202_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:55.505430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:55.505440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:55.505442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:55.505452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:55.505469Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:55.505503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:55.505724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.505739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.505769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:55.505889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2724 partition: 0 MaxSeqNo: 42 sessionId: src_id|9e4bc69d-4264927a-bbd11861-da372202_0
2025-09-30T14:57:55.506250Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37589d0a-fb62ca39-3714e908-3b97fb2c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9e4bc69d-4264927a-bbd11861-da372202_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:55.509128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4bc69d-4264927a-bbd11861-da372202_0] Write session: try to update token
2025-09-30T14:57:55.509150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4bc69d-4264927a-bbd11861-da372202_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:55.518946Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:55.518970Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:55.518987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896628727779027:9081]
2025-09-30T14:57:55.519036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:55.519051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:55.519263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:55.519426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:55.519596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:55.519747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:55.519958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:55.520006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:55.526251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2724 sessionId: src_id|9e4bc69d-4264927a-bbd11861-da372202_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:55.529441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:55.529716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.529763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.529807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:55.531638Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:55.531664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:55.531667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:55.531670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:55.531681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896628727779027:9081]
2025-09-30T14:57:55.531686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896628727779027:9081]
2025-09-30T14:57:55.531690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896628727779027:9081]
2025-09-30T14:57:55.531737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:55.531746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.531750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:55.531913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:55.530044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:55.535336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:55.535358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:55.535363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:55.571435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896628817572244:12049]
2025-09-30T14:57:55.571795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2723, pipe: [1:7555896628817572244:12049]
2025-09-30T14:57:55.646031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:55.654586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.654622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.654789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.654854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.654931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.654998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.655051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.655062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.655137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.655203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.655293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.655365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.655415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.655424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.655498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.655565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.655632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.655704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.655759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.655771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.655847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.655918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.655985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.656057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.656101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.656108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.656183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.656248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.656319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.656388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.656439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.656446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.656523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.656588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.656657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.656725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.656775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.656786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.656861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.656930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.657017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.657086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.657132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.657139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.657214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.657276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.657347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.657422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.657489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.657497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.657569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.657635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.657702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.657770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.657896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.657903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.657979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.658048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.658115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.658182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.658230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.658237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.658306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572244:12049], now have 1 active actors on pipe
2025-09-30T14:57:55.658547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896628817572244:12049]
2025-09-30T14:57:55.658563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:55.658600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:55.658603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:55.658633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2724 reason: error at write: Disconnected sessionId: src_id|9e4bc69d-4264927a-bbd11861-da372202_0
2025-09-30T14:57:55.658929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2724 sessionId: src_id|9e4bc69d-4264927a-bbd11861-da372202_0 is DEAD
2025-09-30T14:57:55.659077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4bc69d-4264927a-bbd11861-da372202_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:55.659088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4bc69d-4264927a-bbd11861-da372202_0] Write session will restart in 0.009629s
2025-09-30T14:57:55.659120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4bc69d-4264927a-bbd11861-da372202_0] Write session: Do CDS request
2025-09-30T14:57:55.659126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4bc69d-4264927a-bbd11861-da372202_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:55.659864Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:55.669779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4bc69d-4264927a-bbd11861-da372202_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:55.669922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:55.669939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2725
2025-09-30T14:57:55.669558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:55.670102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2725 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:55.670152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2725 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:55.670163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2725 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:55.670167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:55.670704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2725 sessionId:  describe result for acl check
2025-09-30T14:57:55.670742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:55.670744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:55.670746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:55.670753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896628817572275:12174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:55.671343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896628817572275:12174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:55.673247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:55.673484Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:55.673498Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:55.673510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:55.673571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:55.673615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896628727779099:9082]
2025-09-30T14:57:55.674247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:55.674469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896628817572275:12174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:55.674588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:55.674642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:55.675000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:55.675080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.675087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.675088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.675089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.675090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.675091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.675093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.675094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.675096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.675097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.675100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.675101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.675102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.675103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.675104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.675110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.675119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.675122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.675126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.675129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.675133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.675137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.675140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.675144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.675149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.675153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.675157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.675161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.675165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.675169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.675176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.675184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.675189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.675195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.675199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.675205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.675210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.675216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.675221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.675226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.675230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.675236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.675257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.675262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.675266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.675271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.675281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.675286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.675289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.675294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.675303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.675307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.675310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.675315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.675319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.675328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.675334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.675339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.675347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.675354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.675400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:55.680820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896628817572275:12174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:55.680842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896628817572275:12174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:55.680846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896628817572275:12174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:55.680857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2725 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:55.681036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:55.681934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:55.681952Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:55.681954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:55.681958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:55.681968Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2724 [2:7555896628727779099:9082]
2025-09-30T14:57:55.681987Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:55.682004Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:55.682007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:55.682011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:55.682013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:55.682035Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:55.682042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:55.682050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:55.682105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.682106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.682108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.682112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:55.682115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:55.682186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:55.682196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.682208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.682220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.682235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:55.682252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896628727779093:9082]
2025-09-30T14:57:55.682261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896628727779093:9082]
2025-09-30T14:57:55.682263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896628727779093:9082]
2025-09-30T14:57:55.682273Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:55.682283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:55.682287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:55.682289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:55.682290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:55.682302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:55.682304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:55.682315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572246:2454], now have 1 active actors on pipe
2025-09-30T14:57:55.682318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572312:12174], now have 1 active actors on pipe
2025-09-30T14:57:55.682353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896628727779093:9082]
2025-09-30T14:57:55.682361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:55.682371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:55.682588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.682383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2724
2025-09-30T14:57:55.682396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2724
2025-09-30T14:57:55.682608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.682641Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:55.682650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:55.682654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:55.682656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:55.682668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:55.682681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:55.682697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:55.683186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.683200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.683221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:55.683326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2725 partition: 0 MaxSeqNo: 42 sessionId: src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0
2025-09-30T14:57:55.687398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e4bc69d-4264927a-bbd11861-da372202_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:55.690304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0] Write session: try to update token
2025-09-30T14:57:55.690326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:55.695197Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:55.695224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:55.695227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:55.695230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:55.695239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896628727779093:9082]
2025-09-30T14:57:55.695260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896628727779093:9082]
2025-09-30T14:57:55.695264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896628727779093:9082]
2025-09-30T14:57:55.695306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:55.695322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.695325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:55.695341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:55.695364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:55.695376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:55.695470Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:55.707839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2725 sessionId: src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:55.710891Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:55.758805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896628817572322:12049]
2025-09-30T14:57:55.759167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2724, pipe: [1:7555896628817572322:12049]
2025-09-30T14:57:55.818718Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:55.820373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.820398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.820418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572322:12049], now have 1 active actors on pipe
2025-09-30T14:57:55.820633Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:55.820897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:55.820969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:55.821051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2725 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0
2025-09-30T14:57:55.821240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2725 sessionId: src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0 is DEAD
2025-09-30T14:57:55.821432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896628817572322:12049]
2025-09-30T14:57:55.821456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:55.821468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0] Write session will restart in 0.005146s
2025-09-30T14:57:55.821490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0] Write session: Do CDS request
2025-09-30T14:57:55.821498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:55.827784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:55.827866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:55.827879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2726
2025-09-30T14:57:55.828067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2726 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:55.828100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2726 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:55.828110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2726 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:55.828114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:55.828504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2726 sessionId:  describe result for acl check
2025-09-30T14:57:55.828549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:55.828555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:55.828556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:55.828561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896628817572374:12186] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:55.829059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896628817572374:12186] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:55.829752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:55.830519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896628817572374:12186] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:55.832984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:55.833227Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:55.833237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:55.833248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:55.833304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:55.833364Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896628727779201:9064]
2025-09-30T14:57:55.833592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896628817572374:12186] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:55.833609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896628817572374:12186] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:55.833612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896628817572374:12186] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:55.833620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2726 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:55.834022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:55.834330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:55.834374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:55.834731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:55.834797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.834803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.834804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.834805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.834807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.834808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.834809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.834810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.834811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.834812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.834813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.834814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.834815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.834816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.834817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.834823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.834834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.834838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.834842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.834847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.834851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.834855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.834859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.834863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.834868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.834872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.834876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.834880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.834885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.834888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.834895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.834905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:55.834912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.834918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:55.834922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.834927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:55.834932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.834938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:55.834943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.834948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:55.834952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.834958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:55.834964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.834969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:55.834974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.834979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:55.834984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.834989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:55.834999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.835004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:55.835011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.835021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.835025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.835036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.835040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.835046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.835056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.835061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:55.835065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.835075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:55.835120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:55.840497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:55.841814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:55.841831Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:55.841837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:55.841841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:55.841848Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2725 [2:7555896628727779201:9064]
2025-09-30T14:57:55.841860Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:55.841873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:55.841880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:55.841882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:55.841884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:55.841897Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:55.841901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:55.841907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:55.841954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.841960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.841962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.841965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:55.841966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:55.842026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:55.842037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.842048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:55.842059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:55.842074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:55.842092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572336:2454], now have 1 active actors on pipe
2025-09-30T14:57:55.842104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896628727779195:9064]
2025-09-30T14:57:55.842106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896628727779195:9064]
2025-09-30T14:57:55.842108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896628727779195:9064]
2025-09-30T14:57:55.842120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:55.842128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572407:12186], now have 1 active actors on pipe
2025-09-30T14:57:55.842133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:55.842136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:55.842138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:55.842141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:55.842155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:55.842159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:55.842190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896628727779195:9064]
2025-09-30T14:57:55.842201Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:55.842227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:55.842202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2725
2025-09-30T14:57:55.842211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2725
2025-09-30T14:57:55.842285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.842295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.842322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:55.842335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:55.842338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:55.842341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:55.842352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:55.842366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:55.842389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:55.842565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.842573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.842587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:55.842672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2726 partition: 0 MaxSeqNo: 42 sessionId: src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0
2025-09-30T14:57:55.843087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9eecb924-4ae69b88-39d02cbb-4ef226ff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:55.846022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0] Write session: try to update token
2025-09-30T14:57:55.846042Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:55.854499Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:55.854515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:55.854526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896628727779195:9064]
2025-09-30T14:57:55.854578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:55.854579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:55.854788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:55.854940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:55.855089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:55.855238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:55.855453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:55.855502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:55.861566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2726 sessionId: src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:55.864558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:55.864735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.864759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.866006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:55.866025Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:55.866028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:55.866030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:55.866040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896628727779195:9064]
2025-09-30T14:57:55.866044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896628727779195:9064]
2025-09-30T14:57:55.866049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896628727779195:9064]
2025-09-30T14:57:55.866091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:55.866104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:55.866110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:55.866113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:55.866115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:55.866120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:55.866123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:55.866208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:55.866265Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:55.921620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896628817572420:12049]
2025-09-30T14:57:55.921986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2725, pipe: [1:7555896628817572420:12049]
2025-09-30T14:57:55.982798Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:55.991863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:55.991891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:55.992084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.992163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.992242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.992317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.992780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.992798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.992877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.992966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.993139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.993565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.993625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.993633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.993719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.993803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.993912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.993983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.994035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.994038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.994118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.994188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.994267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.994347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.994404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.994413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.994524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.994653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.994749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.994835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.994887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.994895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.994973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.995051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.995130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.995211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.995279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.995286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.995355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.995414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.995477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.995544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.995696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.995705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.995770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.995829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.995890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.995950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.995995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.996005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.996069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.996128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.996191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.996253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.996297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.996303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.996370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:55.996430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:55.996494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:55.996555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:55.996599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:55.996604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:55.996665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572420:12049], now have 1 active actors on pipe
2025-09-30T14:57:55.996868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:55.996889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896628817572420:12049]
2025-09-30T14:57:55.996924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:55.996932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:55.996976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2726 reason: error at write: Disconnected sessionId: src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0
2025-09-30T14:57:55.997155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2726 sessionId: src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0 is DEAD
2025-09-30T14:57:55.997317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:55.997328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0] Write session will restart in 0.006434s
2025-09-30T14:57:55.997353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0] Write session: Do CDS request
2025-09-30T14:57:55.997359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:55.997344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:56.004811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:56.004886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:56.004910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2727
2025-09-30T14:57:56.005060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2727 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:56.005091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2727 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:56.005098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2727 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:56.005106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:56.005543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2727 sessionId:  describe result for acl check
2025-09-30T14:57:56.005580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:56.005587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:56.005588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:56.005594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896633112539748:12190] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:56.006143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896633112539748:12190] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:56.006255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:56.008433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896633112539748:12190] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:56.009322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:56.009541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:56.009553Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:56.009565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:56.009635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:56.009693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896633022746564:9052]
2025-09-30T14:57:56.010369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:56.010673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:56.010726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:56.010995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896633112539748:12190] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:56.011008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896633112539748:12190] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:56.011012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896633112539748:12190] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:56.011022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2727 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:56.011051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:56.011134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.011139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.011140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.011142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.011143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.011144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.011145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.011146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.011148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.011149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.011150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.011151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.011152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.011153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.011155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.011160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.011172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.011176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.011181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.011185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.011190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.011194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.011198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.011202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.011206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.011210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.011214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.011218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.011222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.011226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.011234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.011260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.011266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.011272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.011276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.011282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.011286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.011291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.011296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.011301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.011306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.011312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.011317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.011322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.011327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.011333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.011337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.011342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.011346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.011351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.011356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.011361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.011369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.011374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.011378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.011383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.011388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.011393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.011398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.011403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.011454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:56.017073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:56.017999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:56.018014Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:56.018018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:56.018021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:56.018029Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2726 [2:7555896633022746564:9052]
2025-09-30T14:57:56.018045Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:56.018060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:56.018071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:56.018074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:56.018076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:56.018091Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:56.018097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:56.018103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:56.018166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.018174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.018176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.018180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:56.018182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:56.018250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:56.018258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.018272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.018292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.018311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:56.018334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896628817572424:2454], now have 1 active actors on pipe
2025-09-30T14:57:56.018346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112539784:12190], now have 1 active actors on pipe
2025-09-30T14:57:56.018353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896633022746558:9052]
2025-09-30T14:57:56.018355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896633022746558:9052]
2025-09-30T14:57:56.018360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896633022746558:9052]
2025-09-30T14:57:56.018373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:56.018387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:56.018400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:56.018402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:56.018404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:56.018406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:56.018406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:56.018438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896633022746558:9052]
2025-09-30T14:57:56.018449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:56.018425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2726
2025-09-30T14:57:56.018434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2726
2025-09-30T14:57:56.018470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:56.018489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.018498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.018532Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:56.018543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:56.018549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:56.018556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:56.018566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:56.018575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:56.018594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:56.018731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.018738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.018751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:56.018833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2727 partition: 0 MaxSeqNo: 42 sessionId: src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0
2025-09-30T14:57:56.019206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38a81a0-b8ae477b-e7b72b4d-4f16164e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:56.022272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0] Write session: try to update token
2025-09-30T14:57:56.022292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:56.031031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:56.031052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:56.031055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:56.031058Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:56.031068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896633022746558:9052]
2025-09-30T14:57:56.031072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896633022746558:9052]
2025-09-30T14:57:56.031077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896633022746558:9052]
2025-09-30T14:57:56.031120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:56.031127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.031131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:56.031308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:56.039472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:56.039491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:56.039497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:56.039740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2727 sessionId: src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:56.042664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:56.097240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896633112539795:12049]
2025-09-30T14:57:56.097613Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2726, pipe: [1:7555896633112539795:12049]
2025-09-30T14:57:56.156250Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:56.156993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.157011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.157031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112539795:12049], now have 1 active actors on pipe
2025-09-30T14:57:56.157256Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:56.157262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:56.157267Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:56.157279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:56.157313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896633112539795:12049]
2025-09-30T14:57:56.157343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2727 reason: error at write: Disconnected sessionId: src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0
2025-09-30T14:57:56.157529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2727 sessionId: src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0 is DEAD
2025-09-30T14:57:56.157673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:56.157685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0] Write session will restart in 0.009592s
2025-09-30T14:57:56.157709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0] Write session: Do CDS request
2025-09-30T14:57:56.157716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:56.167014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:56.168827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:56.168947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:56.168962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2728
2025-09-30T14:57:56.169098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2728 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:56.169134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2728 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:56.169144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2728 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:56.169149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:56.169611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2728 sessionId:  describe result for acl check
2025-09-30T14:57:56.169658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:56.169666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:56.169668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:56.169693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896633112539829:12194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:56.170231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:56.170255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896633112539829:12194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:56.170441Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:56.170454Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:56.170465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:56.170522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:56.170566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896633022746646:9054]
2025-09-30T14:57:56.171214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:56.171556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:56.171628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:56.172037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:56.172102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.172107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.172111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.172113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.172114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.172115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.172116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.172118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.172118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.172119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.172121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.172121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.172123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.172124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.172125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.172131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.172142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.172146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.172151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.172155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.172159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.172163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.172167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.172172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.172179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.172183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.172186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.172190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.172195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.172199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.172206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.172214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.172230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.172237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.172246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.172251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.172260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.172265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.172273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.172279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.172287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.172292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.172301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.172307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.172313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.172323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.172328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.172333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.172338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.172343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.172348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.172356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.172331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896633112539829:12194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:56.172372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.172380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.172384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.172392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.172398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.172407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.172412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.172418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.172464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:56.177663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896633112539829:12194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:56.177681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896633112539829:12194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:56.177685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896633112539829:12194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:56.177694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2728 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:56.177935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:56.178892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:56.178910Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:56.178913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:56.178917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:56.178926Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2727 [2:7555896633022746646:9054]
2025-09-30T14:57:56.178943Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:56.178959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:56.178962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:56.178966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:56.178968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:56.178985Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:56.178996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:56.179012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:56.179075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.179082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.179084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.179088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:56.179091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:56.179160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:56.179167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.179181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.179198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.179219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:56.179241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112539867:12194], now have 1 active actors on pipe
2025-09-30T14:57:56.179264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112539798:2454], now have 1 active actors on pipe
2025-09-30T14:57:56.179271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896633022746640:9054]
2025-09-30T14:57:56.179275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896633022746640:9054]
2025-09-30T14:57:56.179277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896633022746640:9054]
2025-09-30T14:57:56.179290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:56.179296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:56.179300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:56.179303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:56.179305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:56.179320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:56.179323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:56.179289Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2727
2025-09-30T14:57:56.179290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2727
2025-09-30T14:57:56.179356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896633022746640:9054]
2025-09-30T14:57:56.179363Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:56.179366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:56.179388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.179395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.179442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:56.179456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:56.179462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:56.179465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:56.179475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:56.179484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:56.179509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:56.179663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.179671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.179683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:56.179767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2728 partition: 0 MaxSeqNo: 42 sessionId: src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0
2025-09-30T14:57:56.180108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bdd28c94-f42b330c-2291795a-aafa78d2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:56.183077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0] Write session: try to update token
2025-09-30T14:57:56.183099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:56.191874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:56.191895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:56.191898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:56.191900Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:56.191909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896633022746640:9054]
2025-09-30T14:57:56.191914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896633022746640:9054]
2025-09-30T14:57:56.191918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896633022746640:9054]
2025-09-30T14:57:56.191957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:56.191969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.191972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:56.191971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:56.191977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:56.191981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:56.192120Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:56.198539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2728 sessionId: src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:56.201349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:56.257468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896633112539879:12049]
2025-09-30T14:57:56.257767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2727, pipe: [1:7555896633112539879:12049]
2025-09-30T14:57:56.313462Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:56.314238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.314255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.314277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112539879:12049], now have 1 active actors on pipe
2025-09-30T14:57:56.314560Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:56.315045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:56.315058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0] Write session will restart in 0.009906s
2025-09-30T14:57:56.314558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:56.315082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0] Write session: Do CDS request
2025-09-30T14:57:56.314572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:56.314651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2728 reason: error at write: Disconnected sessionId: src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0
2025-09-30T14:57:56.314652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:56.315089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:56.314701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896633112539879:12049]
2025-09-30T14:57:56.314850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2728 sessionId: src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0 is DEAD
2025-09-30T14:57:56.325876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:56.325920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:56.325934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2729
2025-09-30T14:57:56.326304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:56.326233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2729 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:56.326276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2729 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:56.326282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2729 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:56.326285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:56.326864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2729 sessionId:  describe result for acl check
2025-09-30T14:57:56.326901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:56.326908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:56.326909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:56.326915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896633112539914:12199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:56.327502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896633112539914:12199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:56.329459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:56.329520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896633112539914:12199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:56.329695Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:56.329707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:56.329718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:56.329778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:56.329821Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896633022746715:9044]
2025-09-30T14:57:56.330486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:56.330949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:56.331024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:56.331402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:56.331481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.331482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.331484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.331485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.331486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.331488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.331489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.331491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.331492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.331493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.331495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.331496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.331498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.331499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.331500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.331511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.331522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.331527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.331532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.331536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.331541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.331546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.331551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.331554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.331559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.331564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.331568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.331573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.331577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.331581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.331589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.331598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.331604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.331611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.331616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.331622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.331627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.331633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.331638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.331643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.331648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.331654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.331659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.331665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.331670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.331676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.331684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.331691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.331695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.331701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.331706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.331712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.331717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.331723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.331729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.331734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.331738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.331744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.331749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.331754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.331802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:56.332481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896633112539914:12199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:56.332495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896633112539914:12199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:56.332499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896633112539914:12199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:56.332507Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2729 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:56.337804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:56.338763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:56.338781Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:56.338784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:56.338789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:56.338796Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2728 [2:7555896633022746715:9044]
2025-09-30T14:57:56.338814Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:56.338830Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:56.338834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:56.338838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:56.338840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:56.339887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2728
2025-09-30T14:57:56.338857Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:56.338873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:56.338881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:56.338949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.338951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.338953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.338956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:56.338959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:56.339407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:56.339412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.339429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.339446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.339469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:56.339491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896633022746709:9044]
2025-09-30T14:57:56.339494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896633022746709:9044]
2025-09-30T14:57:56.339496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896633022746709:9044]
2025-09-30T14:57:56.340174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2728
2025-09-30T14:57:56.339513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:56.339530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:56.339547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:56.339551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:56.339591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896633022746709:9044]
2025-09-30T14:57:56.339594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:56.339769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:56.339773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:56.339776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:56.339781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:56.340373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112539956:12199], now have 1 active actors on pipe
2025-09-30T14:57:56.340381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112539883:2454], now have 1 active actors on pipe
2025-09-30T14:57:56.340396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.340401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.340432Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:56.340441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:56.340445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:56.340448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:56.340458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:56.340481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:56.340498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:56.340841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.340848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.340865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:56.341121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2729 partition: 0 MaxSeqNo: 42 sessionId: src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0
2025-09-30T14:57:56.341648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e0dedfb-5341816b-25ccc82d-faa9992a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:56.344565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0] Write session: try to update token
2025-09-30T14:57:56.344590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:56.361321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:56.361341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:56.361343Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:56.361346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:56.361358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896633022746709:9044]
2025-09-30T14:57:56.361363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896633022746709:9044]
2025-09-30T14:57:56.361367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896633022746709:9044]
2025-09-30T14:57:56.361409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:56.361416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.361419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:56.361428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:56.361436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:56.361441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:56.361569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:56.364764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2729 sessionId: src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:56.367830Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:56.414684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896633112539976:12049]
2025-09-30T14:57:56.415122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2728, pipe: [1:7555896633112539976:12049]
2025-09-30T14:57:56.484119Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:56.484485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.484507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.484557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112539976:12049], now have 1 active actors on pipe
2025-09-30T14:57:56.484820Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:56.486789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:56.486861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:56.486958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2729 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0
2025-09-30T14:57:56.486998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896633112539976:12049]
2025-09-30T14:57:56.487153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2729 sessionId: src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0 is DEAD
2025-09-30T14:57:56.487601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:56.487620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0] Write session will restart in 0.009885s
2025-09-30T14:57:56.487662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0] Write session: Do CDS request
2025-09-30T14:57:56.487668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:56.498825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:56.499241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:56.499310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:56.499324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2730
2025-09-30T14:57:56.499503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2730 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:56.499545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2730 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:56.499560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2730 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:56.499566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:56.502625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:56.502860Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:56.502869Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:56.502879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:56.502598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2730 sessionId:  describe result for acl check
2025-09-30T14:57:56.502635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:56.502637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:56.502650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:56.502660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896633112540011:12204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:56.502934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:56.502979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896633022746785:9041]
2025-09-30T14:57:56.503317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896633112540011:12204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:56.503660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:56.504071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:56.504130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:56.504583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:56.504660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.504666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.504667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.504669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.504670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.504671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.504673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.504674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.504675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.504676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.504677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.504679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.504680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.504681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.504682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.504688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.504707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.504712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.504716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.504722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.504726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.504730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.504734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.504738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.504744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.504748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.504752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.504756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.504759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.504763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.504772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.504781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.504786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.504792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.504797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.504802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.504807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.504813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.504818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.504823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.504827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.504832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.504845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.504849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.504853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.504858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.504863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.504869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.504873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.504879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.504884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.504890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.504895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.504899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.504904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.504909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.504914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.504925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.504930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.504947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.504998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:56.505630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896633112540011:12204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:56.510598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:56.511530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:56.511547Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:56.511550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:56.511553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:56.511560Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2729 [2:7555896633022746785:9041]
2025-09-30T14:57:56.511578Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:56.511595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:56.511598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:56.511601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:56.511604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:56.511620Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:56.511629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:56.511636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:56.511701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.511709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.511711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.511714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:56.511717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:56.511798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:56.511805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.511817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.511833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.511850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:56.511873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112539977:2454], now have 1 active actors on pipe
2025-09-30T14:57:56.511885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896633022746779:9041]
2025-09-30T14:57:56.511887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896633022746779:9041]
2025-09-30T14:57:56.511889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896633022746779:9041]
2025-09-30T14:57:56.511919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2729
2025-09-30T14:57:56.512488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896633112540011:12204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:56.512501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896633112540011:12204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:56.512506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896633112540011:12204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:56.512514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2730 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:56.512776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2729
2025-09-30T14:57:56.513612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2730 partition: 0 MaxSeqNo: 42 sessionId: src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0
2025-09-30T14:57:56.513996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4351644c-cf1c8ce4-621f6e9c-82dd5a8a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:56.511902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:56.511927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:56.511939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:56.511941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:56.511943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:56.511943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:56.511945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:56.511978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896633022746779:9041]
2025-09-30T14:57:56.511981Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:56.511985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:56.512766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112540052:12204], now have 1 active actors on pipe
2025-09-30T14:57:56.513106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.513113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.513143Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:56.513153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:56.513157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:56.513159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:56.513172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:56.513185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:56.513200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:56.513459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.513470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.513495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:56.517092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0] Write session: try to update token
2025-09-30T14:57:56.517112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:56.525448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:56.525470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:56.525485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896633022746779:9041]
2025-09-30T14:57:56.525531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:56.525540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:56.525711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:56.525867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:56.526038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:56.526199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:56.526407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:56.526453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:56.534817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2730 sessionId: src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:56.537961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:56.538654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:56.538459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.538494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.538535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:56.545471Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:56.545491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:56.545494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:56.545496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:56.545507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896633022746779:9041]
2025-09-30T14:57:56.545512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896633022746779:9041]
2025-09-30T14:57:56.545517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896633022746779:9041]
2025-09-30T14:57:56.545558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:56.545566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.545569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:56.545569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:56.545577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:56.545582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:56.545719Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:56.587204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896633112540057:12049]
2025-09-30T14:57:56.587610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2729, pipe: [1:7555896633112540057:12049]
2025-09-30T14:57:56.659075Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:56.667643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.667673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.667850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:56.667923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:56.667997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:56.668056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:56.668109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:56.668113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:56.668181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:56.668255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:56.668323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:56.668385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:56.668426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:56.668428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:56.668497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:56.668557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:56.668620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:56.668694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:56.668740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:56.668742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:56.668812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:56.668871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:56.668981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:56.669059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:56.669099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:56.669101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:56.669167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:56.669224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:56.669283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:56.669346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:56.669388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:56.669390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:56.669455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:56.669527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:56.669602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:56.669664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:56.669702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:56.669705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:56.669778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:56.669836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:56.669899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:56.669962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:56.670012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:56.670014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:56.670091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:56.670161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:56.670230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:56.670302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:56.670422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:56.670426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:56.670507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:56.670576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:56.670644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:56.670713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:56.670779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:56.670782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:56.670861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:56.670928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:56.670999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:56.671073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:56.671132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:56.671136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:56.671232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112540057:12049], now have 1 active actors on pipe
2025-09-30T14:57:56.671623Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:56.672873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:56.672884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0] Write session will restart in 0.005752s
2025-09-30T14:57:56.672919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0] Write session: Do CDS request
2025-09-30T14:57:56.672925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:56.672476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896633112540057:12049]
2025-09-30T14:57:56.672510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:56.672514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:56.672545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2730 reason: error at write: Disconnected sessionId: src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0
2025-09-30T14:57:56.672697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:56.672721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2730 sessionId: src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0 is DEAD
2025-09-30T14:57:56.680735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:56.682311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:56.682324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2731
2025-09-30T14:57:56.682448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2731 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:56.682483Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2731 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:56.682494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2731 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:56.682510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:56.683006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2731 sessionId:  describe result for acl check
2025-09-30T14:57:56.683039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:56.683041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:56.683046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:56.683051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896633112540072:12208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:56.683656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896633112540072:12208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:56.696904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896633112540072:12208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:56.700119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896633112540072:12208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:56.700135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896633112540072:12208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:56.700139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896633112540072:12208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:56.700148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2731 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:56.700696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:56.704668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:56.704900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:56.704913Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:56.704924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:56.705002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:56.705044Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896633022746860:9022]
2025-09-30T14:57:56.705727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:56.706086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:56.706152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:56.706516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:56.706596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.706602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.706604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.706605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.706606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.706607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.706608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.706612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.706614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.706615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.706616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.706617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.706618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.706619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.706620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.706626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.706636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.706640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.706645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.706649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.706653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.706657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.706661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.706665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.706669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.706673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.706677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.706681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.706685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.706688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.706696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.706704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.706710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.706715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.706720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.706725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.706731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.706736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.706744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.706748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.706752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.706757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.706762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.706766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.706771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.706776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.706780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.706785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.706790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.706795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.706800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.706805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.706809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.706815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.706820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.706825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.706828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.706833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.706837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.706843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.706891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:56.712591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:56.714040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:56.714061Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:56.714064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:56.714068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:56.714075Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2730 [2:7555896633022746860:9022]
2025-09-30T14:57:56.714091Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:56.714108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:56.714111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:56.714115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:56.714117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:56.714137Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:56.714149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:56.714163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:56.714234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.714242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.714244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.714250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:56.714253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:56.714320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:56.714329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.714344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.714358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.714378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:56.714398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112540125:12208], now have 1 active actors on pipe
2025-09-30T14:57:56.714406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112540059:2454], now have 1 active actors on pipe
2025-09-30T14:57:56.714413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896633022746855:9022]
2025-09-30T14:57:56.714415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896633022746855:9022]
2025-09-30T14:57:56.714417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896633022746855:9022]
2025-09-30T14:57:56.714430Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:56.714450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:56.714453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:56.714457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:56.714460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:56.714464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:56.714467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:56.714507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896633022746855:9022]
2025-09-30T14:57:56.714515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:56.714533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:56.714517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2730
2025-09-30T14:57:56.714526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2730
2025-09-30T14:57:56.714677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.714689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.714716Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:56.714731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:56.714739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:56.714741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:56.714752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:56.714765Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:56.714784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:56.714941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.714952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.714965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:56.715057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2731 partition: 0 MaxSeqNo: 42 sessionId: src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0
2025-09-30T14:57:56.715444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b640a5-92f0a68e-31f7654f-8b0a6a93_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:56.718416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0] Write session: try to update token
2025-09-30T14:57:56.718449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:56.729654Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:56.729671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:56.729674Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:56.729675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:56.729685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896633022746855:9022]
2025-09-30T14:57:56.729689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896633022746855:9022]
2025-09-30T14:57:56.729693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896633022746855:9022]
2025-09-30T14:57:56.729738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:56.729747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.729749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:56.729896Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:56.733705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2731 sessionId: src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:56.735318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:56.735338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:56.735343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:56.736608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:56.772571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896633112540140:12049]
2025-09-30T14:57:56.772997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2730, pipe: [1:7555896633112540140:12049]
2025-09-30T14:57:56.845846Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:56.846526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.846543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.846582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112540140:12049], now have 1 active actors on pipe
2025-09-30T14:57:56.846989Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:56.846883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896633112540140:12049]
2025-09-30T14:57:56.846916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:56.846918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:56.846984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2731 reason: error at write: Disconnected sessionId: src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0
2025-09-30T14:57:56.847151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2731 sessionId: src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0 is DEAD
2025-09-30T14:57:56.847340Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:56.847669Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:56.847680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0] Write session will restart in 0.006848s
2025-09-30T14:57:56.847704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0] Write session: Do CDS request
2025-09-30T14:57:56.847709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:56.855737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:56.855883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:56.855898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2732
2025-09-30T14:57:56.856008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2732 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:56.856041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2732 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:56.856048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2732 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:56.856053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:56.856512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2732 sessionId:  describe result for acl check
2025-09-30T14:57:56.856545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:56.856547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:56.856549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:56.856554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896633112540188:12219] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:56.856641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:56.857099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896633112540188:12219] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:56.858952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896633112540188:12219] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:56.859681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:56.859886Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:56.859894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:56.859904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:56.859955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:56.859992Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896633022746945:9008]
2025-09-30T14:57:56.860679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:56.860965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:56.861004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:56.861340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:56.861366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896633112540188:12219] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:56.861380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896633112540188:12219] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:56.861383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896633112540188:12219] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:56.861390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2732 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:56.861406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.861414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.861415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.861416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.861417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.861419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.861420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.861422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.861423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.861424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.861425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.861426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.861427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.861428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.861429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.861435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.861446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.861449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.861453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.861457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.861461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.861464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.861468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.861471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.861476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.861480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.861484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.861497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.861501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.861504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.861512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.861519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:56.861525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.861530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:56.861535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.861541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:56.861545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.861550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:56.861554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.861560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:56.861564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.861569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:56.861574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.861579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:56.861584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.861592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:56.861597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.861603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:56.861607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.861612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:56.861616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.861622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.861625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.861631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.861636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.861642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.861648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.861653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:56.861657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.861663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:56.861707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:56.867359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:56.868362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:56.868376Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:56.868379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:56.868382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:56.868389Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2731 [2:7555896633022746945:9008]
2025-09-30T14:57:56.868406Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:56.868424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:56.868427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:56.868430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:56.868432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:56.868448Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:56.868460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:56.868467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:56.868524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.868530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.868532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.868535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:56.868539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:56.868610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:56.868618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.868631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:56.868644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:56.868662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:56.868685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112540226:12219], now have 1 active actors on pipe
2025-09-30T14:57:56.868693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112540155:2454], now have 1 active actors on pipe
2025-09-30T14:57:56.868699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896633022746939:9008]
2025-09-30T14:57:56.868701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896633022746939:9008]
2025-09-30T14:57:56.868703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896633022746939:9008]
2025-09-30T14:57:56.868716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:56.868729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:56.868740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:56.868743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:56.868746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:56.868754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:56.868757Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:56.868779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896633022746939:9008]
2025-09-30T14:57:56.868782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:56.868785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:56.868792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2731
2025-09-30T14:57:56.868829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2731
2025-09-30T14:57:56.869065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.869076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.869105Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:56.869112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:56.869124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:56.869127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:56.869138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:56.869148Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:56.869162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:56.869335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.869348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.869369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:56.869481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2732 partition: 0 MaxSeqNo: 42 sessionId: src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0
2025-09-30T14:57:56.869984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5bf4caf2-19e3174c-ce4d216-b0a9b78c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:56.872901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0] Write session: try to update token
2025-09-30T14:57:56.872920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:56.881843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:56.881857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:56.881859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:56.881861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:56.881871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896633022746939:9008]
2025-09-30T14:57:56.881876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896633022746939:9008]
2025-09-30T14:57:56.881880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896633022746939:9008]
2025-09-30T14:57:56.881923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:56.881930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:56.881933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:56.881945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:56.881951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:56.881956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:56.882092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:56.889909Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2732 sessionId: src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:56.892725Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:56.945110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896633112540245:12049]
2025-09-30T14:57:56.945402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2731, pipe: [1:7555896633112540245:12049]
2025-09-30T14:57:56.997731Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:56.998853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:56.998872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:56.998892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112540245:12049], now have 1 active actors on pipe
2025-09-30T14:57:56.999083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896633112540245:12049]
2025-09-30T14:57:56.999082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:56.999128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:56.999132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:56.999196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2732 reason: error at write: Disconnected sessionId: src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0
2025-09-30T14:57:56.999408Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:56.999402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2732 sessionId: src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0 is DEAD
2025-09-30T14:57:56.999577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:56.999587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0] Write session will restart in 0.008467s
2025-09-30T14:57:56.999609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0] Write session: Do CDS request
2025-09-30T14:57:56.999618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:57.008814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:57.008900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:57.008916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2733
2025-09-30T14:57:57.009059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2733 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:57.009107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2733 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:57.009118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2733 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:57.009122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:57.009143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:57.009858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2733 sessionId:  describe result for acl check
2025-09-30T14:57:57.009898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:57.009900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:57.009901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:57.009907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896637407507578:12224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:57.010459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896637407507578:12224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:57.012753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896637407507578:12224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:57.012894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:57.013119Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:57.013131Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:57.013142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:57.013197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:57.013237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896637317714337:8997]
2025-09-30T14:57:57.013889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:57.014247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:57.014295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:57.014582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:57.014643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.014650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.014651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.014652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.014653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.014655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.014666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.014668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.014669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.014670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.014671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.014672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.014674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.014675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.014676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.014681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.014691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.014695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.014699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.014703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.014707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.014714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.014718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.014722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.014727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.014731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.014735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.014738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.014742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.014746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.014754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.014763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.014769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.014775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.014781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.014786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.014791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.014795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.014798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.014801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.014804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.014807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.014812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.014815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.014817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.014821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.014823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.014826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.014828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.014831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.014833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.014836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.014839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.014841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.014844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.014847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.014849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.014852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.014854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.014858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.014884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:57.020442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896637407507578:12224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:57.020464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896637407507578:12224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:57.020468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896637407507578:12224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:57.020478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2733 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:57.020688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:57.021829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:57.021848Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:57.021851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:57.021855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:57.021861Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2732 [2:7555896637317714337:8997]
2025-09-30T14:57:57.021881Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:57.021900Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:57.021903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:57.021907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:57.021909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:57.021928Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:57.021936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:57.021945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:57.022030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.022042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.022045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.022048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:57.022051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:57.022134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:57.022142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.022156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.022174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.022192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:57.022211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896637317714331:8997]
2025-09-30T14:57:57.022213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896637317714331:8997]
2025-09-30T14:57:57.022218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896637317714331:8997]
2025-09-30T14:57:57.022227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:57.022242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:57.022250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:57.022254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:57.022257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:57.022257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:57.022263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:57.022316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507616:12224], now have 1 active actors on pipe
2025-09-30T14:57:57.022335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896633112540246:2454], now have 1 active actors on pipe
2025-09-30T14:57:57.022341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896637317714331:8997]
2025-09-30T14:57:57.022351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:57.022358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2732
2025-09-30T14:57:57.022371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2732
2025-09-30T14:57:57.022365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:57.022418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.022429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.022460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:57.022472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:57.022482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:57.022484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:57.022496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:57.022528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:57.022550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:57.022764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.022776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.022793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:57.022912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2733 partition: 0 MaxSeqNo: 42 sessionId: src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0
2025-09-30T14:57:57.023295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b626d9b9-cb792619-8cd71750-e75d79f1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:57.027695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0] Write session: try to update token
2025-09-30T14:57:57.027721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:57.035938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:57.035957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:57.035967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896637317714331:8997]
2025-09-30T14:57:57.036011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:57.036011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:57.036202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:57.036357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:57.036507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:57.036662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:57.036872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:57.036913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:57.047016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:57.047032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:57.047035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:57.047037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:57.047048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896637317714331:8997]
2025-09-30T14:57:57.047052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896637317714331:8997]
2025-09-30T14:57:57.047062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896637317714331:8997]
2025-09-30T14:57:57.047100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:57.047107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.047109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:57.047119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:57.047126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:57.047131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:57.047738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2733 sessionId: src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:57.050583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:57.047272Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:57.099198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896637407507628:12049]
2025-09-30T14:57:57.099522Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2732, pipe: [1:7555896637407507628:12049]
2025-09-30T14:57:57.163437Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:57.163933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.163947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.163964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507628:12049], now have 1 active actors on pipe
2025-09-30T14:57:57.164166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:57.164271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896637407507628:12049]
2025-09-30T14:57:57.164318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:57.164396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:57.164399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2733 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0
2025-09-30T14:57:57.164598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2733 sessionId: src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0 is DEAD
2025-09-30T14:57:57.164866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:57.164884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0] Write session will restart in 0.005900s
2025-09-30T14:57:57.164918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0] Write session: Do CDS request
2025-09-30T14:57:57.164925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:57.171905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:57.171921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:57.171937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2734
2025-09-30T14:57:57.172204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2734 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:57.172237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2734 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:57.172243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2734 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:57.172253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:57.172719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2734 sessionId:  describe result for acl check
2025-09-30T14:57:57.172762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:57.172768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:57.172770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:57.172776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896637407507663:12228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:57.173354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896637407507663:12228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:57.174034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:57.175384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896637407507663:12228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:57.177511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:57.177736Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:57.177748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:57.177758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:57.177808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896637407507663:12228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:57.177811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:57.177821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896637407507663:12228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:57.177844Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896637317714425:8967]
2025-09-30T14:57:57.177824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896637407507663:12228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:57.177832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2734 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:57.178525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:57.178795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:57.178839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:57.179100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:57.179139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.179144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.179145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.179146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.179146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.179147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.179148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.179149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.179150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.179150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.179151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.179152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.179153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.179153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.179156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.179161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.179167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.179169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.179172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.179174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.179176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.179179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.179182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.179184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.179186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.179189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.179191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.179193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.179195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.179198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.179203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.179208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.179211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.179215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.179217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.179220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.179223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.179227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.179231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.179236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.179240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.179260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.179265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.179269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.179274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.179280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.179284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.179289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.179293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.179297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.179302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.179306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.179310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.179314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.179319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.179324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.179328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.179331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.179333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.179336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.179363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:57.185013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:57.185867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:57.185881Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:57.185884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:57.185888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:57.185895Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2733 [2:7555896637317714425:8967]
2025-09-30T14:57:57.185913Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:57.185934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:57.185942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:57.185946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:57.185949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:57.185966Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:57.185977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:57.185984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:57.186047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.186053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.186055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.186059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:57.186062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:57.186135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:57.186145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.186157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.186170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.186187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:57.186207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507629:2454], now have 1 active actors on pipe
2025-09-30T14:57:57.186213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896637317714419:8967]
2025-09-30T14:57:57.186217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896637317714419:8967]
2025-09-30T14:57:57.186218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896637317714419:8967]
2025-09-30T14:57:57.186235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:57.186249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507702:12228], now have 1 active actors on pipe
2025-09-30T14:57:57.186256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:57.186260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:57.186264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:57.186266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:57.186274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:57.186277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:57.186313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896637317714419:8967]
2025-09-30T14:57:57.186329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:57.186345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:57.186324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2733
2025-09-30T14:57:57.186337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2733
2025-09-30T14:57:57.186443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.186453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.186477Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|329e2264-ec9e0ffc-8529e552-314633d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:57.186484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:57.186492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:57.186496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:57.186507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:57.186519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:57.186540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:57.186722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.186736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.186761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:57.186851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2734 partition: 0 MaxSeqNo: 42 sessionId: src_id|329e2264-ec9e0ffc-8529e552-314633d2_0
2025-09-30T14:57:57.187324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5831a1f6-75f229c7-4b2b2940-e0799bff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|329e2264-ec9e0ffc-8529e552-314633d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:57.190867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|329e2264-ec9e0ffc-8529e552-314633d2_0] Write session: try to update token
2025-09-30T14:57:57.190899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|329e2264-ec9e0ffc-8529e552-314633d2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:57.198703Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:57.198719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:57.198722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:57.198724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:57.198734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896637317714419:8967]
2025-09-30T14:57:57.198739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896637317714419:8967]
2025-09-30T14:57:57.198744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896637317714419:8967]
2025-09-30T14:57:57.198784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:57.198792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.198795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:57.198798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:57.198806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:57.198810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:57.198935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:57.210712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2734 sessionId: src_id|329e2264-ec9e0ffc-8529e552-314633d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:57.213390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:57.264601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896637407507717:12049]
2025-09-30T14:57:57.264995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2733, pipe: [1:7555896637407507717:12049]
2025-09-30T14:57:57.312764Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:57.313355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.313383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.313406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507717:12049], now have 1 active actors on pipe
2025-09-30T14:57:57.313648Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:57.313693Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:57.313731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:57.313737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:57.313768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896637407507717:12049]
2025-09-30T14:57:57.313808Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2734 reason: error at write: Disconnected sessionId: src_id|329e2264-ec9e0ffc-8529e552-314633d2_0
2025-09-30T14:57:57.313994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2734 sessionId: src_id|329e2264-ec9e0ffc-8529e552-314633d2_0 is DEAD
2025-09-30T14:57:57.314231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329e2264-ec9e0ffc-8529e552-314633d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:57.314242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329e2264-ec9e0ffc-8529e552-314633d2_0] Write session will restart in 0.007654s
2025-09-30T14:57:57.314277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329e2264-ec9e0ffc-8529e552-314633d2_0] Write session: Do CDS request
2025-09-30T14:57:57.314287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329e2264-ec9e0ffc-8529e552-314633d2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:57.322944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|329e2264-ec9e0ffc-8529e552-314633d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:57.323096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:57.323112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2735
2025-09-30T14:57:57.323254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2735 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:57.323287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2735 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:57.323297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2735 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:57.323302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:57.323802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2735 sessionId:  describe result for acl check
2025-09-30T14:57:57.323838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:57.323847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:57.323852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:57.323857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896637407507756:12233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:57.324475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896637407507756:12233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:57.324715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:57.326229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896637407507756:12233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:57.328594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:57.328849Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:57.328867Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:57.328880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:57.328961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:57.329012Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896637317714500:8977]
2025-09-30T14:57:57.329119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896637407507756:12233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:57.329136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896637407507756:12233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:57.329140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896637407507756:12233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:57.329149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2735 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:57.329635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:57.330004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:57.330061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:57.330417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:57.330494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.330501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.330502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.330503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.330504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.330506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.330507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.330508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.330509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.330511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.330512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.330513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.330514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.330515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.330517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.330523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.330533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.330540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.330543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.330547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.330551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.330555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.330559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.330563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.330568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.330572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.330576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.330581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.330585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.330589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.330597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.330611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.330623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.330629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.330636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.330646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.330655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.330665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.330675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.330685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.330693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.330699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.330705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.330710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.330715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.330725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.330730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.330742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.330746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.330751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.330757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.330766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.330777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.330782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.330789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.330799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.330803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.330810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.330820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.330826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.330877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:57.337681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:57.338902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:57.338925Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:57.338928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:57.338933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:57.338941Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2734 [2:7555896637317714500:8977]
2025-09-30T14:57:57.338961Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:57.338979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:57.338982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:57.338986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:57.338989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:57.339006Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:57.339013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:57.339027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:57.339098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.339107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.339109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.339113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:57.339116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:57.339189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:57.339198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.339215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.339232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.339400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2734
2025-09-30T14:57:57.339402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2734
2025-09-30T14:57:57.339275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:57.339296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507721:2454], now have 1 active actors on pipe
2025-09-30T14:57:57.339301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507793:12233], now have 1 active actors on pipe
2025-09-30T14:57:57.339308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896637317714494:8977]
2025-09-30T14:57:57.339310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896637317714494:8977]
2025-09-30T14:57:57.339313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896637317714494:8977]
2025-09-30T14:57:57.339330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:57.339347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:57.339352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:57.339355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:57.339357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:57.339379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:57.339383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:57.339423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896637317714494:8977]
2025-09-30T14:57:57.339431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:57.339440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:57.339601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.339607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.339637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:57.339646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:57.339650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:57.339653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:57.339663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:57.339682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:57.339700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:57.339890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.339897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.339913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:57.339988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2735 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0
2025-09-30T14:57:57.340411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|329e2264-ec9e0ffc-8529e552-314633d2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:57.343888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0] Write session: try to update token
2025-09-30T14:57:57.343910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:57.361568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:57.361597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:57.361600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:57.361603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:57.361616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896637317714494:8977]
2025-09-30T14:57:57.361622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896637317714494:8977]
2025-09-30T14:57:57.361629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896637317714494:8977]
2025-09-30T14:57:57.361687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:57.361698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.361711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:57.361709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:57.361717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:57.361723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:57.362066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:57.380577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2735 sessionId: src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:57.383520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:57.414062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896637407507820:12049]
2025-09-30T14:57:57.414296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2734, pipe: [1:7555896637407507820:12049]
2025-09-30T14:57:57.502316Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:57.503194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.503214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.503260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507820:12049], now have 1 active actors on pipe
2025-09-30T14:57:57.505510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:57.505526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896637407507820:12049]
2025-09-30T14:57:57.505560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:57.505563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:57.505641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2735 reason: error at write: Disconnected sessionId: src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0
2025-09-30T14:57:57.505822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2735 sessionId: src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0 is DEAD
2025-09-30T14:57:57.506204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:57.506216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0] Write session will restart in 0.007073s
2025-09-30T14:57:57.506249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0] Write session: Do CDS request
2025-09-30T14:57:57.506255Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:57.507680Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:57.514831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:57.514987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:57.515010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2736
2025-09-30T14:57:57.515194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2736 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:57.515255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2736 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:57.515272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2736 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:57.515279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:57.515879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2736 sessionId:  describe result for acl check
2025-09-30T14:57:57.515939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:57.515947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:57.515950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:57.515957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896637407507835:12238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:57.516676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896637407507835:12238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:57.519415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896637407507835:12238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:57.524670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896637407507835:12238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:57.524689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896637407507835:12238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:57.524693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896637407507835:12238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:57.524704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2736 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:57.526932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:57.530674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:57.530973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:57.530986Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:57.531000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:57.531080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:57.531145Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896637317714577:8975]
2025-09-30T14:57:57.531959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:57.532436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:57.532508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:57.532949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:57.533115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.533116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.533118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.533119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.533120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.533122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.533123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.533125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.533126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.533127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.533129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.533134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.533135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.533137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.533137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.533145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.533156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.533159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.533163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.533167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.533171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.533174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.533177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.533180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.533185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.533189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.533192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.533196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.533199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.533204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.533214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.533223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.533229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.533235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.533241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.533247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.533256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.533262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.533266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.533274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.533278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.533283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.533292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.533301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.533306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.533311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.533318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.533323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.533327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.533332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.533338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.533343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.533347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.533352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.533357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.533361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.533366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.533371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.533376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.533381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.533428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:57.539952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:57.541652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:57.541672Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:57.541676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:57.541681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:57.541691Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2735 [2:7555896637317714577:8975]
2025-09-30T14:57:57.541714Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:57.541734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:57.541738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:57.541742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:57.541745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:57.541768Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:57.541778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:57.541797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:57.541883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.541886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.541888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.541895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:57.541898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:57.541990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:57.541993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.542011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.542025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.542045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:57.542068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896637317714572:8975]
2025-09-30T14:57:57.542071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896637317714572:8975]
2025-09-30T14:57:57.542074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896637317714572:8975]
2025-09-30T14:57:57.542095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:57.542113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:57.542131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:57.542134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:57.542192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896637317714572:8975]
2025-09-30T14:57:57.542195Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:57.542222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:57.542226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:57.542229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507822:2454], now have 1 active actors on pipe
2025-09-30T14:57:57.542229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:57.542236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:57.542326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2735
2025-09-30T14:57:57.542980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2735
2025-09-30T14:57:57.547637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507892:12238], now have 1 active actors on pipe
2025-09-30T14:57:57.547688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.547698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.547743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ff47e40-bdacc061-a64026f-58c91849_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:57.547770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:57.547784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:57.547797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:57.547819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:57.547844Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:57.547869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:57.548318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.548331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.548353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:57.548536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2736 partition: 0 MaxSeqNo: 42 sessionId: src_id|4ff47e40-bdacc061-a64026f-58c91849_0
2025-09-30T14:57:57.549030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f1e8a3f-64848583-ca275fd1-bc491c31_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4ff47e40-bdacc061-a64026f-58c91849_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:57.552184Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff47e40-bdacc061-a64026f-58c91849_0] Write session: try to update token
2025-09-30T14:57:57.552210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff47e40-bdacc061-a64026f-58c91849_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:57.561667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:57.561687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:57.561699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896637317714572:8975]
2025-09-30T14:57:57.561760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:57.561758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:57.562108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:57.562333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:57.562491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:57.562646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:57.562867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:57.562931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:57.578972Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:57.578997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:57.579000Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:57.579003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:57.579015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896637317714572:8975]
2025-09-30T14:57:57.579020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896637317714572:8975]
2025-09-30T14:57:57.579024Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896637317714572:8975]
2025-09-30T14:57:57.579070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:57.579078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.579081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:57.579093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:57.579101Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:57.579106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:57.579271Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:57.581788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2736 sessionId: src_id|4ff47e40-bdacc061-a64026f-58c91849_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:57.585342Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:57.605618Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896637407507907:12049]
2025-09-30T14:57:57.606024Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2735, pipe: [1:7555896637407507907:12049]
2025-09-30T14:57:57.696424Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:57.696792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.696815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.696838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507907:12049], now have 1 active actors on pipe
2025-09-30T14:57:57.697096Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:57.697058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:57.697081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:57.697147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896637407507907:12049]
2025-09-30T14:57:57.697173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2736 reason: error at write: Disconnected sessionId: src_id|4ff47e40-bdacc061-a64026f-58c91849_0
2025-09-30T14:57:57.697182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:57.697391Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2736 sessionId: src_id|4ff47e40-bdacc061-a64026f-58c91849_0 is DEAD
2025-09-30T14:57:57.697547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff47e40-bdacc061-a64026f-58c91849_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:57.697558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff47e40-bdacc061-a64026f-58c91849_0] Write session will restart in 0.009885s
2025-09-30T14:57:57.697583Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff47e40-bdacc061-a64026f-58c91849_0] Write session: Do CDS request
2025-09-30T14:57:57.697591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff47e40-bdacc061-a64026f-58c91849_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:57.708194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:57.708857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff47e40-bdacc061-a64026f-58c91849_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:57.709022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:57.709041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2737
2025-09-30T14:57:57.709158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2737 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:57.709195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2737 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:57.709201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2737 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:57.709205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:57.709846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2737 sessionId:  describe result for acl check
2025-09-30T14:57:57.709906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:57.709914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:57.709916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:57.709924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896637407507950:12242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:57.710646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896637407507950:12242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:57.711366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:57.711572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:57.711584Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:57.711595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:57.711649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:57.711688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896637317714655:8968]
2025-09-30T14:57:57.712371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:57.712649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:57.712694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:57.713047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:57.713116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.713122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.713123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.713125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.713126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.713127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.713128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.713130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.713131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.713132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.713133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.713134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.713138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.713140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.713141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.713147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.713157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.713162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.713165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.713168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.713174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.713178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.713182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.713186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.713191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.713195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.713199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.713203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.713207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.713211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.713222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.713231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.713237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.713242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.713248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.713253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.713258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.713263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.713268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.713273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.713278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.713284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.713288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.713298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.713303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.713308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.713313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.713324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.713299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896637407507950:12242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:57.713329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.713346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.713351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.713356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.713360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.713365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.713371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.713375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.713379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.713384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.713390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.713409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.713458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:57.718565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896637407507950:12242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:57.718587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896637407507950:12242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:57.718590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896637407507950:12242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:57.718597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2737 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:57.718973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:57.719951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:57.719971Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:57.719978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:57.719982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:57.719989Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2736 [2:7555896637317714655:8968]
2025-09-30T14:57:57.720004Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:57.720019Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:57.720022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:57.720025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:57.720028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:57.720044Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:57.720056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:57.720067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:57.720130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.720141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.720144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.720147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:57.720149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:57.720219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:57.720226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.720238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.720249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.720268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:57.720291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507910:2454], now have 1 active actors on pipe
2025-09-30T14:57:57.720299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507988:12242], now have 1 active actors on pipe
2025-09-30T14:57:57.720305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896637317714649:8968]
2025-09-30T14:57:57.720308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896637317714649:8968]
2025-09-30T14:57:57.720309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896637317714649:8968]
2025-09-30T14:57:57.720326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:57.720343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:57.720350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:57.720354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:57.720357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:57.720362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:57.720365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:57.720386Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2736
2025-09-30T14:57:57.720403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896637317714649:8968]
2025-09-30T14:57:57.720387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2736
2025-09-30T14:57:57.720412Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:57.720415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:57.720439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.720449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.720484Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:57.720495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:57.720499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:57.720501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:57.720510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:57.720519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:57.720548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:57.720890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.720903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.720926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:57.721077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2737 partition: 0 MaxSeqNo: 42 sessionId: src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0
2025-09-30T14:57:57.721456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff47e40-bdacc061-a64026f-58c91849_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:57.724204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0] Write session: try to update token
2025-09-30T14:57:57.724223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:57.733294Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:57.733311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:57.733314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:57.733316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:57.733327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896637317714649:8968]
2025-09-30T14:57:57.733332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896637317714649:8968]
2025-09-30T14:57:57.733337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896637317714649:8968]
2025-09-30T14:57:57.733385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:57.733392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.733395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:57.733393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:57.733408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:57.733413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:57.733547Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:57.740780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2737 sessionId: src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:57.743893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:57.797589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896637407507997:12049]
2025-09-30T14:57:57.797920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2736, pipe: [1:7555896637407507997:12049]
2025-09-30T14:57:57.846960Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:57.847693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.847710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.847732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507997:12049], now have 1 active actors on pipe
2025-09-30T14:57:57.847991Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:57.848000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:57.848073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896637407507997:12049]
2025-09-30T14:57:57.848094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:57.848096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:57.848160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2737 reason: error at write: Disconnected sessionId: src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0
2025-09-30T14:57:57.848329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2737 sessionId: src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0 is DEAD
2025-09-30T14:57:57.848749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:57.848757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0] Write session will restart in 0.007395s
2025-09-30T14:57:57.848787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0] Write session: Do CDS request
2025-09-30T14:57:57.848804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:57.857763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:57.857935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:57.857949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2738
2025-09-30T14:57:57.858081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2738 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:57.858120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2738 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:57.858125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2738 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:57.858130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:57.858120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:57.858643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2738 sessionId:  describe result for acl check
2025-09-30T14:57:57.858676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:57.858678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:57.858680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:57.858686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896637407508038:12247] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:57.859272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896637407508038:12247] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:57.862190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896637407508038:12247] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:57.863008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:57.863212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:57.863217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:57.863228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:57.863296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:57.863331Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896637317714733:8972]
2025-09-30T14:57:57.863951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:57.864426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:57.864474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:57.864824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:57.864883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.864885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.864886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.864888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.864889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.864894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.864895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.864897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.864898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.864899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.864900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.864901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.864902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.864903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.864905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.864910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.864920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.864925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.864942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.864946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.864951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.864955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.864959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.864963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.864967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.864970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.864974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.864979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.864982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.864986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.864995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.865002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:57.865009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.865014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:57.865019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.865024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:57.865032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.865037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:57.865042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.865048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:57.865052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.865057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:57.865064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.865068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:57.865072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.865077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:57.865082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.865087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:57.865091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.865095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:57.865100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.865106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.865111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.865117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.865121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.865125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.865130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.865135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:57.865139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.865144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:57.865184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:57.865734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896637407508038:12247] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:57.865750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896637407508038:12247] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:57.865753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896637407508038:12247] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:57.865762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2738 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:57.871803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:57.872707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:57.872723Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:57.872727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:57.872731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:57.872737Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2737 [2:7555896637317714733:8972]
2025-09-30T14:57:57.872756Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:57.872778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:57.872786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:57.872790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:57.872792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:57.872807Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:57.872814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:57.872820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:57.872887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.872896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.872898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.872901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:57.872903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:57.872984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:57.872987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.872999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:57.873010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:57.873024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:57.873040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896637317714727:8972]
2025-09-30T14:57:57.873043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896637317714727:8972]
2025-09-30T14:57:57.873045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896637317714727:8972]
2025-09-30T14:57:57.873061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:57.873075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:57.873091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:57.873093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:57.873132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:57.873135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896637317714727:8972]
2025-09-30T14:57:57.873137Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:57.873137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:57.873139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:57.873145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:57.873260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407508077:12247], now have 1 active actors on pipe
2025-09-30T14:57:57.873269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407507999:2454], now have 1 active actors on pipe
2025-09-30T14:57:57.875685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2737
2025-09-30T14:57:57.875717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2737
2025-09-30T14:57:57.875901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.875933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.875964Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:57.875981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:57.875986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:57.875988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:57.876001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:57.876016Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:57.876040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:57.876347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:57.876358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:57.876376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:57.876848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4d8df93-d74dd0ba-2a9c443b-15f49976_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:57.876461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2738 partition: 0 MaxSeqNo: 42 sessionId: src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0
2025-09-30T14:57:57.879768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0] Write session: try to update token
2025-09-30T14:57:57.879787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:57.894957Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:57.894977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:57.894988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896637317714727:8972]
2025-09-30T14:57:57.895038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:57.895043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:57.895219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:57.895391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:57.895545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:57.895694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:57.895907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:57.895955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:57.900194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2738 sessionId: src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:57.901699Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:57.901717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:57.901719Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:57.901722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:57.901731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896637317714727:8972]
2025-09-30T14:57:57.901736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896637317714727:8972]
2025-09-30T14:57:57.901740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896637317714727:8972]
2025-09-30T14:57:57.901783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:57.901790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:57.901793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:57.901805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:57.901813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:57.901817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:57.901941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:57.903092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:57.948117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896637407508107:12049]
2025-09-30T14:57:57.948474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2737, pipe: [1:7555896637407508107:12049]
2025-09-30T14:57:58.017073Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:58.017351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.017367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.017388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896637407508107:12049], now have 1 active actors on pipe
2025-09-30T14:57:58.017601Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:58.017770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896637407508107:12049]
2025-09-30T14:57:58.017773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:58.017802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:58.017855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2738 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0
2025-09-30T14:57:58.018017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2738 sessionId: src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0 is DEAD
2025-09-30T14:57:58.018157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:58.018168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0] Write session will restart in 0.006413s
2025-09-30T14:57:58.018193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0] Write session: Do CDS request
2025-09-30T14:57:58.018199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:58.025881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:58.025958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:58.025971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2739
2025-09-30T14:57:58.026153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2739 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:58.026184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2739 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:58.026188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2739 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:58.026193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:58.027150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2739 sessionId:  describe result for acl check
2025-09-30T14:57:58.027184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:58.027193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:58.027195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:58.027201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896641702475439:12258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:58.027721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896641702475439:12258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:58.029990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896641702475439:12258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:58.030086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:58.033711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:58.033949Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:58.033961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:58.033974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:58.034034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:58.034080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896641612682145:8928]
2025-09-30T14:57:58.034162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896641702475439:12258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:58.034177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896641702475439:12258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:58.034180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896641702475439:12258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:58.034189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2739 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:58.034770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:58.035091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:58.035146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:58.035728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:58.035824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.035831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.035833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.035834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.035835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.035836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.035838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.035839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.035840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.035841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.035842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.035844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.035846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.035847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.035848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.035854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.035865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.035869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.035874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.035879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.035884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.035888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.035892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.035896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.035901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.035905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.035909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.035913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.035918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.035921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.035934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.035943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.035949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.035955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.035961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.035966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.035971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.035994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.036000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.036006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.036011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.036017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.036031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.036036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.036041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.036052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.036057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.036061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.036068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.036072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.036077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.036088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.036093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.036097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.036102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.036112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.036116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.036122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.036131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.036137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.036183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:58.044040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:58.044915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:58.044944Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:58.044948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:58.044953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:58.044960Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2738 [2:7555896641612682145:8928]
2025-09-30T14:57:58.044978Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:58.044995Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:58.045003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:58.045007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:58.045010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:58.045027Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:58.045040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:58.045052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:58.045124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.045131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.045134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.045138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:58.045140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:58.045222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:58.045231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.045245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.045268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.045289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:58.045308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475482:12258], now have 1 active actors on pipe
2025-09-30T14:57:58.045313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475405:2454], now have 1 active actors on pipe
2025-09-30T14:57:58.045320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896641612682140:8928]
2025-09-30T14:57:58.045323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896641612682140:8928]
2025-09-30T14:57:58.045328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896641612682140:8928]
2025-09-30T14:57:58.045342Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:58.045356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:58.045359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:58.045363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:58.045366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:58.045422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2738
2025-09-30T14:57:58.045460Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2738
2025-09-30T14:57:58.045680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:58.045690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:58.045732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896641612682140:8928]
2025-09-30T14:57:58.045745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:58.045766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:58.045771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.045775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.045822Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:58.045839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:58.045843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:58.045845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:58.045855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:58.045865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:58.045888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:58.051028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.051050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.051097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:58.051306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2739 partition: 0 MaxSeqNo: 42 sessionId: src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0
2025-09-30T14:57:58.051712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7be8182-449f2980-6224ca90-9f28f8bc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:58.054568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0] Write session: try to update token
2025-09-30T14:57:58.054588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:58.059311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:58.059328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:58.059331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:58.059333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:58.059344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896641612682140:8928]
2025-09-30T14:57:58.059349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896641612682140:8928]
2025-09-30T14:57:58.059354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896641612682140:8928]
2025-09-30T14:57:58.059396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:58.059403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.059403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:58.059406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:58.059409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:58.059413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:58.059556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:58.077220Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2739 sessionId: src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:58.080984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:58.118100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896641702475493:12049]
2025-09-30T14:57:58.118407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2738, pipe: [1:7555896641702475493:12049]
2025-09-30T14:57:58.177697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:58.178158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.178168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.178188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475493:12049], now have 1 active actors on pipe
2025-09-30T14:57:58.178421Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:58.178745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:58.178798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:58.178801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:58.178864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2739 reason: error at write: Disconnected sessionId: src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0
2025-09-30T14:57:58.179042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2739 sessionId: src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0 is DEAD
2025-09-30T14:57:58.179226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:58.179292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0] Write session will restart in 0.007114s
2025-09-30T14:57:58.179295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896641702475493:12049]
2025-09-30T14:57:58.179322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0] Write session: Do CDS request
2025-09-30T14:57:58.179329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:58.187729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:58.188078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:58.188092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2740
2025-09-30T14:57:58.188427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2740 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:58.188465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2740 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:58.188470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2740 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:58.188478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:58.188898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2740 sessionId:  describe result for acl check
2025-09-30T14:57:58.188941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:58.188944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:58.188946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:58.188952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896641702475537:12264] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:58.189509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896641702475537:12264] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:58.191160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:58.193437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896641702475537:12264] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:58.196309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896641702475537:12264] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:58.196325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896641702475537:12264] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:58.196328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896641702475537:12264] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:58.196337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2740 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:58.195872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:58.196106Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:58.196111Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:58.196124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:58.196196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:58.196236Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896641612682236:8909]
2025-09-30T14:57:58.196941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:58.197317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:58.197392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:58.197765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:58.197862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.197870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.197872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.197873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.197875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.197876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.197882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.197883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.197885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.197886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.197888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.197889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.197890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.197891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.197892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.197899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.197911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.197915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.197920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.197925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.197929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.197934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.197939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.197943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.197948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.197952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.197957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.197961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.197964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.197969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.197979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.197988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.197995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.198000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.198005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.198011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.198016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.198024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.198030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.198036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.198048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.198054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.198060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.198066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.198071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.198106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.198117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.198123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.198133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.198139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.198149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.198156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.198165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.198170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.198175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.198179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.198185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.198191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.198195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.198200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.198249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:58.204235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:58.205158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:58.205176Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:58.205180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:58.205184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:58.205205Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2739 [2:7555896641612682236:8909]
2025-09-30T14:57:58.205238Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:58.205261Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:58.205272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:58.205276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:58.205278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:58.205295Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:58.205302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:58.205308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:58.205366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.205376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.205378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.205382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:58.205385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:58.205456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:58.205460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.205473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.205487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.205506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:58.205522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896641612682230:8909]
2025-09-30T14:57:58.205525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896641612682230:8909]
2025-09-30T14:57:58.205527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896641612682230:8909]
2025-09-30T14:57:58.205543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:58.205559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:58.205576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:58.205579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:58.205617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896641612682230:8909]
2025-09-30T14:57:58.205621Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:58.205625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:58.205630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:58.205632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:58.205638Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:58.205850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475498:2454], now have 1 active actors on pipe
2025-09-30T14:57:58.205867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475575:12264], now have 1 active actors on pipe
2025-09-30T14:57:58.205919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2739
2025-09-30T14:57:58.205967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2739
2025-09-30T14:57:58.206116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.206127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.206162Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:58.206172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:58.206176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:58.206178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:58.206189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:58.206201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:58.206217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:58.207655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.207683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.207713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:58.207926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2740 partition: 0 MaxSeqNo: 42 sessionId: src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0
2025-09-30T14:57:58.208330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3e830f-77b1bf3b-edaebe22-261b1c73_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:58.211186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0] Write session: try to update token
2025-09-30T14:57:58.211209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:58.218366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:58.218385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:58.218388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:58.218390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:58.218400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896641612682230:8909]
2025-09-30T14:57:58.218404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896641612682230:8909]
2025-09-30T14:57:58.218408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896641612682230:8909]
2025-09-30T14:57:58.218449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:58.218455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.218458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:58.218605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:58.218782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:58.218813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:58.218818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:58.234318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2740 sessionId: src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:58.237158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:58.279612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896641702475591:12049]
2025-09-30T14:57:58.279987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2739, pipe: [1:7555896641702475591:12049]
2025-09-30T14:57:58.336437Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:58.337180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.337198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.337220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475591:12049], now have 1 active actors on pipe
2025-09-30T14:57:58.337548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:58.338035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:58.338046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0] Write session will restart in 0.006417s
2025-09-30T14:57:58.338103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0] Write session: Do CDS request
2025-09-30T14:57:58.338109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:58.337579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:58.337594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:58.337668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2740 reason: error at write: Disconnected sessionId: src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0
2025-09-30T14:57:58.337851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2740 sessionId: src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0 is DEAD
2025-09-30T14:57:58.338037Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:58.338050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896641702475591:12049]
2025-09-30T14:57:58.345816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:58.345991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:58.346008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2741
2025-09-30T14:57:58.346164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2741 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:58.346214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2741 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:58.346242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2741 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:58.346251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:58.346694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2741 sessionId:  describe result for acl check
2025-09-30T14:57:58.346728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:58.346735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:58.346738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:58.346744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896641702475611:12269] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:58.347692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896641702475611:12269] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:58.349800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896641702475611:12269] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:58.350526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:58.353981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:58.354228Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:58.354242Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:58.354255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:58.354325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:58.354378Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896641612682316:8901]
2025-09-30T14:57:58.354397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896641702475611:12269] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:58.354413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896641702475611:12269] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:58.354416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896641702475611:12269] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:58.354427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2741 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:58.355090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:58.355492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:58.355552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:58.355931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:58.355996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.356003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.356004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.356005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.356007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.356008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.356010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.356011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.356022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.356025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.356027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.356028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.356029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.356030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.356031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.356037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.356046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.356050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.356053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.356057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.356061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.356065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.356069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.356074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.356078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.356082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.356086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.356089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.356092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.356095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.356106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.356114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.356120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.356125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.356131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.356136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.356139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.356144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.356148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.356153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.356159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.356163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.356168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.356174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.356179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.356184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.356189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.356194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.356206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.356212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.356218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.356224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.356228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.356233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.356237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.356242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.356247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.356252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.356256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.356262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.356316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:58.362205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:58.363494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:58.363509Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:58.363512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:58.363516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:58.363525Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2740 [2:7555896641612682316:8901]
2025-09-30T14:57:58.363542Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:58.363559Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:58.363563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:58.363566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:58.363569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:58.363588Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:58.363600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:58.363607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:58.363674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.363683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.363685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.363688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:58.363691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:58.363763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:58.363770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.363782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.363793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.363814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:58.363833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475595:2454], now have 1 active actors on pipe
2025-09-30T14:57:58.363840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475673:12269], now have 1 active actors on pipe
2025-09-30T14:57:58.363846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896641612682311:8901]
2025-09-30T14:57:58.363848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896641612682311:8901]
2025-09-30T14:57:58.363849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896641612682311:8901]
2025-09-30T14:57:58.363864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:58.363883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:58.363892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:58.363897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:58.363901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:58.363904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:58.363918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:58.363942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896641612682311:8901]
2025-09-30T14:57:58.363945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:58.363950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:58.363962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2740
2025-09-30T14:57:58.363964Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2740
2025-09-30T14:57:58.364089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.364100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.364131Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:58.364142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:58.364145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:58.364148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:58.364158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:58.364168Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:58.364182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:58.364364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.364372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.364386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:58.364473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2741 partition: 0 MaxSeqNo: 42 sessionId: src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0
2025-09-30T14:57:58.364840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33e3bf4e-2e02c003-f9fe3a80-3801b2a9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:58.367830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0] Write session: try to update token
2025-09-30T14:57:58.367853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:58.376855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:58.376873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:58.376885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896641612682311:8901]
2025-09-30T14:57:58.376947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:58.376980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:58.377132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:58.377294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:58.377447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:58.377619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:58.378079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:58.378139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:58.383665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2741 sessionId: src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:58.386608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:58.386843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.386867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.386904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:58.386997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:58.388622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:58.388646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:58.388648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:58.388650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:58.388663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896641612682311:8901]
2025-09-30T14:57:58.388667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896641612682311:8901]
2025-09-30T14:57:58.388671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896641612682311:8901]
2025-09-30T14:57:58.388707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:58.388719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.388722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:58.388724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:58.388734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:58.388746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:58.388876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:58.438099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896641702475697:12049]
2025-09-30T14:57:58.438683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2740, pipe: [1:7555896641702475697:12049]
2025-09-30T14:57:58.509319Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:58.519898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.519931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.520137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.520214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.520289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.520357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.520693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.520700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.520787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.520854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.520922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.521016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.521066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.521070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.521153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.521218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.521283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.521359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.521405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.521408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.521492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.521560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.521630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.521693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.521740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.521743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.521819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.521888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.521981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.522051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.522119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.522123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.522208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.522272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.522336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.522403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.522465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.522470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.522545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.522608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.522680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.522746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.522793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.522797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.522872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.522935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.523000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.523067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.523973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.523989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.524067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.524136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.524207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.524283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.524330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.524353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.525045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:58.525087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:58.525091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:58.525108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896641702475697:12049]
2025-09-30T14:57:58.525124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2741 reason: error at write: Disconnected sessionId: src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0
2025-09-30T14:57:58.525321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2741 sessionId: src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0 is DEAD
2025-09-30T14:57:58.525662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:58.525674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0] Write session will restart in 0.006079s
2025-09-30T14:57:58.525699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0] Write session: Do CDS request
2025-09-30T14:57:58.525705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:58.524426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.524503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.524569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.524637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.524680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.524683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.524763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475697:12049], now have 1 active actors on pipe
2025-09-30T14:57:58.525508Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:58.535728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:58.536100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:58.536115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2742
2025-09-30T14:57:58.536271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2742 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:58.536311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2742 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:58.536323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2742 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:58.536327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:58.536737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2742 sessionId:  describe result for acl check
2025-09-30T14:57:58.536769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:58.536770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:58.536773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:58.536779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896641702475742:12274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:58.537394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896641702475742:12274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:58.538032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:58.542527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896641702475742:12274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:58.542055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:58.542284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:58.542289Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:58.542300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:58.542360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:58.542400Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896641612682397:8888]
2025-09-30T14:57:58.543087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:58.544131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:58.544253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:58.544634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:58.544711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.544719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.544720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.544721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.544724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.544726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.544727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.544728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.544729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.544731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.544732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.544733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.544734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.544735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.544736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.544743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.544754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.544759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.544764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.544768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.544772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.544777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.544781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.544785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.544790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.544795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.544799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.544804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.544808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.544812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.544821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.544828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.544834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.544838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.544843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.544849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.544858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.544864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.544869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.544875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.544885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.544891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.544901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.544906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.544916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.544922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.544946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.544951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.544956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.544966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.544973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.544984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.544989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.544999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.545006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.545016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.545020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.545031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.545036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.545045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.545092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:58.545555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896641702475742:12274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:58.545571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896641702475742:12274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:58.545575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896641702475742:12274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:58.545583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2742 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:58.551155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:58.552122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:58.552143Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:58.552148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:58.552152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:58.552159Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2741 [2:7555896641612682397:8888]
2025-09-30T14:57:58.552179Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:58.552200Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:58.552209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:58.552213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:58.552215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:58.552233Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:58.552244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:58.552252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:58.552317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.552325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.552328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.552331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:58.552333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:58.552408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:58.552416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.552432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.552449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.552471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:58.552493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896641612682392:8888]
2025-09-30T14:57:58.552500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896641612682392:8888]
2025-09-30T14:57:58.552503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896641612682392:8888]
2025-09-30T14:57:58.552518Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:58.552538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:58.552559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:58.552568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:58.552569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:58.552571Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:58.552572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:58.552609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896641612682392:8888]
2025-09-30T14:57:58.552619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:58.552654Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:58.552821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475783:12274], now have 1 active actors on pipe
2025-09-30T14:57:58.552833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475700:2454], now have 1 active actors on pipe
2025-09-30T14:57:58.552953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2741
2025-09-30T14:57:58.552956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2741
2025-09-30T14:57:58.553177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.553191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.553220Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:58.553229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:58.553242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:58.553249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:58.553261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:58.553277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:58.553299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:58.553542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.553551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.553568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:58.553698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2742 partition: 0 MaxSeqNo: 42 sessionId: src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0
2025-09-30T14:57:58.554086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ae89fd13-3da3c74-4be3ee1f-216652d6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:58.556974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0] Write session: try to update token
2025-09-30T14:57:58.556993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:58.566660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:58.566684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:58.566686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:58.566689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:58.566699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896641612682392:8888]
2025-09-30T14:57:58.566703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896641612682392:8888]
2025-09-30T14:57:58.566707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896641612682392:8888]
2025-09-30T14:57:58.566754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:58.566763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.566776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:58.566932Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:58.569664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:58.569672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:58.569680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:58.601467Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2742 sessionId: src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:58.604289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:58.623910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896641702475790:12049]
2025-09-30T14:57:58.627759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2741, pipe: [1:7555896641702475790:12049]
2025-09-30T14:57:58.694772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:58.695682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.695700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.695720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475790:12049], now have 1 active actors on pipe
2025-09-30T14:57:58.696033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896641702475790:12049]
2025-09-30T14:57:58.696062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:58.696067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:58.696071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:58.696135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2742 reason: error at write: Disconnected sessionId: src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0
2025-09-30T14:57:58.696327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2742 sessionId: src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0 is DEAD
2025-09-30T14:57:58.696523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:58.696535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0] Write session will restart in 0.009558s
2025-09-30T14:57:58.696569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0] Write session: Do CDS request
2025-09-30T14:57:58.696575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:58.696419Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:58.711703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:58.715481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:58.716281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:58.716308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2743
2025-09-30T14:57:58.716460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2743 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:58.716496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2743 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:58.716506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2743 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:58.716511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:58.716984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2743 sessionId:  describe result for acl check
2025-09-30T14:57:58.717026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:58.717036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:58.717038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:58.717055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896641702475839:12278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:58.717653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896641702475839:12278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:58.718761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:58.718959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:58.718971Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:58.718983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:58.719041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:58.719082Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896641612682481:8897]
2025-09-30T14:57:58.719776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:58.720085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:58.720140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:58.720061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896641702475839:12278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:58.720479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:58.720536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.720538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.720539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.720542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.720543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.720544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.720545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.720546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.720547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.720549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.720550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.720551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.720552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.720553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.720554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.720559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.720568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.720573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.720577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.720581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.720585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.720589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.720593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.720597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.720601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.720605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.720609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.720613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.720616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.720620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.720626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.720634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.720640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.720646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.720652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.720658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.720662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.720667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.720672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.720677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.720681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.720688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.720693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.720698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.720703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.720708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.720713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.720717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.720723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.720729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.720733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.720738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.720742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.720747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.720752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.720757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.720761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.720766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.720770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.720775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.720820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:58.726409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896641702475839:12278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:58.726426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896641702475839:12278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:58.726430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896641702475839:12278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:58.726439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2743 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:58.726908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:58.728059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:58.728076Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:58.728079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:58.728083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:58.728090Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2742 [2:7555896641612682481:8897]
2025-09-30T14:57:58.728108Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:58.728124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:58.728127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:58.728131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:58.728133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:58.728147Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:58.728154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:58.728161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:58.728221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.728229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.728230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.728233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:58.728236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:58.728296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:58.728303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.728328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.728344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.728456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2742
2025-09-30T14:57:58.728488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2742
2025-09-30T14:57:58.728360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:58.728383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475876:12278], now have 1 active actors on pipe
2025-09-30T14:57:58.728387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475792:2454], now have 1 active actors on pipe
2025-09-30T14:57:58.728393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896641612682476:8897]
2025-09-30T14:57:58.728396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896641612682476:8897]
2025-09-30T14:57:58.728397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896641612682476:8897]
2025-09-30T14:57:58.728410Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:58.728425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:58.728440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:58.728443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:58.728481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896641612682476:8897]
2025-09-30T14:57:58.728483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:58.728484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:58.728488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:58.728491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:58.728498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:58.728960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.728967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.728997Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:58.729005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:58.729009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:58.729012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:58.729021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:58.729031Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:58.729047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:58.729619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2743 partition: 0 MaxSeqNo: 42 sessionId: src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0
2025-09-30T14:57:58.729446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.729457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.729478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:58.729989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e3a70f0-28c3354-35cecf56-7909dbb3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:58.732814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0] Write session: try to update token
2025-09-30T14:57:58.732835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:58.744830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:58.744850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:58.744863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896641612682476:8897]
2025-09-30T14:57:58.744914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:58.745003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:58.745109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:58.745529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:58.745698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:58.745858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:58.746167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:58.746217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:58.749504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2743 sessionId: src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:58.752465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:58.752885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.752919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.752969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:58.753760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:58.757360Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:58.757384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:58.757387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:58.757389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:58.757400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896641612682476:8897]
2025-09-30T14:57:58.757405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896641612682476:8897]
2025-09-30T14:57:58.757409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896641612682476:8897]
2025-09-30T14:57:58.757449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:58.757454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:58.757457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.757460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:58.757459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:58.757464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:58.757606Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:58.795945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896641702475886:12049]
2025-09-30T14:57:58.796274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2742, pipe: [1:7555896641702475886:12049]
2025-09-30T14:57:58.884205Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:58.892686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.892715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.892899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.892980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.893054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.893118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.893167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.893177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.893251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.893320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.893385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.893455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.893503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.893514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.893584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.893644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.893714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.893784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.893828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.893835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.893905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.893970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.894036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.894103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.894151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.894159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.894226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.894290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.894357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.894426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.894472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.894479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.894552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.894615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.894695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.894768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.894820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.894828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.894899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.894965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.895036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.895105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.895150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.895158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.895229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.895451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.895533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.895604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.895647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.895650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.895726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.895803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.895872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.895940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.895990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.896001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.896076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:58.896145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:58.896213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:58.896276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:58.896324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:58.896328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:58.897171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:58.897186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0] Write session will restart in 0.007668s
2025-09-30T14:57:58.897212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0] Write session: Do CDS request
2025-09-30T14:57:58.897218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:58.896738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:58.896754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:58.896788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2743 reason: error at write: Disconnected sessionId: src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0
2025-09-30T14:57:58.897003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2743 sessionId: src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0 is DEAD
2025-09-30T14:57:58.897181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:58.897215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896641702475886:12049]
2025-09-30T14:57:58.896401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475886:12049], now have 1 active actors on pipe
2025-09-30T14:57:58.897804Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:58.907892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:58.908275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:58.908291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2744
2025-09-30T14:57:58.908541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2744 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:58.908576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2744 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:58.908582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2744 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:58.908585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:58.909079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2744 sessionId:  describe result for acl check
2025-09-30T14:57:58.909113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:58.909115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:58.909117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:58.909123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896641702475931:12283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:58.909667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896641702475931:12283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:58.913560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896641702475931:12283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:58.917203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:58.917827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896641702475931:12283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:58.917840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896641702475931:12283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:58.917844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896641702475931:12283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:58.917853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2744 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:58.921171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:58.921396Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:58.921411Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:58.921424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:58.921484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:58.921525Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896641612682565:8889]
2025-09-30T14:57:58.922208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:58.923109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:58.923165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:58.923540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:58.923625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.923627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.923628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.923629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.923630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.923632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.923633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.923634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.923636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.923637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.923638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.923639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.923641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.923642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.923643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.923649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.923658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.923662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.923666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.923669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.923673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.923676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.923679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.923693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.923697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.923702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.923706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.923709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.923713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.923717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.923726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.923734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:58.923741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.923747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:58.923756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.923761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:58.923767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.923772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:58.923776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.923781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:58.923786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.923790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:58.923795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.923801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:58.923805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.923811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:58.923815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.923821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:58.923825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.923832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:58.923836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.923841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.923845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.923851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.923856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.923861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.923867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.923872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:58.923877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.923883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:58.923926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:58.933009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:58.933915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:58.933932Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:58.933934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:58.933938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:58.933944Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2743 [2:7555896641612682565:8889]
2025-09-30T14:57:58.933960Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:58.933974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:58.933978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:58.933981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:58.933983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:58.933999Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:58.934012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:58.934018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:58.934077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.934085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.934087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.934090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:58.934092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:58.934160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:58.934168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.934181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:58.934194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:58.934217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:58.934239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896641612682558:8889]
2025-09-30T14:57:58.934242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896641612682558:8889]
2025-09-30T14:57:58.934244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896641612682558:8889]
2025-09-30T14:57:58.934252Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:58.934265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:58.934281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:58.934290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:58.934322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896641612682558:8889]
2025-09-30T14:57:58.934329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:58.934417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:58.934425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:58.934428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:58.934433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:58.934755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2743
2025-09-30T14:57:58.934798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2743
2025-09-30T14:57:58.936701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475969:12283], now have 1 active actors on pipe
2025-09-30T14:57:58.936723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702475889:2454], now have 1 active actors on pipe
2025-09-30T14:57:58.936743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.936748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.936772Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93e6bfa9-c34803c4-982666e0-73853e41_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:58.936792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:58.936795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:58.936797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:58.936806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:58.936818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:58.936834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:58.937461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:58.937477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:58.937492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:58.937628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2744 partition: 0 MaxSeqNo: 42 sessionId: src_id|93e6bfa9-c34803c4-982666e0-73853e41_0
2025-09-30T14:57:58.938081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a1f5285-37e6bd86-15c1b951-97a3c12f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|93e6bfa9-c34803c4-982666e0-73853e41_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:58.940936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93e6bfa9-c34803c4-982666e0-73853e41_0] Write session: try to update token
2025-09-30T14:57:58.940954Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93e6bfa9-c34803c4-982666e0-73853e41_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:58.952092Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:58.952114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:58.952116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:58.952118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:58.952128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896641612682558:8889]
2025-09-30T14:57:58.952132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896641612682558:8889]
2025-09-30T14:57:58.952138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896641612682558:8889]
2025-09-30T14:57:58.952181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:58.952186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:58.952189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:58.952322Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:58.952874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:58.952881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:58.952885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:58.971446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2744 sessionId: src_id|93e6bfa9-c34803c4-982666e0-73853e41_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:58.974212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:58.996160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896641702476003:12049]
2025-09-30T14:57:59.001423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2743, pipe: [1:7555896641702476003:12049]
2025-09-30T14:57:59.075849Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:59.076193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.076212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.076232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896641702476003:12049], now have 1 active actors on pipe
2025-09-30T14:57:59.076511Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:59.076602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:59.076617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:59.076678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2744 reason: error at write: Disconnected sessionId: src_id|93e6bfa9-c34803c4-982666e0-73853e41_0
2025-09-30T14:57:59.076823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896641702476003:12049]
2025-09-30T14:57:59.076834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2744 sessionId: src_id|93e6bfa9-c34803c4-982666e0-73853e41_0 is DEAD
2025-09-30T14:57:59.076842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:59.077104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e6bfa9-c34803c4-982666e0-73853e41_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:59.077115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e6bfa9-c34803c4-982666e0-73853e41_0] Write session will restart in 0.006178s
2025-09-30T14:57:59.077138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e6bfa9-c34803c4-982666e0-73853e41_0] Write session: Do CDS request
2025-09-30T14:57:59.077147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e6bfa9-c34803c4-982666e0-73853e41_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:59.085476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93e6bfa9-c34803c4-982666e0-73853e41_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:59.087418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:59.087433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2745
2025-09-30T14:57:59.087564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2745 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:59.087598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2745 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:59.087608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2745 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:59.087612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:59.088031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2745 sessionId:  describe result for acl check
2025-09-30T14:57:59.088063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:59.088070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:59.088072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:59.088078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896645997443346:5868] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:59.088611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896645997443346:5868] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:59.090239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:59.093384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896645997443346:5868] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:59.093662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:59.093824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:59.093833Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:59.093841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:59.093877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:59.093913Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896645907649983:8870]
2025-09-30T14:57:59.094372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:59.094746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:59.094781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:59.095016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:59.095061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.095066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.095067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.095068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.095068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.095069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.095070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.095071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.095072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.095073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.095073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.095074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.095075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.095075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.095076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.095079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.095085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.095089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.095092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.095094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.095096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.095099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.095101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.095104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.095106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.095108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.095110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.095113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.095115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.095117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.095122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.095127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.095131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.095135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.095138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.095141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.095144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.095147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.095150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.095153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.095155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.095158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.095161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.095164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.095167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.095170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.095173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.095175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.095181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.095186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.095190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.095195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.095200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.095204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.095207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.095210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.095213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.095215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.095218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.095221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.095269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:59.096325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896645997443346:5868] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:59.096338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896645997443346:5868] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:59.096342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896645997443346:5868] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:59.096349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2745 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:59.100800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:59.102165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:59.102183Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:59.102185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:59.102190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:59.102198Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2744 [2:7555896645907649983:8870]
2025-09-30T14:57:59.102215Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:59.102231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:59.102234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:59.102237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:59.102242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:59.102257Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:59.102265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:59.102271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:59.102327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.102335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.102337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.102341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:59.102343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:59.102418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:59.102426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.102438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.102445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.102459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:59.102484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443301:2454], now have 1 active actors on pipe
2025-09-30T14:57:59.102492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443388:5868], now have 1 active actors on pipe
2025-09-30T14:57:59.102498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896645907649977:8870]
2025-09-30T14:57:59.102500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896645907649977:8870]
2025-09-30T14:57:59.102502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896645907649977:8870]
2025-09-30T14:57:59.102515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:59.102535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:59.102541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:59.102545Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:59.102548Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:59.102553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:59.102556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:59.102587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896645907649977:8870]
2025-09-30T14:57:59.102600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:59.102627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:59.103140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2744
2025-09-30T14:57:59.103143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2744
2025-09-30T14:57:59.103266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.103278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.103307Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4210381-da25b2c2-4d112646-32c47596_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:59.103315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:59.103319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:59.103321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:59.103334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:59.103348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:59.103365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:59.103579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.103586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.103601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:59.103703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2745 partition: 0 MaxSeqNo: 42 sessionId: src_id|f4210381-da25b2c2-4d112646-32c47596_0
2025-09-30T14:57:59.104053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93e6bfa9-c34803c4-982666e0-73853e41_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f4210381-da25b2c2-4d112646-32c47596_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:59.106887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4210381-da25b2c2-4d112646-32c47596_0] Write session: try to update token
2025-09-30T14:57:59.106909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4210381-da25b2c2-4d112646-32c47596_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:59.116598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:59.116614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:59.116626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896645907649977:8870]
2025-09-30T14:57:59.116663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:59.116670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:59.116907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:59.117070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:59.117207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:59.117360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:59.117569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:59.117612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:59.122855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2745 sessionId: src_id|f4210381-da25b2c2-4d112646-32c47596_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:59.125897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:59.126680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:59.126142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.126166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.126210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:57:59.127956Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:59.127961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:59.127964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:59.127965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:59.127979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896645907649977:8870]
2025-09-30T14:57:59.127982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896645907649977:8870]
2025-09-30T14:57:59.127985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896645907649977:8870]
2025-09-30T14:57:59.128026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:59.128034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.128034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:59.128036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:59.128039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:59.128044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:59.128175Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:59.176919Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896645997443395:12049]
2025-09-30T14:57:59.177372Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2744, pipe: [1:7555896645997443395:12049]
2025-09-30T14:57:59.244618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:59.253175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.253202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.253392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:59.253466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:59.253540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:59.253610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:59.253664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:59.253670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:59.253743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:59.253802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:59.253862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:59.253926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:59.253969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:59.253971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:59.254053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:59.254115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:59.254177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:59.254244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:59.254289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:59.254293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:59.254369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:59.254458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:59.254521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:59.254586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:59.254625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:59.254628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:59.254708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:59.254784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:59.254849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:59.254910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:59.254952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:59.254955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:59.255035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:59.255100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:59.255168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:59.255233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:59.255475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:59.255487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:59.255560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:59.255624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:59.258580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896645997443395:12049]
2025-09-30T14:57:59.258590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:59.258594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:59.258615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:59.258625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2745 reason: error at write: Disconnected sessionId: src_id|f4210381-da25b2c2-4d112646-32c47596_0
2025-09-30T14:57:59.255699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:59.255777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:59.255822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:59.255825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:59.255899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:59.255957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:59.256019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:59.256081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:59.256123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:59.256126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:59.256200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:59.256261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:59.256330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:59.256393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:59.256460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:59.256464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:59.256539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:57:59.256604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:57:59.256675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:57:59.256742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:57:59.256781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:57:59.256784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:57:59.256861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443395:12049], now have 1 active actors on pipe
2025-09-30T14:57:59.258494Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:59.259005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4210381-da25b2c2-4d112646-32c47596_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:59.259017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4210381-da25b2c2-4d112646-32c47596_0] Write session will restart in 0.009940s
2025-09-30T14:57:59.259042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4210381-da25b2c2-4d112646-32c47596_0] Write session: Do CDS request
2025-09-30T14:57:59.259048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4210381-da25b2c2-4d112646-32c47596_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:59.258820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2745 sessionId: src_id|f4210381-da25b2c2-4d112646-32c47596_0 is DEAD
2025-09-30T14:57:59.271754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4210381-da25b2c2-4d112646-32c47596_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:59.273374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:59.274565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:59.274590Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2746
2025-09-30T14:57:59.274775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2746 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:59.274811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2746 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:59.274830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2746 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:59.274839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:59.275351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2746 sessionId:  describe result for acl check
2025-09-30T14:57:59.275387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:59.275393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:59.275395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:59.275401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896645997443452:5877] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:59.276069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896645997443452:5877] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:59.276810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:59.277064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:59.277077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:59.277088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:59.277148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:59.277188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896645907650082:8867]
2025-09-30T14:57:59.277810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:59.278173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:59.278228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:59.278588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:59.278668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.278675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.278677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.278678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.278679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.278681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.278682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.278684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.278685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.278686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.278688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.278689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.278693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.278694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.278695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.278701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.278711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.278715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.278719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.278723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.278727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.278730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.278734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.278737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.278741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.278745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.278749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.278753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.278756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.278760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.278769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.278778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.278783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.278789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.278793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.278799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.278803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.278808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.278813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.278818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.278822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.278827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.278831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.278837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.278841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.278846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.278850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.278855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.278867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.278874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.278879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.278889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.278893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.278898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.278902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.278909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.278918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.278924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.278932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.278936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.278983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:59.282252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896645997443452:5877] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:59.285052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:59.285080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896645997443452:5877] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:59.285096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896645997443452:5877] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:59.285100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896645997443452:5877] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:59.285112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2746 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:59.286147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:59.286171Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:59.286175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:59.286179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:59.286186Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2745 [2:7555896645907650082:8867]
2025-09-30T14:57:59.286202Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:59.286218Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:59.286227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:59.286230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:59.286233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:59.286251Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:59.286263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:59.286273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:59.286337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.286346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.286347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.286351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:59.286353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:59.286422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:59.286431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.286446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.286465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.286490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:59.286514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443489:5877], now have 1 active actors on pipe
2025-09-30T14:57:59.286523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443399:2454], now have 1 active actors on pipe
2025-09-30T14:57:59.286531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896645907650077:8867]
2025-09-30T14:57:59.286538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896645907650077:8867]
2025-09-30T14:57:59.286541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896645907650077:8867]
2025-09-30T14:57:59.286557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:59.286579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:59.286596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:59.286599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:59.286600Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:59.286605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:59.286607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:59.286635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896645907650077:8867]
2025-09-30T14:57:59.286638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:59.286591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2745
2025-09-30T14:57:59.286650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:59.286616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2745
2025-09-30T14:57:59.286673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.286686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.286720Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:59.286734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:59.286743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:59.286745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:59.286755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:59.286769Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:59.286789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:59.287011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.287025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.287043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:59.287131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2746 partition: 0 MaxSeqNo: 42 sessionId: src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0
2025-09-30T14:57:59.287567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4210381-da25b2c2-4d112646-32c47596_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:59.290488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0] Write session: try to update token
2025-09-30T14:57:59.290509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:59.302485Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:59.302504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:59.302508Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:59.302509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:59.302521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896645907650077:8867]
2025-09-30T14:57:59.302526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896645907650077:8867]
2025-09-30T14:57:59.302529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896645907650077:8867]
2025-09-30T14:57:59.302575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:59.302583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.302586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:59.302600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:59.302617Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:59.302622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:59.302735Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:59.311682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2746 sessionId: src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:59.314487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:59.358648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896645997443501:12049]
2025-09-30T14:57:59.358981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2745, pipe: [1:7555896645997443501:12049]
2025-09-30T14:57:59.424118Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:59.424709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.424719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.424758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443501:12049], now have 1 active actors on pipe
2025-09-30T14:57:59.425025Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:59.425116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:59.425127Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:59.425131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:59.425203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2746 reason: error at write: Disconnected sessionId: src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0
2025-09-30T14:57:59.425378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2746 sessionId: src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0 is DEAD
2025-09-30T14:57:59.425505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:59.425519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0] Write session will restart in 0.005132s
2025-09-30T14:57:59.425551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0] Write session: Do CDS request
2025-09-30T14:57:59.425556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:59.425533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896645997443501:12049]
2025-09-30T14:57:59.431825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:59.431889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:59.431903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2747
2025-09-30T14:57:59.432078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2747 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:59.432113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2747 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:59.432123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2747 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:59.432128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:59.432694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2747 sessionId:  describe result for acl check
2025-09-30T14:57:59.432734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:59.432744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:59.432747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:59.432753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896645997443522:5884] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:59.433376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896645997443522:5884] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:59.435540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896645997443522:5884] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:59.438410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896645997443522:5884] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:59.438425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896645997443522:5884] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:59.438429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896645997443522:5884] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:59.438442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2747 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:59.440563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:59.443890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:59.444127Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:59.444139Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:59.444152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:59.444216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:59.444260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896645907650170:8865]
2025-09-30T14:57:59.444751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:59.445151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:59.445210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:59.445571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:59.445655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.445663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.445665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.445666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.445667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.445669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.445670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.445671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.445672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.445673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.445674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.445679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.445680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.445681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.445683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.445689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.445700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.445704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.445708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.445711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.445715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.445718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.445721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.445725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.445729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.445733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.445737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.445740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.445743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.445747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.445763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.445786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.445793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.445799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.445804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.445810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.445818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.445823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.445828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.445834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.445838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.445843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.445849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.445864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.445869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.445874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.445879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.445884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.445888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.445893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.445898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.445903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.445907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.445913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.445918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.445923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.445928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.445932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.445938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.445942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.445984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:59.455119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:59.456328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:59.456345Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:59.456347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:59.456352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:59.456360Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2746 [2:7555896645907650170:8865]
2025-09-30T14:57:59.456375Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:59.456390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:59.456392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:59.456394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:59.456396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:59.456407Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:59.456413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:59.456418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:59.456464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.456470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.456472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.456475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:59.456477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:59.456742Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2746
2025-09-30T14:57:59.456773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2746
2025-09-30T14:57:59.456540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:59.456550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.456573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.456584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.456600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:59.456618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443594:5884], now have 1 active actors on pipe
2025-09-30T14:57:59.456621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443514:2454], now have 1 active actors on pipe
2025-09-30T14:57:59.456628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896645907650165:8865]
2025-09-30T14:57:59.456632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896645907650165:8865]
2025-09-30T14:57:59.456634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896645907650165:8865]
2025-09-30T14:57:59.456645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:59.456660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:59.456674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:59.456676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:59.456713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896645907650165:8865]
2025-09-30T14:57:59.456715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:59.456758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:59.456762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:59.456764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:59.456770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:59.456973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.456981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.457022Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|80792abf-56342fef-5fcd321e-67ecc5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:59.457030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:59.457034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:59.457036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:59.457048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:59.457060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:59.457076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:59.457231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.457235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.457248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:59.459790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|133361e8-fad127d5-8ed08cc7-85561a9b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|80792abf-56342fef-5fcd321e-67ecc5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:59.462492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80792abf-56342fef-5fcd321e-67ecc5c_0] Write session: try to update token
2025-09-30T14:57:59.462509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80792abf-56342fef-5fcd321e-67ecc5c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:59.459359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2747 partition: 0 MaxSeqNo: 42 sessionId: src_id|80792abf-56342fef-5fcd321e-67ecc5c_0
2025-09-30T14:57:59.470404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:57:59.470423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:59.470433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896645907650165:8865]
2025-09-30T14:57:59.470479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:57:59.470656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:57:59.470807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:59.471007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:59.471082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:57:59.471159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:57:59.471392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:57:59.471433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:57:59.479084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2747 sessionId: src_id|80792abf-56342fef-5fcd321e-67ecc5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:59.481660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:59.481677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:59.481679Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:59.481680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:59.481690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896645907650165:8865]
2025-09-30T14:57:59.481695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896645907650165:8865]
2025-09-30T14:57:59.481702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896645907650165:8865]
2025-09-30T14:57:59.481739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:59.481745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.481752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:59.481876Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:59.481864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:59.483352Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:59.483367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:59.483371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:59.524524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896645997443610:12049]
2025-09-30T14:57:59.524866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2746, pipe: [1:7555896645997443610:12049]
2025-09-30T14:57:59.598283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:59.598613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.598623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.598662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443610:12049], now have 1 active actors on pipe
2025-09-30T14:57:59.599146Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:59.599658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:59.599671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:59.599733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2747 reason: error at write: Disconnected sessionId: src_id|80792abf-56342fef-5fcd321e-67ecc5c_0
2025-09-30T14:57:59.599931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2747 sessionId: src_id|80792abf-56342fef-5fcd321e-67ecc5c_0 is DEAD
2025-09-30T14:57:59.600122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896645997443610:12049]
2025-09-30T14:57:59.600138Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:59.603291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80792abf-56342fef-5fcd321e-67ecc5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:59.603307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80792abf-56342fef-5fcd321e-67ecc5c_0] Write session will restart in 0.005476s
2025-09-30T14:57:59.603334Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80792abf-56342fef-5fcd321e-67ecc5c_0] Write session: Do CDS request
2025-09-30T14:57:59.603342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80792abf-56342fef-5fcd321e-67ecc5c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:59.611700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|80792abf-56342fef-5fcd321e-67ecc5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:59.612054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:59.612075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2748
2025-09-30T14:57:59.612352Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2748 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:59.612398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2748 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:59.612418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2748 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:59.612424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:59.614912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2748 sessionId:  describe result for acl check
2025-09-30T14:57:59.614954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:59.614956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:59.614958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:59.614974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896645997443660:5902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:59.615549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896645997443660:5902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:59.618553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:59.623381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896645997443660:5902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:59.624306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:59.624556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:59.624561Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:59.624572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:59.624633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:59.624673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896645907650259:8863]
2025-09-30T14:57:59.625403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:59.625774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:59.625845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:59.626225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:59.626317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.626325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.626326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.626328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.626329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.626330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.626332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.626333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.626334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.626336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.626337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.626339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.626342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.626343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.626344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.626350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.626362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.626366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.626371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.626374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.626378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.626382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.626387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.626391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.626395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.626399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.626403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.626407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.626410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.626414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.626423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.626431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.626437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.626442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.626447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.626455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.626459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.626465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.626470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.626474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.626479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.626484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.626489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.626496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.626501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.626505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.626523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.626529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.626533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.626538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.626543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.626548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.626552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.626557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.626564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.626569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.626574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.626578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.626590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.626594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.626642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:59.626858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896645997443660:5902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:59.626885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896645997443660:5902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:59.626889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896645997443660:5902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:59.626898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2748 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:59.632262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:59.633239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:59.633262Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:59.633264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:59.633269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:59.633277Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2747 [2:7555896645907650259:8863]
2025-09-30T14:57:59.633295Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:59.633313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:59.633316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:59.633320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:59.633323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:59.633339Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:59.633349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:59.633356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:59.633418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.633428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.633432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.633436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:59.633439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:59.633510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:59.633518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.633531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.633542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.633566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:59.633585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443699:5902], now have 1 active actors on pipe
2025-09-30T14:57:59.633591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896645907650254:8863]
2025-09-30T14:57:59.633595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896645907650254:8863]
2025-09-30T14:57:59.633597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896645907650254:8863]
2025-09-30T14:57:59.633611Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:59.633625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443611:2454], now have 1 active actors on pipe
2025-09-30T14:57:59.633627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:59.633630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:59.633633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:59.633635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:59.633649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:59.633657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:59.633696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896645907650254:8863]
2025-09-30T14:57:59.633708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:59.633718Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:59.633717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2747
2025-09-30T14:57:59.633752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2747
2025-09-30T14:57:59.633938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.633955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.633992Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:59.634006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:59.634027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:59.634034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:59.634046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:59.634057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:59.634081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:59.634309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.634320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.634337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:59.634429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2748 partition: 0 MaxSeqNo: 42 sessionId: src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0
2025-09-30T14:57:59.634839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|80792abf-56342fef-5fcd321e-67ecc5c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:59.637738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0] Write session: try to update token
2025-09-30T14:57:59.637763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:59.648230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:59.648251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:59.648254Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:59.648256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:59.648266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896645907650254:8863]
2025-09-30T14:57:59.648270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896645907650254:8863]
2025-09-30T14:57:59.648274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896645907650254:8863]
2025-09-30T14:57:59.648328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:59.648339Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:59.648340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.648343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:59.648346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:59.648350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:59.648483Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:59.666520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2748 sessionId: src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:59.669433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:59.705467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896645997443709:12049]
2025-09-30T14:57:59.705920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2747, pipe: [1:7555896645997443709:12049]
2025-09-30T14:57:59.763058Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:59.763577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.763591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.763610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443709:12049], now have 1 active actors on pipe
2025-09-30T14:57:59.763964Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:59.764253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:57:59.764266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0] Write session will restart in 0.005130s
2025-09-30T14:57:59.764302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0] Write session: Do CDS request
2025-09-30T14:57:59.764308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:59.763809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896645997443709:12049]
2025-09-30T14:57:59.763831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:59.763859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:57:59.763861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:57:59.763906Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2748 reason: error at write: Disconnected sessionId: src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0
2025-09-30T14:57:59.764065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2748 sessionId: src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0 is DEAD
2025-09-30T14:57:59.770821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:59.770887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:59.770902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2749
2025-09-30T14:57:59.771097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2749 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:59.771132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2749 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:59.771143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2749 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:59.771147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:59.771616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2749 sessionId:  describe result for acl check
2025-09-30T14:57:59.771657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:59.771659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:59.771661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:59.771667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896645997443736:5921] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:59.772235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896645997443736:5921] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:59.774928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896645997443736:5921] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:59.775579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:59.778988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:59.779198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:59.779208Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:59.779218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:59.779297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:59.779340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896645907650348:8856]
2025-09-30T14:57:59.780006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:59.780079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896645997443736:5921] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:59.780094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896645997443736:5921] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:59.780098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896645997443736:5921] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:59.780111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2749 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:59.780357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:59.780420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:59.780730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:59.780801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.780808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.780809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.780811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.780812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.780813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.780814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.780815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.780817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.780818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.780819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.780820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.780822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.780823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.780824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.780830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.780842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.780846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.780850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.780854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.780858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.780862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.780866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.780870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.780874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.780879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.780883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.780887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.780890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.780894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.780900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.780905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.780909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.780912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.780915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.780931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.780935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.780940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.780943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.780946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.780948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.780951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.780954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.780957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.780959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.780962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.780965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.780968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.780971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.780975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.780978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.780980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.780983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.780986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.780988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.780991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.780993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.780996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.780998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.781001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.781030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:59.786333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:59.787112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:59.787126Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:59.787127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:59.787131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:59.787136Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2748 [2:7555896645907650348:8856]
2025-09-30T14:57:59.787150Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:59.787163Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:59.787166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:59.787168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:59.787169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:59.787181Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:59.787185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:59.787191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:59.787237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.787260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.787262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.787266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:59.787269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:59.787319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:59.787328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.787340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.787351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.787368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:59.787390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443712:2454], now have 1 active actors on pipe
2025-09-30T14:57:59.787399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443799:5921], now have 1 active actors on pipe
2025-09-30T14:57:59.787404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896645907650343:8856]
2025-09-30T14:57:59.787406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896645907650343:8856]
2025-09-30T14:57:59.787409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896645907650343:8856]
2025-09-30T14:57:59.787420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:59.787434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:59.787440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:59.787444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:59.787446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:59.787457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:59.787460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:59.787490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896645907650343:8856]
2025-09-30T14:57:59.787499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:59.787504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:59.787499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2748
2025-09-30T14:57:59.787505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2748
2025-09-30T14:57:59.787635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.787659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.787685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:59.787698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:59.787707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:59.787709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:59.787721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:59.787733Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:59.787763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:59.787923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.787931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.787944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:59.788040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2749 partition: 0 MaxSeqNo: 42 sessionId: src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0
2025-09-30T14:57:59.788441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7379a580-3c06194e-1a356b5a-e18e0dc9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:59.791277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0] Write session: try to update token
2025-09-30T14:57:59.791294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:59.799794Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:59.799816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:59.799819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:59.799821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:59.799832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896645907650343:8856]
2025-09-30T14:57:59.799837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896645907650343:8856]
2025-09-30T14:57:59.799842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896645907650343:8856]
2025-09-30T14:57:59.799883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:59.799889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.799892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:59.799923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:59.799936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:59.799944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:59.800059Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:59.805805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2749 sessionId: src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:59.808643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:57:59.864020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896645997443809:12049]
2025-09-30T14:57:59.864300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2748, pipe: [1:7555896645997443809:12049]
2025-09-30T14:57:59.914637Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:57:59.915240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.915274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.915318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443809:12049], now have 1 active actors on pipe
2025-09-30T14:57:59.915561Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:57:59.916038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:57:59.916050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0] Write session will restart in 0.007562s
2025-09-30T14:57:59.916073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0] Write session: Do CDS request
2025-09-30T14:57:59.916080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:57:59.915584Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896645997443809:12049]
2025-09-30T14:57:59.915618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:57:59.915654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:57:59.915731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2749 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0
2025-09-30T14:57:59.915901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2749 sessionId: src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0 is DEAD
2025-09-30T14:57:59.924803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:59.924891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:57:59.924905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2750
2025-09-30T14:57:59.925069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2750 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:57:59.925109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2750 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:57:59.925114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2750 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:57:59.925119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:57:59.925590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2750 sessionId:  describe result for acl check
2025-09-30T14:57:59.925620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:57:59.925622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:57:59.925624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:57:59.925632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896645997443843:5922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:57:59.926149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896645997443843:5922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:57:59.929021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896645997443843:5922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:57:59.931039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:57:59.934631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:57:59.934857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896645997443843:5922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:57:59.934874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896645997443843:5922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:57:59.934877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896645997443843:5922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:57:59.934892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2750 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:57:59.934863Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:57:59.934877Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:57:59.934888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:57:59.934951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:57:59.934999Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896645907650438:8854]
2025-09-30T14:57:59.935673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:57:59.936044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:57:59.936090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:57:59.936416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:57:59.936485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.936491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.936492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.936496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.936497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.936498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.936499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.936500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.936502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.936503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.936504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.936505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.936506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.936508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.936509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.936514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.936525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.936529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.936533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.936537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.936542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.936546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.936550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.936554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.936561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.936565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.936569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.936573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.936577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.936580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.936589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.936597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:57:59.936602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.936608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:57:59.936614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.936620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:57:59.936624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.936630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:57:59.936634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.936640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:57:59.936644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.936649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:57:59.936653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.936658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:57:59.936662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.936667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:57:59.936671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.936675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:57:59.936679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.936685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:57:59.936689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.936695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.936708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.936713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.936718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.936722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.936726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.936732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:57:59.936736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.936741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:57:59.936786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:57:59.942326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:57:59.943561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:57:59.943576Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:57:59.943579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:57:59.943583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:57:59.943589Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2749 [2:7555896645907650438:8854]
2025-09-30T14:57:59.943608Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:57:59.943625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:57:59.943629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:59.943632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:59.943634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:59.943650Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:57:59.943656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:57:59.943663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:57:59.943723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.943731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.943733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.943736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:57:59.943738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:57:59.943808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:57:59.943816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.943828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:57:59.943846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:57:59.943868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:57:59.943892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443810:2454], now have 1 active actors on pipe
2025-09-30T14:57:59.943900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896645997443897:5922], now have 1 active actors on pipe
2025-09-30T14:57:59.943906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896645907650432:8854]
2025-09-30T14:57:59.943908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896645907650432:8854]
2025-09-30T14:57:59.943910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896645907650432:8854]
2025-09-30T14:57:59.943923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:57:59.943941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:57:59.943947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:57:59.943952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:57:59.943954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:57:59.943961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:57:59.943965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:57:59.944004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896645907650432:8854]
2025-09-30T14:57:59.944016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:57:59.944022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:57:59.944045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2749
2025-09-30T14:57:59.944078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2749
2025-09-30T14:57:59.944131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.944141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.944164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:57:59.944178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:57:59.944182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:57:59.944184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:57:59.944194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:57:59.944204Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:57:59.944217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:59.944387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:57:59.944396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:57:59.944411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:57:59.944551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2750 partition: 0 MaxSeqNo: 42 sessionId: src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0
2025-09-30T14:57:59.944976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10b05f1c-1e3ebe2b-bf475997-2daa62e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:57:59.947789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0] Write session: try to update token
2025-09-30T14:57:59.947811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:57:59.956812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:57:59.956834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:57:59.956837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:57:59.956839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:57:59.956849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896645907650432:8854]
2025-09-30T14:57:59.956855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896645907650432:8854]
2025-09-30T14:57:59.956860Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896645907650432:8854]
2025-09-30T14:57:59.956901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:57:59.956908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:57:59.956911Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:57:59.956913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:57:59.956932Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:57:59.956937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:57:59.957067Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:57:59.966857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2750 sessionId: src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:57:59.969535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:00.015583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896650292411217:12049]
2025-09-30T14:58:00.015806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2749, pipe: [1:7555896650292411217:12049]
2025-09-30T14:58:00.076313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:00.076660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.076676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.076695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411217:12049], now have 1 active actors on pipe
2025-09-30T14:58:00.076940Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:00.076947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:00.076960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:00.076967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896650292411217:12049]
2025-09-30T14:58:00.076987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:00.077029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2750 reason: error at write: Disconnected sessionId: src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0
2025-09-30T14:58:00.077389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:00.077420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0] Write session will restart in 0.006353s
2025-09-30T14:58:00.077213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2750 sessionId: src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0 is DEAD
2025-09-30T14:58:00.077444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0] Write session: Do CDS request
2025-09-30T14:58:00.077452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:00.084833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:00.084940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:00.084954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2751
2025-09-30T14:58:00.085198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2751 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:00.085232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2751 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:00.085237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2751 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:00.085241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:00.085728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2751 sessionId:  describe result for acl check
2025-09-30T14:58:00.085764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:00.085767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:00.085768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:00.085774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896650292411253:5936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:00.086325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896650292411253:5936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:00.089086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:00.089123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896650292411253:5936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:00.093033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:00.093271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:00.093288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:00.093304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:00.093373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:00.093371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896650292411253:5936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:00.093388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896650292411253:5936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:00.093391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896650292411253:5936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:00.093401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2751 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:00.093420Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896650202617862:8823]
2025-09-30T14:58:00.094102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:00.094454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:00.094505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:00.094841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:00.094924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.094931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.094933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.094935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.094936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.094937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.094939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.094940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.094941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.094943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.094944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.094945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.094947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.094948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.094949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.094955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.094966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.094970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.094975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.094980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.094984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.094989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.094993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.094998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.095002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.095006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.095013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.095017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.095021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.095025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.095035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.095043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.095049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.095055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.095060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.095066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.095074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.095079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.095089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.095095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.095104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.095109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.095119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.095125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.095134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.095140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.095149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.095155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.095164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.095170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.095179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.095185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.095194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.095199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.095209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.095214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.095223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.095230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.095239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.095268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.095323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:00.100879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:00.102172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:00.102191Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:00.102195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:00.102199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:00.102206Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2750 [2:7555896650202617862:8823]
2025-09-30T14:58:00.102224Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:00.102242Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:00.102251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:00.102254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:00.102257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:00.102273Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:00.102280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:00.102294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:00.102362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.102370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.102373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.102377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:00.102380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:00.102458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:00.102467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.102481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.102500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.102525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:00.102549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411228:2454], now have 1 active actors on pipe
2025-09-30T14:58:00.102558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411315:5936], now have 1 active actors on pipe
2025-09-30T14:58:00.102564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896650202617856:8823]
2025-09-30T14:58:00.102571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896650202617856:8823]
2025-09-30T14:58:00.102573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896650202617856:8823]
2025-09-30T14:58:00.102585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:00.102599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:00.102603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:00.102608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:00.102611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:00.102617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:00.102620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:00.102607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2750
2025-09-30T14:58:00.102653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896650202617856:8823]
2025-09-30T14:58:00.102613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2750
2025-09-30T14:58:00.102666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:00.102683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:00.102718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.102727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.102753Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:00.102766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:00.102774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:00.102776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:00.102786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:00.102795Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:00.102813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:00.102998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.103006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.103020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:00.103117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2751 partition: 0 MaxSeqNo: 42 sessionId: src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0
2025-09-30T14:58:00.103511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2184553-5eb2fbf6-d10bd54e-705f5d08_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:00.106403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0] Write session: try to update token
2025-09-30T14:58:00.106424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:00.114605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:00.114632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:00.114642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896650202617856:8823]
2025-09-30T14:58:00.114694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:00.114775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:00.114911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:00.115061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:00.115208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:00.115374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:00.115581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:00.115630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:00.122020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2751 sessionId: src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:00.125051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:00.125798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.125824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.125843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:00.125847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:00.125850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:00.125852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:00.125861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896650202617856:8823]
2025-09-30T14:58:00.125865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896650202617856:8823]
2025-09-30T14:58:00.125868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896650202617856:8823]
2025-09-30T14:58:00.125906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:00.125912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:00.125915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:00.125916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:00.125923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.125926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:00.126069Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:00.177350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896650292411327:12049]
2025-09-30T14:58:00.177654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2750, pipe: [1:7555896650292411327:12049]
2025-09-30T14:58:00.241317Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:00.241980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:00.242020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411327:12049], now have 1 active actors on pipe
2025-09-30T14:58:00.242600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:00.242156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:00.242611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0] Write session will restart in 0.005893s
2025-09-30T14:58:00.242241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:00.242244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:00.242317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2751 reason: error at write: Disconnected sessionId: src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0
2025-09-30T14:58:00.242450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2751 sessionId: src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0 is DEAD
2025-09-30T14:58:00.242535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:00.242581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896650292411327:12049]
2025-09-30T14:58:00.242647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0] Write session: Do CDS request
2025-09-30T14:58:00.242666Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:00.249843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:00.249959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:00.249985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2752
2025-09-30T14:58:00.250093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2752 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:00.250128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2752 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:00.250141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2752 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:00.250146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:00.250573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2752 sessionId:  describe result for acl check
2025-09-30T14:58:00.250613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:00.250622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:00.250624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:00.250630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896650292411342:5951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:00.251181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896650292411342:5951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:00.253444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896650292411342:5951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:00.256494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896650292411342:5951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:00.256516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896650292411342:5951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:00.256520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896650292411342:5951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:00.256529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2752 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:00.257492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:00.261022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:00.261286Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:00.261297Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:00.261311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:00.261382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:00.261430Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896650202617967:8816]
2025-09-30T14:58:00.262118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:00.262482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:00.262537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:00.262889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:00.262967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.262975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.262980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.262982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.262983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.262984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.262986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.262987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.262989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.262990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.262991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.262992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.262993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.262994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.262995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.263001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.263011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.263015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.263019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.263023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.263027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.263031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.263035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.263039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.263043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.263047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.263051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.263054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.263057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.263060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.263069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.263076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.263083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.263090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.263094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.263100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.263104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.263109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.263114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.263121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.263126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.263130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.263135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.263140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.263144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.263148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.263153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.263159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.263163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.263168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.263173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.263178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.263183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.263188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.263193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.263197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.263199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.263203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.263207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.263212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.263282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:00.271973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:00.272952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:00.272958Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:00.272961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:00.272965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:00.272976Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2751 [2:7555896650202617967:8816]
2025-09-30T14:58:00.272993Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:00.273009Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:00.273012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:00.273015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:00.273017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:00.273034Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:00.273040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:00.273047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:00.273108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.273111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.273113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.273116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:00.273118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:00.273189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:00.273191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.273207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.273217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.273232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:00.273247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896650202617962:8816]
2025-09-30T14:58:00.273249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896650202617962:8816]
2025-09-30T14:58:00.273251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896650202617962:8816]
2025-09-30T14:58:00.273261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:00.273269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:00.273274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:00.273276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:00.273277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411331:2454], now have 1 active actors on pipe
2025-09-30T14:58:00.273280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411417:5951], now have 1 active actors on pipe
2025-09-30T14:58:00.273287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:00.273299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:00.273302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:00.273351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896650202617962:8816]
2025-09-30T14:58:00.273359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:00.273390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:00.273798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2751
2025-09-30T14:58:00.273836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2751
2025-09-30T14:58:00.276120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.276139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.276171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:00.276182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:00.276186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:00.276189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:00.276202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:00.276217Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:00.276234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:00.276622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.276629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.276645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:00.276768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2752 partition: 0 MaxSeqNo: 42 sessionId: src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0
2025-09-30T14:58:00.279538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1ee3988-1e458a44-f74b8a0c-5c329ca1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:00.282664Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0] Write session: try to update token
2025-09-30T14:58:00.282695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:00.286768Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:00.286786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:00.286788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:00.286789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:00.286797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896650202617962:8816]
2025-09-30T14:58:00.286801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896650202617962:8816]
2025-09-30T14:58:00.286805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896650202617962:8816]
2025-09-30T14:58:00.286838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:00.286848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.286850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:00.286980Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:00.287325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:00.287332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:00.287337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:00.308160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2752 sessionId: src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:00.310987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:00.342228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896650292411437:12049]
2025-09-30T14:58:00.342762Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2751, pipe: [1:7555896650292411437:12049]
2025-09-30T14:58:00.402161Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:00.402554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.402573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.402598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411437:12049], now have 1 active actors on pipe
2025-09-30T14:58:00.403570Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:00.403661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:00.403676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:00.403746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2752 reason: error at write: Disconnected sessionId: src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0
2025-09-30T14:58:00.403922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2752 sessionId: src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0 is DEAD
2025-09-30T14:58:00.404068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896650292411437:12049]
2025-09-30T14:58:00.404096Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:00.407430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:00.407447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0] Write session will restart in 0.009001s
2025-09-30T14:58:00.407475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0] Write session: Do CDS request
2025-09-30T14:58:00.407485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:00.422012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:00.423682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:00.423850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:00.423867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2753
2025-09-30T14:58:00.424209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2753 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:00.424253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2753 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:00.424265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2753 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:00.424269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:00.424795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2753 sessionId:  describe result for acl check
2025-09-30T14:58:00.424832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:00.424835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:00.424837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:00.424844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896650292411506:5969] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:00.425416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896650292411506:5969] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:00.426053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:00.426306Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:00.426319Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:00.426331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:00.426392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:00.426442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896650202618059:8814]
2025-09-30T14:58:00.427131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:00.427631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:00.427689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:00.428082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:00.428149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.428151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.428153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.428154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.428156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.428158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.428159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.428161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.428163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.428164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.428166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.428167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.428169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.428170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.428172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.428178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.428190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.428195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.428200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.428205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.428210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.428215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.428221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.428225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.428230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.428234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.428239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.428243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.428248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.428252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.428261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.428269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.428277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.428283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.428289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.428295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.428301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.428307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.428313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.428319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.428324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.428330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.428336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.428342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.428347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.428353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.428358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.428364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.428371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.428377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.428382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.428387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.428392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.428401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.428407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.428412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.428417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.428423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.428428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.428434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.428481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:00.430327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896650292411506:5969] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:00.434607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896650292411506:5969] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:00.434623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896650292411506:5969] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:00.434640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896650292411506:5969] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:00.434656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2753 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:00.435587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:00.436860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:00.436867Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:00.436870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:00.436875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:00.436883Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2752 [2:7555896650202618059:8814]
2025-09-30T14:58:00.436900Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:00.436934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:00.436937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:00.436942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:00.436944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:00.436963Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:00.436970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:00.436978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:00.437047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.437052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.437055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.437059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:00.437062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:00.437139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:00.437142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.437157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.437170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.437189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:00.437207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896650202618054:8814]
2025-09-30T14:58:00.437209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896650202618054:8814]
2025-09-30T14:58:00.437211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896650202618054:8814]
2025-09-30T14:58:00.437221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:00.437236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:00.437242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:00.437247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:00.437249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:00.437252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:00.437255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:00.437266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411545:5969], now have 1 active actors on pipe
2025-09-30T14:58:00.437271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411439:2454], now have 1 active actors on pipe
2025-09-30T14:58:00.437305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896650202618054:8814]
2025-09-30T14:58:00.437314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:00.437329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:00.437719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2752
2025-09-30T14:58:00.437759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2752
2025-09-30T14:58:00.438028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.438050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.438076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:00.438084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:00.438088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:00.438091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:00.438102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:00.438114Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:00.438130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:00.438397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.438405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.438422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:00.438664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2753 partition: 0 MaxSeqNo: 42 sessionId: src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0
2025-09-30T14:58:00.439414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7de4aed3-1ec7930a-2cef461d-c98b5570_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:00.442378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0] Write session: try to update token
2025-09-30T14:58:00.442402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:00.456287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:00.456310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:00.456313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:00.456316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:00.456325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896650202618054:8814]
2025-09-30T14:58:00.456331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896650202618054:8814]
2025-09-30T14:58:00.456336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896650202618054:8814]
2025-09-30T14:58:00.456377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:00.456381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:00.456385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.456387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:00.456389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:00.456391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:00.456539Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:00.467046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2753 sessionId: src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:00.470218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:00.504137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896650292411552:12049]
2025-09-30T14:58:00.504472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2752, pipe: [1:7555896650292411552:12049]
2025-09-30T14:58:00.568737Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:00.569368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.569387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.569407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411552:12049], now have 1 active actors on pipe
2025-09-30T14:58:00.569641Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:00.569857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:00.569942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2753 reason: status is not ok: tablet will be restarted right now sessionId: src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0
2025-09-30T14:58:00.570124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2753 sessionId: src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0 is DEAD
2025-09-30T14:58:00.570270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:00.570317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896650292411552:12049]
2025-09-30T14:58:00.571356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:00.571371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0] Write session will restart in 0.005942s
2025-09-30T14:58:00.571394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0] Write session: Do CDS request
2025-09-30T14:58:00.571401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:00.579258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:00.579618Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:00.579632Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2754
2025-09-30T14:58:00.579749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2754 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:00.579782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2754 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:00.579792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2754 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:00.579796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:00.580456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2754 sessionId:  describe result for acl check
2025-09-30T14:58:00.580505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:00.580512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:00.580514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:00.580521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896650292411596:5975] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:00.581057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896650292411596:5975] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:00.583816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896650292411596:5975] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:00.585092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:00.589853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:00.590326Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:00.590343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:00.590356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:00.590427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:00.590473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896650202618155:8807]
2025-09-30T14:58:00.591110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:00.591473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:00.591525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:00.591855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:00.591926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.591934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.591935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.591936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.591937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.591939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.591940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.591941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.591943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.591944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.591945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.591946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.591947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.591948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.591949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.591955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.591966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.591971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.591976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.591980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.591984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.591988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.591992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.591995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.591999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.592003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.592007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.592011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.592015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.592021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.592029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.592037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.592042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.592048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.592052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.592057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.592061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.592066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.592071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.592077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.592081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.592086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.592091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.592097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.592102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.592108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.592113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.592118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.592123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.592129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.592134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.592139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.592143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.592149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.592153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.592159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.592163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.592169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.592174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.592180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.591787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896650292411596:5975] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:00.591804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896650292411596:5975] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:00.592227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:00.591807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896650292411596:5975] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:00.591821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2754 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:00.597963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:00.599333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:00.599354Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:00.599358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:00.599362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:00.599371Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2753 [2:7555896650202618155:8807]
2025-09-30T14:58:00.599392Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:00.599414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:00.599426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:00.599429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:00.599432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:00.599452Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:00.599460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:00.599469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:00.599560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.599575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.599578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.599582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:00.599585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:00.599686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:00.599697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.599713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.599733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.599755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:00.599785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896650202618149:8807]
2025-09-30T14:58:00.599793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896650202618149:8807]
2025-09-30T14:58:00.599795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896650202618149:8807]
2025-09-30T14:58:00.600242Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2753
2025-09-30T14:58:00.600243Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2753
2025-09-30T14:58:00.599812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:00.599833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:00.599835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:00.599837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:00.599839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:00.599851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:00.599854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:00.599906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896650202618149:8807]
2025-09-30T14:58:00.599909Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:00.599945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:00.600032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411645:5975], now have 1 active actors on pipe
2025-09-30T14:58:00.600040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411554:2454], now have 1 active actors on pipe
2025-09-30T14:58:00.600410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.600418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.600448Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c73184c9-44d72c53-a873661a-512961b3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:00.600474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:00.600478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:00.600481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:00.600494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:00.600508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:00.600540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:00.600733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.600741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.600759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:00.600900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2754 partition: 0 MaxSeqNo: 42 sessionId: src_id|c73184c9-44d72c53-a873661a-512961b3_0
2025-09-30T14:58:00.601307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|260e0a2e-abb8dfdc-c06f851a-8d191d6b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c73184c9-44d72c53-a873661a-512961b3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:00.604727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c73184c9-44d72c53-a873661a-512961b3_0] Write session: try to update token
2025-09-30T14:58:00.604749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c73184c9-44d72c53-a873661a-512961b3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:00.623167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2754 sessionId: src_id|c73184c9-44d72c53-a873661a-512961b3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:00.616802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:00.616823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:00.616834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896650202618149:8807]
2025-09-30T14:58:00.616880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:00.617103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:00.617256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:00.617402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:00.617458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:00.617552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:00.617773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:00.617815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:00.626286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:00.626768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:00.626571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.626598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.626647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:00.629814Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:00.629833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:00.629835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:00.629837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:00.629848Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896650202618149:8807]
2025-09-30T14:58:00.629852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896650202618149:8807]
2025-09-30T14:58:00.629857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896650202618149:8807]
2025-09-30T14:58:00.629900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:00.629908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.629909Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:00.629911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:00.629916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:00.629931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:00.630055Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:00.670421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896650292411655:12049]
2025-09-30T14:58:00.670829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2753, pipe: [1:7555896650292411655:12049]
2025-09-30T14:58:00.754449Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:00.763828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.763856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.764046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:00.764115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:00.764179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:00.764242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:00.764291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:00.764295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:00.764372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:00.764437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:00.764506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:00.764574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:00.764617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:00.764621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:00.764692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:00.764758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:00.764824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:00.764891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:00.764951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:00.764954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:00.765031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:00.765094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:00.765158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:00.765223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:00.765267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:00.765270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:00.765345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:00.765408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:00.765474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:00.765543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:00.765588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:00.765591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:00.765671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:00.765735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:00.765805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:00.765875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:00.765920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:00.765922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:00.766000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:00.766064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:00.766134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:00.766202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:00.766391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:00.766394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:00.766467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:00.766525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:00.766589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:00.766654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:00.766699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:00.766702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:00.766773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:00.766838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:00.766911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:00.766983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:00.767032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:00.767035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:00.767115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:00.767177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:00.767303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:00.767375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:00.767422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:00.767425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:00.767534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411655:12049], now have 1 active actors on pipe
2025-09-30T14:58:00.767966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896650292411655:12049]
2025-09-30T14:58:00.768006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:00.768009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:00.768040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2754 reason: error at write: Disconnected sessionId: src_id|c73184c9-44d72c53-a873661a-512961b3_0
2025-09-30T14:58:00.768226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:00.768265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2754 sessionId: src_id|c73184c9-44d72c53-a873661a-512961b3_0 is DEAD
2025-09-30T14:58:00.769103Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:00.770637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73184c9-44d72c53-a873661a-512961b3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:00.770648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73184c9-44d72c53-a873661a-512961b3_0] Write session will restart in 0.008895s
2025-09-30T14:58:00.770673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73184c9-44d72c53-a873661a-512961b3_0] Write session: Do CDS request
2025-09-30T14:58:00.770680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73184c9-44d72c53-a873661a-512961b3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:00.781656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c73184c9-44d72c53-a873661a-512961b3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:00.781926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:00.781942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2755
2025-09-30T14:58:00.782082Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2755 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:00.782115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2755 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:00.782121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2755 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:00.782127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:00.782645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2755 sessionId:  describe result for acl check
2025-09-30T14:58:00.782692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:00.782700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:00.782702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:00.782708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896650292411715:5983] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:00.783283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896650292411715:5983] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:00.783927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:00.786847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896650292411715:5983] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:00.791553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:00.791827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:00.791842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:00.791856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:00.791928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:00.791976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896650202618251:8811]
2025-09-30T14:58:00.792693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:00.793569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:00.793648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:00.794044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:00.794133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.794140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.794141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.794142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.794144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.794145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.794146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.794148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.794149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.794150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.794152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.794154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.794155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.794156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.794158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.794165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.794176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.794181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.794185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.794189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.794194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.794199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.794203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.794210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.794215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.794219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.794192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896650292411715:5983] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:00.794223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.794211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896650292411715:5983] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:00.794215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896650292411715:5983] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:00.794227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.794235Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2755 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:00.794231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.794234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.794244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.794252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.794259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.794264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.794269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.794275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.794279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.794284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.794290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.794294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.794299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.794304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.794309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.794313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.794318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.794323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.794327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.794332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.794336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.794343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.794348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.794353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.794357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.794361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.794367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.794372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.794376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.794381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.794394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.794399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.794447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:00.805295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:00.806260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:00.806280Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:00.806284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:00.806288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:00.806310Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2754 [2:7555896650202618251:8811]
2025-09-30T14:58:00.806329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:00.806350Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:00.806358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:00.806361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:00.806363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:00.806382Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:00.806394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:00.806401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:00.806477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.806489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.806492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.806496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:00.806500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:00.806578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:00.806586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.806601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.806620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.806641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:00.806665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411753:5983], now have 1 active actors on pipe
2025-09-30T14:58:00.806674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411660:2454], now have 1 active actors on pipe
2025-09-30T14:58:00.806680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896650202618246:8811]
2025-09-30T14:58:00.806683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896650202618246:8811]
2025-09-30T14:58:00.806685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896650202618246:8811]
2025-09-30T14:58:00.806698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:00.806718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:00.806738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:00.806745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:00.806784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896650202618246:8811]
2025-09-30T14:58:00.806791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:00.806790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:00.806794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:00.806800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:00.806807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:00.806953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.806964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.806993Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:00.807005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:00.807010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:00.807013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:00.807023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:00.807038Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:00.807065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:00.806797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2754
2025-09-30T14:58:00.806798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2754
2025-09-30T14:58:00.807315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.807333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.807358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:00.807512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2755 partition: 0 MaxSeqNo: 42 sessionId: src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0
2025-09-30T14:58:00.807898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c73184c9-44d72c53-a873661a-512961b3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:00.811100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0] Write session: try to update token
2025-09-30T14:58:00.811125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:00.820034Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:00.820056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:00.820069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896650202618246:8811]
2025-09-30T14:58:00.820116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:00.820116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:00.820303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:00.820456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:00.820594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:00.820751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:00.820978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:00.821028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:00.831361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:00.831382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:00.831385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:00.831387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:00.831399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896650202618246:8811]
2025-09-30T14:58:00.831404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896650202618246:8811]
2025-09-30T14:58:00.831408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896650202618246:8811]
2025-09-30T14:58:00.831452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:00.831461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.831464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:00.831464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:00.831471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:00.831476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:00.831627Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:00.832409Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2755 sessionId: src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:00.835542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:00.868042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896650292411764:12049]
2025-09-30T14:58:00.868471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2754, pipe: [1:7555896650292411764:12049]
2025-09-30T14:58:00.949574Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:00.950098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.950116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.950138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411764:12049], now have 1 active actors on pipe
2025-09-30T14:58:00.950602Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:00.950541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:00.950558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:00.950630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2755 reason: error at write: Disconnected sessionId: src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0
2025-09-30T14:58:00.950790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896650292411764:12049]
2025-09-30T14:58:00.950809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:00.950840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2755 sessionId: src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0 is DEAD
2025-09-30T14:58:00.951428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:00.951440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0] Write session will restart in 0.005437s
2025-09-30T14:58:00.951464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0] Write session: Do CDS request
2025-09-30T14:58:00.951475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:00.957794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:00.957933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:00.957949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2756
2025-09-30T14:58:00.958075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2756 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:00.958121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2756 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:00.958132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2756 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:00.958138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:00.958648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2756 sessionId:  describe result for acl check
2025-09-30T14:58:00.958687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:00.958694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:00.958697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:00.958704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896650292411775:5992] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:00.959297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896650292411775:5992] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:00.965463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896650292411775:5992] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:00.968368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896650292411775:5992] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:00.968384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896650292411775:5992] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:00.968388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896650292411775:5992] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:00.968397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2756 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:00.973223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:00.973928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:00.974139Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:00.974149Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:00.974160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:00.974212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:00.974255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896650202618349:8809]
2025-09-30T14:58:00.974963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:00.978208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:00.978284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:00.978711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:00.978808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.978814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.978816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.978817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.978818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.978820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.978821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.978823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.978824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.978826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.978827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.978829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.978830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.978832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.978833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.978841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.978852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.978857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.978861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.978866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.978870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.978874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.978878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.978883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.978887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.978891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.978895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.978899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.978904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.978908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.978923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.978931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:00.978936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.978941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:00.978945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.978950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:00.978954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.978959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:00.978964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.978969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:00.978972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.978978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:00.978982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.978988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:00.978993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.978998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:00.979003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.979009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:00.979013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.979017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:00.979021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.979026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.979030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.979036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.979041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.979047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.979051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.979058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:00.979065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.979077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:00.979125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:00.985472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:00.986502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:00.986525Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:00.986528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:00.986534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:00.986542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2755 [2:7555896650202618349:8809]
2025-09-30T14:58:00.986561Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:00.986580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:00.986584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:00.986588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:00.986591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:00.986610Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:00.986627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:00.986635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:00.986717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.986727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.986730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.986734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:00.986737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:00.986819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:00.986828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:00.986842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:00.986853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:00.986875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:00.986899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896650202618344:8809]
2025-09-30T14:58:00.986902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896650202618344:8809]
2025-09-30T14:58:00.986908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896650202618344:8809]
2025-09-30T14:58:00.986923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:00.986939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411815:5992], now have 1 active actors on pipe
2025-09-30T14:58:00.986939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:00.986943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:00.986945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:00.986947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896650292411766:2454], now have 1 active actors on pipe
2025-09-30T14:58:00.986953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:00.986968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:00.986972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:00.987011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896650202618344:8809]
2025-09-30T14:58:00.987020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:00.987038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:00.987067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2755
2025-09-30T14:58:00.987132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2755
2025-09-30T14:58:00.987330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.987348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.987380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:00.987396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:00.987406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:00.987409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:00.987421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:00.987441Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:00.987461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:00.987864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:00.987882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:00.987908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:00.988143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2756 partition: 0 MaxSeqNo: 42 sessionId: src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0
2025-09-30T14:58:00.988564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3816fdd3-b10e3eb2-afcdcfc8-c0a6495_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:00.992070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0] Write session: try to update token
2025-09-30T14:58:00.992098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:01.004191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:01.004214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:01.004218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:01.004220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:01.004228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896650202618344:8809]
2025-09-30T14:58:01.004233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896650202618344:8809]
2025-09-30T14:58:01.004238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896650202618344:8809]
2025-09-30T14:58:01.004298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:01.004301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:01.004309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:01.004313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:01.004315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.004318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:01.004494Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:01.017994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2756 sessionId: src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:01.021361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:01.051317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896654587379182:12049]
2025-09-30T14:58:01.052960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2755, pipe: [1:7555896654587379182:12049]
2025-09-30T14:58:01.124351Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:01.125258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.125277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.125320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379182:12049], now have 1 active actors on pipe
2025-09-30T14:58:01.125574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:01.125571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:01.125596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:01.125602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:01.125666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896654587379182:12049]
2025-09-30T14:58:01.125676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2756 reason: error at write: Disconnected sessionId: src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0
2025-09-30T14:58:01.125878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2756 sessionId: src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0 is DEAD
2025-09-30T14:58:01.127516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:01.127530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0] Write session will restart in 0.005230s
2025-09-30T14:58:01.127567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0] Write session: Do CDS request
2025-09-30T14:58:01.127578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:01.133757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:01.134155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:01.134172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2757
2025-09-30T14:58:01.134334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2757 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:01.134393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2757 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:01.134403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2757 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:01.134409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:01.134995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2757 sessionId:  describe result for acl check
2025-09-30T14:58:01.135033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:01.135035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:01.135037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:01.135044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896654587379224:6020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:01.135827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896654587379224:6020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:01.137880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896654587379224:6020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:01.139061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:01.142895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:01.143189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:01.143202Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:01.143215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:01.143297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:01.143346Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896654497585779:8783]
2025-09-30T14:58:01.144043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:01.144120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896654587379224:6020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:01.144138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896654587379224:6020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:01.144143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896654587379224:6020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:01.144153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2757 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:01.144600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:01.144661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:01.145044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:01.145134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.145141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.145143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.145144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.145147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.145148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.145150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.145151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.145153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.145155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.145156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.145158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.145159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.145161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.145162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.145169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.145181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.145184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.145188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.145191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.145195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.145199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.145203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.145207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.145211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.145216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.145219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.145223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.145227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.145230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.145240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.145248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.145256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.145261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.145267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.145273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.145279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.145284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.145290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.145296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.145300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.145305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.145310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.145317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.145322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.145328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.145333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.145339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.145343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.145349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.145354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.145359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.145364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.145370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.145376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.145382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.145388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.145401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.145407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.145413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.145460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:01.151380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:01.152362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:01.152387Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:01.152391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:01.152395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:01.152402Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2756 [2:7555896654497585779:8783]
2025-09-30T14:58:01.152421Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:01.152440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:01.152449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:01.152453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:01.152456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:01.152479Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:01.152494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:01.152502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:01.152569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.152578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.152580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.152584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:01.152587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:01.152667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:01.152680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.152693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.152703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.152720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:01.152740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379196:2454], now have 1 active actors on pipe
2025-09-30T14:58:01.152743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379288:6020], now have 1 active actors on pipe
2025-09-30T14:58:01.152750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896654497585774:8783]
2025-09-30T14:58:01.152752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896654497585774:8783]
2025-09-30T14:58:01.152755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896654497585774:8783]
2025-09-30T14:58:01.152771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:01.152785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:01.152789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:01.152793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:01.152795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:01.152804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:01.152807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:01.152847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896654497585774:8783]
2025-09-30T14:58:01.152859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:01.152870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:01.153043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2756
2025-09-30T14:58:01.153092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2756
2025-09-30T14:58:01.153142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.153158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.153187Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:01.153195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:01.153200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:01.153202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:01.153213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:01.153226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:01.153244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:01.153410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.153419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.153433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:01.153549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2757 partition: 0 MaxSeqNo: 42 sessionId: src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0
2025-09-30T14:58:01.153979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e4ff1ba-db3b9914-a9f4b270-37a793b5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:01.157143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0] Write session: try to update token
2025-09-30T14:58:01.157163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:01.166854Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:01.166878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:01.166889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896654497585774:8783]
2025-09-30T14:58:01.166941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:01.167135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:01.167313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:01.167374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:01.167463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:01.167612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:01.167811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:01.167848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:01.179292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:01.179312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:01.179315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:01.179317Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:01.179326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896654497585774:8783]
2025-09-30T14:58:01.179331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896654497585774:8783]
2025-09-30T14:58:01.179335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896654497585774:8783]
2025-09-30T14:58:01.179374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:01.179381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.179384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:01.179394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:01.179402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:01.179406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:01.179531Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:01.180167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2757 sessionId: src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:01.183424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:01.225916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896654587379299:12049]
2025-09-30T14:58:01.226255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2756, pipe: [1:7555896654587379299:12049]
2025-09-30T14:58:01.297913Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:01.298410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.298431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.298455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379299:12049], now have 1 active actors on pipe
2025-09-30T14:58:01.298710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:01.298828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:01.298837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896654587379299:12049]
2025-09-30T14:58:01.298842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:01.298856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:01.298912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2757 reason: error at write: Disconnected sessionId: src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0
2025-09-30T14:58:01.299300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:01.299313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0] Write session will restart in 0.007056s
2025-09-30T14:58:01.299338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0] Write session: Do CDS request
2025-09-30T14:58:01.299344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:01.299102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2757 sessionId: src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0 is DEAD
2025-09-30T14:58:01.307795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:01.307886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:01.307909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2758
2025-09-30T14:58:01.308050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2758 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:01.308103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2758 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:01.308115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2758 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:01.308121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:01.308596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2758 sessionId:  describe result for acl check
2025-09-30T14:58:01.308635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:01.308641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:01.308644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:01.308650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896654587379317:6011] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:01.309205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896654587379317:6011] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:01.311403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896654587379317:6011] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:01.314293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896654587379317:6011] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:01.314321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896654587379317:6011] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:01.314326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896654587379317:6011] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:01.314335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2758 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:01.319922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:01.324609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:01.324896Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:01.324909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:01.324946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:01.325018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:01.325070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896654497585890:8785]
2025-09-30T14:58:01.325791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:01.326328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:01.326410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:01.326856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:01.326930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.326937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.326938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.326939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.326941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.326943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.326945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.326946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.326948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.326949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.326950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.326953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.326954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.326955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.326957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.326963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.326976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.326980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.326985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.326990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.326996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.327000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.327005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.327013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.327018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.327022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.327027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.327031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.327036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.327040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.327049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.327058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.327064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.327070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.327076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.327101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.327108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.327114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.327120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.327127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.327132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.327138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.327150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.327156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.327166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.327171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.327183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.327189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.327194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.327200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.327205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.327212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.327219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.327224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.327230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.327236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.327262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.327268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.327274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.327282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.327332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:01.349578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:01.350561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:01.350582Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:01.350586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:01.350590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:01.350597Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2757 [2:7555896654497585890:8785]
2025-09-30T14:58:01.350616Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:01.350637Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:01.350645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:01.350649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:01.350652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:01.350669Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:01.350683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:01.350695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:01.350766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.350775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.350781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.350785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:01.350787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:01.350863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:01.350873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.350885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.350897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.350918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:01.350941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896654497585885:8785]
2025-09-30T14:58:01.350948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896654497585885:8785]
2025-09-30T14:58:01.350951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896654497585885:8785]
2025-09-30T14:58:01.350959Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:01.350976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:01.350981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:01.350984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:01.350986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:01.350999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:01.351003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:01.351013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379399:6011], now have 1 active actors on pipe
2025-09-30T14:58:01.351056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379306:2454], now have 1 active actors on pipe
2025-09-30T14:58:01.351063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896654497585885:8785]
2025-09-30T14:58:01.351069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:01.351299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:01.351479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2757
2025-09-30T14:58:01.351622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2757
2025-09-30T14:58:01.351694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.351706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.351744Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:01.351758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:01.351762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:01.351765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:01.351776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:01.351788Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:01.351807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:01.353422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.353437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.353464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:01.353575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2758 partition: 0 MaxSeqNo: 42 sessionId: src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0
2025-09-30T14:58:01.353965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4b65b7b-4ce6e4ad-a9025b64-b53b5a64_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:01.356820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0] Write session: try to update token
2025-09-30T14:58:01.356839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:01.368828Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:01.368856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:01.368858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:01.368864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:01.368876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896654497585885:8785]
2025-09-30T14:58:01.368881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896654497585885:8785]
2025-09-30T14:58:01.368885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896654497585885:8785]
2025-09-30T14:58:01.368948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:01.368956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.368959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:01.368963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:01.368970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:01.368976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:01.369114Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:01.383422Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2758 sessionId: src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:01.386509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:01.398967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896654587379418:12049]
2025-09-30T14:58:01.399326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2757, pipe: [1:7555896654587379418:12049]
2025-09-30T14:58:01.516667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:01.517077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.517088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.517109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379418:12049], now have 1 active actors on pipe
2025-09-30T14:58:01.518471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896654587379418:12049]
2025-09-30T14:58:01.518509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:01.518512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:01.518573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2758 reason: error at write: Disconnected sessionId: src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0
2025-09-30T14:58:01.517696Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:01.518759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2758 sessionId: src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0 is DEAD
2025-09-30T14:58:01.518930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:01.519497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:01.519506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0] Write session will restart in 0.007777s
2025-09-30T14:58:01.519525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0] Write session: Do CDS request
2025-09-30T14:58:01.519534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:01.528823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:01.531875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:01.531894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2759
2025-09-30T14:58:01.532151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2759 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:01.532211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2759 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:01.532223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2759 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:01.532227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:01.532696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2759 sessionId:  describe result for acl check
2025-09-30T14:58:01.532736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:01.532743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:01.532745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:01.532752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896654587379494:6029] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:01.533349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896654587379494:6029] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:01.535800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896654587379494:6029] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:01.537225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:01.543026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:01.543284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:01.543288Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:01.543301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:01.543365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:01.543404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896654497585989:8776]
2025-09-30T14:58:01.544107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:01.545089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896654587379494:6029] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:01.545108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896654587379494:6029] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:01.545112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896654587379494:6029] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:01.545122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2759 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:01.544607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:01.544654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:01.545014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:01.545079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.545080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.545081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.545083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.545085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.545087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.545088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.545090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.545092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.545093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.545095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.545096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.545098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.545099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.545101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.545108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.545120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.545125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.545130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.545135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.545140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.545144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.545149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.545153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.545160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.545164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.545172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.545177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.545180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.545185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.545192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.545202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.545210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.545216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.545222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.545228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.545234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.545239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.545245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.545252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.545259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.545264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.545269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.545276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.545281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.545287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.545292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.545298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.545303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.545309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.545314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.545320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.545325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.545330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.545335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.545341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.545346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.545355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.545361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.545367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.545421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:01.558529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:01.559876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:01.559883Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:01.559886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:01.559890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:01.559899Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2758 [2:7555896654497585989:8776]
2025-09-30T14:58:01.559919Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:01.559937Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:01.559940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:01.559944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:01.559946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:01.559965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:01.559974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:01.559983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:01.560050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.560052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.560056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.560059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:01.560065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:01.560150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:01.560153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.560171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.560185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.560205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:01.560221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896654497585983:8776]
2025-09-30T14:58:01.560224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896654497585983:8776]
2025-09-30T14:58:01.560226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896654497585983:8776]
2025-09-30T14:58:01.560242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:01.560257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:01.560273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:01.560276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:01.560317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896654497585983:8776]
2025-09-30T14:58:01.560319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:01.560754Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2758
2025-09-30T14:58:01.560819Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2758
2025-09-30T14:58:01.560620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:01.560629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:01.560631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:01.560637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:01.560876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379433:2454], now have 1 active actors on pipe
2025-09-30T14:58:01.560881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379530:6029], now have 1 active actors on pipe
2025-09-30T14:58:01.561103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.561113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.561141Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4632f65d-7c72815e-a84b696-c06830f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:01.561150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:01.561154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:01.561157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:01.561169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:01.561181Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:01.561199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:01.561467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.561474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.561487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:01.561633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2759 partition: 0 MaxSeqNo: 42 sessionId: src_id|4632f65d-7c72815e-a84b696-c06830f2_0
2025-09-30T14:58:01.563519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e0a78419-8fecb608-9ae57419-2b590cfc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4632f65d-7c72815e-a84b696-c06830f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:01.566597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4632f65d-7c72815e-a84b696-c06830f2_0] Write session: try to update token
2025-09-30T14:58:01.566622Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4632f65d-7c72815e-a84b696-c06830f2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:01.576194Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:01.576219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:01.576230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896654497585983:8776]
2025-09-30T14:58:01.576272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:01.576469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:01.576625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:01.576773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:01.576992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:01.577202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:01.577241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:01.577558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:01.588156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2759 sessionId: src_id|4632f65d-7c72815e-a84b696-c06830f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:01.591088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:01.592861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.592888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.592906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:01.592909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:01.592928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:01.592930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:01.592941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896654497585983:8776]
2025-09-30T14:58:01.592944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896654497585983:8776]
2025-09-30T14:58:01.592947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896654497585983:8776]
2025-09-30T14:58:01.592989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:01.592998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.592999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:01.593003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:01.593008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:01.593026Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:01.593129Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:01.618646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896654587379541:12049]
2025-09-30T14:58:01.618969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2758, pipe: [1:7555896654587379541:12049]
2025-09-30T14:58:01.708242Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:01.708575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:01.708616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379541:12049], now have 1 active actors on pipe
2025-09-30T14:58:01.709129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:01.709235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:01.709243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:01.709292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896654587379541:12049]
2025-09-30T14:58:01.709316Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:01.709318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2759 reason: error at write: Disconnected sessionId: src_id|4632f65d-7c72815e-a84b696-c06830f2_0
2025-09-30T14:58:01.709460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2759 sessionId: src_id|4632f65d-7c72815e-a84b696-c06830f2_0 is DEAD
2025-09-30T14:58:01.710962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4632f65d-7c72815e-a84b696-c06830f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:01.710974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4632f65d-7c72815e-a84b696-c06830f2_0] Write session will restart in 0.009336s
2025-09-30T14:58:01.710999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4632f65d-7c72815e-a84b696-c06830f2_0] Write session: Do CDS request
2025-09-30T14:58:01.711005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4632f65d-7c72815e-a84b696-c06830f2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:01.721881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4632f65d-7c72815e-a84b696-c06830f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:01.723701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:01.723720Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2760
2025-09-30T14:58:01.724643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:01.727402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2760 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:01.727478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2760 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:01.727489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2760 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:01.727495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:01.728052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2760 sessionId:  describe result for acl check
2025-09-30T14:58:01.728089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:01.728096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:01.728097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:01.728104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896654587379607:6038] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:01.728673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896654587379607:6038] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:01.728672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:01.728985Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:01.729002Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:01.729018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:01.729118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:01.729168Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896654497586091:8772]
2025-09-30T14:58:01.729787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:01.731027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:01.731091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:01.731444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:01.731522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.731530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.731531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.731532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.731533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.731535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.731536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.731538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.731539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.731541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.731542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.731544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.731545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.731546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.731547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.731552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.731561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.731565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.731569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.731572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.731576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.731579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.731582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.731586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.731590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.731593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.731597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.731600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.731603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.731607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.731615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.731622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.731628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.731633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.731638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.731642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.731646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.731651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.731655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.731659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.731664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.731668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.731674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.731678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.731682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.731686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.731690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.731694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.731698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.731702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.731706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.731711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.731715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.731719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.731723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.731729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.731732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.731736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.731740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.731744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.731784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:01.732869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896654587379607:6038] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:01.737922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896654587379607:6038] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:01.737941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896654587379607:6038] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:01.737945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896654587379607:6038] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:01.737956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2760 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:01.740628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:01.741629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:01.741647Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:01.741650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:01.741655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:01.741662Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2759 [2:7555896654497586091:8772]
2025-09-30T14:58:01.741681Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:01.741698Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:01.741707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:01.741710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:01.741713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:01.741733Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:01.741745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:01.741752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:01.741822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.741830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.741832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.741836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:01.741838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:01.741912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:01.741920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.741934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.741951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.741969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:01.741989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379544:2454], now have 1 active actors on pipe
2025-09-30T14:58:01.741999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379645:6038], now have 1 active actors on pipe
2025-09-30T14:58:01.742006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896654497586086:8772]
2025-09-30T14:58:01.742008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896654497586086:8772]
2025-09-30T14:58:01.742010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896654497586086:8772]
2025-09-30T14:58:01.742023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:01.742038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:01.742042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:01.742044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:01.742057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:01.742060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:01.742064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:01.742056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2759
2025-09-30T14:58:01.742096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896654497586086:8772]
2025-09-30T14:58:01.742104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:01.742075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2759
2025-09-30T14:58:01.742117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:01.742141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.742145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.742185Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:01.742198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:01.742201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:01.742203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:01.742214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:01.742224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:01.742241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:01.742612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.742626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.742650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:01.742750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2760 partition: 0 MaxSeqNo: 42 sessionId: src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0
2025-09-30T14:58:01.743125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4632f65d-7c72815e-a84b696-c06830f2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:01.746003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0] Write session: try to update token
2025-09-30T14:58:01.746024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:01.754566Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:01.754587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:01.754590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:01.754592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:01.754603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896654497586086:8772]
2025-09-30T14:58:01.754609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896654497586086:8772]
2025-09-30T14:58:01.754614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896654497586086:8772]
2025-09-30T14:58:01.754654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:01.754659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.754662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:01.754676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:01.754692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:01.754698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:01.754792Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:01.767114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2760 sessionId: src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:01.770138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:01.809825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896654587379654:12049]
2025-09-30T14:58:01.810227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2759, pipe: [1:7555896654587379654:12049]
2025-09-30T14:58:01.877238Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:01.877584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.877598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.877620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379654:12049], now have 1 active actors on pipe
2025-09-30T14:58:01.877894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:01.877891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896654587379654:12049]
2025-09-30T14:58:01.877898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:01.877932Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:01.877935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:01.878021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2760 reason: error at write: Disconnected sessionId: src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0
2025-09-30T14:58:01.878204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2760 sessionId: src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0 is DEAD
2025-09-30T14:58:01.878695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:01.878703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0] Write session will restart in 0.007133s
2025-09-30T14:58:01.878730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0] Write session: Do CDS request
2025-09-30T14:58:01.878736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:01.886774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:01.886911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:01.886941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2761
2025-09-30T14:58:01.887114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2761 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:01.887159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2761 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:01.887178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2761 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:01.887184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:01.887753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2761 sessionId:  describe result for acl check
2025-09-30T14:58:01.887796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:01.887798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:01.887801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:01.887808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896654587379682:6048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:01.888416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896654587379682:6048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:01.890886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896654587379682:6048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:01.891744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:01.896194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:01.896376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896654587379682:6048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:01.896405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896654587379682:6048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:01.896409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896654587379682:6048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:01.896417Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2761 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:01.896444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:01.896455Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:01.896466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:01.896525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:01.896581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896654497586193:8761]
2025-09-30T14:58:01.897279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:01.897632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:01.897685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:01.898058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:01.898123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.898132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.898134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.898135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.898136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.898138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.898139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.898141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.898143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.898145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.898146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.898147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.898149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.898150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.898152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.898158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.898170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.898174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.898180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.898185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.898190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.898194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.898199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.898204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.898209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.898213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.898218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.898222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.898226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.898231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.898241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.898249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:01.898256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.898262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:01.898268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.898275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:01.898281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.898287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:01.898294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.898300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:01.898305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.898310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:01.898316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.898322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:01.898328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.898334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:01.898339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.898351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:01.898356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.898362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:01.898372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.898378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.898387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.898394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.898403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.898408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.898413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.898423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:01.898428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.898458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:01.898523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:01.904806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:01.906302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:01.906325Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:01.906330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:01.906334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:01.906342Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2760 [2:7555896654497586193:8761]
2025-09-30T14:58:01.906361Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:01.906378Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:01.906383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:01.906386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:01.906388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:01.906410Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:01.906418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:01.906426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:01.906494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.906498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.906500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.906503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:01.906506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:01.906574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:01.906577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.906591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:01.906603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:01.906619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:01.906637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896654497586188:8761]
2025-09-30T14:58:01.906640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896654497586188:8761]
2025-09-30T14:58:01.906642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896654497586188:8761]
2025-09-30T14:58:01.906656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:01.906671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:01.906685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:01.906687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:01.906725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896654497586188:8761]
2025-09-30T14:58:01.906727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:01.907410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:01.907414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:01.907420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:01.907426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:01.907599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379658:2454], now have 1 active actors on pipe
2025-09-30T14:58:01.907615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379756:6048], now have 1 active actors on pipe
2025-09-30T14:58:01.907702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2760
2025-09-30T14:58:01.907729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2760
2025-09-30T14:58:01.907844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.907869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.907904Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:01.907915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:01.907920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:01.907922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:01.907935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:01.907948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:01.907976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:01.908276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:01.908285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:01.908302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:01.908456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2761 partition: 0 MaxSeqNo: 42 sessionId: src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0
2025-09-30T14:58:01.909029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a32b78d7-ca2b715f-9aea768f-7964d4a0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:01.911986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0] Write session: try to update token
2025-09-30T14:58:01.912013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:01.921729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:01.921755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:01.921766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896654497586188:8761]
2025-09-30T14:58:01.921810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:01.922017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:01.922172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:01.922329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:01.922482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:01.922704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:01.922745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:01.923200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:01.935413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:01.935439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:01.935443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:01.935445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:01.935457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896654497586188:8761]
2025-09-30T14:58:01.935462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896654497586188:8761]
2025-09-30T14:58:01.935467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896654497586188:8761]
2025-09-30T14:58:01.935523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:01.935530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:01.935529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:01.935532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:01.935534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:01.935538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:01.935704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:01.937934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2761 sessionId: src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:01.940777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:01.978088Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896654587379767:12049]
2025-09-30T14:58:01.978401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2760, pipe: [1:7555896654587379767:12049]
2025-09-30T14:58:02.056275Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:02.056632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.056649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.056672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896654587379767:12049], now have 1 active actors on pipe
2025-09-30T14:58:02.056980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:02.057802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:02.057816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0] Write session will restart in 0.006097s
2025-09-30T14:58:02.057850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0] Write session: Do CDS request
2025-09-30T14:58:02.057856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:02.057308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:02.057414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2761 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0
2025-09-30T14:58:02.057610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2761 sessionId: src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0 is DEAD
2025-09-30T14:58:02.057843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896654587379767:12049]
2025-09-30T14:58:02.057865Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:02.064879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:02.064939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:02.064967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2762
2025-09-30T14:58:02.065167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2762 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:02.065204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2762 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:02.065215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2762 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:02.065220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:02.065703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2762 sessionId:  describe result for acl check
2025-09-30T14:58:02.065744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:02.065752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:02.065754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:02.065761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896658882347081:6062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:02.066363Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896658882347081:6062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:02.069008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896658882347081:6062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:02.072876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896658882347081:6062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:02.072895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896658882347081:6062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:02.072901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896658882347081:6062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:02.072922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2762 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:02.074859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:02.078766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:02.079367Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:02.079381Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:02.079396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:02.079471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:02.079518Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896658792553594:8751]
2025-09-30T14:58:02.080227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:02.080610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:02.080657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:02.081036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:02.081102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.081109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.081111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.081112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.081114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.081118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.081119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.081120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.081121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.081123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.081124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.081125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.081126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.081128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.081129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.081135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.081147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.081151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.081156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.081160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.081164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.081168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.081173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.081177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.081184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.081189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.081194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.081197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.081201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.081205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.081216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.081224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.081230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.081238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.081243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.081249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.081260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.081266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.081275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.081280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.081284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.081289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.081294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.081299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.081303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.081309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.081314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.081320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.081324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.081335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.081340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.081349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.081354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.081364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.081369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.081379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.081383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.081394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.081401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.081407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.081455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:02.087101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:02.088312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:02.088335Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:02.088338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:02.088343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:02.088352Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2761 [2:7555896658792553594:8751]
2025-09-30T14:58:02.088373Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:02.088400Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:02.088413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:02.088417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:02.088419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:02.088440Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:02.088448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:02.088463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:02.088539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.088550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.088552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.088556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:02.088559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:02.088638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:02.088648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.088663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.088680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.088702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:02.088727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896658792553589:8751]
2025-09-30T14:58:02.088735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896658792553589:8751]
2025-09-30T14:58:02.088737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896658792553589:8751]
2025-09-30T14:58:02.088753Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:02.088768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:02.088791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:02.088799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:02.088817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:02.088828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:02.088831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:02.088843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896658792553589:8751]
2025-09-30T14:58:02.088847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:02.088936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:02.088985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347066:2454], now have 1 active actors on pipe
2025-09-30T14:58:02.089002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347161:6062], now have 1 active actors on pipe
2025-09-30T14:58:02.089080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2761
2025-09-30T14:58:02.089087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2761
2025-09-30T14:58:02.089168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.089180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.089208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:02.089222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:02.089230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:02.089232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:02.089244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:02.089261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:02.089282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:02.089574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.089595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.089609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:02.089726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2762 partition: 0 MaxSeqNo: 42 sessionId: src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0
2025-09-30T14:58:02.090133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b63096a-e52dc7d2-a7f9dcfe-b0a2f188_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:02.093290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0] Write session: try to update token
2025-09-30T14:58:02.093319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:02.104696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:02.104717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:02.104728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896658792553589:8751]
2025-09-30T14:58:02.104777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:02.104970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:02.105045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:02.105130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:02.105282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:02.105432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:02.105883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:02.105940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:02.110413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2762 sessionId: src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:02.113858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:02.114158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.114186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.114224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:02.114336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:02.119166Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:02.119187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:02.119190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:02.119192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:02.119204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896658792553589:8751]
2025-09-30T14:58:02.119208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896658792553589:8751]
2025-09-30T14:58:02.119211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896658792553589:8751]
2025-09-30T14:58:02.119238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:02.119260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:02.119261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:02.119264Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:02.119268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.119270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:02.119423Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:02.159510Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896658882347189:12049]
2025-09-30T14:58:02.160154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2761, pipe: [1:7555896658882347189:12049]
2025-09-30T14:58:02.236425Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:02.245084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.245123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.245314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.245385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.245464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.245535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.245771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.245787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.245868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.245938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.246018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.246093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.246144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.246152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.246229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.246296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.246371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.246452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.246503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.246514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.246594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.246669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.246743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.246834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.246882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.246892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.246972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.247050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.247130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.247207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.247278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.247285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.247362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.247434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.247511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.247576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.247620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.247623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.247698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.247762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.247832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.247898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.247953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.247956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.248029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.248092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.248154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.248216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.248278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.248284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.248360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.248425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.248491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.248561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.248606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.248610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.248685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.248747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.248809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.248873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.248933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.248936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.249015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347189:12049], now have 1 active actors on pipe
2025-09-30T14:58:02.250223Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:02.250669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896658882347189:12049]
2025-09-30T14:58:02.250720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:02.250769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:02.250815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2762 reason: status is not ok: tablet will be restarted right now sessionId: src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0
2025-09-30T14:58:02.251030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2762 sessionId: src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0 is DEAD
2025-09-30T14:58:02.251187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:02.251195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0] Write session will restart in 0.006903s
2025-09-30T14:58:02.251219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0] Write session: Do CDS request
2025-09-30T14:58:02.251226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:02.259790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:02.260035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:02.260055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2763
2025-09-30T14:58:02.260219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2763 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:02.260264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2763 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:02.260275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2763 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:02.260281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:02.260952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2763 sessionId:  describe result for acl check
2025-09-30T14:58:02.261000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:02.261011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:02.261013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:02.261020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896658882347238:6074] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:02.262071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896658882347238:6074] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:02.264113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896658882347238:6074] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:02.264274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:02.268452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:02.268720Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:02.268731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:02.268743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:02.268807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:02.268854Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896658792553743:8721]
2025-09-30T14:58:02.268952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896658882347238:6074] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:02.268969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896658882347238:6074] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:02.268972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896658882347238:6074] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:02.268982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2763 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:02.269533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:02.269950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:02.270005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:02.270379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:02.270445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.270453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.270454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.270455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.270456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.270458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.270459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.270461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.270462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.270464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.270465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.270467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.270468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.270469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.270471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.270477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.270488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.270492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.270497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.270501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.270505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.270510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.270514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.270519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.270526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.270530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.270534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.270537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.270541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.270545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.270554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.270561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.270568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.270574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.270580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.270587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.270592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.270597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.270603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.270608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.270615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.270620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.270625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.270630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.270635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.270640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.270647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.270653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.270657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.270674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.270686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.270691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.270695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.270705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.270710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.270715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.270724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.270729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.270738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.270744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.270798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:02.276544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:02.277909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:02.277930Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:02.277933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:02.277937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:02.277945Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2762 [2:7555896658792553743:8721]
2025-09-30T14:58:02.277962Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:02.277981Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:02.277985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:02.277988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:02.277990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:02.278010Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:02.278018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:02.278025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:02.278093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.278101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.278103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.278107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:02.278109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:02.278185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:02.278192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.278207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.278226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.278244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:02.278261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896658792553738:8721]
2025-09-30T14:58:02.278269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896658792553738:8721]
2025-09-30T14:58:02.278271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896658792553738:8721]
2025-09-30T14:58:02.278281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:02.278298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:02.278313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:02.278319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:02.278322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:02.278326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:02.278329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:02.278355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896658792553738:8721]
2025-09-30T14:58:02.278365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:02.278368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:02.278375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347204:2454], now have 1 active actors on pipe
2025-09-30T14:58:02.278378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347303:6074], now have 1 active actors on pipe
2025-09-30T14:58:02.278848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2762
2025-09-30T14:58:02.278868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2762
2025-09-30T14:58:02.278938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.278948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.278976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ae34546-69170964-fb6c65a2-caf369c5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:02.278988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:02.278997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:02.278999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:02.279009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:02.279020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:02.279041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:02.279653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.279668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.279691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:02.279813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2763 partition: 0 MaxSeqNo: 42 sessionId: src_id|9ae34546-69170964-fb6c65a2-caf369c5_0
2025-09-30T14:58:02.280224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|533ac824-3bfaa834-dd1b8c49-2bcded98_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9ae34546-69170964-fb6c65a2-caf369c5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:02.283460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae34546-69170964-fb6c65a2-caf369c5_0] Write session: try to update token
2025-09-30T14:58:02.283482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae34546-69170964-fb6c65a2-caf369c5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:02.291838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:02.291858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:02.291860Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:02.291862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:02.291872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896658792553738:8721]
2025-09-30T14:58:02.291876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896658792553738:8721]
2025-09-30T14:58:02.291879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896658792553738:8721]
2025-09-30T14:58:02.291927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:02.291939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.291947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:02.292103Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:02.295325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:02.295351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:02.295355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:02.300750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2763 sessionId: src_id|9ae34546-69170964-fb6c65a2-caf369c5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:02.303597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:02.350830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896658882347322:12049]
2025-09-30T14:58:02.351143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2762, pipe: [1:7555896658882347322:12049]
2025-09-30T14:58:02.405405Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:02.405973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.405989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.406012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347322:12049], now have 1 active actors on pipe
2025-09-30T14:58:02.406255Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:02.406283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:02.406293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:02.406298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:02.406345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896658882347322:12049]
2025-09-30T14:58:02.406716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae34546-69170964-fb6c65a2-caf369c5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:02.406729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae34546-69170964-fb6c65a2-caf369c5_0] Write session will restart in 0.009215s
2025-09-30T14:58:02.406752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae34546-69170964-fb6c65a2-caf369c5_0] Write session: Do CDS request
2025-09-30T14:58:02.406758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae34546-69170964-fb6c65a2-caf369c5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:02.406371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2763 reason: error at write: Disconnected sessionId: src_id|9ae34546-69170964-fb6c65a2-caf369c5_0
2025-09-30T14:58:02.406569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2763 sessionId: src_id|9ae34546-69170964-fb6c65a2-caf369c5_0 is DEAD
2025-09-30T14:58:02.416790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae34546-69170964-fb6c65a2-caf369c5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:02.416929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:02.416949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2764
2025-09-30T14:58:02.418078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2764 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:02.418142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2764 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:02.418154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2764 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:02.418159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:02.418820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2764 sessionId:  describe result for acl check
2025-09-30T14:58:02.418861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:02.418869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:02.418871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:02.418878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896658882347376:6090] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:02.419497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896658882347376:6090] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:02.422721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896658882347376:6090] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:02.426277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:02.429516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896658882347376:6090] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:02.429533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896658882347376:6090] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:02.429537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896658882347376:6090] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:02.429546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2764 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:02.436068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:02.436314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:02.436338Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:02.436358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:02.436429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:02.436474Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896658792553847:8718]
2025-09-30T14:58:02.437218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:02.437615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:02.437687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:02.438082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:02.438168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.438175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.438176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.438178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.438179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.438181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.438182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.438184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.438185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.438186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.438187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.438188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.438190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.438191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.438192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.438199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.438209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.438213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.438217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.438221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.438225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.438229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.438233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.438238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.438242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.438246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.438249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.438253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.438256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.438260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.438269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.438278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.438286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.438291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.438295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.438300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.438305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.438310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.438315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.438321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.438325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.438331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.438336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.438342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.438346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.438351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.438356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.438361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.438365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.438370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.438375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.438380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.438385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.438390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.438395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.438400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.438405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.438409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.438414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.438419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.438476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:02.444443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:02.445496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:02.445521Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:02.445525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:02.445529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:02.445537Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2763 [2:7555896658792553847:8718]
2025-09-30T14:58:02.445561Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:02.445578Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:02.445582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:02.445585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:02.445587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:02.445605Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:02.445622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:02.445628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:02.445695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.445705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.445708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.445711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:02.445714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:02.445791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:02.445803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.445818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.445829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.445849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:02.446013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2763
2025-09-30T14:58:02.446019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2763
2025-09-30T14:58:02.445868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896658792553840:8718]
2025-09-30T14:58:02.445876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896658792553840:8718]
2025-09-30T14:58:02.445878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896658792553840:8718]
2025-09-30T14:58:02.445887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:02.445899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:02.445903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:02.445906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:02.445907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347423:6090], now have 1 active actors on pipe
2025-09-30T14:58:02.445915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:02.445929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:02.445932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:02.445938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347323:2454], now have 1 active actors on pipe
2025-09-30T14:58:02.445979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896658792553840:8718]
2025-09-30T14:58:02.445989Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:02.446000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:02.446254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.446261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.446291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:02.446300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:02.446304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:02.446307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:02.446318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:02.446328Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:02.446349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:02.446572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.446587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.446613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:02.446745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2764 partition: 0 MaxSeqNo: 42 sessionId: src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0
2025-09-30T14:58:02.447141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ae34546-69170964-fb6c65a2-caf369c5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:02.450269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0] Write session: try to update token
2025-09-30T14:58:02.450301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:02.459856Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:02.459882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:02.459892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896658792553840:8718]
2025-09-30T14:58:02.459941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:02.459959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:02.460156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:02.460319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:02.460478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:02.460637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:02.460863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:02.460901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:02.467923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2764 sessionId: src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:02.471178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:02.471697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.471724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.471763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:02.471866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:02.473365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:02.473389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:02.473392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:02.473394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:02.473406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896658792553840:8718]
2025-09-30T14:58:02.473410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896658792553840:8718]
2025-09-30T14:58:02.473414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896658792553840:8718]
2025-09-30T14:58:02.473461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:02.473469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.473472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:02.473633Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:02.475317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:02.475336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:02.475341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:02.510291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896658882347448:12049]
2025-09-30T14:58:02.513018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2763, pipe: [1:7555896658882347448:12049]
2025-09-30T14:58:02.601359Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:02.611156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.611197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.611409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.611480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.611554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.611621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.611669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.611674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.611747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.611810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.611875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.611943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.611984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.611987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.612061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.612123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.612190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.612256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.612299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.612302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.615231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:02.612381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.612446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.615269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896658882347448:12049]
2025-09-30T14:58:02.612514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.612579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.612620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.612624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.612699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.612763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.612829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.612904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.612963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.612967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.613044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.613111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.613178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.613249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.613302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.613304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.613382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.613450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.613520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.613587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.613635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.613639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.613710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.613773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.613838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.613904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.613946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.613949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.614045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.614112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.614187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.614253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.614297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.614301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.614420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:02.614485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:02.614550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:02.614620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:02.614664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:02.614667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:02.614750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347448:12049], now have 1 active actors on pipe
2025-09-30T14:58:02.615308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:02.615325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:02.615361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2764 reason: error at write: Disconnected sessionId: src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0
2025-09-30T14:58:02.616858Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:02.615543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2764 sessionId: src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0 is DEAD
2025-09-30T14:58:02.619357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:02.619370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0] Write session will restart in 0.007781s
2025-09-30T14:58:02.619396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0] Write session: Do CDS request
2025-09-30T14:58:02.619402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:02.628816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:02.628981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:02.628997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2765
2025-09-30T14:58:02.629120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2765 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:02.629160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2765 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:02.629165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2765 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:02.629171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:02.629671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2765 sessionId:  describe result for acl check
2025-09-30T14:58:02.630043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:02.630051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:02.630057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:02.630063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896658882347470:6098] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:02.630605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896658882347470:6098] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:02.634178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896658882347470:6098] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:02.635831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:02.639654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:02.639885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896658882347470:6098] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:02.639902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896658882347470:6098] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:02.639906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896658882347470:6098] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:02.639914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2765 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:02.639913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:02.639926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:02.639938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:02.639991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:02.640035Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896658792553954:8694]
2025-09-30T14:58:02.640775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:02.641109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:02.641153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:02.641516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:02.641578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.641585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.641586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.641588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.641590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.641591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.641593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.641595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.641596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.641598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.641600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.641601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.641603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.641604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.641606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.641611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.641623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.641628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.641633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.641637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.641642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.641645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.641650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.641654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.641659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.641664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.641669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.641673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.641677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.641682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.641690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.641699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.641705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.641711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.641718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.641725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.641730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.641737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.641742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.641749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.641754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.641761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.641766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.641778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.641783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.641790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.641800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.641806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.641816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.641824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.641834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.641841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.641846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.641856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.641861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.641867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.641876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.641882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.641887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.641903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.641957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:02.648702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:02.649809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:02.649832Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:02.649835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:02.649844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:02.649852Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2764 [2:7555896658792553954:8694]
2025-09-30T14:58:02.649870Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:02.649889Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:02.649898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:02.649902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:02.649904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:02.649921Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:02.649934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:02.649943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:02.650013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.650021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.650024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.650027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:02.650030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:02.650108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:02.650120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.650135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.650149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.650168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:02.650186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896658792553948:8694]
2025-09-30T14:58:02.650189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896658792553948:8694]
2025-09-30T14:58:02.650191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896658792553948:8694]
2025-09-30T14:58:02.650202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:02.650215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347450:2454], now have 1 active actors on pipe
2025-09-30T14:58:02.650224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:02.650222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:02.650227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:02.650230Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:02.650238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:02.650241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:02.650247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347551:6098], now have 1 active actors on pipe
2025-09-30T14:58:02.650287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896658792553948:8694]
2025-09-30T14:58:02.650295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:02.650339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:02.650452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2764
2025-09-30T14:58:02.650499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2764
2025-09-30T14:58:02.650550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.650567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.650597Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:02.650612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:02.650616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:02.650619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:02.650631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:02.650646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:02.650668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:02.651006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.651014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.651029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:02.651145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2765 partition: 0 MaxSeqNo: 42 sessionId: src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0
2025-09-30T14:58:02.653300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|551a7f83-51c45921-ebc47e44-29d8dc7f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:02.656433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0] Write session: try to update token
2025-09-30T14:58:02.656454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:02.665346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:02.665377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:02.665380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:02.665383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:02.665393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896658792553948:8694]
2025-09-30T14:58:02.665398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896658792553948:8694]
2025-09-30T14:58:02.665402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896658792553948:8694]
2025-09-30T14:58:02.665458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:02.665466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.665469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:02.665636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:02.665639Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:02.665653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:02.665663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:02.676581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2765 sessionId: src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:02.679695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:02.715344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896658882347563:12049]
2025-09-30T14:58:02.715755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2764, pipe: [1:7555896658882347563:12049]
2025-09-30T14:58:02.784707Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:02.785412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.785431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.785453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347563:12049], now have 1 active actors on pipe
2025-09-30T14:58:02.785681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:02.786089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:02.786236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:02.786244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:02.786307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2765 reason: error at write: Disconnected sessionId: src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0
2025-09-30T14:58:02.786488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2765 sessionId: src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0 is DEAD
2025-09-30T14:58:02.786661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896658882347563:12049]
2025-09-30T14:58:02.787341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:02.787354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0] Write session will restart in 0.008746s
2025-09-30T14:58:02.787379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0] Write session: Do CDS request
2025-09-30T14:58:02.787388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:02.799682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:02.800470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:02.800487Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2766
2025-09-30T14:58:02.803821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2766 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:02.803878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2766 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:02.803889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2766 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:02.803894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:02.804365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2766 sessionId:  describe result for acl check
2025-09-30T14:58:02.804395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:02.804400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:02.804402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:02.804408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896658882347635:6106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:02.804694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:02.804928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896658882347635:6106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:02.807090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896658882347635:6106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:02.808777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:02.808995Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:02.809000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:02.809010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:02.809064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:02.809103Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896658792554059:8695]
2025-09-30T14:58:02.809761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:02.809977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896658882347635:6106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:02.809991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896658882347635:6106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:02.809994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896658882347635:6106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:02.810002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2766 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:02.810083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:02.810132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:02.810479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:02.810541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.810542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.810543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.810545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.810546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.810547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.810548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.810549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.810550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.810552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.810552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.810554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.810554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.810555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.810556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.810561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.810570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.810574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.810577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.810580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.810583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.810586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.810590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.810593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.810597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.810600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.810603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.810606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.810610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.810613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.810620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.810627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.810633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.810638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.810642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.810647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.810651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.810656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.810660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.810665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.810669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.810673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.810678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.810682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.810686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.810690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.810695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.810699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.810704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.810708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.810713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.810717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.810721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.810725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.810728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.810732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.810736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.810740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.810744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.810749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.810786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:02.816530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:02.817680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:02.817687Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:02.817691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:02.817696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:02.817704Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2765 [2:7555896658792554059:8695]
2025-09-30T14:58:02.817721Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:02.817738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:02.817742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:02.817745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:02.817747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:02.817765Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:02.817772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:02.817781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:02.817849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.817851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.817853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.817857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:02.817860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:02.817937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:02.817940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.817954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.817966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.817983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:02.818000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896658792554054:8695]
2025-09-30T14:58:02.818003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896658792554054:8695]
2025-09-30T14:58:02.818005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896658792554054:8695]
2025-09-30T14:58:02.818014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:02.818023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:02.818028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347566:2454], now have 1 active actors on pipe
2025-09-30T14:58:02.818032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347672:6106], now have 1 active actors on pipe
2025-09-30T14:58:02.818037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:02.818040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:02.818042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:02.818059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:02.818062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:02.818097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896658792554054:8695]
2025-09-30T14:58:02.818109Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:02.818118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2765
2025-09-30T14:58:02.818189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2765
2025-09-30T14:58:02.818155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:02.818305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.818322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.818352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:02.818365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:02.818375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:02.818377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:02.818388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:02.818400Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:02.818420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:02.818601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.818621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.818644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:02.818736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2766 partition: 0 MaxSeqNo: 42 sessionId: src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0
2025-09-30T14:58:02.823371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7b79e07-ffb1a06f-af935c5b-c819283e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:02.826397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0] Write session: try to update token
2025-09-30T14:58:02.826422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:02.837554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:02.837578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:02.837591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896658792554054:8695]
2025-09-30T14:58:02.837647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:02.837838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:02.838001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:02.838155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:02.838312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:02.838523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:02.838569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:02.838658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:02.845627Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:02.845653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:02.845656Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:02.845658Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:02.845669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896658792554054:8695]
2025-09-30T14:58:02.845674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896658792554054:8695]
2025-09-30T14:58:02.845679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896658792554054:8695]
2025-09-30T14:58:02.845720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:02.845727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.845731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:02.845883Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:02.850757Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:02.850773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:02.850777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:02.849798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2766 sessionId: src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:02.852738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:02.887344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896658882347682:12049]
2025-09-30T14:58:02.887649Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2765, pipe: [1:7555896658882347682:12049]
2025-09-30T14:58:02.961632Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:02.961986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.962004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.962028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347682:12049], now have 1 active actors on pipe
2025-09-30T14:58:02.962342Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:02.962318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:02.962380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:02.962384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:02.962453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2766 reason: error at write: Disconnected sessionId: src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0
2025-09-30T14:58:02.962619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896658882347682:12049]
2025-09-30T14:58:02.962654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2766 sessionId: src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0 is DEAD
2025-09-30T14:58:02.962843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:02.962852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0] Write session will restart in 0.007352s
2025-09-30T14:58:02.962878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0] Write session: Do CDS request
2025-09-30T14:58:02.962890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:02.971933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:02.972041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:02.972059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2767
2025-09-30T14:58:02.972270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2767 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:02.972332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2767 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:02.972342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2767 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:02.972348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:02.972866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2767 sessionId:  describe result for acl check
2025-09-30T14:58:02.972928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:02.972937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:02.972941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:02.972948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896658882347752:6121] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:02.973544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896658882347752:6121] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:02.975497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:02.976989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896658882347752:6121] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:02.979510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:02.979779Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:02.979783Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:02.979795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:02.979850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:02.979886Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896658792554165:8692]
2025-09-30T14:58:02.980599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:02.981094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:02.981175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:02.981620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896658882347752:6121] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:02.981637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896658882347752:6121] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:02.981641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896658882347752:6121] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:02.981650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2767 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:02.981593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:02.981690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.981692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.981694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.981696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.981698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.981699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.981701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.981702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.981704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.981707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.981709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.981710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.981711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.981712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.981714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.981721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.981732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.981737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.981741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.981746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.981751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.981755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.981760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.981764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.981768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.981773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.981778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.981782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.981787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.981791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.981801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.981810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:02.981817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.981826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:02.981831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.981837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:02.981842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.981849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:02.981855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.981860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:02.981865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.981871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:02.981880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.981887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:02.981891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.981896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:02.981901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.981906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:02.981911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.981916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:02.981921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.981927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.981931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.981936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.981941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.981946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.981950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.981955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:02.981961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.981967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:02.982012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:02.992852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:02.993855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:02.993862Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:02.993866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:02.993871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:02.993879Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2766 [2:7555896658792554165:8692]
2025-09-30T14:58:02.993899Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:02.993917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:02.993921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:02.993927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:02.993930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:02.993947Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:02.993954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:02.993963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:02.994462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.994465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.994469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.994473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:02.994476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:02.994564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:02.994567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:02.994581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:02.994591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:02.994607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:02.994628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896658792554160:8692]
2025-09-30T14:58:02.994633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896658792554160:8692]
2025-09-30T14:58:02.994635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896658792554160:8692]
2025-09-30T14:58:02.994648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:02.994663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:02.994675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:02.994678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:02.994722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896658792554160:8692]
2025-09-30T14:58:02.994724Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:02.994936Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:02.994938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:02.994940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:02.994945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:02.995454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2766
2025-09-30T14:58:02.995502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2766
2025-09-30T14:58:02.996830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2767 partition: 0 MaxSeqNo: 42 sessionId: src_id|d161369e-5094684e-5c86535-c0ff5cb6_0
2025-09-30T14:58:02.997628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f0c8c73-b0b5c100-2eda252c-5d5b3a2d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d161369e-5094684e-5c86535-c0ff5cb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:02.995232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347789:6121], now have 1 active actors on pipe
2025-09-30T14:58:02.995271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896658882347686:2454], now have 1 active actors on pipe
2025-09-30T14:58:02.995619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.995626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.995659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d161369e-5094684e-5c86535-c0ff5cb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:02.995677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:02.995685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:02.995687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:02.995698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:02.995711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:02.995729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:02.995989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:02.995994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:02.996015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:03.001123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d161369e-5094684e-5c86535-c0ff5cb6_0] Write session: try to update token
2025-09-30T14:58:03.001145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d161369e-5094684e-5c86535-c0ff5cb6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:03.008564Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:03.008585Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:03.008588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:03.008590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:03.008604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896658792554160:8692]
2025-09-30T14:58:03.008608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896658792554160:8692]
2025-09-30T14:58:03.008612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896658792554160:8692]
2025-09-30T14:58:03.008654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:03.008661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.008661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:03.008664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:03.008668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:03.008672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:03.008805Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:03.023559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2767 sessionId: src_id|d161369e-5094684e-5c86535-c0ff5cb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:03.026641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:03.062958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896663177315095:12049]
2025-09-30T14:58:03.065836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2766, pipe: [1:7555896663177315095:12049]
2025-09-30T14:58:03.126852Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:03.127304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.127327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.127348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315095:12049], now have 1 active actors on pipe
2025-09-30T14:58:03.127603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896663177315095:12049]
2025-09-30T14:58:03.127645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:03.127647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:03.127692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:03.127713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2767 reason: error at write: Disconnected sessionId: src_id|d161369e-5094684e-5c86535-c0ff5cb6_0
2025-09-30T14:58:03.127883Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2767 sessionId: src_id|d161369e-5094684e-5c86535-c0ff5cb6_0 is DEAD
2025-09-30T14:58:03.127608Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:03.128372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d161369e-5094684e-5c86535-c0ff5cb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:03.128395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d161369e-5094684e-5c86535-c0ff5cb6_0] Write session will restart in 0.009332s
2025-09-30T14:58:03.128421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d161369e-5094684e-5c86535-c0ff5cb6_0] Write session: Do CDS request
2025-09-30T14:58:03.128427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d161369e-5094684e-5c86535-c0ff5cb6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:03.138834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d161369e-5094684e-5c86535-c0ff5cb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:03.139389Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:03.139403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2768
2025-09-30T14:58:03.139635Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2768 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:03.139686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2768 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:03.139697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2768 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:03.139702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:03.140175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2768 sessionId:  describe result for acl check
2025-09-30T14:58:03.140214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:03.140223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:03.140225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:03.140232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896663177315169:6120] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:03.140773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896663177315169:6120] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:03.141584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:03.142757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896663177315169:6120] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:03.144990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:03.145205Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:03.145217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:03.145228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:03.145283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:03.145322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896663087521570:8686]
2025-09-30T14:58:03.145890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:03.146234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896663177315169:6120] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:03.146249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896663177315169:6120] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:03.146252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896663177315169:6120] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:03.146260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2768 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:03.146225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:03.146305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:03.146682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:03.146751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.146758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.146760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.146761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.146762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.146764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.146765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.146767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.146768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.146770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.146771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.146773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.146774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.146775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.146777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.146784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.146795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.146800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.146805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.146810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.146820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.146825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.146829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.146842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.146847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.146852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.146855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.146860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.146864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.146869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.146894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.146908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.146919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.146926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.146936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.146942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.146951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.146957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.146968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.146974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.146979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.146985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.146990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.147001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.147006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.147016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.147022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.147033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.147043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.147049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.147058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.147064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.147075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.147081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.147093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.147103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.147108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.147114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.147124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.147129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.147185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:03.156868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:03.158400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:03.158421Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:03.158425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:03.158429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:03.158436Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2767 [2:7555896663087521570:8686]
2025-09-30T14:58:03.158454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:03.158471Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:03.158474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:03.158478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:03.158481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:03.158498Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:03.158507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:03.158515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:03.158581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.158592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.158594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.158598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:03.158601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:03.158673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:03.158683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.158698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.158716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.158742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:03.158764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896663087521565:8686]
2025-09-30T14:58:03.158773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896663087521565:8686]
2025-09-30T14:58:03.158776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896663087521565:8686]
2025-09-30T14:58:03.158785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:03.158800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:03.158808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:03.158811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:03.158814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:03.158822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:03.158825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:03.158835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315207:6120], now have 1 active actors on pipe
2025-09-30T14:58:03.158839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315100:2454], now have 1 active actors on pipe
2025-09-30T14:58:03.158873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896663087521565:8686]
2025-09-30T14:58:03.158880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:03.158885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:03.158901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2767
2025-09-30T14:58:03.158941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2767
2025-09-30T14:58:03.158975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.158986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.159013Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:03.159025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:03.159030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:03.159037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:03.159047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:03.159057Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:03.159080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:03.159265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.159275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.159290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:03.159370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2768 partition: 0 MaxSeqNo: 42 sessionId: src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0
2025-09-30T14:58:03.159884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d161369e-5094684e-5c86535-c0ff5cb6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:03.162730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0] Write session: try to update token
2025-09-30T14:58:03.162746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:03.172660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:03.172686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:03.172689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:03.172691Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:03.172700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896663087521565:8686]
2025-09-30T14:58:03.172705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896663087521565:8686]
2025-09-30T14:58:03.172709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896663087521565:8686]
2025-09-30T14:58:03.172757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:03.172763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.172766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:03.172777Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:03.172785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:03.172790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:03.172938Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:03.179118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2768 sessionId: src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:03.182082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:03.227823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896663177315241:12049]
2025-09-30T14:58:03.228035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2767, pipe: [1:7555896663177315241:12049]
2025-09-30T14:58:03.290135Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:03.290471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.290485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.290524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315241:12049], now have 1 active actors on pipe
2025-09-30T14:58:03.290766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:03.290816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896663177315241:12049]
2025-09-30T14:58:03.290822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:03.290826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:03.290851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:03.290907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2768 reason: error at write: Disconnected sessionId: src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0
2025-09-30T14:58:03.291154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2768 sessionId: src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0 is DEAD
2025-09-30T14:58:03.291295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:03.291307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0] Write session will restart in 0.006299s
2025-09-30T14:58:03.291342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0] Write session: Do CDS request
2025-09-30T14:58:03.291351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:03.298752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:03.298839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:03.298856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2769
2025-09-30T14:58:03.299030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2769 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:03.299078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2769 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:03.299088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2769 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:03.299092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:03.299608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2769 sessionId:  describe result for acl check
2025-09-30T14:58:03.299675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:03.299691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:03.299698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:03.299706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896663177315262:6149] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:03.300409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896663177315262:6149] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:03.304716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896663177315262:6149] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:03.307403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896663177315262:6149] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:03.307420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896663177315262:6149] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:03.307424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896663177315262:6149] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:03.307434Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2769 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:03.307965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:03.311845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:03.312082Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:03.312092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:03.312103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:03.312160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:03.312199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896663087521728:8660]
2025-09-30T14:58:03.312867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:03.313251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:03.313300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:03.313630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:03.313694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.313700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.313701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.313702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.313703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.313705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.313706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.313708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.313709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.313710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.313712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.313713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.313714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.313715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.313717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.313722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.313734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.313737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.313741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.313744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.313748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.313751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.313755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.313760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.313764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.313769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.313773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.313777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.313781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.313785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.313794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.313803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.313810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.313816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.313821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.313827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.313832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.313842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.313847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.313852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.313858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.313870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.313875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.313881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.313889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.313895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.313904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.313909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.313918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.313923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.313928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.313934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.313942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.313948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.313957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.313963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.313971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.313976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.313982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.313991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.314037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:03.324795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:03.326166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:03.326191Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:03.326194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:03.326198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:03.326206Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2768 [2:7555896663087521728:8660]
2025-09-30T14:58:03.326225Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:03.326243Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:03.326247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:03.326250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:03.326253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:03.326271Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:03.326279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:03.326287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:03.326362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.326373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.326375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.326379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:03.326382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:03.326464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:03.326476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.326491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.326507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.326527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:03.326552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315356:6149], now have 1 active actors on pipe
2025-09-30T14:58:03.326556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315247:2454], now have 1 active actors on pipe
2025-09-30T14:58:03.326563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896663087521723:8660]
2025-09-30T14:58:03.326568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896663087521723:8660]
2025-09-30T14:58:03.326570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896663087521723:8660]
2025-09-30T14:58:03.326584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:03.326602Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:03.326607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:03.326617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:03.326622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:03.326626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:03.326636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:03.326674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896663087521723:8660]
2025-09-30T14:58:03.326688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:03.326643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2768
2025-09-30T14:58:03.326698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:03.326646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2768
2025-09-30T14:58:03.326862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.326874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.326905Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|695b0b51-78cddd4f-331f2149-547d85b8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:03.326918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:03.326932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:03.326940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:03.326951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:03.326963Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:03.326990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:03.327183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.327196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.327214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:03.327342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2769 partition: 0 MaxSeqNo: 42 sessionId: src_id|695b0b51-78cddd4f-331f2149-547d85b8_0
2025-09-30T14:58:03.327757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|397c4195-f5e3df0f-dd37888b-b3ec579a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|695b0b51-78cddd4f-331f2149-547d85b8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:03.330832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|695b0b51-78cddd4f-331f2149-547d85b8_0] Write session: try to update token
2025-09-30T14:58:03.330867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|695b0b51-78cddd4f-331f2149-547d85b8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:03.341894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:03.341916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:03.341926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896663087521723:8660]
2025-09-30T14:58:03.341972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:03.341995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:03.342160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:03.342315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:03.342468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:03.342621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:03.342816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:03.342860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:03.354246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:03.354267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:03.354270Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:03.354273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:03.354284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896663087521723:8660]
2025-09-30T14:58:03.354288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896663087521723:8660]
2025-09-30T14:58:03.354294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896663087521723:8660]
2025-09-30T14:58:03.354332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:03.354332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:03.354337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:03.354340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.354341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:03.354342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:03.354486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:03.353331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2769 sessionId: src_id|695b0b51-78cddd4f-331f2149-547d85b8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:03.356236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:03.391182Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896663177315372:12049]
2025-09-30T14:58:03.391488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2768, pipe: [1:7555896663177315372:12049]
2025-09-30T14:58:03.469242Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:03.469956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.469975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.469995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315372:12049], now have 1 active actors on pipe
2025-09-30T14:58:03.470259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:03.470333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896663177315372:12049]
2025-09-30T14:58:03.470362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:03.470443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2769 reason: status is not ok: tablet will be restarted right now sessionId: src_id|695b0b51-78cddd4f-331f2149-547d85b8_0
2025-09-30T14:58:03.470217Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:03.470627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2769 sessionId: src_id|695b0b51-78cddd4f-331f2149-547d85b8_0 is DEAD
2025-09-30T14:58:03.470827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|695b0b51-78cddd4f-331f2149-547d85b8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:03.470840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|695b0b51-78cddd4f-331f2149-547d85b8_0] Write session will restart in 0.008263s
2025-09-30T14:58:03.470873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|695b0b51-78cddd4f-331f2149-547d85b8_0] Write session: Do CDS request
2025-09-30T14:58:03.470881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|695b0b51-78cddd4f-331f2149-547d85b8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:03.480822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|695b0b51-78cddd4f-331f2149-547d85b8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:03.480941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:03.480958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2770
2025-09-30T14:58:03.481078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2770 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:03.481108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2770 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:03.481114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2770 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:03.481118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:03.481608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2770 sessionId:  describe result for acl check
2025-09-30T14:58:03.481697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:03.481705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:03.481707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:03.481713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896663177315401:6160] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:03.482303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896663177315401:6160] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:03.485872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896663177315401:6160] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:03.489348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896663177315401:6160] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:03.489369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896663177315401:6160] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:03.489372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896663177315401:6160] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:03.489382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2770 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:03.489609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:03.493685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:03.493948Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:03.493958Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:03.493970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:03.494028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:03.494075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896663087521838:8658]
2025-09-30T14:58:03.494764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:03.495135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:03.495195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:03.495562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:03.495638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.495644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.495646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.495647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.495649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.495650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.495652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.495654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.495655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.495657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.495658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.495660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.495661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.495663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.495665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.495670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.495681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.495685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.495690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.495694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.495699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.495703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.495708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.495712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.495717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.495722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.495726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.495730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.495734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.495738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.495746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.495755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.495762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.495769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.495781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.495788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.495798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.495802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.495807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.495815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.495819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.495824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.495829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.495839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.495846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.495857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.495864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.495873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.495878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.495888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.495894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.495905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.495910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.495920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.495926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.495936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.495941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.495957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.495965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.495970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.496023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:03.502733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:03.504179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:03.504207Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:03.504210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:03.504214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:03.504222Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2769 [2:7555896663087521838:8658]
2025-09-30T14:58:03.504239Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:03.504263Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:03.504266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:03.504270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:03.504272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:03.504291Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:03.504298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:03.504305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:03.504390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.504401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.504403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.504406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:03.504409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:03.504477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:03.504484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.504500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.504514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.504540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:03.504562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896663087521832:8658]
2025-09-30T14:58:03.504569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896663087521832:8658]
2025-09-30T14:58:03.504572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896663087521832:8658]
2025-09-30T14:58:03.504583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:03.504599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:03.504612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:03.504612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:03.504615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:03.504618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:03.504622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:03.504635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315494:6160], now have 1 active actors on pipe
2025-09-30T14:58:03.504639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315386:2454], now have 1 active actors on pipe
2025-09-30T14:58:03.504675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896663087521832:8658]
2025-09-30T14:58:03.504691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:03.504728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:03.504814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.504827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.504851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:03.504858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:03.504862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:03.504865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:03.504729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2769
2025-09-30T14:58:03.504876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:03.504731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2769
2025-09-30T14:58:03.504891Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:03.504926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:03.505074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.505083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.505098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:03.505167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2770 partition: 0 MaxSeqNo: 42 sessionId: src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0
2025-09-30T14:58:03.505550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|695b0b51-78cddd4f-331f2149-547d85b8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:03.508819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0] Write session: try to update token
2025-09-30T14:58:03.508842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:03.520665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:03.520687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:03.520699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896663087521832:8658]
2025-09-30T14:58:03.520750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:03.520957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:03.520979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:03.521124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:03.521279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:03.521433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:03.521640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:03.521685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:03.530701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2770 sessionId: src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:03.533866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:03.532895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:03.532932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:03.532935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:03.532938Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:03.532948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896663087521832:8658]
2025-09-30T14:58:03.532958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896663087521832:8658]
2025-09-30T14:58:03.532962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896663087521832:8658]
2025-09-30T14:58:03.533006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:03.533011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:03.533014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.533017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:03.533018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:03.533021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:03.533207Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:03.570365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896663177315506:12049]
2025-09-30T14:58:03.570687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2769, pipe: [1:7555896663177315506:12049]
2025-09-30T14:58:03.648401Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:03.648880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.648898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.648933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315506:12049], now have 1 active actors on pipe
2025-09-30T14:58:03.649225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:03.649230Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:03.649255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:03.649296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896663177315506:12049]
2025-09-30T14:58:03.649301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:03.649975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:03.649990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0] Write session will restart in 0.006228s
2025-09-30T14:58:03.650028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0] Write session: Do CDS request
2025-09-30T14:58:03.650033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:03.649335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2770 reason: error at write: Disconnected sessionId: src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0
2025-09-30T14:58:03.649559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2770 sessionId: src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0 is DEAD
2025-09-30T14:58:03.657831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:03.658210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:03.658227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2771
2025-09-30T14:58:03.658385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2771 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:03.658422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2771 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:03.658433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2771 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:03.658437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:03.659038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2771 sessionId:  describe result for acl check
2025-09-30T14:58:03.659078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:03.659086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:03.659088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:03.659095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896663177315522:6164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:03.659674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896663177315522:6164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:03.662045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896663177315522:6164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:03.668941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896663177315522:6164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:03.668961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896663177315522:6164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:03.668964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896663177315522:6164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:03.668974Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2771 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:03.669572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:03.676265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:03.676526Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:03.676539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:03.676553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:03.676639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:03.676682Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896663087521951:8655]
2025-09-30T14:58:03.677352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:03.677744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:03.677794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:03.678129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:03.678206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.678208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.678209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.678210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.678212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.678213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.678214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.678215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.678217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.678219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.678220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.678222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.678223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.678224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.678225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.678231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.678243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.678248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.678253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.678257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.678262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.678267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.678271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.678275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.678280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.678285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.678290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.678295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.678299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.678303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.678314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.678323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.678330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.678336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.678341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.678348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.678353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.678360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.678365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.678371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.678376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.678383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.678388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.678403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.678408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.678414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.678420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.678425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.678431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.678437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.678443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.678449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.678454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.678465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.678470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.678475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.678481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.678487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.678496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.678506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.678550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:03.688754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:03.689839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:03.689857Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:03.689860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:03.689865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:03.689873Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2770 [2:7555896663087521951:8655]
2025-09-30T14:58:03.689890Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:03.689912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:03.689919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:03.689923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:03.689926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:03.689941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:03.689953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:03.689965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:03.690030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.690037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.690040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.690044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:03.690047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:03.690120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:03.690129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.690142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.690155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.690295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2770
2025-09-30T14:58:03.690309Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2770
2025-09-30T14:58:03.690172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:03.690199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315615:6164], now have 1 active actors on pipe
2025-09-30T14:58:03.690203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315507:2454], now have 1 active actors on pipe
2025-09-30T14:58:03.690210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896663087521944:8655]
2025-09-30T14:58:03.690213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896663087521944:8655]
2025-09-30T14:58:03.690217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896663087521944:8655]
2025-09-30T14:58:03.690230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:03.690243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:03.690259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:03.690262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:03.690297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896663087521944:8655]
2025-09-30T14:58:03.690299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:03.690544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:03.690547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:03.690549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:03.690556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:03.690745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.690762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.690795Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:03.690804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:03.690808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:03.690819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:03.690831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:03.690843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:03.690864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:03.691958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2771 partition: 0 MaxSeqNo: 42 sessionId: src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0
2025-09-30T14:58:03.692435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0c06ca4-6d50f28d-ae7cc3bf-bedbc07d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:03.695280Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0] Write session: try to update token
2025-09-30T14:58:03.695297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:03.691793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.691803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.691820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:03.703498Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:03.703522Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:03.703524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:03.703527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:03.703538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896663087521944:8655]
2025-09-30T14:58:03.703542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896663087521944:8655]
2025-09-30T14:58:03.703551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896663087521944:8655]
2025-09-30T14:58:03.703598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:03.703605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.703608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:03.703607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:03.703614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:03.703621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:03.703752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:03.714123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2771 sessionId: src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:03.717192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:03.749590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896663177315630:12049]
2025-09-30T14:58:03.749915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2770, pipe: [1:7555896663177315630:12049]
2025-09-30T14:58:03.817951Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:03.818616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.818633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.818655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315630:12049], now have 1 active actors on pipe
2025-09-30T14:58:03.819033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:03.819052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:03.819135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2771 reason: error at write: Disconnected sessionId: src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0
2025-09-30T14:58:03.819118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:03.819357Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:03.819366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2771 sessionId: src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0 is DEAD
2025-09-30T14:58:03.819402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896663177315630:12049]
2025-09-30T14:58:03.823478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:03.823490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0] Write session will restart in 0.005128s
2025-09-30T14:58:03.823535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0] Write session: Do CDS request
2025-09-30T14:58:03.823544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:03.829793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:03.830170Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:03.830189Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2772
2025-09-30T14:58:03.830294Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2772 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:03.830316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2772 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:03.830320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2772 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:03.830324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:03.830791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2772 sessionId:  describe result for acl check
2025-09-30T14:58:03.830821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:03.830823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:03.830825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:03.830830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896663177315705:6182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:03.831864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:03.831404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896663177315705:6182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:03.833660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896663177315705:6182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:03.836281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:03.836520Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:03.836532Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:03.836543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:03.836603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:03.836646Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896663087522062:8653]
2025-09-30T14:58:03.836735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896663177315705:6182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:03.836750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896663177315705:6182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:03.836754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896663177315705:6182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:03.836764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2772 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:03.837279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:03.837619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:03.837667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:03.838032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:03.838095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.838101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.838102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.838104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.838105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.838106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.838107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.838109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.838110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.838111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.838113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.838114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.838116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.838117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.838118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.838124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.838135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.838139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.838144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.838148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.838152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.838156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.838161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.838165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.838170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.838175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.838179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.838184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.838188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.838192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.838199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.838207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:03.838213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.838219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:03.838224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.838229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:03.838234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.838240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:03.838248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.838260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:03.838264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.838269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:03.838276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.838279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:03.838281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.838284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:03.838288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.838293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:03.838299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.838309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:03.838314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.838324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.838329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.838338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.838343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.838353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.838358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.838362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:03.838367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.838372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:03.838418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:03.843983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:03.845431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:03.845451Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:03.845454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:03.845457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:03.845464Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2771 [2:7555896663087522062:8653]
2025-09-30T14:58:03.845483Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:03.845500Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:03.845504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:03.845507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:03.845509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:03.845525Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:03.845532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:03.845538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:03.845602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.845604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.845608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.845612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:03.845615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:03.845685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:03.845693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.845706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:03.845722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:03.845742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:03.845766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315742:6182], now have 1 active actors on pipe
2025-09-30T14:58:03.845774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315631:2454], now have 1 active actors on pipe
2025-09-30T14:58:03.845781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896663087522057:8653]
2025-09-30T14:58:03.845787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896663087522057:8653]
2025-09-30T14:58:03.845794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896663087522057:8653]
2025-09-30T14:58:03.845806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:03.845827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:03.845837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:03.845840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:03.845842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:03.845845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:03.845849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:03.845885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896663087522057:8653]
2025-09-30T14:58:03.845896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:03.845903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:03.845978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2771
2025-09-30T14:58:03.845994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2771
2025-09-30T14:58:03.846181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.846198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.846238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:03.846252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:03.846256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:03.846259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:03.846272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:03.846284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:03.846301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:03.846649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.846675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.846701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:03.846810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2772 partition: 0 MaxSeqNo: 42 sessionId: src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0
2025-09-30T14:58:03.847301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d8175d24-a4980db9-55c64b98-625cd3cc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:03.852010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0] Write session: try to update token
2025-09-30T14:58:03.852033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:03.859546Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:03.859571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:03.859582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896663087522057:8653]
2025-09-30T14:58:03.859631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:03.859650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:03.859824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:03.859982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:03.860139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:03.860297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:03.860510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:03.860547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:03.869242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2772 sessionId: src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:03.872199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:03.872235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:03.872259Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:03.872261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:03.872264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:03.872274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896663087522057:8653]
2025-09-30T14:58:03.872279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896663087522057:8653]
2025-09-30T14:58:03.872283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896663087522057:8653]
2025-09-30T14:58:03.872324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:03.872336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:03.872339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:03.872342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:03.872343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:03.872347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:03.872490Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:03.919554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896663177315753:12049]
2025-09-30T14:58:03.919905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2771, pipe: [1:7555896663177315753:12049]
2025-09-30T14:58:03.989355Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:03.989709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:03.989734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:03.989758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315753:12049], now have 1 active actors on pipe
2025-09-30T14:58:03.990024Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:03.990343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:03.990359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:03.990424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2772 reason: error at write: Disconnected sessionId: src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0
2025-09-30T14:58:03.990620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2772 sessionId: src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0 is DEAD
2025-09-30T14:58:03.990801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:03.990811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0] Write session will restart in 0.008871s
2025-09-30T14:58:03.990798Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:03.990838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0] Write session: Do CDS request
2025-09-30T14:58:03.990845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:03.990837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896663177315753:12049]
2025-09-30T14:58:04.000796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:04.007387Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:04.007401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2773
2025-09-30T14:58:04.007793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2773 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:04.007820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2773 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:04.007825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2773 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:04.007829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:04.008360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:04.008419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2773 sessionId:  describe result for acl check
2025-09-30T14:58:04.008460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:04.008462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:04.008464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:04.008470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896667472283127:6187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:04.009076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896667472283127:6187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:04.013670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:04.013973Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:04.013987Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:04.013999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:04.014064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:04.014107Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896667382489471:8652]
2025-09-30T14:58:04.014826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:04.014540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896667472283127:6187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:04.015378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:04.015448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:04.015820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:04.015887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.015895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.015896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.015898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.015900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.015901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.015903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.015904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.015906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.015907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.015909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.015910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.015912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.015913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.015914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.015921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.015933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.015938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.015943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.015947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.015952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.015957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.015975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.015980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.015985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.015990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.015995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.016000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.016004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.016008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.016020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.016031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.016038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.016043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.016048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.016053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.016059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.016076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.016082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.016087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.016092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.016098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.016104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.016111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.016116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.016124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.016129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.016134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.016139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.016146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.016152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.016158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.016163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.016168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.016174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.016179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.016185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.016191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.016196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.016202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.016252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:04.017965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896667472283127:6187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:04.017992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896667472283127:6187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:04.017997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896667472283127:6187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:04.018006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2773 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:04.022949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:04.023919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:04.023945Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:04.023949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:04.023953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:04.023961Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2772 [2:7555896667382489471:8652]
2025-09-30T14:58:04.023980Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:04.023999Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:04.024002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:04.024006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:04.024009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:04.024029Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:04.024041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:04.024054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:04.024125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.024130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.024133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.024137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:04.024140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:04.024213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:04.024222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.024235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.024254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.024276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:04.024300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896663177315755:2454], now have 1 active actors on pipe
2025-09-30T14:58:04.024309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283166:6187], now have 1 active actors on pipe
2025-09-30T14:58:04.024316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896667382489466:8652]
2025-09-30T14:58:04.024325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896667382489466:8652]
2025-09-30T14:58:04.024327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896667382489466:8652]
2025-09-30T14:58:04.024341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:04.024363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:04.024363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:04.024367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:04.024372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:04.024383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:04.024387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:04.024425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896667382489466:8652]
2025-09-30T14:58:04.024437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:04.024448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:04.024418Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2772
2025-09-30T14:58:04.024478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.024488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.024449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2772
2025-09-30T14:58:04.024521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:04.024533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:04.024537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:04.024544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:04.024554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:04.024568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:04.024588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:04.024896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.024926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.024950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:04.025065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2773 partition: 0 MaxSeqNo: 42 sessionId: src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0
2025-09-30T14:58:04.025481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f15c2d23-7c6d65a2-4ad6a4c-cdd27d34_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:04.028692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0] Write session: try to update token
2025-09-30T14:58:04.028720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:04.038927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:04.038952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:04.038964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896667382489466:8652]
2025-09-30T14:58:04.039017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:04.039019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:04.039235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:04.039432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:04.039587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:04.039744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:04.039974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:04.040018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:04.051400Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:04.051424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:04.051427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:04.051429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:04.051441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896667382489466:8652]
2025-09-30T14:58:04.051448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896667382489466:8652]
2025-09-30T14:58:04.051454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896667382489466:8652]
2025-09-30T14:58:04.051498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:04.051498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:04.051504Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:04.051507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.051509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:04.051510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:04.051665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:04.053094Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2773 sessionId: src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:04.056299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:04.091086Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896667472283173:12049]
2025-09-30T14:58:04.091438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2772, pipe: [1:7555896667472283173:12049]
2025-09-30T14:58:04.170175Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:04.170928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.170962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.170990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283173:12049], now have 1 active actors on pipe
2025-09-30T14:58:04.171236Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896667472283173:12049]
2025-09-30T14:58:04.171281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:04.171284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:04.171344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:04.171423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2773 reason: error at write: Disconnected sessionId: src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0
2025-09-30T14:58:04.171627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2773 sessionId: src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0 is DEAD
2025-09-30T14:58:04.171814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:04.171822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0] Write session will restart in 0.005346s
2025-09-30T14:58:04.171849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0] Write session: Do CDS request
2025-09-30T14:58:04.171281Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:04.171854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:04.178857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:04.178949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:04.178965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2774
2025-09-30T14:58:04.179100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2774 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:04.179129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2774 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:04.179134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2774 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:04.179138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:04.179653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2774 sessionId:  describe result for acl check
2025-09-30T14:58:04.179686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:04.179688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:04.179691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:04.179697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896667472283191:6191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:04.180288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896667472283191:6191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:04.183501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896667472283191:6191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:04.185632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:04.189447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:04.189488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896667472283191:6191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:04.189510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896667472283191:6191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:04.189513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896667472283191:6191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:04.189522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2774 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:04.189672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:04.189682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:04.189692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:04.189753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:04.189796Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896667382489587:8640]
2025-09-30T14:58:04.190460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:04.190799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:04.190853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:04.191213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:04.191297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.191305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.191306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.191307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.191308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.191310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.191311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.191312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.191314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.191315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.191316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.191318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.191319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.191321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.191322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.191328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.191339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.191344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.191348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.191352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.191356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.191359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.191363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.191366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.191371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.191374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.191378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.191383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.191387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.191392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.191400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.191408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.191414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.191420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.191426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.191431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.191436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.191442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.191447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.191453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.191457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.191463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.191468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.191473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.191480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.191486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.191491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.191496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.191501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.191507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.191511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.191517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.191522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.191527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.191532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.191544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.191548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.191554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.191559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.191564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.191618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:04.197405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:04.198501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:04.198521Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:04.198525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:04.198529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:04.198536Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2773 [2:7555896667382489587:8640]
2025-09-30T14:58:04.198554Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:04.198571Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:04.198575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:04.198578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:04.198581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:04.198597Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:04.198611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:04.198622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:04.198689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.198697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.198699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.198703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:04.198705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:04.198777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:04.198787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.198803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.198816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.198833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:04.198855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896667382489582:8640]
2025-09-30T14:58:04.198864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896667382489582:8640]
2025-09-30T14:58:04.198866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896667382489582:8640]
2025-09-30T14:58:04.198879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:04.198892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283286:6191], now have 1 active actors on pipe
2025-09-30T14:58:04.198892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:04.198896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:04.198898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283175:2454], now have 1 active actors on pipe
2025-09-30T14:58:04.198899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:04.198906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:04.198922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:04.198925Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:04.198962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896667382489582:8640]
2025-09-30T14:58:04.198972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:04.198992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:04.198971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2773
2025-09-30T14:58:04.199019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.198971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2773
2025-09-30T14:58:04.199030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.199053Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:04.199065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:04.199068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:04.199070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:04.199080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:04.199089Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:04.199101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:04.199322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.199338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.199365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:04.199504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2774 partition: 0 MaxSeqNo: 42 sessionId: src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0
2025-09-30T14:58:04.199910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4f3968a-bbc8922a-19ff58c5-93d0d28_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:04.202901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0] Write session: try to update token
2025-09-30T14:58:04.202925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:04.211401Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:04.211423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:04.211435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896667382489582:8640]
2025-09-30T14:58:04.211486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:04.211496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:04.211685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:04.211852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:04.212023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:04.212184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:04.212451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:04.212503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:04.218450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2774 sessionId: src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:04.221543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:04.221830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.221861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.221898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:04.222016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:04.224063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:04.224090Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:04.224093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:04.224100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:04.224110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896667382489582:8640]
2025-09-30T14:58:04.224114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896667382489582:8640]
2025-09-30T14:58:04.224118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896667382489582:8640]
2025-09-30T14:58:04.224159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:04.224166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.224170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:04.224176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:04.224192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:04.224197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:04.224325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:04.271521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896667472283313:12049]
2025-09-30T14:58:04.271961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2773, pipe: [1:7555896667472283313:12049]
2025-09-30T14:58:04.342394Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:04.351732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.351772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.351963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:04.352028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:04.352092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:04.352156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:04.352203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:04.352209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:04.352287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:04.352350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:04.352415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:04.352483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:04.352526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:04.352530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:04.352608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:04.352679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:04.352749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:04.352815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:04.352859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:04.352863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:04.352958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:04.353037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:04.353105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:04.353173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:04.353216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:04.353219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:04.353294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:04.353357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:04.353423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:04.353491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:04.353536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:04.353539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:04.353616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:04.353679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:04.353744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:04.353808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:04.353854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:04.353857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:04.353936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:04.354003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:04.354082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:04.354147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:04.354196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:04.354200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:04.354273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:04.354336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:04.354399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:04.354468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:04.354512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:04.354515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:04.354589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:04.354653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:04.354717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:04.354786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:04.354832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:04.354835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:04.354912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:04.354979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:04.355046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:04.355112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:04.355161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:04.355165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:04.355229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283313:12049], now have 1 active actors on pipe
2025-09-30T14:58:04.355951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896667472283313:12049]
2025-09-30T14:58:04.355959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:04.355964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:04.355996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2774 reason: error at write: Disconnected sessionId: src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0
2025-09-30T14:58:04.356002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:04.356202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2774 sessionId: src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0 is DEAD
2025-09-30T14:58:04.356324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:04.356351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0] Write session will restart in 0.006579s
2025-09-30T14:58:04.356378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0] Write session: Do CDS request
2025-09-30T14:58:04.356384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:04.357035Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:04.363824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:04.364025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:04.364044Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2775
2025-09-30T14:58:04.364192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2775 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:04.364236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2775 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:04.364255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2775 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:04.364264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:04.364679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2775 sessionId:  describe result for acl check
2025-09-30T14:58:04.364711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:04.364713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:04.364715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:04.364720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896667472283346:6215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:04.365267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896667472283346:6215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:04.370676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896667472283346:6215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:04.375768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:04.376305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:04.376300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896667472283346:6215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:04.376320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896667472283346:6215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:04.376323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896667472283346:6215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:04.376335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2775 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:04.376517Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:04.376528Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:04.376538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:04.376590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:04.376634Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896667382489750:8618]
2025-09-30T14:58:04.377349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:04.377716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:04.377780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:04.378184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:04.378249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.378254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.378255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.378256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.378258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.378259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.378261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.378263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.378264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.378265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.378266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.378268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.378269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.378270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.378271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.378277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.378288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.378293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.378296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.378301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.378305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.378309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.378314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.378319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.378324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.378328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.378333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.378337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.378341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.378345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.378355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.378363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.378370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.378376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.378381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.378387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.378392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.378396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.378402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.378408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.378413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.378419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.378425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.378431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.378447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.378453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.378458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.378464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.378469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.378483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.378493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.378504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.378514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.378524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.378533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.378543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.378548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.378554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.378559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.378564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.378610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:04.384635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:04.385588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:04.385614Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:04.385617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:04.385622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:04.385629Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2774 [2:7555896667382489750:8618]
2025-09-30T14:58:04.385648Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:04.385666Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:04.385670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:04.385674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:04.385677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:04.385696Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:04.385709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:04.385717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:04.385784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.385792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.385795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.385799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:04.385802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:04.385876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:04.385885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.385900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.385919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.385946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:04.385970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896667382489745:8618]
2025-09-30T14:58:04.385978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896667382489745:8618]
2025-09-30T14:58:04.385980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896667382489745:8618]
2025-09-30T14:58:04.385994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:04.386009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:04.386015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283443:6215], now have 1 active actors on pipe
2025-09-30T14:58:04.386021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:04.386022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283331:2454], now have 1 active actors on pipe
2025-09-30T14:58:04.386023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:04.386028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:04.386043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:04.386047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:04.386085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896667382489745:8618]
2025-09-30T14:58:04.386100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:04.386111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:04.386117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2774
2025-09-30T14:58:04.386214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.386224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.386156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2774
2025-09-30T14:58:04.386248Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:04.386255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:04.386259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:04.386262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:04.386275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:04.386291Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:04.386311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:04.386457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.386471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.386493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:04.386575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2775 partition: 0 MaxSeqNo: 42 sessionId: src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0
2025-09-30T14:58:04.387061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f58210b-ef17588c-9d8daedf-ffed65e1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:04.390080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0] Write session: try to update token
2025-09-30T14:58:04.390106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:04.400340Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:04.400365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:04.400367Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:04.400369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:04.400380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896667382489745:8618]
2025-09-30T14:58:04.400392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896667382489745:8618]
2025-09-30T14:58:04.400395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896667382489745:8618]
2025-09-30T14:58:04.400438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:04.400456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.400458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:04.400460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:04.400471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:04.400486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:04.400617Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:04.411229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2775 sessionId: src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:04.414216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:04.459432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896667472283466:12049]
2025-09-30T14:58:04.459759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2774, pipe: [1:7555896667472283466:12049]
2025-09-30T14:58:04.516947Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:04.517908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.517930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.517954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283466:12049], now have 1 active actors on pipe
2025-09-30T14:58:04.518245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:04.518262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:04.518260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:04.518325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2775 reason: error at write: Disconnected sessionId: src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0
2025-09-30T14:58:04.518335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896667472283466:12049]
2025-09-30T14:58:04.518509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2775 sessionId: src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0 is DEAD
2025-09-30T14:58:04.518685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:04.518697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0] Write session will restart in 0.006859s
2025-09-30T14:58:04.518737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0] Write session: Do CDS request
2025-09-30T14:58:04.518743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:04.518792Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:04.526816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:04.526886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:04.526904Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2776
2025-09-30T14:58:04.527041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2776 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:04.527068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2776 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:04.527073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2776 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:04.527077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:04.527587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2776 sessionId:  describe result for acl check
2025-09-30T14:58:04.527630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:04.527632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:04.527634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:04.527640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896667472283507:6231] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:04.528181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896667472283507:6231] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:04.530487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896667472283507:6231] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:04.531026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:04.535018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:04.535188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896667472283507:6231] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:04.535206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896667472283507:6231] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:04.535222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896667472283507:6231] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:04.535231Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2776 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:04.535305Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:04.535317Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:04.535329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:04.535389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:04.535436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896667382489867:8615]
2025-09-30T14:58:04.536156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:04.536471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:04.536516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:04.536867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:04.536960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.536967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.536968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.536969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.536971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.536972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.536974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.536976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.536977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.536979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.536980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.536982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.536984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.536985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.536987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.536993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.537005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.537011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.537016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.537021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.537025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.537030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.537034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.537040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.537045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.537049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.537054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.537058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.537064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.537068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.537076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.537085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.537092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.537098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.537104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.537110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.537116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.537122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.537128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.537134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.537139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.537145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.537152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.537158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.537169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.537175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.537185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.537191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.537196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.537207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.537213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.537224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.537228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.537239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.537245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.537255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.537260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.537265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.537275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.537280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.537330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:04.543022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:04.544476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:04.544495Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:04.544498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:04.544502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:04.544509Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2775 [2:7555896667382489867:8615]
2025-09-30T14:58:04.544527Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:04.544546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:04.544550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:04.544553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:04.544554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:04.544568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:04.544577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:04.544582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:04.544635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.544640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.544641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.544643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:04.544645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:04.544713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:04.544719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.544731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.544748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.544773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:04.544793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283580:6231], now have 1 active actors on pipe
2025-09-30T14:58:04.544802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283468:2454], now have 1 active actors on pipe
2025-09-30T14:58:04.544809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896667382489861:8615]
2025-09-30T14:58:04.544811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896667382489861:8615]
2025-09-30T14:58:04.544813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896667382489861:8615]
2025-09-30T14:58:04.544825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:04.544840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:04.544844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:04.544854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:04.544857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:04.544859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:04.544862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:04.544914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896667382489861:8615]
2025-09-30T14:58:04.544929Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:04.544953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:04.544948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2775
2025-09-30T14:58:04.544955Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2775
2025-09-30T14:58:04.545098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.545114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.545145Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:04.545163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:04.545168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:04.545170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:04.545182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:04.545199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:04.545215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:04.545387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.545400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.545423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:04.545521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2776 partition: 0 MaxSeqNo: 42 sessionId: src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0
2025-09-30T14:58:04.545916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e963398-f234891a-3b7cd0f1-d345d6cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:04.548973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0] Write session: try to update token
2025-09-30T14:58:04.548995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:04.557674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:04.557701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:04.557704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:04.557706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:04.557716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896667382489861:8615]
2025-09-30T14:58:04.557721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896667382489861:8615]
2025-09-30T14:58:04.557724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896667382489861:8615]
2025-09-30T14:58:04.557764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:04.557772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.557775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:04.557781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:04.557788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:04.557793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:04.557934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:04.566490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2776 sessionId: src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:04.569425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:04.618440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896667472283591:12049]
2025-09-30T14:58:04.618746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2775, pipe: [1:7555896667472283591:12049]
2025-09-30T14:58:04.671828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:04.672210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.672225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.672246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283591:12049], now have 1 active actors on pipe
2025-09-30T14:58:04.672577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896667472283591:12049]
2025-09-30T14:58:04.672590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:04.672585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:04.672602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:04.672618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:04.672680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2776 reason: error at write: Disconnected sessionId: src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0
2025-09-30T14:58:04.672866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2776 sessionId: src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0 is DEAD
2025-09-30T14:58:04.673070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:04.673081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0] Write session will restart in 0.008537s
2025-09-30T14:58:04.673105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0] Write session: Do CDS request
2025-09-30T14:58:04.673111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:04.682773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:04.682924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:04.682940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2777
2025-09-30T14:58:04.683081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2777 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:04.683121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2777 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:04.683132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2777 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:04.683135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:04.683602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2777 sessionId:  describe result for acl check
2025-09-30T14:58:04.683640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:04.683648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:04.683651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:04.683657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896667472283655:6240] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:04.684209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896667472283655:6240] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:04.686449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896667472283655:6240] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:04.686474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:04.690626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:04.690887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:04.690906Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:04.690919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:04.690937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896667472283655:6240] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:04.690991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:04.690954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896667472283655:6240] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:04.690958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896667472283655:6240] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:04.690967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2777 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:04.691038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896667382489986:8601]
2025-09-30T14:58:04.691729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:04.692118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:04.692179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:04.692566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:04.692655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.692656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.692658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.692659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.692661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.692662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.692663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.692665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.692666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.692667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.692669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.692670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.692671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.692673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.692674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.692681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.692693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.692697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.692702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.692706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.692711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.692716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.692720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.692725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.692730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.692734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.692738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.692743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.692748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.692752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.692760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.692769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.692775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.692781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.692786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.692792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.692798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.692803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.692809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.692815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.692821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.692827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.692843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.692848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.692853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.692859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.692864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.692870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.692874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.692880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.692886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.692892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.692912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.692917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.692921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.692927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.692932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.692938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.692945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.692965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.693011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:04.698708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:04.699630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:04.699652Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:04.699656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:04.699660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:04.699668Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2776 [2:7555896667382489986:8601]
2025-09-30T14:58:04.699688Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:04.699706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:04.699710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:04.699713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:04.699715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:04.699734Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:04.699741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:04.699748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:04.699811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.699820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.699822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.699825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:04.699828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:04.699899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:04.699906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.699917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.699934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.699949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:04.699973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283707:6240], now have 1 active actors on pipe
2025-09-30T14:58:04.699981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283593:2454], now have 1 active actors on pipe
2025-09-30T14:58:04.699988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896667382489981:8601]
2025-09-30T14:58:04.699990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896667382489981:8601]
2025-09-30T14:58:04.699993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896667382489981:8601]
2025-09-30T14:58:04.700005Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:04.700025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:04.700044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:04.700051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:04.700075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:04.700085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896667382489981:8601]
2025-09-30T14:58:04.700087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:04.700088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:04.700090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:04.700096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:04.700112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2776
2025-09-30T14:58:04.700187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2776
2025-09-30T14:58:04.700250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.700261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.700286Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:04.700298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:04.700302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:04.700305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:04.700316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:04.700325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:04.700338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:04.700515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.700523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.700535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:04.700645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2777 partition: 0 MaxSeqNo: 42 sessionId: src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0
2025-09-30T14:58:04.701042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8923aee1-f48b66c3-2f14687a-e296eafc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:04.704125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0] Write session: try to update token
2025-09-30T14:58:04.704149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:04.713014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:04.713040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:04.713082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896667382489981:8601]
2025-09-30T14:58:04.713128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:04.713135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:04.713322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:04.713481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:04.713643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:04.713801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:04.714012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:04.714064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:04.722337Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2777 sessionId: src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:04.725117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:04.725143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:04.725146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:04.725148Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:04.725158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896667382489981:8601]
2025-09-30T14:58:04.725163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896667382489981:8601]
2025-09-30T14:58:04.725168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896667382489981:8601]
2025-09-30T14:58:04.725210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:04.725212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:04.725218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:04.725218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.725221Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:04.725220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:04.725396Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:04.725501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:04.772542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896667472283720:12049]
2025-09-30T14:58:04.772836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2776, pipe: [1:7555896667472283720:12049]
2025-09-30T14:58:04.842637Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:04.842977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.842997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.843017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283720:12049], now have 1 active actors on pipe
2025-09-30T14:58:04.843318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:04.843315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:04.843324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:04.843331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:04.843389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896667472283720:12049]
2025-09-30T14:58:04.843411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2777 reason: error at write: Disconnected sessionId: src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0
2025-09-30T14:58:04.843591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2777 sessionId: src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0 is DEAD
2025-09-30T14:58:04.843941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:04.843954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0] Write session will restart in 0.005053s
2025-09-30T14:58:04.843980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0] Write session: Do CDS request
2025-09-30T14:58:04.843988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:04.851826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:04.851947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:04.851966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2778
2025-09-30T14:58:04.852156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2778 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:04.852203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2778 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:04.852223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2778 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:04.852233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:04.852732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2778 sessionId:  describe result for acl check
2025-09-30T14:58:04.852770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:04.852773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:04.852775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:04.852781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896667472283738:6258] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:04.853384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896667472283738:6258] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:04.856518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896667472283738:6258] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:04.860313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:04.860570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896667472283738:6258] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:04.860588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896667472283738:6258] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:04.860592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896667472283738:6258] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:04.860601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2778 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:04.864293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:04.864530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:04.864540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:04.864550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:04.864596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:04.864632Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896667382490105:8592]
2025-09-30T14:58:04.865279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:04.865691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:04.865746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:04.866072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:04.866143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.866144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.866146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.866147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.866149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.866150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.866151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.866153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.866154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.866155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.866157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.866158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.866160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.866160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.866162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.866167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.866177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.866180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.866184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.866188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.866192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.866195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.866198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.866202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.866206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.866210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.866214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.866218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.866221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.866224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.866233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.866240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:04.866245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.866250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:04.866254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.866260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:04.866265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.866270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:04.866275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.866279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:04.866283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.866288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:04.866293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.866298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:04.866302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.866307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:04.866312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.866317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:04.866322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.866327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:04.866330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.866338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.866343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.866348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.866352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.866358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.866362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.866366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:04.866372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.866377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:04.866417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:04.874880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:04.876306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:04.876327Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:04.876329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:04.876333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:04.876340Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2777 [2:7555896667382490105:8592]
2025-09-30T14:58:04.876357Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:04.876373Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:04.876376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:04.876379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:04.876381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:04.876400Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:04.876407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:04.876413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:04.876477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.876487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.876489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.876492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:04.876494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:04.876566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:04.876573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.876587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:04.876598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:04.876617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:04.876638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896667382490099:8592]
2025-09-30T14:58:04.876644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896667382490099:8592]
2025-09-30T14:58:04.876646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896667382490099:8592]
2025-09-30T14:58:04.876661Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:04.876679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:04.876696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:04.876703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:04.876741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896667382490099:8592]
2025-09-30T14:58:04.876747Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:04.876751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:04.876754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:04.876756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:04.876756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283836:6258], now have 1 active actors on pipe
2025-09-30T14:58:04.876760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283722:2454], now have 1 active actors on pipe
2025-09-30T14:58:04.876760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:04.876873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2777
2025-09-30T14:58:04.876928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2777
2025-09-30T14:58:04.877142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.877154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.877183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:04.877196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:04.877200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:04.877202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:04.877221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:04.877236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:04.877255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:04.877485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:04.877493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:04.877505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:04.878312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2778 partition: 0 MaxSeqNo: 42 sessionId: src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0
2025-09-30T14:58:04.878677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|922c7e41-83d01c80-2cbb81f0-9c98a460_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:04.881638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0] Write session: try to update token
2025-09-30T14:58:04.881663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:04.893255Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:04.893281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:04.893284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:04.893286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:04.893295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896667382490099:8592]
2025-09-30T14:58:04.893300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896667382490099:8592]
2025-09-30T14:58:04.893304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896667382490099:8592]
2025-09-30T14:58:04.893344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:04.893352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:04.893355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:04.893366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:04.893377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:04.893381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:04.893494Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:04.901773Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2778 sessionId: src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:04.904981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:04.943559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896667472283849:12049]
2025-09-30T14:58:04.943892Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2777, pipe: [1:7555896667472283849:12049]
2025-09-30T14:58:05.008541Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:05.008839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.008852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.008870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896667472283849:12049], now have 1 active actors on pipe
2025-09-30T14:58:05.009080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:05.009144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896667472283849:12049]
2025-09-30T14:58:05.009186Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:05.009274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2778 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0
2025-09-30T14:58:05.009434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:05.009467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2778 sessionId: src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0 is DEAD
2025-09-30T14:58:05.011430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:05.011442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0] Write session will restart in 0.006484s
2025-09-30T14:58:05.011467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0] Write session: Do CDS request
2025-09-30T14:58:05.011472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:05.018825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:05.018968Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:05.018985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2779
2025-09-30T14:58:05.019124Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2779 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:05.019157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2779 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:05.019173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2779 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:05.019177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:05.019712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2779 sessionId:  describe result for acl check
2025-09-30T14:58:05.019756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:05.019758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:05.019760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:05.019766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896671767251205:6268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:05.020334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896671767251205:6268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:05.022343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896671767251205:6268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:05.023492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:05.027296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:05.027548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:05.027559Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:05.027570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:05.027626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:05.027672Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896671677457519:8589]
2025-09-30T14:58:05.027666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896671767251205:6268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:05.027697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896671767251205:6268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:05.027701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896671767251205:6268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:05.027709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2779 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:05.028362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:05.028666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:05.028723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:05.029088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:05.029159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.029166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.029168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.029169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.029170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.029172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.029174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.029175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.029177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.029178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.029180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.029182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.029183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.029184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.029204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.029210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.029220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.029225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.029229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.029233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.029238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.029242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.029246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.029250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.029255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.029259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.029264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.029268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.029271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.029276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.029283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.029292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.029298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.029304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.029309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.029315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.029324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.029330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.029334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.029340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.029345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.029349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.029354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.029359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.029370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.029375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.029380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.029386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.029393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.029399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.029407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.029413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.029422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.029427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.029432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.029442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.029447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.029453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.029465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.029470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.029516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:05.035386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:05.036271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:05.036295Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:05.036298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:05.036303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:05.036310Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2778 [2:7555896671677457519:8589]
2025-09-30T14:58:05.036330Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:05.036347Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:05.036352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:05.036355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:05.036358Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:05.036374Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:05.036388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:05.036396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:05.036463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.036472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.036474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.036479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:05.036482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:05.036598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:05.036606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.036620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.036637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.036656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:05.036680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251263:6268], now have 1 active actors on pipe
2025-09-30T14:58:05.036688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251147:2454], now have 1 active actors on pipe
2025-09-30T14:58:05.036694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896671677457514:8589]
2025-09-30T14:58:05.036697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896671677457514:8589]
2025-09-30T14:58:05.036700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896671677457514:8589]
2025-09-30T14:58:05.036718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:05.036737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:05.036759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:05.036765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:05.036768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:05.036768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:05.036771Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:05.036726Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2778
2025-09-30T14:58:05.036746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2778
2025-09-30T14:58:05.036804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896671677457514:8589]
2025-09-30T14:58:05.036812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:05.036814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:05.036844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.036854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.036888Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d222e61b-f3504538-df47a84e-6a643c95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:05.036911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:05.036916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:05.036918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:05.036928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:05.036938Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:05.036960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:05.037104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.037118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.037143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:05.037250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2779 partition: 0 MaxSeqNo: 42 sessionId: src_id|d222e61b-f3504538-df47a84e-6a643c95_0
2025-09-30T14:58:05.037611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b5a5bd1-5f93b94e-15515f5a-55dd07a4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d222e61b-f3504538-df47a84e-6a643c95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:05.040602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d222e61b-f3504538-df47a84e-6a643c95_0] Write session: try to update token
2025-09-30T14:58:05.040620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d222e61b-f3504538-df47a84e-6a643c95_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:05.049999Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:05.050023Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:05.050026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:05.050029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:05.050039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896671677457514:8589]
2025-09-30T14:58:05.050044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896671677457514:8589]
2025-09-30T14:58:05.050048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896671677457514:8589]
2025-09-30T14:58:05.050088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:05.050089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:05.050093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:05.050096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.050097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:05.050099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:05.050248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:05.056370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2779 sessionId: src_id|d222e61b-f3504538-df47a84e-6a643c95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:05.059286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:05.109460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896671767251274:12049]
2025-09-30T14:58:05.109782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2778, pipe: [1:7555896671767251274:12049]
2025-09-30T14:58:05.165997Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:05.166744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.166761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.166803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251274:12049], now have 1 active actors on pipe
2025-09-30T14:58:05.167083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:05.167526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:05.167636Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:05.167640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2779 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d222e61b-f3504538-df47a84e-6a643c95_0
2025-09-30T14:58:05.167716Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896671767251274:12049]
2025-09-30T14:58:05.167862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2779 sessionId: src_id|d222e61b-f3504538-df47a84e-6a643c95_0 is DEAD
2025-09-30T14:58:05.168048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d222e61b-f3504538-df47a84e-6a643c95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:05.168061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d222e61b-f3504538-df47a84e-6a643c95_0] Write session will restart in 0.006851s
2025-09-30T14:58:05.168085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d222e61b-f3504538-df47a84e-6a643c95_0] Write session: Do CDS request
2025-09-30T14:58:05.168091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d222e61b-f3504538-df47a84e-6a643c95_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:05.175780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d222e61b-f3504538-df47a84e-6a643c95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:05.175901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:05.175915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2780
2025-09-30T14:58:05.176069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2780 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:05.176105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2780 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:05.176116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2780 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:05.176120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:05.176619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2780 sessionId:  describe result for acl check
2025-09-30T14:58:05.176670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:05.176672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:05.176674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:05.176681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896671767251314:6273] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:05.177311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896671767251314:6273] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:05.179650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896671767251314:6273] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:05.185061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:05.185304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896671767251314:6273] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:05.185322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896671767251314:6273] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:05.185326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896671767251314:6273] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:05.185335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2780 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:05.188960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:05.189244Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:05.189260Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:05.189274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:05.189342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:05.189394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896671677457642:8572]
2025-09-30T14:58:05.190124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:05.190561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:05.190633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:05.191014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:05.191090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.191098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.191099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.191101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.191111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.191113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.191115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.191116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.191118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.191120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.191121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.191122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.191123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.191125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.191127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.191134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.191145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.191149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.191153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.191156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.191160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.191164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.191168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.191172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.191176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.191180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.191184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.191188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.191192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.191196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.191206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.191215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.191222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.191231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.191236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.191258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.191264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.191270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.191275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.191281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.191286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.191292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.191298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.191303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.191309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.191314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.191320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.191325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.191340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.191346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.191352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.191358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.191363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.191368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.191372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.191377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.191381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.191386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.191391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.191397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.191440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:05.197296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:05.198737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:05.198761Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:05.198763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:05.198768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:05.198775Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2779 [2:7555896671677457642:8572]
2025-09-30T14:58:05.198796Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:05.198818Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:05.198825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:05.198829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:05.198831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:05.198849Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:05.198863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:05.198872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:05.198942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.198951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.198953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.198957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:05.198960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:05.199036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:05.199044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.199059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.199075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.199238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2779
2025-09-30T14:58:05.199271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2779
2025-09-30T14:58:05.199098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:05.199122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251393:6273], now have 1 active actors on pipe
2025-09-30T14:58:05.199125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251276:2454], now have 1 active actors on pipe
2025-09-30T14:58:05.199132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896671677457636:8572]
2025-09-30T14:58:05.199135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896671677457636:8572]
2025-09-30T14:58:05.199137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896671677457636:8572]
2025-09-30T14:58:05.199150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:05.199165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:05.199165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:05.199173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:05.199175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:05.199179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:05.199183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:05.199221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896671677457636:8572]
2025-09-30T14:58:05.199231Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:05.199273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:05.199385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.199395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.199441Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:05.199450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:05.199453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:05.199459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:05.199470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:05.199484Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:05.199503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:05.199670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.199676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.199701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:05.199799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2780 partition: 0 MaxSeqNo: 42 sessionId: src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0
2025-09-30T14:58:05.200219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d222e61b-f3504538-df47a84e-6a643c95_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:05.203436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0] Write session: try to update token
2025-09-30T14:58:05.203461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:05.218611Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:05.218637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:05.218648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896671677457636:8572]
2025-09-30T14:58:05.218699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:05.218711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:05.218915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:05.219174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:05.219372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:05.220278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2780 sessionId: src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:05.219580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:05.219887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:05.219942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:05.223470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:05.223492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:05.223495Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:05.223498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:05.223508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896671677457636:8572]
2025-09-30T14:58:05.223512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896671677457636:8572]
2025-09-30T14:58:05.223516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896671677457636:8572]
2025-09-30T14:58:05.223569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:05.223577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.223575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:05.223583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:05.223584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:05.223587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:05.223737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:05.223865Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:05.267679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896671767251406:12049]
2025-09-30T14:58:05.268031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2779, pipe: [1:7555896671767251406:12049]
2025-09-30T14:58:05.339463Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:05.339938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.339956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.339977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251406:12049], now have 1 active actors on pipe
2025-09-30T14:58:05.340135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:05.343339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:05.343425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2780 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0
2025-09-30T14:58:05.343611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2780 sessionId: src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0 is DEAD
2025-09-30T14:58:05.343786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:05.343801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0] Write session will restart in 0.005205s
2025-09-30T14:58:05.343779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:05.343824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896671767251406:12049]
2025-09-30T14:58:05.343830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0] Write session: Do CDS request
2025-09-30T14:58:05.343855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:05.349818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:05.351530Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:05.351545Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2781
2025-09-30T14:58:05.351756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2781 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:05.351791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2781 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:05.351802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2781 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:05.351806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:05.352342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2781 sessionId:  describe result for acl check
2025-09-30T14:58:05.352373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:05.352380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:05.352382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:05.352389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896671767251472:6282] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:05.352929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896671767251472:6282] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:05.356169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896671767251472:6282] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:05.358586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:05.362514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:05.362956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:05.362968Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:05.362984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:05.363072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:05.363118Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896671677457810:8567]
2025-09-30T14:58:05.363216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896671767251472:6282] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:05.363233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896671767251472:6282] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:05.363236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896671767251472:6282] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:05.363260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2781 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:05.363794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:05.364262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:05.364350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:05.364749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:05.364832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.364834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.364836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.364839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.364840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.364842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.364843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.364844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.364845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.364846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.364848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.364849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.364850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.364851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.364852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.364859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.364871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.364875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.364879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.364883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.364888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.364892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.364910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.364914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.364918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.364922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.364925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.364929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.364932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.364937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.364946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.364954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.364961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.364966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.364974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.364980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.364984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.364990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.364995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.365000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.365005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.365011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.365016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.365022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.365027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.365032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.365037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.365043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.365047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.365052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.365056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.365062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.365068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.365073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.365078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.365083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.365088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.365093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.365098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.365103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.365152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:05.371041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:05.372039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:05.372061Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:05.372065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:05.372069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:05.372077Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2780 [2:7555896671677457810:8567]
2025-09-30T14:58:05.372099Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:05.372117Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:05.372121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:05.372124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:05.372126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:05.372145Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:05.372153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:05.372161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:05.372241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.372243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.372246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.372249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:05.372252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:05.372333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:05.372336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.372351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.372362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.372377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:05.372397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896671677457805:8567]
2025-09-30T14:58:05.372399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896671677457805:8567]
2025-09-30T14:58:05.372401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896671677457805:8567]
2025-09-30T14:58:05.372417Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:05.372438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:05.372453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:05.372457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:05.372495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896671677457805:8567]
2025-09-30T14:58:05.372498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:05.375321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:05.375341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:05.375347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:05.375355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:05.375565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251553:6282], now have 1 active actors on pipe
2025-09-30T14:58:05.375577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251432:2454], now have 1 active actors on pipe
2025-09-30T14:58:05.376003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2780
2025-09-30T14:58:05.376042Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2780
2025-09-30T14:58:05.376156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.376171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.376203Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:05.376214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:05.376219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:05.376222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:05.376236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:05.376253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:05.376285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:05.376752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.376768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.376790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:05.376939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2781 partition: 0 MaxSeqNo: 42 sessionId: src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0
2025-09-30T14:58:05.377354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb53fc6f-a8a51e28-37766283-b7a6f4d7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:05.380258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0] Write session: try to update token
2025-09-30T14:58:05.380279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:05.391350Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:05.391372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:05.391375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:05.391378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:05.391387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896671677457805:8567]
2025-09-30T14:58:05.391394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896671677457805:8567]
2025-09-30T14:58:05.391399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896671677457805:8567]
2025-09-30T14:58:05.391441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:05.391458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.391461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:05.391623Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:05.393133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:05.393141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:05.393146Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:05.409144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2781 sessionId: src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:05.412244Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:05.450443Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896671767251564:12049]
2025-09-30T14:58:05.451665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2780, pipe: [1:7555896671767251564:12049]
2025-09-30T14:58:05.507566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:05.508319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.508333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.508350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251564:12049], now have 1 active actors on pipe
2025-09-30T14:58:05.511040Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:05.511056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:05.511065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:05.511136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2781 reason: error at write: Disconnected sessionId: src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0
2025-09-30T14:58:05.511354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2781 sessionId: src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0 is DEAD
2025-09-30T14:58:05.511430Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:05.511472Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896671767251564:12049]
2025-09-30T14:58:05.512285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:05.512296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0] Write session will restart in 0.005842s
2025-09-30T14:58:05.512320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0] Write session: Do CDS request
2025-09-30T14:58:05.512329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:05.519759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:05.520979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:05.521009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2782
2025-09-30T14:58:05.521149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2782 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:05.521184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2782 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:05.521195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2782 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:05.521200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:05.521639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2782 sessionId:  describe result for acl check
2025-09-30T14:58:05.521674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:05.521681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:05.521683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:05.521689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896671767251592:6297] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:05.522200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896671767251592:6297] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:05.524578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896671767251592:6297] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:05.527442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896671767251592:6297] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:05.527458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896671767251592:6297] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:05.527462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896671767251592:6297] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:05.527471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2782 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:05.528621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:05.532084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:05.532327Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:05.532341Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:05.532353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:05.532427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:05.532474Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896671677457933:8548]
2025-09-30T14:58:05.533171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:05.533502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:05.533560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:05.533970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:05.534053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.534061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.534062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.534063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.534065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.534066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.534068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.534069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.534070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.534072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.534073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.534075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.534077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.534078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.534080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.534086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.534097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.534102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.534107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.534112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.534117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.534122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.534126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.534130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.534134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.534138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.534143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.534147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.534151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.534155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.534165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.534174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.534181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.534193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.534199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.534205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.534210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.534216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.534227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.534233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.534243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.534249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.534255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.534261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.534272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.534278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.534287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.534293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.534298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.534304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.534310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.534321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.534327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.534339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.534349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.534355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.534366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.534371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.534381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.534386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.534438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:05.540312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:05.541364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:05.541387Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:05.541390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:05.541396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:05.541403Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2781 [2:7555896671677457933:8548]
2025-09-30T14:58:05.541421Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:05.541438Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:05.541442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:05.541445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:05.541448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:05.541464Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:05.541472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:05.541480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:05.541559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.541567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.541569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.541574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:05.541577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:05.541818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2781
2025-09-30T14:58:05.541830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2781
2025-09-30T14:58:05.542113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:05.542123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.542137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.542150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.542174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:05.542197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251697:6297], now have 1 active actors on pipe
2025-09-30T14:58:05.542206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251579:2454], now have 1 active actors on pipe
2025-09-30T14:58:05.542222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.542231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.542250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896671677457928:8548]
2025-09-30T14:58:05.542256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896671677457928:8548]
2025-09-30T14:58:05.542257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896671677457928:8548]
2025-09-30T14:58:05.542268Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:05.542282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:05.542285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:05.542289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:05.542291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:05.542301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:05.542306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:05.542327Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2073990-504c4725-c2321f5e-3474bba7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:05.542340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:05.542344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:05.542346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:05.542356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:05.542373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:05.542424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896671677457928:8548]
2025-09-30T14:58:05.542434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:05.542442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:05.542443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:05.542640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.542654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.542680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:05.542778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2782 partition: 0 MaxSeqNo: 42 sessionId: src_id|a2073990-504c4725-c2321f5e-3474bba7_0
2025-09-30T14:58:05.543186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330d21cb-b3e583e9-476d8586-2660f3d4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a2073990-504c4725-c2321f5e-3474bba7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:05.546120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2073990-504c4725-c2321f5e-3474bba7_0] Write session: try to update token
2025-09-30T14:58:05.546139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2073990-504c4725-c2321f5e-3474bba7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:05.555093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:05.555119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:05.555130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896671677457928:8548]
2025-09-30T14:58:05.555177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:05.555181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:05.555398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:05.555567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:05.555729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:05.555891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:05.556140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:05.556184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:05.562089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2782 sessionId: src_id|a2073990-504c4725-c2321f5e-3474bba7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:05.564958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:05.566091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.566120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.566141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:05.566144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:05.566146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:05.566149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:05.566162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896671677457928:8548]
2025-09-30T14:58:05.566166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896671677457928:8548]
2025-09-30T14:58:05.566169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896671677457928:8548]
2025-09-30T14:58:05.566201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:05.566207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:05.566216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:05.566223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.566225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:05.566233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:05.566373Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:05.611737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896671767251709:12049]
2025-09-30T14:58:05.612367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2781, pipe: [1:7555896671767251709:12049]
2025-09-30T14:58:05.683031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:05.683547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:05.683590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251709:12049], now have 1 active actors on pipe
2025-09-30T14:58:05.683964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:05.684059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:05.684063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:05.684137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2782 reason: error at write: Disconnected sessionId: src_id|a2073990-504c4725-c2321f5e-3474bba7_0
2025-09-30T14:58:05.684294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2782 sessionId: src_id|a2073990-504c4725-c2321f5e-3474bba7_0 is DEAD
2025-09-30T14:58:05.684450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896671767251709:12049]
2025-09-30T14:58:05.684466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:05.686780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2073990-504c4725-c2321f5e-3474bba7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:05.686793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2073990-504c4725-c2321f5e-3474bba7_0] Write session will restart in 0.007322s
2025-09-30T14:58:05.686820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2073990-504c4725-c2321f5e-3474bba7_0] Write session: Do CDS request
2025-09-30T14:58:05.686826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2073990-504c4725-c2321f5e-3474bba7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:05.695725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2073990-504c4725-c2321f5e-3474bba7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:05.696073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:05.696090Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2783
2025-09-30T14:58:05.696326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2783 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:05.696371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2783 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:05.696377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2783 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:05.696397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:05.697977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2783 sessionId:  describe result for acl check
2025-09-30T14:58:05.698031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:05.698039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:05.698041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:05.698047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896671767251721:6306] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:05.698662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896671767251721:6306] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:05.703567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896671767251721:6306] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:05.715937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896671767251721:6306] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:05.715951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896671767251721:6306] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:05.715954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896671767251721:6306] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:05.715962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2783 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:05.724728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:05.729523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:05.729798Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:05.729804Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:05.729818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:05.729890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:05.729936Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896671677458058:8557]
2025-09-30T14:58:05.730632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:05.731327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:05.731404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:05.731791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:05.731881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.731882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.731884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.731885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.731887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.731889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.731890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.731891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.731893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.731895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.731896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.731897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.731899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.731900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.731902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.731909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.731921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.731927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.731931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.731936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.731940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.731945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.731949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.731953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.731958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.731962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.731966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.731971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.731975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.731980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.731988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.731997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.732004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.732010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.732015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.732021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.732027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.732034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.732039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.732046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.732050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.732056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.732062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.732067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.732072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.732079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.732085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.732090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.732094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.732103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.732109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.732115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.732121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.732126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.732131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.732137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.732142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.732148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.732153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.732160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.732214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:05.740048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:05.741028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:05.741036Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:05.741040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:05.741045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:05.741052Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2782 [2:7555896671677458058:8557]
2025-09-30T14:58:05.741072Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:05.741090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:05.741094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:05.741098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:05.741101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:05.741120Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:05.741128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:05.741136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:05.741210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.741213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.741218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.741222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:05.741224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:05.741305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:05.741308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.741325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.741339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.741358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:05.741377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896671677458053:8557]
2025-09-30T14:58:05.741380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896671677458053:8557]
2025-09-30T14:58:05.741383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896671677458053:8557]
2025-09-30T14:58:05.741399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:05.741418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:05.741435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:05.741438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:05.741477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896671677458053:8557]
2025-09-30T14:58:05.741480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:05.742103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2782
2025-09-30T14:58:05.742109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2782
2025-09-30T14:58:05.741825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:05.741837Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:05.741840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:05.741846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:05.742351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251806:6306], now have 1 active actors on pipe
2025-09-30T14:58:05.742364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251711:2454], now have 1 active actors on pipe
2025-09-30T14:58:05.742380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.742387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.742420Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:05.742441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:05.742447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:05.742450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:05.742462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:05.742476Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:05.742496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:05.742875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.742887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.742904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:05.743045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2783 partition: 0 MaxSeqNo: 42 sessionId: src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0
2025-09-30T14:58:05.743444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2073990-504c4725-c2321f5e-3474bba7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:05.746392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0] Write session: try to update token
2025-09-30T14:58:05.746418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:05.757274Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:05.757300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:05.757308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:05.757310Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:05.757321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896671677458053:8557]
2025-09-30T14:58:05.757327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896671677458053:8557]
2025-09-30T14:58:05.757331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896671677458053:8557]
2025-09-30T14:58:05.757379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:05.757387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.757390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:05.757545Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:05.757710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:05.757718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:05.757723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:05.764064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2783 sessionId: src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:05.767007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:05.784793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896671767251845:12049]
2025-09-30T14:58:05.785219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2782, pipe: [1:7555896671767251845:12049]
2025-09-30T14:58:05.881088Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:05.882087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.882102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.882161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251845:12049], now have 1 active actors on pipe
2025-09-30T14:58:05.882430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:05.882435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896671767251845:12049]
2025-09-30T14:58:05.882446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:05.882456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:05.882515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2783 reason: error at write: Disconnected sessionId: src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0
2025-09-30T14:58:05.882694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2783 sessionId: src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0 is DEAD
2025-09-30T14:58:05.883036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:05.883047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0] Write session will restart in 0.008687s
2025-09-30T14:58:05.883071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0] Write session: Do CDS request
2025-09-30T14:58:05.883077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:05.882440Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:05.892859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:05.892937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:05.892970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2784
2025-09-30T14:58:05.893096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2784 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:05.893125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2784 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:05.893131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2784 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:05.893135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:05.893911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2784 sessionId:  describe result for acl check
2025-09-30T14:58:05.893953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:05.893955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:05.893958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:05.893964Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896671767251877:6311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:05.894536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896671767251877:6311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:05.897937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896671767251877:6311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:05.900296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:05.901921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896671767251877:6311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:05.901939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896671767251877:6311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:05.901943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896671767251877:6311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:05.901952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2784 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:05.904266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:05.904530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:05.904547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:05.904560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:05.904621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:05.904668Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896671677458183:8554]
2025-09-30T14:58:05.905389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:05.905762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:05.905842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:05.906236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:05.906354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.906365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.906366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.906367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.906369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.906370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.906372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.906373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.906374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.906375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.906377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.906379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.906380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.906381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.906383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.906390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.906400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.906404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.906407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.906411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.906415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.906419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.906423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.906427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.906431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.906434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.906438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.906441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.906445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.906448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.906459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.906467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:05.906474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.906481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:05.906486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.906491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:05.906496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.906503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:05.906508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.906514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:05.906519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.906534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:05.906545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.906551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:05.906563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.906569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:05.906575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.906580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:05.906585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.906590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:05.906595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.906601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.906614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.906623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.906628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.906641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.906652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.906657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:05.906663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.906674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:05.906720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:05.913486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:05.914577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:05.914653Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:05.914656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:05.914660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:05.914669Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2783 [2:7555896671677458183:8554]
2025-09-30T14:58:05.914689Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:05.914710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:05.914713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:05.914717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:05.914720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:05.914739Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:05.914747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:05.914755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:05.914828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.914839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.914842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.914847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:05.914850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:05.914926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:05.914937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.914952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:05.914962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:05.914977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:05.914998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251969:6311], now have 1 active actors on pipe
2025-09-30T14:58:05.915009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251848:2454], now have 1 active actors on pipe
2025-09-30T14:58:05.915017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896671677458176:8554]
2025-09-30T14:58:05.915025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896671677458176:8554]
2025-09-30T14:58:05.915027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896671677458176:8554]
2025-09-30T14:58:05.915039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:05.915055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:05.915056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:05.915069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:05.915072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:05.915075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:05.915082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:05.915125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896671677458176:8554]
2025-09-30T14:58:05.915136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:05.915142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:05.915128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2783
2025-09-30T14:58:05.915131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2783
2025-09-30T14:58:05.915340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.915355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.915384Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a562c593-db44abd3-872d4cff-c55a607d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:05.915398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:05.915408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:05.915410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:05.915431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:05.915449Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:05.915470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:05.915644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.915656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.915682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:05.915785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2784 partition: 0 MaxSeqNo: 42 sessionId: src_id|a562c593-db44abd3-872d4cff-c55a607d_0
2025-09-30T14:58:05.916212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec1e5429-db4b2760-89c6ac87-d83e4e4f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a562c593-db44abd3-872d4cff-c55a607d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:05.919334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a562c593-db44abd3-872d4cff-c55a607d_0] Write session: try to update token
2025-09-30T14:58:05.919365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a562c593-db44abd3-872d4cff-c55a607d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:05.928210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:05.928235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:05.928249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896671677458176:8554]
2025-09-30T14:58:05.928301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:05.928302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:05.928519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:05.928693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:05.928856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:05.929030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:05.929258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:05.929315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:05.935872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2784 sessionId: src_id|a562c593-db44abd3-872d4cff-c55a607d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:05.938962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:05.939718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:05.939753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:05.939775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:05.939778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:05.939787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:05.939789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:05.939798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896671677458176:8554]
2025-09-30T14:58:05.939801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896671677458176:8554]
2025-09-30T14:58:05.939805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896671677458176:8554]
2025-09-30T14:58:05.939851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:05.939856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:05.939862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:05.939865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:05.939869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:05.939873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:05.940011Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:05.982404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896671767251980:12049]
2025-09-30T14:58:05.982750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2783, pipe: [1:7555896671767251980:12049]
2025-09-30T14:58:06.054610Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:06.055632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:06.055688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896671767251980:12049], now have 1 active actors on pipe
2025-09-30T14:58:06.055853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:06.055917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:06.056502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a562c593-db44abd3-872d4cff-c55a607d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:06.055961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:06.055973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:06.056513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a562c593-db44abd3-872d4cff-c55a607d_0] Write session will restart in 0.005194s
2025-09-30T14:58:06.055975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896671767251980:12049]
2025-09-30T14:58:06.056042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2784 reason: error at write: Disconnected sessionId: src_id|a562c593-db44abd3-872d4cff-c55a607d_0
2025-09-30T14:58:06.056579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a562c593-db44abd3-872d4cff-c55a607d_0] Write session: Do CDS request
2025-09-30T14:58:06.056589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a562c593-db44abd3-872d4cff-c55a607d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:06.056176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2784 sessionId: src_id|a562c593-db44abd3-872d4cff-c55a607d_0 is DEAD
2025-09-30T14:58:06.065728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a562c593-db44abd3-872d4cff-c55a607d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:06.065866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:06.065884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2785
2025-09-30T14:58:06.066030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2785 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:06.066076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2785 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:06.066082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2785 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:06.066087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:06.066594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2785 sessionId:  describe result for acl check
2025-09-30T14:58:06.066628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:06.066635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:06.066637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:06.066643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896676062219312:6327] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:06.067218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896676062219312:6327] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:06.070750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896676062219312:6327] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:06.072369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:06.073366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:06.073596Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:06.073620Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:06.073636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:06.073705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:06.073751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896675972425605:8553]
2025-09-30T14:58:06.074472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:06.077132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:06.077228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:06.077707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:06.077818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.077825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.077826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.077828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.077829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.077831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.077832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.077834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.077835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.077836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.077838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.077839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.077840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.077842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.077843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.077851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.077861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.077865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.077869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.077873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.077876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.077880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.077884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.077888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.077895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.077898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.077902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.077906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.077909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.077912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.077927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.077936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.077942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.077947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.077952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.077957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.077962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.077967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.077971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.077976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.077981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.077985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.077990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.077995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.078000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.078005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.078009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.078014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.078018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.078025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.078030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.078035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.078039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.078044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.078051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.078055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.078083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.078093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.078098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.078108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.078153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:06.081299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896676062219312:6327] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:06.081318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896676062219312:6327] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:06.081321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896676062219312:6327] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:06.081332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2785 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:06.087269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:06.088501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:06.088522Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:06.088525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:06.088530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:06.088537Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2784 [2:7555896675972425605:8553]
2025-09-30T14:58:06.088554Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:06.088571Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:06.088574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:06.088577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:06.088580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:06.088596Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:06.088603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:06.088610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:06.088678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.088699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.088701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.088705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:06.088707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:06.088777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:06.088787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.088801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.088813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.088831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:06.088852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896675972425599:8553]
2025-09-30T14:58:06.088855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896675972425599:8553]
2025-09-30T14:58:06.088857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896675972425599:8553]
2025-09-30T14:58:06.088869Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:06.088878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:06.088882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:06.088884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:06.088903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219405:6327], now have 1 active actors on pipe
2025-09-30T14:58:06.088911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219278:2454], now have 1 active actors on pipe
2025-09-30T14:58:06.088916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:06.088932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:06.088935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:06.088976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896675972425599:8553]
2025-09-30T14:58:06.088985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:06.089023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:06.089063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2784
2025-09-30T14:58:06.089064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2784
2025-09-30T14:58:06.089146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.089161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.089207Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f42fe052-30764e35-47f262ad-fa18329_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:06.089220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:06.089229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:06.089232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:06.089243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:06.089260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:06.089282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:06.089447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.089458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.089473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:06.089566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2785 partition: 0 MaxSeqNo: 42 sessionId: src_id|f42fe052-30764e35-47f262ad-fa18329_0
2025-09-30T14:58:06.089920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a562c593-db44abd3-872d4cff-c55a607d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f42fe052-30764e35-47f262ad-fa18329_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:06.092847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f42fe052-30764e35-47f262ad-fa18329_0] Write session: try to update token
2025-09-30T14:58:06.092869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f42fe052-30764e35-47f262ad-fa18329_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:06.102858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:06.102875Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:06.102878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:06.102880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:06.102891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896675972425599:8553]
2025-09-30T14:58:06.102896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896675972425599:8553]
2025-09-30T14:58:06.102901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896675972425599:8553]
2025-09-30T14:58:06.102948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:06.102958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.102959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:06.102962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:06.102967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:06.102973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:06.103111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:06.117964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2785 sessionId: src_id|f42fe052-30764e35-47f262ad-fa18329_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:06.121026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:06.159401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896676062219412:12049]
2025-09-30T14:58:06.159912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2784, pipe: [1:7555896676062219412:12049]
2025-09-30T14:58:06.225236Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:06.226003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.226025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.226050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219412:12049], now have 1 active actors on pipe
2025-09-30T14:58:06.226538Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:06.227074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f42fe052-30764e35-47f262ad-fa18329_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:06.227088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f42fe052-30764e35-47f262ad-fa18329_0] Write session will restart in 0.008111s
2025-09-30T14:58:06.227114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f42fe052-30764e35-47f262ad-fa18329_0] Write session: Do CDS request
2025-09-30T14:58:06.227120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f42fe052-30764e35-47f262ad-fa18329_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:06.226379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:06.226399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:06.226392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896676062219412:12049]
2025-09-30T14:58:06.226426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:06.226467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2785 reason: error at write: Disconnected sessionId: src_id|f42fe052-30764e35-47f262ad-fa18329_0
2025-09-30T14:58:06.226680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2785 sessionId: src_id|f42fe052-30764e35-47f262ad-fa18329_0 is DEAD
2025-09-30T14:58:06.236843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f42fe052-30764e35-47f262ad-fa18329_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:06.236976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:06.237004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2786
2025-09-30T14:58:06.237305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2786 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:06.237348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2786 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:06.237355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2786 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:06.237359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:06.237891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2786 sessionId:  describe result for acl check
2025-09-30T14:58:06.237931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:06.237933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:06.237934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:06.237940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896676062219425:6329] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:06.238464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896676062219425:6329] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:06.241926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896676062219425:6329] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:06.246598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896676062219425:6329] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:06.246614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896676062219425:6329] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:06.246618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896676062219425:6329] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:06.246627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2786 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:06.249060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:06.253483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:06.253742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:06.253753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:06.253768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:06.253836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:06.253881Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896675972425745:8550]
2025-09-30T14:58:06.254539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:06.255789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:06.255862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:06.256292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:06.256363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.256369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.256371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.256372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.256373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.256375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.256376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.256378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.256379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.256380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.256382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.256383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.256385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.256386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.256388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.256395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.256408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.256413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.256418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.256423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.256427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.256432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.256438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.256442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.256446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.256451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.256455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.256458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.256462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.256466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.256478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.256488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.256497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.256503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.256510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.256520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.256534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.256544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.256550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.256560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.256569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.256575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.256580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.256585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.256590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.256596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.256602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.256608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.256614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.256622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.256627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.256633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.256638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.256644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.256650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.256656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.256662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.256670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.256676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.256682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.256738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:06.262576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:06.263762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:06.263778Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:06.263781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:06.263786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:06.263794Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2785 [2:7555896675972425745:8550]
2025-09-30T14:58:06.263812Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:06.263832Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:06.263835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:06.263838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:06.263841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:06.263859Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:06.263866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:06.263878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:06.264187Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2785
2025-09-30T14:58:06.264237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2785
2025-09-30T14:58:06.263944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.263956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.263959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.263962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:06.263966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:06.264042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:06.264045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.264059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.264071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.264088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:06.264110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219414:2454], now have 1 active actors on pipe
2025-09-30T14:58:06.264114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219537:6329], now have 1 active actors on pipe
2025-09-30T14:58:06.264121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896675972425740:8550]
2025-09-30T14:58:06.264124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896675972425740:8550]
2025-09-30T14:58:06.264126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896675972425740:8550]
2025-09-30T14:58:06.264142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:06.264158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:06.264174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:06.264178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:06.264186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:06.264190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:06.264192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:06.264224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896675972425740:8550]
2025-09-30T14:58:06.264227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:06.264240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:06.264418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.264428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.264455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:06.264462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:06.264467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:06.264470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:06.264480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:06.264498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:06.264514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:06.264705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.264714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.264729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:06.264879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2786 partition: 0 MaxSeqNo: 42 sessionId: src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0
2025-09-30T14:58:06.265341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f42fe052-30764e35-47f262ad-fa18329_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:06.268863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0] Write session: try to update token
2025-09-30T14:58:06.268908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:06.278759Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:06.278781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:06.278784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:06.278786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:06.278797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896675972425740:8550]
2025-09-30T14:58:06.278802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896675972425740:8550]
2025-09-30T14:58:06.278806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896675972425740:8550]
2025-09-30T14:58:06.278853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:06.278860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.278862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:06.279042Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:06.281986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:06.282001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:06.282009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:06.304320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2786 sessionId: src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:06.307608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:06.325911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896676062219554:12049]
2025-09-30T14:58:06.327870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2785, pipe: [1:7555896676062219554:12049]
2025-09-30T14:58:06.398608Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:06.399302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.399321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.399342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219554:12049], now have 1 active actors on pipe
2025-09-30T14:58:06.399702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896676062219554:12049]
2025-09-30T14:58:06.399882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:06.400282Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:06.399931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:06.399939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:06.399995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2786 reason: error at write: Disconnected sessionId: src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0
2025-09-30T14:58:06.400171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2786 sessionId: src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0 is DEAD
2025-09-30T14:58:06.403363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:06.403377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0] Write session will restart in 0.008838s
2025-09-30T14:58:06.403405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0] Write session: Do CDS request
2025-09-30T14:58:06.403428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:06.413753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:06.414131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:06.414146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2787
2025-09-30T14:58:06.414311Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2787 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:06.414336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2787 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:06.414341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2787 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:06.414345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:06.414751Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2787 sessionId:  describe result for acl check
2025-09-30T14:58:06.414780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:06.414784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:06.414786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:06.414792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896676062219670:6362] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:06.415331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896676062219670:6362] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:06.416412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:06.417179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896676062219670:6362] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:06.421176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:06.421465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:06.421478Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:06.421493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:06.421568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:06.421615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896675972425907:8496]
2025-09-30T14:58:06.422299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:06.422765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:06.422837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:06.423215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:06.423309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.423316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.423317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.423319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.423320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.423321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.423327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.423328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.423329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.423330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.423331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.423332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.423334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.423335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.423336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.423342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.423352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.423356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.423359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.423363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.423366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.423369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.423373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.423376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.423380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.423384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.423387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.423390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.423393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.423397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.423407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.423414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.423420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.423424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.423429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.423433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.423438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.423445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.423449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.423454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.423457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.423461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.423468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.423472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.423476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.423480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.423484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.423488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.423493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.423497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.423502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.423507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.423510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.423515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.423519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.423523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.423528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.423532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.423536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.423541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.423587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:06.423822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896676062219670:6362] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:06.423840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896676062219670:6362] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:06.423844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896676062219670:6362] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:06.423853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2787 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:06.431056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:06.432348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:06.432371Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:06.432374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:06.432378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:06.432385Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2786 [2:7555896675972425907:8496]
2025-09-30T14:58:06.432406Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:06.432426Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:06.432433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:06.432437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:06.432439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:06.432456Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:06.432463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:06.432470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:06.432538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.432546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.432548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.432552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:06.432555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:06.432633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:06.432641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.432654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.432663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.432678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:06.432703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219572:2454], now have 1 active actors on pipe
2025-09-30T14:58:06.432715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896675972425902:8496]
2025-09-30T14:58:06.432720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896675972425902:8496]
2025-09-30T14:58:06.432722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896675972425902:8496]
2025-09-30T14:58:06.432735Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:06.432749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219707:6362], now have 1 active actors on pipe
2025-09-30T14:58:06.432754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:06.432758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:06.432759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:06.432761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:06.432772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:06.432775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:06.432816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896675972425902:8496]
2025-09-30T14:58:06.432829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:06.432836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:06.432845Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2786
2025-09-30T14:58:06.432882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2786
2025-09-30T14:58:06.433109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.433132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.433162Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:06.433176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:06.433180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:06.433181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:06.433194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:06.433205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:06.433222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:06.433407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.433416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.433431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:06.433528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2787 partition: 0 MaxSeqNo: 42 sessionId: src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0
2025-09-30T14:58:06.433942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f7aa6a23-d6ad8d0a-e2ce7e4c-5761c287_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:06.437188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0] Write session: try to update token
2025-09-30T14:58:06.437212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:06.446609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:06.446628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:06.446631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:06.446634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:06.446657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896675972425902:8496]
2025-09-30T14:58:06.446663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896675972425902:8496]
2025-09-30T14:58:06.446667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896675972425902:8496]
2025-09-30T14:58:06.446712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:06.446719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.446722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:06.446895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:06.446898Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:06.446901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:06.446905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:06.457899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2787 sessionId: src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:06.461031Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:06.500004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896676062219729:12049]
2025-09-30T14:58:06.500492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2786, pipe: [1:7555896676062219729:12049]
2025-09-30T14:58:06.569913Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:06.570524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.570539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.570559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219729:12049], now have 1 active actors on pipe
2025-09-30T14:58:06.570741Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:06.570827Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:06.570828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:06.570852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:06.570877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896676062219729:12049]
2025-09-30T14:58:06.570937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2787 reason: error at write: Disconnected sessionId: src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0
2025-09-30T14:58:06.571137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2787 sessionId: src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0 is DEAD
2025-09-30T14:58:06.571406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:06.571417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0] Write session will restart in 0.007023s
2025-09-30T14:58:06.571447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0] Write session: Do CDS request
2025-09-30T14:58:06.571457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:06.580567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:06.580637Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:06.580653Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2788
2025-09-30T14:58:06.581035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2788 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:06.581083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2788 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:06.581094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2788 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:06.581099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:06.581592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2788 sessionId:  describe result for acl check
2025-09-30T14:58:06.581629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:06.581636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:06.581638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:06.581644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896676062219784:6384] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:06.582192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896676062219784:6384] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:06.584958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896676062219784:6384] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:06.590020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:06.590230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896676062219784:6384] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:06.590249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896676062219784:6384] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:06.590253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896676062219784:6384] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:06.590270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2788 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:06.590590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:06.590839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:06.590856Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:06.590872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:06.590938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:06.591000Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896675972426038:8478]
2025-09-30T14:58:06.591735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:06.592054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:06.592109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:06.592465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:06.592548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.592556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.592557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.592558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.592560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.592561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.592562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.592563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.592564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.592565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.592567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.592568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.592569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.592570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.592572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.592577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.592589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.592594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.592598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.592602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.592607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.592611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.592615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.592620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.592624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.592629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.592633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.592638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.592642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.592647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.592655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.592664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.592670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.592677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.592682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.592689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.592695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.592701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.592707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.592720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.592725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.592731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.592737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.592743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.592753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.592759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.592771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.592778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.592788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.592796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.592807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.592812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.592817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.592827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.592831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.592841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.592845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.592850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.592859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.592865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.592923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:06.598744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:06.599695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:06.599711Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:06.599715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:06.599719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:06.599726Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2787 [2:7555896675972426038:8478]
2025-09-30T14:58:06.599742Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:06.599758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:06.599765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:06.599769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:06.599772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:06.599791Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:06.599798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:06.599805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:06.599869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.599876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.599879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.599882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:06.599885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:06.599958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:06.599967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.599979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.599996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.600019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:06.600042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219731:2454], now have 1 active actors on pipe
2025-09-30T14:58:06.600053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219856:6384], now have 1 active actors on pipe
2025-09-30T14:58:06.600059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896675972426032:8478]
2025-09-30T14:58:06.600062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896675972426032:8478]
2025-09-30T14:58:06.600065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896675972426032:8478]
2025-09-30T14:58:06.600080Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:06.600095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:06.600105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:06.600110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:06.600113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:06.600116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:06.600118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:06.600160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896675972426032:8478]
2025-09-30T14:58:06.600172Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:06.600203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:06.600159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2787
2025-09-30T14:58:06.600204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2787
2025-09-30T14:58:06.600405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.600417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.600442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:06.600453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:06.600458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:06.600460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:06.600472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:06.600481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:06.600504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:06.600684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.600692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.600706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:06.600843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2788 partition: 0 MaxSeqNo: 42 sessionId: src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0
2025-09-30T14:58:06.601278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6eb6c0b-a5738e2c-3167ce23-fc5997e9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:06.604418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0] Write session: try to update token
2025-09-30T14:58:06.604440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:06.612730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:06.612748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:06.612750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:06.612753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:06.612764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896675972426032:8478]
2025-09-30T14:58:06.612769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896675972426032:8478]
2025-09-30T14:58:06.612773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896675972426032:8478]
2025-09-30T14:58:06.612813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:06.612820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.612823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:06.612828Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:06.612835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:06.612840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:06.612984Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:06.625743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2788 sessionId: src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:06.628654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:06.671039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896676062219868:12049]
2025-09-30T14:58:06.671293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2787, pipe: [1:7555896676062219868:12049]
2025-09-30T14:58:06.729776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:06.730558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.730573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.730596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219868:12049], now have 1 active actors on pipe
2025-09-30T14:58:06.730881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:06.730897Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:06.731000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896676062219868:12049]
2025-09-30T14:58:06.731035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2788 reason: error at write: Disconnected sessionId: src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0
2025-09-30T14:58:06.731043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:06.731120Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:06.731278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2788 sessionId: src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0 is DEAD
2025-09-30T14:58:06.731459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:06.731474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0] Write session will restart in 0.006034s
2025-09-30T14:58:06.731501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0] Write session: Do CDS request
2025-09-30T14:58:06.731508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:06.738842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:06.738976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:06.738992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2789
2025-09-30T14:58:06.739442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2789 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:06.739504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2789 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:06.739516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2789 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:06.739522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:06.740043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2789 sessionId:  describe result for acl check
2025-09-30T14:58:06.740086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:06.740093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:06.740095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:06.740101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896676062219885:6382] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:06.740684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896676062219885:6382] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:06.743117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896676062219885:6382] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:06.748073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896676062219885:6382] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:06.748093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896676062219885:6382] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:06.748106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896676062219885:6382] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:06.748116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2789 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:06.748126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:06.753397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:06.753652Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:06.753663Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:06.753675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:06.753733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:06.753793Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896675972426167:8473]
2025-09-30T14:58:06.754508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:06.754931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:06.754982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:06.755348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:06.755426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.755433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.755439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.755443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.755445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.755447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.755448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.755450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.755452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.755453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.755455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.755457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.755458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.755460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.755461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.755469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.755480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.755485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.755489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.755494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.755499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.755503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.755508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.755512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.755516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.755520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.755523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.755527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.755531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.755535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.755544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.755553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.755560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.755566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.755571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.755584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.755589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.755599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.755605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.755616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.755620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.755626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.755635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.755639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.755643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.755648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.755658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.755663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.755678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.755687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.755692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.755700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.755709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.755715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.755720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.755730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.755735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.755745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.755750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.755759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.755808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:06.761657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:06.763488Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2788
2025-09-30T14:58:06.763538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2788
2025-09-30T14:58:06.762962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:06.762985Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:06.762988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:06.762992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:06.763001Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2788 [2:7555896675972426167:8473]
2025-09-30T14:58:06.763018Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:06.763039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:06.763044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:06.763048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:06.763050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:06.763069Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:06.763077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:06.763087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:06.763165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.763167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.763170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.763174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:06.763177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:06.763276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:06.763279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.763294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.763307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.763326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:06.763348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219870:2454], now have 1 active actors on pipe
2025-09-30T14:58:06.763352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062219996:6382], now have 1 active actors on pipe
2025-09-30T14:58:06.763361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896675972426160:8473]
2025-09-30T14:58:06.763363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896675972426160:8473]
2025-09-30T14:58:06.763366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896675972426160:8473]
2025-09-30T14:58:06.763380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:06.763396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:06.763398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:06.763400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:06.763403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:06.763416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:06.763420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:06.763463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896675972426160:8473]
2025-09-30T14:58:06.763471Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:06.763492Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:06.763540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.763546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.763573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:06.763582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:06.763589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:06.763591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:06.763602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:06.763613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:06.763628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:06.763989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.763999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.764015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:06.764164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2789 partition: 0 MaxSeqNo: 42 sessionId: src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0
2025-09-30T14:58:06.764585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34e93bcb-57cf442c-7acfd5c4-d77d5f5f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:06.767793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0] Write session: try to update token
2025-09-30T14:58:06.767818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:06.777309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:06.777328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:06.777340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896675972426160:8473]
2025-09-30T14:58:06.777390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:06.777412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:06.777595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:06.777759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:06.777922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:06.778087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:06.778307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:06.778351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:06.785513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2789 sessionId: src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:06.788629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:06.789225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.789247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.789266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:06.789269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:06.789271Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:06.789272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:06.789281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896675972426160:8473]
2025-09-30T14:58:06.789285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896675972426160:8473]
2025-09-30T14:58:06.789288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896675972426160:8473]
2025-09-30T14:58:06.789344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:06.789348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:06.789354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.789355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:06.789357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:06.789360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:06.789501Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:06.831454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896676062220009:12049]
2025-09-30T14:58:06.831807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2788, pipe: [1:7555896676062220009:12049]
2025-09-30T14:58:06.903661Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:06.904281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:06.904319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062220009:12049], now have 1 active actors on pipe
2025-09-30T14:58:06.904868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:06.904909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:06.904954Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896676062220009:12049]
2025-09-30T14:58:06.905021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:06.905030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:06.905109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2789 reason: error at write: Disconnected sessionId: src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0
2025-09-30T14:58:06.905289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2789 sessionId: src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0 is DEAD
2025-09-30T14:58:06.905428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:06.905436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0] Write session will restart in 0.009353s
2025-09-30T14:58:06.905462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0] Write session: Do CDS request
2025-09-30T14:58:06.905469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:06.915881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:06.915921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:06.915938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2790
2025-09-30T14:58:06.916182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2790 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:06.916219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2790 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:06.916225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2790 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:06.916230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:06.916773Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2790 sessionId:  describe result for acl check
2025-09-30T14:58:06.916817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:06.916824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:06.916826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:06.916847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896676062220102:6390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:06.917442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896676062220102:6390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:06.919290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:06.919950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896676062220102:6390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:06.923126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:06.923381Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:06.923392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:06.923404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:06.923372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896676062220102:6390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:06.923390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896676062220102:6390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:06.923394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896676062220102:6390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:06.923403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2790 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:06.923471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:06.923515Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896675972426296:8468]
2025-09-30T14:58:06.924244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:06.924559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:06.924628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:06.925013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:06.925103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.925114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.925115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.925116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.925118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.925119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.925121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.925122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.925124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.925125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.925126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.925128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.925129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.925130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.925131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.925138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.925149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.925153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.925158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.925162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.925167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.925171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.925175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.925179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.925184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.925188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.925191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.925195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.925198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.925202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.925209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.925217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:06.925223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.925228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:06.925233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.925238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:06.925242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.925247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:06.925252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.925257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:06.925261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.925265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:06.925270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.925274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:06.925279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.925284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:06.925288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.925300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:06.925305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.925309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:06.925320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.925325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.925334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.925340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.925350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.925356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.925359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.925366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:06.925375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.925381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:06.925421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:06.930934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:06.931917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:06.931938Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:06.931942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:06.931946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:06.931954Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2789 [2:7555896675972426296:8468]
2025-09-30T14:58:06.931973Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:06.931990Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:06.931994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:06.931998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:06.932001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:06.932019Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:06.932027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:06.932035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:06.932102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.932112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.932115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.932118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:06.932122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:06.932198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:06.932207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.932221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:06.932237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:06.932256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:06.932282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062220011:2454], now have 1 active actors on pipe
2025-09-30T14:58:06.932291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896676062220139:6390], now have 1 active actors on pipe
2025-09-30T14:58:06.932298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896675972426291:8468]
2025-09-30T14:58:06.932305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896675972426291:8468]
2025-09-30T14:58:06.932308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896675972426291:8468]
2025-09-30T14:58:06.932320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:06.932336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:06.932340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:06.932346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:06.932349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:06.932355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:06.932358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:06.932365Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2789
2025-09-30T14:58:06.932374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2789
2025-09-30T14:58:06.932414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896675972426291:8468]
2025-09-30T14:58:06.932428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:06.932434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:06.932450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.932459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.932509Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15b50ba4-5ed50334-17734651-17b618ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:06.932522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:06.932526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:06.932535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:06.932547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:06.932563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:06.932586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:06.932757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:06.932766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:06.932785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:06.932878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2790 partition: 0 MaxSeqNo: 42 sessionId: src_id|15b50ba4-5ed50334-17734651-17b618ed_0
2025-09-30T14:58:06.933292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fcef1d4-ea56cc53-3fe19992-1a36a337_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|15b50ba4-5ed50334-17734651-17b618ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:06.936988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b50ba4-5ed50334-17734651-17b618ed_0] Write session: try to update token
2025-09-30T14:58:06.937013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b50ba4-5ed50334-17734651-17b618ed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:06.945082Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:06.945101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:06.945103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:06.945106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:06.945117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896675972426291:8468]
2025-09-30T14:58:06.945121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896675972426291:8468]
2025-09-30T14:58:06.945125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896675972426291:8468]
2025-09-30T14:58:06.945170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:06.945177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:06.945180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:06.945179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:06.945187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:06.945191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:06.945330Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:06.955024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2790 sessionId: src_id|15b50ba4-5ed50334-17734651-17b618ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:06.958128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:07.005376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896680357187447:12049]
2025-09-30T14:58:07.005632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2789, pipe: [1:7555896680357187447:12049]
2025-09-30T14:58:07.066276Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:07.067319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.067339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.067360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357187447:12049], now have 1 active actors on pipe
2025-09-30T14:58:07.067587Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:07.069256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:07.069323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896680357187447:12049]
2025-09-30T14:58:07.069358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:07.069446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2790 reason: status is not ok: tablet will be restarted right now sessionId: src_id|15b50ba4-5ed50334-17734651-17b618ed_0
2025-09-30T14:58:07.069655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2790 sessionId: src_id|15b50ba4-5ed50334-17734651-17b618ed_0 is DEAD
2025-09-30T14:58:07.069806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b50ba4-5ed50334-17734651-17b618ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:07.069830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b50ba4-5ed50334-17734651-17b618ed_0] Write session will restart in 0.007382s
2025-09-30T14:58:07.069857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b50ba4-5ed50334-17734651-17b618ed_0] Write session: Do CDS request
2025-09-30T14:58:07.069863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b50ba4-5ed50334-17734651-17b618ed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:07.078948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15b50ba4-5ed50334-17734651-17b618ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:07.079085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:07.079104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2791
2025-09-30T14:58:07.079327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2791 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:07.079374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2791 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:07.079380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2791 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:07.079385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:07.079900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2791 sessionId:  describe result for acl check
2025-09-30T14:58:07.079954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:07.079965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:07.079967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:07.079973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896680357187464:6395] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:07.080624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896680357187464:6395] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:07.085409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896680357187464:6395] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:07.088394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:07.088580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896680357187464:6395] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:07.088598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896680357187464:6395] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:07.088601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896680357187464:6395] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:07.088610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2791 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:07.092268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:07.092519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:07.092530Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:07.092542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:07.092603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:07.092652Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896680267393726:8456]
2025-09-30T14:58:07.093350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:07.093734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:07.093785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:07.094137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:07.094212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.094218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.094220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.094221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.094222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.094224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.094225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.094227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.094228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.094229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.094231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.094233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.094234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.094235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.094236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.094242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.094254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.094258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.094263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.094267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.094271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.094276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.094280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.094284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.094289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.094293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.094297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.094302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.094306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.094310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.094319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.094327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.094334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.094340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.094345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.094356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.094362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.094373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.094378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.094386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.094391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.094401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.094407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.094413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.094423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.094428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.094435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.094445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.094450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.094456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.094466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.094471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.094481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.094486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.094496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.094501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.094506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.094513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.094522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.094528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.094594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:07.100731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:07.101793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:07.101813Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:07.101816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:07.101820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:07.101828Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2790 [2:7555896680267393726:8456]
2025-09-30T14:58:07.101849Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:07.101869Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:07.101873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:07.101876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:07.101879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:07.101898Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:07.101905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:07.101914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:07.101990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.101998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.102001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.102005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:07.102008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:07.102089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:07.102097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.102115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.102133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.102156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:07.102177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896680267393720:8456]
2025-09-30T14:58:07.102185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896680267393720:8456]
2025-09-30T14:58:07.102187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896680267393720:8456]
2025-09-30T14:58:07.102202Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:07.102217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:07.102236Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:07.102244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:07.102247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:07.102249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:07.102253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:07.102292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896680267393720:8456]
2025-09-30T14:58:07.102299Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:07.102348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:07.102573Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2790
2025-09-30T14:58:07.102588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2790
2025-09-30T14:58:07.102805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357187576:6395], now have 1 active actors on pipe
2025-09-30T14:58:07.102815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357187448:2454], now have 1 active actors on pipe
2025-09-30T14:58:07.102834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.102840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.102866Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|86e92678-26530f30-d16fafcc-fa779520_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:07.102881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:07.102885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:07.102887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:07.102899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:07.103284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2791 partition: 0 MaxSeqNo: 42 sessionId: src_id|86e92678-26530f30-d16fafcc-fa779520_0
2025-09-30T14:58:07.103977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15b50ba4-5ed50334-17734651-17b618ed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|86e92678-26530f30-d16fafcc-fa779520_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:07.107106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86e92678-26530f30-d16fafcc-fa779520_0] Write session: try to update token
2025-09-30T14:58:07.107131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86e92678-26530f30-d16fafcc-fa779520_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:07.102911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:07.102931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:07.103129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.103133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.103149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:07.115365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:07.115380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:07.115383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:07.115385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:07.115399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896680267393720:8456]
2025-09-30T14:58:07.115404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896680267393720:8456]
2025-09-30T14:58:07.115408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896680267393720:8456]
2025-09-30T14:58:07.115450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:07.115457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.115460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:07.115462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:07.115469Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:07.115474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:07.115602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:07.123602Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2791 sessionId: src_id|86e92678-26530f30-d16fafcc-fa779520_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:07.126757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:07.169745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896680357187588:12049]
2025-09-30T14:58:07.170082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2790, pipe: [1:7555896680357187588:12049]
2025-09-30T14:58:07.239286Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:07.239597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.239620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.239658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357187588:12049], now have 1 active actors on pipe
2025-09-30T14:58:07.240007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:07.240138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:07.240162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:07.240236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2791 reason: error at write: Disconnected sessionId: src_id|86e92678-26530f30-d16fafcc-fa779520_0
2025-09-30T14:58:07.240459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:07.240463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2791 sessionId: src_id|86e92678-26530f30-d16fafcc-fa779520_0 is DEAD
2025-09-30T14:58:07.240499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896680357187588:12049]
2025-09-30T14:58:07.243481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86e92678-26530f30-d16fafcc-fa779520_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:07.243496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86e92678-26530f30-d16fafcc-fa779520_0] Write session will restart in 0.007610s
2025-09-30T14:58:07.243523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86e92678-26530f30-d16fafcc-fa779520_0] Write session: Do CDS request
2025-09-30T14:58:07.243529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86e92678-26530f30-d16fafcc-fa779520_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:07.256029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|86e92678-26530f30-d16fafcc-fa779520_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:07.256097Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:07.256120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2792
2025-09-30T14:58:07.256371Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2792 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:07.256423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2792 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:07.256437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2792 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:07.256442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:07.256940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2792 sessionId:  describe result for acl check
2025-09-30T14:58:07.256979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:07.256988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:07.256990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:07.256997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896680357187600:6409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:07.257582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896680357187600:6409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:07.259776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896680357187600:6409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:07.268416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896680357187600:6409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:07.268439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896680357187600:6409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:07.268446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896680357187600:6409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:07.268456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2792 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:07.275661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:07.280363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:07.280615Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:07.280628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:07.280640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:07.280703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:07.280748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896680267393870:8450]
2025-09-30T14:58:07.281385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:07.281949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:07.282033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:07.282474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:07.282557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.282563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.282565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.282567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.282569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.282570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.282571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.282573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.282574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.282576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.282577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.282579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.282580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.282581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.282583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.282590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.282602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.282607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.282611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.282616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.282620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.282624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.282629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.282634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.282639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.282644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.282649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.282654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.282658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.282663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.282674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.282683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.282689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.282695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.282701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.282712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.282718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.282729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.282736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.282748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.282759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.282765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.282771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.282782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.282788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.282798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.282804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.282814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.282819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.282827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.282838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.282844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.282853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.282860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.282873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.282884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.282888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.282897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.282906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.282912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.282961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:07.292724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:07.293718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:07.293736Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:07.293740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:07.293745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:07.293754Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2791 [2:7555896680267393870:8450]
2025-09-30T14:58:07.293778Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:07.293799Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:07.293806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:07.293810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:07.293813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:07.293832Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:07.293847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:07.293856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:07.293929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.293939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.293942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.293946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:07.293949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:07.294034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:07.294042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.294057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.294074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.294096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:07.294120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896680267393865:8450]
2025-09-30T14:58:07.294126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896680267393865:8450]
2025-09-30T14:58:07.294129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896680267393865:8450]
2025-09-30T14:58:07.294145Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:07.294163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:07.294166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357187591:2454], now have 1 active actors on pipe
2025-09-30T14:58:07.294172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357187641:6409], now have 1 active actors on pipe
2025-09-30T14:58:07.294175Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:07.294178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:07.294181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:07.294198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:07.294206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:07.294248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896680267393865:8450]
2025-09-30T14:58:07.294260Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:07.294276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:07.294369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2791
2025-09-30T14:58:07.294388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2791
2025-09-30T14:58:07.294512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.294522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.294552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1786028-659c094-2689ed6f-e2956e63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:07.294564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:07.294572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:07.294575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:07.294588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:07.294602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:07.294621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:07.294990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.295007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.295034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:07.295184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2792 partition: 0 MaxSeqNo: 42 sessionId: src_id|1786028-659c094-2689ed6f-e2956e63_0
2025-09-30T14:58:07.295620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|86e92678-26530f30-d16fafcc-fa779520_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1786028-659c094-2689ed6f-e2956e63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:07.298658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1786028-659c094-2689ed6f-e2956e63_0] Write session: try to update token
2025-09-30T14:58:07.298678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1786028-659c094-2689ed6f-e2956e63_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:07.321430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2792 sessionId: src_id|1786028-659c094-2689ed6f-e2956e63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:07.321808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:07.321825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:07.321836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896680267393865:8450]
2025-09-30T14:58:07.321910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:07.323275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:07.323512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:07.323683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:07.323847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:07.324025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:07.324274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:07.324327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:07.324339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:07.324342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:07.324345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:07.324354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896680267393865:8450]
2025-09-30T14:58:07.324358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896680267393865:8450]
2025-09-30T14:58:07.324363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896680267393865:8450]
2025-09-30T14:58:07.324410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:07.324417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:07.324423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:07.324430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:07.324434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:07.324440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.324443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:07.324589Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:07.325246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:07.340711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896680357187738:12049]
2025-09-30T14:58:07.341010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2791, pipe: [1:7555896680357187738:12049]
2025-09-30T14:58:07.453041Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:07.454743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.454771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.454795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357187738:12049], now have 1 active actors on pipe
2025-09-30T14:58:07.455574Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:07.455631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896680357187738:12049]
2025-09-30T14:58:07.455658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:07.456198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1786028-659c094-2689ed6f-e2956e63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:07.456216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1786028-659c094-2689ed6f-e2956e63_0] Write session will restart in 0.007386s
2025-09-30T14:58:07.455878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2792 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1786028-659c094-2689ed6f-e2956e63_0
2025-09-30T14:58:07.456239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1786028-659c094-2689ed6f-e2956e63_0] Write session: Do CDS request
2025-09-30T14:58:07.456049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2792 sessionId: src_id|1786028-659c094-2689ed6f-e2956e63_0 is DEAD
2025-09-30T14:58:07.456245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1786028-659c094-2689ed6f-e2956e63_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:07.455203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:07.464776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1786028-659c094-2689ed6f-e2956e63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:07.465296Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:07.465316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2793
2025-09-30T14:58:07.465465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2793 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:07.465498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2793 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:07.465517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2793 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:07.465527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:07.466219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2793 sessionId:  describe result for acl check
2025-09-30T14:58:07.466259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:07.466261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:07.466263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:07.466268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896680357187774:6438] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:07.466721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896680357187774:6438] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:07.469131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896680357187774:6438] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:07.472199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896680357187774:6438] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:07.472216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896680357187774:6438] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:07.472219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896680357187774:6438] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:07.472236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2793 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:07.479409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:07.483834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:07.484114Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:07.484128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:07.484140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:07.484211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:07.484261Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896680267394039:8435]
2025-09-30T14:58:07.484975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:07.485438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:07.485509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:07.485879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:07.485966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.485973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.485975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.485976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.485978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.485980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.485981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.485983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.485984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.485986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.485987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.485988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.485990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.485991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.485992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.485999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.486010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.486014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.486019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.486024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.486028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.486032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.486037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.486041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.486046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.486050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.486054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.486059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.486063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.486068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.486076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.486085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.486093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.486100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.486105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.486111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.486117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.486123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.486128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.486135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.486146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.486153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.486165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.486171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.486181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.486188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.486203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.486213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.486218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.486224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.486230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.486237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.486242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.486255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.486261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.486272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.486278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.486289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.486294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.486306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.486354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:07.492563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:07.493604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:07.493631Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:07.493634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:07.493639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:07.493647Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2792 [2:7555896680267394039:8435]
2025-09-30T14:58:07.493668Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:07.493687Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:07.493697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:07.493701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:07.493703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:07.493721Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:07.493733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:07.493741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:07.493815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.493823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.493826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.493830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:07.493833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:07.493915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:07.493924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.493939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.493953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.493978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:07.494001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357187822:6438], now have 1 active actors on pipe
2025-09-30T14:58:07.494011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357187753:2454], now have 1 active actors on pipe
2025-09-30T14:58:07.494018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896680267394034:8435]
2025-09-30T14:58:07.494021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896680267394034:8435]
2025-09-30T14:58:07.494023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896680267394034:8435]
2025-09-30T14:58:07.494040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:07.494057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:07.494061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:07.494062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:07.494065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:07.494077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:07.494081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:07.494122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896680267394034:8435]
2025-09-30T14:58:07.494136Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:07.494089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2792
2025-09-30T14:58:07.494150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:07.494089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2792
2025-09-30T14:58:07.494673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.494690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.494722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:07.494736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:07.494746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:07.494749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:07.494760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:07.494771Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:07.494787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:07.495033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.495043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.495061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:07.495176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2793 partition: 0 MaxSeqNo: 42 sessionId: src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0
2025-09-30T14:58:07.495593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1786028-659c094-2689ed6f-e2956e63_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:07.498620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0] Write session: try to update token
2025-09-30T14:58:07.498640Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:07.509888Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:07.509915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:07.509919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:07.509922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:07.509935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896680267394034:8435]
2025-09-30T14:58:07.509941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896680267394034:8435]
2025-09-30T14:58:07.509947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896680267394034:8435]
2025-09-30T14:58:07.510007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:07.510023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.510024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:07.510026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:07.510035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:07.510040Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:07.510311Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:07.514823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2793 sessionId: src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:07.517936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:07.555785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896680357187916:12049]
2025-09-30T14:58:07.558112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2792, pipe: [1:7555896680357187916:12049]
2025-09-30T14:58:07.638580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896680357187916:12049]
2025-09-30T14:58:07.638625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:07.638629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:07.639192Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:07.637407Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:07.637757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.637768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.637811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357187916:12049], now have 1 active actors on pipe
2025-09-30T14:58:07.638339Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:07.639343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2793 reason: error at write: Disconnected sessionId: src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0
2025-09-30T14:58:07.639566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2793 sessionId: src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0 is DEAD
2025-09-30T14:58:07.639812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:07.639824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0] Write session will restart in 0.005713s
2025-09-30T14:58:07.639851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0] Write session: Do CDS request
2025-09-30T14:58:07.639862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:07.647767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:07.647839Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:07.647857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2794
2025-09-30T14:58:07.647985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2794 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:07.648015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2794 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:07.648026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2794 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:07.648032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:07.648502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2794 sessionId:  describe result for acl check
2025-09-30T14:58:07.648532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:07.648535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:07.648537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:07.648544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896680357187933:6461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:07.649123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896680357187933:6461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:07.652921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896680357187933:6461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:07.659480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896680357187933:6461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:07.659496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896680357187933:6461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:07.659499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896680357187933:6461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:07.659506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2794 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:07.662981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:07.672119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:07.672393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:07.672397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:07.672409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:07.672493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:07.672539Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896680267394175:8427]
2025-09-30T14:58:07.673261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:07.673861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:07.673941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:07.674316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:07.674378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.674379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.674381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.674382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.674384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.674386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.674388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.674390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.674391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.674393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.674395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.674396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.674398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.674400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.674401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.674408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.674424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.674428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.674433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.674438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.674443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.674448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.674453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.674457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.674463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.674468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.674473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.674478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.674482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.674487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.674496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.674505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.674512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.674519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.674525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.674532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.674538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.674544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.674549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.674556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.674564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.674571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.674577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.674582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.674588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.674594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.674600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.674605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.674610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.674616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.674621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.674627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.674633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.674639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.674644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.674650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.674656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.674662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.674667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.674674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.674725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:07.682020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:07.683512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:07.683529Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:07.683532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:07.683536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:07.683544Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2793 [2:7555896680267394175:8427]
2025-09-30T14:58:07.683560Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:07.683578Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:07.683580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:07.683583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:07.683586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:07.683602Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:07.683610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:07.683617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:07.683684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.683997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2793
2025-09-30T14:58:07.684003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2793
2025-09-30T14:58:07.683694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.683699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.683702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:07.683705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:07.683784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:07.683786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.683801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.683815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.683833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:07.683851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896680267394170:8427]
2025-09-30T14:58:07.683854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896680267394170:8427]
2025-09-30T14:58:07.683856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896680267394170:8427]
2025-09-30T14:58:07.683866Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:07.683881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357187920:2454], now have 1 active actors on pipe
2025-09-30T14:58:07.683885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357188023:6461], now have 1 active actors on pipe
2025-09-30T14:58:07.683887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:07.683894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:07.683895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:07.683898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:07.683908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:07.683911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:07.683954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896680267394170:8427]
2025-09-30T14:58:07.683965Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:07.683994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:07.684087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.684093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.684118Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:07.684126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:07.684130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:07.684132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:07.684143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:07.684153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:07.684168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:07.684375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.684391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.684418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:07.684579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2794 partition: 0 MaxSeqNo: 42 sessionId: src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0
2025-09-30T14:58:07.685028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|39ee5e42-7afcb1dc-96ebb886-479fefc9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:07.687996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0] Write session: try to update token
2025-09-30T14:58:07.688017Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:07.698792Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:07.698819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:07.698823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:07.698826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:07.698837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896680267394170:8427]
2025-09-30T14:58:07.698843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896680267394170:8427]
2025-09-30T14:58:07.698849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896680267394170:8427]
2025-09-30T14:58:07.698902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:07.698912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.698913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:07.698916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:07.698922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:07.698942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:07.699109Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:07.710513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2794 sessionId: src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:07.713498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:07.735847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896680357188060:12049]
2025-09-30T14:58:07.736349Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2793, pipe: [1:7555896680357188060:12049]
2025-09-30T14:58:07.826699Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:07.827212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.827258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.827286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357188060:12049], now have 1 active actors on pipe
2025-09-30T14:58:07.827609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:07.829200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:07.829215Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0] Write session will restart in 0.006095s
2025-09-30T14:58:07.829242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0] Write session: Do CDS request
2025-09-30T14:58:07.829248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:07.828667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:07.828732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896680357188060:12049]
2025-09-30T14:58:07.828756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:07.828759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:07.828825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2794 reason: error at write: Disconnected sessionId: src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0
2025-09-30T14:58:07.829022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2794 sessionId: src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0 is DEAD
2025-09-30T14:58:07.839802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:07.841381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:07.841401Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2795
2025-09-30T14:58:07.841717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2795 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:07.841756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2795 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:07.841763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2795 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:07.841768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:07.842266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2795 sessionId:  describe result for acl check
2025-09-30T14:58:07.842302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:07.842304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:07.842307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:07.842314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896680357188079:6455] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:07.842960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896680357188079:6455] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:07.851283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896680357188079:6455] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:07.856371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896680357188079:6455] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:07.856392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896680357188079:6455] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:07.856396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896680357188079:6455] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:07.856412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2795 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:07.862266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:07.863226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:07.863545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:07.863558Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:07.863574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:07.863647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:07.863720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896680267394311:8425]
2025-09-30T14:58:07.864567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:07.865030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:07.865091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:07.865533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:07.865625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.865636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.865637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.865639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.865641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.865643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.865645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.865647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.865649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.865650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.865652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.865654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.865655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.865657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.865658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.865666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.865679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.865683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.865688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.865693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.865698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.865702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.865708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.865712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.865718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.865722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.865727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.865730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.865735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.865740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.865750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.865759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:07.865767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.865774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:07.865779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.865785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:07.865792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.865798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:07.865804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.865816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:07.865822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.865833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:07.865846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.865857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:07.865863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.865870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:07.865883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.865893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:07.865899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.865909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:07.865915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.865925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.865930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.865938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.865943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.865949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.865954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.865960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:07.865965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.865970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:07.866018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:07.872369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:07.874250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:07.874272Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:07.874275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:07.874280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:07.874289Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2794 [2:7555896680267394311:8425]
2025-09-30T14:58:07.874311Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:07.874336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:07.874341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:07.874345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:07.874348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:07.874372Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:07.874382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:07.874392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:07.874493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.874510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.874513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.874518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:07.874522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:07.874625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:07.874639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.874657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:07.874670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:07.874689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:07.874723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357188064:2454], now have 1 active actors on pipe
2025-09-30T14:58:07.874732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896680267394306:8425]
2025-09-30T14:58:07.874735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896680267394306:8425]
2025-09-30T14:58:07.874739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896680267394306:8425]
2025-09-30T14:58:07.874763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:07.874790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357188195:6455], now have 1 active actors on pipe
2025-09-30T14:58:07.874801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:07.874798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:07.874805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:07.874809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:07.874821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:07.874826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:07.874885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896680267394306:8425]
2025-09-30T14:58:07.874845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2794
2025-09-30T14:58:07.874881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2794
2025-09-30T14:58:07.874906Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:07.874916Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:07.875170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.875182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.875217Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:07.875229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:07.875234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:07.875236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:07.875273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:07.875292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:07.875314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:07.875533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:07.875543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:07.875560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:07.876168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7be85db0-9995e9c8-9e975d43-77e3eb24_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:07.875680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2795 partition: 0 MaxSeqNo: 42 sessionId: src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0
2025-09-30T14:58:07.879116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0] Write session: try to update token
2025-09-30T14:58:07.879139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:07.890305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:07.890334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:07.890347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896680267394306:8425]
2025-09-30T14:58:07.890407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:07.890408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:07.890627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:07.890809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:07.890984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:07.891156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:07.891451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:07.891506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:07.906587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:07.906609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:07.906612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:07.906615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:07.906626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896680267394306:8425]
2025-09-30T14:58:07.906632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896680267394306:8425]
2025-09-30T14:58:07.906636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896680267394306:8425]
2025-09-30T14:58:07.906682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:07.906691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:07.906694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:07.906718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:07.906729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:07.906744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:07.906852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:07.911485Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2795 sessionId: src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:07.915776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:07.929072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896680357188208:12049]
2025-09-30T14:58:07.929561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2794, pipe: [1:7555896680357188208:12049]
2025-09-30T14:58:08.034017Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:08.034755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.034775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.034799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896680357188208:12049], now have 1 active actors on pipe
2025-09-30T14:58:08.035066Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:08.035100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:08.035166Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:08.035183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896680357188208:12049]
2025-09-30T14:58:08.035264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2795 reason: status is not ok: tablet will be restarted right now sessionId: src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0
2025-09-30T14:58:08.035464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2795 sessionId: src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0 is DEAD
2025-09-30T14:58:08.039598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:08.039618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0] Write session will restart in 0.008283s
2025-09-30T14:58:08.039664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0] Write session: Do CDS request
2025-09-30T14:58:08.039674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:08.048763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:08.049007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:08.049023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2796
2025-09-30T14:58:08.049200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2796 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:08.049262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2796 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:08.049273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2796 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:08.049278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:08.049838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2796 sessionId:  describe result for acl check
2025-09-30T14:58:08.049880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:08.049889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:08.049893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:08.049900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896684652155523:6465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:08.050544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896684652155523:6465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:08.053398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896684652155523:6465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:08.056052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:08.061637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:08.061917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:08.061930Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:08.061942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:08.061984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896684652155523:6465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:08.062008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896684652155523:6465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:08.062012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896684652155523:6465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:08.062025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2796 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:08.062008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:08.062074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896684562361744:8411]
2025-09-30T14:58:08.062822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:08.063275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:08.063324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:08.063683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:08.063750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.063757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.063758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.063759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.063761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.063762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.063764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.063766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.063767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.063769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.063770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.063771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.063773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.063775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.063776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.063782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.063794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.063799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.063804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.063808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.063812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.063817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.063822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.063826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.063831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.063836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.063840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.063844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.063849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.063853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.063862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.063871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.063877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.063883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.063889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.063894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.063900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.063906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.063918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.063925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.063930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.063937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.063942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.063947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.063962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.063969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.063975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.063981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.063993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.064001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.064006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.064012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.064016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.064021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.064027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.064032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.064036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.064041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.064046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.064052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.064105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:08.071530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:08.072559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:08.072577Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:08.072580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:08.072585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:08.072593Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2795 [2:7555896684562361744:8411]
2025-09-30T14:58:08.072611Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:08.072632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:08.072636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:08.072639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:08.072642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:08.072659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:08.072667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:08.072674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:08.072749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.072761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.072764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.072769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:08.072772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:08.073352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:08.073366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.073381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.073394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.073343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2795
2025-09-30T14:58:08.073378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2795
2025-09-30T14:58:08.073413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:08.073440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652155640:6465], now have 1 active actors on pipe
2025-09-30T14:58:08.073446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652155507:2454], now have 1 active actors on pipe
2025-09-30T14:58:08.073453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896684562361739:8411]
2025-09-30T14:58:08.073457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896684562361739:8411]
2025-09-30T14:58:08.073460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896684562361739:8411]
2025-09-30T14:58:08.073481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:08.073506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:08.073516Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:08.073525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:08.073526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:08.073529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:08.073535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:08.073574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896684562361739:8411]
2025-09-30T14:58:08.073581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:08.073588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:08.073614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.073619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.073677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:08.073690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:08.073696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:08.073699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:08.073709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:08.073719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:08.073746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:08.074171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.074182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.074203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:08.074678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2796 partition: 0 MaxSeqNo: 42 sessionId: src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0
2025-09-30T14:58:08.075154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95987f7f-96b31fa9-7415f351-c81d30f8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:08.078772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0] Write session: try to update token
2025-09-30T14:58:08.078806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:08.088775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:08.088796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:08.088799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:08.088802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:08.088812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896684562361739:8411]
2025-09-30T14:58:08.088816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896684562361739:8411]
2025-09-30T14:58:08.088821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896684562361739:8411]
2025-09-30T14:58:08.088864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:08.088877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.088880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:08.088890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:08.088898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:08.088905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:08.089041Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:08.112254Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2796 sessionId: src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:08.115967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:08.135383Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896684652155654:12049]
2025-09-30T14:58:08.135775Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2795, pipe: [1:7555896684652155654:12049]
2025-09-30T14:58:08.205353Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:08.205680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.205694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.205717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652155654:12049], now have 1 active actors on pipe
2025-09-30T14:58:08.205952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:08.206016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:08.206030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:08.206068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:08.206133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896684652155654:12049]
2025-09-30T14:58:08.206147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2796 reason: error at write: Disconnected sessionId: src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0
2025-09-30T14:58:08.206343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2796 sessionId: src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0 is DEAD
2025-09-30T14:58:08.206890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:08.206907Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0] Write session will restart in 0.007833s
2025-09-30T14:58:08.206942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0] Write session: Do CDS request
2025-09-30T14:58:08.206954Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:08.215912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:08.216009Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:08.216029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2797
2025-09-30T14:58:08.216252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2797 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:08.216292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2797 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:08.216303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2797 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:08.216308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:08.216803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2797 sessionId:  describe result for acl check
2025-09-30T14:58:08.216843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:08.216850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:08.216852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:08.216859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896684652155671:6469] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:08.217469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896684652155671:6469] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:08.222030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896684652155671:6469] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:08.225510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896684652155671:6469] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:08.225539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896684652155671:6469] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:08.225543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896684652155671:6469] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:08.225553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2797 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:08.226739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:08.231825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:08.232081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:08.232096Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:08.232108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:08.232176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:08.232229Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896684562361882:8409]
2025-09-30T14:58:08.232877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:08.233233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:08.233283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:08.233579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:08.233654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.233661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.233663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.233664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.233665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.233667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.233668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.233670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.233671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.233672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.233673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.233675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.233676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.233678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.233679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.233685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.233695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.233700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.233705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.233709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.233714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.233718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.233723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.233727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.233731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.233736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.233740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.233744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.233748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.233752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.233763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.233771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.233778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.233784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.233790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.233793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.233797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.233800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.233803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.233806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.233809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.233813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.233816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.233820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.233823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.233826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.233829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.233833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.233835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.233838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.233851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.233857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.233862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.233872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.233878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.233883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.233891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.233896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.233901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.233906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.233948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:08.239602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:08.241099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:08.241118Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:08.241121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:08.241125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:08.241132Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2796 [2:7555896684562361882:8409]
2025-09-30T14:58:08.241150Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:08.241168Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:08.241172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:08.241176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:08.241178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:08.241196Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:08.241206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:08.241213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:08.241279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.241289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.241291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.241295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:08.241297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:08.241377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:08.241386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.241402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.241415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.241431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:08.241452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652155656:2454], now have 1 active actors on pipe
2025-09-30T14:58:08.241463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652155791:6469], now have 1 active actors on pipe
2025-09-30T14:58:08.241470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896684562361877:8409]
2025-09-30T14:58:08.241474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896684562361877:8409]
2025-09-30T14:58:08.241476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896684562361877:8409]
2025-09-30T14:58:08.241489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:08.241510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:08.241514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:08.241519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:08.241521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:08.241524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:08.241527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:08.241564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896684562361877:8409]
2025-09-30T14:58:08.241572Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:08.241574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:08.241536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2796
2025-09-30T14:58:08.241547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2796
2025-09-30T14:58:08.241593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.241606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.241655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:08.241667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:08.241671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:08.241673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:08.241683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:08.241699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:08.241738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:08.241881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.241889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.241902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:08.242026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2797 partition: 0 MaxSeqNo: 42 sessionId: src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0
2025-09-30T14:58:08.242455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d321001d-ab0d3512-ebdfcac3-5d085a0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:08.245777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0] Write session: try to update token
2025-09-30T14:58:08.245799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:08.254497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:08.254527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:08.254531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:08.254533Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:08.254546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896684562361877:8409]
2025-09-30T14:58:08.254551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896684562361877:8409]
2025-09-30T14:58:08.254556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896684562361877:8409]
2025-09-30T14:58:08.254606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:08.254614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.254616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:08.254615Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:08.254622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:08.254627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:08.254776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:08.272128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2797 sessionId: src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:08.275659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:08.306382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896684652155809:12049]
2025-09-30T14:58:08.307493Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2796, pipe: [1:7555896684652155809:12049]
2025-09-30T14:58:08.378294Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:08.378829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.378852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.378874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652155809:12049], now have 1 active actors on pipe
2025-09-30T14:58:08.379088Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:08.379116Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:08.379137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896684652155809:12049]
2025-09-30T14:58:08.379148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:08.379151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:08.379218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2797 reason: error at write: Disconnected sessionId: src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0
2025-09-30T14:58:08.379420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2797 sessionId: src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0 is DEAD
2025-09-30T14:58:08.379793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:08.379805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0] Write session will restart in 0.006214s
2025-09-30T14:58:08.379831Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0] Write session: Do CDS request
2025-09-30T14:58:08.379840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:08.386788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:08.387051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:08.387078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2798
2025-09-30T14:58:08.387217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2798 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:08.387300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2798 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:08.387312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2798 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:08.387318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:08.387785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2798 sessionId:  describe result for acl check
2025-09-30T14:58:08.387824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:08.387827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:08.387829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:08.387834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896684652155828:6481] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:08.388351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896684652155828:6481] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:08.394492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896684652155828:6481] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:08.396736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:08.400388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:08.400527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896684652155828:6481] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:08.400546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896684652155828:6481] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:08.400550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896684652155828:6481] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:08.400560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2798 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:08.400618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:08.400629Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:08.400640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:08.400689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:08.400730Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896684562362031:8407]
2025-09-30T14:58:08.401406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:08.401704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:08.401759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:08.402029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:08.402088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.402094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.402095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.402096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.402098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.402099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.402100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.402102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.402103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.402105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.402106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.402107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.402109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.402110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.402111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.402117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.402128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.402132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.402137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.402142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.402146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.402150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.402153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.402157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.402161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.402166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.402170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.402173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.402177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.402182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.402191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.402200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.402206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.402213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.402222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.402228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.402232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.402238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.402243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.402249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.402259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.402268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.402275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.402284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.402290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.402299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.402305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.402315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.402320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.402330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.402337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.402346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.402352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.402361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.402367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.402377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.402386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.402392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.402400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.402410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.402450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:08.408109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:08.409585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:08.409604Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:08.409607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:08.409611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:08.409618Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2797 [2:7555896684562362031:8407]
2025-09-30T14:58:08.409639Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:08.409656Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:08.409660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:08.409664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:08.409666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:08.409683Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:08.409691Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:08.409698Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:08.409750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.409760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.409762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.409765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:08.409767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:08.409827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:08.409837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.409852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.409863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.409885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:08.409907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896684562362026:8407]
2025-09-30T14:58:08.409914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896684562362026:8407]
2025-09-30T14:58:08.409916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896684562362026:8407]
2025-09-30T14:58:08.409926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:08.409939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:08.409945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:08.409952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:08.409954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:08.409954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:08.409956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:08.409964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652155949:6481], now have 1 active actors on pipe
2025-09-30T14:58:08.409966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652155814:2454], now have 1 active actors on pipe
2025-09-30T14:58:08.409997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896684562362026:8407]
2025-09-30T14:58:08.410009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:08.410070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2797
2025-09-30T14:58:08.410103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2797
2025-09-30T14:58:08.410034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:08.410177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.410184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.410210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:08.410221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:08.410225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:08.410228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:08.410239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:08.410249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:08.410263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:08.410448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.410455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.410468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:08.410570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2798 partition: 0 MaxSeqNo: 42 sessionId: src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0
2025-09-30T14:58:08.411001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a6e0ef5-8c4197a5-a32c93c9-33822b98_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:08.414026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0] Write session: try to update token
2025-09-30T14:58:08.414046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:08.422960Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:08.422983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:08.422995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896684562362026:8407]
2025-09-30T14:58:08.423048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:08.423059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:08.423239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:08.423448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:08.423627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:08.423777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:08.423986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:08.424032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:08.434441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:08.434466Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:08.434468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:08.434471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:08.434481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896684562362026:8407]
2025-09-30T14:58:08.434486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896684562362026:8407]
2025-09-30T14:58:08.434491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896684562362026:8407]
2025-09-30T14:58:08.434534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:08.434543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.434548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:08.434552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:08.434554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:08.434559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:08.434713Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:08.453394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2798 sessionId: src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:08.457051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:08.479460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896684652155986:12049]
2025-09-30T14:58:08.479771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2797, pipe: [1:7555896684652155986:12049]
2025-09-30T14:58:08.563586Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:08.563934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.563949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.563970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652155986:12049], now have 1 active actors on pipe
2025-09-30T14:58:08.564259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:08.564940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:08.564952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0] Write session will restart in 0.006822s
2025-09-30T14:58:08.564980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0] Write session: Do CDS request
2025-09-30T14:58:08.564986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:08.564357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:08.564362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896684652155986:12049]
2025-09-30T14:58:08.564377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:08.564397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:08.564503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2798 reason: error at write: Disconnected sessionId: src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0
2025-09-30T14:58:08.564740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2798 sessionId: src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0 is DEAD
2025-09-30T14:58:08.572823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:08.573038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:08.573057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2799
2025-09-30T14:58:08.574137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2799 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:08.574191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2799 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:08.574208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2799 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:08.574213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:08.574949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2799 sessionId:  describe result for acl check
2025-09-30T14:58:08.575001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:08.575005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:08.575007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:08.575016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896684652156030:6506] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:08.575731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896684652156030:6506] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:08.578985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896684652156030:6506] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:08.581117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:08.587172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:08.588064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896684652156030:6506] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:08.588086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896684652156030:6506] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:08.588091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896684652156030:6506] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:08.588102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2799 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:08.588028Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:08.588043Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:08.588060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:08.588147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:08.588200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896684562362209:8384]
2025-09-30T14:58:08.589004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:08.589503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:08.589559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:08.589972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:08.590055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.590064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.590065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.590067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.590069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.590071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.590073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.590076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.590077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.590079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.590081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.590083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.590084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.590086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.590088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.590096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.590108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.590113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.590119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.590123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.590129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.590134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.590139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.590144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.590149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.590153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.590158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.590162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.590167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.590171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.590182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.590190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.590202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.590208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.590221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.590228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.590233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.590238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.590244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.590250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.590261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.590267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.590279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.590286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.590295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.590300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.590310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.590315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.590321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.590331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.590337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.590349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.590354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.590360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.590366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.590377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.590383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.590397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.590404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.590410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.590461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:08.601162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:08.602316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:08.602341Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:08.602346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:08.602352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:08.602361Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2798 [2:7555896684562362209:8384]
2025-09-30T14:58:08.602390Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:08.602416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:08.602420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:08.602424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:08.602434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:08.602466Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:08.602479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:08.602490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:08.602588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.602599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.602602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.602606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:08.602610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:08.602721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:08.602732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.602752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.602770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.602930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2798
2025-09-30T14:58:08.602939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2798
2025-09-30T14:58:08.604115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2799 partition: 0 MaxSeqNo: 42 sessionId: src_id|74dcade0-bb746cad-83d43d37-c90da95d_0
2025-09-30T14:58:08.604667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bc56e9b-1321b082-b3f4d72c-4eb9d993_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|74dcade0-bb746cad-83d43d37-c90da95d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:08.602796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:08.602831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652156132:6506], now have 1 active actors on pipe
2025-09-30T14:58:08.602840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896684562362204:8384]
2025-09-30T14:58:08.602843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896684562362204:8384]
2025-09-30T14:58:08.602845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896684562362204:8384]
2025-09-30T14:58:08.602864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:08.602880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652156000:2454], now have 1 active actors on pipe
2025-09-30T14:58:08.602890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:08.602890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:08.602893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:08.602896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:08.602905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:08.602910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:08.602967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896684562362204:8384]
2025-09-30T14:58:08.602976Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:08.602983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:08.603581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.603590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.603643Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|74dcade0-bb746cad-83d43d37-c90da95d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:08.603656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:08.603661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:08.603664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:08.603680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:08.603697Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:08.603721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:08.603989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.603994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.604016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:08.607665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74dcade0-bb746cad-83d43d37-c90da95d_0] Write session: try to update token
2025-09-30T14:58:08.607692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74dcade0-bb746cad-83d43d37-c90da95d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:08.619388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:08.619413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:08.619416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:08.619418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:08.619431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896684562362204:8384]
2025-09-30T14:58:08.619438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896684562362204:8384]
2025-09-30T14:58:08.619444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896684562362204:8384]
2025-09-30T14:58:08.619497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:08.619507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.619510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:08.619513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:08.619521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:08.619526Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:08.619698Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:08.629994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2799 sessionId: src_id|74dcade0-bb746cad-83d43d37-c90da95d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:08.633539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:08.664293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896684652156144:12049]
2025-09-30T14:58:08.664685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2798, pipe: [1:7555896684652156144:12049]
2025-09-30T14:58:08.744995Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:08.745555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.745581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.745605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652156144:12049], now have 1 active actors on pipe
2025-09-30T14:58:08.745909Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:08.745925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:08.745998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896684652156144:12049]
2025-09-30T14:58:08.746010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2799 reason: error at write: Disconnected sessionId: src_id|74dcade0-bb746cad-83d43d37-c90da95d_0
2025-09-30T14:58:08.746029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:08.746218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2799 sessionId: src_id|74dcade0-bb746cad-83d43d37-c90da95d_0 is DEAD
2025-09-30T14:58:08.745854Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:08.746379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74dcade0-bb746cad-83d43d37-c90da95d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:08.746391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74dcade0-bb746cad-83d43d37-c90da95d_0] Write session will restart in 0.005544s
2025-09-30T14:58:08.746417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74dcade0-bb746cad-83d43d37-c90da95d_0] Write session: Do CDS request
2025-09-30T14:58:08.746426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74dcade0-bb746cad-83d43d37-c90da95d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:08.752871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|74dcade0-bb746cad-83d43d37-c90da95d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:08.753011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:08.753028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2800
2025-09-30T14:58:08.753161Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2800 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:08.753192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2800 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:08.753204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2800 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:08.753208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:08.753687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2800 sessionId:  describe result for acl check
2025-09-30T14:58:08.753730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:08.753738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:08.753740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:08.753747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896684652156164:6517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:08.754320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896684652156164:6517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:08.757084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896684652156164:6517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:08.760413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896684652156164:6517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:08.760433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896684652156164:6517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:08.760436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896684652156164:6517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:08.760446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2800 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:08.760661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:08.765669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:08.765932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:08.765946Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:08.765960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:08.766046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:08.766096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896684562362350:8382]
2025-09-30T14:58:08.766785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:08.767184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:08.767266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:08.767627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:08.767726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.767735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.767736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.767737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.767739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.767740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.767742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.767743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.767745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.767746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.767748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.767749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.767750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.767751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.767752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.767757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.767768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.767772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.767777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.767781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.767784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.767788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.767792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.767795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.767799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.767803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.767807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.767810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.767815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.767819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.767827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.767836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.767842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.767849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.767854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.767860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.767865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.767871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.767876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.767881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.767887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.767892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.767898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.767904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.767911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.767917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.767922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.767927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.767932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.767937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.767943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.767948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.767953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.767959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.767963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.767969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.767985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.767991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.767997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.768003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.768050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:08.773920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:08.775391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:08.775412Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:08.775414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:08.775419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:08.775426Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2799 [2:7555896684562362350:8382]
2025-09-30T14:58:08.775444Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:08.775461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:08.775465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:08.775469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:08.775471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:08.775489Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:08.775496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:08.775503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:08.775571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.775580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.775582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.775586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:08.775589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:08.775664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:08.775673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.775688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.775706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.775732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:08.775837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2799
2025-09-30T14:58:08.775888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2799
2025-09-30T14:58:08.775758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652156149:2454], now have 1 active actors on pipe
2025-09-30T14:58:08.775768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652156285:6517], now have 1 active actors on pipe
2025-09-30T14:58:08.775775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896684562362344:8382]
2025-09-30T14:58:08.775778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896684562362344:8382]
2025-09-30T14:58:08.775782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896684562362344:8382]
2025-09-30T14:58:08.775797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:08.775812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:08.775816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:08.775820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:08.775822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:08.775827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:08.775830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:08.775870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896684562362344:8382]
2025-09-30T14:58:08.775879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:08.775904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:08.776113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.776125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.776152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:08.776165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:08.776169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:08.776171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:08.776184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:08.776195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:08.776225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:08.776470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.776479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.776496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:08.776811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2800 partition: 0 MaxSeqNo: 42 sessionId: src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0
2025-09-30T14:58:08.777281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|74dcade0-bb746cad-83d43d37-c90da95d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:08.780188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0] Write session: try to update token
2025-09-30T14:58:08.780210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:08.789448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:08.789471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:08.789474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:08.789476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:08.789487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896684562362344:8382]
2025-09-30T14:58:08.789492Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896684562362344:8382]
2025-09-30T14:58:08.789496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896684562362344:8382]
2025-09-30T14:58:08.789541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:08.789550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.789553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:08.789561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:08.789569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:08.789575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:08.789709Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:08.797460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2800 sessionId: src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:08.800487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:08.846022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896684652156298:12049]
2025-09-30T14:58:08.846388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2799, pipe: [1:7555896684652156298:12049]
2025-09-30T14:58:08.903611Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:08.904118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.904133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.904176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652156298:12049], now have 1 active actors on pipe
2025-09-30T14:58:08.904358Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:08.904385Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:08.904387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:08.904392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:08.904441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896684652156298:12049]
2025-09-30T14:58:08.904471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2800 reason: error at write: Disconnected sessionId: src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0
2025-09-30T14:58:08.904636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2800 sessionId: src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0 is DEAD
2025-09-30T14:58:08.904788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:08.904797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0] Write session will restart in 0.009310s
2025-09-30T14:58:08.904815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0] Write session: Do CDS request
2025-09-30T14:58:08.904823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:08.915778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:08.915834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:08.915849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2801
2025-09-30T14:58:08.916003Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2801 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:08.916034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2801 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:08.916043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2801 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:08.916047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:08.916502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2801 sessionId:  describe result for acl check
2025-09-30T14:58:08.916533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:08.916542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:08.916544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:08.916550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896684652156401:6526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:08.917094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896684652156401:6526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:08.917620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:08.918952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896684652156401:6526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:08.921535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:08.921751Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:08.921762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:08.921773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:08.921828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:08.921868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896684562362490:8381]
2025-09-30T14:58:08.921894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896684652156401:6526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:08.921907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896684652156401:6526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:08.921911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896684652156401:6526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:08.921919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2801 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:08.922490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:08.922755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:08.922798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:08.923100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:08.923174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.923175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.923177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.923178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.923179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.923181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.923182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.923183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.923185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.923186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.923187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.923189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.923190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.923191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.923192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.923198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.923208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.923212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.923217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.923221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.923225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.923229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.923233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.923237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.923256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.923260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.923264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.923268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.923272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.923276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.923284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.923292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:08.923299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.923305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:08.923309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.923315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:08.923320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.923326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:08.923336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.923342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:08.923347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.923352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:08.923356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.923362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:08.923366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.923386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:08.923391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.923396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:08.923405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.923411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:08.923420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.923425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.923430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.923441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.923447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.923454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.923456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.923460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:08.923463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.923466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:08.923492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:08.929080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:08.930407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:08.930422Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:08.930425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:08.930429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:08.930437Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2800 [2:7555896684562362490:8381]
2025-09-30T14:58:08.930455Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:08.930475Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:08.930483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:08.930487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:08.930490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:08.930510Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:08.930522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:08.930532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:08.930599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.930605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.930607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.930610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:08.930613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:08.930679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:08.930688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.930701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:08.930714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:08.930729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:08.930747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652156299:2454], now have 1 active actors on pipe
2025-09-30T14:58:08.930750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896684652156437:6526], now have 1 active actors on pipe
2025-09-30T14:58:08.930757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896684562362485:8381]
2025-09-30T14:58:08.930759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896684562362485:8381]
2025-09-30T14:58:08.930761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896684562362485:8381]
2025-09-30T14:58:08.930774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:08.930787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:08.930788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:08.930795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:08.930797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:08.930802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:08.930806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:08.930840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896684562362485:8381]
2025-09-30T14:58:08.930829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2800
2025-09-30T14:58:08.930853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:08.930852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2800
2025-09-30T14:58:08.930876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:08.930907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.930918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.930945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:08.930958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:08.930966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:08.930969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:08.930979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:08.930993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:08.931007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:08.931161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.931172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.931184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:08.931281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2801 partition: 0 MaxSeqNo: 42 sessionId: src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0
2025-09-30T14:58:08.931622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f233e017-d9eaf3f7-bb6f9c4f-d84ddbbd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:08.934387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0] Write session: try to update token
2025-09-30T14:58:08.934403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:08.943182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:08.943202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:08.943211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896684562362485:8381]
2025-09-30T14:58:08.943268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:08.943269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:08.943853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:08.944010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:08.944555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:08.944712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:08.944932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:08.944979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:08.948739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2801 sessionId: src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:08.951632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:08.951803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:08.951829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:08.951865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:08.951936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:08.954285Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:08.954308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:08.954311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:08.954313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:08.954324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896684562362485:8381]
2025-09-30T14:58:08.954329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896684562362485:8381]
2025-09-30T14:58:08.954333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896684562362485:8381]
2025-09-30T14:58:08.954373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:08.954386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:08.954389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:08.954381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:08.954412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:08.954417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:08.954529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:09.004703Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896688947123745:12049]
2025-09-30T14:58:09.005036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2800, pipe: [1:7555896688947123745:12049]
2025-09-30T14:58:09.067213Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:09.075734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.075766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.075946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.076017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.076091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.076161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.076212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.076220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.076302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.076371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.076439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.076520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.076572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.076581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.076655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.076720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.076787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.076857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.076920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.076927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.077000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.077359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.077437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.077506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.077555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.077563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.077637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.077703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.077775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.077845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.078023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.078032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.078108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.078177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.078247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.078318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.078369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.078380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.078455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.078527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.078599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.078668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.078716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.078722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.078787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.078859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.078921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.078984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.079028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.079035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.079102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.079169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.079239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.079334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.080093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:09.080107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:09.080114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896688947123745:12049]
2025-09-30T14:58:09.080137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:09.080139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2801 reason: error at write: Disconnected sessionId: src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0
2025-09-30T14:58:09.080166Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:58:09.080251Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 28 consumer shared/user session shared/user_1_28_10111498465067162831_v1 is DEAD
2025-09-30T14:58:09.080261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2801 sessionId: src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0 is DEAD
2025-09-30T14:58:09.080414Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896611637697725:12044] disconnected; active server actors: 1
2025-09-30T14:58:09.080426Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896611637697725:12044] client user disconnected session shared/user_1_28_10111498465067162831_v1
2025-09-30T14:58:09.080672Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:58:09.080672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:09.080693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0] Write session will restart in 0.008035s
2025-09-30T14:58:09.080731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0] Write session: Do CDS request
2025-09-30T14:58:09.080737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:09.080831Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:58:09.080836Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:58:09.080855Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.008011s
2025-09-30T14:58:09.079392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.079401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.079474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.079533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.079591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.079656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.079702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.079704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.079771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947123745:12049], now have 1 active actors on pipe
2025-09-30T14:58:09.080813Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:09.089662Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:58:09.089804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:09.089898Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:58:09.089913Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 29
2025-09-30T14:58:09.089912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:09.089919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2802
2025-09-30T14:58:09.090065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2802 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:09.090097Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 29 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:58:09.090100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2802 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:09.090106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2802 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:09.090112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:09.090149Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:58:09.090234Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 auth for : user
2025-09-30T14:58:09.090299Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 Handle describe topics response
2025-09-30T14:58:09.090325Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 auth is DEAD
2025-09-30T14:58:09.090353Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:58:09.090501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2802 sessionId:  describe result for acl check
2025-09-30T14:58:09.090534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:09.090541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:09.090543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:09.090549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896688947123794:6528] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:09.090602Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:58:09.090686Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_29_9891895112688442900_v1
2025-09-30T14:58:09.090807Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896688947123797:6527] connected; active server actors: 1
2025-09-30T14:58:09.090825Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896688947123797:6527] session shared/user_1_29_9891895112688442900_v1
2025-09-30T14:58:09.090834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:58:09.090843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:58:09.090855Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_29_9891895112688442900_v1" (Sender=[1:7555896688947123775:6527], Pipe=[1:7555896688947123797:6527], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:58:09.090859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:58:09.090874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:58:09.090882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_29_9891895112688442900_v1" (Sender=[1:7555896688947123775:6527], Pipe=[1:7555896688947123797:6527], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:58:09.090897Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_29_9891895112688442900_v1" sender [1:7555896688947123775:6527] lock partition 0 for ReadingSession "shared/user_1_29_9891895112688442900_v1" (Sender=[1:7555896688947123775:6527], Pipe=[1:7555896688947123797:6527], Partitions=[], ActiveFamilyCount=1) generation 1 step 29
2025-09-30T14:58:09.090910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:58:09.090913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000037s
2025-09-30T14:58:09.091089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896688947123794:6528] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:09.091092Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 29 Session: "shared/user_1_29_9891895112688442900_v1" ClientId: "user" PipeClient { RawX1: 7555896688947123797 RawX2: 4503603922344319 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:58:09.091106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:58:09.094123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896688947123794:6528] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:09.095079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:09.099147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:09.099395Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:09.099406Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:09.099418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:09.099475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:09.099472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896688947123794:6528] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:09.099488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896688947123794:6528] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:09.099491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896688947123794:6528] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:09.099532Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896688857329931:8378]
2025-09-30T14:58:09.099515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2802 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:09.100216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:09.100507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:09.100561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:09.100833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:09.100904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.100919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.100926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.100927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.100928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.100928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.100929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.100930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.100931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.100931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.100933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.100934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.100934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.100935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.100936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.100939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.100946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.100949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.100952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.100954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.100957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.100960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.100962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.100964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.100967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.100969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.100972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.100974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.100977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.100979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.100985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.100990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.100994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.100998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.101001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.101004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.101007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.101010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.101013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.101016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.101019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.101022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.101025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.101028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.101031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.101036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.101041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.101045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.101051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.101055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.101063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.101067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.101072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.101077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.101083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.101089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.101094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.101099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.101104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.101107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.101133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:09.106985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:09.108024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:09.108041Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:09.108044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:09.108048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:09.108056Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2801 [2:7555896688857329931:8378]
2025-09-30T14:58:09.108076Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:09.108093Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:09.108097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:09.108101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:09.108104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:09.108121Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:09.108128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:09.108135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:09.108202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.108211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.108214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.108218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:09.108222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:09.108301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:09.108310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.108325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.108343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.108360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:09.108479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2801, pipe: [1:7555896688947123815:6545]
2025-09-30T14:58:09.108385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947123815:6545], now have 1 active actors on pipe
2025-09-30T14:58:09.108395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947123746:2454], now have 1 active actors on pipe
2025-09-30T14:58:09.108479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2801
2025-09-30T14:58:09.108399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947123893:6528], now have 1 active actors on pipe
2025-09-30T14:58:09.108517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2801
2025-09-30T14:58:09.108406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896688857329926:8378]
2025-09-30T14:58:09.108409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896688857329926:8378]
2025-09-30T14:58:09.108412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896688857329926:8378]
2025-09-30T14:58:09.108424Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:09.108440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:09.108454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:09.108459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:09.108459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:09.108462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:09.108463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:09.108498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896688857329926:8378]
2025-09-30T14:58:09.108502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:09.108505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:09.108521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.108525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.108537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_29_9891895112688442900_v1 on pipe: [1:7555896688947123815:6545]
2025-09-30T14:58:09.108582Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_29_9891895112688442900_v1:1 with generation 2801
2025-09-30T14:58:09.108583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.108586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.108597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:09.108603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:09.108605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:09.108620Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_29_9891895112688442900_v1
2025-09-30T14:58:09.108629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:09.108668Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d67b71ee-76526b79-8f2aa241-8282a457_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:09.108680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:58:09.108684Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:58:09.111501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:58:09.111538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:58:09.111547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:09.111564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:09.111572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:09.111585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:09.111598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:09.111610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:58:09.111622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:58:09.111638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:09.111766Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244289108 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:58:09.111794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:58:09.111830Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 sending to client partition status
2025-09-30T14:58:09.112303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.112325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.112346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:09.112459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2802 partition: 0 MaxSeqNo: 42 sessionId: src_id|d67b71ee-76526b79-8f2aa241-8282a457_0
2025-09-30T14:58:09.112701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66c2c518-24167bf6-d47a2c45-b3e35ff1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d67b71ee-76526b79-8f2aa241-8282a457_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:09.115719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d67b71ee-76526b79-8f2aa241-8282a457_0] Write session: try to update token
2025-09-30T14:58:09.115741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d67b71ee-76526b79-8f2aa241-8282a457_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:09.121130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:09.121149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:09.121152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:09.121154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:09.121163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896688857329926:8378]
2025-09-30T14:58:09.121169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896688857329926:8378]
2025-09-30T14:58:09.121174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896688857329926:8378]
2025-09-30T14:58:09.121216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:09.121223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.121227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:09.121250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:09.121266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:09.121270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:09.121383Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:09.142158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2802 sessionId: src_id|d67b71ee-76526b79-8f2aa241-8282a457_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:09.145141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:09.240715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896688947123815:6545]
2025-09-30T14:58:09.240757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:09.240760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:09.240806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:09.240845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2802 reason: error at write: Disconnected sessionId: src_id|d67b71ee-76526b79-8f2aa241-8282a457_0
2025-09-30T14:58:09.241073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2802 sessionId: src_id|d67b71ee-76526b79-8f2aa241-8282a457_0 is DEAD
2025-09-30T14:58:09.240036Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:09.240391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.240401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.240730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_29_9891895112688442900_v1
2025-09-30T14:58:09.240749Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:09.241234Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_29_9891895112688442900_v1
2025-09-30T14:58:09.243406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67b71ee-76526b79-8f2aa241-8282a457_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:09.243418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67b71ee-76526b79-8f2aa241-8282a457_0] Write session will restart in 0.009267s
2025-09-30T14:58:09.243446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67b71ee-76526b79-8f2aa241-8282a457_0] Write session: Do CDS request
2025-09-30T14:58:09.243453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67b71ee-76526b79-8f2aa241-8282a457_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:09.253904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d67b71ee-76526b79-8f2aa241-8282a457_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:09.254022Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:09.254050Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2803
2025-09-30T14:58:09.254184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2803 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:09.254218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2803 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:09.254237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2803 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:09.254246Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:09.254679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2803 sessionId:  describe result for acl check
2025-09-30T14:58:09.254721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:09.254728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:09.254730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:09.254735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896688947123925:6540] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:09.255305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896688947123925:6540] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:09.260834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896688947123925:6540] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:09.264334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896688947123925:6540] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:09.264350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896688947123925:6540] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:09.264353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896688947123925:6540] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:09.264363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2803 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:09.265717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:09.272591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:09.272916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:09.272921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:09.272934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:09.273019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:09.273066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896688857330089:8370]
2025-09-30T14:58:09.273533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:09.273949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:09.274003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:09.274289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:09.274344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.274345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.274346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.274348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.274349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.274351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.274352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.274354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.274355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.274357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.274358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.274360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.274361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.274363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.274364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.274370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.274378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.274380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.274383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.274386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.274388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.274391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.274393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.274396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.274399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.274401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.274404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.274407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.274409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.274411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.274418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.274423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.274432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.274438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.274444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.274450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.274455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.274461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.274467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.274473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.274477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.274480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.274482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.274486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.274488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.274492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.274495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.274498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.274500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.274504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.274507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.274510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.274513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.274516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.274520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.274523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.274525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.274529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.274531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.274535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.274560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:09.281590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:09.283021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:09.283045Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:09.283048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:09.283052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:09.283059Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2802 [2:7555896688857330089:8370]
2025-09-30T14:58:09.283077Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:09.283095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:09.283098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:09.283102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:09.283104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:09.283124Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:09.283131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:09.283138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:09.283205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.283214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.283219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.283223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:09.283226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:09.283320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:09.283329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.283344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.283361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.283379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:09.283404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947124046:6540], now have 1 active actors on pipe
2025-09-30T14:58:09.283413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947123908:2454], now have 1 active actors on pipe
2025-09-30T14:58:09.283420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896688857330084:8370]
2025-09-30T14:58:09.283427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896688857330084:8370]
2025-09-30T14:58:09.283430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896688857330084:8370]
2025-09-30T14:58:09.283444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:09.283457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:09.283463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:09.283467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:09.283472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:09.283478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:09.283481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:09.283517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896688857330084:8370]
2025-09-30T14:58:09.283526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:09.283528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:09.283499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2802
2025-09-30T14:58:09.283540Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2802
2025-09-30T14:58:09.283561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.283571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.283610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:09.283623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:09.283627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:09.283633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:09.283642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:09.283657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:09.283680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:09.284023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.284033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.284052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:09.284167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2803 partition: 0 MaxSeqNo: 42 sessionId: src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0
2025-09-30T14:58:09.284551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d67b71ee-76526b79-8f2aa241-8282a457_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:09.287779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0] Write session: try to update token
2025-09-30T14:58:09.287809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:09.296563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:09.296591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:09.296599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:09.296601Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:09.296612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896688857330084:8370]
2025-09-30T14:58:09.296631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896688857330084:8370]
2025-09-30T14:58:09.296635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896688857330084:8370]
2025-09-30T14:58:09.296681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:09.296687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:09.296694Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:09.296695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.296697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:09.296698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:09.296849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:09.303985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2803 sessionId: src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:09.307025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:09.343454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896688947124068:6545]
2025-09-30T14:58:09.343814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2802, pipe: [1:7555896688947124068:6545]
2025-09-30T14:58:09.418058Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:09.418572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.418587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.418604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947124068:6545], now have 1 active actors on pipe
2025-09-30T14:58:09.418761Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:09.418878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:09.418884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:09.418892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:09.418943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896688947124068:6545]
2025-09-30T14:58:09.418959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2803 reason: error at write: Disconnected sessionId: src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0
2025-09-30T14:58:09.419142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2803 sessionId: src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0 is DEAD
2025-09-30T14:58:09.419305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:09.419317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0] Write session will restart in 0.005136s
2025-09-30T14:58:09.419342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0] Write session: Do CDS request
2025-09-30T14:58:09.419350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:09.425801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:09.425927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:09.425943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2804
2025-09-30T14:58:09.426084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2804 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:09.426118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2804 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:09.426125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2804 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:09.426129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:09.426593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2804 sessionId:  describe result for acl check
2025-09-30T14:58:09.426631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:09.426638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:09.426640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:09.426646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896688947124085:6557] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:09.427188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896688947124085:6557] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:09.431874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896688947124085:6557] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:09.433886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:09.437953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896688947124085:6557] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:09.437972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896688947124085:6557] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:09.437976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896688947124085:6557] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:09.437950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:09.437986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2804 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:09.438189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:09.438205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:09.438218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:09.438285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:09.438325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896688857330233:8368]
2025-09-30T14:58:09.438990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:09.439323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:09.439377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:09.439718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:09.439814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.439822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.439823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.439824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.439826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.439827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.439828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.439830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.439831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.439833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.439834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.439835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.439836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.439838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.439839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.439845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.439857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.439862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.439867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.439872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.439877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.439881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.439886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.439890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.439895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.439900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.439904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.439909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.439914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.439918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.439930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.439939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.439945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.439959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.439970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.439976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.439985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.439991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.439997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.440009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.440013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.440023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.440029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.440034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.440040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.440050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.440056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.440067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.440071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.440076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.440082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.440087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.440097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.440102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.440107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.440117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.440122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.440132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.440138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.440148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.440196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:09.446004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:09.447548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:09.447572Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:09.447574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:09.447579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:09.447588Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2803 [2:7555896688857330233:8368]
2025-09-30T14:58:09.447608Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:09.447626Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:09.447635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:09.447639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:09.447641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:09.447663Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:09.447675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:09.447682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:09.447771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.447779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.447782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.447785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:09.447789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:09.448075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:09.448088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.448107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.448126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.448152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:09.448177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896688857330227:8368]
2025-09-30T14:58:09.448184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896688857330227:8368]
2025-09-30T14:58:09.448189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896688857330227:8368]
2025-09-30T14:58:09.448205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:09.448225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:09.448239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:09.448238Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:09.448243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:09.448243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:09.448245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:09.448286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896688857330227:8368]
2025-09-30T14:58:09.448295Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:09.448356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:09.448449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947124210:6557], now have 1 active actors on pipe
2025-09-30T14:58:09.448465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947124069:2454], now have 1 active actors on pipe
2025-09-30T14:58:09.448805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.448820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.448851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:09.448865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:09.448889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:09.448892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:09.448903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:09.448922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:09.448942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:09.448625Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2803
2025-09-30T14:58:09.448661Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2803
2025-09-30T14:58:09.455547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.455572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.455622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:09.455721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2804 partition: 0 MaxSeqNo: 42 sessionId: src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0
2025-09-30T14:58:09.456110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5a5c93-21be1b33-e0dc62b7-506e248c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:09.459077Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0] Write session: try to update token
2025-09-30T14:58:09.459097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:09.463497Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:09.463521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:09.463523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:09.463525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:09.463536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896688857330227:8368]
2025-09-30T14:58:09.463540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896688857330227:8368]
2025-09-30T14:58:09.463544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896688857330227:8368]
2025-09-30T14:58:09.463584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:09.463591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:09.463593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.463596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:09.463597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:09.463602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:09.463748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:09.474964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2804 sessionId: src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:09.478063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:09.519344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896688947124234:6545]
2025-09-30T14:58:09.519616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2803, pipe: [1:7555896688947124234:6545]
2025-09-30T14:58:09.580287Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:09.580704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.580723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.580743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947124234:6545], now have 1 active actors on pipe
2025-09-30T14:58:09.580995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:09.583799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:09.583814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0] Write session will restart in 0.007261s
2025-09-30T14:58:09.583837Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0] Write session: Do CDS request
2025-09-30T14:58:09.583844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:09.583330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896688947124234:6545]
2025-09-30T14:58:09.583383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:09.583463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2804 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0
2025-09-30T14:58:09.583652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2804 sessionId: src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0 is DEAD
2025-09-30T14:58:09.583846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:09.595780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:09.596128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:09.596143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2805
2025-09-30T14:58:09.596310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2805 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:09.596342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2805 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:09.596348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2805 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:09.596351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:09.596749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2805 sessionId:  describe result for acl check
2025-09-30T14:58:09.596777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:09.596780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:09.596781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:09.596788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896688947124351:6568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:09.597343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896688947124351:6568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:09.600653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:09.604724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:09.604874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896688947124351:6568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:09.605305Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:09.605320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:09.605335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:09.605417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:09.605463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896688857330416:8348]
2025-09-30T14:58:09.606160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:09.606509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:09.606559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:09.606908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:09.606975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.606982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.606984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.606985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.606986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.606988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.606989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.606990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.606991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.606993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.606994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.606995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.606997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.606998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.606999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.607005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.607016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.607021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.607026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.607030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.607034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.607039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.607043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.607048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.607052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.607057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.607061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.607065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.607070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.607074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.607082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.607096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.607106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.607117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.607129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.607140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.607149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.607160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.607170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.607181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.607186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.607197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.607203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.607213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.607218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.607224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.607234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.607263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.607274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.607281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.607286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.607291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.607296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.607302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.607308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.607314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.607320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.607332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.607337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.607343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.607398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:09.613444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:09.614351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:09.614373Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:09.614376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:09.614381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:09.614389Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2804 [2:7555896688857330416:8348]
2025-09-30T14:58:09.614408Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:09.614427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:09.614430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:09.614434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:09.614437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:09.614454Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:09.614461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:09.614471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:09.614848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.614861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.614863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.614867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:09.614870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:09.614947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:09.614955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.614971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.614990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.615015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:09.615038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896688857330411:8348]
2025-09-30T14:58:09.615045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896688857330411:8348]
2025-09-30T14:58:09.615047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896688857330411:8348]
2025-09-30T14:58:09.615064Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:09.615085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:09.615105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:09.615112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:09.615133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:09.615147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:09.615149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896688857330411:8348]
2025-09-30T14:58:09.615150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:09.615152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:09.615157Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:09.615441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947124263:2454], now have 1 active actors on pipe
2025-09-30T14:58:09.616155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947124402:6568], now have 1 active actors on pipe
2025-09-30T14:58:09.616479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.615444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2804
2025-09-30T14:58:09.616490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.615841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896688947124351:6568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:09.616516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:09.615850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896688947124351:6568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:09.616526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:09.616532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:09.616535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:09.615853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896688947124351:6568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:09.616546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:09.615863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2805 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:09.616388Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2804
2025-09-30T14:58:09.616559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:09.616581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:09.623522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.623552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.623592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:09.625894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0d0ffda-100b96d3-9395ba61-c5c43bcf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:09.623761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2805 partition: 0 MaxSeqNo: 42 sessionId: src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0
2025-09-30T14:58:09.628976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0] Write session: try to update token
2025-09-30T14:58:09.628994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:09.638655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:09.638677Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:09.638688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896688857330411:8348]
2025-09-30T14:58:09.638739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:09.638754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:09.638952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:09.639118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:09.639295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:09.639450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:09.639666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:09.639707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:09.652804Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:09.652832Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:09.652835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:09.652838Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:09.652849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896688857330411:8348]
2025-09-30T14:58:09.652853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896688857330411:8348]
2025-09-30T14:58:09.652857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896688857330411:8348]
2025-09-30T14:58:09.652919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:09.652931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.652934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:09.652943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:09.652956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:09.652962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:09.653152Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:09.660907Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2805 sessionId: src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:09.663859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:09.683605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896688947124409:6545]
2025-09-30T14:58:09.683839Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2804, pipe: [1:7555896688947124409:6545]
2025-09-30T14:58:09.769362Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:09.769872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.769880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.769897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947124409:6545], now have 1 active actors on pipe
2025-09-30T14:58:09.770353Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:09.771575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:09.771588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0] Write session will restart in 0.009035s
2025-09-30T14:58:09.771133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:09.771147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:09.771204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2805 reason: error at write: Disconnected sessionId: src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0
2025-09-30T14:58:09.771396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2805 sessionId: src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0 is DEAD
2025-09-30T14:58:09.771521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:09.771611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0] Write session: Do CDS request
2025-09-30T14:58:09.771608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896688947124409:6545]
2025-09-30T14:58:09.771619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:09.781778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:09.781911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:09.781928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2806
2025-09-30T14:58:09.786060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2806 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:09.786135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2806 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:09.786144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2806 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:09.786151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:09.786633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2806 sessionId:  describe result for acl check
2025-09-30T14:58:09.786677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:09.786683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:09.786685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:09.786692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896688947124489:6575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:09.787226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896688947124489:6575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:09.791336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896688947124489:6575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:09.792751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:09.796920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:09.797065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896688947124489:6575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:09.797080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896688947124489:6575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:09.797094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896688947124489:6575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:09.797143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2806 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:09.797160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:09.797168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:09.797179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:09.797233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:09.797276Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896688857330562:8340]
2025-09-30T14:58:09.797973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:09.798334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:09.798426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:09.798796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:09.798899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.798906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.798908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.798909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.798910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.798912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.798913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.798914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.798916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.798917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.798918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.798919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.798921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.798922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.798923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.798930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.798940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.798944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.798948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.798951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.798955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.798958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.798961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.798965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.798970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.798973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.798977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.798981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.798984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.798988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.798996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.799004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:09.799010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.799016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:09.799021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.799026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:09.799030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.799036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:09.799040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.799045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:09.799048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.799053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:09.799058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.799063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:09.799067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.799072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:09.799076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.799081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:09.799086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.799096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:09.799103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.799114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.799118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.799128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.799134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.799302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.799317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.799321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:09.799325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.799330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:09.799386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:09.809275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:09.810581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:09.810602Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:09.810605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:09.810609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:09.810616Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2805 [2:7555896688857330562:8340]
2025-09-30T14:58:09.810632Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:09.810648Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:09.810652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:09.810655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:09.810660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:09.810676Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:09.810682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:09.810689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:09.810756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.810758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.810760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.810763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:09.810766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:09.810840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:09.810843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.810856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:09.810866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:09.810883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:09.810905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947124415:2454], now have 1 active actors on pipe
2025-09-30T14:58:09.810913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896688857330557:8340]
2025-09-30T14:58:09.810915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896688857330557:8340]
2025-09-30T14:58:09.810917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896688857330557:8340]
2025-09-30T14:58:09.810925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:09.810935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947124556:6575], now have 1 active actors on pipe
2025-09-30T14:58:09.810942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:09.810948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:09.810952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:09.810957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:09.810959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:09.810960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:09.810999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896688857330557:8340]
2025-09-30T14:58:09.811002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:09.811019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:09.810986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2805
2025-09-30T14:58:09.811001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2805
2025-09-30T14:58:09.811605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.811619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.811645Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:09.811654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:09.811658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:09.811660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:09.811671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:09.811684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:09.811701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:09.811881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.811889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.811903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:09.811971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2806 partition: 0 MaxSeqNo: 42 sessionId: src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0
2025-09-30T14:58:09.812337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fbc8b2df-9178267-3cec78f-a10dfbff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:09.815147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0] Write session: try to update token
2025-09-30T14:58:09.815168Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:09.830570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2806 sessionId: src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:09.833878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:09.833910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:09.833922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896688857330557:8340]
2025-09-30T14:58:09.833981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:09.833987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:09.834176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:09.834048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:09.834325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:09.834474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:09.834622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:09.834819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:09.834863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:09.835457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.835474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.835506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:09.835657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:09.857168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:09.857192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:09.857195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:09.857198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:09.857208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896688857330557:8340]
2025-09-30T14:58:09.857217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896688857330557:8340]
2025-09-30T14:58:09.857220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896688857330557:8340]
2025-09-30T14:58:09.857265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:09.857271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:09.857274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:09.857284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:09.857294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:09.857300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:09.857417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:09.871595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896688947124568:6545]
2025-09-30T14:58:09.872017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2805, pipe: [1:7555896688947124568:6545]
2025-09-30T14:58:09.977006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:09.986411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:09.986661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:09.986856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.986924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.986992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.987057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.987100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.987106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.987179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.987265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.987331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.987400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.987444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.987447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.987520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.987581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.987644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.987711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.987753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.987756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.987834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.987897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.987967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.988030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.988072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.988075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.988146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.988207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.988273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.988336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.988383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.988385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.988459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.988518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.988583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.988651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.988700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.988703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.988778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.988838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.988927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.988992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.989033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.989036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.989109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.989170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.989234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.989298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.989340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.989347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.989418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.989478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.989542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.989610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.989652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.989655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.989726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:09.989787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:09.989853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:09.989916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:09.989960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:09.989963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:09.990052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947124568:6545], now have 1 active actors on pipe
2025-09-30T14:58:09.991364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:09.991383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:09.991423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2806 reason: error at write: Disconnected sessionId: src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0
2025-09-30T14:58:09.991677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2806 sessionId: src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0 is DEAD
2025-09-30T14:58:09.991112Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:09.991893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:09.991946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896688947124568:6545]
2025-09-30T14:58:09.995342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:09.995355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0] Write session will restart in 0.007712s
2025-09-30T14:58:09.995382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0] Write session: Do CDS request
2025-09-30T14:58:09.995387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:10.004817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:10.007608Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:10.007628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2807
2025-09-30T14:58:10.007789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2807 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:10.007826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2807 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:10.007846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2807 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:10.007855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:10.008279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2807 sessionId:  describe result for acl check
2025-09-30T14:58:10.008312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:10.008318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:10.008321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:10.008331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896693242091951:6589] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:10.008911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896693242091951:6589] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:10.012001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896693242091951:6589] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:10.014125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:10.020407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:10.020656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:10.020668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:10.020679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:10.020733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:10.020747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896693242091951:6589] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:10.020774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896693152298005:8334]
2025-09-30T14:58:10.020766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896693242091951:6589] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:10.020770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896693242091951:6589] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:10.020779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2807 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:10.021458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:10.021851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:10.021900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:10.022228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:10.022295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.022302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.022303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.022304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.022306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.022308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.022309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.022310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.022311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.022313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.022314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.022316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.022317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.022318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.022320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.022325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.022334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.022339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.022343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.022348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.022352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.022356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.022360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.022365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.022369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.022373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.022377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.022381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.022385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.022389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.022396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.022404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.022410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.022416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.022421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.022427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.022431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.022437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.022442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.022448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.022453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.022458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.022463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.022468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.022471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.022476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.022487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.022494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.022498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.022504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.022513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.022519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.022528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.022533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.022538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.022544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.022548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.022553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.022558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.022564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.022610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:10.028442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:10.029732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:10.029757Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:10.029760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:10.029764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:10.029772Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2806 [2:7555896693152298005:8334]
2025-09-30T14:58:10.029791Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:10.030305Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2806
2025-09-30T14:58:10.030311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2806
2025-09-30T14:58:10.029807Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:10.029820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:10.029824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:10.029826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:10.029859Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:10.029868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:10.029874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:10.029947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.029948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.029950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.029954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:10.029956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:10.030030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:10.030033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.030048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.030058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.030074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:10.030091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896693152298000:8334]
2025-09-30T14:58:10.030093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896693152298000:8334]
2025-09-30T14:58:10.030095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896693152298000:8334]
2025-09-30T14:58:10.030112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:10.030125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:10.030140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:10.030143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:10.030180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896693152298000:8334]
2025-09-30T14:58:10.030183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:10.030190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:10.030192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092010:6589], now have 1 active actors on pipe
2025-09-30T14:58:10.030194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:10.030196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896688947124572:2454], now have 1 active actors on pipe
2025-09-30T14:58:10.030196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:10.030203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:10.030550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.030558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.030590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:10.030600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:10.030604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:10.030606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:10.030618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:10.030631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:10.030659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:10.034386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.034411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.034449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:10.034674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2807 partition: 0 MaxSeqNo: 42 sessionId: src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0
2025-09-30T14:58:10.037365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1eb8dff-ea3c4e8e-a939f63d-e99cc609_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:10.040521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0] Write session: try to update token
2025-09-30T14:58:10.040547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:10.044812Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:10.044837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:10.044840Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:10.044842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:10.044854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896693152298000:8334]
2025-09-30T14:58:10.044858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896693152298000:8334]
2025-09-30T14:58:10.044863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896693152298000:8334]
2025-09-30T14:58:10.044912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:10.044919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.044922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:10.044926Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:10.044945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:10.044949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:10.045052Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:10.075455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2807 sessionId: src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:10.078826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:10.092211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896693242092021:6545]
2025-09-30T14:58:10.092526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2806, pipe: [1:7555896693242092021:6545]
2025-09-30T14:58:10.170102Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:10.170505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.170518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.170541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092021:6545], now have 1 active actors on pipe
2025-09-30T14:58:10.170796Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:10.170906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:10.170923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:10.170987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2807 reason: error at write: Disconnected sessionId: src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0
2025-09-30T14:58:10.171184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2807 sessionId: src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0 is DEAD
2025-09-30T14:58:10.171341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:10.171367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:10.171386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0] Write session will restart in 0.006041s
2025-09-30T14:58:10.171412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0] Write session: Do CDS request
2025-09-30T14:58:10.171417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:10.171353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896693242092021:6545]
2025-09-30T14:58:10.179165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:10.179274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:10.179291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2808
2025-09-30T14:58:10.180154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2808 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:10.180203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2808 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:10.180225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2808 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:10.180229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:10.181579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2808 sessionId:  describe result for acl check
2025-09-30T14:58:10.181615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:10.181622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:10.181624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:10.181630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896693242092039:6603] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:10.182203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896693242092039:6603] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:10.184285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896693242092039:6603] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:10.192126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896693242092039:6603] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:10.192153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896693242092039:6603] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:10.192157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896693242092039:6603] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:10.192170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2808 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:10.198756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:10.199930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:10.200167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:10.200177Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:10.200190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:10.200263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:10.200317Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896693152298157:8332]
2025-09-30T14:58:10.200997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:10.204966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:10.205057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:10.205540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:10.205632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.205633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.205635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.205636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.205638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.205640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.205641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.205643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.205645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.205646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.205648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.205649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.205650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.205652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.205653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.205661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.205674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.205679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.205683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.205687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.205692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.205697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.205701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.205706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.205710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.205714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.205719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.205724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.205728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.205733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.205743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.205752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.205759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.205766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.205772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.205778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.205784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.205790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.205795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.205801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.205806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.205812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.205817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.205826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.205831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.205837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.205843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.205848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.205853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.205860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.205866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.205872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.205877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.205883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.205889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.205895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.205900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.205905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.205911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.205917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.205965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:10.211747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:10.213083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:10.213090Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:10.213092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:10.213095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:10.213101Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2807 [2:7555896693152298157:8332]
2025-09-30T14:58:10.213117Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:10.213135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:10.213139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:10.213142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:10.213144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:10.213161Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:10.213168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:10.213177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:10.213229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.213230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.213231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.213234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:10.213236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:10.213293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:10.213295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.213305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.213311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.213321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:10.213334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896693152298151:8332]
2025-09-30T14:58:10.213335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896693152298151:8332]
2025-09-30T14:58:10.213337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896693152298151:8332]
2025-09-30T14:58:10.213354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:10.213374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:10.213391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:10.213394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:10.213426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:10.213431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:10.213433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:10.213433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896693152298151:8332]
2025-09-30T14:58:10.213435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:10.213439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:10.213838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2807
2025-09-30T14:58:10.213869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2807
2025-09-30T14:58:10.214147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092129:6603], now have 1 active actors on pipe
2025-09-30T14:58:10.214164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092025:2454], now have 1 active actors on pipe
2025-09-30T14:58:10.214178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.214184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.214214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|be01b391-1ed12f96-f7a3266-566c018e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:10.214223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:10.214229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:10.214233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:10.214245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:10.214257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:10.214277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:10.215403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.215422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.215448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:10.215585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2808 partition: 0 MaxSeqNo: 42 sessionId: src_id|be01b391-1ed12f96-f7a3266-566c018e_0
2025-09-30T14:58:10.219400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d91f7f6f-d1cffd1a-55395213-64c022e6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|be01b391-1ed12f96-f7a3266-566c018e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:10.222198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be01b391-1ed12f96-f7a3266-566c018e_0] Write session: try to update token
2025-09-30T14:58:10.222221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be01b391-1ed12f96-f7a3266-566c018e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:10.227394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:10.227419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:10.227422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:10.227425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:10.227435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896693152298151:8332]
2025-09-30T14:58:10.227440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896693152298151:8332]
2025-09-30T14:58:10.227444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896693152298151:8332]
2025-09-30T14:58:10.227484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:10.227491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.227494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:10.227636Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:10.230616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:10.230639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:10.230643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:10.248061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2808 sessionId: src_id|be01b391-1ed12f96-f7a3266-566c018e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:10.250687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:10.273067Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896693242092184:6545]
2025-09-30T14:58:10.273549Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2807, pipe: [1:7555896693242092184:6545]
2025-09-30T14:58:10.356645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:10.357205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.357224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.357245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092184:6545], now have 1 active actors on pipe
2025-09-30T14:58:10.357496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:10.357509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:10.357530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896693242092184:6545]
2025-09-30T14:58:10.357558Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:10.357583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2808 reason: error at write: Disconnected sessionId: src_id|be01b391-1ed12f96-f7a3266-566c018e_0
2025-09-30T14:58:10.357760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2808 sessionId: src_id|be01b391-1ed12f96-f7a3266-566c018e_0 is DEAD
2025-09-30T14:58:10.357910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be01b391-1ed12f96-f7a3266-566c018e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:10.357917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be01b391-1ed12f96-f7a3266-566c018e_0] Write session will restart in 0.005436s
2025-09-30T14:58:10.357958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be01b391-1ed12f96-f7a3266-566c018e_0] Write session: Do CDS request
2025-09-30T14:58:10.357964Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be01b391-1ed12f96-f7a3266-566c018e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:10.358063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:10.364828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|be01b391-1ed12f96-f7a3266-566c018e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:10.364938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:10.364954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2809
2025-09-30T14:58:10.365196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2809 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:10.365229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2809 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:10.365235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2809 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:10.365240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:10.365706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2809 sessionId:  describe result for acl check
2025-09-30T14:58:10.365743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:10.365746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:10.365748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:10.365753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896693242092208:6621] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:10.366329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896693242092208:6621] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:10.369288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896693242092208:6621] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:10.372025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896693242092208:6621] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:10.372039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896693242092208:6621] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:10.372043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896693242092208:6621] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:10.372050Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2809 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:10.373434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:10.378484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:10.378993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:10.379010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:10.379023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:10.379102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:10.379146Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896693152298318:8329]
2025-09-30T14:58:10.379885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:10.380232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:10.380282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:10.380628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:10.380692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.380693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.380695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.380696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.380698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.380699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.380701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.380702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.380704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.380705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.380707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.380708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.380709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.380711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.380712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.380718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.380730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.380735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.380740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.380744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.380749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.380754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.380758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.380763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.380768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.380773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.380777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.380782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.380786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.380790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.380798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.380807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.380814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.380820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.380826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.380832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.380837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.380844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.380850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.380856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.380861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.380868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.380888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.380894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.380900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.380906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.380911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.380917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.380922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.380928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.380935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.380942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.380947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.380953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.380958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.380964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.380969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.380974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.380978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.380984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.381035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:10.387077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:10.387990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:10.388010Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:10.388013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:10.388017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:10.388026Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2808 [2:7555896693152298318:8329]
2025-09-30T14:58:10.388044Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:10.388071Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:10.388074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:10.388078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:10.388080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:10.388097Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:10.388105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:10.388112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:10.388195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.388203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.388206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.388213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:10.388216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:10.388454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2808
2025-09-30T14:58:10.388492Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2808
2025-09-30T14:58:10.388623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:10.388633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.388648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.388661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.388688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:10.388714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092336:6621], now have 1 active actors on pipe
2025-09-30T14:58:10.388723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092193:2454], now have 1 active actors on pipe
2025-09-30T14:58:10.388740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.388745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.388765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896693152298313:8329]
2025-09-30T14:58:10.388774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896693152298313:8329]
2025-09-30T14:58:10.388777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896693152298313:8329]
2025-09-30T14:58:10.388791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:10.388812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:10.388822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:10.388826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:10.388827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:10.388835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:10.388838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:10.388856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:10.388867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:10.388889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:10.388891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:10.388901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:10.388912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:10.388961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896693152298313:8329]
2025-09-30T14:58:10.388973Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:10.388985Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:10.388986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:10.389150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.389160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.389177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:10.389281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2809 partition: 0 MaxSeqNo: 42 sessionId: src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0
2025-09-30T14:58:10.389653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|be01b391-1ed12f96-f7a3266-566c018e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:10.392449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0] Write session: try to update token
2025-09-30T14:58:10.392468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:10.401391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:10.401417Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:10.401427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896693152298313:8329]
2025-09-30T14:58:10.401477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:10.401518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:10.401656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:10.401804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:10.401946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:10.402078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:10.402279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:10.402315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:10.415029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2809 sessionId: src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:10.412791Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:10.412819Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:10.412822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:10.412824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:10.412836Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896693152298313:8329]
2025-09-30T14:58:10.412842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896693152298313:8329]
2025-09-30T14:58:10.412847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896693152298313:8329]
2025-09-30T14:58:10.412909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:10.412916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.412920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:10.412922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:10.412931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:10.412936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:10.413077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:10.417822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:10.457797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896693242092350:6545]
2025-09-30T14:58:10.458101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2808, pipe: [1:7555896693242092350:6545]
2025-09-30T14:58:10.533892Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:10.534486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.534502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.534523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092350:6545], now have 1 active actors on pipe
2025-09-30T14:58:10.534734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:10.534730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:10.534751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896693242092350:6545]
2025-09-30T14:58:10.535352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:10.534913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:10.535365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0] Write session will restart in 0.005294s
2025-09-30T14:58:10.534989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2809 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0
2025-09-30T14:58:10.535175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2809 sessionId: src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0 is DEAD
2025-09-30T14:58:10.535415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0] Write session: Do CDS request
2025-09-30T14:58:10.535421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:10.541776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:10.541868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:10.541883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2810
2025-09-30T14:58:10.542019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2810 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:10.542056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2810 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:10.542064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2810 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:10.542068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:10.542551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2810 sessionId:  describe result for acl check
2025-09-30T14:58:10.542587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:10.542594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:10.542598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:10.542604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896693242092380:6623] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:10.543178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896693242092380:6623] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:10.545592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896693242092380:6623] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:10.548669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896693242092380:6623] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:10.548685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896693242092380:6623] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:10.548688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896693242092380:6623] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:10.548696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2810 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:10.550148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:10.554311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:10.554624Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:10.554637Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:10.554650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:10.554737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:10.554787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896693152298468:8323]
2025-09-30T14:58:10.555506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:10.555846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:10.555911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:10.556263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:10.556333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.556339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.556340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.556342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.556343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.556345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.556346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.556348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.556349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.556351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.556352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.556354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.556355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.556356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.556357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.556364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.556376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.556381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.556385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.556389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.556394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.556398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.556402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.556406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.556411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.556415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.556419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.556423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.556427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.556431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.556443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.556450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.556457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.556462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.556467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.556473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.556490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.556495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.556500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.556506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.556511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.556517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.556522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.556528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.556533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.556539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.556544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.556549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.556556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.556561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.556566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.556572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.556576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.556582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.556588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.556595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.556606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.556611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.556617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.556627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.556676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:10.562276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:10.563641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:10.563655Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:10.563658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:10.563662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:10.563669Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2809 [2:7555896693152298468:8323]
2025-09-30T14:58:10.563687Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:10.563706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:10.563710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:10.563713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:10.563715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:10.563733Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:10.563739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:10.563747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:10.563812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.563819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.563822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.563825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:10.563828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:10.563894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:10.563901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.563915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.563932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.563954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:10.563975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092365:2454], now have 1 active actors on pipe
2025-09-30T14:58:10.563984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092509:6623], now have 1 active actors on pipe
2025-09-30T14:58:10.563990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896693152298463:8323]
2025-09-30T14:58:10.563993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896693152298463:8323]
2025-09-30T14:58:10.563997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896693152298463:8323]
2025-09-30T14:58:10.564014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:10.564028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:10.564028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:10.564033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:10.564035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:10.564051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:10.564054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:10.564089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896693152298463:8323]
2025-09-30T14:58:10.564100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:10.564107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:10.564120Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2809
2025-09-30T14:58:10.564180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.564189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.564212Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:10.564222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:10.564226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:10.564228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:10.564238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:10.564251Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:10.564256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2809
2025-09-30T14:58:10.564265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:10.564416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.564429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.564444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:10.564547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2810 partition: 0 MaxSeqNo: 42 sessionId: src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0
2025-09-30T14:58:10.564943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b34474aa-8830cb86-69dead71-38e8e4b7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:10.567871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0] Write session: try to update token
2025-09-30T14:58:10.567897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:10.576648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:10.576668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:10.576671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:10.576673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:10.576686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896693152298463:8323]
2025-09-30T14:58:10.576690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896693152298463:8323]
2025-09-30T14:58:10.576694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896693152298463:8323]
2025-09-30T14:58:10.576735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:10.576743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.576747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:10.576754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:10.576761Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:10.576765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:10.576922Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:10.585564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2810 sessionId: src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:10.590016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:10.634973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896693242092545:6545]
2025-09-30T14:58:10.639903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2809, pipe: [1:7555896693242092545:6545]
2025-09-30T14:58:10.694683Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:10.695043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.695059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.695079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092545:6545], now have 1 active actors on pipe
2025-09-30T14:58:10.695347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:10.695402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:10.695406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:10.695838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:10.695848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0] Write session will restart in 0.007493s
2025-09-30T14:58:10.695873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0] Write session: Do CDS request
2025-09-30T14:58:10.695879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:10.695469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2810 reason: error at write: Disconnected sessionId: src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0
2025-09-30T14:58:10.695661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2810 sessionId: src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0 is DEAD
2025-09-30T14:58:10.695807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896693242092545:6545]
2025-09-30T14:58:10.695659Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:10.705109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:10.705245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:10.705261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2811
2025-09-30T14:58:10.705391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2811 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:10.705418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2811 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:10.705423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2811 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:10.705427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:10.705844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2811 sessionId:  describe result for acl check
2025-09-30T14:58:10.705870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:10.705872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:10.705874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:10.705880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896693242092562:6640] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:10.706406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896693242092562:6640] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:10.718929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896693242092562:6640] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:10.720941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:10.726866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896693242092562:6640] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:10.726886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896693242092562:6640] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:10.726890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896693242092562:6640] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:10.726899Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2811 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:10.726576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:10.726812Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:10.726817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:10.726828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:10.726886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:10.726920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896693152298655:8279]
2025-09-30T14:58:10.727621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:10.727977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:10.728033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:10.728369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:10.728428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.728429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.728431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.728432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.728433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.728435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.728436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.728437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.728439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.728440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.728441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.728443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.728444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.728445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.728447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.728453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.728463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.728467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.728471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.728475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.728479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.728483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.728487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.728491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.728495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.728499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.728503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.728507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.728510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.728514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.728522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.728530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.728536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.728541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.728546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.728551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.728555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.728561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.728566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.728571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.728578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.728583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.728588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.728593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.728598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.728602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.728607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.728612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.728616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.728623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.728628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.728636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.728641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.728646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.728650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.728655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.728660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.728665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.728669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.728674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.728719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:10.734249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:10.735554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:10.735573Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:10.735576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:10.735581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:10.735587Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2810 [2:7555896693152298655:8279]
2025-09-30T14:58:10.735604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:10.735620Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:10.735624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:10.735627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:10.735630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:10.735645Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:10.735652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:10.735664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:10.735732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.735740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.735742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.735745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:10.735747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:10.735815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:10.735823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.735835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.735846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.735860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:10.735883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092547:2454], now have 1 active actors on pipe
2025-09-30T14:58:10.735891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092695:6640], now have 1 active actors on pipe
2025-09-30T14:58:10.735897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896693152298649:8279]
2025-09-30T14:58:10.735905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896693152298649:8279]
2025-09-30T14:58:10.735907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896693152298649:8279]
2025-09-30T14:58:10.735920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:10.735933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:10.735936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:10.735942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:10.735944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:10.735949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:10.735951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:10.735987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896693152298649:8279]
2025-09-30T14:58:10.736002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:10.736016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:10.736003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2810
2025-09-30T14:58:10.736057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2810
2025-09-30T14:58:10.736258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.736271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.736294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:10.736307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:10.736317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:10.736319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:10.736331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:10.736341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:10.736361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:10.736574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.736585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.736606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:10.736700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2811 partition: 0 MaxSeqNo: 42 sessionId: src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0
2025-09-30T14:58:10.739518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|842ea07f-bf91b40b-103a7c27-6000f8ce_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:10.742662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0] Write session: try to update token
2025-09-30T14:58:10.742690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:10.748417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:10.748438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:10.748441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:10.748443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:10.748451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896693152298649:8279]
2025-09-30T14:58:10.748457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896693152298649:8279]
2025-09-30T14:58:10.748462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896693152298649:8279]
2025-09-30T14:58:10.748508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:10.748514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.748516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:10.748520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:10.748527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:10.748534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:10.748677Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:10.759117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2811 sessionId: src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:10.762073Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:10.796257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896693242092709:6545]
2025-09-30T14:58:10.796978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2810, pipe: [1:7555896693242092709:6545]
2025-09-30T14:58:10.877724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:10.878210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.878221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.878242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092709:6545], now have 1 active actors on pipe
2025-09-30T14:58:10.878472Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:10.878520Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:10.878495Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896693242092709:6545]
2025-09-30T14:58:10.878522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:10.878525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:10.878598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2811 reason: error at write: Disconnected sessionId: src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0
2025-09-30T14:58:10.878781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2811 sessionId: src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0 is DEAD
2025-09-30T14:58:10.878948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:10.878955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0] Write session will restart in 0.006620s
2025-09-30T14:58:10.878979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0] Write session: Do CDS request
2025-09-30T14:58:10.878987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:10.886764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:10.886852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:10.886868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2812
2025-09-30T14:58:10.886983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2812 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:10.887015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2812 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:10.887029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2812 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:10.887034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:10.887473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2812 sessionId:  describe result for acl check
2025-09-30T14:58:10.887518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:10.887528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:10.887530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:10.887536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896693242092728:6644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:10.888064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896693242092728:6644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:10.890647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896693242092728:6644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:10.893549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896693242092728:6644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:10.893564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896693242092728:6644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:10.893568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896693242092728:6644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:10.893576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2812 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:10.893801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:10.898373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:10.898599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:10.898611Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:10.898622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:10.898684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:10.898728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896693152298807:8277]
2025-09-30T14:58:10.899478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:10.899808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:10.899855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:10.900195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:10.900263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.900270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.900271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.900273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.900274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.900275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.900276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.900278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.900279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.900280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.900281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.900282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.900284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.900285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.900286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.900291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.900302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.900306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.900310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.900314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.900319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.900323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.900328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.900334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.900339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.900343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.900347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.900351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.900355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.900359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.900367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.900376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:10.900382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.900389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:10.900394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.900400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:10.900404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.900409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:10.900414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.900419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:10.900423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.900429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:10.900434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.900439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:10.900445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.900450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:10.900455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.900466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:10.900470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.900475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:10.900484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.900489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.900494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.900503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.900509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.900518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.900523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.900527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:10.900531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.900537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:10.900587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:10.906246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:10.907491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:10.907506Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:10.907509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:10.907513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:10.907520Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2811 [2:7555896693152298807:8277]
2025-09-30T14:58:10.907537Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:10.907554Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:10.907558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:10.907562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:10.907564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:10.907579Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:10.907586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:10.907593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:10.907653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.907663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.907668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.907672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:10.907674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:10.907744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:10.907751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.907766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:10.907800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:10.907820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:10.907914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2811
2025-09-30T14:58:10.907922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2811
2025-09-30T14:58:10.907839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092711:2454], now have 1 active actors on pipe
2025-09-30T14:58:10.907852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092860:6644], now have 1 active actors on pipe
2025-09-30T14:58:10.907859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896693152298801:8277]
2025-09-30T14:58:10.907861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896693152298801:8277]
2025-09-30T14:58:10.907866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896693152298801:8277]
2025-09-30T14:58:10.907880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:10.907894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:10.907902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:10.907905Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:10.907907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:10.907911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:10.907914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:10.907950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896693152298801:8277]
2025-09-30T14:58:10.907954Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:10.907956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:10.907985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.907990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.908025Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f5b6275-c2521cec-16be9ace-248609b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:10.908032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:10.908040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:10.908042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:10.908052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:10.908061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:10.908078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:10.908281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:10.908294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:10.908310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:10.908399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2812 partition: 0 MaxSeqNo: 42 sessionId: src_id|4f5b6275-c2521cec-16be9ace-248609b4_0
2025-09-30T14:58:10.908777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a9d7428-af521d15-40b4bda9-4e6774ab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4f5b6275-c2521cec-16be9ace-248609b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:10.911668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5b6275-c2521cec-16be9ace-248609b4_0] Write session: try to update token
2025-09-30T14:58:10.911688Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5b6275-c2521cec-16be9ace-248609b4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:10.920535Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:10.920552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:10.920555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:10.920562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:10.920572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896693152298801:8277]
2025-09-30T14:58:10.920577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896693152298801:8277]
2025-09-30T14:58:10.920581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896693152298801:8277]
2025-09-30T14:58:10.920621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:10.920628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:10.920630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:10.920633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:10.920641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:10.920645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:10.920768Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:10.934043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2812 sessionId: src_id|4f5b6275-c2521cec-16be9ace-248609b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:10.936757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:10.978475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896693242092873:6545]
2025-09-30T14:58:10.978708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2811, pipe: [1:7555896693242092873:6545]
2025-09-30T14:58:11.036919Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:11.037339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.037353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.037373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896693242092873:6545], now have 1 active actors on pipe
2025-09-30T14:58:11.037637Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:11.037675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:11.037695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:11.037754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2812 reason: error at write: Disconnected sessionId: src_id|4f5b6275-c2521cec-16be9ace-248609b4_0
2025-09-30T14:58:11.038125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5b6275-c2521cec-16be9ace-248609b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:11.038135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5b6275-c2521cec-16be9ace-248609b4_0] Write session will restart in 0.008825s
2025-09-30T14:58:11.037934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2812 sessionId: src_id|4f5b6275-c2521cec-16be9ace-248609b4_0 is DEAD
2025-09-30T14:58:11.038045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896693242092873:6545]
2025-09-30T14:58:11.038064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:11.038162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5b6275-c2521cec-16be9ace-248609b4_0] Write session: Do CDS request
2025-09-30T14:58:11.038168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5b6275-c2521cec-16be9ace-248609b4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:11.051669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5b6275-c2521cec-16be9ace-248609b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:11.054864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:11.055584Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:11.055601Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2813
2025-09-30T14:58:11.058934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:11.059151Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:11.059162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:11.059173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:11.059226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:11.059379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2813 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:11.059436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2813 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:11.059441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2813 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:11.059447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:11.059566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896697447266257:8273]
2025-09-30T14:58:11.059925Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2813 sessionId:  describe result for acl check
2025-09-30T14:58:11.059962Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:11.059968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:11.059970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:11.059975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896697537060291:6654] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:11.060256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:11.060491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896697537060291:6654] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:11.060602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:11.060647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:11.060998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:11.061063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.061064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.061065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.061067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.061068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.061069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.061071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.061072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.061073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.061074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.061076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.061077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.061078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.061080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.061081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.061087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.061098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.061103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.061107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.061112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.061117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.061121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.061125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.061129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.061134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.061139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.061143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.061147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.061152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.061156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.061164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.061173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.061181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.061188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.061193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.061199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.061204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.061209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.061214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.061218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.061223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.061228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.061232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.061237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.061242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.061248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.061254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.061260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.061264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.061270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.061275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.061281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.061285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.061291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.061296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.061301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.061305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.061311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.061315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.061320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.061370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:11.062288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896697537060291:6654] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:11.066432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896697537060291:6654] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:11.066450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896697537060291:6654] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:11.066453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896697537060291:6654] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:11.066462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2813 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:11.066730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:11.067601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:11.067618Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:11.067621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:11.067625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:11.067631Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2812 [2:7555896697447266257:8273]
2025-09-30T14:58:11.067647Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:11.067662Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:11.067669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:11.067673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:11.067675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:11.067690Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:11.067701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:11.067711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:11.067768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.067775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.067777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.067780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:11.067783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:11.067850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:11.067859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.067873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.067886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.067907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:11.067929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537060329:6654], now have 1 active actors on pipe
2025-09-30T14:58:11.067933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537060174:2454], now have 1 active actors on pipe
2025-09-30T14:58:11.067939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896697447266252:8273]
2025-09-30T14:58:11.067947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896697447266252:8273]
2025-09-30T14:58:11.067950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896697447266252:8273]
2025-09-30T14:58:11.067963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:11.067976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:11.067976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:11.067980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:11.067983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:11.067998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:11.068002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:11.067994Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2812
2025-09-30T14:58:11.067999Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2812
2025-09-30T14:58:11.068037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896697447266252:8273]
2025-09-30T14:58:11.068048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:11.068054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:11.068120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.068129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.068150Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:11.068162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:11.068166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:11.068168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:11.068178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:11.068192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:11.068211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:11.068409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.068416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.068432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:11.068534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2813 partition: 0 MaxSeqNo: 42 sessionId: src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0
2025-09-30T14:58:11.068901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5b6275-c2521cec-16be9ace-248609b4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:11.071704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0] Write session: try to update token
2025-09-30T14:58:11.071725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:11.080095Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:11.080111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:11.080121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896697447266252:8273]
2025-09-30T14:58:11.080162Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:11.080165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:11.080361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:11.080517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:11.080672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:11.080818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:11.081028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:11.081072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:11.091519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:11.091541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:11.091543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:11.091546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:11.091556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896697447266252:8273]
2025-09-30T14:58:11.091561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896697447266252:8273]
2025-09-30T14:58:11.091565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896697447266252:8273]
2025-09-30T14:58:11.091608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:11.091615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.091618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:11.091639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:11.091655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:11.091659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:11.091757Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:11.091905Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2813 sessionId: src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:11.094720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:11.138242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896697537060339:6545]
2025-09-30T14:58:11.138607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2812, pipe: [1:7555896697537060339:6545]
2025-09-30T14:58:11.215433Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:11.216273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.216292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.216313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537060339:6545], now have 1 active actors on pipe
2025-09-30T14:58:11.216618Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:11.217001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896697537060339:6545]
2025-09-30T14:58:11.217037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:11.217098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2813 reason: status is not ok: tablet will be restarted right now sessionId: src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0
2025-09-30T14:58:11.217270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2813 sessionId: src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0 is DEAD
2025-09-30T14:58:11.217402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:11.223350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:11.223366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0] Write session will restart in 0.005093s
2025-09-30T14:58:11.223390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0] Write session: Do CDS request
2025-09-30T14:58:11.223396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:11.229795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:11.229939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:11.229962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2814
2025-09-30T14:58:11.230143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2814 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:11.230184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2814 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:11.230199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2814 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:11.230205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:11.230787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2814 sessionId:  describe result for acl check
2025-09-30T14:58:11.230845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:11.230848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:11.230850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:11.230857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896697537060422:6661] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:11.231477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896697537060422:6661] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:11.235044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896697537060422:6661] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:11.237216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:11.237308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896697537060422:6661] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:11.237323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896697537060422:6661] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:11.237327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896697537060422:6661] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:11.237336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2814 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:11.242277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:11.242846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:11.242861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:11.242875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:11.242943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:11.242990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896697447266411:8266]
2025-09-30T14:58:11.243703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:11.244101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:11.244177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:11.244567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:11.244637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.244643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.244645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.244646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.244647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.244649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.244650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.244652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.244654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.244655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.244656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.244658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.244659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.244660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.244662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.244668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.244679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.244684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.244688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.244692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.244696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.244700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.244704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.244708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.244712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.244716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.244720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.244724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.244728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.244732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.244742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.244751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.244757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.244763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.244768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.244774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.244778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.244784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.244797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.244804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.244809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.244814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.244820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.244826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.244835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.244840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.244845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.244851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.244865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.244888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.244892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.244898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.244907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.244912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.244924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.244929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.244934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.244939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.244944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.244950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.244993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:11.251372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:11.252288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:11.252307Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:11.252311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:11.252316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:11.252323Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2813 [2:7555896697447266411:8266]
2025-09-30T14:58:11.252340Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:11.252356Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:11.252361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:11.252365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:11.252367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:11.252382Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:11.252398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:11.252406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:11.252473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.252484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.252486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.252490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:11.252493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:11.252564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:11.252572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.252587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.252606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.252627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:11.252649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896697447266405:8266]
2025-09-30T14:58:11.252656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896697447266405:8266]
2025-09-30T14:58:11.252659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896697447266405:8266]
2025-09-30T14:58:11.252668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:11.252679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:11.252682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:11.252685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:11.252690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537060492:6661], now have 1 active actors on pipe
2025-09-30T14:58:11.252696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:11.252714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:11.252722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:11.252728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537060341:2454], now have 1 active actors on pipe
2025-09-30T14:58:11.252761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896697447266405:8266]
2025-09-30T14:58:11.252775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:11.252862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2813
2025-09-30T14:58:11.252863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2813
2025-09-30T14:58:11.253028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:11.253190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.253205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.253228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|230e8450-f534ef7f-be84e167-50bab254_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:11.253241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:11.253251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:11.253253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:11.253264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:11.253274Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:11.253294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:11.253584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.253600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.253621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:11.253763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2814 partition: 0 MaxSeqNo: 42 sessionId: src_id|230e8450-f534ef7f-be84e167-50bab254_0
2025-09-30T14:58:11.254598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34502f03-a01fda59-89a5bc7b-b05f25d8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|230e8450-f534ef7f-be84e167-50bab254_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:11.257504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|230e8450-f534ef7f-be84e167-50bab254_0] Write session: try to update token
2025-09-30T14:58:11.257523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|230e8450-f534ef7f-be84e167-50bab254_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:11.265835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:11.265852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:11.265855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:11.265857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:11.265868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896697447266405:8266]
2025-09-30T14:58:11.265874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896697447266405:8266]
2025-09-30T14:58:11.265878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896697447266405:8266]
2025-09-30T14:58:11.265927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:11.265933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.265936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:11.265949Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:11.265969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:11.265978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:11.266077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:11.281376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2814 sessionId: src_id|230e8450-f534ef7f-be84e167-50bab254_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:11.284273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:11.319642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896697537060509:6545]
2025-09-30T14:58:11.320171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2813, pipe: [1:7555896697537060509:6545]
2025-09-30T14:58:11.386456Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:11.387290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:11.387302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896697537060509:6545]
2025-09-30T14:58:11.387305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:11.387324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:11.387379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2814 reason: error at write: Disconnected sessionId: src_id|230e8450-f534ef7f-be84e167-50bab254_0
2025-09-30T14:58:11.387545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2814 sessionId: src_id|230e8450-f534ef7f-be84e167-50bab254_0 is DEAD
2025-09-30T14:58:11.388027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230e8450-f534ef7f-be84e167-50bab254_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:11.388036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230e8450-f534ef7f-be84e167-50bab254_0] Write session will restart in 0.008471s
2025-09-30T14:58:11.388069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230e8450-f534ef7f-be84e167-50bab254_0] Write session: Do CDS request
2025-09-30T14:58:11.388075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230e8450-f534ef7f-be84e167-50bab254_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:11.386896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.386915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.386935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537060509:6545], now have 1 active actors on pipe
2025-09-30T14:58:11.388663Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:11.399774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|230e8450-f534ef7f-be84e167-50bab254_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:11.403400Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:11.403419Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2815
2025-09-30T14:58:11.403569Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2815 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:11.403604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2815 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:11.403627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2815 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:11.403636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:11.404143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2815 sessionId:  describe result for acl check
2025-09-30T14:58:11.404179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:11.404181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:11.404183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:11.404190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896697537060531:6670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:11.404745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896697537060531:6670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:11.407486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896697537060531:6670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:11.411798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896697537060531:6670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:11.411815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896697537060531:6670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:11.411818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896697537060531:6670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:11.411828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2815 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:11.417133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:11.421746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:11.422010Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:11.422022Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:11.422034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:11.422096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:11.422575Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896697447266579:8253]
2025-09-30T14:58:11.423305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:11.423828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:11.423897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:11.424276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:11.424356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.424363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.424364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.424366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.424367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.424368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.424370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.424371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.424372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.424374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.424375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.424377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.424378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.424379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.424381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.424387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.424400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.424414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.424418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.424422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.424427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.424431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.424435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.424439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.424446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.424450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.424454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.424459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.424463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.424467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.424476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.424485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.424491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.424497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.424503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.424509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.424512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.424518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.424525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.424531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.424542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.424547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.424553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.424559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.424563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.424569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.424574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.424580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.424599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.424605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.424615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.424620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.424629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.424635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.424643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.424653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.424658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.424664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.424669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.424674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.424722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:11.430769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:11.431739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:11.431762Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:11.431766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:11.431770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:11.431781Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2814 [2:7555896697447266579:8253]
2025-09-30T14:58:11.431799Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:11.431815Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:11.431832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:11.431835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:11.431838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:11.431856Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:11.431863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:11.431870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:11.431940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.431948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.431951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.431955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:11.431958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:11.432039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:11.432047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.432061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.432072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.432094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:11.432121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537060514:2454], now have 1 active actors on pipe
2025-09-30T14:58:11.432133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896697447266574:8253]
2025-09-30T14:58:11.432136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896697447266574:8253]
2025-09-30T14:58:11.432138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896697447266574:8253]
2025-09-30T14:58:11.432152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:11.432171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537060630:6670], now have 1 active actors on pipe
2025-09-30T14:58:11.432170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:11.432174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:11.432176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:11.432184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:11.432198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:11.432201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:11.432238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896697447266574:8253]
2025-09-30T14:58:11.432253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:11.432254Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:11.432454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.432470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.432496Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:11.432508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:11.432512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:11.432519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:11.432530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:11.432541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:11.432560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:11.432817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.432832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.432858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:11.432248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2814
2025-09-30T14:58:11.432313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2814
2025-09-30T14:58:11.433002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2815 partition: 0 MaxSeqNo: 42 sessionId: src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0
2025-09-30T14:58:11.435966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|230e8450-f534ef7f-be84e167-50bab254_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:11.438916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0] Write session: try to update token
2025-09-30T14:58:11.438942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:11.449391Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:11.449413Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:11.449416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:11.449418Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:11.449428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896697447266574:8253]
2025-09-30T14:58:11.449432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896697447266574:8253]
2025-09-30T14:58:11.449436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896697447266574:8253]
2025-09-30T14:58:11.449483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:11.449489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.449489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:11.449492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:11.449496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:11.449501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:11.449636Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:11.452852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2815 sessionId: src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:11.455759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:11.487398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896697537060692:6545]
2025-09-30T14:58:11.487667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2814, pipe: [1:7555896697537060692:6545]
2025-09-30T14:58:11.563520Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:11.564190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.564207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.564247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537060692:6545], now have 1 active actors on pipe
2025-09-30T14:58:11.564716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:11.564930Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896697537060692:6545]
2025-09-30T14:58:11.564957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:11.564987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:11.565057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2815 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0
2025-09-30T14:58:11.565221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2815 sessionId: src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0 is DEAD
2025-09-30T14:58:11.565493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:11.565513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0] Write session will restart in 0.009378s
2025-09-30T14:58:11.565546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0] Write session: Do CDS request
2025-09-30T14:58:11.565556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:11.576067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:11.576053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:11.576069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2816
2025-09-30T14:58:11.576398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2816 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:11.576441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2816 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:11.576452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2816 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:11.576458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:11.577003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2816 sessionId:  describe result for acl check
2025-09-30T14:58:11.577038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:11.577044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:11.577046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:11.577053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896697537060811:6677] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:11.577587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896697537060811:6677] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:11.579515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896697537060811:6677] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:11.583561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:11.584167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:11.584186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896697537060811:6677] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:11.584203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896697537060811:6677] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:11.584209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896697537060811:6677] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:11.584218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2816 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:11.584658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:11.584673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:11.584688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:11.584760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:11.584824Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896697447266736:8247]
2025-09-30T14:58:11.585502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:11.585916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:11.585972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:11.586312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:11.586374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.586380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.586381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.586382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.586383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.586384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.586386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.586387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.586388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.586389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.586390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.586392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.586393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.586394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.586395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.586400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.586411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.586414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.586418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.586422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.586425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.586429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.586432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.586436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.586440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.586443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.586447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.586450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.586453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.586456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.586465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.586472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.586477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.586482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.586486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.586490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.586494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.586498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.586502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.586507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.586510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.586515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.586518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.586523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.586526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.586531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.586534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.586539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.586543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.586547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.586551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.586555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.586560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.586565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.586569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.586573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.586577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.586581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.586585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.586589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.586625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:11.592839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:11.593780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:11.593803Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:11.593806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:11.593810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:11.593817Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2815 [2:7555896697447266736:8247]
2025-09-30T14:58:11.593835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:11.593854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:11.593858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:11.593861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:11.593864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:11.593881Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:11.593888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:11.593895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:11.593966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.593977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.593979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.593984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:11.593987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:11.594056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:11.594065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.594079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.594093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.594110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:11.594135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537060694:2454], now have 1 active actors on pipe
2025-09-30T14:58:11.594147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537060847:6677], now have 1 active actors on pipe
2025-09-30T14:58:11.594152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896697447266730:8247]
2025-09-30T14:58:11.594155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896697447266730:8247]
2025-09-30T14:58:11.594160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896697447266730:8247]
2025-09-30T14:58:11.594175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:11.594194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:11.594215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:11.594223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:11.594247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:11.594258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:11.594260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:11.594223Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2815
2025-09-30T14:58:11.594261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896697447266730:8247]
2025-09-30T14:58:11.594283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2815
2025-09-30T14:58:11.594263Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:11.594267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:11.594416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.594432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.594458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:11.594475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:11.594480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:11.594483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:11.594497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:11.594510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:11.594531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:11.594753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.594763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.594779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:11.594862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2816 partition: 0 MaxSeqNo: 42 sessionId: src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0
2025-09-30T14:58:11.595261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ea60968f-81e1d606-2565dd2f-6360df5f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:11.598165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0] Write session: try to update token
2025-09-30T14:58:11.598188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:11.607912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:11.607933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:11.607936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:11.607943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:11.607953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896697447266730:8247]
2025-09-30T14:58:11.607957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896697447266730:8247]
2025-09-30T14:58:11.607961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896697447266730:8247]
2025-09-30T14:58:11.608002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:11.608009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.608012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:11.608020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:11.608029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:11.608033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:11.608157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:11.626151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2816 sessionId: src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:11.628902Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:11.667256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896697537060872:6545]
2025-09-30T14:58:11.671524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2815, pipe: [1:7555896697537060872:6545]
2025-09-30T14:58:11.722859Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:11.723411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.723433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.723455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537060872:6545], now have 1 active actors on pipe
2025-09-30T14:58:11.723656Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:11.723717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896697537060872:6545]
2025-09-30T14:58:11.723752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:11.723785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:11.723788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:11.723846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2816 reason: error at write: Disconnected sessionId: src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0
2025-09-30T14:58:11.724019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2816 sessionId: src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0 is DEAD
2025-09-30T14:58:11.727400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:11.727421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0] Write session will restart in 0.008324s
2025-09-30T14:58:11.727467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0] Write session: Do CDS request
2025-09-30T14:58:11.727478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:11.739981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:11.740112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:11.740130Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2817
2025-09-30T14:58:11.740305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2817 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:11.740348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2817 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:11.740359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2817 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:11.740364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:11.740909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2817 sessionId:  describe result for acl check
2025-09-30T14:58:11.740945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:11.740947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:11.740949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:11.740956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896697537060934:6703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:11.741515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896697537060934:6703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:11.743741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896697537060934:6703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:11.746791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896697537060934:6703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:11.746809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896697537060934:6703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:11.746813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896697537060934:6703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:11.746821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2817 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:11.750576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:11.751262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:11.751470Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:11.751482Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:11.751493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:11.751558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:11.751603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896697447266929:8217]
2025-09-30T14:58:11.752275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:11.752843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:11.752919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:11.753285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:11.753350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.753356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.753358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.753359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.753360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.753362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.753364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.753365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.753366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.753368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.753369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.753370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.753372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.753373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.753374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.753380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.753390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.753394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.753398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.753403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.753407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.753411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.753415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.753419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.753425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.753429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.753433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.753437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.753442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.753446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.753455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.753463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.753469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.753475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.753480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.753485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.753490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.753495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.753500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.753505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.753510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.753515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.753520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.753526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.753536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.753541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.753546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.753551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.753556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.753561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.753566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.753571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.753575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.753592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.753602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.753607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.753611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.753621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.753625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.753631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.753680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:11.759604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:11.760980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:11.760993Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:11.760995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:11.760998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:11.761006Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2816 [2:7555896697447266929:8217]
2025-09-30T14:58:11.761019Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:11.761033Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:11.761035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:11.761037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:11.761038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:11.761052Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:11.761057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:11.761062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:11.761129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.761134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.761135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.761138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:11.761140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:11.761198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:11.761204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.761214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.761221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.761230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:11.761249Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896697447266924:8217]
2025-09-30T14:58:11.761257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896697447266924:8217]
2025-09-30T14:58:11.761259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896697447266924:8217]
2025-09-30T14:58:11.761267Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:11.761279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:11.761283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537061038:6703], now have 1 active actors on pipe
2025-09-30T14:58:11.761288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537060883:2454], now have 1 active actors on pipe
2025-09-30T14:58:11.761289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:11.761291Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:11.761294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:11.761306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:11.761309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:11.761344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896697447266924:8217]
2025-09-30T14:58:11.761356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:11.761364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:11.761361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2816
2025-09-30T14:58:11.761369Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2816
2025-09-30T14:58:11.761539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.761547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.761572Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:11.761583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:11.761587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:11.761589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:11.761599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:11.761606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:11.761616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:11.761795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.761805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.761822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:11.762016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2817 partition: 0 MaxSeqNo: 42 sessionId: src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0
2025-09-30T14:58:11.762495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e816bc24-c8055db4-19d3040b-fb4e53d0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:11.766303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0] Write session: try to update token
2025-09-30T14:58:11.766332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:11.773660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:11.773682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:11.773693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896697447266924:8217]
2025-09-30T14:58:11.773739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:11.773749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:11.773917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:11.774068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:11.774213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:11.774371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:11.774564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:11.774599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:11.783458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2817 sessionId: src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:11.786311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:11.786579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.786611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.786647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:11.786781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:11.788736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:11.788753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:11.788755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:11.788756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:11.788763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896697447266924:8217]
2025-09-30T14:58:11.788766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896697447266924:8217]
2025-09-30T14:58:11.788769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896697447266924:8217]
2025-09-30T14:58:11.788802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:11.788807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.788810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:11.788811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:11.788818Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:11.788823Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:11.788945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:11.823792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896697537061050:6545]
2025-09-30T14:58:11.824341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2816, pipe: [1:7555896697537061050:6545]
2025-09-30T14:58:11.905305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:11.914399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.914430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.914626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:11.914698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:11.914764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:11.915101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:11.915149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:11.915154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:11.915226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:11.915305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:11.915370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:11.915435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:11.919425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:11.919460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0] Write session will restart in 0.006261s
2025-09-30T14:58:11.919494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0] Write session: Do CDS request
2025-09-30T14:58:11.919502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:11.915477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:11.915480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:11.915556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:11.915616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:11.915679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:11.915741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:11.915783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:11.915786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:11.915855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:11.915916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:11.915981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:11.916046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:11.916088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:11.916091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:11.916164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:11.916226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:11.916289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:11.916349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:11.916391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:11.916394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:11.916463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:11.916522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:11.916587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:11.916653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:11.916695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:11.916702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:11.916773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:11.916832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:11.916913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:11.916976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:11.917022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:11.917026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:11.917094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:11.917153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:11.917215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:11.917278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:11.917319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:11.917322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:11.917394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:11.917452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:11.917515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:11.917580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:11.917621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:11.917624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:11.917692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:11.917751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:11.917819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:11.917881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:11.917924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:11.917928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:11.918016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537061050:6545], now have 1 active actors on pipe
2025-09-30T14:58:11.918456Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:11.918667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896697537061050:6545]
2025-09-30T14:58:11.918703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:11.918709Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:11.918736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2817 reason: error at write: Disconnected sessionId: src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0
2025-09-30T14:58:11.918926Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2817 sessionId: src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0 is DEAD
2025-09-30T14:58:11.919108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:11.926896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:11.927962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:11.927980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2818
2025-09-30T14:58:11.928378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2818 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:11.928419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2818 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:11.928425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2818 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:11.928429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:11.928856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2818 sessionId:  describe result for acl check
2025-09-30T14:58:11.928918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:11.928921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:11.928923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:11.928928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896697537061065:6717] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:11.929497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896697537061065:6717] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:11.932391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896697537061065:6717] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:11.937067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896697537061065:6717] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:11.937082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896697537061065:6717] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:11.937086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896697537061065:6717] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:11.937096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2818 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:11.946287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:11.947081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:11.947291Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:11.947301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:11.947313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:11.947376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:11.947417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896697447267088:8220]
2025-09-30T14:58:11.948087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:11.948503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:11.948585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:11.948946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:11.949023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.949029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.949031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.949032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.949034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.949035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.949036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.949038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.949039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.949040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.949042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.949043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.949055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.949057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.949058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.949065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.949076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.949081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.949085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.949089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.949094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.949098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.949102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.949106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.949111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.949115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.949119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.949124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.949128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.949132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.949142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.949151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:11.949157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.949162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:11.949168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.949178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:11.949183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.949189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:11.949194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.949200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:11.949204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.949210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:11.949215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.949225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:11.949230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.949236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:11.949246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.949251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:11.949284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.949294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:11.949299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.949304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.949309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.949314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.949319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.949324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.949329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.949333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:11.949338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.949343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:11.949388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:11.955668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:11.956883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:11.956899Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:11.956902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:11.956906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:11.956913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2817 [2:7555896697447267088:8220]
2025-09-30T14:58:11.956929Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:11.956947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:11.956950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:11.956953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:11.956955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:11.956973Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:11.956980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:11.956986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:11.957050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.957053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.957055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.957058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:11.957061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:11.957128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:11.957130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.957144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:11.957153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:11.957167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:11.957184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896697447267082:8220]
2025-09-30T14:58:11.957190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896697447267082:8220]
2025-09-30T14:58:11.957193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896697447267082:8220]
2025-09-30T14:58:11.957206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:11.957220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:11.957237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:11.957239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:11.957277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896697447267082:8220]
2025-09-30T14:58:11.957280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:11.957322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:11.957326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:11.957329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:11.957335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:11.957618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2817
2025-09-30T14:58:11.957653Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2817
2025-09-30T14:58:11.957859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537061151:6717], now have 1 active actors on pipe
2025-09-30T14:58:11.957869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896697537061054:2454], now have 1 active actors on pipe
2025-09-30T14:58:11.957887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.957892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.957917Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:11.957925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:11.957928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:11.957930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:11.957942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:11.957952Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:11.957967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:11.958201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:11.958206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:11.958221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:11.958379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2818 partition: 0 MaxSeqNo: 42 sessionId: src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0
2025-09-30T14:58:11.958823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24119639-dd27ace1-63a7dcc1-b3ce687f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:11.962209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0] Write session: try to update token
2025-09-30T14:58:11.962236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:11.972576Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:11.972600Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:11.972603Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:11.972605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:11.972615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896697447267082:8220]
2025-09-30T14:58:11.972619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896697447267082:8220]
2025-09-30T14:58:11.972627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896697447267082:8220]
2025-09-30T14:58:11.972669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:11.972676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:11.972679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:11.972679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:11.972689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:11.972693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:11.972821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:11.988514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2818 sessionId: src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:11.991398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:12.018867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896701832028517:6545]
2025-09-30T14:58:12.019227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2817, pipe: [1:7555896701832028517:6545]
2025-09-30T14:58:12.088788Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:12.089293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.089309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.089330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832028517:6545], now have 1 active actors on pipe
2025-09-30T14:58:12.089779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:12.089745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:12.089810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:12.089813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:12.089890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2818 reason: error at write: Disconnected sessionId: src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0
2025-09-30T14:58:12.089890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896701832028517:6545]
2025-09-30T14:58:12.090064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2818 sessionId: src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0 is DEAD
2025-09-30T14:58:12.091440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:12.091452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0] Write session will restart in 0.008943s
2025-09-30T14:58:12.091478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0] Write session: Do CDS request
2025-09-30T14:58:12.091486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:12.103043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:12.103896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:12.103913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2819
2025-09-30T14:58:12.104212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2819 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:12.104250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2819 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:12.104260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2819 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:12.104264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:12.107719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2819 sessionId:  describe result for acl check
2025-09-30T14:58:12.107758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:12.107760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:12.107762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:12.107768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896701832028603:6723] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:12.108289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896701832028603:6723] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:12.111336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896701832028603:6723] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:12.115355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:12.119116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896701832028603:6723] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:12.119131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896701832028603:6723] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:12.119135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896701832028603:6723] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:12.119144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2819 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:12.120188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:12.120718Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:12.120731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:12.120744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:12.120809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:12.120851Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896701742234545:8190]
2025-09-30T14:58:12.121515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:12.121924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:12.121964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:12.122277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:12.122337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.122344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.122345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.122346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.122348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.122349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.122351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.122352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.122353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.122354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.122356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.122357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.122358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.122360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.122361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.122366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.122376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.122381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.122385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.122389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.122393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.122398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.122402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.122406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.122410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.122415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.122419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.122423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.122428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.122432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.122441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.122448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.122454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.122460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.122465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.122471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.122482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.122488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.122493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.122498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.122503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.122510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.122520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.122526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.122534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.122540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.122546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.122555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.122559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.122565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.122573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.122578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.122583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.122588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.122596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.122601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.122606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.122616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.122621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.122630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.122690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:12.129607Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2818
2025-09-30T14:58:12.129613Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2818
2025-09-30T14:58:12.128350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:12.129239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:12.129245Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:12.129248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:12.129253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:12.129260Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2818 [2:7555896701742234545:8190]
2025-09-30T14:58:12.129277Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:12.129293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:12.129296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:12.129300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:12.129302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:12.129317Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:12.129324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:12.129332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:12.129394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.129396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.129400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.129403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:12.129406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:12.129486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:12.129489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.129503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.129517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.129537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:12.129556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832028518:2454], now have 1 active actors on pipe
2025-09-30T14:58:12.129560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832028674:6723], now have 1 active actors on pipe
2025-09-30T14:58:12.129566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896701742234539:8190]
2025-09-30T14:58:12.129569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896701742234539:8190]
2025-09-30T14:58:12.129571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896701742234539:8190]
2025-09-30T14:58:12.129586Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:12.129599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:12.129609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:12.129614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:12.129615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:12.129617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:12.129618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:12.129651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896701742234539:8190]
2025-09-30T14:58:12.129658Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:12.129664Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:12.129848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.129865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.129895Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e209c45-94a522ba-3705d30c-37279fba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:12.129912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:12.129916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:12.129918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:12.129930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:12.129960Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:12.129980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:12.130163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.130172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.130187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:12.130290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2819 partition: 0 MaxSeqNo: 42 sessionId: src_id|4e209c45-94a522ba-3705d30c-37279fba_0
2025-09-30T14:58:12.130671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b18f7e15-67cea5e0-4f8f3aa5-a27d7b66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4e209c45-94a522ba-3705d30c-37279fba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:12.133736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e209c45-94a522ba-3705d30c-37279fba_0] Write session: try to update token
2025-09-30T14:58:12.133755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e209c45-94a522ba-3705d30c-37279fba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:12.142634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:12.142659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:12.142662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:12.142664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:12.142676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896701742234539:8190]
2025-09-30T14:58:12.142681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896701742234539:8190]
2025-09-30T14:58:12.142687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896701742234539:8190]
2025-09-30T14:58:12.142738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:12.142741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:12.142745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.142748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:12.142749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:12.142753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:12.142928Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:12.150344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2819 sessionId: src_id|4e209c45-94a522ba-3705d30c-37279fba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:12.153147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:12.189868Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896701832028687:6545]
2025-09-30T14:58:12.191642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2818, pipe: [1:7555896701832028687:6545]
2025-09-30T14:58:12.261320Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:12.261750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.261764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.261781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832028687:6545], now have 1 active actors on pipe
2025-09-30T14:58:12.262034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:12.262086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:12.262088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:12.262109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896701832028687:6545]
2025-09-30T14:58:12.262159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2819 reason: error at write: Disconnected sessionId: src_id|4e209c45-94a522ba-3705d30c-37279fba_0
2025-09-30T14:58:12.262347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2819 sessionId: src_id|4e209c45-94a522ba-3705d30c-37279fba_0 is DEAD
2025-09-30T14:58:12.262470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e209c45-94a522ba-3705d30c-37279fba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:12.262482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e209c45-94a522ba-3705d30c-37279fba_0] Write session will restart in 0.005414s
2025-09-30T14:58:12.262507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e209c45-94a522ba-3705d30c-37279fba_0] Write session: Do CDS request
2025-09-30T14:58:12.262513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e209c45-94a522ba-3705d30c-37279fba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:12.261983Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:12.271311Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:12.271324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2820
2025-09-30T14:58:12.271423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e209c45-94a522ba-3705d30c-37279fba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:12.271667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2820 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:12.271710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2820 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:12.271715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2820 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:12.271720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:12.272147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2820 sessionId:  describe result for acl check
2025-09-30T14:58:12.272201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:12.272211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:12.272213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:12.272219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896701832028768:6725] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:12.272775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896701832028768:6725] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:12.275015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896701832028768:6725] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:12.277308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:12.280603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:12.280858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896701832028768:6725] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:12.280898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896701832028768:6725] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:12.280901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896701832028768:6725] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:12.280911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2820 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:12.281100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:12.281112Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:12.281125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:12.281189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:12.281231Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896701742234716:8202]
2025-09-30T14:58:12.281924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:12.282232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:12.282278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:12.282638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:12.282712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.282719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.282720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.282722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.282723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.282724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.282726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.282727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.282728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.282730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.282731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.282732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.282734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.282735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.282737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.282742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.282753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.282758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.282763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.282767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.282772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.282777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.282781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.282785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.282792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.282796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.282801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.282805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.282810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.282814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.282821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.282830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.282836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.282843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.282848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.282853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.282858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.282864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.282869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.282875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.282882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.282888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.282894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.282900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.282905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.282917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.282922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.282937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.282941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.282947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.282953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.282963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.282968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.282978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.282984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.282994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.282999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.283004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.283009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.283015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.283072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:12.288998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:12.289959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:12.289978Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:12.289981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:12.289985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:12.289992Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2819 [2:7555896701742234716:8202]
2025-09-30T14:58:12.290017Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:12.290038Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:12.290041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:12.290045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:12.290047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:12.290064Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:12.290073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:12.290080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:12.290157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.290170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.290174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.290178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:12.290181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:12.290253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:12.290261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.290276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.290298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.290313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:12.290331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896701742234711:8202]
2025-09-30T14:58:12.290348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896701742234711:8202]
2025-09-30T14:58:12.290355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896701742234711:8202]
2025-09-30T14:58:12.290366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:12.290388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:12.290400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:12.290400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:12.290403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:12.290417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:12.290421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:12.290436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832028859:6725], now have 1 active actors on pipe
2025-09-30T14:58:12.290440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832028690:2454], now have 1 active actors on pipe
2025-09-30T14:58:12.290478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896701742234711:8202]
2025-09-30T14:58:12.290493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:12.290510Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:12.290503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2819
2025-09-30T14:58:12.290515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2819
2025-09-30T14:58:12.290589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.290600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.290625Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de253c97-eaa17264-95cba8c1-b14f15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:12.290638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:12.290646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:12.290649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:12.290659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:12.290670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:12.290689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:12.290918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.290932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.290964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:12.291072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2820 partition: 0 MaxSeqNo: 42 sessionId: src_id|de253c97-eaa17264-95cba8c1-b14f15_0
2025-09-30T14:58:12.291572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e209c45-94a522ba-3705d30c-37279fba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|de253c97-eaa17264-95cba8c1-b14f15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:12.296973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de253c97-eaa17264-95cba8c1-b14f15_0] Write session: try to update token
2025-09-30T14:58:12.296995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de253c97-eaa17264-95cba8c1-b14f15_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:12.306731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:12.306750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:12.306752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:12.306755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:12.306764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896701742234711:8202]
2025-09-30T14:58:12.306769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896701742234711:8202]
2025-09-30T14:58:12.306773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896701742234711:8202]
2025-09-30T14:58:12.306812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:12.306819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.306822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:12.306954Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:12.311390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:12.311416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:12.311421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:12.314987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2820 sessionId: src_id|de253c97-eaa17264-95cba8c1-b14f15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:12.317874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:12.362446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896701832028874:6545]
2025-09-30T14:58:12.362732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2819, pipe: [1:7555896701832028874:6545]
2025-09-30T14:58:12.422837Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:12.423403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.423421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.423441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832028874:6545], now have 1 active actors on pipe
2025-09-30T14:58:12.423711Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:12.423835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:12.423850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:12.423873Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:12.423915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2820 reason: error at write: Disconnected sessionId: src_id|de253c97-eaa17264-95cba8c1-b14f15_0
2025-09-30T14:58:12.423918Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896701832028874:6545]
2025-09-30T14:58:12.424086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2820 sessionId: src_id|de253c97-eaa17264-95cba8c1-b14f15_0 is DEAD
2025-09-30T14:58:12.424235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de253c97-eaa17264-95cba8c1-b14f15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:12.424248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de253c97-eaa17264-95cba8c1-b14f15_0] Write session will restart in 0.006518s
2025-09-30T14:58:12.424275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de253c97-eaa17264-95cba8c1-b14f15_0] Write session: Do CDS request
2025-09-30T14:58:12.424286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de253c97-eaa17264-95cba8c1-b14f15_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:12.435786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de253c97-eaa17264-95cba8c1-b14f15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:12.435844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:12.435863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2821
2025-09-30T14:58:12.435992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2821 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:12.436025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2821 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:12.436035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2821 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:12.436040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:12.436547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2821 sessionId:  describe result for acl check
2025-09-30T14:58:12.436584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:12.436586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:12.436588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:12.436595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896701832028903:6748] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:12.437356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896701832028903:6748] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:12.443015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896701832028903:6748] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:12.446793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896701832028903:6748] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:12.446808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896701832028903:6748] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:12.446811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896701832028903:6748] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:12.446820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2821 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:12.454483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:12.455323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:12.455577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:12.455591Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:12.455605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:12.455684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:12.455754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896701742234878:8200]
2025-09-30T14:58:12.456435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:12.457240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:12.457308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:12.457724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:12.457821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.457830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.457832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.457833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.457835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.457837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.457838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.457840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.457841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.457843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.457844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.457845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.457847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.457848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.457850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.457857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.457870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.457874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.457879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.457883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.457887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.457891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.457896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.457899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.457904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.457909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.457913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.457918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.457922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.457926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.457936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.457945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.457951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.457956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.457962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.457968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.457973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.457979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.457984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.457990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.458005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.458010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.458016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.458022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.458029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.458035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.458040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.458046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.458051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.458056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.458062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.458067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.458072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.458077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.458082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.458088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.458093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.458098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.458103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.458109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.458169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:12.465181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:12.466443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:12.466471Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:12.466474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:12.466478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:12.466486Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2820 [2:7555896701742234878:8200]
2025-09-30T14:58:12.466501Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:12.466518Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:12.466526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:12.466529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:12.466531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:12.466548Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:12.466555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:12.466567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:12.466630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.466640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.466642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.466645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:12.466648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:12.466728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:12.466736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.466752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.466771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.466795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:12.466815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896701742234873:8200]
2025-09-30T14:58:12.466818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896701742234873:8200]
2025-09-30T14:58:12.466822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896701742234873:8200]
2025-09-30T14:58:12.466830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:12.466845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:12.466846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:12.466849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:12.466851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:12.466862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:12.466867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:12.466877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832029030:6748], now have 1 active actors on pipe
2025-09-30T14:58:12.466882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832028875:2454], now have 1 active actors on pipe
2025-09-30T14:58:12.466919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896701742234873:8200]
2025-09-30T14:58:12.466939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:12.467022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2820
2025-09-30T14:58:12.467077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2820
2025-09-30T14:58:12.466979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:12.467227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.467233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.467279Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:12.467292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:12.467297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:12.467299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:12.467310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:12.467335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:12.467351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:12.467688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.467700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.467729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:12.467822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2821 partition: 0 MaxSeqNo: 42 sessionId: src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0
2025-09-30T14:58:12.470729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de253c97-eaa17264-95cba8c1-b14f15_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:12.473869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0] Write session: try to update token
2025-09-30T14:58:12.473892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:12.481932Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:12.481958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:12.481960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:12.481962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:12.481971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896701742234873:8200]
2025-09-30T14:58:12.481975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896701742234873:8200]
2025-09-30T14:58:12.481979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896701742234873:8200]
2025-09-30T14:58:12.482010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:12.482017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:12.482021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:12.482021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:12.482027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.482030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:12.482169Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:12.501690Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2821 sessionId: src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:12.504567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:12.524224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896701832029057:6545]
2025-09-30T14:58:12.524488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2820, pipe: [1:7555896701832029057:6545]
2025-09-30T14:58:12.606166Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:12.606669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.606686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.606707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832029057:6545], now have 1 active actors on pipe
2025-09-30T14:58:12.607176Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:12.607942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:12.607951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0] Write session will restart in 0.006930s
2025-09-30T14:58:12.607976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0] Write session: Do CDS request
2025-09-30T14:58:12.607982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:12.607361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:12.607423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896701832029057:6545]
2025-09-30T14:58:12.607444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:12.607446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:12.607512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2821 reason: error at write: Disconnected sessionId: src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0
2025-09-30T14:58:12.607695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2821 sessionId: src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0 is DEAD
2025-09-30T14:58:12.615786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:12.619553Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:12.619570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2822
2025-09-30T14:58:12.619751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2822 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:12.619783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2822 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:12.619789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2822 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:12.619793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:12.620193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2822 sessionId:  describe result for acl check
2025-09-30T14:58:12.620218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:12.620220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:12.620223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:12.620228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896701832029073:6754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:12.620771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896701832029073:6754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:12.624623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896701832029073:6754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:12.628823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896701832029073:6754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:12.628841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896701832029073:6754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:12.628845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896701832029073:6754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:12.628853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2822 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:12.637301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:12.637982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:12.638368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:12.638379Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:12.638393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:12.638470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:12.638515Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896701742235042:8197]
2025-09-30T14:58:12.639053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:12.639413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:12.639465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:12.639808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:12.639876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.639881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.639883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.639884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.639886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.639887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.639888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.639889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.639891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.639892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.639893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.639894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.639896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.639897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.639898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.639904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.639914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.639919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.639923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.639927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.639931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.639935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.639939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.639946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.639951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.639955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.639959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.639963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.639967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.639971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.639979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.639987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.639994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.640000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.640005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.640010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.640015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.640020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.640026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.640031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.640035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.640038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.640041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.640044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.640049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.640053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.640057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.640062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.640067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.640072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.640077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.640082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.640087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.640092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.640097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.640102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.640106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.640111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.640116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.640121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.640179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:12.646099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:12.647065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:12.647082Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:12.647085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:12.647088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:12.647094Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2821 [2:7555896701742235042:8197]
2025-09-30T14:58:12.647108Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:12.647124Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:12.647126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:12.647129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:12.647131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:12.647143Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:12.647149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:12.647155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:12.647207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.647215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.647220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.647224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:12.647226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:12.647310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:12.647316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.647330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.647346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.647368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:12.647387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896701742235037:8197]
2025-09-30T14:58:12.647394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896701742235037:8197]
2025-09-30T14:58:12.647396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896701742235037:8197]
2025-09-30T14:58:12.647403Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:12.647414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:12.647414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:12.647428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:12.647428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:12.647430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:12.647430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:12.647439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832029059:2454], now have 1 active actors on pipe
2025-09-30T14:58:12.647443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832029202:6754], now have 1 active actors on pipe
2025-09-30T14:58:12.647478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896701742235037:8197]
2025-09-30T14:58:12.647489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:12.647508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:12.647534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2821
2025-09-30T14:58:12.647606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2821
2025-09-30T14:58:12.647680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.647693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.647728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9061524d-648f5da4-109fa10a-9ba62b27_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:12.647751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:12.647756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:12.647759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:12.647773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:12.647798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:12.647818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:12.648010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.648025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.648048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:12.648168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2822 partition: 0 MaxSeqNo: 42 sessionId: src_id|9061524d-648f5da4-109fa10a-9ba62b27_0
2025-09-30T14:58:12.648552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e45dcc7-706d82e4-6feece6b-8cfe8c9b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9061524d-648f5da4-109fa10a-9ba62b27_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:12.651521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9061524d-648f5da4-109fa10a-9ba62b27_0] Write session: try to update token
2025-09-30T14:58:12.651540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9061524d-648f5da4-109fa10a-9ba62b27_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:12.660472Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:12.660492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:12.660499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:12.660501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:12.660510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896701742235037:8197]
2025-09-30T14:58:12.660514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896701742235037:8197]
2025-09-30T14:58:12.660518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896701742235037:8197]
2025-09-30T14:58:12.660560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:12.660560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:12.660566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.660567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:12.660568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:12.660571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:12.660706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:12.671613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2822 sessionId: src_id|9061524d-648f5da4-109fa10a-9ba62b27_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:12.674250Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:12.707526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896701832029243:6545]
2025-09-30T14:58:12.711473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2821, pipe: [1:7555896701832029243:6545]
2025-09-30T14:58:12.776213Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:12.776700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.776715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.776735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832029243:6545], now have 1 active actors on pipe
2025-09-30T14:58:12.776952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:12.777051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:12.777124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2822 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9061524d-648f5da4-109fa10a-9ba62b27_0
2025-09-30T14:58:12.777273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2822 sessionId: src_id|9061524d-648f5da4-109fa10a-9ba62b27_0 is DEAD
2025-09-30T14:58:12.777438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9061524d-648f5da4-109fa10a-9ba62b27_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:12.777449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9061524d-648f5da4-109fa10a-9ba62b27_0] Write session will restart in 0.007835s
2025-09-30T14:58:12.777476Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9061524d-648f5da4-109fa10a-9ba62b27_0] Write session: Do CDS request
2025-09-30T14:58:12.777482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9061524d-648f5da4-109fa10a-9ba62b27_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:12.777454Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:12.777507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896701832029243:6545]
2025-09-30T14:58:12.786758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9061524d-648f5da4-109fa10a-9ba62b27_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:12.787322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:12.787338Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2823
2025-09-30T14:58:12.789525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2823 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:12.789574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2823 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:12.789580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2823 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:12.789585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:12.790122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2823 sessionId:  describe result for acl check
2025-09-30T14:58:12.790161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:12.790164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:12.790166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:12.790171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896701832029372:6769] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:12.790732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896701832029372:6769] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:12.797057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:12.797611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:12.797652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896701832029372:6769] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:12.798016Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:12.798027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:12.798040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:12.798102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:12.798140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896701742235240:8172]
2025-09-30T14:58:12.798821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:12.799133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:12.799180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:12.799553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:12.799615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.799622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.799623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.799625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.799626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.799627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.799628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.799629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.799630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.799631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.799633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.799634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.799635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.799636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.799639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.799645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.799655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.799659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.799663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.799667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.799671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.799675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.799679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.799683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.799687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.799690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.799695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.799699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.799703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.799707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.799713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.799721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.799728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.799733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.799738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.799742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.799746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.799752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.799756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.799762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.799766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.799772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.799776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.799781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.799786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.799792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.799797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.799802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.799806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.799812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.799816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.799821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.799824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.799836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.799840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.799850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.799854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.799860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.799870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.799875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.799923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:12.800423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896701832029372:6769] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:12.800438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896701832029372:6769] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:12.800442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896701832029372:6769] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:12.800450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2823 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:12.805520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:12.806701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:12.806718Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:12.806720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:12.806724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:12.806731Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2822 [2:7555896701742235240:8172]
2025-09-30T14:58:12.806748Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:12.806765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:12.806772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:12.806775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:12.806777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:12.806793Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:12.806800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:12.806807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:12.806878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.806884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.806887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.806890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:12.806893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:12.806959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:12.806966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.806979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.806991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.807010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:12.807033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832029419:6769], now have 1 active actors on pipe
2025-09-30T14:58:12.807040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832029255:2454], now have 1 active actors on pipe
2025-09-30T14:58:12.807046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896701742235235:8172]
2025-09-30T14:58:12.807052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896701742235235:8172]
2025-09-30T14:58:12.807055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896701742235235:8172]
2025-09-30T14:58:12.807070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:12.807084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:12.807096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:12.807103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:12.807107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:12.807108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:12.807111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:12.807138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896701742235235:8172]
2025-09-30T14:58:12.807150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:12.807155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:12.807183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.807191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.807132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2822
2025-09-30T14:58:12.807221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:12.807173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2822
2025-09-30T14:58:12.807235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:12.807285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:12.807291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:12.807301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:12.807313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:12.807329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:12.807575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.807585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.807602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:12.807703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2823 partition: 0 MaxSeqNo: 42 sessionId: src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0
2025-09-30T14:58:12.811352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9061524d-648f5da4-109fa10a-9ba62b27_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:12.814088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0] Write session: try to update token
2025-09-30T14:58:12.814108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:12.820170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:12.820188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:12.820191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:12.820193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:12.820203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896701742235235:8172]
2025-09-30T14:58:12.820208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896701742235235:8172]
2025-09-30T14:58:12.820212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896701742235235:8172]
2025-09-30T14:58:12.820256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:12.820264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.820265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:12.820266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:12.820272Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:12.820279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:12.820414Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:12.829400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2823 sessionId: src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:12.832213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:12.877494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896701832029428:6545]
2025-09-30T14:58:12.877734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2822, pipe: [1:7555896701832029428:6545]
2025-09-30T14:58:12.940484Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:12.941020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.941038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.941060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832029428:6545], now have 1 active actors on pipe
2025-09-30T14:58:12.941299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:12.941319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896701832029428:6545]
2025-09-30T14:58:12.941327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:12.941331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:12.941353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:12.941417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2823 reason: error at write: Disconnected sessionId: src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0
2025-09-30T14:58:12.941620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2823 sessionId: src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0 is DEAD
2025-09-30T14:58:12.941774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:12.941786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0] Write session will restart in 0.005209s
2025-09-30T14:58:12.941824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0] Write session: Do CDS request
2025-09-30T14:58:12.941833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:12.947776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:12.951624Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:12.951641Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2824
2025-09-30T14:58:12.951832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2824 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:12.951891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2824 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:12.951897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2824 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:12.951902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:12.952395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2824 sessionId:  describe result for acl check
2025-09-30T14:58:12.952423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:12.952425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:12.952427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:12.952433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896701832029444:6782] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:12.952990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896701832029444:6782] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:12.955087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896701832029444:6782] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:12.960127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896701832029444:6782] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:12.960144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896701832029444:6782] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:12.960147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896701832029444:6782] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:12.960156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2824 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:12.964101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:12.968378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:12.968598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:12.968608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:12.968618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:12.968668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:12.968710Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896701742235405:8170]
2025-09-30T14:58:12.969372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:12.969758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:12.969799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:12.970129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:12.970187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.970192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.970194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.970195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.970196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.970197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.970199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.970200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.970201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.970203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.970204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.970205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.970206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.970207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.970209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.970214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.970224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.970228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.970232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.970235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.970240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.970243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.970247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.970251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.970255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.970259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.970262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.970266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.970270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.970274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.970280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.970288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:12.970294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.970299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:12.970304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.970309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:12.970313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.970318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:12.970323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.970328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:12.970333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.970338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:12.970342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.970348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:12.970359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.970364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:12.970373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.970378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:12.970383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.970388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:12.970392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.970399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.970407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.970412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.970416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.970425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.970430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.970435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:12.970443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.970448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:12.970492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:12.976153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:12.977304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:12.977319Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:12.977322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:12.977327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:12.977333Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2823 [2:7555896701742235405:8170]
2025-09-30T14:58:12.977350Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:12.977364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:12.977369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:12.977373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:12.977375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:12.977389Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:12.977396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:12.977403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:12.977464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.977473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.977474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.977477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:12.977480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:12.977545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:12.977554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.977566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:12.977579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:12.977595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:12.977614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832029429:2454], now have 1 active actors on pipe
2025-09-30T14:58:12.977618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896701832029544:6782], now have 1 active actors on pipe
2025-09-30T14:58:12.977624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896701742235400:8170]
2025-09-30T14:58:12.977628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896701742235400:8170]
2025-09-30T14:58:12.977630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896701742235400:8170]
2025-09-30T14:58:12.977648Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:12.977668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:12.977677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:12.977681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:12.977683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:12.977686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:12.977690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:12.977723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896701742235400:8170]
2025-09-30T14:58:12.977733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:12.977736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:12.977753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.977757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.978123Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:12.978140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:12.978143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:12.978145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:12.978156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:12.978166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:12.978191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:12.978394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:12.978403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:12.978416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:12.978896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a42ecc95-748f7dc7-c7da588d-ed22f62_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:12.977684Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2823
2025-09-30T14:58:12.977707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2823
2025-09-30T14:58:12.978524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2824 partition: 0 MaxSeqNo: 42 sessionId: src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0
2025-09-30T14:58:12.981715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0] Write session: try to update token
2025-09-30T14:58:12.981735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:12.990565Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:12.990589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:12.990591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:12.990593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:12.990603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896701742235400:8170]
2025-09-30T14:58:12.990608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896701742235400:8170]
2025-09-30T14:58:12.990612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896701742235400:8170]
2025-09-30T14:58:12.990655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:12.990663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:12.990667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:12.990670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:12.990699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:12.990703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:12.990801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:12.996696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2824 sessionId: src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:12.999516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:13.041341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896706126996898:6545]
2025-09-30T14:58:13.041639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2823, pipe: [1:7555896706126996898:6545]
2025-09-30T14:58:13.104356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:13.104664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.104681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.104721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126996898:6545], now have 1 active actors on pipe
2025-09-30T14:58:13.104952Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:13.105044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896706126996898:6545]
2025-09-30T14:58:13.105074Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:13.105202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:13.105288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2824 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0
2025-09-30T14:58:13.105474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2824 sessionId: src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0 is DEAD
2025-09-30T14:58:13.105699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:13.105717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0] Write session will restart in 0.009886s
2025-09-30T14:58:13.105751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0] Write session: Do CDS request
2025-09-30T14:58:13.105758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:13.117047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:13.117162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:13.117179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2825
2025-09-30T14:58:13.117332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2825 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:13.117377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2825 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:13.117383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2825 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:13.117388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:13.117845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2825 sessionId:  describe result for acl check
2025-09-30T14:58:13.117887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:13.117896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:13.117897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:13.117904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896706126996988:6790] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:13.118479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896706126996988:6790] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:13.120693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896706126996988:6790] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:13.121983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:13.126161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:13.126742Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:13.126758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:13.126776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:13.126807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896706126996988:6790] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:13.126848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:13.126826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896706126996988:6790] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:13.126829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896706126996988:6790] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:13.126837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2825 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:13.126897Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896706037202867:8167]
2025-09-30T14:58:13.127562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:13.127958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:13.128026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:13.128377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:13.128461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.128478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.128484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.128485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.128486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.128487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.128489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.128490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.128491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.128492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.128493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.128494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.128496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.128497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.128498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.128504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.128516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.128520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.128525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.128529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.128533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.128537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.128541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.128545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.128552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.128556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.128560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.128564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.128568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.128572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.128581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.128589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.128595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.128600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.128607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.128612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.128617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.128622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.128627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.128632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.128636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.128643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.128648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.128652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.128656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.128660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.128674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.128679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.128688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.128693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.128698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.128703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.128712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.128718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.128726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.128732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.128737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.128742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.128747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.128753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.128798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:13.134587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:13.135542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:13.135560Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:13.135564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:13.135569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:13.135576Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2824 [2:7555896706037202867:8167]
2025-09-30T14:58:13.135595Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:13.135613Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:13.135617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:13.135621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:13.135624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:13.135641Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:13.135657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:13.135669Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:13.135736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.135742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.135745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.135748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:13.135751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:13.135820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:13.135830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.135843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.135856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.135875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:13.135891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896706037202862:8167]
2025-09-30T14:58:13.135896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896706037202862:8167]
2025-09-30T14:58:13.135898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896706037202862:8167]
2025-09-30T14:58:13.135907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:13.135921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:13.135921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:13.135924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:13.135927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:13.135935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:13.135939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:13.135978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997064:6790], now have 1 active actors on pipe
2025-09-30T14:58:13.135982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126996899:2454], now have 1 active actors on pipe
2025-09-30T14:58:13.135985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896706037202862:8167]
2025-09-30T14:58:13.135993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:13.136023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:13.136183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2824
2025-09-30T14:58:13.136195Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2824
2025-09-30T14:58:13.136435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.136448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.136475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|18a34e7f-6228747e-15d5b795-3d0390d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:13.136483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:13.136487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:13.136489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:13.136500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:13.136510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:13.136528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:13.136682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.136691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.136705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:13.136809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2825 partition: 0 MaxSeqNo: 42 sessionId: src_id|18a34e7f-6228747e-15d5b795-3d0390d_0
2025-09-30T14:58:13.137232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df7a432-bc9ecc97-d5565729-ec4f06cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|18a34e7f-6228747e-15d5b795-3d0390d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:13.140164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18a34e7f-6228747e-15d5b795-3d0390d_0] Write session: try to update token
2025-09-30T14:58:13.140181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18a34e7f-6228747e-15d5b795-3d0390d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:13.150269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:13.150292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:13.150295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:13.150296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:13.150306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896706037202862:8167]
2025-09-30T14:58:13.150310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896706037202862:8167]
2025-09-30T14:58:13.150314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896706037202862:8167]
2025-09-30T14:58:13.150356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:13.150363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.150365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:13.150396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:13.150412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:13.150417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:13.150507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:13.157034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2825 sessionId: src_id|18a34e7f-6228747e-15d5b795-3d0390d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:13.159964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:13.205197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896706126997076:6545]
2025-09-30T14:58:13.205478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2824, pipe: [1:7555896706126997076:6545]
2025-09-30T14:58:13.271485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:13.272011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.272025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.272068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997076:6545], now have 1 active actors on pipe
2025-09-30T14:58:13.272313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:13.272315Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:13.272356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896706126997076:6545]
2025-09-30T14:58:13.272368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:13.272436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2825 reason: status is not ok: tablet will be restarted right now sessionId: src_id|18a34e7f-6228747e-15d5b795-3d0390d_0
2025-09-30T14:58:13.272612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2825 sessionId: src_id|18a34e7f-6228747e-15d5b795-3d0390d_0 is DEAD
2025-09-30T14:58:13.272749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a34e7f-6228747e-15d5b795-3d0390d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:13.272761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a34e7f-6228747e-15d5b795-3d0390d_0] Write session will restart in 0.008563s
2025-09-30T14:58:13.272785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a34e7f-6228747e-15d5b795-3d0390d_0] Write session: Do CDS request
2025-09-30T14:58:13.272791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a34e7f-6228747e-15d5b795-3d0390d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:13.283340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|18a34e7f-6228747e-15d5b795-3d0390d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:13.283683Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:13.283701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2826
2025-09-30T14:58:13.283855Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2826 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:13.283898Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2826 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:13.283908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2826 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:13.283912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:13.284437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2826 sessionId:  describe result for acl check
2025-09-30T14:58:13.284473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:13.284480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:13.284486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:13.284492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896706126997168:6797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:13.285050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896706126997168:6797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:13.287182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896706126997168:6797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:13.288357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:13.293747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896706126997168:6797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:13.293766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896706126997168:6797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:13.293770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896706126997168:6797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:13.293779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2826 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:13.293927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:13.294177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:13.294181Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:13.294193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:13.294253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:13.294290Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896706037203046:8159]
2025-09-30T14:58:13.294955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:13.295336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:13.295388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:13.295755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:13.295816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.295818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.295819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.295820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.295821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.295823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.295824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.295825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.295827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.295828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.295829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.295830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.295831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.295833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.295833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.295840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.295851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.295855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.295860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.295865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.295868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.295871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.295875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.295878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.295882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.295886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.295890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.295894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.295898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.295901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.295909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.295917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.295924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.295930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.295934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.295940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.295944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.295950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.295955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.295960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.295963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.295968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.295978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.295983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.295988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.295993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.295998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.296003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.296008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.296013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.296018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.296023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.296030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.296035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.296040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.296046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.296050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.296055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.296060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.296065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.296108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:13.301945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:13.303267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:13.303284Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:13.303287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:13.303291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:13.303299Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2825 [2:7555896706037203046:8159]
2025-09-30T14:58:13.303316Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:13.303333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:13.303336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:13.303340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:13.303342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:13.303358Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:13.303372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:13.303381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:13.303451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.303459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.303461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.303466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:13.303468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:13.303534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:13.303541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.303554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.303572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.303596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:13.303614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896706037203040:8159]
2025-09-30T14:58:13.303623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896706037203040:8159]
2025-09-30T14:58:13.303625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896706037203040:8159]
2025-09-30T14:58:13.303634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:13.303649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:13.303649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:13.303653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:13.303656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:13.303664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:13.303667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:13.303677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997245:6797], now have 1 active actors on pipe
2025-09-30T14:58:13.303688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997079:2454], now have 1 active actors on pipe
2025-09-30T14:58:13.303727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896706037203040:8159]
2025-09-30T14:58:13.303738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:13.303745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:13.303778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2825
2025-09-30T14:58:13.303817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2825
2025-09-30T14:58:13.303911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.303941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.303976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|972eff3e-95d93941-55efb5f5-d5907cac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:13.303986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:13.303990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:13.303993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:13.304004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:13.304017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:13.304035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:13.304212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.304222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.304401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2826 partition: 0 MaxSeqNo: 42 sessionId: src_id|972eff3e-95d93941-55efb5f5-d5907cac_0
2025-09-30T14:58:13.304812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|18a34e7f-6228747e-15d5b795-3d0390d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|972eff3e-95d93941-55efb5f5-d5907cac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:13.304260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:13.307864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|972eff3e-95d93941-55efb5f5-d5907cac_0] Write session: try to update token
2025-09-30T14:58:13.307885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|972eff3e-95d93941-55efb5f5-d5907cac_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:13.326607Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2826 sessionId: src_id|972eff3e-95d93941-55efb5f5-d5907cac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:13.328927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:13.328947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:13.328962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896706037203040:8159]
2025-09-30T14:58:13.329017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:13.329044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:13.329248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:13.329432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:13.329444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:13.329587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:13.329751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:13.329970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:13.331293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.331314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.331336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:13.331366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:13.331375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:13.331377Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:13.331379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:13.331387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896706037203040:8159]
2025-09-30T14:58:13.331392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896706037203040:8159]
2025-09-30T14:58:13.331396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896706037203040:8159]
2025-09-30T14:58:13.331438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:13.331444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.331447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:13.331463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:13.331471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:13.331482Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:13.331582Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:13.372624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896706126997260:6545]
2025-09-30T14:58:13.372961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2825, pipe: [1:7555896706126997260:6545]
2025-09-30T14:58:13.445958Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:13.446582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:13.446625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997260:6545], now have 1 active actors on pipe
2025-09-30T14:58:13.446750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:13.446852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:13.446861Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:13.446927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2826 reason: error at write: Disconnected sessionId: src_id|972eff3e-95d93941-55efb5f5-d5907cac_0
2025-09-30T14:58:13.447075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2826 sessionId: src_id|972eff3e-95d93941-55efb5f5-d5907cac_0 is DEAD
2025-09-30T14:58:13.447100Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896706126997260:6545]
2025-09-30T14:58:13.447117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:13.447239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972eff3e-95d93941-55efb5f5-d5907cac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:13.447293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972eff3e-95d93941-55efb5f5-d5907cac_0] Write session will restart in 0.006645s
2025-09-30T14:58:13.447338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972eff3e-95d93941-55efb5f5-d5907cac_0] Write session: Do CDS request
2025-09-30T14:58:13.447344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972eff3e-95d93941-55efb5f5-d5907cac_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:13.454837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|972eff3e-95d93941-55efb5f5-d5907cac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:13.454936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:13.454953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2827
2025-09-30T14:58:13.455150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2827 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:13.455201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2827 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:13.455212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2827 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:13.455217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:13.455722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2827 sessionId:  describe result for acl check
2025-09-30T14:58:13.455760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:13.455762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:13.455767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:13.455774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896706126997277:6808] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:13.456348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896706126997277:6808] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:13.459183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896706126997277:6808] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:13.465082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896706126997277:6808] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:13.465100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896706126997277:6808] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:13.465104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896706126997277:6808] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:13.465113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2827 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:13.469603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:13.474208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:13.474439Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:13.474450Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:13.474459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:13.474504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:13.474541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896706037203213:8155]
2025-09-30T14:58:13.475095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:13.475444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:13.475498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:13.476176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:13.476278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.476286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.476288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.476289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.476291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.476292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.476294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.476295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.476296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.476297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.476299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.476300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.476301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.476303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.476304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.476310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.476321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.476326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.476331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.476334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.476338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.476342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.476346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.476350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.476355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.476359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.476363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.476366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.476370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.476374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.476384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.476392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.476402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.476408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.476413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.476419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.476424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.476430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.476435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.476441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.476446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.476452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.476457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.476462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.476466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.476472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.476485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.476493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.476497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.476502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.476507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.476512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.476516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.476521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.476525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.476530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.476534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.476538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.476546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.476550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.476589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:13.482409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:13.483319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:13.483324Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:13.483327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:13.483331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:13.483338Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2826 [2:7555896706037203213:8155]
2025-09-30T14:58:13.483355Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:13.483382Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:13.483385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:13.483388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:13.483391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:13.483407Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:13.483423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:13.483431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:13.483486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.483495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.483497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.483501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:13.483504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:13.483578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:13.483586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.483598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.483613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.483636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:13.483658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997405:6808], now have 1 active actors on pipe
2025-09-30T14:58:13.483662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997261:2454], now have 1 active actors on pipe
2025-09-30T14:58:13.483669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896706037203208:8155]
2025-09-30T14:58:13.483671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896706037203208:8155]
2025-09-30T14:58:13.483674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896706037203208:8155]
2025-09-30T14:58:13.483688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:13.483704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:13.483726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:13.483727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:13.483731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:13.483732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:13.483733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:13.483706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2826
2025-09-30T14:58:13.483744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2826
2025-09-30T14:58:13.483766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896706037203208:8155]
2025-09-30T14:58:13.483774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:13.483776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:13.483791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.483799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.483850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:13.483860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:13.483864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:13.483871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:13.483882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:13.483895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:13.483919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:13.484423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.484434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.484453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:13.484647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2827 partition: 0 MaxSeqNo: 42 sessionId: src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0
2025-09-30T14:58:13.485038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|972eff3e-95d93941-55efb5f5-d5907cac_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:13.487898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0] Write session: try to update token
2025-09-30T14:58:13.487915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:13.496387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:13.496412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:13.496415Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:13.496425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:13.496441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896706037203208:8155]
2025-09-30T14:58:13.496446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896706037203208:8155]
2025-09-30T14:58:13.496449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896706037203208:8155]
2025-09-30T14:58:13.496490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:13.496497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.496499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:13.496513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:13.496520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:13.496525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:13.496646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:13.503674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2827 sessionId: src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:13.506656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:13.547204Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896706126997450:6545]
2025-09-30T14:58:13.547951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2826, pipe: [1:7555896706126997450:6545]
2025-09-30T14:58:13.611722Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:13.612296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.612310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.612331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997450:6545], now have 1 active actors on pipe
2025-09-30T14:58:13.612590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:13.613074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896706126997450:6545]
2025-09-30T14:58:13.613103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:13.613130Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:13.613195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2827 reason: status is not ok: tablet will be restarted right now sessionId: src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0
2025-09-30T14:58:13.613368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2827 sessionId: src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0 is DEAD
2025-09-30T14:58:13.619368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:13.619384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0] Write session will restart in 0.008184s
2025-09-30T14:58:13.619410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0] Write session: Do CDS request
2025-09-30T14:58:13.619416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:13.631946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:13.632516Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:13.632535Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2828
2025-09-30T14:58:13.632704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2828 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:13.632735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2828 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:13.632740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2828 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:13.632750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:13.638220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2828 sessionId:  describe result for acl check
2025-09-30T14:58:13.638265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:13.638268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:13.638270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:13.638277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896706126997476:6819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:13.638844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896706126997476:6819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:13.650838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896706126997476:6819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:13.660208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896706126997476:6819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:13.660228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896706126997476:6819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:13.660236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896706126997476:6819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:13.660246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2828 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:13.660523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:13.662594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:13.662824Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:13.662836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:13.662848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:13.662901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:13.662946Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896706037203383:8137]
2025-09-30T14:58:13.663633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:13.664076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:13.664129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:13.664467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:13.664534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.664539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.664540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.664542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.664543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.664544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.664545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.664547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.664548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.664549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.664550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.664552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.664553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.664554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.664555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.664561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.664571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.664575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.664579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.664583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.664586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.664590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.664594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.664598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.664605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.664608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.664611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.664614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.664618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.664621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.664630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.664638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.664644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.664649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.664653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.664658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.664662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.664668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.664673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.664678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.664683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.664687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.664691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.664696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.664701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.664706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.664711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.664716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.664723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.664728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.664733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.664738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.664742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.664746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.664751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.664755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.664760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.664765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.664770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.664775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.664820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:13.673117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:13.674290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:13.674297Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:13.674299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:13.674304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:13.674312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2827 [2:7555896706037203383:8137]
2025-09-30T14:58:13.674329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:13.674346Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:13.674349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:13.674352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:13.674354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:13.674371Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:13.674378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:13.674385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:13.674448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.674451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.674453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.674457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:13.674460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:13.674550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:13.674553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.674570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.674583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.674603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:13.674620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896706037203377:8137]
2025-09-30T14:58:13.674623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896706037203377:8137]
2025-09-30T14:58:13.674626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896706037203377:8137]
2025-09-30T14:58:13.674641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:13.674656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:13.674672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:13.674675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:13.674714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896706037203377:8137]
2025-09-30T14:58:13.674716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:13.674820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:13.674823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:13.674825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:13.674830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:13.675164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2827
2025-09-30T14:58:13.675207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2827
2025-09-30T14:58:13.675436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997451:2454], now have 1 active actors on pipe
2025-09-30T14:58:13.675453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997615:6819], now have 1 active actors on pipe
2025-09-30T14:58:13.676344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.676350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.676379Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:13.676392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:13.676397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:13.676400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:13.676411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:13.676424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:13.676440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:13.678344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.678361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.678386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:13.678525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2828 partition: 0 MaxSeqNo: 42 sessionId: src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0
2025-09-30T14:58:13.683411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|389676f7-74f51f57-ae00ac28-7fc81a42_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:13.686713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0] Write session: try to update token
2025-09-30T14:58:13.686735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:13.689235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:13.689256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:13.689258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:13.689260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:13.689273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896706037203377:8137]
2025-09-30T14:58:13.689278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896706037203377:8137]
2025-09-30T14:58:13.689282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896706037203377:8137]
2025-09-30T14:58:13.689323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:13.689330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.689334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:13.689468Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:13.689611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:13.689618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:13.689635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:13.707270Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2828 sessionId: src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:13.710029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:13.712680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896706126997629:6545]
2025-09-30T14:58:13.715659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2827, pipe: [1:7555896706126997629:6545]
2025-09-30T14:58:13.815445Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:13.815771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.815789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.815808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997629:6545], now have 1 active actors on pipe
2025-09-30T14:58:13.816107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:13.816094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:13.816098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896706126997629:6545]
2025-09-30T14:58:13.816124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:13.816127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:13.816188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2828 reason: error at write: Disconnected sessionId: src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0
2025-09-30T14:58:13.816394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2828 sessionId: src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0 is DEAD
2025-09-30T14:58:13.816553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:13.816564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0] Write session will restart in 0.005256s
2025-09-30T14:58:13.816588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0] Write session: Do CDS request
2025-09-30T14:58:13.816596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:13.822695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:13.822824Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:13.822837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2829
2025-09-30T14:58:13.822985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2829 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:13.823018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2829 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:13.823030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2829 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:13.823034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:13.823455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2829 sessionId:  describe result for acl check
2025-09-30T14:58:13.823491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:13.823501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:13.823503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:13.823508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896706126997672:6842] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:13.824064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896706126997672:6842] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:13.827455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896706126997672:6842] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:13.829935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896706126997672:6842] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:13.829946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896706126997672:6842] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:13.829948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896706126997672:6842] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:13.829955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2829 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:13.835420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:13.835930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:13.836091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:13.836102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:13.836112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:13.836156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:13.836192Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896706037203588:8125]
2025-09-30T14:58:13.836840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:13.837164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:13.837208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:13.837532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:13.837599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.837602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.837604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.837605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.837606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.837607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.837609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.837610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.837611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.837613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.837614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.837615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.837617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.837618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.837619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.837624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.837636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.837640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.837645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.837649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.837654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.837658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.837663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.837667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.837671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.837676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.837680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.837684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.837688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.837692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.837699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.837707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.837713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.837719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.837724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.837730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.837734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.837740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.837745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.837751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.837756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.837761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.837767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.837773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.837777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.837784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.837791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.837796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.837801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.837807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.837812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.837818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.837823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.837828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.837833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.837838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.837842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.837848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.837852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.837858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.837905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:13.843165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:13.844359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:13.844375Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:13.844378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:13.844382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:13.844388Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2828 [2:7555896706037203588:8125]
2025-09-30T14:58:13.844404Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:13.844419Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:13.844422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:13.844425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:13.844427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:13.844442Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:13.844450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:13.844463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:13.844523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.844532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.844534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.844540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:13.844543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:13.844605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:13.844612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.844626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.844643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.844670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:13.844692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997817:6842], now have 1 active actors on pipe
2025-09-30T14:58:13.844700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997657:2454], now have 1 active actors on pipe
2025-09-30T14:58:13.844706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896706037203583:8125]
2025-09-30T14:58:13.844709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896706037203583:8125]
2025-09-30T14:58:13.844712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896706037203583:8125]
2025-09-30T14:58:13.844726Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:13.844742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:13.844744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:13.844752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:13.844754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:13.844760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:13.844763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:13.844775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2828
2025-09-30T14:58:13.844777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2828
2025-09-30T14:58:13.844791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896706037203583:8125]
2025-09-30T14:58:13.844799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:13.844802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:13.844815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.844821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.844878Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:13.844885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:13.844888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:13.844890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:13.844900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:13.844908Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:13.844929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:13.845115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.845128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.845162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:13.845259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2829 partition: 0 MaxSeqNo: 42 sessionId: src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0
2025-09-30T14:58:13.845639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1992dd50-ba0c06ed-7a61e631-af5bfe84_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:13.848412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0] Write session: try to update token
2025-09-30T14:58:13.848437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:13.857151Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:13.857171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:13.857173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:13.857175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:13.857189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896706037203583:8125]
2025-09-30T14:58:13.857193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896706037203583:8125]
2025-09-30T14:58:13.857197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896706037203583:8125]
2025-09-30T14:58:13.857237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:13.857244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.857246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:13.857256Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:13.857266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:13.857271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:13.857400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:13.863218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2829 sessionId: src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:13.865884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:13.916363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896706126997832:6545]
2025-09-30T14:58:13.916742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2828, pipe: [1:7555896706126997832:6545]
2025-09-30T14:58:13.973728Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:13.974210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:13.974227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:13.974265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997832:6545], now have 1 active actors on pipe
2025-09-30T14:58:13.974574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:13.974590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:13.974611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:13.974656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2829 reason: error at write: Disconnected sessionId: src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0
2025-09-30T14:58:13.974657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896706126997832:6545]
2025-09-30T14:58:13.974832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2829 sessionId: src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0 is DEAD
2025-09-30T14:58:13.974578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:13.975195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:13.975206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0] Write session will restart in 0.006584s
2025-09-30T14:58:13.975232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0] Write session: Do CDS request
2025-09-30T14:58:13.975240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:13.987780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:13.988133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:13.988148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2830
2025-09-30T14:58:13.988368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2830 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:13.988402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2830 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:13.988408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2830 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:13.988412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:13.989150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2830 sessionId:  describe result for acl check
2025-09-30T14:58:13.989190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:13.989193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:13.989195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:13.989201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896706126997967:6846] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:13.989752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896706126997967:6846] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:13.991097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:13.991911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896706126997967:6846] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:13.995442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:13.995504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896706126997967:6846] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:13.995519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896706126997967:6846] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:13.995522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896706126997967:6846] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:13.995529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2830 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:13.995643Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:13.995656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:13.995667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:13.995719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:13.995761Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896706037203757:8111]
2025-09-30T14:58:13.996432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:13.996783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:13.996853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:13.997256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:13.997332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.997340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.997342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.997343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.997344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.997346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.997347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.997348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.997350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.997351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.997352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.997353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.997354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.997356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.997357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.997364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.997375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.997379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.997384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.997388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.997393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.997397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.997401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.997405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.997409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.997413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.997418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.997422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.997426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.997430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.997439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.997448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:13.997455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.997460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:13.997466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.997472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:13.997477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.997483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:13.997487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.997500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:13.997504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.997510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:13.997515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.997521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:13.997524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.997530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:13.997535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.997547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:13.997557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.997563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:13.997568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.997572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:13.997577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.997590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:13.997595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.997600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:13.997604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.997616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:13.997621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.997631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:13.997675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:14.003104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:14.004403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:14.004423Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:14.004426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:14.004430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:14.004437Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2829 [2:7555896706037203757:8111]
2025-09-30T14:58:14.004453Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:14.004467Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:14.004471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:14.004475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:14.004478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:14.004495Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:14.004504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:14.004510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:14.004579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.004588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.004590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.004593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:14.004596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:14.004670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:14.004680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.004692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.004709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.004733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:14.004759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126998001:6846], now have 1 active actors on pipe
2025-09-30T14:58:14.004767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896706126997837:2454], now have 1 active actors on pipe
2025-09-30T14:58:14.004774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896706037203752:8111]
2025-09-30T14:58:14.004776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896706037203752:8111]
2025-09-30T14:58:14.004778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896706037203752:8111]
2025-09-30T14:58:14.004791Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:14.004809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:14.004804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:14.004821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:14.004824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:14.004830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:14.004832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:14.004826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2829
2025-09-30T14:58:14.004827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2829
2025-09-30T14:58:14.004877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896706037203752:8111]
2025-09-30T14:58:14.004892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:14.004917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:14.005033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.005049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.005079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:14.005092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:14.005096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:14.005099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:14.005109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:14.005120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:14.005133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:14.005435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.005445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.005460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:14.005565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2830 partition: 0 MaxSeqNo: 42 sessionId: src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0
2025-09-30T14:58:14.005941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27259c53-7c8295cf-5ff2c484-2850ea9d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:14.008774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0] Write session: try to update token
2025-09-30T14:58:14.008795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:14.016533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:14.016553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:14.016561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896706037203752:8111]
2025-09-30T14:58:14.016595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:14.016602Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:14.016755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:14.016905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:14.017028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:14.017158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:14.017334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:14.017372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:14.023493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2830 sessionId: src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:14.026185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:14.026394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.026418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.026484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:14.026567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:14.027726Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:14.027743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:14.027745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:14.027747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:14.027757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896706037203752:8111]
2025-09-30T14:58:14.027762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896706037203752:8111]
2025-09-30T14:58:14.027766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896706037203752:8111]
2025-09-30T14:58:14.027804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:14.027811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.027813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:14.027820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:14.027826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:14.027829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:14.027953Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:14.074543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896710421965309:6545]
2025-09-30T14:58:14.074855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2829, pipe: [1:7555896710421965309:6545]
2025-09-30T14:58:14.142123Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:14.151401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.151431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.151619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.151698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.151773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.151849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.151899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.151909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.151998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.152068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.152139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.152218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.152269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.152277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.152358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.152431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.152509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.152580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.152627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.152636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.152708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.152780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.152850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.152988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.153125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.153133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.153208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.153276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.153353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.153425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.153478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.153486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.153562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.153629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.153695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.153769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.153819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.153828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.153902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.153976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.154053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.154126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.154177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.154187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.154260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.154331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.154404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.154482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.154601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.154610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.154685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.154754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.154828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.154902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.154954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.154962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.155034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.155102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.155177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.155273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.155322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.155330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.155397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421965309:6545], now have 1 active actors on pipe
2025-09-30T14:58:14.155659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:14.155675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:14.155702Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:14.155717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2830 reason: error at write: Disconnected sessionId: src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0
2025-09-30T14:58:14.155752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896710421965309:6545]
2025-09-30T14:58:14.155933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2830 sessionId: src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0 is DEAD
2025-09-30T14:58:14.156143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:14.156154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0] Write session will restart in 0.008311s
2025-09-30T14:58:14.156179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0] Write session: Do CDS request
2025-09-30T14:58:14.156184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:14.156654Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:14.165755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:14.167182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:14.167210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2831
2025-09-30T14:58:14.167363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2831 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:14.167398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2831 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:14.167403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2831 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:14.167407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:14.167844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2831 sessionId:  describe result for acl check
2025-09-30T14:58:14.167876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:14.167884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:14.167886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:14.167893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896710421965354:6854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:14.168529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896710421965354:6854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:14.171491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896710421965354:6854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:14.175381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896710421965354:6854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:14.175399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896710421965354:6854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:14.175403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896710421965354:6854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:14.175412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2831 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:14.175975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:14.179827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:14.180031Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:14.180042Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:14.180053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:14.180100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:14.180140Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896710332171227:8122]
2025-09-30T14:58:14.180843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:14.181181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:14.181224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:14.181558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:14.181625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.181631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.181632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.181634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.181635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.181636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.181637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.181638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.181640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.181641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.181643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.181644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.181645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.181646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.181647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.181652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.181663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.181667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.181671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.181675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.181679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.181683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.181687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.181691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.181695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.181698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.181702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.181705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.181710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.181714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.181722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.181729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.181734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.181739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.181750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.181755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.181764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.181769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.181777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.181782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.181790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.181795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.181804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.181809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.181814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.181823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.181828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.181834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.181839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.181844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.181851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.181856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.181861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.181870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.181874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.181883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.181888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.181898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.181903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.181912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.181969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:14.187429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:14.188295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:14.188309Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:14.188312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:14.188316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:14.188322Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2830 [2:7555896710332171227:8122]
2025-09-30T14:58:14.188338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:14.188353Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:14.188356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:14.188359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:14.188361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:14.188375Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:14.188383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:14.188391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:14.188447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.188461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.188463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.188466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:14.188469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:14.188538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:14.188545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.188557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.188573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.188595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:14.188615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896710332171222:8122]
2025-09-30T14:58:14.188622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896710332171222:8122]
2025-09-30T14:58:14.188624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896710332171222:8122]
2025-09-30T14:58:14.188639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:14.188656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:14.188674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:14.188681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:14.188711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896710332171222:8122]
2025-09-30T14:58:14.188718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:14.188891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:14.188900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:14.188902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:14.188908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:14.189173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421965477:6854], now have 1 active actors on pipe
2025-09-30T14:58:14.189183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421965311:2454], now have 1 active actors on pipe
2025-09-30T14:58:14.189235Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2830
2025-09-30T14:58:14.189239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2830
2025-09-30T14:58:14.189378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.189389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.189414Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:14.189421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:14.189424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:14.189427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:14.189437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:14.189452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:14.189468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:14.189655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.189665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.189679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:14.189764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2831 partition: 0 MaxSeqNo: 42 sessionId: src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0
2025-09-30T14:58:14.190168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26381fff-6da1a12-ab9e211e-e4ac6fa7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:14.192878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0] Write session: try to update token
2025-09-30T14:58:14.192897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:14.206292Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:14.206315Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:14.206318Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:14.206320Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:14.206330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896710332171222:8122]
2025-09-30T14:58:14.206335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896710332171222:8122]
2025-09-30T14:58:14.206339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896710332171222:8122]
2025-09-30T14:58:14.206378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:14.206384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.206387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:14.206395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:14.206401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:14.206405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:14.206524Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:14.212498Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2831 sessionId: src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:14.215437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:14.256845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896710421965495:6545]
2025-09-30T14:58:14.265583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2830, pipe: [1:7555896710421965495:6545]
2025-09-30T14:58:14.320921Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:14.321752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.321770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.321815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421965495:6545], now have 1 active actors on pipe
2025-09-30T14:58:14.322051Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:14.322215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896710421965495:6545]
2025-09-30T14:58:14.322258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:14.322265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:14.322345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2831 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0
2025-09-30T14:58:14.322523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2831 sessionId: src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0 is DEAD
2025-09-30T14:58:14.322663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:14.322672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0] Write session will restart in 0.007130s
2025-09-30T14:58:14.322697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0] Write session: Do CDS request
2025-09-30T14:58:14.322703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:14.330797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:14.330899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:14.330914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2832
2025-09-30T14:58:14.331051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2832 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:14.331082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2832 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:14.331091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2832 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:14.331096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:14.331635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2832 sessionId:  describe result for acl check
2025-09-30T14:58:14.331667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:14.331669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:14.331672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:14.331677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896710421965517:6870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:14.332185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896710421965517:6870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:14.334953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896710421965517:6870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:14.338003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896710421965517:6870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:14.338028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896710421965517:6870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:14.338031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896710421965517:6870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:14.338041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2832 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:14.343688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:14.344290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:14.344481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:14.344493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:14.344504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:14.344557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:14.344602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896710332171411:8120]
2025-09-30T14:58:14.345326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:14.345660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:14.345708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:14.346036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:14.346099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.346106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.346107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.346108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.346110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.346112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.346113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.346115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.346116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.346117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.346118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.346119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.346120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.346122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.346123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.346130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.346141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.346146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.346150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.346155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.346160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.346165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.346170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.346174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.346179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.346184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.346188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.346193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.346198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.346202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.346210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.346218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.346225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.346231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.346236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.346243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.346248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.346254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.346260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.346272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.346277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.346289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.346295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.346306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.346313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.346323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.346328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.346339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.346343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.346353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.346358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.346364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.346374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.346380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.346390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.346395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.346404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.346410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.346420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.346425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.346475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:14.351864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:14.353033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:14.353049Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:14.353052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:14.353056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:14.353063Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2831 [2:7555896710332171411:8120]
2025-09-30T14:58:14.353081Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:14.353098Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:14.353102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:14.353105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:14.353108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:14.353125Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:14.353135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:14.353147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:14.353209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.353218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.353221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.353224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:14.353227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:14.353293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:14.353302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.353316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.353328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.353481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2831
2025-09-30T14:58:14.353519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2831
2025-09-30T14:58:14.353346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:14.353374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421965665:6870], now have 1 active actors on pipe
2025-09-30T14:58:14.353378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421965499:2454], now have 1 active actors on pipe
2025-09-30T14:58:14.353385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896710332171406:8120]
2025-09-30T14:58:14.353387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896710332171406:8120]
2025-09-30T14:58:14.353391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896710332171406:8120]
2025-09-30T14:58:14.353408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:14.353420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:14.353421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:14.353425Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:14.353427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:14.353435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:14.353438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:14.353471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896710332171406:8120]
2025-09-30T14:58:14.353478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:14.353494Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:14.353649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.353660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.353690Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:14.353703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:14.353708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:14.353716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:14.353727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:14.353736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:14.353751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:14.353923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.353931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.353945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:14.354035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2832 partition: 0 MaxSeqNo: 42 sessionId: src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0
2025-09-30T14:58:14.354421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9bb3267-afbc6a5f-43162a8c-344525ad_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:14.357352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0] Write session: try to update token
2025-09-30T14:58:14.357372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:14.365787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:14.365809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:14.365819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896710332171406:8120]
2025-09-30T14:58:14.365865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:14.365873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:14.366033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:14.366172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:14.366310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:14.366454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:14.366643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:14.366682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:14.373649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2832 sessionId: src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:14.376285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:14.377106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.377134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.377154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:14.377157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:14.377159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:14.377162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:14.377170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896710332171406:8120]
2025-09-30T14:58:14.377174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896710332171406:8120]
2025-09-30T14:58:14.377178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896710332171406:8120]
2025-09-30T14:58:14.377217Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:14.377223Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:14.377224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:14.377227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:14.377232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.377235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:14.377370Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:14.422238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896710421965683:6545]
2025-09-30T14:58:14.422609Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2831, pipe: [1:7555896710421965683:6545]
2025-09-30T14:58:14.497401Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:14.498284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:14.498322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421965683:6545], now have 1 active actors on pipe
2025-09-30T14:58:14.499071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:14.499082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0] Write session will restart in 0.008577s
2025-09-30T14:58:14.499104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0] Write session: Do CDS request
2025-09-30T14:58:14.499109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:14.498449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:14.498479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896710421965683:6545]
2025-09-30T14:58:14.498496Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:14.498603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:14.498606Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:14.498687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2832 reason: error at write: Disconnected sessionId: src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0
2025-09-30T14:58:14.498829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2832 sessionId: src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0 is DEAD
2025-09-30T14:58:14.508783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:14.508993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:14.509010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2833
2025-09-30T14:58:14.509257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2833 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:14.509349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2833 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:14.509364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2833 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:14.509371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:14.510020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2833 sessionId:  describe result for acl check
2025-09-30T14:58:14.510070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:14.510079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:14.510087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:14.510095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896710421965749:6881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:14.510790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896710421965749:6881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:14.513832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896710421965749:6881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:14.520215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:14.523449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896710421965749:6881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:14.523467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896710421965749:6881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:14.523471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896710421965749:6881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:14.523480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2833 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:14.523455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:14.523703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:14.523717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:14.523729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:14.523795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:14.523849Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896710332171584:8113]
2025-09-30T14:58:14.524508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:14.524836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:14.524900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:14.525231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:14.525292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.525298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.525300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.525301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.525303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.525304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.525306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.525307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.525309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.525310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.525311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.525312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.525314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.525315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.525316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.525322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.525333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.525338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.525342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.525345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.525350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.525355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.525359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.525363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.525367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.525372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.525376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.525380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.525384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.525388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.525398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.525406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.525412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.525417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.525422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.525428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.525433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.525439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.525444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.525449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.525454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.525459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.525464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.525470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.525475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.525480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.525485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.525492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.525497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.525502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.525507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.525513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.525517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.525527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.525532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.525538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.525547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.525552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.525557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.525563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.525616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:14.531335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:14.533168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:14.533186Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:14.533188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:14.533192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:14.533200Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2832 [2:7555896710332171584:8113]
2025-09-30T14:58:14.533217Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:14.533235Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:14.533242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:14.533246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:14.533248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:14.533267Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:14.533279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:14.533289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:14.533358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.533365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.533367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.533371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:14.533373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:14.533446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:14.533453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.533468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.533486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.533508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:14.533529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896710332171579:8113]
2025-09-30T14:58:14.533535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896710332171579:8113]
2025-09-30T14:58:14.533538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896710332171579:8113]
2025-09-30T14:58:14.533548Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:14.533566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:14.533569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:14.533574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:14.533576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:14.533584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:14.533587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:14.533597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421965696:2454], now have 1 active actors on pipe
2025-09-30T14:58:14.533605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421965866:6881], now have 1 active actors on pipe
2025-09-30T14:58:14.533640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896710332171579:8113]
2025-09-30T14:58:14.533654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:14.533675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:14.533681Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2832
2025-09-30T14:58:14.533681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2832
2025-09-30T14:58:14.533912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.533924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.533949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36035bc0-65ebe997-80563559-e8478975_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:14.533961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:14.533965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:14.533968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:14.533977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:14.533987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:14.534000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:14.534186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.534196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.534208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:14.534313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2833 partition: 0 MaxSeqNo: 42 sessionId: src_id|36035bc0-65ebe997-80563559-e8478975_0
2025-09-30T14:58:14.534715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c8a335d3-ad193c5e-54cdb078-2468d5d6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|36035bc0-65ebe997-80563559-e8478975_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:14.537866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36035bc0-65ebe997-80563559-e8478975_0] Write session: try to update token
2025-09-30T14:58:14.537888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36035bc0-65ebe997-80563559-e8478975_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:14.547985Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:14.548006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:14.548010Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:14.548012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:14.548022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896710332171579:8113]
2025-09-30T14:58:14.548026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896710332171579:8113]
2025-09-30T14:58:14.548031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896710332171579:8113]
2025-09-30T14:58:14.548067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:14.548073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.548075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:14.548084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:14.548091Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:14.548095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:14.548210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:14.554503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2833 sessionId: src_id|36035bc0-65ebe997-80563559-e8478975_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:14.557546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:14.598842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896710421965879:6545]
2025-09-30T14:58:14.599172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2832, pipe: [1:7555896710421965879:6545]
2025-09-30T14:58:14.664291Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:14.664611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.664620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.664662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421965879:6545], now have 1 active actors on pipe
2025-09-30T14:58:14.665269Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:14.665331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896710421965879:6545]
2025-09-30T14:58:14.665355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:14.664995Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:14.665423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2833 reason: status is not ok: tablet will be restarted right now sessionId: src_id|36035bc0-65ebe997-80563559-e8478975_0
2025-09-30T14:58:14.665699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36035bc0-65ebe997-80563559-e8478975_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:14.665708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36035bc0-65ebe997-80563559-e8478975_0] Write session will restart in 0.009817s
2025-09-30T14:58:14.665730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36035bc0-65ebe997-80563559-e8478975_0] Write session: Do CDS request
2025-09-30T14:58:14.665736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36035bc0-65ebe997-80563559-e8478975_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:14.665579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2833 sessionId: src_id|36035bc0-65ebe997-80563559-e8478975_0 is DEAD
2025-09-30T14:58:14.676794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36035bc0-65ebe997-80563559-e8478975_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:14.676877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:14.676894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2834
2025-09-30T14:58:14.677061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2834 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:14.677095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2834 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:14.677105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2834 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:14.677109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:14.677503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2834 sessionId:  describe result for acl check
2025-09-30T14:58:14.677536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:14.677543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:14.677544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:14.677551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896710421965893:6888] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:14.678114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896710421965893:6888] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:14.680994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896710421965893:6888] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:14.685183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896710421965893:6888] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:14.685198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896710421965893:6888] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:14.685201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896710421965893:6888] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:14.685211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2834 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:14.692616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:14.696659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:14.696879Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:14.696889Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:14.696901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:14.696973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:14.697015Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896710332171761:8109]
2025-09-30T14:58:14.697680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:14.698066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:14.698124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:14.698479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:14.698558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.698564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.698566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.698567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.698568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.698570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.698571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.698573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.698574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.698575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.698576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.698578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.698579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.698580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.698581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.698587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.698597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.698602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.698606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.698611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.698615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.698619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.698623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.698627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.698632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.698636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.698639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.698644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.698648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.698652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.698660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.698669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.698675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.698681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.698686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.698691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.698696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.698701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.698707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.698712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.698716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.698720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.698725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.698731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.698743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.698748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.698754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.698759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.698764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.698771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.698776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.698781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.698785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.698795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.698799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.698804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.698813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.698817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.698822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.698826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.698880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:14.704265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:14.705450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:14.705467Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:14.705469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:14.705473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:14.705479Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2833 [2:7555896710332171761:8109]
2025-09-30T14:58:14.705494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:14.705508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:14.705511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:14.705514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:14.705515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:14.705530Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:14.705537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:14.705543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:14.705606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.705614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.705616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.705620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:14.705623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:14.705682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:14.705690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.705701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.705715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.705733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:14.705753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896710332171756:8109]
2025-09-30T14:58:14.705760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896710332171756:8109]
2025-09-30T14:58:14.705762Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896710332171756:8109]
2025-09-30T14:58:14.705774Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:14.705789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:14.705791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421965971:6888], now have 1 active actors on pipe
2025-09-30T14:58:14.705794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421965880:2454], now have 1 active actors on pipe
2025-09-30T14:58:14.705799Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:14.705801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:14.705802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:14.705814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:14.705817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:14.705847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896710332171756:8109]
2025-09-30T14:58:14.705861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:14.705885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:14.705884Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2833
2025-09-30T14:58:14.705892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2833
2025-09-30T14:58:14.706036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.706047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.706071Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91a81ea5-80280fcf-16106294-b8578c5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:14.706082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:14.706086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:14.706088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:14.706101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:14.706117Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:14.706129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:14.706358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.706384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.706410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:14.706524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2834 partition: 0 MaxSeqNo: 42 sessionId: src_id|91a81ea5-80280fcf-16106294-b8578c5c_0
2025-09-30T14:58:14.706894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36035bc0-65ebe997-80563559-e8478975_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|91a81ea5-80280fcf-16106294-b8578c5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:14.709709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91a81ea5-80280fcf-16106294-b8578c5c_0] Write session: try to update token
2025-09-30T14:58:14.709730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91a81ea5-80280fcf-16106294-b8578c5c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:14.717787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:14.717809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:14.717818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896710332171756:8109]
2025-09-30T14:58:14.717862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:14.718048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:14.718204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:14.718347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:14.718492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:14.718702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:14.718742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:14.718868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:14.724560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2834 sessionId: src_id|91a81ea5-80280fcf-16106294-b8578c5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:14.727507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:14.727700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.727723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.727786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:14.727873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:14.729039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:14.729055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:14.729057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:14.729059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:14.729068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896710332171756:8109]
2025-09-30T14:58:14.729071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896710332171756:8109]
2025-09-30T14:58:14.729075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896710332171756:8109]
2025-09-30T14:58:14.729108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:14.729115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.729117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:14.729123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:14.729125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:14.729130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:14.729262Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:14.763743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896710421966066:6545]
2025-09-30T14:58:14.764011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2833, pipe: [1:7555896710421966066:6545]
2025-09-30T14:58:14.835668Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:14.844378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.844406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.844588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.844656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.844723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.844801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.845287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.845303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.845382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.845446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.845512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.845781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.845830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.845838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.845914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.845982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.846049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.846122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.846169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.846177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.846249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.846323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.846392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.846468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.846516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.846524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.846602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.846671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.846740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.846810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.846856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.846863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.846938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.847004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.847079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.847149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.847196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.847204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.847300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.847367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.847453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.847525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.847574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.847583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.847658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.847725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.847792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.847862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.847914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.847921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.847993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.848066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.848140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.848209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.848259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.848266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.848341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:14.848409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:14.848480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:14.848553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:14.848664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:14.848673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:14.848736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421966066:6545], now have 1 active actors on pipe
2025-09-30T14:58:14.849057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896710421966066:6545]
2025-09-30T14:58:14.849066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:14.849070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:14.849102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2834 reason: error at write: Disconnected sessionId: src_id|91a81ea5-80280fcf-16106294-b8578c5c_0
2025-09-30T14:58:14.849244Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:14.849295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2834 sessionId: src_id|91a81ea5-80280fcf-16106294-b8578c5c_0 is DEAD
2025-09-30T14:58:14.849455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a81ea5-80280fcf-16106294-b8578c5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:14.849466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a81ea5-80280fcf-16106294-b8578c5c_0] Write session will restart in 0.006883s
2025-09-30T14:58:14.849491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a81ea5-80280fcf-16106294-b8578c5c_0] Write session: Do CDS request
2025-09-30T14:58:14.849497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a81ea5-80280fcf-16106294-b8578c5c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:14.849718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:14.857860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91a81ea5-80280fcf-16106294-b8578c5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:14.857965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:14.857980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2835
2025-09-30T14:58:14.858087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2835 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:14.858116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2835 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:14.858125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2835 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:14.858129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:14.858577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2835 sessionId:  describe result for acl check
2025-09-30T14:58:14.858616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:14.858623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:14.858625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:14.858631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896710421966118:6910] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:14.859205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896710421966118:6910] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:14.861996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896710421966118:6910] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:14.864809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896710421966118:6910] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:14.864823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896710421966118:6910] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:14.864826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896710421966118:6910] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:14.864834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2835 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:14.865763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:14.869307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:14.869706Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:14.869722Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:14.869736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:14.869811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:14.869857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896710332171972:8076]
2025-09-30T14:58:14.870545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:14.870873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:14.870924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:14.871304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:14.871375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.871382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.871384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.871385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.871387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.871388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.871389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.871391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.871392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.871393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.871394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.871396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.871397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.871398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.871399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.871406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.871418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.871423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.871427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.871431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.871436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.871440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.871445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.871449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.871454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.871459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.871463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.871467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.871472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.871476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.871484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.871498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:14.871509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.871520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:14.871532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.871543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:14.871548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.871558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:14.871563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.871577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:14.871582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.871588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:14.871593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.871599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:14.871603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.871609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:14.871615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.871620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:14.871630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.871642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:14.871651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.871661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.871670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.871680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.871684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.871694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.871702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.871707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:14.871716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.871726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:14.871772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:14.877061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:14.877939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:14.877957Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:14.877960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:14.877964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:14.877972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2834 [2:7555896710332171972:8076]
2025-09-30T14:58:14.877988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:14.878008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:14.878011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:14.878014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:14.878016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:14.878033Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:14.878046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:14.878057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:14.878120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.878128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.878131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.878134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:14.878137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:14.878206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:14.878219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.878233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:14.878247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:14.878267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:14.878284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421966260:6910], now have 1 active actors on pipe
2025-09-30T14:58:14.878293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421966092:2454], now have 1 active actors on pipe
2025-09-30T14:58:14.878301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896710332171967:8076]
2025-09-30T14:58:14.878303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896710332171967:8076]
2025-09-30T14:58:14.878306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896710332171967:8076]
2025-09-30T14:58:14.878322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:14.878341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:14.878348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:14.878352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:14.878355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:14.878361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:14.878364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:14.878355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2834
2025-09-30T14:58:14.878394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896710332171967:8076]
2025-09-30T14:58:14.878356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2834
2025-09-30T14:58:14.878402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:14.878404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:14.878435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.878439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.878472Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c5e57906-68283386-b78e6e6b-4169ed9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:14.878484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:14.878488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:14.878494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:14.878505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:14.878514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:14.878535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:14.878643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:14.878663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:14.878683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:14.878769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2835 partition: 0 MaxSeqNo: 42 sessionId: src_id|c5e57906-68283386-b78e6e6b-4169ed9_0
2025-09-30T14:58:14.879109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a81ea5-80280fcf-16106294-b8578c5c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c5e57906-68283386-b78e6e6b-4169ed9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:14.881799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e57906-68283386-b78e6e6b-4169ed9_0] Write session: try to update token
2025-09-30T14:58:14.881815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e57906-68283386-b78e6e6b-4169ed9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:14.890503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:14.890523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:14.890526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:14.890528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:14.890539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896710332171967:8076]
2025-09-30T14:58:14.890543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896710332171967:8076]
2025-09-30T14:58:14.890547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896710332171967:8076]
2025-09-30T14:58:14.890593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:14.890601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:14.890600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:14.890606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:14.890608Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:14.890614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:14.890744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:14.902325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2835 sessionId: src_id|c5e57906-68283386-b78e6e6b-4169ed9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:14.905111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:14.949072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896710421966273:6545]
2025-09-30T14:58:14.949422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2834, pipe: [1:7555896710421966273:6545]
2025-09-30T14:58:15.006849Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:15.007405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.007421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.007442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896710421966273:6545], now have 1 active actors on pipe
2025-09-30T14:58:15.007661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:15.007742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896710421966273:6545]
2025-09-30T14:58:15.007787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:15.007853Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:15.007862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2835 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c5e57906-68283386-b78e6e6b-4169ed9_0
2025-09-30T14:58:15.008052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2835 sessionId: src_id|c5e57906-68283386-b78e6e6b-4169ed9_0 is DEAD
2025-09-30T14:58:15.008227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e57906-68283386-b78e6e6b-4169ed9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:15.008238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e57906-68283386-b78e6e6b-4169ed9_0] Write session will restart in 0.006397s
2025-09-30T14:58:15.008262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e57906-68283386-b78e6e6b-4169ed9_0] Write session: Do CDS request
2025-09-30T14:58:15.008267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e57906-68283386-b78e6e6b-4169ed9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:15.015763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e57906-68283386-b78e6e6b-4169ed9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:15.015833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:15.015860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2836
2025-09-30T14:58:15.015995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2836 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:15.016027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2836 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:15.016038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2836 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:15.016042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:15.016529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2836 sessionId:  describe result for acl check
2025-09-30T14:58:15.016571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:15.016578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:15.016580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:15.016586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896714716933581:6916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:15.017184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896714716933581:6916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:15.018955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896714716933581:6916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:15.022837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896714716933581:6916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:15.022853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896714716933581:6916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:15.022856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896714716933581:6916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:15.022865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2836 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:15.029470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:15.033973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:15.034198Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:15.034212Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:15.034223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:15.034280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:15.034322Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896714627139444:8071]
2025-09-30T14:58:15.034981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:15.035390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:15.035470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:15.035851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:15.035931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.035937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.035939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.035941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.035942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.035944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.035945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.035946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.035948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.035950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.035952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.035953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.035954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.035956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.035957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.035964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.035975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.035980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.035985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.035989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.035995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.036000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.036005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.036009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.036014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.036019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.036023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.036028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.036033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.036038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.036047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.036056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.036063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.036070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.036078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.036084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.036089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.036096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.036101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.036108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.036113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.036119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.036125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.036132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.036136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.036148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.036154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.036165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.036171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.036177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.036184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.036190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.036200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.036205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.036211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.036221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.036225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.036235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.036240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.036246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.036305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:15.042038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:15.043005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:15.043022Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:15.043025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:15.043029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:15.043035Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2835 [2:7555896714627139444:8071]
2025-09-30T14:58:15.043047Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:15.043061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:15.043063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:15.043066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:15.043067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:15.043080Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:15.043085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:15.043098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:15.043154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.043161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.043162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.043165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:15.043167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:15.043232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:15.043258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.043273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.043286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.043302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:15.043326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716933638:6916], now have 1 active actors on pipe
2025-09-30T14:58:15.043335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716933573:2454], now have 1 active actors on pipe
2025-09-30T14:58:15.043341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896714627139439:8071]
2025-09-30T14:58:15.043344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896714627139439:8071]
2025-09-30T14:58:15.043347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896714627139439:8071]
2025-09-30T14:58:15.043361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:15.043375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:15.043391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:15.043398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:15.043387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:15.043404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:15.043407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:15.043438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896714627139439:8071]
2025-09-30T14:58:15.043451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:15.043457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:15.043447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2835
2025-09-30T14:58:15.043484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2835
2025-09-30T14:58:15.043533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.043543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.043573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:15.043588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:15.043592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:15.043594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:15.043603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:15.043614Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:15.043641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:15.043771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.043779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.043792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:15.043965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2836 partition: 0 MaxSeqNo: 42 sessionId: src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0
2025-09-30T14:58:15.044383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c5e57906-68283386-b78e6e6b-4169ed9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:15.047344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0] Write session: try to update token
2025-09-30T14:58:15.047368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:15.055761Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:15.055778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:15.055789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896714627139439:8071]
2025-09-30T14:58:15.055834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:15.055834Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:15.056019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:15.056176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:15.056330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:15.056489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:15.056696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:15.056736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:15.063871Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2836 sessionId: src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:15.066741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:15.067877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.067902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.067923Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:15.067926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:15.067928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:15.067930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:15.067940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896714627139439:8071]
2025-09-30T14:58:15.067944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896714627139439:8071]
2025-09-30T14:58:15.067948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896714627139439:8071]
2025-09-30T14:58:15.067995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:15.067998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:15.068005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.068007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:15.068014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:15.068018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:15.068156Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:15.107790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896714716933755:6545]
2025-09-30T14:58:15.108066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2835, pipe: [1:7555896714716933755:6545]
2025-09-30T14:58:15.182464Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:15.183067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:15.183109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716933755:6545], now have 1 active actors on pipe
2025-09-30T14:58:15.183215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:15.183325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:15.183380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896714716933755:6545]
2025-09-30T14:58:15.194680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:15.194694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:15.194718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2836 reason: error at write: Disconnected sessionId: src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0
2025-09-30T14:58:15.194885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2836 sessionId: src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0 is DEAD
2025-09-30T14:58:15.195005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:15.195016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0] Write session will restart in 0.005860s
2025-09-30T14:58:15.195049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0] Write session: Do CDS request
2025-09-30T14:58:15.195055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:15.201737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:15.201997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:15.202026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2837
2025-09-30T14:58:15.202138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2837 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:15.202168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2837 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:15.202178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2837 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:15.202182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:15.202557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:15.202592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2837 sessionId:  describe result for acl check
2025-09-30T14:58:15.202627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:15.202629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:15.202631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:15.202637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896714716933897:6927] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:15.203137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896714716933897:6927] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:15.205787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896714716933897:6927] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:15.206166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:15.206366Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:15.206377Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:15.206388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:15.206437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:15.206477Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896714627139622:8061]
2025-09-30T14:58:15.207163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:15.207506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:15.207560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:15.207889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:15.207963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.207972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.207973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.207974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.207976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.207977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.207978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.207979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.207980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.207981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.207983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.207984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.207986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.207986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.207988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.207993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.208003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.208007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.208011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.208016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.208019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.208023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.208028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.208031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.208036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.208039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.208043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.208048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.208051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.208054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.208062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.208071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.208077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.208083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.208088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.208093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.208100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.208106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.208111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.208117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.208121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.208126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.208130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896714716933897:6927] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:15.208141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896714716933897:6927] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:15.208143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896714716933897:6927] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:15.208130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.208135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.208139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.208149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2837 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:15.208144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.208150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.208155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.208159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.208166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.208171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.208176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.208180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.208185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.208191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.208197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.208201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.208206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.208211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.208215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.208264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:15.213631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:15.215002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:15.215019Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:15.215021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:15.215026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:15.215033Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2836 [2:7555896714627139622:8061]
2025-09-30T14:58:15.215049Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:15.215063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:15.215066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:15.215069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:15.215070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:15.215082Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:15.215088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:15.215093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:15.215153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.215160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.215162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.215164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:15.215166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:15.215225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:15.215233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.215275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.215290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.215309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:15.215334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716933934:6927], now have 1 active actors on pipe
2025-09-30T14:58:15.215343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716933757:2454], now have 1 active actors on pipe
2025-09-30T14:58:15.215350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896714627139617:8061]
2025-09-30T14:58:15.215353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896714627139617:8061]
2025-09-30T14:58:15.215356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896714627139617:8061]
2025-09-30T14:58:15.215368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:15.215385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:15.215388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:15.215392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:15.215395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:15.215397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:15.215400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:15.215430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896714627139617:8061]
2025-09-30T14:58:15.215436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:15.215445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:15.215408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2836
2025-09-30T14:58:15.215421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2836
2025-09-30T14:58:15.215469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.215476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.215498Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:15.215507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:15.215510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:15.215511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:15.215518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:15.215525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:15.215545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:15.215705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.215721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.215745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:15.215840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2837 partition: 0 MaxSeqNo: 42 sessionId: src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0
2025-09-30T14:58:15.216192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13771b68-8f70df0c-fbd679d6-8e9d0cec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:15.219024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0] Write session: try to update token
2025-09-30T14:58:15.219048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:15.227628Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:15.227653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:15.227663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896714627139617:8061]
2025-09-30T14:58:15.227709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:15.227712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:15.227897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:15.228054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:15.228208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:15.228363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:15.228569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:15.228618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:15.234510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2837 sessionId: src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:15.237409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:15.237593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.237622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.239130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:15.239176Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:15.239180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:15.239183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:15.239185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:15.239195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896714627139617:8061]
2025-09-30T14:58:15.239200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896714627139617:8061]
2025-09-30T14:58:15.239204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896714627139617:8061]
2025-09-30T14:58:15.239233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:15.239238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:15.239265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.239265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:15.239268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:15.239270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:15.239288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:15.239412Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:15.283410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896714716933950:6545]
2025-09-30T14:58:15.283848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2836, pipe: [1:7555896714716933950:6545]
2025-09-30T14:58:15.350965Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:15.358832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.358854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.359009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.359074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.359138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.359202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.359478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.359487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.359558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.359615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.359676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.359739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.359780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.359786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.359847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.359903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.359961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.360019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.360060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.360066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.360129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.360189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.360257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.360316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.360363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.360368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.360435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.360498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.360580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.360646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.360693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.360701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.360772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.360838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.360917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.360982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.361036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.361039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.361112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.361176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.361248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.361314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.361358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.361365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.361435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.361493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.361559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.361619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.361660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.361667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.361736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.361794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.361860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.361929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.361973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.361981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.362047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.362110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.362170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.362230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.362281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.362288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.362351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716933950:6545], now have 1 active actors on pipe
2025-09-30T14:58:15.362570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:15.362644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:15.362652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:15.362696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2837 reason: error at write: Disconnected sessionId: src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0
2025-09-30T14:58:15.362920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896714716933950:6545]
2025-09-30T14:58:15.362924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2837 sessionId: src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0 is DEAD
2025-09-30T14:58:15.362956Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:15.363071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:15.363082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0] Write session will restart in 0.005685s
2025-09-30T14:58:15.363104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0] Write session: Do CDS request
2025-09-30T14:58:15.363110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:15.369788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:15.369914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:15.369928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2838
2025-09-30T14:58:15.370041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2838 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:15.370074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2838 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:15.370083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2838 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:15.370087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:15.370551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2838 sessionId:  describe result for acl check
2025-09-30T14:58:15.370593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:15.370600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:15.370603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:15.370609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896714716933970:6936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:15.371180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896714716933970:6936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:15.374139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896714716933970:6936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:15.377486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896714716933970:6936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:15.377509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896714716933970:6936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:15.377513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896714716933970:6936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:15.377523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2838 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:15.379752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:15.384538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:15.384781Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:15.384792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:15.384804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:15.384872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:15.384917Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896714627139813:8049]
2025-09-30T14:58:15.385614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:15.385949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:15.385995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:15.386825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:15.386906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.386913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.386915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.386916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.386918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.386919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.386920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.386921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.386923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.386924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.386926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.386927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.386928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.386929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.386930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.386936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.386948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.386953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.386958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.386962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.386967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.386971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.386975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.386979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.386984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.386988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.386992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.386996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.387001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.387005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.387014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.387022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.387030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.387036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.387041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.387046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.387051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.387056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.387063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.387068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.387073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.387078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.387086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.387091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.387096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.387102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.387106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.387111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.387116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.387122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.387127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.387132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.387137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.387142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.387147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.387154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.387158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.387163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.387168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.387173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.387219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:15.393086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:15.394021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:15.394041Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:15.394044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:15.394048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:15.394056Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2837 [2:7555896714627139813:8049]
2025-09-30T14:58:15.394072Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:15.394091Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:15.394094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:15.394098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:15.394101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:15.394116Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:15.394132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:15.394144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:15.394207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.394215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.394218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.394221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:15.394224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:15.394292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:15.394309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.394322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.394339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.394354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:15.394380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716933955:2454], now have 1 active actors on pipe
2025-09-30T14:58:15.394391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896714627139808:8049]
2025-09-30T14:58:15.394394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896714627139808:8049]
2025-09-30T14:58:15.394395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896714627139808:8049]
2025-09-30T14:58:15.394411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:15.394424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716934128:6936], now have 1 active actors on pipe
2025-09-30T14:58:15.394433Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:15.394446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:15.394449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:15.394487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896714627139808:8049]
2025-09-30T14:58:15.394498Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:15.394520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:15.394530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:15.394534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:15.394541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:15.394733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.394746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.394776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:15.394788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:15.394792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:15.394798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:15.394809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:15.394823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:15.394851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:15.395057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.395070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.395092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:15.394495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2837
2025-09-30T14:58:15.394552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2837
2025-09-30T14:58:15.395289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2838 partition: 0 MaxSeqNo: 42 sessionId: src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0
2025-09-30T14:58:15.395640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2770bee3-1cd7d122-34a8d0a4-9433b408_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:15.398523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0] Write session: try to update token
2025-09-30T14:58:15.398543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:15.407039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:15.407063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:15.407074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896714627139808:8049]
2025-09-30T14:58:15.407126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:15.407130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:15.407383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:15.407565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:15.407738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:15.407906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:15.408150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:15.408206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:15.413530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2838 sessionId: src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:15.416445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:15.416611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.416635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.417871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:15.417907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:15.417911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:15.417913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:15.417918Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:15.417928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896714627139808:8049]
2025-09-30T14:58:15.417932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896714627139808:8049]
2025-09-30T14:58:15.417935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896714627139808:8049]
2025-09-30T14:58:15.417967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:15.417973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:15.417979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:15.417983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:15.417982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.417985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:15.417991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:15.418117Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:15.463148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896714716934142:6545]
2025-09-30T14:58:15.463545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2837, pipe: [1:7555896714716934142:6545]
2025-09-30T14:58:15.532710Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:15.541422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.541452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.541623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.541686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.541750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.541818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.541868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.541882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.541949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.542012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.542075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.542150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.542194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.542201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.542268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.542334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.542395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.542454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.542500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.542503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.542569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.543021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.543090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.543152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.543198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.543208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.543293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.543350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.543417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.543483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.543528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.543538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.543611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.543673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.543742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.543807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.543849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.543857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.543929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.543990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.544055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.544118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.544164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.544175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.544242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.544304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.544365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.544433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.544478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.544485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.544558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.544618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.544683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.544748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.544791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.544798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.544877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:15.544940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:15.545004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:15.545065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:15.545111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:15.545118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:15.545187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716934142:6545], now have 1 active actors on pipe
2025-09-30T14:58:15.545463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:15.545475Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:15.545479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:15.545520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2838 reason: error at write: Disconnected sessionId: src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0
2025-09-30T14:58:15.545521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896714716934142:6545]
2025-09-30T14:58:15.545693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2838 sessionId: src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0 is DEAD
2025-09-30T14:58:15.545826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:15.545833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0] Write session will restart in 0.008169s
2025-09-30T14:58:15.545851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0] Write session: Do CDS request
2025-09-30T14:58:15.545855Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:15.546063Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:15.554772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:15.554897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:15.554912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2839
2025-09-30T14:58:15.555055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2839 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:15.555085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2839 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:15.555095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2839 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:15.555098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:15.555575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2839 sessionId:  describe result for acl check
2025-09-30T14:58:15.555604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:15.555611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:15.555614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:15.555620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896714716934206:6949] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:15.556100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896714716934206:6949] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:15.558551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896714716934206:6949] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:15.561274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896714716934206:6949] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:15.561291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896714716934206:6949] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:15.561296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896714716934206:6949] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:15.561305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2839 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:15.565395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:15.565976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:15.566183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:15.566195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:15.566207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:15.566274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:15.566324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896714627139993:8047]
2025-09-30T14:58:15.566991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:15.567329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:15.567402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:15.567715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:15.567777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.567783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.567785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.567786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.567787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.567788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.567790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.567791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.567792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.567793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.567795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.567796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.567797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.567799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.567800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.567806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.567817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.567821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.567826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.567830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.567834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.567838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.567842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.567847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.567851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.567856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.567860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.567864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.567868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.567872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.567879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.567887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.567892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.567895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.567900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.567903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.567905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.567908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.567911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.567914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.567917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.567920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.567923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.567926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.567931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.567942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.567947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.567957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.567962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.567968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.567976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.567981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.567985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.567991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.567998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.568004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.568008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.568014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.568020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.568025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.568071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:15.573621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:15.574987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:15.575002Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:15.575005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:15.575009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:15.575016Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2838 [2:7555896714627139993:8047]
2025-09-30T14:58:15.575033Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:15.575049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:15.575053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:15.575056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:15.575059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:15.575075Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:15.575089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:15.575100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:15.575154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.575159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.575161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.575163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:15.575165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:15.575214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:15.575220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.575230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.575240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.575270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:15.575297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896714627139988:8047]
2025-09-30T14:58:15.575300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896714627139988:8047]
2025-09-30T14:58:15.575302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896714627139988:8047]
2025-09-30T14:58:15.575320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:15.575341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716934157:2454], now have 1 active actors on pipe
2025-09-30T14:58:15.575349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716934332:6949], now have 1 active actors on pipe
2025-09-30T14:58:15.575355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:15.575358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:15.575367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:15.575369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:15.575372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:15.575375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:15.575408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896714627139988:8047]
2025-09-30T14:58:15.575421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:15.575438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:15.575410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2838
2025-09-30T14:58:15.575437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2838
2025-09-30T14:58:15.575565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.575578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.575603Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:15.575610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:15.575613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:15.575615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:15.575625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:15.575634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:15.575653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:15.576087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.576102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.576122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:15.576224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2839 partition: 0 MaxSeqNo: 42 sessionId: src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0
2025-09-30T14:58:15.576624Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3acf2787-3ec82728-59436bb4-eb9502a0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:15.579453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0] Write session: try to update token
2025-09-30T14:58:15.579471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:15.587750Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:15.587773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:15.587775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:15.587777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:15.587787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896714627139988:8047]
2025-09-30T14:58:15.587791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896714627139988:8047]
2025-09-30T14:58:15.587796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896714627139988:8047]
2025-09-30T14:58:15.587844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:15.587858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.587867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:15.587889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:15.587895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:15.587900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:15.588015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:15.595394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2839 sessionId: src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:15.598472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:15.645906Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896714716934344:6545]
2025-09-30T14:58:15.646209Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2838, pipe: [1:7555896714716934344:6545]
2025-09-30T14:58:15.707576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:15.708105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.708126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.708148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716934344:6545], now have 1 active actors on pipe
2025-09-30T14:58:15.708390Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:15.708375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:15.708384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:15.708390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:15.708428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896714716934344:6545]
2025-09-30T14:58:15.708458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2839 reason: error at write: Disconnected sessionId: src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0
2025-09-30T14:58:15.708640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2839 sessionId: src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0 is DEAD
2025-09-30T14:58:15.708786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:15.708796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0] Write session will restart in 0.009519s
2025-09-30T14:58:15.708820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0] Write session: Do CDS request
2025-09-30T14:58:15.708829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:15.719730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:15.719860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:15.719877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2840
2025-09-30T14:58:15.720010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2840 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:15.720058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2840 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:15.720069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2840 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:15.720074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:15.720501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2840 sessionId:  describe result for acl check
2025-09-30T14:58:15.720540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:15.720546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:15.720548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:15.720555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896714716934362:6951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:15.721125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896714716934362:6951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:15.723235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896714716934362:6951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:15.726145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896714716934362:6951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:15.726158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896714716934362:6951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:15.726162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896714716934362:6951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:15.726170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2840 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:15.728677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:15.732887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:15.733115Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:15.733128Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:15.733139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:15.733199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:15.733245Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896714627140175:8028]
2025-09-30T14:58:15.733900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:15.734237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:15.734284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:15.734638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:15.734714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.734722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.734723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.734724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.734725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.734726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.734728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.734730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.734731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.734733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.734734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.734735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.734736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.734738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.734739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.734744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.734754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.734758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.734763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.734766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.734770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.734774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.734778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.734782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.734786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.734790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.734795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.734798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.734801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.734805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.734814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.734822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.734828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.734834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.734839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.734844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.734850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.734855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.734861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.734866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.734878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.734884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.734889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.734895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.734899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.734905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.734910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.734916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.734926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.734932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.734942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.734949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.734958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.734964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.734969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.734980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.734985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.734995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.735000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.735006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.735056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:15.740396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:15.741344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:15.741363Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:15.741366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:15.741371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:15.741379Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2839 [2:7555896714627140175:8028]
2025-09-30T14:58:15.741396Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:15.741414Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:15.741423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:15.741426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:15.741429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:15.741445Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:15.741459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:15.741466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:15.741531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.741540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.741542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.741546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:15.741549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:15.741614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:15.741623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.741637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.741647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.741664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:15.741684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716934520:6951], now have 1 active actors on pipe
2025-09-30T14:58:15.741698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896714627140169:8028]
2025-09-30T14:58:15.741701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896714627140169:8028]
2025-09-30T14:58:15.741703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896714627140169:8028]
2025-09-30T14:58:15.741720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:15.741732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716934346:2454], now have 1 active actors on pipe
2025-09-30T14:58:15.741739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:15.741754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:15.741754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:15.741756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:15.741770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:15.741774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:15.741805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896714627140169:8028]
2025-09-30T14:58:15.741784Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2839
2025-09-30T14:58:15.741812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:15.741825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2839
2025-09-30T14:58:15.741815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:15.741829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.741835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.741884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:15.741896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:15.741901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:15.741903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:15.741913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:15.741927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:15.741952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:15.742176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.742184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.742199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:15.742304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2840 partition: 0 MaxSeqNo: 42 sessionId: src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0
2025-09-30T14:58:15.742723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9546bbe9-e8f7cd43-e03edd80-9ca023e9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:15.745817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0] Write session: try to update token
2025-09-30T14:58:15.745838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:15.754106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:15.754129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:15.754132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:15.754134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:15.754146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896714627140169:8028]
2025-09-30T14:58:15.754151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896714627140169:8028]
2025-09-30T14:58:15.754155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896714627140169:8028]
2025-09-30T14:58:15.754193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:15.754197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:15.754200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.754203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:15.754204Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:15.754208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:15.754347Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:15.766528Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2840 sessionId: src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:15.769150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:15.808741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896714716934536:6545]
2025-09-30T14:58:15.809071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2839, pipe: [1:7555896714716934536:6545]
2025-09-30T14:58:15.871101Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:15.872088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.872110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.872129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716934536:6545], now have 1 active actors on pipe
2025-09-30T14:58:15.872301Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:15.872802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:15.872815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0] Write session will restart in 0.008929s
2025-09-30T14:58:15.872840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0] Write session: Do CDS request
2025-09-30T14:58:15.872846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:15.872355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:15.872371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:15.872432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2840 reason: error at write: Disconnected sessionId: src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0
2025-09-30T14:58:15.872625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2840 sessionId: src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0 is DEAD
2025-09-30T14:58:15.872779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896714716934536:6545]
2025-09-30T14:58:15.872794Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:15.882882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:15.882963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:15.882984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2841
2025-09-30T14:58:15.883112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2841 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:15.883153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2841 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:15.883163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2841 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:15.883168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:15.883712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2841 sessionId:  describe result for acl check
2025-09-30T14:58:15.883744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:15.883751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:15.883753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:15.883758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896714716934617:6973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:15.884288Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896714716934617:6973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:15.886688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896714716934617:6973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:15.889129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:15.889420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896714716934617:6973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:15.889436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896714716934617:6973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:15.889439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896714716934617:6973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:15.889448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2841 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:15.894130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:15.894383Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:15.894397Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:15.894409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:15.894465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:15.894508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896714627140390:8015]
2025-09-30T14:58:15.895205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:15.895615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:15.895704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:15.896091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:15.896180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.896182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.896183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.896184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.896186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.896187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.896189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.896190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.896192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.896193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.896194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.896196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.896197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.896198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.896200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.896206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.896219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.896223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.896227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.896231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.896235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.896239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.896243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.896247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.896252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.896257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.896262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.896266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.896271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.896276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.896284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.896293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:15.896300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.896306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:15.896311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.896317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:15.896322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.896328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:15.896333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.896339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:15.896344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.896349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:15.896354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.896359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:15.896365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.896373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:15.896378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.896383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:15.896387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.896392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:15.896396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.896401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.896405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.896409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.896414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.896418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.896422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.896427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:15.896435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.896439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:15.896480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:15.902195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:15.904087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2840
2025-09-30T14:58:15.903624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:15.903646Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:15.903649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:15.903653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:15.903659Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2840 [2:7555896714627140390:8015]
2025-09-30T14:58:15.903677Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:15.903695Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:15.903699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:15.903702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:15.903704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:15.903721Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:15.903728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:15.903736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:15.903802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.903804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.903807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.903810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:15.903813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:15.903889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:15.903892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.903907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:15.903919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:15.903937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:15.903956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716934558:2454], now have 1 active actors on pipe
2025-09-30T14:58:15.903960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716934737:6973], now have 1 active actors on pipe
2025-09-30T14:58:15.903966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896714627140384:8015]
2025-09-30T14:58:15.903969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896714627140384:8015]
2025-09-30T14:58:15.903971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896714627140384:8015]
2025-09-30T14:58:15.903990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:15.904008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:15.904012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:15.904017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:15.904019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:15.904022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:15.904026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:15.904062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896714627140384:8015]
2025-09-30T14:58:15.904070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:15.904106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:15.904187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.904195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.904224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|de9984c2-8956e32-70413d06-cc9255b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:15.904232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:15.904236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:15.904238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:15.904250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:15.904261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:15.904274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:15.904105Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2840
2025-09-30T14:58:15.904575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2841 partition: 0 MaxSeqNo: 42 sessionId: src_id|de9984c2-8956e32-70413d06-cc9255b6_0
2025-09-30T14:58:15.904995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|30631238-c57bcc01-2eb4c1b4-a5e3d618_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|de9984c2-8956e32-70413d06-cc9255b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:15.904461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:15.904470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:15.904483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:15.907920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de9984c2-8956e32-70413d06-cc9255b6_0] Write session: try to update token
2025-09-30T14:58:15.907940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de9984c2-8956e32-70413d06-cc9255b6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:15.916655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:15.916682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:15.916693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896714627140384:8015]
2025-09-30T14:58:15.916741Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:15.916742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:15.916956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:15.917125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:15.917293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:15.917452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:15.917768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:15.917822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:15.927863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:15.927887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:15.927890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:15.927893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:15.927903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896714627140384:8015]
2025-09-30T14:58:15.927908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896714627140384:8015]
2025-09-30T14:58:15.927912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896714627140384:8015]
2025-09-30T14:58:15.927955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:15.927958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:15.927962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:15.927965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:15.927965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:15.927969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:15.928108Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:15.931302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2841 sessionId: src_id|de9984c2-8956e32-70413d06-cc9255b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:15.934083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:15.973056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896714716934748:6545]
2025-09-30T14:58:15.973357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2840, pipe: [1:7555896714716934748:6545]
2025-09-30T14:58:16.041975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:16.042542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.042563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.042594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896714716934748:6545], now have 1 active actors on pipe
2025-09-30T14:58:16.042768Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:16.042793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:16.042799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:16.042803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:16.042845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896714716934748:6545]
2025-09-30T14:58:16.042867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2841 reason: error at write: Disconnected sessionId: src_id|de9984c2-8956e32-70413d06-cc9255b6_0
2025-09-30T14:58:16.043044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2841 sessionId: src_id|de9984c2-8956e32-70413d06-cc9255b6_0 is DEAD
2025-09-30T14:58:16.043198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de9984c2-8956e32-70413d06-cc9255b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:16.043208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de9984c2-8956e32-70413d06-cc9255b6_0] Write session will restart in 0.006597s
2025-09-30T14:58:16.043226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de9984c2-8956e32-70413d06-cc9255b6_0] Write session: Do CDS request
2025-09-30T14:58:16.043232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de9984c2-8956e32-70413d06-cc9255b6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:16.050793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|de9984c2-8956e32-70413d06-cc9255b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:16.050841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:16.050856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2842
2025-09-30T14:58:16.051015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2842 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:16.051043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2842 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:16.051052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2842 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:16.051056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:16.051527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2842 sessionId:  describe result for acl check
2025-09-30T14:58:16.051563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:16.051572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:16.051576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:16.051582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896719011902062:6981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:16.052123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896719011902062:6981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:16.054902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896719011902062:6981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:16.057662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896719011902062:6981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:16.057675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896719011902062:6981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:16.057677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896719011902062:6981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:16.057683Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2842 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:16.063195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:16.063737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:16.063922Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:16.063932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:16.063941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:16.063987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:16.064017Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896718922107870:8011]
2025-09-30T14:58:16.064484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:16.064811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:16.064878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:16.065198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:16.065259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.065265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.065266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.065267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.065268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.065269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.065270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.065271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.065272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.065274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.065274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.065275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.065276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.065278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.065279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.065284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.065294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.065298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.065301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.065305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.065308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.065312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.065316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.065319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.065326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.065330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.065334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.065337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.065351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.065355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.065363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.065371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.065377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.065384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.065389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.065395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.065402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.065407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.065413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.065421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.065425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.065436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.065441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.065446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.065456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.065461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.065470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.065474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.065479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.065485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.065490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.065496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.065500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.065506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.065517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.065522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.065527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.065532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.065537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.065541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.065586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:16.071035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:16.072363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:16.072377Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:16.072379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:16.072382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:16.072387Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2841 [2:7555896718922107870:8011]
2025-09-30T14:58:16.072400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:16.072413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:16.072415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:16.072417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:16.072419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:16.072432Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:16.072444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:16.072456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:16.072519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.072527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.072529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.072533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:16.072534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:16.072599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:16.072608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.072621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.072634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.072653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:16.072672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011902223:6981], now have 1 active actors on pipe
2025-09-30T14:58:16.072680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011902047:2454], now have 1 active actors on pipe
2025-09-30T14:58:16.072687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896718922107865:8011]
2025-09-30T14:58:16.072690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896718922107865:8011]
2025-09-30T14:58:16.072693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896718922107865:8011]
2025-09-30T14:58:16.072704Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:16.072722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:16.072728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:16.072732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:16.072735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:16.072735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:16.072738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:16.072775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896718922107865:8011]
2025-09-30T14:58:16.072750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2841
2025-09-30T14:58:16.072788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:16.072758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2841
2025-09-30T14:58:16.072814Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:16.072837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.072860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.072887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:16.072899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:16.072904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:16.072906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:16.072916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:16.072926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:16.072939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:16.073062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.073069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.073082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:16.073164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2842 partition: 0 MaxSeqNo: 42 sessionId: src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0
2025-09-30T14:58:16.073537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|de9984c2-8956e32-70413d06-cc9255b6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:16.076507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0] Write session: try to update token
2025-09-30T14:58:16.076527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:16.084963Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:16.084982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:16.084991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896718922107865:8011]
2025-09-30T14:58:16.085038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:16.085050Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:16.085226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:16.085387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:16.085542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:16.085679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:16.085885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:16.085930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:16.091465Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2842 sessionId: src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:16.094220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:16.094449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.094475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.094513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:16.094593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:16.095987Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:16.096003Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:16.096006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:16.096008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:16.096018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896718922107865:8011]
2025-09-30T14:58:16.096023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896718922107865:8011]
2025-09-30T14:58:16.096027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896718922107865:8011]
2025-09-30T14:58:16.096065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:16.096072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:16.096078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.096078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:16.096080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:16.096082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:16.096228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:16.143055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896719011902237:6545]
2025-09-30T14:58:16.143347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2841, pipe: [1:7555896719011902237:6545]
2025-09-30T14:58:16.208816Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:16.217583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.217632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.217806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:16.217878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:16.217956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:16.218029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:16.218596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:16.218610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:16.218683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:16.218748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:16.218823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:16.218890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:16.218939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:16.218946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:16.219012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:16.219079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:16.219141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:16.219209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:16.219268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:16.219276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:16.219352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:16.219427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:16.219496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:16.219567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:16.219612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:16.219619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:16.219696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:16.219767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:16.219847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:16.219924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:16.219972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:16.219980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:16.220051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:16.220145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:16.220226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:16.220320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:16.220368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:16.220376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:16.220457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:16.220522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:16.220605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:16.220683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:16.220732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:16.220740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:16.220809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:16.220885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:16.220948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:16.221013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:16.221056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:16.221064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:16.221135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:16.221197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:16.221264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:16.221330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:16.221382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:16.221386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:16.221452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:16.221517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:16.221586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:16.221654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:16.221697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:16.221706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:16.221773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011902237:6545], now have 1 active actors on pipe
2025-09-30T14:58:16.222336Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:16.222350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896719011902237:6545]
2025-09-30T14:58:16.222354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:16.222359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:16.222386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2842 reason: error at write: Disconnected sessionId: src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0
2025-09-30T14:58:16.222391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:16.222574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2842 sessionId: src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0 is DEAD
2025-09-30T14:58:16.222710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:16.222719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0] Write session will restart in 0.007370s
2025-09-30T14:58:16.222743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0] Write session: Do CDS request
2025-09-30T14:58:16.222748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:16.231806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:16.231886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:16.231903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2843
2025-09-30T14:58:16.232037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2843 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:16.232070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2843 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:16.232080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2843 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:16.232088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:16.232544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2843 sessionId:  describe result for acl check
2025-09-30T14:58:16.232582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:16.232584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:16.232587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:16.232593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896719011902286:6998] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:16.233159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896719011902286:6998] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:16.236005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896719011902286:6998] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:16.239082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:16.239184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896719011902286:6998] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:16.239202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896719011902286:6998] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:16.239208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896719011902286:6998] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:16.239216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2843 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:16.242994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:16.243212Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:16.243225Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:16.243236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:16.243307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:16.243359Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896718922108053:8009]
2025-09-30T14:58:16.244033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:16.244338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:16.244397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:16.244729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:16.244784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.244792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.244793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.244795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.244796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.244797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.244798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.244800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.244801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.244803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.244804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.244805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.244806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.244808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.244809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.244814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.244824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.244829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.244834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.244838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.244842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.244855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.244860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.244864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.244869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.244873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.244877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.244881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.244885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.244888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.244896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.244903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.244910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.244915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.244922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.244928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.244932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.244938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.244942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.244953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.244958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.244969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.244974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.244979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.244988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.244994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.245006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.245010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.245014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.245019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.245023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.245029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.245033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.245039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.245044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.245049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.245053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.245059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.245064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.245071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.245125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:16.250408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:16.251526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:16.251539Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:16.251541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:16.251546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:16.251552Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2842 [2:7555896718922108053:8009]
2025-09-30T14:58:16.251568Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:16.251584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:16.251592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:16.251596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:16.251598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:16.251616Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:16.251626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:16.251635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:16.251694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.251700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.251702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.251706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:16.251709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:16.251774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:16.251783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.251795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.251808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.251825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:16.251848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011902240:2454], now have 1 active actors on pipe
2025-09-30T14:58:16.251856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011902420:6998], now have 1 active actors on pipe
2025-09-30T14:58:16.251863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896718922108047:8009]
2025-09-30T14:58:16.251865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896718922108047:8009]
2025-09-30T14:58:16.251868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896718922108047:8009]
2025-09-30T14:58:16.251880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:16.251893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:16.251896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:16.251899Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:16.251901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:16.251912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:16.251916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:16.251909Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2842
2025-09-30T14:58:16.251921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2842
2025-09-30T14:58:16.251946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896718922108047:8009]
2025-09-30T14:58:16.251956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:16.251959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:16.251985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.251994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.252024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:16.252036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:16.252040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:16.252042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:16.252053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:16.252066Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:16.252086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:16.252235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.252242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.252253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:16.252383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2843 partition: 0 MaxSeqNo: 42 sessionId: src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0
2025-09-30T14:58:16.252739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e52c1591-86bd92c9-1c8f6fac-687026a5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:16.255478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0] Write session: try to update token
2025-09-30T14:58:16.255497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:16.264314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:16.264347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:16.264350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:16.264354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:16.264367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896718922108047:8009]
2025-09-30T14:58:16.264373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896718922108047:8009]
2025-09-30T14:58:16.264381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896718922108047:8009]
2025-09-30T14:58:16.264437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:16.264447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:16.264455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:16.264459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.264459Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:16.264463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:16.264702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:16.270076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2843 sessionId: src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:16.272743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:16.322763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896719011902436:6545]
2025-09-30T14:58:16.322993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2842, pipe: [1:7555896719011902436:6545]
2025-09-30T14:58:16.375170Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:16.375718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.375738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.375775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011902436:6545], now have 1 active actors on pipe
2025-09-30T14:58:16.376004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:16.376053Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:16.376039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896719011902436:6545]
2025-09-30T14:58:16.376054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:16.376057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:16.376122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2843 reason: error at write: Disconnected sessionId: src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0
2025-09-30T14:58:16.376292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2843 sessionId: src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0 is DEAD
2025-09-30T14:58:16.376455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:16.376467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0] Write session will restart in 0.008548s
2025-09-30T14:58:16.376491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0] Write session: Do CDS request
2025-09-30T14:58:16.376497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:16.385748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:16.385861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:16.385888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2844
2025-09-30T14:58:16.386017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2844 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:16.386051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2844 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:16.386061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2844 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:16.386064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:16.386486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2844 sessionId:  describe result for acl check
2025-09-30T14:58:16.386530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:16.386537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:16.386539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:16.386544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896719011902480:6999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:16.387107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896719011902480:6999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:16.389910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896719011902480:6999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:16.392575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896719011902480:6999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:16.392592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896719011902480:6999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:16.392595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896719011902480:6999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:16.392604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2844 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:16.392735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:16.397307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:16.397538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:16.397548Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:16.397558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:16.397612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:16.397663Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896718922108248:8006]
2025-09-30T14:58:16.398191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:16.398507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:16.398541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:16.398795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:16.398842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.398849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.398850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.398852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.398853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.398854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.398856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.398857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.398858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.398860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.398861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.398862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.398863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.398865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.398866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.398871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.398883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.398887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.398891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.398895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.398899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.398904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.398909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.398914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.398921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.398925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.398929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.398932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.398937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.398940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.398948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.398957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.398964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.398971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.398977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.398984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.398988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.398993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.398999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.399005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.399011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.399022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.399027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.399034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.399043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.399049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.399058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.399064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.399072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.399078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.399100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.399105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.399109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.399113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.399118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.399123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.399127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.399131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.399136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.399141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.399182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:16.404911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:16.405808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:16.405827Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:16.405831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:16.405836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:16.405843Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2843 [2:7555896718922108248:8006]
2025-09-30T14:58:16.405863Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:16.405883Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:16.405891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:16.405895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:16.405897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:16.405915Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:16.405927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:16.405934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:16.406001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.406010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.406012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.406016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:16.406019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:16.406090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:16.406097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.406111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.406129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.406151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:16.406174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011902441:2454], now have 1 active actors on pipe
2025-09-30T14:58:16.406182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011902621:6999], now have 1 active actors on pipe
2025-09-30T14:58:16.406189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896718922108241:8006]
2025-09-30T14:58:16.406197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896718922108241:8006]
2025-09-30T14:58:16.406199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896718922108241:8006]
2025-09-30T14:58:16.406212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:16.406229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:16.406227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:16.406232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:16.406235Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:16.406248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:16.406251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:16.406291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896718922108241:8006]
2025-09-30T14:58:16.406304Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:16.406312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:16.406282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2843
2025-09-30T14:58:16.406282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2843
2025-09-30T14:58:16.406346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.406355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.406385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:16.406399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:16.406404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:16.406406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:16.406415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:16.406424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:16.406444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:16.406596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.406614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.406640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:16.406737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2844 partition: 0 MaxSeqNo: 42 sessionId: src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0
2025-09-30T14:58:16.407097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f5836a5-4b358cd2-8d7debc8-99924425_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:16.410078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0] Write session: try to update token
2025-09-30T14:58:16.410104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:16.418642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:16.418662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:16.418664Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:16.418667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:16.418676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896718922108241:8006]
2025-09-30T14:58:16.418681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896718922108241:8006]
2025-09-30T14:58:16.418685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896718922108241:8006]
2025-09-30T14:58:16.418727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:16.418733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.418734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:16.418737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:16.418740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:16.418744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:16.418877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:16.426083Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2844 sessionId: src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:16.428929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:16.476693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896719011902633:6545]
2025-09-30T14:58:16.477028Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2843, pipe: [1:7555896719011902633:6545]
2025-09-30T14:58:16.532676Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:16.533035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.533050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.533069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011902633:6545], now have 1 active actors on pipe
2025-09-30T14:58:16.533290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:16.533354Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:16.533370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:16.533378Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:16.533433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2844 reason: error at write: Disconnected sessionId: src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0
2025-09-30T14:58:16.533444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896719011902633:6545]
2025-09-30T14:58:16.533610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2844 sessionId: src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0 is DEAD
2025-09-30T14:58:16.533747Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:16.533760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0] Write session will restart in 0.007232s
2025-09-30T14:58:16.533783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0] Write session: Do CDS request
2025-09-30T14:58:16.533794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:16.541762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:16.541866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:16.541885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2845
2025-09-30T14:58:16.542024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2845 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:16.542068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2845 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:16.542079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2845 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:16.542084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:16.542582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2845 sessionId:  describe result for acl check
2025-09-30T14:58:16.542635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:16.542643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:16.542645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:16.542650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896719011902680:7004] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:16.543168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896719011902680:7004] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:16.545845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896719011902680:7004] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:16.548627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896719011902680:7004] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:16.548644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896719011902680:7004] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:16.548648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896719011902680:7004] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:16.548656Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2845 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:16.548812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:16.553008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:16.553273Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:16.553283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:16.553293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:16.553345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:16.553386Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896718922108431:8004]
2025-09-30T14:58:16.554042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:16.554368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:16.554409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:16.554724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:16.554780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.554786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.554787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.554788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.554789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.554791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.554792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.554793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.554794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.554796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.554797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.554798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.554800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.554801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.554802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.554807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.554816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.554821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.554824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.554827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.554831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.554834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.554838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.554841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.554846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.554849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.554852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.554856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.554859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.554863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.554871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.554878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.554884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.554894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.554902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.554911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.554917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.554926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.554935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.554940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.554949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.554958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.554968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.554976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.554985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.554989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.554997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.555002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.555010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.555014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.555023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.555031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.555037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.555046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.555051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.555060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.555064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.555069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.555073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.555078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.555121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:16.560431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:16.561348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:16.561366Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:16.561369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:16.561374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:16.561381Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2844 [2:7555896718922108431:8004]
2025-09-30T14:58:16.561400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:16.561416Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:16.561420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:16.561423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:16.561426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:16.561441Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:16.561453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:16.561460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:16.561528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.561536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.561538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.561542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:16.561545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:16.561614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:16.561622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.561634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.561645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.561665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:16.561688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011902828:7004], now have 1 active actors on pipe
2025-09-30T14:58:16.561696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011902647:2454], now have 1 active actors on pipe
2025-09-30T14:58:16.561703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896718922108425:8004]
2025-09-30T14:58:16.561705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896718922108425:8004]
2025-09-30T14:58:16.561708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896718922108425:8004]
2025-09-30T14:58:16.561720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:16.561734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:16.561740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:16.561745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:16.561748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:16.561755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:16.561759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:16.561789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896718922108425:8004]
2025-09-30T14:58:16.561798Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:16.561800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:16.561765Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2844
2025-09-30T14:58:16.561768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2844
2025-09-30T14:58:16.561825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.561835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.561872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:16.561885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:16.561893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:16.561895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:16.561906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:16.561920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:16.561945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:16.562112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.562127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.562143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:16.562248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2845 partition: 0 MaxSeqNo: 42 sessionId: src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0
2025-09-30T14:58:16.562610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0736574-c2d78ea3-7343a6fd-e311b55c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:16.565496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0] Write session: try to update token
2025-09-30T14:58:16.565518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:16.574039Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:16.574061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:16.574064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:16.574065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:16.574074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896718922108425:8004]
2025-09-30T14:58:16.574082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896718922108425:8004]
2025-09-30T14:58:16.574086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896718922108425:8004]
2025-09-30T14:58:16.574125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:16.574124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:16.574130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:16.574133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:16.574137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.574140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:16.574292Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:16.580074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2845 sessionId: src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:16.582753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:16.633586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896719011902840:6545]
2025-09-30T14:58:16.633882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2844, pipe: [1:7555896719011902840:6545]
2025-09-30T14:58:16.685798Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:16.686426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.686444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.686486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011902840:6545], now have 1 active actors on pipe
2025-09-30T14:58:16.686721Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:16.686787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:16.686797Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:16.686806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:16.686845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896719011902840:6545]
2025-09-30T14:58:16.686869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2845 reason: error at write: Disconnected sessionId: src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0
2025-09-30T14:58:16.687057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2845 sessionId: src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0 is DEAD
2025-09-30T14:58:16.687240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:16.687270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0] Write session will restart in 0.008523s
2025-09-30T14:58:16.687294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0] Write session: Do CDS request
2025-09-30T14:58:16.687300Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:16.696818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:16.696881Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:16.696900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2846
2025-09-30T14:58:16.697056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2846 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:16.697089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2846 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:16.697102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2846 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:16.697107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:16.697700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2846 sessionId:  describe result for acl check
2025-09-30T14:58:16.697737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:16.697744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:16.697745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:16.697752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896719011902913:7018] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:16.698299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896719011902913:7018] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:16.700710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896719011902913:7018] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:16.701783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:16.705744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:16.705932Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:16.705941Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:16.705948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:16.705986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:16.706019Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896718922108617:8003]
2025-09-30T14:58:16.706069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896719011902913:7018] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:16.706082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896719011902913:7018] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:16.706085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896719011902913:7018] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:16.706092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2846 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:16.706494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:16.706745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:16.706780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:16.707010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:16.707056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.707063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.707064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.707065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.707066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.707067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.707068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.707070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.707071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.707072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.707073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.707074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.707076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.707077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.707077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.707083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.707093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.707098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.707102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.707104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.707107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.707109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.707112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.707114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.707117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.707119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.707122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.707124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.707126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.707129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.707134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.707141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.707146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.707151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.707155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.707159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.707164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.707168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.707173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.707178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.707182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.707187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.707192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.707197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.707201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.707206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.707211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.707215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.707220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.707225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.707229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.707236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.707258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.707264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.707270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.707276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.707280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.707285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.707290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.707296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.707335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:16.712779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:16.713713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:16.713729Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:16.713732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:16.713736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:16.713744Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2845 [2:7555896718922108617:8003]
2025-09-30T14:58:16.713761Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:16.713782Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:16.713789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:16.713792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:16.713795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:16.713810Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:16.713821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:16.713828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:16.713884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.713891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.713893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.713897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:16.713900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:16.713965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:16.713972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.713985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.714002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.714024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:16.714048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011903026:7018], now have 1 active actors on pipe
2025-09-30T14:58:16.714058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011902841:2454], now have 1 active actors on pipe
2025-09-30T14:58:16.714064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896718922108612:8003]
2025-09-30T14:58:16.714066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896718922108612:8003]
2025-09-30T14:58:16.714069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896718922108612:8003]
2025-09-30T14:58:16.714082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:16.714095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:16.714099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:16.714105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:16.714107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:16.714115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:16.714118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:16.714152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896718922108612:8003]
2025-09-30T14:58:16.714123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2845
2025-09-30T14:58:16.714160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:16.714134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2845
2025-09-30T14:58:16.714163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:16.714192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.714201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.714236Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:16.714248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:16.714251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:16.714253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:16.714263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:16.714277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:16.714302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:16.714437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.714453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.714477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:16.714548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2846 partition: 0 MaxSeqNo: 42 sessionId: src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0
2025-09-30T14:58:16.714927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a9eee56-b2dd53d6-5293c7eb-49604360_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:16.717492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0] Write session: try to update token
2025-09-30T14:58:16.717513Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:16.726021Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:16.726046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:16.726049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:16.726052Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:16.726064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896718922108612:8003]
2025-09-30T14:58:16.726069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896718922108612:8003]
2025-09-30T14:58:16.726072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896718922108612:8003]
2025-09-30T14:58:16.726107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:16.726113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.726114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:16.726115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:16.726122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:16.726126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:16.726261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:16.731994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2846 sessionId: src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:16.734854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:16.787127Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896719011903039:6545]
2025-09-30T14:58:16.787464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2845, pipe: [1:7555896719011903039:6545]
2025-09-30T14:58:16.819869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:58:16.819890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 16
2025-09-30T14:58:16.836228Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:16.836493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.836507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.836543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011903039:6545], now have 1 active actors on pipe
2025-09-30T14:58:16.836753Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:16.836813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:16.836828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:16.836831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:16.836856Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 16
2025-09-30T14:58:16.836895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896719011903039:6545]
2025-09-30T14:58:16.836901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2846 reason: error at write: Disconnected sessionId: src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0
2025-09-30T14:58:16.837065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2846 sessionId: src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0 is DEAD
2025-09-30T14:58:16.837192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:16.837203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0] Write session will restart in 0.005857s
2025-09-30T14:58:16.837225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0] Write session: Do CDS request
2025-09-30T14:58:16.837241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:16.843807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:16.843897Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:16.843909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2847
2025-09-30T14:58:16.844035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2847 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:16.844061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2847 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:16.844065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2847 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:16.844069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:16.844501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2847 sessionId:  describe result for acl check
2025-09-30T14:58:16.844533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:16.844540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:16.844542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:16.844548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896719011903084:7030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:16.845073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896719011903084:7030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:16.848232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896719011903084:7030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:16.851292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896719011903084:7030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:16.851309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896719011903084:7030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:16.851312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896719011903084:7030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:16.851318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2847 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:16.856446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:16.857112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:16.857265Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:16.857272Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:16.857279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:16.857318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:16.857348Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896718922108805:7992]
2025-09-30T14:58:16.857961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:16.858334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:16.858398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:16.858676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:16.858730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.858736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.858737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.858738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.858739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.858740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.858742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.858743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.858745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.858746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.858748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.858749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.858751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.858752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.858753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.858758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.858769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.858773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.858776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.858780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.858785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.858789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.858794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.858798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.858802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.858807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.858811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.858815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.858819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.858823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.858831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.858840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:16.858847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.858853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:16.858855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.858859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:16.858862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.858865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:16.858869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.858872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:16.858875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.858878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:16.858881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.858884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:16.858889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.858893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:16.858896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.858899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:16.858901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.858905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:16.858907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.858910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.858913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.858916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.858919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.858922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.858925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.858929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:16.858932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.858935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:16.858961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:16.864175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:16.865039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:16.865054Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:16.865056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:16.865059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:16.865064Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2846 [2:7555896718922108805:7992]
2025-09-30T14:58:16.865081Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:16.865099Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:16.865104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:16.865107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:16.865109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:16.865121Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:16.865126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:16.865131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:16.865180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.865185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.865188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.865190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:16.865192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:16.865416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2846
2025-09-30T14:58:16.865420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2846
2025-09-30T14:58:16.865688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:16.865697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.865707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:16.865713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:16.865729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:16.865752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011903250:7030], now have 1 active actors on pipe
2025-09-30T14:58:16.865759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011903069:2454], now have 1 active actors on pipe
2025-09-30T14:58:16.865791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.865802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.865818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896718922108800:7992]
2025-09-30T14:58:16.865821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896718922108800:7992]
2025-09-30T14:58:16.865823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896718922108800:7992]
2025-09-30T14:58:16.865835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:16.865860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:16.865865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:16.865869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:16.865870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:16.865881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:16.865884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:16.865929Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:58:16.865955Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:16.865964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:16.865966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:16.865968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:16.865976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:16.865985Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:16.866020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896718922108800:7992]
2025-09-30T14:58:16.866034Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:16.866039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:16.866050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:16.866144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 20 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:58:16.866174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:58:16.866199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.866208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.866223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:16.866322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2847 partition: 0 MaxSeqNo: 42 sessionId: src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0
2025-09-30T14:58:16.866652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cafe4123-654bf825-e895fd36-a9fd38ff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:16.869445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0] Write session: try to update token
2025-09-30T14:58:16.869466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:16.878245Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:16.878277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:16.878287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896718922108800:7992]
2025-09-30T14:58:16.878328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:16.878331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:16.878516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:16.878662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:16.878816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:16.878969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:16.879278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:16.879330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:16.884137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2847 sessionId: src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:16.887048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:16.887303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:16.887332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:16.887370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:16.887470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:16.889311Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:16.889330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:16.889333Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:16.889334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:16.889344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896718922108800:7992]
2025-09-30T14:58:16.889348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896718922108800:7992]
2025-09-30T14:58:16.889351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896718922108800:7992]
2025-09-30T14:58:16.889394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:16.889404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:16.889404Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:16.889407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:16.889410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:16.889414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:16.889552Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:16.937115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896719011903289:6545]
2025-09-30T14:58:16.937427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2846, pipe: [1:7555896719011903289:6545]
2025-09-30T14:58:17.003400Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:17.012122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.012160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.012343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.012415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.012482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.012550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.013079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.013101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.013178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.013248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.013320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.013403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.013455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.013463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.013541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.013612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.013686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.013759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.013807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.013815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.013886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.013959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.014040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.014114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.014161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.014168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.014238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.014310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.014387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.014460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.014511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.014521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.014591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.014658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.014724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.014799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.014847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.014857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.014929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.015007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.015091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.015166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.015215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.015224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.015313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.015378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.015446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.015522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.015635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.015643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.015715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.015780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.015850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.015987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.016037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.016044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.016121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.016189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.016257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.016329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.016377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.016384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.016451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896719011903289:6545], now have 1 active actors on pipe
2025-09-30T14:58:17.016740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:17.016766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:17.016798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2847 reason: error at write: Disconnected sessionId: src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0
2025-09-30T14:58:17.016879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:17.017127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2847 sessionId: src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0 is DEAD
2025-09-30T14:58:17.017267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:17.017279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0] Write session will restart in 0.007877s
2025-09-30T14:58:17.017314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0] Write session: Do CDS request
2025-09-30T14:58:17.017320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:17.017329Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:17.017345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-09-30T14:58:17.017347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896719011903289:6545]
2025-09-30T14:58:17.026740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.026781Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:17.026799Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2848
2025-09-30T14:58:17.026971Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2848 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.027002Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2848 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:17.027008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2848 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:17.027014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:17.027580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2848 sessionId:  describe result for acl check
2025-09-30T14:58:17.027616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:17.027622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:17.027626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:17.027631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896723306870654:7057] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:17.028138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896723306870654:7057] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:17.030636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896723306870654:7057] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:17.036525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:17.037007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896723306870654:7057] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:17.037024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896723306870654:7057] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:17.037027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896723306870654:7057] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:17.037035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2848 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:17.037208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:17.037420Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:17.037430Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:17.037439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:17.037500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:17.037537Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896723217076326:7978]
2025-09-30T14:58:17.038229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:17.038482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:17.038526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:17.038858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:17.038917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.038923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.038924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.038925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.038926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.038927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.038929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.038930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.038931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.038932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.038933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.038935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.038936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.038937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.038938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.038944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.038954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.038959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.038963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.038967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.038972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.038976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.038980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.038984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.038989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.038993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.038996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.039000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.039004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.039008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.039015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.039023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.039029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.039034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.039039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.039044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.039048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.039054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.039058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.039063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.039068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.039078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.039083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.039092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.039096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.039102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.039111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.039116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.039121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.039130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.039136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.039141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.039146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.039151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.039157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.039167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.039171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.039177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.039185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.039191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.039238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:17.044385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:17.045678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:17.045698Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:17.045701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:17.045704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:17.045710Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2847 [2:7555896723217076326:7978]
2025-09-30T14:58:17.045725Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:17.045739Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:17.045742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.045745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.045747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.045762Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:17.045769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:17.045775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:17.045833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.045840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.045843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.045846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:17.045849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:17.045915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:17.045923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.045934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.045947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.045969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:17.045991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306870591:2454], now have 1 active actors on pipe
2025-09-30T14:58:17.046000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306870776:7057], now have 1 active actors on pipe
2025-09-30T14:58:17.046005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896723217076320:7978]
2025-09-30T14:58:17.046008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896723217076320:7978]
2025-09-30T14:58:17.046010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896723217076320:7978]
2025-09-30T14:58:17.046022Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:17.046035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:17.046038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:17.046047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:17.046049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:17.046052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:17.046055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:17.046085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896723217076320:7978]
2025-09-30T14:58:17.046096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:17.046100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:17.046095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2847
2025-09-30T14:58:17.046108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2847
2025-09-30T14:58:17.046194Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:58:17.046231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.046236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.046257Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|17624159-e4e533c-f07825ae-f6cf0221_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:17.046267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.046271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.046274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:17.046282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.046294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:17.046309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.046361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 21 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:58:17.046395Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:58:17.046448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.046455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.046466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.046544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2848 partition: 0 MaxSeqNo: 42 sessionId: src_id|17624159-e4e533c-f07825ae-f6cf0221_0
2025-09-30T14:58:17.046898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9404da-dea27cc1-71e061bc-18b336f6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|17624159-e4e533c-f07825ae-f6cf0221_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:17.049652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17624159-e4e533c-f07825ae-f6cf0221_0] Write session: try to update token
2025-09-30T14:58:17.049669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17624159-e4e533c-f07825ae-f6cf0221_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:17.057734Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:17.057756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:17.057766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896723217076320:7978]
2025-09-30T14:58:17.057807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:17.057809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:17.057971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:17.058110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:17.058246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:17.058383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:17.058588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:17.058635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:17.067345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2848 sessionId: src_id|17624159-e4e533c-f07825ae-f6cf0221_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:17.068205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:17.068227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:17.068229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:17.068230Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:17.068238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896723217076320:7978]
2025-09-30T14:58:17.068241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896723217076320:7978]
2025-09-30T14:58:17.068244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896723217076320:7978]
2025-09-30T14:58:17.068282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:17.068287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:17.068289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.068291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:17.068293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:17.068305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:17.068426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:17.069995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:17.117364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896723306870790:6545]
2025-09-30T14:58:17.117673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2847, pipe: [1:7555896723306870790:6545]
2025-09-30T14:58:17.173708Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:17.174217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.174231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.174250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306870790:6545], now have 1 active actors on pipe
2025-09-30T14:58:17.174465Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:17.174502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:17.174507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:17.174511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:17.174564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896723306870790:6545]
2025-09-30T14:58:17.174790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2848 reason: error at write: Disconnected sessionId: src_id|17624159-e4e533c-f07825ae-f6cf0221_0
2025-09-30T14:58:17.174969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2848 sessionId: src_id|17624159-e4e533c-f07825ae-f6cf0221_0 is DEAD
2025-09-30T14:58:17.175135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17624159-e4e533c-f07825ae-f6cf0221_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:17.175146Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17624159-e4e533c-f07825ae-f6cf0221_0] Write session will restart in 0.008150s
2025-09-30T14:58:17.175170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17624159-e4e533c-f07825ae-f6cf0221_0] Write session: Do CDS request
2025-09-30T14:58:17.175175Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17624159-e4e533c-f07825ae-f6cf0221_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:17.184720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|17624159-e4e533c-f07825ae-f6cf0221_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.184829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:17.184856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2849
2025-09-30T14:58:17.184998Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2849 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.185033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2849 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:17.185038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2849 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:17.185043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:17.185477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2849 sessionId:  describe result for acl check
2025-09-30T14:58:17.185521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:17.185528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:17.185530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:17.185536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896723306870893:7064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:17.186060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896723306870893:7064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:17.187880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896723306870893:7064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:17.193646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:17.193682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896723306870893:7064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:17.193700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896723306870893:7064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:17.193704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896723306870893:7064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:17.193712Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2849 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:17.194199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:17.194368Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:17.194375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:17.194383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:17.194450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:17.194494Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896723217076518:7968]
2025-09-30T14:58:17.195122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:17.195435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:17.195473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:17.195775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:17.195837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.195843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.195844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.195845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.195846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.195847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.195848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.195849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.195850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.195851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.195853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.195854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.195855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.195856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.195857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.195863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.195873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.195877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.195880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.195883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.195888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.195891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.195894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.195897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.195901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.195905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.195908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.195911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.195914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.195919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.195927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.195935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.195941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.195947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.195951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.195956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.195960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.195964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.195969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.195974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.195978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.195983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.195987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.195992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.195995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.196000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.196007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.196013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.196017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.196021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.196027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.196033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.196037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.196042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.196048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.196053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.196058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.196063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.196073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.196078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.196127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:17.201388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:17.202623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:17.202641Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:17.202643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:17.202648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:17.202655Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2848 [2:7555896723217076518:7968]
2025-09-30T14:58:17.202670Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:17.202684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:17.202692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.202696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.202698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.202714Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:17.202725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:17.202732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:17.202806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.202813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.202815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.202819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:17.202822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:17.202901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:17.202908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.202921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.202936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.202956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:17.202979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306870980:7064], now have 1 active actors on pipe
2025-09-30T14:58:17.202987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306870795:2454], now have 1 active actors on pipe
2025-09-30T14:58:17.202993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896723217076512:7968]
2025-09-30T14:58:17.203000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896723217076512:7968]
2025-09-30T14:58:17.203002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896723217076512:7968]
2025-09-30T14:58:17.203016Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:17.203032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:17.203037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:17.203041Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:17.203043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:17.203050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:17.203053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:17.203064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2848
2025-09-30T14:58:17.203067Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2848
2025-09-30T14:58:17.203086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896723217076512:7968]
2025-09-30T14:58:17.203095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:17.203097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:17.203120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.203125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.203158Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96640e70-b2f0f248-834767e1-586b9e15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:17.203171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.203175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.203176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:17.203185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.203193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:17.203215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.203423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.203431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.203444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.203520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2849 partition: 0 MaxSeqNo: 42 sessionId: src_id|96640e70-b2f0f248-834767e1-586b9e15_0
2025-09-30T14:58:17.203899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|17624159-e4e533c-f07825ae-f6cf0221_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96640e70-b2f0f248-834767e1-586b9e15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:17.206499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96640e70-b2f0f248-834767e1-586b9e15_0] Write session: try to update token
2025-09-30T14:58:17.206517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96640e70-b2f0f248-834767e1-586b9e15_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:17.215096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:17.215119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:17.215122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:17.215124Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:17.215135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896723217076512:7968]
2025-09-30T14:58:17.215139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896723217076512:7968]
2025-09-30T14:58:17.215143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896723217076512:7968]
2025-09-30T14:58:17.215181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:17.215188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.215191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:17.215192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:17.215198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:17.215203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:17.215353Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:17.220418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2849 sessionId: src_id|96640e70-b2f0f248-834767e1-586b9e15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:17.223070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:17.274557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896723306870994:6545]
2025-09-30T14:58:17.274793Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2848, pipe: [1:7555896723306870994:6545]
2025-09-30T14:58:17.323835Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:17.324239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.324254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.324287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306870994:6545], now have 1 active actors on pipe
2025-09-30T14:58:17.324476Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:17.324546Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:17.324573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:17.324598Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896723306870994:6545]
2025-09-30T14:58:17.324681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2849 reason: status is not ok: tablet will be restarted right now sessionId: src_id|96640e70-b2f0f248-834767e1-586b9e15_0
2025-09-30T14:58:17.324877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2849 sessionId: src_id|96640e70-b2f0f248-834767e1-586b9e15_0 is DEAD
2025-09-30T14:58:17.325038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96640e70-b2f0f248-834767e1-586b9e15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:17.325046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96640e70-b2f0f248-834767e1-586b9e15_0] Write session will restart in 0.006738s
2025-09-30T14:58:17.325070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96640e70-b2f0f248-834767e1-586b9e15_0] Write session: Do CDS request
2025-09-30T14:58:17.325075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96640e70-b2f0f248-834767e1-586b9e15_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:17.332793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96640e70-b2f0f248-834767e1-586b9e15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.332880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:17.332898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2850
2025-09-30T14:58:17.333057Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2850 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.333117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2850 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:17.333127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2850 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:17.333132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:17.333596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2850 sessionId:  describe result for acl check
2025-09-30T14:58:17.333625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:17.333633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:17.333635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:17.333643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896723306871021:7069] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:17.334216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896723306871021:7069] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:17.336914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896723306871021:7069] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:17.339821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896723306871021:7069] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:17.339836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896723306871021:7069] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:17.339839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896723306871021:7069] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:17.339845Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2850 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:17.340582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:17.344629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:17.344866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:17.344878Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:17.344889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:17.344943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:17.344984Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896723217076720:7961]
2025-09-30T14:58:17.345499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:17.345792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:17.345866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:17.346166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:17.346218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.346223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.346224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.346225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.346225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.346226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.346227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.346228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.346229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.346229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.346230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.346231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.346232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.346233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.346234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.346238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.346245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.346247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.346250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.346252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.346255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.346257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.346259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.346262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.346265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.346267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.346269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.346272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.346274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.346276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.346282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.346288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.346293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.346296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.346299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.346303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.346306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.346309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.346320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.346323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.346326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.346329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.346332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.346335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.346338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.346341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.346344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.346347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.346350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.346353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.346356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.346359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.346362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.346368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.346372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.346378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.346382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.346388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.346392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.346395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.346422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:17.351983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:17.352912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:17.352931Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:17.352934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:17.352939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:17.352948Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2849 [2:7555896723217076720:7961]
2025-09-30T14:58:17.352965Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:17.352984Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:17.352987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.352991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.352993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.353009Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:17.353015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:17.353022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:17.353084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.353093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.353096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.353100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:17.353102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:17.353171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:17.353178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.353192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.353210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.353232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:17.353249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306871184:7069], now have 1 active actors on pipe
2025-09-30T14:58:17.353258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306870999:2454], now have 1 active actors on pipe
2025-09-30T14:58:17.353264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896723217076715:7961]
2025-09-30T14:58:17.353267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896723217076715:7961]
2025-09-30T14:58:17.353270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896723217076715:7961]
2025-09-30T14:58:17.353283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:17.353298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:17.353302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:17.353316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:17.353319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:17.353322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:17.353324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:17.353355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896723217076715:7961]
2025-09-30T14:58:17.353370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:17.353375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:17.353358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2849
2025-09-30T14:58:17.353409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.353418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.353444Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:17.353456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.353460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.353462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:17.353472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.353487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:17.353510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.353494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2849
2025-09-30T14:58:17.353632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.353639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.353651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.353749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2850 partition: 0 MaxSeqNo: 42 sessionId: src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0
2025-09-30T14:58:17.354142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96640e70-b2f0f248-834767e1-586b9e15_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:17.357041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0] Write session: try to update token
2025-09-30T14:58:17.357065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:17.366078Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:17.366101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:17.366103Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:17.366105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:17.366115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896723217076715:7961]
2025-09-30T14:58:17.366118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896723217076715:7961]
2025-09-30T14:58:17.366122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896723217076715:7961]
2025-09-30T14:58:17.366165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:17.366173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.366173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:17.366175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:17.366180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:17.366184Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:17.366324Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:17.371848Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2850 sessionId: src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:17.374653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:17.424561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896723306871200:6545]
2025-09-30T14:58:17.424878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2849, pipe: [1:7555896723306871200:6545]
2025-09-30T14:58:17.476670Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:17.476941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.476961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.476998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306871200:6545], now have 1 active actors on pipe
2025-09-30T14:58:17.477177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:17.477274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896723306871200:6545]
2025-09-30T14:58:17.477280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:17.477285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:17.477310Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:17.477359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2850 reason: error at write: Disconnected sessionId: src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0
2025-09-30T14:58:17.477530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2850 sessionId: src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0 is DEAD
2025-09-30T14:58:17.477680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:17.477691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0] Write session will restart in 0.008830s
2025-09-30T14:58:17.477713Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0] Write session: Do CDS request
2025-09-30T14:58:17.477718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:17.487743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.487858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:17.487876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2851
2025-09-30T14:58:17.488029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2851 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.488074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2851 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:17.488086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2851 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:17.488090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:17.488569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2851 sessionId:  describe result for acl check
2025-09-30T14:58:17.488608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:17.488617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:17.488621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:17.488628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896723306871291:7070] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:17.489170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896723306871291:7070] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:17.491007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896723306871291:7070] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:17.497361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896723306871291:7070] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:17.497378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896723306871291:7070] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:17.497395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896723306871291:7070] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:17.497404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2851 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:17.497444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:17.498067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:17.498252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:17.498261Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:17.498271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:17.498322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:17.498363Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896723217076911:7959]
2025-09-30T14:58:17.498962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:17.499274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:17.499314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:17.499630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:17.499684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.499689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.499690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.499691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.499692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.499693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.499694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.499694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.499695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.499696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.499697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.499697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.499698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.499699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.499700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.499704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.499710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.499713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.499715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.499718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.499720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.499723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.499725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.499728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.499730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.499733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.499735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.499737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.499741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.499746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.499752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.499760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.499766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.499770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.499773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.499777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.499779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.499782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.499788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.499791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.499794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.499797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.499800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.499803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.499805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.499808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.499811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.499814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.499817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.499820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.499822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.499826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.499828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.499831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.499834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.499836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.499839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.499842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.499845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.499848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.499872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:17.505321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:17.506509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:17.506526Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:17.506529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:17.506533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:17.506540Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2850 [2:7555896723217076911:7959]
2025-09-30T14:58:17.506557Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:17.506573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:17.506577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.506580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.506585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.506600Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:17.506613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:17.506620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:17.506685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.506692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.506695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.506698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:17.506700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:17.506768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:17.506780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.506792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.506805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.506823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:17.506848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306871201:2454], now have 1 active actors on pipe
2025-09-30T14:58:17.506856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306871401:7070], now have 1 active actors on pipe
2025-09-30T14:58:17.506863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896723217076905:7959]
2025-09-30T14:58:17.506865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896723217076905:7959]
2025-09-30T14:58:17.506867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896723217076905:7959]
2025-09-30T14:58:17.506881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:17.506895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:17.506896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:17.506898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:17.506900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:17.506913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:17.506917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:17.506944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896723217076905:7959]
2025-09-30T14:58:17.506956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:17.506961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:17.506966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2850
2025-09-30T14:58:17.507000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2850
2025-09-30T14:58:17.507060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.507070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.507100Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc0251c5-649c767f-69668015-a6717cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:17.507110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.507115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.507117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:17.507125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.507142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:17.507157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.507464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.507481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.507504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.507622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2851 partition: 0 MaxSeqNo: 42 sessionId: src_id|fc0251c5-649c767f-69668015-a6717cf_0
2025-09-30T14:58:17.507963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aadbccd3-7b075ad9-b2903443-a5b3cf85_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fc0251c5-649c767f-69668015-a6717cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:17.510914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0251c5-649c767f-69668015-a6717cf_0] Write session: try to update token
2025-09-30T14:58:17.510939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0251c5-649c767f-69668015-a6717cf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:17.519558Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:17.519588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:17.519591Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:17.519593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:17.519606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896723217076905:7959]
2025-09-30T14:58:17.519611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896723217076905:7959]
2025-09-30T14:58:17.519615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896723217076905:7959]
2025-09-30T14:58:17.519659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:17.519666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.519669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:17.519687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:17.519702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:17.519710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:17.519830Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:17.525265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2851 sessionId: src_id|fc0251c5-649c767f-69668015-a6717cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:17.527930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:17.577628Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896723306871413:6545]
2025-09-30T14:58:17.577827Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2850, pipe: [1:7555896723306871413:6545]
2025-09-30T14:58:17.627341Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:17.627652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.627667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.627709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306871413:6545], now have 1 active actors on pipe
2025-09-30T14:58:17.627897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:17.627921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:17.627936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:17.627965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896723306871413:6545]
2025-09-30T14:58:17.627986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:17.628005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2851 reason: error at write: Disconnected sessionId: src_id|fc0251c5-649c767f-69668015-a6717cf_0
2025-09-30T14:58:17.628172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2851 sessionId: src_id|fc0251c5-649c767f-69668015-a6717cf_0 is DEAD
2025-09-30T14:58:17.628337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0251c5-649c767f-69668015-a6717cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:17.628348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0251c5-649c767f-69668015-a6717cf_0] Write session will restart in 0.008410s
2025-09-30T14:58:17.628373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0251c5-649c767f-69668015-a6717cf_0] Write session: Do CDS request
2025-09-30T14:58:17.628383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0251c5-649c767f-69668015-a6717cf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:17.637717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0251c5-649c767f-69668015-a6717cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.637864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:17.637879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2852
2025-09-30T14:58:17.637985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2852 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.638016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2852 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:17.638026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2852 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:17.638031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:17.638438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2852 sessionId:  describe result for acl check
2025-09-30T14:58:17.638472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:17.638474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:17.638476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:17.638482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896723306871512:7084] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:17.639017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896723306871512:7084] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:17.640916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896723306871512:7084] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:17.646139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:17.646466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896723306871512:7084] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:17.646483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896723306871512:7084] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:17.646487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896723306871512:7084] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:17.646495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2852 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:17.646603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:17.646762Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:17.646771Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:17.646779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:17.646821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:17.646856Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896723217077105:7948]
2025-09-30T14:58:17.647334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:17.647551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:17.647579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:17.647814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:17.647857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.647862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.647863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.647864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.647865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.647865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.647866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.647867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.647868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.647869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.647870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.647871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.647872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.647872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.647873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.647877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.647883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.647886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.647888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.647891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.647893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.647895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.647897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.647900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.647903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.647905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.647907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.647909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.647912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.647914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.647921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.647925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.647929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.647933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.647936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.647939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.647942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.647945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.647947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.647950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.647953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.647956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.647958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.647961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.647963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.647967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.647970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.647972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.647975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.647978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.647980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.647983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.647985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.647988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.647991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.647994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.647996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.648000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.648002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.648005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.648043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:17.653522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:17.654403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:17.654419Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:17.654422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:17.654426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:17.654432Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2851 [2:7555896723217077105:7948]
2025-09-30T14:58:17.654449Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:17.654472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:17.654479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.654483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.654485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.654500Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:17.654511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:17.654519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:17.654575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.654582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.654585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.654588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:17.654591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:17.654826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2851
2025-09-30T14:58:17.654828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2851
2025-09-30T14:58:17.655160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:17.655169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.655182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.655196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.655220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:17.655259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306871603:7084], now have 1 active actors on pipe
2025-09-30T14:58:17.655270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306871414:2454], now have 1 active actors on pipe
2025-09-30T14:58:17.655286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.655290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.655309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896723217077099:7948]
2025-09-30T14:58:17.655311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896723217077099:7948]
2025-09-30T14:58:17.655313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896723217077099:7948]
2025-09-30T14:58:17.655327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:17.655341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:17.655345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:17.655349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:17.655351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:17.655360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:17.655363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:17.655377Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:17.655384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.655390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.655392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:17.655402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.655411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:17.655447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896723217077099:7948]
2025-09-30T14:58:17.655460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:17.655466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:17.655470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.655627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.655637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.655661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.655755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2852 partition: 0 MaxSeqNo: 42 sessionId: src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0
2025-09-30T14:58:17.656113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc0251c5-649c767f-69668015-a6717cf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:17.658837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0] Write session: try to update token
2025-09-30T14:58:17.658864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:17.672601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2852 sessionId: src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:17.673181Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:17.673202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:17.673211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896723217077099:7948]
2025-09-30T14:58:17.673256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:17.673263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:17.673445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:17.673602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:17.673743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:17.673895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:17.674104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:17.674148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:17.675216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:17.675429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.675448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.675480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:17.675564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:17.678847Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:17.678864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:17.678867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:17.678869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:17.678879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896723217077099:7948]
2025-09-30T14:58:17.678882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896723217077099:7948]
2025-09-30T14:58:17.678886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896723217077099:7948]
2025-09-30T14:58:17.678924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:17.678930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:17.678935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.678935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:17.678938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:17.678939Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:17.679070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:17.728192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896723306871615:6545]
2025-09-30T14:58:17.728463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2851, pipe: [1:7555896723306871615:6545]
2025-09-30T14:58:17.787049Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:17.794287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.794318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.794471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.794528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.794583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.794644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.794695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.794704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.794779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.794839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.794899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.794959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.795004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.795011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.795074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.795126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.795184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.795264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.795308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.795314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.795377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.795435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.795493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.795555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.795596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.795603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.795665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.795723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.795782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.795842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.795883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.795889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.795953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.796025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.796084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.796143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.796185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.796191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.796252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.796310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.796371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.796437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.796540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.796548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.796611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.796669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.796730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.796801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.796857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.796863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.796924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.796977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.797035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.797094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.797136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.797142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.797206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:17.797272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:17.797340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:17.797409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:17.797452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:17.797459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:17.797512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306871615:6545], now have 1 active actors on pipe
2025-09-30T14:58:17.797771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896723306871615:6545]
2025-09-30T14:58:17.797778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:17.797782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:17.797802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:17.797813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2852 reason: error at write: Disconnected sessionId: src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0
2025-09-30T14:58:17.798012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2852 sessionId: src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0 is DEAD
2025-09-30T14:58:17.798163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:17.798173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0] Write session will restart in 0.008988s
2025-09-30T14:58:17.798197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0] Write session: Do CDS request
2025-09-30T14:58:17.798203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:17.798481Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:17.808747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.808782Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:17.808796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2853
2025-09-30T14:58:17.808963Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2853 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.809004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2853 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:17.809013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2853 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:17.809019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:17.809386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2853 sessionId:  describe result for acl check
2025-09-30T14:58:17.809417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:17.809418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:17.809420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:17.809424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896723306871726:7091] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:17.809859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896723306871726:7091] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:17.811770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896723306871726:7091] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:17.816411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:17.816623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896723306871726:7091] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:17.816637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896723306871726:7091] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:17.816639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896723306871726:7091] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:17.816646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2853 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:17.816807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:17.817081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:17.817100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:17.817111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:17.817155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:17.817188Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896723217077298:7946]
2025-09-30T14:58:17.817639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:17.817905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:17.817937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:17.818187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:17.818234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.818239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.818240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.818240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.818241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.818242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.818243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.818244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.818245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.818245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.818246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.818247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.818247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.818248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.818249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.818253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.818260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.818262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.818264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.818267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.818269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.818271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.818274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.818276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.818279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.818281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.818284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.818286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.818288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.818291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.818296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.818301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.818305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.818309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.818312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.818315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.818318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.818321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.818324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.818328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.818331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.818334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.818338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.818342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.818344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.818347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.818350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.818353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.818355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.818358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.818360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.818364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.818367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.818370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.818373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.818376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.818378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.818381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.818383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.818386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.818411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:17.823608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:17.824958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:17.824973Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:17.824975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:17.824981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:17.824989Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2852 [2:7555896723217077298:7946]
2025-09-30T14:58:17.825003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:17.825024Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:17.825027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.825031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.825033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.825048Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:17.825055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:17.825067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:17.825137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.825144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.825146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.825150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:17.825153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:17.825222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:17.825230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.825242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.825253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.825273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:17.825295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306871808:7091], now have 1 active actors on pipe
2025-09-30T14:58:17.825303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306871618:2454], now have 1 active actors on pipe
2025-09-30T14:58:17.825310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896723217077292:7946]
2025-09-30T14:58:17.825313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896723217077292:7946]
2025-09-30T14:58:17.825315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896723217077292:7946]
2025-09-30T14:58:17.825326Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:17.825338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:17.825341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:17.825347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:17.825349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:17.825355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:17.825358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:17.825347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2852
2025-09-30T14:58:17.825359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2852
2025-09-30T14:58:17.825388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896723217077292:7946]
2025-09-30T14:58:17.825397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:17.825399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:17.825429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.825438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.825474Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11d94bf1-51237bc3-b4804766-4b069806_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:17.825485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.825489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.825491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:17.825501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.825514Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:17.825531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.825678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.825684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.825698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.825776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2853 partition: 0 MaxSeqNo: 42 sessionId: src_id|11d94bf1-51237bc3-b4804766-4b069806_0
2025-09-30T14:58:17.826123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5efbd0e4-db509f0a-879ef99b-d60fd103_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|11d94bf1-51237bc3-b4804766-4b069806_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:17.828987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11d94bf1-51237bc3-b4804766-4b069806_0] Write session: try to update token
2025-09-30T14:58:17.829009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11d94bf1-51237bc3-b4804766-4b069806_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:17.837404Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:17.837423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:17.837426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:17.837429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:17.837441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896723217077292:7946]
2025-09-30T14:58:17.837445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896723217077292:7946]
2025-09-30T14:58:17.837450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896723217077292:7946]
2025-09-30T14:58:17.837488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:17.837495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.837498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:17.837500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:17.837507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:17.837511Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:17.838028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:17.843190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2853 sessionId: src_id|11d94bf1-51237bc3-b4804766-4b069806_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:17.845908Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:17.898186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896723306871821:6545]
2025-09-30T14:58:17.898485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2852, pipe: [1:7555896723306871821:6545]
2025-09-30T14:58:17.951475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:17.952478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.952498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.952534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306871821:6545], now have 1 active actors on pipe
2025-09-30T14:58:17.952712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:17.952729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:17.952747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:17.952803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2853 reason: error at write: Disconnected sessionId: src_id|11d94bf1-51237bc3-b4804766-4b069806_0
2025-09-30T14:58:17.953024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2853 sessionId: src_id|11d94bf1-51237bc3-b4804766-4b069806_0 is DEAD
2025-09-30T14:58:17.953199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11d94bf1-51237bc3-b4804766-4b069806_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:17.953210Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11d94bf1-51237bc3-b4804766-4b069806_0] Write session will restart in 0.006171s
2025-09-30T14:58:17.953195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896723306871821:6545]
2025-09-30T14:58:17.953231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11d94bf1-51237bc3-b4804766-4b069806_0] Write session: Do CDS request
2025-09-30T14:58:17.953224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:17.953237Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11d94bf1-51237bc3-b4804766-4b069806_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:17.960729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11d94bf1-51237bc3-b4804766-4b069806_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.960803Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:17.960820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2854
2025-09-30T14:58:17.960991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2854 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:17.961016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2854 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:17.961019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2854 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:17.961022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:17.961481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2854 sessionId:  describe result for acl check
2025-09-30T14:58:17.961528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:17.961534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:17.961536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:17.961541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896723306871884:7111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:17.962093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896723306871884:7111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:17.964976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896723306871884:7111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:17.967302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896723306871884:7111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:17.967317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896723306871884:7111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:17.967330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896723306871884:7111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:17.967339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2854 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:17.967619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:17.972150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:17.972431Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:17.972442Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:17.972452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:17.972502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:17.972536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896723217077528:7916]
2025-09-30T14:58:17.973086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:17.973478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:17.973523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:17.973851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:17.973907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.973914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.973915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.973916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.973917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.973919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.973920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.973921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.973922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.973924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.973925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.973926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.973927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.973928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.973930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.973935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.973946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.973950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.973954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.973958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.973963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.973968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.973972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.973976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.973980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.973984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.973989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.973993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.973997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.974001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.974008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.974016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:17.974023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.974028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:17.974033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.974040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:17.974045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.974050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:17.974055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.974060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:17.974064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.974070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:17.974077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.974088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:17.974092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.974098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:17.974108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.974113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:17.974122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.974127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:17.974136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.974141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.974145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.974149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.974158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.974164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.974169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.974178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:17.974183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.974188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:17.974235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:17.979966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:17.981329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:17.981344Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:17.981346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:17.981350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:17.981357Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2853 [2:7555896723217077528:7916]
2025-09-30T14:58:17.981373Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:17.981389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:17.981393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.981396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.981398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.981412Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:17.981419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:17.981426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:17.981486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.981494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.981499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.981502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:17.981504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:17.981575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:17.981582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.981596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:17.981613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:17.981634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:17.981656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306871838:2454], now have 1 active actors on pipe
2025-09-30T14:58:17.981664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896723306872033:7111], now have 1 active actors on pipe
2025-09-30T14:58:17.981671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896723217077523:7916]
2025-09-30T14:58:17.981678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896723217077523:7916]
2025-09-30T14:58:17.981681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896723217077523:7916]
2025-09-30T14:58:17.981693Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:17.981714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:17.981715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:17.981719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:17.981721Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:17.981734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:17.981737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:17.981770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896723217077523:7916]
2025-09-30T14:58:17.981743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2853
2025-09-30T14:58:17.981778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:17.981750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2853
2025-09-30T14:58:17.981781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:17.981805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.981815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.981851Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:17.981862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:17.981866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:17.981869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:17.981879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:17.981886Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:17.981905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.982090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:17.982099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:17.982111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:17.982267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2854 partition: 0 MaxSeqNo: 42 sessionId: src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0
2025-09-30T14:58:17.982585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11d94bf1-51237bc3-b4804766-4b069806_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:17.985341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0] Write session: try to update token
2025-09-30T14:58:17.985359Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:17.994454Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:17.994474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:17.994476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:17.994477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:17.994489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896723217077523:7916]
2025-09-30T14:58:17.994493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896723217077523:7916]
2025-09-30T14:58:17.994495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896723217077523:7916]
2025-09-30T14:58:17.994527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:17.994533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:17.994535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:17.994541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:17.994551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:17.994555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:17.994667Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:18.005582Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2854 sessionId: src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:18.008264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:18.053310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896727601839342:6545]
2025-09-30T14:58:18.053606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2853, pipe: [1:7555896727601839342:6545]
2025-09-30T14:58:18.102607Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:18.102889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.102900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.102916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601839342:6545], now have 1 active actors on pipe
2025-09-30T14:58:18.103164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:18.103170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896727601839342:6545]
2025-09-30T14:58:18.103195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:18.103197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:18.103274Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2854 reason: error at write: Disconnected sessionId: src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0
2025-09-30T14:58:18.103464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2854 sessionId: src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0 is DEAD
2025-09-30T14:58:18.103605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:18.103636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0] Write session will restart in 0.005748s
2025-09-30T14:58:18.103662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0] Write session: Do CDS request
2025-09-30T14:58:18.103667Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:18.103902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:18.110762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:18.110837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:18.110852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2855
2025-09-30T14:58:18.111018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2855 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:18.111049Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2855 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:18.111059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2855 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:18.111063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:18.111510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2855 sessionId:  describe result for acl check
2025-09-30T14:58:18.111542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:18.111550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:18.111552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:18.111557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896727601839374:7133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:18.112068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896727601839374:7133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:18.114600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896727601839374:7133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:18.117572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896727601839374:7133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:18.117585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896727601839374:7133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:18.117589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896727601839374:7133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:18.117597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2855 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:18.123220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:18.123810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:18.123983Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:18.123993Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:18.124001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:18.124039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:18.124069Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896727512045022:7921]
2025-09-30T14:58:18.124593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:18.124885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:18.124928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:18.125152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:18.125191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.125196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.125197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.125197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.125198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.125199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.125200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.125200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.125201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.125202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.125203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.125203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.125204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.125205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.125205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.125209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.125219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.125223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.125228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.125233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.125237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.125241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.125245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.125249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.125251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.125253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.125255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.125258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.125260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.125263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.125268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.125274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.125278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.125281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.125283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.125286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.125289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.125291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.125294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.125297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.125300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.125302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.125307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.125310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.125312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.125315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.125318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.125320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.125323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.125326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.125331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.125336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.125340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.125345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.125350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.125355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.125361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.125364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.125367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.125370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.125407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:18.130701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:18.131606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:18.131628Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:18.131632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:18.131636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:18.131643Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2854 [2:7555896727512045022:7921]
2025-09-30T14:58:18.131661Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:18.131684Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:18.131697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:18.131701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:18.131703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:18.131720Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:18.131736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:18.131749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:18.131827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.131836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.131838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.131842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:18.131845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:18.132012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2854
2025-09-30T14:58:18.132012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2854
2025-09-30T14:58:18.132341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:18.132360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.132375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.132395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.132419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:18.132448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601839541:7133], now have 1 active actors on pipe
2025-09-30T14:58:18.132457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601839352:2454], now have 1 active actors on pipe
2025-09-30T14:58:18.132477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.132488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.132508Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896727512045016:7921]
2025-09-30T14:58:18.132516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896727512045016:7921]
2025-09-30T14:58:18.132518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896727512045016:7921]
2025-09-30T14:58:18.132534Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:18.132555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:18.132559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:18.132560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:18.132561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:18.132578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:18.132582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:18.132598Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:18.132606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:18.132615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:18.132618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:18.132628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:18.132637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:18.132679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896727512045016:7921]
2025-09-30T14:58:18.132692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:18.132698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:18.132704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:18.132875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.132884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.132899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:18.133030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2855 partition: 0 MaxSeqNo: 42 sessionId: src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0
2025-09-30T14:58:18.133396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|48350b79-7c33ed37-ebaeceb1-e1d6039d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:18.136238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0] Write session: try to update token
2025-09-30T14:58:18.136261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:18.151014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:18.151044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:18.151055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896727512045016:7921]
2025-09-30T14:58:18.151109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:18.151112Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:18.151327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:18.151498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:18.151662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:18.151821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:18.152043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:18.152104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:18.152567Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2855 sessionId: src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:18.155533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:18.155757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.155787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.155808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:18.155810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:18.155812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:18.155815Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:18.155822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896727512045016:7921]
2025-09-30T14:58:18.155826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896727512045016:7921]
2025-09-30T14:58:18.155830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896727512045016:7921]
2025-09-30T14:58:18.155873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:18.155876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:18.155883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.155885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:18.155888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:18.155893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:18.156015Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:18.203350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896727601839558:6545]
2025-09-30T14:58:18.203678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2854, pipe: [1:7555896727601839558:6545]
2025-09-30T14:58:18.264457Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:18.265112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:18.265160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601839558:6545], now have 1 active actors on pipe
2025-09-30T14:58:18.265314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:18.265411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896727601839558:6545]
2025-09-30T14:58:18.265414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:18.265416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:18.265445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:18.265485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2855 reason: error at write: Disconnected sessionId: src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0
2025-09-30T14:58:18.265655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2855 sessionId: src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0 is DEAD
2025-09-30T14:58:18.265808Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:18.265819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0] Write session will restart in 0.009310s
2025-09-30T14:58:18.265843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0] Write session: Do CDS request
2025-09-30T14:58:18.265849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:18.276806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:18.276926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:18.276944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2856
2025-09-30T14:58:18.277081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2856 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:18.277112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2856 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:18.277122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2856 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:18.277127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:18.277609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2856 sessionId:  describe result for acl check
2025-09-30T14:58:18.277651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:18.277658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:18.277660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:18.277666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896727601839665:7147] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:18.278181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896727601839665:7147] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:18.280008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896727601839665:7147] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:18.286311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:18.286522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896727601839665:7147] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:18.286542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896727601839665:7147] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:18.286545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896727601839665:7147] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:18.286554Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2856 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:18.286994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:18.287206Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:18.287217Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:18.287229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:18.287295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:18.287340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896727512045230:7914]
2025-09-30T14:58:18.287997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:18.288325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:18.288369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:18.288704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:18.288783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.288790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.288791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.288792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.288794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.288796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.288797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.288799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.288800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.288801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.288802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.288803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.288804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.288805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.288806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.288812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.288821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.288825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.288830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.288834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.288850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.288854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.288859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.288863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.288867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.288871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.288875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.288879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.288884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.288888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.288895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.288903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.288910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.288916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.288921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.288926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.288931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.288936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.288942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.288948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.288953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.288959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.288964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.288969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.288974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.288979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.288984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.288989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.288994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.289000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.289006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.289011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.289016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.289022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.289026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.289032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.289037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.289048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.289055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.289060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.289107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:18.294652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:18.295839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:18.295860Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:18.295864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:18.295868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:18.295876Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2855 [2:7555896727512045230:7914]
2025-09-30T14:58:18.295895Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:18.295912Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:18.295915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:18.295919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:18.295922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:18.295940Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:18.295949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:18.295957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:18.296030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.296047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.296050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.296057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:18.296061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:18.296143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:18.296155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.296170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.296182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.296200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:18.296218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601839756:7147], now have 1 active actors on pipe
2025-09-30T14:58:18.296222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601839561:2454], now have 1 active actors on pipe
2025-09-30T14:58:18.296229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896727512045224:7914]
2025-09-30T14:58:18.296231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896727512045224:7914]
2025-09-30T14:58:18.296233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896727512045224:7914]
2025-09-30T14:58:18.296246Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:18.296260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:18.296266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:18.296273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:18.296276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:18.296280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:18.296283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:18.296324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896727512045224:7914]
2025-09-30T14:58:18.296343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:18.296311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2855
2025-09-30T14:58:18.296360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:18.296318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2855
2025-09-30T14:58:18.296393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.296399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.296451Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|296432ae-d736c327-1146c980-d5c9daec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:18.296467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:18.296472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:18.296474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:18.296484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:18.296496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:18.296516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:18.296691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.296703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.296720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:18.296823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2856 partition: 0 MaxSeqNo: 42 sessionId: src_id|296432ae-d736c327-1146c980-d5c9daec_0
2025-09-30T14:58:18.297232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14aa9d2c-84f04c0b-5045ec7a-58ee704c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|296432ae-d736c327-1146c980-d5c9daec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:18.300504Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|296432ae-d736c327-1146c980-d5c9daec_0] Write session: try to update token
2025-09-30T14:58:18.300533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|296432ae-d736c327-1146c980-d5c9daec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:18.308827Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:18.308871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:18.308874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:18.308876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:18.308892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896727512045224:7914]
2025-09-30T14:58:18.308898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896727512045224:7914]
2025-09-30T14:58:18.308903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896727512045224:7914]
2025-09-30T14:58:18.308951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:18.308959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.308960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:18.308968Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:18.308968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:18.308973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:18.309128Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:18.315574Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2856 sessionId: src_id|296432ae-d736c327-1146c980-d5c9daec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:18.318321Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:18.365660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896727601839772:6545]
2025-09-30T14:58:18.366011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2855, pipe: [1:7555896727601839772:6545]
2025-09-30T14:58:18.431058Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:18.431896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.431918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.431966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601839772:6545], now have 1 active actors on pipe
2025-09-30T14:58:18.432227Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:18.432243Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896727601839772:6545]
2025-09-30T14:58:18.432291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:18.432513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:18.432586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2856 reason: status is not ok: tablet will be restarted right now sessionId: src_id|296432ae-d736c327-1146c980-d5c9daec_0
2025-09-30T14:58:18.432794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2856 sessionId: src_id|296432ae-d736c327-1146c980-d5c9daec_0 is DEAD
2025-09-30T14:58:18.432973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296432ae-d736c327-1146c980-d5c9daec_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 135 BytesWritten: 94617674 MessagesWritten: 42 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 13516812 MessagesInflight: 10 }
2025-09-30T14:58:18.433002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296432ae-d736c327-1146c980-d5c9daec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:18.433007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296432ae-d736c327-1146c980-d5c9daec_0] Write session will restart in 0.005274s
2025-09-30T14:58:18.433029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296432ae-d736c327-1146c980-d5c9daec_0] Write session: Do CDS request
2025-09-30T14:58:18.433035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296432ae-d736c327-1146c980-d5c9daec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:18.439791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|296432ae-d736c327-1146c980-d5c9daec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:18.439871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:18.439902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2857
2025-09-30T14:58:18.440049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2857 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:18.440082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2857 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:18.440092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2857 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:18.440096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:18.440553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2857 sessionId:  describe result for acl check
2025-09-30T14:58:18.440588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:18.440595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:18.440597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:18.440603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896727601839788:7157] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:18.441157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896727601839788:7157] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:18.443503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896727601839788:7157] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:18.447235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896727601839788:7157] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:18.447266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896727601839788:7157] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:18.447270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896727601839788:7157] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:18.447279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2857 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:18.449659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:18.454204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:18.454436Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:18.454448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:18.454461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:18.454524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:18.454572Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896727512045427:7904]
2025-09-30T14:58:18.455277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:18.455627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:18.455693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:18.456018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:18.456090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.456096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.456098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.456099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.456101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.456102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.456103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.456105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.456107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.456108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.456110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.456111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.456112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.456114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.456116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.456124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.456133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.456138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.456143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.456147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.456150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.456155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.456158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.456163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.456168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.456171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.456175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.456180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.456184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.456188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.456199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.456207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.456218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.456224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.456234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.456245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.456254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.456260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.456270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.456280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.456285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.456294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.456300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.456310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.456318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.456324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.456333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.456338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.456347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.456353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.456362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.456372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.456377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.456387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.456395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.456403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.456411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.456417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.456426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.456434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.456485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:18.461903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:18.463142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:18.463158Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:18.463161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:18.463165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:18.463171Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2856 [2:7555896727512045427:7904]
2025-09-30T14:58:18.463186Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:18.463202Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:18.463210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:18.463213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:18.463216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:18.463233Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:18.463259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:18.463266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:18.463323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.463330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.463332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.463336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:18.463338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:18.463399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:18.463406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.463419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.463436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.463461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:18.463525Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2856
2025-09-30T14:58:18.463528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2856
2025-09-30T14:58:18.463479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601839959:7157], now have 1 active actors on pipe
2025-09-30T14:58:18.463489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601839773:2454], now have 1 active actors on pipe
2025-09-30T14:58:18.463495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896727512045422:7904]
2025-09-30T14:58:18.463497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896727512045422:7904]
2025-09-30T14:58:18.463499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896727512045422:7904]
2025-09-30T14:58:18.463512Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:18.463526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:18.463527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:18.463531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:18.463533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:18.463539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:18.463542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:18.463577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896727512045422:7904]
2025-09-30T14:58:18.463580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:18.463587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:18.463595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.463599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.463650Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8e471356-aba4147-bc5ddaed-db71204_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:18.463662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:18.463670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:18.463672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:18.463681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:18.463694Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:18.463717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:18.463892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.463904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.463920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:18.464026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2857 partition: 0 MaxSeqNo: 42 sessionId: src_id|8e471356-aba4147-bc5ddaed-db71204_0
2025-09-30T14:58:18.464412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|296432ae-d736c327-1146c980-d5c9daec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8e471356-aba4147-bc5ddaed-db71204_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:18.467130Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e471356-aba4147-bc5ddaed-db71204_0] Write session: try to update token
2025-09-30T14:58:18.467150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e471356-aba4147-bc5ddaed-db71204_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:18.475600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:18.475622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:18.475625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:18.475626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:18.475633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896727512045422:7904]
2025-09-30T14:58:18.475638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896727512045422:7904]
2025-09-30T14:58:18.475642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896727512045422:7904]
2025-09-30T14:58:18.475683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:18.475689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.475691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:18.475695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:18.475705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:18.475721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:18.475837Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:18.481995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2857 sessionId: src_id|8e471356-aba4147-bc5ddaed-db71204_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:18.484565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:18.532539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896727601839991:6545]
2025-09-30T14:58:18.532887Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2856, pipe: [1:7555896727601839991:6545]
2025-09-30T14:58:18.585795Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:18.586309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.586322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.586339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601839991:6545], now have 1 active actors on pipe
2025-09-30T14:58:18.586551Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:18.586548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:18.586564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896727601839991:6545]
2025-09-30T14:58:18.586585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:18.586587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:18.586640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2857 reason: error at write: Disconnected sessionId: src_id|8e471356-aba4147-bc5ddaed-db71204_0
2025-09-30T14:58:18.586821Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2857 sessionId: src_id|8e471356-aba4147-bc5ddaed-db71204_0 is DEAD
2025-09-30T14:58:18.586965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e471356-aba4147-bc5ddaed-db71204_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:18.586974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e471356-aba4147-bc5ddaed-db71204_0] Write session will restart in 0.008883s
2025-09-30T14:58:18.586991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e471356-aba4147-bc5ddaed-db71204_0] Write session: Do CDS request
2025-09-30T14:58:18.586998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e471356-aba4147-bc5ddaed-db71204_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:18.596785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8e471356-aba4147-bc5ddaed-db71204_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:18.596865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:18.596883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2858
2025-09-30T14:58:18.597000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2858 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:18.597031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2858 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:18.597036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2858 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:18.597040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:18.597455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2858 sessionId:  describe result for acl check
2025-09-30T14:58:18.597489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:18.597491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:18.597492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:18.597497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896727601840070:7172] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:18.597994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896727601840070:7172] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:18.600198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896727601840070:7172] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:18.602826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896727601840070:7172] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:18.602841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896727601840070:7172] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:18.602844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896727601840070:7172] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:18.602853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2858 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:18.602889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:18.607071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:18.607342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:18.607357Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:18.607369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:18.607432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:18.607476Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896727512045627:7887]
2025-09-30T14:58:18.608184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:18.608531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:18.608581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:18.608945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:18.609113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.609123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.609124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.609126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.609127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.609128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.609129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.609131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.609132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.609134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.609135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.609136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.609137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.609139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.609140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.609146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.609157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.609161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.609164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.609168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.609172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.609177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.609180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.609185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.609189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.609192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.609197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.609201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.609205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.609209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.609217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.609225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.609240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.609246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.609251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.609256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.609261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.609267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.609272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.609277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.609282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.609288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.609293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.609299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.609304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.609310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.609316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.609321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.609326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.609331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.609335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.609340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.609344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.609356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.609362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.609367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.609379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.609386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.609391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.609397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.609446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:18.614716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:18.616103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:18.616118Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:18.616121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:18.616125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:18.616131Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2857 [2:7555896727512045627:7887]
2025-09-30T14:58:18.616150Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:18.616165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:18.616169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:18.616172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:18.616174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:18.616189Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:18.616202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:18.616208Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:18.616269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.616277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.616280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.616284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:18.616286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:18.616352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:18.616359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.616372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.616391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.616415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:18.616438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601839992:2454], now have 1 active actors on pipe
2025-09-30T14:58:18.616447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601840186:7172], now have 1 active actors on pipe
2025-09-30T14:58:18.616453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896727512045621:7887]
2025-09-30T14:58:18.616461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896727512045621:7887]
2025-09-30T14:58:18.616464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896727512045621:7887]
2025-09-30T14:58:18.616479Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:18.616496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:18.616496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:18.616499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:18.616502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:18.616515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:18.616518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:18.616494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2857
2025-09-30T14:58:18.616511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2857
2025-09-30T14:58:18.616567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.616575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.616595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896727512045621:7887]
2025-09-30T14:58:18.616607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:18.616614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:18.616634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|84611ad3-e65275c9-136127d5-d4686374_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:18.616645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:18.616649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:18.616651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:18.616661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:18.616673Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:18.616699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:18.616845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.616852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.616866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:18.616936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2858 partition: 0 MaxSeqNo: 42 sessionId: src_id|84611ad3-e65275c9-136127d5-d4686374_0
2025-09-30T14:58:18.617267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8e471356-aba4147-bc5ddaed-db71204_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|84611ad3-e65275c9-136127d5-d4686374_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:18.620033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84611ad3-e65275c9-136127d5-d4686374_0] Write session: try to update token
2025-09-30T14:58:18.620052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84611ad3-e65275c9-136127d5-d4686374_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:18.628013Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:18.628029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:18.628035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:18.628037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:18.628045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896727512045621:7887]
2025-09-30T14:58:18.628049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896727512045621:7887]
2025-09-30T14:58:18.628053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896727512045621:7887]
2025-09-30T14:58:18.628094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:18.628097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:18.628100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.628103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:18.628109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:18.628114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:18.628234Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:18.634122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2858 sessionId: src_id|84611ad3-e65275c9-136127d5-d4686374_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:18.636801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:18.686653Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896727601840199:6545]
2025-09-30T14:58:18.686949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2857, pipe: [1:7555896727601840199:6545]
2025-09-30T14:58:18.750197Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:18.750776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.750792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.750811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601840199:6545], now have 1 active actors on pipe
2025-09-30T14:58:18.750997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896727601840199:6545]
2025-09-30T14:58:18.751030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:18.751032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:18.751036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:18.751099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2858 reason: error at write: Disconnected sessionId: src_id|84611ad3-e65275c9-136127d5-d4686374_0
2025-09-30T14:58:18.751290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2858 sessionId: src_id|84611ad3-e65275c9-136127d5-d4686374_0 is DEAD
2025-09-30T14:58:18.751415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84611ad3-e65275c9-136127d5-d4686374_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:18.751424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84611ad3-e65275c9-136127d5-d4686374_0] Write session will restart in 0.009016s
2025-09-30T14:58:18.751442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84611ad3-e65275c9-136127d5-d4686374_0] Write session: Do CDS request
2025-09-30T14:58:18.751446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84611ad3-e65275c9-136127d5-d4686374_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:18.751817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:18.761745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|84611ad3-e65275c9-136127d5-d4686374_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:18.761853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:18.761867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2859
2025-09-30T14:58:18.761966Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2859 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:18.761998Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2859 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:18.762006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2859 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:18.762009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:18.762420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2859 sessionId:  describe result for acl check
2025-09-30T14:58:18.762454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:18.762462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:18.762464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:18.762470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896727601840329:7174] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:18.763004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896727601840329:7174] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:18.764519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896727601840329:7174] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:18.769000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:18.769221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896727601840329:7174] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:18.769234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896727601840329:7174] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:18.769238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896727601840329:7174] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:18.769247Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2859 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:18.769365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:18.769512Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:18.769521Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:18.769530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:18.769567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:18.769603Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896727512045826:7899]
2025-09-30T14:58:18.770309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:18.770527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:18.770560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:18.770892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:18.770942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.770948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.770949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.770950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.770951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.770952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.770953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.770955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.770956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.770957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.770958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.770959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.770960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.770962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.770963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.770967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.770977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.770982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.770986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.770990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.770994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.770998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.771002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.771006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.771010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.771014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.771017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.771021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.771025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.771029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.771036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.771044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.771049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.771055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.771059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.771065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.771069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.771074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.771079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.771086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.771094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.771099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.771104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.771114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.771119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.771124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.771132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.771137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.771141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.771150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.771155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.771160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.771168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.771173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.771178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.771187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.771192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.771197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.771201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.771210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.771272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:18.776283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:18.777183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:18.777200Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:18.777203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:18.777207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:18.777214Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2858 [2:7555896727512045826:7899]
2025-09-30T14:58:18.777231Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:18.777246Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:18.777256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:18.777259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:18.777261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:18.777276Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:18.777288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:18.777294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:18.777354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.777362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.777365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.777369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:18.777371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:18.777441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:18.777449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.777463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.777478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.777502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:18.777525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601840202:2454], now have 1 active actors on pipe
2025-09-30T14:58:18.777533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601840397:7174], now have 1 active actors on pipe
2025-09-30T14:58:18.777540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896727512045820:7899]
2025-09-30T14:58:18.777542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896727512045820:7899]
2025-09-30T14:58:18.777544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896727512045820:7899]
2025-09-30T14:58:18.777557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:18.777566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:18.777569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:18.777572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:18.777575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:18.777557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2858
2025-09-30T14:58:18.777590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:18.777598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:18.777582Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2858
2025-09-30T14:58:18.777642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.777651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.777667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896727512045820:7899]
2025-09-30T14:58:18.777680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:18.777687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:18.777707Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:18.777719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:18.777728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:18.777730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:18.777740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:18.777753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:18.777782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:18.777931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.777941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.777954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:18.778026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2859 partition: 0 MaxSeqNo: 42 sessionId: src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0
2025-09-30T14:58:18.778383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|84611ad3-e65275c9-136127d5-d4686374_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:18.781040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0] Write session: try to update token
2025-09-30T14:58:18.781062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:18.789305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:18.789323Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:18.789325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:18.789327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:18.789335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896727512045820:7899]
2025-09-30T14:58:18.789339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896727512045820:7899]
2025-09-30T14:58:18.789342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896727512045820:7899]
2025-09-30T14:58:18.789375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:18.789380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.789382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:18.789392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:18.789398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:18.789403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:18.789506Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:18.794372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2859 sessionId: src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:18.796912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:18.851013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896727601840410:6545]
2025-09-30T14:58:18.851327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2858, pipe: [1:7555896727601840410:6545]
2025-09-30T14:58:18.894397Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:18.895140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.895157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.895206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601840410:6545], now have 1 active actors on pipe
2025-09-30T14:58:18.895483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:18.895493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:18.895508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:18.895509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896727601840410:6545]
2025-09-30T14:58:18.895528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:18.895568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2859 reason: error at write: Disconnected sessionId: src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0
2025-09-30T14:58:18.895756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2859 sessionId: src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0 is DEAD
2025-09-30T14:58:18.895942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:18.895951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0] Write session will restart in 0.009294s
2025-09-30T14:58:18.895968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0] Write session: Do CDS request
2025-09-30T14:58:18.895973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:18.906683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:18.906804Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:18.906819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2860
2025-09-30T14:58:18.906962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2860 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:18.906993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2860 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:18.907004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2860 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:18.907009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:18.907487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2860 sessionId:  describe result for acl check
2025-09-30T14:58:18.907527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:18.907534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:18.907536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:18.907542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896727601840566:7183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:18.908111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896727601840566:7183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:18.909578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:18.910373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896727601840566:7183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:18.914075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:18.914284Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:18.914293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:18.914303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:18.914364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:18.914371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896727601840566:7183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:18.914400Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896727512046024:7897]
2025-09-30T14:58:18.914386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896727601840566:7183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:18.914389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896727601840566:7183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:18.914397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2860 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:18.915075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:18.915401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:18.915456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:18.916010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:18.916073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.916077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.916078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.916079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.916079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.916080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.916081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.916081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.916082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.916083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.916083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.916084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.916085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.916085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.916086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.916090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.916096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.916099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.916101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.916103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.916106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.916108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.916110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.916113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.916115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.916117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.916120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.916122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.916124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.916127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.916133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.916138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:18.916142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.916145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:18.916148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.916151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:18.916153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.916157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:18.916159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.916162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:18.916165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.916168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:18.916170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.916173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:18.916175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.916178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:18.916180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.916183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:18.916186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.916189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:18.916191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.916194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.916196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.916200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.916202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.916205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.916207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.916210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:18.916212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.916215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:18.916239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:18.921374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:18.922184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:18.922197Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:18.922199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:18.922202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:18.922207Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2859 [2:7555896727512046024:7897]
2025-09-30T14:58:18.922219Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:18.922230Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:18.922232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:18.922235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:18.922236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:18.922248Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:18.922253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:18.922258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:18.922298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.922304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.922305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.922308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:18.922310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:18.922357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:18.922364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.922375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:18.922391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:18.922407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:18.922423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601840411:2454], now have 1 active actors on pipe
2025-09-30T14:58:18.922429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601840608:7183], now have 1 active actors on pipe
2025-09-30T14:58:18.922434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896727512046018:7897]
2025-09-30T14:58:18.922436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896727512046018:7897]
2025-09-30T14:58:18.922438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896727512046018:7897]
2025-09-30T14:58:18.922448Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:18.922461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:18.922460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:18.922463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:18.922465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:18.922473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:18.922475Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:18.922498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896727512046018:7897]
2025-09-30T14:58:18.922504Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:18.922520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:18.922498Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2859
2025-09-30T14:58:18.922527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2859
2025-09-30T14:58:18.922600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.922608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.922629Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:18.922639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:18.922643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:18.922645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:18.922654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:18.922664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:18.922675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:18.922848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.922854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.922864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:18.922968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2860 partition: 0 MaxSeqNo: 42 sessionId: src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0
2025-09-30T14:58:18.923320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef032f6a-9eb9b22a-bfbc3dc9-49c3a425_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:18.926088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0] Write session: try to update token
2025-09-30T14:58:18.926105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:18.934124Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:18.934142Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:18.934152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896727512046018:7897]
2025-09-30T14:58:18.934198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:18.934207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:18.934372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:18.934527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:18.934670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:18.934812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:18.934997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:18.935030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:18.939692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2860 sessionId: src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:18.942554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:18.942761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:18.942780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:18.942814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:18.942890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:18.944547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:18.944561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:18.944563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:18.944565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:18.944574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896727512046018:7897]
2025-09-30T14:58:18.944578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896727512046018:7897]
2025-09-30T14:58:18.944584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896727512046018:7897]
2025-09-30T14:58:18.944617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:18.944622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:18.944622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:18.944625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:18.944627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:18.944630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:18.944770Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:18.995877Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896727601840642:6545]
2025-09-30T14:58:18.996277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2859, pipe: [1:7555896727601840642:6545]
2025-09-30T14:58:19.050296Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:19.058863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.058895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.059073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.059140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.059211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.059301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.059348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.059358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.059429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.059502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.059574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.059650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.059699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.059707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.059788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.059861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.059932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.060003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.060055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.060063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.060139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.060213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.060285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.060357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.060414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.060421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.060497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.060565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.060635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.060708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.060758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.060767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.060855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.060922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.060996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.061067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.061114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.061122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.061199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.061268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.061339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.061404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.061447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.061450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.061518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.061580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.061649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.061742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.061791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.061799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.061870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.061941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.062013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.062084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.062130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.062138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.062211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.062276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.062343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.062433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.062483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.062491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.062561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896727601840642:6545], now have 1 active actors on pipe
2025-09-30T14:58:19.062836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:19.062848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:19.062853Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:19.062884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2860 reason: error at write: Disconnected sessionId: src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0
2025-09-30T14:58:19.062902Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896727601840642:6545]
2025-09-30T14:58:19.063083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2860 sessionId: src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0 is DEAD
2025-09-30T14:58:19.063229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:19.063241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0] Write session will restart in 0.009818s
2025-09-30T14:58:19.063282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0] Write session: Do CDS request
2025-09-30T14:58:19.063287Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:19.063598Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:19.074755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:19.075115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:19.075131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2861
2025-09-30T14:58:19.075293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2861 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:19.075324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2861 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:19.075333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2861 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:19.075338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:19.075955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2861 sessionId:  describe result for acl check
2025-09-30T14:58:19.075990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:19.075997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:19.075999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:19.076005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896731896808101:7202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:19.076387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:19.076530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896731896808101:7202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:19.079067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896731896808101:7202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:19.080480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:19.080656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:19.080665Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:19.080687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:19.080740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:19.080774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896731807013559:7876]
2025-09-30T14:58:19.081370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896731896808101:7202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:19.081382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896731896808101:7202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:19.081385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896731896808101:7202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:19.081392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2861 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:19.081433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:19.081665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:19.081722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:19.082027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:19.082073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.082078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.082079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.082080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.082080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.082081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.082082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.082083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.082084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.082084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.082085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.082086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.082086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.082087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.082087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.082091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.082098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.082100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.082103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.082105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.082108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.082110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.082112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.082114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.082117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.082119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.082122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.082124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.082126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.082128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.082134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.082140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.082152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.082155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.082158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.082161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.082164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.082167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.082170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.082173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.082175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.082179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.082182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.082185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.082187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.082191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.082195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.082201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.082207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.082216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.082221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.082229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.082231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.082234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.082237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.082240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.082242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.082245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.082247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.082250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.082274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:19.087472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:19.088707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:19.088721Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:19.088724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:19.088727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:19.088734Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2860 [2:7555896731807013559:7876]
2025-09-30T14:58:19.088753Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:19.088771Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:19.088778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:19.088781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:19.088783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:19.088797Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:19.088808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:19.088817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:19.088888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.088896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.088898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.088901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:19.088904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:19.088962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:19.088969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.088982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.088998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.089022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:19.089038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896807939:2454], now have 1 active actors on pipe
2025-09-30T14:58:19.089047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896808138:7202], now have 1 active actors on pipe
2025-09-30T14:58:19.089052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896731807013553:7876]
2025-09-30T14:58:19.089059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896731807013553:7876]
2025-09-30T14:58:19.089061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896731807013553:7876]
2025-09-30T14:58:19.089072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:19.089086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:19.089088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:19.089092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:19.089095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:19.089105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:19.089108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:19.089136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896731807013553:7876]
2025-09-30T14:58:19.089119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2860
2025-09-30T14:58:19.089154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:19.089155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:19.089182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.089190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.089219Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:19.089228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:19.089236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:19.089238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:19.089247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:19.089258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:19.089277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:19.089330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2860
2025-09-30T14:58:19.089359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.089365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.089376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:19.089446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2861 partition: 0 MaxSeqNo: 42 sessionId: src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0
2025-09-30T14:58:19.089768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bba499cf-b094d496-a1e07c3e-1103aaff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:19.092398Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0] Write session: try to update token
2025-09-30T14:58:19.092416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:19.100936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:19.100952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:19.100954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:19.100956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:19.100963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896731807013553:7876]
2025-09-30T14:58:19.100967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896731807013553:7876]
2025-09-30T14:58:19.100970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896731807013553:7876]
2025-09-30T14:58:19.101001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:19.101007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.101009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:19.101025Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:19.101033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:19.101037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:19.101145Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:19.105825Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2861 sessionId: src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:19.108454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:19.163356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896731896808150:6545]
2025-09-30T14:58:19.163694Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2860, pipe: [1:7555896731896808150:6545]
2025-09-30T14:58:19.202066Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:19.202603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.202615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.202645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896808150:6545], now have 1 active actors on pipe
2025-09-30T14:58:19.202817Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:19.202875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:19.202882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:19.202886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:19.202920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896731896808150:6545]
2025-09-30T14:58:19.202939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2861 reason: error at write: Disconnected sessionId: src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0
2025-09-30T14:58:19.203108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2861 sessionId: src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0 is DEAD
2025-09-30T14:58:19.203275Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:19.203286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0] Write session will restart in 0.008387s
2025-09-30T14:58:19.203309Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0] Write session: Do CDS request
2025-09-30T14:58:19.203315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:19.212754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:19.212880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:19.212903Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2862
2025-09-30T14:58:19.213006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2862 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:19.213030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2862 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:19.213034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2862 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:19.213036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:19.213430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2862 sessionId:  describe result for acl check
2025-09-30T14:58:19.213453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:19.213457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:19.213458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:19.213463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896731896808257:7209] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:19.213861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896731896808257:7209] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:19.215694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896731896808257:7209] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:19.216187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:19.219906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:19.220103Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:19.220113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:19.220125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:19.220187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:19.220228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896731807013761:7872]
2025-09-30T14:58:19.220197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896731896808257:7209] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:19.220213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896731896808257:7209] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:19.220217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896731896808257:7209] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:19.220225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2862 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:19.220768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:19.221020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:19.221052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:19.221274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:19.221316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.221320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.221321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.221322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.221323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.221324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.221325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.221326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.221327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.221328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.221328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.221329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.221330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.221330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.221331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.221335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.221341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.221344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.221347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.221349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.221351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.221354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.221356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.221358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.221361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.221363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.221365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.221368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.221370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.221372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.221377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.221381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.221385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.221389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.221392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.221395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.221397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.221401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.221403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.221407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.221409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.221413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.221416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.221420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.221424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.221427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.221430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.221433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.221436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.221440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.221442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.221445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.221449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.221452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.221454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.221457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.221461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.221464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.221467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.221470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.221494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:19.226744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:19.227547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:19.227560Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:19.227563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:19.227566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:19.227571Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2861 [2:7555896731807013761:7872]
2025-09-30T14:58:19.227583Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:19.227595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:19.227597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:19.227600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:19.227602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:19.227613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:19.227621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:19.227626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:19.227670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.227676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.227678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.227681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:19.227683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:19.227737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:19.227743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.227751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.227758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.227768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:19.227783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896808151:2454], now have 1 active actors on pipe
2025-09-30T14:58:19.227793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896731807013755:7872]
2025-09-30T14:58:19.227794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896731807013755:7872]
2025-09-30T14:58:19.227796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896731807013755:7872]
2025-09-30T14:58:19.227806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:19.227813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896808348:7209], now have 1 active actors on pipe
2025-09-30T14:58:19.227821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:19.227830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:19.227829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:19.227833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:19.227834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:19.227835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:19.227859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896731807013755:7872]
2025-09-30T14:58:19.227867Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:19.227873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:19.227887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2861
2025-09-30T14:58:19.227927Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2861
2025-09-30T14:58:19.227980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.227987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.228006Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:19.228011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:19.228014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:19.228015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:19.228023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:19.228029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:19.228044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:19.228164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.228169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.228179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:19.228244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2862 partition: 0 MaxSeqNo: 42 sessionId: src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0
2025-09-30T14:58:19.228579Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6007b9cc-cb988960-d5da4b2d-29384f4e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:19.231139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0] Write session: try to update token
2025-09-30T14:58:19.231156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:19.239219Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:19.239236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:19.239260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896731807013755:7872]
2025-09-30T14:58:19.239299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:19.239299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:19.239463Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:19.239607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:19.239743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:19.239881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:19.240092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:19.240132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:19.244190Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2862 sessionId: src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:19.246700Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:19.246882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.246901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.246931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:19.246995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:19.249589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:19.249604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:19.249607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:19.249608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:19.249616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896731807013755:7872]
2025-09-30T14:58:19.249620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896731807013755:7872]
2025-09-30T14:58:19.249623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896731807013755:7872]
2025-09-30T14:58:19.249653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:19.249659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.249661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:19.249665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:19.249672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:19.249676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:19.249786Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:19.303112Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896731896808365:6545]
2025-09-30T14:58:19.303406Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2861, pipe: [1:7555896731896808365:6545]
2025-09-30T14:58:19.351031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:19.358451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.358482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.358656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.358717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.358786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.358851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.358898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.358908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.358978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.359041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.359104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.359178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.359223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.359231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.359322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.359386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.359452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.359526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.359568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.359576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.359647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.359712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.359777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.359842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.359886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.359894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.359966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.360032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.360094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.360158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.360202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.360210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.360277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.360337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.360399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.360467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.360513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.360521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.360588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.360651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.360717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.360785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.360829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.360848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.360914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.360977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.361039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.361102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.361152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.361159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.361225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.361285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.361350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.361413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.361460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.361469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.361533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.361598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.361663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.361729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.361772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.361779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.361840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896808365:6545], now have 1 active actors on pipe
2025-09-30T14:58:19.362085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:19.362104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:19.362118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896731896808365:6545]
2025-09-30T14:58:19.362136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2862 reason: error at write: Disconnected sessionId: src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0
2025-09-30T14:58:19.362152Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:19.362348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2862 sessionId: src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0 is DEAD
2025-09-30T14:58:19.362520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:19.362531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0] Write session will restart in 0.005277s
2025-09-30T14:58:19.362558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0] Write session: Do CDS request
2025-09-30T14:58:19.362563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:19.363066Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:19.368731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:19.368838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:19.368856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2863
2025-09-30T14:58:19.368994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2863 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:19.369026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2863 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:19.369035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2863 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:19.369039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:19.369444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2863 sessionId:  describe result for acl check
2025-09-30T14:58:19.369476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:19.369480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:19.369481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:19.369486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896731896808385:7214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:19.369923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896731896808385:7214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:19.372659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896731896808385:7214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:19.375722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896731896808385:7214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:19.375733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896731896808385:7214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:19.375737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896731896808385:7214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:19.375744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2863 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:19.378094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:19.381701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:19.381869Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:19.381879Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:19.381889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:19.381931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:19.381963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896731807013977:7870]
2025-09-30T14:58:19.382467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:19.382729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:19.382775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:19.383043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:19.383090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.383096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.383098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.383099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.383100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.383101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.383103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.383105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.383107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.383108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.383109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.383110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.383112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.383113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.383113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.383118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.383125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.383128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.383130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.383132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.383135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.383138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.383140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.383142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.383145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.383148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.383150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.383152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.383155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.383157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.383163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.383168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.383173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.383177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.383179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.383183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.383185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.383188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.383191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.383194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.383198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.383203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.383208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.383214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.383219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.383225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.383230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.383235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.383239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.383262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.383265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.383269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.383272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.383275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.383278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.383281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.383283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.383286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.383289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.383291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.383318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:19.388544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:19.389625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:19.389642Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:19.389646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:19.389650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:19.389656Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2862 [2:7555896731807013977:7870]
2025-09-30T14:58:19.389668Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:19.389686Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:19.389688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:19.389690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:19.389692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:19.389704Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:19.389710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:19.389715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:19.389762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.389769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.389770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.389773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:19.389775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:19.389827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:19.389833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.389842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.389848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.389857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:19.389873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896731807013972:7870]
2025-09-30T14:58:19.389877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896731807013972:7870]
2025-09-30T14:58:19.389878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896731807013972:7870]
2025-09-30T14:58:19.389884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:19.389893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:19.389901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:19.389907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:19.389910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:19.389915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:19.389918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:19.389934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896731807013972:7870]
2025-09-30T14:58:19.389940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:19.389943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:19.389947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896808370:2454], now have 1 active actors on pipe
2025-09-30T14:58:19.389951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896808547:7214], now have 1 active actors on pipe
2025-09-30T14:58:19.390003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2862
2025-09-30T14:58:19.390020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2862
2025-09-30T14:58:19.390100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.390114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.390140Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:19.390155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:19.390159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:19.390162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:19.390175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:19.390190Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:19.390213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:19.390400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.390411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.390428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:19.390521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2863 partition: 0 MaxSeqNo: 42 sessionId: src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0
2025-09-30T14:58:19.390835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6fff223b-31346b28-e1ca2f0d-6d78de18_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:19.393464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0] Write session: try to update token
2025-09-30T14:58:19.393481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:19.401444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:19.401463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:19.401472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896731807013972:7870]
2025-09-30T14:58:19.401513Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:19.401517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:19.401692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:19.401834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:19.401982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:19.402126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:19.402316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:19.402354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:19.406894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2863 sessionId: src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:19.409833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:19.410119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.410140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.410175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:19.410268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:19.411928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:19.411946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:19.411948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:19.411950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:19.411959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896731807013972:7870]
2025-09-30T14:58:19.411969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896731807013972:7870]
2025-09-30T14:58:19.411973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896731807013972:7870]
2025-09-30T14:58:19.412012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:19.412014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:19.412018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.412019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:19.412021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:19.412024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:19.412158Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:19.462352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896731896808581:6545]
2025-09-30T14:58:19.462606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2862, pipe: [1:7555896731896808581:6545]
2025-09-30T14:58:19.517266Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:19.525442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.525463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.525612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.525667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.525731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.525788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.525830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.525838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.525899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.525953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.526016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.526078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.526120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.526126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.526190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.526264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.526325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.526387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.526427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.526436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.526503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.526561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.526621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.526681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.526721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.526726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.526786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.526841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.526902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.526962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.527005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.527010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.527074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.527130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.527188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.527285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.527327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.527333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.527394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.527449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.527508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.527568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.527609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.527615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.527675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.527731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.527790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.527849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.527907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.527914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.527973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.528031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.528088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.528146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.528191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.528196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.528256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:19.528311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:19.528368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:19.528428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:19.528483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:19.528489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:19.528539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896808581:6545], now have 1 active actors on pipe
2025-09-30T14:58:19.528744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:19.528778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:19.528782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:19.528792Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896731896808581:6545]
2025-09-30T14:58:19.528809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2863 reason: error at write: Disconnected sessionId: src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0
2025-09-30T14:58:19.528982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2863 sessionId: src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0 is DEAD
2025-09-30T14:58:19.529159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:19.529174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0] Write session will restart in 0.005577s
2025-09-30T14:58:19.529193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0] Write session: Do CDS request
2025-09-30T14:58:19.529197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:19.529496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:19.535650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:19.535716Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:19.535726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2864
2025-09-30T14:58:19.535911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2864 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:19.535951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2864 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:19.535960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2864 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:19.535964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:19.536371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2864 sessionId:  describe result for acl check
2025-09-30T14:58:19.536400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:19.536407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:19.536409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:19.536413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896731896808616:7232] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:19.536937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896731896808616:7232] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:19.539353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896731896808616:7232] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:19.541654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896731896808616:7232] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:19.541665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896731896808616:7232] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:19.541668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896731896808616:7232] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:19.541675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2864 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:19.546192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:19.546572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:19.546709Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:19.546716Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:19.546723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:19.546767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:19.546797Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896731807014181:7868]
2025-09-30T14:58:19.547311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:19.547545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:19.547581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:19.547884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:19.547947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.547952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.547953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.547955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.547956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.547957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.547958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.547959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.547960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.547962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.547963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.547964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.547965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.547966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.547967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.547972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.547982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.547986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.547991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.547995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.547999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.548003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.548009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.548013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.548020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.548022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.548024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.548027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.548029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.548031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.548038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.548046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.548050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.548053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.548056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.548059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.548061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.548064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.548069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.548072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.548074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.548077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.548081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.548084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.548088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.548093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.548103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.548108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.548112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.548116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.548123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.548128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.548132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.548137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.548142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.548147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.548151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.548155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.548157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.548160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.548183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:19.553168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:19.554408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:19.554423Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:19.554425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:19.554428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:19.554434Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2863 [2:7555896731807014181:7868]
2025-09-30T14:58:19.554447Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:19.554459Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:19.554462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:19.554465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:19.554467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:19.554482Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:19.554495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:19.554502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:19.554560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.554567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.554569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.554572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:19.554575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:19.554642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:19.554649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.554660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.554678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.554700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:19.554723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896808794:7232], now have 1 active actors on pipe
2025-09-30T14:58:19.554731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896808595:2454], now have 1 active actors on pipe
2025-09-30T14:58:19.554737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896731807014176:7868]
2025-09-30T14:58:19.554743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896731807014176:7868]
2025-09-30T14:58:19.554746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896731807014176:7868]
2025-09-30T14:58:19.554758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:19.554775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:19.554790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:19.554794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:19.554797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:19.554801Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:19.554803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:19.554818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896731807014176:7868]
2025-09-30T14:58:19.554830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:19.554841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:19.554826Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2863
2025-09-30T14:58:19.554877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2863
2025-09-30T14:58:19.554927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.554936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.554957Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:19.554970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:19.554974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:19.554976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:19.554984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:19.554994Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:19.555006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:19.555159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.555165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.555176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:19.555255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2864 partition: 0 MaxSeqNo: 42 sessionId: src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0
2025-09-30T14:58:19.555608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5716a59b-3adb1215-fa6ac0c2-4ea0ed8e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:19.558178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0] Write session: try to update token
2025-09-30T14:58:19.558189Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:19.570619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:19.570638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:19.570646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896731807014176:7868]
2025-09-30T14:58:19.570684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:19.570697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:19.571163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:19.571320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:19.571448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:19.571577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:19.571755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:19.571790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:19.576019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2864 sessionId: src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:19.576288Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:19.576304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:19.576306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:19.576308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:19.576316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896731807014176:7868]
2025-09-30T14:58:19.576320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896731807014176:7868]
2025-09-30T14:58:19.576324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896731807014176:7868]
2025-09-30T14:58:19.576359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:19.576361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:19.576364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.576365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:19.576367Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:19.576372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:19.576496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:19.578414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:19.597401Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] Counters: { Errors: 28 CurrentSessionLifetimeMs: 481641 BytesRead: 38297624 MessagesRead: 17 BytesReadCompressed: 38297624 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-09-30T14:58:19.628742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896731896808807:6545]
2025-09-30T14:58:19.629047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2863, pipe: [1:7555896731896808807:6545]
2025-09-30T14:58:19.681249Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:19.681572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.681588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.681609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896808807:6545], now have 1 active actors on pipe
2025-09-30T14:58:19.681839Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:19.681862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:19.681875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:19.681897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896731896808807:6545]
2025-09-30T14:58:19.681929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:19.681934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2864 reason: error at write: Disconnected sessionId: src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0
2025-09-30T14:58:19.682125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2864 sessionId: src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0 is DEAD
2025-09-30T14:58:19.682284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:19.682294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0] Write session will restart in 0.009305s
2025-09-30T14:58:19.682313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0] Write session: Do CDS request
2025-09-30T14:58:19.682319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:19.692804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:19.692893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:19.692908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2865
2025-09-30T14:58:19.693037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2865 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:19.693068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2865 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:19.693078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2865 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:19.693082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:19.693552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2865 sessionId:  describe result for acl check
2025-09-30T14:58:19.693585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:19.693588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:19.693590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:19.693599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896731896808920:7238] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:19.694053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896731896808920:7238] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:19.696263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896731896808920:7238] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:19.696987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:19.700998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:19.701197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:19.701209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896731896808920:7238] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:19.701210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:19.701227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896731896808920:7238] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:19.701230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896731896808920:7238] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:19.701221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:19.701239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2865 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:19.701278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:19.701316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896731807014387:7865]
2025-09-30T14:58:19.701815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:19.702054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:19.702094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:19.702326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:19.702379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.702384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.702386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.702387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.702388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.702389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.702390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.702391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.702393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.702394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.702395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.702396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.702397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.702398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.702400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.702405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.702415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.702420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.702424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.702428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.702433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.702437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.702440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.702444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.702449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.702453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.702458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.702462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.702467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.702471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.702478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.702487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.702493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.702499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.702504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.702512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.702520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.702526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.702533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.702540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.702545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.702559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.702564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.702569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.702574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.702579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.702584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.702587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.702590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.702592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.702595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.702599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.702601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.702604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.702606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.702609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.702611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.702614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.702616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.702619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.702642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:19.707676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:19.709128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:19.709141Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:19.709143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:19.709145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:19.709150Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2864 [2:7555896731807014387:7865]
2025-09-30T14:58:19.709162Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:19.709173Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:19.709175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:19.709177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:19.709178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:19.709190Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:19.709194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:19.709200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:19.709239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.709245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.709247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.709249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:19.709251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:19.709299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:19.709304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.709313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.709320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.709333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:19.709349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896731807014382:7865]
2025-09-30T14:58:19.709354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896731807014382:7865]
2025-09-30T14:58:19.709356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896731807014382:7865]
2025-09-30T14:58:19.709362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:19.709371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:19.709372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:19.709376Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:19.709378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:19.709383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:19.709385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:19.709391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896809011:7238], now have 1 active actors on pipe
2025-09-30T14:58:19.709397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896808809:2454], now have 1 active actors on pipe
2025-09-30T14:58:19.709418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896731807014382:7865]
2025-09-30T14:58:19.709426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:19.709439Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:19.709467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2864
2025-09-30T14:58:19.709484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2864
2025-09-30T14:58:19.709506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.709516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.709534Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:19.709539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:19.709541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:19.709544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:19.709550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:19.709556Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:19.709569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:19.709671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.709677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.709685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:19.709736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2865 partition: 0 MaxSeqNo: 42 sessionId: src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0
2025-09-30T14:58:19.710044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|396b0d30-e5ce6ec5-86f401ba-d99b37ea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:19.712583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0] Write session: try to update token
2025-09-30T14:58:19.712600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:19.720789Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:19.720807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:19.720809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:19.720810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:19.720818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896731807014382:7865]
2025-09-30T14:58:19.720821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896731807014382:7865]
2025-09-30T14:58:19.720824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896731807014382:7865]
2025-09-30T14:58:19.720863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:19.720869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.720870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:19.720883Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:19.720889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:19.720893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:19.720992Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:19.728106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2865 sessionId: src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:19.730570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:19.781832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896731896809024:6545]
2025-09-30T14:58:19.782091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2864, pipe: [1:7555896731896809024:6545]
2025-09-30T14:58:19.825593Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:19.825834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.825845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.825861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896809024:6545], now have 1 active actors on pipe
2025-09-30T14:58:19.826070Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:19.826069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:19.826080Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:19.826084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:19.826123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896731896809024:6545]
2025-09-30T14:58:19.826142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2865 reason: error at write: Disconnected sessionId: src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0
2025-09-30T14:58:19.826309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2865 sessionId: src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0 is DEAD
2025-09-30T14:58:19.826446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:19.826455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0] Write session will restart in 0.008529s
2025-09-30T14:58:19.826474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0] Write session: Do CDS request
2025-09-30T14:58:19.826478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:19.835798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:19.835913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:19.835934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2866
2025-09-30T14:58:19.836088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2866 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:19.836124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2866 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:19.836129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2866 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:19.836134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:19.836598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2866 sessionId:  describe result for acl check
2025-09-30T14:58:19.836635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:19.836642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:19.836644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:19.836650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896731896809108:7253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:19.837186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896731896809108:7253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:19.839217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896731896809108:7253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:19.841716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896731896809108:7253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:19.841728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896731896809108:7253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:19.841731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896731896809108:7253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:19.841738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2866 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:19.841731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:19.845731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:19.845933Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:19.845950Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:19.845960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:19.846010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:19.846054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896731807014594:7863]
2025-09-30T14:58:19.846526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:19.846810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:19.846847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:19.847079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:19.847134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.847140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.847141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.847142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.847144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.847145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.847146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.847148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.847149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.847150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.847151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.847152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.847154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.847155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.847156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.847173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.847184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.847188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.847192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.847197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.847202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.847206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.847210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.847214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.847220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.847224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.847229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.847233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.847238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.847256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.847264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.847272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:19.847283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.847290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:19.847298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.847304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:19.847310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.847316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:19.847325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.847331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:19.847340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.847345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:19.847354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.847360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:19.847368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.847374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:19.847380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.847390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:19.847397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.847403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:19.847411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.847416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.847425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.847431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.847439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.847445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.847454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.847460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:19.847468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.847474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:19.847521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:19.852720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:19.853565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:19.853583Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:19.853585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:19.853589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:19.853600Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2865 [2:7555896731807014594:7863]
2025-09-30T14:58:19.853617Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:19.853632Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:19.853635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:19.853638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:19.853640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:19.853655Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:19.853661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:19.853666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:19.853711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.853717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.853719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.853721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:19.853723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:19.853776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:19.853782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.853790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:19.853796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:19.853806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:19.853817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896731807014588:7863]
2025-09-30T14:58:19.853820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896731807014588:7863]
2025-09-30T14:58:19.853821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896731807014588:7863]
2025-09-30T14:58:19.853827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:19.853835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:19.853839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896809026:2454], now have 1 active actors on pipe
2025-09-30T14:58:19.853843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:19.853844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:19.853847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:19.853860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:19.853863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:19.853868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896809228:7253], now have 1 active actors on pipe
2025-09-30T14:58:19.853892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896731807014588:7863]
2025-09-30T14:58:19.853903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:19.853910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:19.853897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2865
2025-09-30T14:58:19.853954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2865
2025-09-30T14:58:19.854011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.854020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.854043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:19.854051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:19.854055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:19.854057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:19.854066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:19.854080Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:19.854093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:19.854209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.854216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.854226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:19.854324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2866 partition: 0 MaxSeqNo: 42 sessionId: src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0
2025-09-30T14:58:19.854695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a27e4af-b68b1ef2-53ce4b0f-e0f01a3a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:19.857316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0] Write session: try to update token
2025-09-30T14:58:19.857330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:19.865250Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:19.865267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:19.865276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896731807014588:7863]
2025-09-30T14:58:19.865316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:19.865320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:19.865485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:19.865617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:19.865764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:19.865903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:19.866090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:19.866130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:19.870862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2866 sessionId: src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:19.873462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:19.873636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:19.873655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:19.873689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:19.873785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:19.875705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:19.875724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:19.875727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:19.875729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:19.875739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896731807014588:7863]
2025-09-30T14:58:19.875743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896731807014588:7863]
2025-09-30T14:58:19.875748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896731807014588:7863]
2025-09-30T14:58:19.875788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:19.875791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:19.875798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:19.875799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:19.875801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:19.875802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:19.875948Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:19.926212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896731896809240:6545]
2025-09-30T14:58:19.926497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2865, pipe: [1:7555896731896809240:6545]
2025-09-30T14:58:19.992848Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:20.002196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.002230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.002394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:20.002460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:20.002528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:20.002596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:20.002642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:20.002653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:20.002719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:20.002782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:20.002852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:20.003002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:20.003048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:20.003059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:20.003126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:20.003187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:20.003278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:20.003350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:20.003394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:20.003404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:20.003474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:20.003542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:20.003608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:20.003679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:20.003723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:20.003731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:20.003809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:20.003889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:20.003979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:20.004081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:20.004134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:20.004143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:20.004222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:20.004320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:20.004416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:20.004517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:20.004573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:20.004583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:20.004653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:20.004719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:20.004793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:20.004876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:20.004958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:20.004968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:20.005044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:20.005120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:20.005192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:20.005258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:20.005307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:20.005314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:20.005386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:20.005454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:20.005518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:20.005584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:20.005631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:20.005639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:20.005712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:20.005782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:20.005851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:20.005924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:20.005971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:20.005979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:20.006141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896731896809240:6545], now have 1 active actors on pipe
2025-09-30T14:58:20.006391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896731896809240:6545]
2025-09-30T14:58:20.006432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:20.006434Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:20.006459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2866 reason: error at write: Disconnected sessionId: src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0
2025-09-30T14:58:20.006682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2866 sessionId: src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0 is DEAD
2025-09-30T14:58:20.006847Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:20.006856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0] Write session will restart in 0.009657s
2025-09-30T14:58:20.006878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0] Write session: Do CDS request
2025-09-30T14:58:20.006884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:20.007045Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:20.007483Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:20.017739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:20.017898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:20.017917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2867
2025-09-30T14:58:20.018055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2867 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:20.018089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2867 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:20.018099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2867 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:20.018108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:20.018499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2867 sessionId:  describe result for acl check
2025-09-30T14:58:20.018537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:20.018545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:20.018547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:20.018553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896736191776690:7267] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:20.019042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896736191776690:7267] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:20.021179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896736191776690:7267] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:20.021374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:20.025549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:20.025932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896736191776690:7267] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:20.025948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896736191776690:7267] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:20.025952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896736191776690:7267] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:20.025960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2867 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:20.025991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:20.026000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:20.026010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:20.026058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:20.026090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896736101982109:7845]
2025-09-30T14:58:20.026522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:20.026792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:20.026823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:20.027042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:20.027082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.027088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.027089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.027090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.027090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.027091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.027092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.027092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.027093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.027093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.027094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.027095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.027095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.027096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.027097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.027100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.027106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.027109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.027111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.027114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.027116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.027118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.027121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.027123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.027126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.027129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.027131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.027133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.027135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.027137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.027143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.027148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.027152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.027155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.027158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.027161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.027164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.027167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.027170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.027173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.027175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.027178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.027181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.027184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.027186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.027190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.027192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.027195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.027198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.027201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.027203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.027206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.027209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.027212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.027214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.027217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.027230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.027233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.027235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.027238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.027291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:20.032413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:20.033595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:20.033609Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:20.033612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:20.033615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:20.033622Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2866 [2:7555896736101982109:7845]
2025-09-30T14:58:20.033637Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:20.033651Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:20.033654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:20.033657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:20.033660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:20.033676Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:20.033683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:20.033693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:20.033745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.033751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.033753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.033757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:20.033760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:20.033826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:20.033832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.033843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.033854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.033872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:20.033894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191776754:7267], now have 1 active actors on pipe
2025-09-30T14:58:20.033901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191776552:2454], now have 1 active actors on pipe
2025-09-30T14:58:20.033907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896736101982104:7845]
2025-09-30T14:58:20.033910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896736101982104:7845]
2025-09-30T14:58:20.033912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896736101982104:7845]
2025-09-30T14:58:20.033920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:20.033931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:20.033936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:20.033941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:20.033944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:20.033950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:20.033953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:20.033936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2866
2025-09-30T14:58:20.033945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2866
2025-09-30T14:58:20.033996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.034004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.034016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896736101982104:7845]
2025-09-30T14:58:20.034027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:20.034039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:20.034063Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:20.034073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:20.034080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:20.034083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:20.034092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:20.034104Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:20.034129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:20.034274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.034281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.034293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:20.034385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2867 partition: 0 MaxSeqNo: 42 sessionId: src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0
2025-09-30T14:58:20.034732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2f6e7e80-2e3fa1f9-ab42c66e-6dc6bf7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:20.037448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0] Write session: try to update token
2025-09-30T14:58:20.037468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:20.046226Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:20.046245Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:20.046248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:20.046249Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:20.046259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896736101982104:7845]
2025-09-30T14:58:20.046262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896736101982104:7845]
2025-09-30T14:58:20.046271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896736101982104:7845]
2025-09-30T14:58:20.046311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:20.046313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:20.046318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.046321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:20.046323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:20.046326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:20.046472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:20.050689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2867 sessionId: src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:20.053516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:20.106438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896736191776775:6545]
2025-09-30T14:58:20.106705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2866, pipe: [1:7555896736191776775:6545]
2025-09-30T14:58:20.155728Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:20.156135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.156149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.156190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191776775:6545], now have 1 active actors on pipe
2025-09-30T14:58:20.156377Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:20.156467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:20.156469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896736191776775:6545]
2025-09-30T14:58:20.156493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:20.157160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2867 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0
2025-09-30T14:58:20.157350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2867 sessionId: src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0 is DEAD
2025-09-30T14:58:20.157517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:20.157529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0] Write session will restart in 0.005302s
2025-09-30T14:58:20.157569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0] Write session: Do CDS request
2025-09-30T14:58:20.157575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:20.163782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:20.163874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:20.163891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2868
2025-09-30T14:58:20.164007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2868 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:20.164040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2868 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:20.164046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2868 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:20.164056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:20.164484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2868 sessionId:  describe result for acl check
2025-09-30T14:58:20.164520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:20.164527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:20.164529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:20.164534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896736191776792:7279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:20.165037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896736191776792:7279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:20.167836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896736191776792:7279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:20.171695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896736191776792:7279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:20.171713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896736191776792:7279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:20.171716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896736191776792:7279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:20.171726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2868 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:20.177610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:20.178128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:20.178292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:20.178304Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:20.178314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:20.178357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:20.178394Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896736101982343:7833]
2025-09-30T14:58:20.179015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:20.179331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:20.179376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:20.179687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:20.179753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.179759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.179761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.179762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.179763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.179764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.179765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.179766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.179767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.179768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.179769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.179771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.179772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.179773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.179774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.179780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.179791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.179795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.179800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.179804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.179808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.179812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.179816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.179821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.179825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.179829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.179833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.179837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.179841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.179845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.179854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.179862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.179868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.179873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.179878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.179883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.179892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.179897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.179907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.179912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.179917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.179923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.179932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.179937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.179941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.179945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.179953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.179957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.179963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.179970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.179975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.179986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.179990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.179994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.179999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.180004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.180011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.180016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.180026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.180030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.180071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:20.185488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:20.186327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:20.186341Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:20.186343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:20.186348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:20.186354Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2867 [2:7555896736101982343:7833]
2025-09-30T14:58:20.186369Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:20.186385Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:20.186388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:20.186392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:20.186394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:20.186409Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:20.186424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:20.186431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:20.186486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.186494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.186496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.186500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:20.186503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:20.186568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:20.186575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.186586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.186596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.186617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:20.186638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191776979:7279], now have 1 active actors on pipe
2025-09-30T14:58:20.186646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191776776:2454], now have 1 active actors on pipe
2025-09-30T14:58:20.186653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896736101982338:7833]
2025-09-30T14:58:20.186655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896736101982338:7833]
2025-09-30T14:58:20.186657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896736101982338:7833]
2025-09-30T14:58:20.186671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:20.186690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:20.186702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:20.186705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:20.186707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:20.186716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:20.186720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:20.186699Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2867
2025-09-30T14:58:20.186717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2867
2025-09-30T14:58:20.186751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896736101982338:7833]
2025-09-30T14:58:20.186762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:20.186763Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:20.186783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.186788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.186835Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:20.186850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:20.186853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:20.186856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:20.186866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:20.186875Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:20.186893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:20.187038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.187051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.187083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:20.187175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2868 partition: 0 MaxSeqNo: 42 sessionId: src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0
2025-09-30T14:58:20.187537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e047546b-52ec0a7e-bb227362-1f52ae19_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:20.190165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0] Write session: try to update token
2025-09-30T14:58:20.190179Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:20.199168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:20.199186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:20.199189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:20.199191Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:20.199203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896736101982338:7833]
2025-09-30T14:58:20.199207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896736101982338:7833]
2025-09-30T14:58:20.199211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896736101982338:7833]
2025-09-30T14:58:20.199280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:20.199282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:20.199289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:20.199291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.199293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:20.199294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:20.199467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:20.204118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2868 sessionId: src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:20.206619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:20.256448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896736191776997:6545]
2025-09-30T14:58:20.256699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2867, pipe: [1:7555896736191776997:6545]
2025-09-30T14:58:20.304732Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:20.305496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.305510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.305543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191776997:6545], now have 1 active actors on pipe
2025-09-30T14:58:20.305716Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:20.305777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:20.305810Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896736191776997:6545]
2025-09-30T14:58:20.305829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:20.305909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2868 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0
2025-09-30T14:58:20.306056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2868 sessionId: src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0 is DEAD
2025-09-30T14:58:20.306190Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:20.306199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0] Write session will restart in 0.007331s
2025-09-30T14:58:20.306216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0] Write session: Do CDS request
2025-09-30T14:58:20.306220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:20.314779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:20.314868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:20.314884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2869
2025-09-30T14:58:20.315038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2869 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:20.315071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2869 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:20.315082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2869 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:20.315086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:20.315544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2869 sessionId:  describe result for acl check
2025-09-30T14:58:20.315575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:20.315583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:20.315586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:20.315592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896736191777038:7286] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:20.316143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896736191777038:7286] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:20.318450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896736191777038:7286] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:20.321489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896736191777038:7286] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:20.321505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896736191777038:7286] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:20.321509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896736191777038:7286] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:20.321516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2869 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:20.327907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:20.328514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:20.328691Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:20.328702Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:20.328713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:20.328762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:20.328805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896736101982564:7834]
2025-09-30T14:58:20.329528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:20.329808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:20.329845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:20.330177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:20.330255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.330262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.330264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.330265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.330267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.330268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.330270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.330271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.330272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.330274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.330275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.330277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.330278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.330280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.330281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.330287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.330299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.330304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.330308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.330312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.330317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.330321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.330325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.330330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.330334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.330338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.330342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.330347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.330351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.330355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.330362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.330370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.330378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.330385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.330390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.330396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.330401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.330407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.330413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.330419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.330424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.330429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.330440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.330446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.330451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.330459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.330464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.330476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.330481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.330491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.330496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.330506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.330510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.330516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.330521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.330532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.330537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.330542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.330549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.330555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.330605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:20.336009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:20.336870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:20.336885Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:20.336889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:20.336893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:20.336901Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2868 [2:7555896736101982564:7834]
2025-09-30T14:58:20.336918Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:20.336934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:20.336942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:20.336945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:20.336947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:20.336965Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:20.336972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:20.336983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:20.337034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.337040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.337041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.337044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:20.337047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:20.337113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:20.337123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.337135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.337147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.337165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:20.337184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191777204:7286], now have 1 active actors on pipe
2025-09-30T14:58:20.337188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191777001:2454], now have 1 active actors on pipe
2025-09-30T14:58:20.337194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896736101982559:7834]
2025-09-30T14:58:20.337196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896736101982559:7834]
2025-09-30T14:58:20.337199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896736101982559:7834]
2025-09-30T14:58:20.337214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:20.337233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:20.337240Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:20.337244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:20.337247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:20.337255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:20.337259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:20.337246Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2868
2025-09-30T14:58:20.337252Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2868
2025-09-30T14:58:20.337289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896736101982559:7834]
2025-09-30T14:58:20.337297Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:20.337300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:20.337315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.337320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.337367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6a90930e-60d50861-98466e20-6e7e582c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:20.337379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:20.337383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:20.337385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:20.337394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:20.337402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:20.337423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:20.337535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.337543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.337554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:20.337616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2869 partition: 0 MaxSeqNo: 42 sessionId: src_id|6a90930e-60d50861-98466e20-6e7e582c_0
2025-09-30T14:58:20.338049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2a23adc9-af832ec0-f2e93c53-6375e818_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6a90930e-60d50861-98466e20-6e7e582c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:20.340880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a90930e-60d50861-98466e20-6e7e582c_0] Write session: try to update token
2025-09-30T14:58:20.340903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a90930e-60d50861-98466e20-6e7e582c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:20.349399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:20.349423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:20.349426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:20.349428Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:20.349439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896736101982559:7834]
2025-09-30T14:58:20.349445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896736101982559:7834]
2025-09-30T14:58:20.349450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896736101982559:7834]
2025-09-30T14:58:20.349490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:20.349497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.349500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:20.349502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:20.349509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:20.349515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:20.349647Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:20.355856Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2869 sessionId: src_id|6a90930e-60d50861-98466e20-6e7e582c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:20.358777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:20.405955Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896736191777222:6545]
2025-09-30T14:58:20.406289Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2868, pipe: [1:7555896736191777222:6545]
2025-09-30T14:58:20.470808Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:20.471552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.471572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.471614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191777222:6545], now have 1 active actors on pipe
2025-09-30T14:58:20.471844Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:20.471921Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896736191777222:6545]
2025-09-30T14:58:20.471929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:20.471961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:20.472046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2869 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6a90930e-60d50861-98466e20-6e7e582c_0
2025-09-30T14:58:20.472225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2869 sessionId: src_id|6a90930e-60d50861-98466e20-6e7e582c_0 is DEAD
2025-09-30T14:58:20.472412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a90930e-60d50861-98466e20-6e7e582c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:20.472423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a90930e-60d50861-98466e20-6e7e582c_0] Write session will restart in 0.009012s
2025-09-30T14:58:20.472449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a90930e-60d50861-98466e20-6e7e582c_0] Write session: Do CDS request
2025-09-30T14:58:20.472472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a90930e-60d50861-98466e20-6e7e582c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:20.482807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6a90930e-60d50861-98466e20-6e7e582c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:20.482983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:20.483000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2870
2025-09-30T14:58:20.483105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2870 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:20.483133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2870 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:20.483138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2870 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:20.483142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:20.483654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2870 sessionId:  describe result for acl check
2025-09-30T14:58:20.483686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:20.483691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:20.483693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:20.483712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896736191777248:7289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:20.484302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896736191777248:7289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:20.486752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896736191777248:7289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:20.491219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896736191777248:7289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:20.491240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896736191777248:7289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:20.491261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896736191777248:7289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:20.491271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2870 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:20.494307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:20.499974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:20.500241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:20.500254Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:20.500267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:20.500327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:20.500376Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896736101982774:7828]
2025-09-30T14:58:20.501088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:20.501509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:20.501562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:20.501925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:20.501994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.502000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.502001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.502003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.502004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.502006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.502007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.502009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.502010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.502011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.502013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.502014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.502015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.502017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.502018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.502024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.502035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.502039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.502044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.502048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.502053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.502057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.502061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.502065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.502069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.502072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.502076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.502080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.502083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.502087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.502097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.502105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.502111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.502117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.502123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.502129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.502133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.502139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.502145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.502155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.502160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.502166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.502175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.502181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.502185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.502193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.502199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.502209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.502213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.502220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.502227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.502233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.502242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.502248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.502252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.502260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.502265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.502271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.502276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.502285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.502332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:20.508129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:20.509877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:20.509901Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:20.509905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:20.509909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:20.509916Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2869 [2:7555896736101982774:7828]
2025-09-30T14:58:20.509939Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:20.509956Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:20.509966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:20.509970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:20.509973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:20.509992Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:20.510004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:20.510011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:20.510104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.510113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.510115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.510119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:20.510122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:20.510202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:20.510211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.510229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.510249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.510265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:20.510283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896736101982769:7828]
2025-09-30T14:58:20.510290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896736101982769:7828]
2025-09-30T14:58:20.510293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896736101982769:7828]
2025-09-30T14:58:20.510302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:20.510321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:20.510335Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:20.510337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:20.510341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:20.510344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:20.510346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:20.510382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896736101982769:7828]
2025-09-30T14:58:20.510393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:20.510409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191777426:7289], now have 1 active actors on pipe
2025-09-30T14:58:20.510417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191777223:2454], now have 1 active actors on pipe
2025-09-30T14:58:20.510453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:20.510571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.510584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.510610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:20.510623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:20.510627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:20.510630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:20.510645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:20.510662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:20.510687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:20.510869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.510877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.510892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:20.511379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6a90930e-60d50861-98466e20-6e7e582c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:20.510455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2869
2025-09-30T14:58:20.510456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2869
2025-09-30T14:58:20.510983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2870 partition: 0 MaxSeqNo: 42 sessionId: src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0
2025-09-30T14:58:20.514374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0] Write session: try to update token
2025-09-30T14:58:20.514399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:20.524136Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:20.524157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:20.524160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:20.524162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:20.524173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896736101982769:7828]
2025-09-30T14:58:20.524178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896736101982769:7828]
2025-09-30T14:58:20.524182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896736101982769:7828]
2025-09-30T14:58:20.524225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:20.524233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.524235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:20.524388Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:20.525845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:20.525857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:20.525862Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:20.534842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2870 sessionId: src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:20.537576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:20.571920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896736191777455:6545]
2025-09-30T14:58:20.572249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2869, pipe: [1:7555896736191777455:6545]
2025-09-30T14:58:20.640113Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:20.640420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.640430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.640476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191777455:6545], now have 1 active actors on pipe
2025-09-30T14:58:20.640888Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896736191777455:6545]
2025-09-30T14:58:20.640923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:20.640926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:20.640988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2870 reason: error at write: Disconnected sessionId: src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0
2025-09-30T14:58:20.641165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2870 sessionId: src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0 is DEAD
2025-09-30T14:58:20.641176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:20.640922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:20.643221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:20.643232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0] Write session will restart in 0.005359s
2025-09-30T14:58:20.643266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0] Write session: Do CDS request
2025-09-30T14:58:20.643274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:20.649838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:20.651593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:20.651610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2871
2025-09-30T14:58:20.651835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2871 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:20.651864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2871 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:20.651870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2871 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:20.651876Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:20.652714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2871 sessionId:  describe result for acl check
2025-09-30T14:58:20.652763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:20.652768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:20.652770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:20.652775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896736191777477:7304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:20.653312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896736191777477:7304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:20.660213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896736191777477:7304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:20.663650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896736191777477:7304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:20.663668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896736191777477:7304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:20.663672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896736191777477:7304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:20.663680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2871 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:20.669751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:20.671755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:20.671918Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:20.671921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:20.671929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:20.671964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:20.671991Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896736101982987:7824]
2025-09-30T14:58:20.672481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:20.675639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:20.675706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:20.676026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:20.676087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.676093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.676094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.676095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.676097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.676098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.676100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.676102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.676103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.676105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.676106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.676107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.676109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.676110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.676111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.676117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.676127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.676132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.676137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.676141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.676146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.676151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.676155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.676158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.676164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.676168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.676173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.676178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.676183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.676187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.676197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.676205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.676212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.676219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.676224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.676235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.676239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.676244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.676248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.676254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.676258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.676265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.676271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.676277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.676282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.676288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.676293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.676304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.676309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.676315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.676324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.676331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.676339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.676345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.676357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.676366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.676371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.676378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.676382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.676389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.676435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:20.685166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:20.686656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:20.686663Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:20.686666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:20.686670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:20.686677Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2870 [2:7555896736101982987:7824]
2025-09-30T14:58:20.686694Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:20.686710Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:20.686715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:20.686718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:20.686720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:20.687287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2870
2025-09-30T14:58:20.687344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2870
2025-09-30T14:58:20.686738Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:20.686746Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:20.686753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:20.686824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.686827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.686829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.686833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:20.686836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:20.686913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:20.686917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.686934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.686948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.686968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:20.686986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896736101982981:7824]
2025-09-30T14:58:20.686989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896736101982981:7824]
2025-09-30T14:58:20.686992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896736101982981:7824]
2025-09-30T14:58:20.687012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:20.687029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:20.687045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:20.687048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:20.687085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:20.687090Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:20.687091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896736101982981:7824]
2025-09-30T14:58:20.687092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:20.687096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:20.687098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:20.687159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191777456:2454], now have 1 active actors on pipe
2025-09-30T14:58:20.687167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191777649:7304], now have 1 active actors on pipe
2025-09-30T14:58:20.687495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.687502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.688128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2871 partition: 0 MaxSeqNo: 42 sessionId: src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0
2025-09-30T14:58:20.688516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d57ae1b-c4de2216-69a84004-d71fe56f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:20.687531Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:20.687547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:20.687552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:20.687554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:20.687565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:20.687577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:20.687593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:20.687987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.687992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.688008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:20.691377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0] Write session: try to update token
2025-09-30T14:58:20.691397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:20.710198Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:20.710220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:20.710223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:20.710225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:20.710234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896736101982981:7824]
2025-09-30T14:58:20.710239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896736101982981:7824]
2025-09-30T14:58:20.710243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896736101982981:7824]
2025-09-30T14:58:20.710284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:20.710291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.710295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:20.710443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:20.712214Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2871 sessionId: src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:20.715322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:20.712947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:20.712975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:20.712979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:20.740789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896736191777677:6545]
2025-09-30T14:58:20.741101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2870, pipe: [1:7555896736191777677:6545]
2025-09-30T14:58:20.833573Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:20.833918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.833934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.833979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191777677:6545], now have 1 active actors on pipe
2025-09-30T14:58:20.834230Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:20.835299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:20.835403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2871 reason: status is not ok: tablet will be restarted right now sessionId: src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0
2025-09-30T14:58:20.835412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896736191777677:6545]
2025-09-30T14:58:20.835446Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:20.835607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2871 sessionId: src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0 is DEAD
2025-09-30T14:58:20.841454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:20.841472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0] Write session will restart in 0.008950s
2025-09-30T14:58:20.841499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0] Write session: Do CDS request
2025-09-30T14:58:20.841505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:20.851799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:20.852610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:20.852630Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2872
2025-09-30T14:58:20.852874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2872 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:20.852907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2872 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:20.852913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2872 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:20.852917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:20.853346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2872 sessionId:  describe result for acl check
2025-09-30T14:58:20.853376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:20.853378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:20.853381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:20.853388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896736191777697:7313] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:20.853971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896736191777697:7313] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:20.861606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896736191777697:7313] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:20.867767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896736191777697:7313] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:20.867785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896736191777697:7313] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:20.867789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896736191777697:7313] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:20.867799Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2872 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:20.887711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:20.893716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:20.893957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:20.893961Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:20.893972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:20.894028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:20.894068Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896736101983199:7818]
2025-09-30T14:58:20.894788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:20.895301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:20.895353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:20.895690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:20.895752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.895753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.895754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.895755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.895757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.895758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.895760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.895761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.895763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.895765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.895766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.895767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.895769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.895770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.895772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.895777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.895788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.895793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.895797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.895802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.895807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.895811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.895815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.895819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.895823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.895827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.895831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.895835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.895840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.895845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.895853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.895862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:20.895869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.895875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:20.895880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.895887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:20.895891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.895896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:20.895902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.895907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:20.895911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.895916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:20.895922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.895928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:20.895933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.895940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:20.895945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.895951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:20.895956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.895962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:20.895969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.895976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.895981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.895987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.895992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.895998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.896005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.896011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:20.896016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.896021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:20.896072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:20.902247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:20.903197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:20.903217Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:20.903221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:20.903225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:20.903233Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2871 [2:7555896736101983199:7818]
2025-09-30T14:58:20.903268Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:20.903286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:20.903295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:20.903299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:20.903302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:20.903319Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:20.903327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:20.903334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:20.903397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.903409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.903412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.903416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:20.903419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:20.903492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:20.903503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.903519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:20.903532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:20.903552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:20.903574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896736101983193:7818]
2025-09-30T14:58:20.903582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896736101983193:7818]
2025-09-30T14:58:20.903585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896736101983193:7818]
2025-09-30T14:58:20.903594Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:20.903614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:20.903619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:20.903623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:20.903625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:20.903634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:20.903637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:20.903684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191777682:2454], now have 1 active actors on pipe
2025-09-30T14:58:20.903695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191777803:7313], now have 1 active actors on pipe
2025-09-30T14:58:20.903698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896736101983193:7818]
2025-09-30T14:58:20.903710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:20.903783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:20.903909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.903921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.903954Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:20.903967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:20.903975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:20.903978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:20.903990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:20.904012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:20.904029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:20.904272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:20.904285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:20.904305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:20.904797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14f4d584-8090e769-4dabe47b-3d9cd7f1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:20.903733Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2871
2025-09-30T14:58:20.903733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2871
2025-09-30T14:58:20.904415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2872 partition: 0 MaxSeqNo: 42 sessionId: src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0
2025-09-30T14:58:20.907646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0] Write session: try to update token
2025-09-30T14:58:20.907666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:20.920202Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:20.920220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:20.920222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:20.920224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:20.920234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896736101983193:7818]
2025-09-30T14:58:20.920238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896736101983193:7818]
2025-09-30T14:58:20.920242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896736101983193:7818]
2025-09-30T14:58:20.920280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:20.920287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:20.920290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:20.920309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:20.920316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:20.920321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:20.920432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:20.926740Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2872 sessionId: src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:20.929523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:20.935415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896736191777903:6545]
2025-09-30T14:58:20.936146Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2871, pipe: [1:7555896736191777903:6545]
2025-09-30T14:58:21.045432Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:21.045638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.045649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.045680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896736191777903:6545], now have 1 active actors on pipe
2025-09-30T14:58:21.045941Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:21.050736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:21.050753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0] Write session will restart in 0.006385s
2025-09-30T14:58:21.050778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0] Write session: Do CDS request
2025-09-30T14:58:21.050783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:21.048711Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:21.048790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:21.048896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2872 reason: status is not ok: tablet will be restarted right now sessionId: src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0
2025-09-30T14:58:21.049069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2872 sessionId: src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0 is DEAD
2025-09-30T14:58:21.049252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896736191777903:6545]
2025-09-30T14:58:21.060058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:21.060267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:21.060287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2873
2025-09-30T14:58:21.060423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2873 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:21.060454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2873 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:21.060464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2873 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:21.060468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:21.060863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2873 sessionId:  describe result for acl check
2025-09-30T14:58:21.060896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:21.060903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:21.060904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:21.060910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896740486745243:7348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:21.061477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896740486745243:7348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:21.066678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896740486745243:7348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:21.072281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896740486745243:7348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:21.072305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896740486745243:7348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:21.072309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896740486745243:7348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:21.072318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2873 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:21.077260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:21.082490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:21.082744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:21.082756Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:21.082767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:21.082820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:21.082858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896740396950724:7804]
2025-09-30T14:58:21.083568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:21.083941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:21.083989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:21.084311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:21.084375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.084382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.084384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.084385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.084386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.084387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.084389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.084390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.084391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.084392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.084394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.084395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.084396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.084397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.084398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.084403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.084415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.084418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.084423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.084427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.084431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.084435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.084440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.084444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.084448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.084452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.084455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.084459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.084463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.084467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.084474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.084482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.084488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.084494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.084498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.084503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.084508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.084514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.084519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.084525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.084529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.084533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.084544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.084550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.084554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.084559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.084563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.084568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.084573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.084577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.084582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.084586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.084596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.084602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.084607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.084612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.084616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.084620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.084625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.084634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.084678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:21.091138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:21.092244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:21.092260Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:21.092262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:21.092266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:21.092272Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2872 [2:7555896740396950724:7804]
2025-09-30T14:58:21.092284Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:21.092298Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:21.092306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:21.092309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:21.092311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:21.092325Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:21.092331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:21.092344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:21.092394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.092401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.092403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.092406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:21.092408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:21.092468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:21.092478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.092492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.092505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.092524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:21.092540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896740396950719:7804]
2025-09-30T14:58:21.092542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896740396950719:7804]
2025-09-30T14:58:21.092544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896740396950719:7804]
2025-09-30T14:58:21.092552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:21.092562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:21.092565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:21.092566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486745221:2454], now have 1 active actors on pipe
2025-09-30T14:58:21.092567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:21.092569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486745419:7348], now have 1 active actors on pipe
2025-09-30T14:58:21.092589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:21.092603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:21.092605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:21.092638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896740396950719:7804]
2025-09-30T14:58:21.092646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:21.092804Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:21.093117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.093128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.093153Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:21.093165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:21.093171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:21.093173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:21.093183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:21.093192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:21.093205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:21.093459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.093465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.093477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:21.093996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78e672f9-d00ac0dd-9e2a5e61-4071c2ad_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:21.092859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2872
2025-09-30T14:58:21.092892Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2872
2025-09-30T14:58:21.093600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2873 partition: 0 MaxSeqNo: 42 sessionId: src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0
2025-09-30T14:58:21.097096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0] Write session: try to update token
2025-09-30T14:58:21.097117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:21.106819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:21.106844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:21.106847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:21.106849Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:21.106859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896740396950719:7804]
2025-09-30T14:58:21.106864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896740396950719:7804]
2025-09-30T14:58:21.106868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896740396950719:7804]
2025-09-30T14:58:21.106911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:21.106918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.106921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:21.106929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:21.106936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:21.106940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:21.107080Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:21.117944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2873 sessionId: src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:21.120565Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:21.148925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896740486745449:6545]
2025-09-30T14:58:21.149525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2872, pipe: [1:7555896740486745449:6545]
2025-09-30T14:58:21.243460Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:21.244303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.244330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.244356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486745449:6545], now have 1 active actors on pipe
2025-09-30T14:58:21.244682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:21.244789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:21.244797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:21.244884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2873 reason: error at write: Disconnected sessionId: src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0
2025-09-30T14:58:21.245092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2873 sessionId: src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0 is DEAD
2025-09-30T14:58:21.245202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896740486745449:6545]
2025-09-30T14:58:21.245529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:21.247324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:21.247338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0] Write session will restart in 0.009975s
2025-09-30T14:58:21.247363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0] Write session: Do CDS request
2025-09-30T14:58:21.247370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:21.258797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:21.258931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:21.258950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2874
2025-09-30T14:58:21.259170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2874 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:21.259236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2874 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:21.259264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2874 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:21.259276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:21.259873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2874 sessionId:  describe result for acl check
2025-09-30T14:58:21.259915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:21.259917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:21.259920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:21.259926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896740486745482:7351] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:21.260712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896740486745482:7351] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:21.270696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896740486745482:7351] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:21.274548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896740486745482:7351] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:21.274566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896740486745482:7351] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:21.274570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896740486745482:7351] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:21.274579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2874 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:21.276054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:21.282186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:21.282461Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:21.282475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:21.282489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:21.282550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:21.282606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896740396950974:7795]
2025-09-30T14:58:21.283415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:21.284024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:21.284087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:21.284473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:21.284540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.284541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.284543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.284544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.284546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.284548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.284549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.284551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.284553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.284554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.284556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.284557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.284559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.284560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.284561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.284568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.284581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.284586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.284591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.284596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.284601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.284606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.284611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.284616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.284621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.284626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.284631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.284636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.284641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.284646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.284655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.284663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.284671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.284678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.284686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.284693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.284698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.284704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.284714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.284720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.284726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.284733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.284739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.284745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.284751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.284758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.284767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.284773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.284778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.284783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.284789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.284795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.284800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.284807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.284813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.284819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.284838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.284845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.284850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.284856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.284909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:21.292889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:21.294765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:21.294791Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:21.294794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:21.294799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:21.294807Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2873 [2:7555896740396950974:7795]
2025-09-30T14:58:21.294831Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:21.294851Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:21.294862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:21.294866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:21.294868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:21.294889Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:21.294904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:21.294913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:21.295001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.295011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.295014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.295019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:21.295022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:21.295115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:21.295125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.295143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.295162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.295187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:21.295216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486745665:7351], now have 1 active actors on pipe
2025-09-30T14:58:21.295226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486745452:2454], now have 1 active actors on pipe
2025-09-30T14:58:21.295235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896740396950957:7795]
2025-09-30T14:58:21.295350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2873
2025-09-30T14:58:21.295392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2873
2025-09-30T14:58:21.295718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896740396950957:7795]
2025-09-30T14:58:21.295734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896740396950957:7795]
2025-09-30T14:58:21.295764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:21.295788Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:21.295793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:21.295795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:21.295796Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:21.295821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:21.295825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:21.295850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.295857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.295921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896740396950957:7795]
2025-09-30T14:58:21.295932Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:21.295938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:21.295952Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:21.295975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:21.295981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:21.295984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:21.295997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:21.296010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:21.296061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:21.296370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.296381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.296403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:21.299591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2874 partition: 0 MaxSeqNo: 42 sessionId: src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0
2025-09-30T14:58:21.303370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dcb8a135-733de8ea-4a733c50-d5bc6e1c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:21.306092Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0] Write session: try to update token
2025-09-30T14:58:21.306116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:21.312995Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:21.313021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:21.313024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:21.313026Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:21.313038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896740396950957:7795]
2025-09-30T14:58:21.313044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896740396950957:7795]
2025-09-30T14:58:21.313050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896740396950957:7795]
2025-09-30T14:58:21.313099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:21.313109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.313112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:21.313289Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:21.314616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:21.314624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:21.314630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:21.325796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2874 sessionId: src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:21.328806Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:21.340387Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896740486745682:6545]
2025-09-30T14:58:21.340932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2873, pipe: [1:7555896740486745682:6545]
2025-09-30T14:58:21.436204Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:21.436754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.436770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.436789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486745682:6545], now have 1 active actors on pipe
2025-09-30T14:58:21.437018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:21.437132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896740486745682:6545]
2025-09-30T14:58:21.437158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:21.437164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:21.437306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2874 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0
2025-09-30T14:58:21.437534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2874 sessionId: src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0 is DEAD
2025-09-30T14:58:21.437701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:21.437709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0] Write session will restart in 0.009416s
2025-09-30T14:58:21.437740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0] Write session: Do CDS request
2025-09-30T14:58:21.437748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:21.448995Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:21.449032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:21.449064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2875
2025-09-30T14:58:21.449335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2875 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:21.449380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2875 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:21.449387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2875 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:21.449393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:21.450068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2875 sessionId:  describe result for acl check
2025-09-30T14:58:21.450115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:21.450123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:21.450125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:21.450131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896740486745762:7357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:21.450691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896740486745762:7357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:21.453382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896740486745762:7357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:21.456067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:21.456411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896740486745762:7357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:21.456429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896740486745762:7357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:21.456432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896740486745762:7357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:21.456441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2875 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:21.462706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:21.462937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:21.462951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:21.462974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:21.463032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:21.463070Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896740396951188:7792]
2025-09-30T14:58:21.463749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:21.464258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:21.464313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:21.464664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:21.464723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.464730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.464731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.464732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.464734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.464735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.464737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.464738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.464739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.464741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.464742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.464743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.464745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.464746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.464747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.464753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.464765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.464769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.464774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.464778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.464783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.464791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.464796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.464804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.464809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.464818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.464834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.464843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.464847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.464851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.464859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.464886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.464898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.464908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.464913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.464919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.464929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.464938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.464948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.464955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.464960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.464966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.464971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.464976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.464980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.464986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.464991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.464997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.465002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.465007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.465013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.465018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.465027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.465038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.465044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.465055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.465064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.465069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.465078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.465088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.465141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:21.471228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:21.473102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2874
2025-09-30T14:58:21.473102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2874
2025-09-30T14:58:21.472656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:21.472661Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:21.472664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:21.472668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:21.472676Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2874 [2:7555896740396951188:7792]
2025-09-30T14:58:21.472692Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:21.472707Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:21.472711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:21.472714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:21.472716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:21.472734Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:21.472740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:21.472748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:21.472809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.472811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.472813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.472817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:21.472820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:21.472907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:21.472910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.472926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.472940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.472959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:21.472978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486745898:7357], now have 1 active actors on pipe
2025-09-30T14:58:21.472982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486745687:2454], now have 1 active actors on pipe
2025-09-30T14:58:21.472989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896740396951182:7792]
2025-09-30T14:58:21.472992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896740396951182:7792]
2025-09-30T14:58:21.472994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896740396951182:7792]
2025-09-30T14:58:21.473006Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:21.473019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:21.473021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:21.473028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:21.473030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:21.473033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:21.473036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:21.473071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896740396951182:7792]
2025-09-30T14:58:21.473078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:21.473084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:21.473232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.473237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.473268Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:21.473276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:21.473280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:21.473282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:21.473293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:21.473302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:21.473316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:21.473565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.473574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.473588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:21.473683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2875 partition: 0 MaxSeqNo: 42 sessionId: src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0
2025-09-30T14:58:21.474123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5427fa40-e3019444-e83ddcd0-54f1acba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:21.477394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0] Write session: try to update token
2025-09-30T14:58:21.477418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:21.486532Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:21.486559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:21.486571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896740396951182:7792]
2025-09-30T14:58:21.486638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:21.486647Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:21.486857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:21.487020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:21.487188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:21.487372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:21.487618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:21.487664Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:21.496608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2875 sessionId: src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:21.498822Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:21.498852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:21.498855Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:21.498857Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:21.498870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896740396951182:7792]
2025-09-30T14:58:21.498876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896740396951182:7792]
2025-09-30T14:58:21.498881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896740396951182:7792]
2025-09-30T14:58:21.498934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:21.498943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.498944Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:21.498946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:21.498953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:21.498958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:21.499123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:21.499829Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:21.537494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896740486745923:6545]
2025-09-30T14:58:21.537891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2874, pipe: [1:7555896740486745923:6545]
2025-09-30T14:58:21.618143Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:21.618798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.618815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.618835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486745923:6545], now have 1 active actors on pipe
2025-09-30T14:58:21.619005Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:21.619160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:21.619176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:21.619214Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:21.619233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2875 reason: error at write: Disconnected sessionId: src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0
2025-09-30T14:58:21.619320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896740486745923:6545]
2025-09-30T14:58:21.619417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2875 sessionId: src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0 is DEAD
2025-09-30T14:58:21.619564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:21.619576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0] Write session will restart in 0.006143s
2025-09-30T14:58:21.619602Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0] Write session: Do CDS request
2025-09-30T14:58:21.619610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:21.626865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:21.626950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:21.626977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2876
2025-09-30T14:58:21.627157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2876 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:21.627194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2876 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:21.627205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2876 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:21.627210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:21.627795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2876 sessionId:  describe result for acl check
2025-09-30T14:58:21.627844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:21.627852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:21.627858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:21.627865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896740486745953:7377] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:21.628540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896740486745953:7377] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:21.631716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896740486745953:7377] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:21.635538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896740486745953:7377] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:21.635557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896740486745953:7377] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:21.635562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896740486745953:7377] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:21.635573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2876 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:21.645355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:21.646028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:21.646267Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:21.646281Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:21.646295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:21.646361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:21.646425Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896740396951405:7773]
2025-09-30T14:58:21.647232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:21.647631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:21.647685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:21.648090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:21.648168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.648175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.648177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.648178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.648180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.648181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.648183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.648185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.648186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.648188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.648189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.648191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.648192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.648194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.648195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.648201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.648214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.648218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.648222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.648226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.648231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.648235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.648240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.648244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.648250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.648254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.648258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.648263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.648267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.648271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.648280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.648288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.648295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.648302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.648311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.648317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.648330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.648335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.648346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.648352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.648361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.648367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.648378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.648384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.648395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.648402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.648413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.648425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.648430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.648442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.648448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.648457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.648462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.648470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.648481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.648492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.648497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.648507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.648512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.648522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.648572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:21.654326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:21.655474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:21.655493Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:21.655497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:21.655502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:21.655510Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2875 [2:7555896740396951405:7773]
2025-09-30T14:58:21.655531Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:21.655550Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:21.655559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:21.655563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:21.655566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:21.655587Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:21.655596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:21.655610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:21.655693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.655703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.655706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.655713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:21.655716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:21.655916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2875
2025-09-30T14:58:21.655946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2875
2025-09-30T14:58:21.656613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:21.656630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.656647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.656662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.656690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:21.656724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486746099:7377], now have 1 active actors on pipe
2025-09-30T14:58:21.656737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486745925:2454], now have 1 active actors on pipe
2025-09-30T14:58:21.656761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.656767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.656794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896740396951400:7773]
2025-09-30T14:58:21.656802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896740396951400:7773]
2025-09-30T14:58:21.656805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896740396951400:7773]
2025-09-30T14:58:21.656838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:21.656865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:21.656868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:21.656873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:21.656877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:21.656886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:21.656890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:21.656918Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:21.656933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:21.656938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:21.656940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:21.656954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:21.656973Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:21.657025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896740396951400:7773]
2025-09-30T14:58:21.657038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:21.657044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:21.657052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:21.657308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.657319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.657342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:21.657467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2876 partition: 0 MaxSeqNo: 42 sessionId: src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0
2025-09-30T14:58:21.657956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddbb956d-584242a9-400ad86c-e53d8d18_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:21.661358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0] Write session: try to update token
2025-09-30T14:58:21.661382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:21.670693Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:21.670717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:21.670730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896740396951400:7773]
2025-09-30T14:58:21.670790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:21.671078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:21.671287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:21.671532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:21.671711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:21.672126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:21.672482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:21.672553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:21.681446Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2876 sessionId: src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:21.684868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:21.684936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:21.684961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:21.684964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:21.684966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:21.684976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896740396951400:7773]
2025-09-30T14:58:21.684980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896740396951400:7773]
2025-09-30T14:58:21.684984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896740396951400:7773]
2025-09-30T14:58:21.685026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:21.685033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.685036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:21.685056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:21.685064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:21.685073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:21.685185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:21.719786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896740486746163:6545]
2025-09-30T14:58:21.720210Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2875, pipe: [1:7555896740486746163:6545]
2025-09-30T14:58:21.809601Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:21.809932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.809942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.809962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486746163:6545], now have 1 active actors on pipe
2025-09-30T14:58:21.810391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:21.810407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:21.810474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2876 reason: error at write: Disconnected sessionId: src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0
2025-09-30T14:58:21.810341Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:21.810707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2876 sessionId: src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0 is DEAD
2025-09-30T14:58:21.810741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896740486746163:6545]
2025-09-30T14:58:21.810780Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:21.811498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:21.811511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0] Write session will restart in 0.008367s
2025-09-30T14:58:21.811542Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0] Write session: Do CDS request
2025-09-30T14:58:21.811548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:21.824197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:21.824368Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:21.824391Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2877
2025-09-30T14:58:21.824650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2877 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:21.824691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2877 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:21.824703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2877 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:21.824709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:21.827399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2877 sessionId:  describe result for acl check
2025-09-30T14:58:21.827450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:21.827460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:21.827463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:21.827471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896740486746181:7390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:21.828191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896740486746181:7390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:21.836797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896740486746181:7390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:21.844467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896740486746181:7390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:21.844490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896740486746181:7390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:21.844494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896740486746181:7390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:21.844503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2877 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:21.865417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:21.866652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:21.866943Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:21.866959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:21.866976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:21.867045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:21.867110Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896740396951621:7783]
2025-09-30T14:58:21.867863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:21.868289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:21.868347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:21.868737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:21.868800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.868802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.868804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.868805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.868806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.868808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.868810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.868811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.868813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.868814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.868816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.868818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.868830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.868833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.868834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.868841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.868854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.868860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.868865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.868870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.868875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.868879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.868883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.868889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.868894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.868899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.868904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.868908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.868915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.868920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.868932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.868941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:21.868948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.868955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:21.868961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.868968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:21.868974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.868980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:21.868986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.868993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:21.868999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.869005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:21.869012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.869018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:21.869026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.869032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:21.869037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.869043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:21.869048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.869055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:21.869060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.869067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.869072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.869078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.869084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.869091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.869096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.869103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:21.869108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.869115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:21.869168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:21.878325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:21.879755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:21.879774Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:21.879777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:21.879781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:21.879788Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2876 [2:7555896740396951621:7783]
2025-09-30T14:58:21.879808Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:21.879825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:21.879828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:21.879831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:21.879834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:21.879850Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:21.879856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:21.879863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:21.879927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.879929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.879932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.879935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:21.879939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:21.880011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:21.880025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.880037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:21.880047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:21.880062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:21.880084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896740396951616:7783]
2025-09-30T14:58:21.880094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896740396951616:7783]
2025-09-30T14:58:21.880095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896740396951616:7783]
2025-09-30T14:58:21.880104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:21.880120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:21.880132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:21.880135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:21.880144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486746267:7390], now have 1 active actors on pipe
2025-09-30T14:58:21.880148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486746167:2454], now have 1 active actors on pipe
2025-09-30T14:58:21.880159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:21.880176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:21.880179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:21.880181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896740396951616:7783]
2025-09-30T14:58:21.880183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:21.880199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:21.880637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2876
2025-09-30T14:58:21.880682Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2876
2025-09-30T14:58:21.883484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.883508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.883551Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:21.883571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:21.883578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:21.883582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:21.883599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:21.883626Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:21.883653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:21.887530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:21.887555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:21.887598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:21.891379Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2877 partition: 0 MaxSeqNo: 42 sessionId: src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0
2025-09-30T14:58:21.891914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f227d2c2-7cadaf4e-9f3d1c4a-d4ac124a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:21.897052Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0] Write session: try to update token
2025-09-30T14:58:21.897081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:21.902643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:21.902669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:21.902672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:21.902675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:21.902693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896740396951616:7783]
2025-09-30T14:58:21.902698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896740396951616:7783]
2025-09-30T14:58:21.902703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896740396951616:7783]
2025-09-30T14:58:21.902751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:21.902760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:21.902764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:21.902934Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:21.908321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:21.908343Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:21.908348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:21.910981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896740486746394:6545]
2025-09-30T14:58:21.913488Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2876, pipe: [1:7555896740486746394:6545]
2025-09-30T14:58:21.943821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2877 sessionId: src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:21.948283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:22.029415Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:22.029838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896740486746394:6545], now have 1 active actors on pipe
2025-09-30T14:58:22.029891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.029898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.030359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:22.031012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:22.031025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0] Write session will restart in 0.009723s
2025-09-30T14:58:22.031058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0] Write session: Do CDS request
2025-09-30T14:58:22.031065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:22.030458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896740486746394:6545]
2025-09-30T14:58:22.030498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:22.030501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:22.030597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2877 reason: error at write: Disconnected sessionId: src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0
2025-09-30T14:58:22.030811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2877 sessionId: src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0 is DEAD
2025-09-30T14:58:22.031014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:22.041795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:22.043407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:22.043427Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2878
2025-09-30T14:58:22.043587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2878 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:22.043624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2878 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:22.043631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2878 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:22.043639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:22.044145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2878 sessionId:  describe result for acl check
2025-09-30T14:58:22.044178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:22.044180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:22.044183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:22.044190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896744781713707:7408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:22.044891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896744781713707:7408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:22.050990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896744781713707:7408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:22.068980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896744781713707:7408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:22.069007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896744781713707:7408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:22.069012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896744781713707:7408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:22.069024Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2878 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:22.095586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:22.104226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:22.104459Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:22.104463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:22.104474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:22.104528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:22.104580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896744691919150:7785]
2025-09-30T14:58:22.105292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:22.105917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:22.105965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:22.106308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:22.106364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.106365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.106366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.106367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.106369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.106370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.106371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.106372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.106374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.106375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.106376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.106378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.106379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.106380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.106382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.106387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.106397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.106402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.106406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.106411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.106415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.106419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.106423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.106428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.106432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.106438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.106442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.106447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.106451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.106455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.106463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.106472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.106478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.106484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.106490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.106495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.106517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.106523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.106530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.106536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.106541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.106546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.106552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.106557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.106562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.106567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.106571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.106576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.106581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.106586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.106591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.106596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.106601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.106606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.106611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.106616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.106622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.106628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.106634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.106640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.106684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:22.113393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:22.114438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:22.114444Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:22.114446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:22.114450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:22.114458Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2877 [2:7555896744691919150:7785]
2025-09-30T14:58:22.114475Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:22.114492Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:22.114495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:22.114499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:22.114502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:22.114517Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:22.114524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:22.114531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:22.114590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.114592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.114595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.114599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:22.114604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:22.114675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:22.114679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.114694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.114708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.114729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:22.114747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896744691919132:7785]
2025-09-30T14:58:22.114749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896744691919132:7785]
2025-09-30T14:58:22.114754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896744691919132:7785]
2025-09-30T14:58:22.114768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:22.114781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:22.114796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:22.114799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:22.114831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896744691919132:7785]
2025-09-30T14:58:22.114833Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:22.115347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:22.115353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:22.115355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:22.115360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:22.119347Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2877
2025-09-30T14:58:22.119408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2877
2025-09-30T14:58:22.123345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781713693:2454], now have 1 active actors on pipe
2025-09-30T14:58:22.123361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781713778:7408], now have 1 active actors on pipe
2025-09-30T14:58:22.123385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.123392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.123436Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:22.123448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:22.123452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:22.123455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:22.123469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:22.123485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:22.123518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:22.124663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.124673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.124691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:22.124848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2878 partition: 0 MaxSeqNo: 42 sessionId: src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0
2025-09-30T14:58:22.127365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87c0899-e3aeef9-2b965cea-5908f32c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:22.130307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0] Write session: try to update token
2025-09-30T14:58:22.130329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:22.130704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896744781713930:6545]
2025-09-30T14:58:22.131480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781713930:6545], now have 1 active actors on pipe
2025-09-30T14:58:22.135521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2877, pipe: [1:7555896744781713930:6545]
2025-09-30T14:58:22.141423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:22.141444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:22.141446Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:22.141448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:22.141458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896744691919132:7785]
2025-09-30T14:58:22.141463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896744691919132:7785]
2025-09-30T14:58:22.141467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896744691919132:7785]
2025-09-30T14:58:22.141505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:22.141513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.141516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:22.141646Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:22.142568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:22.142578Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:22.142582Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:22.172677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2878 sessionId: src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:22.175429Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:22.277591Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:22.278136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.278146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.278582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:22.278897Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:22.278957Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896744781713930:6545]
2025-09-30T14:58:22.278975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:22.278978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:22.279040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2878 reason: error at write: Disconnected sessionId: src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0
2025-09-30T14:58:22.279228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2878 sessionId: src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0 is DEAD
2025-09-30T14:58:22.281014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:22.281029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0] Write session will restart in 0.007085s
2025-09-30T14:58:22.281053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0] Write session: Do CDS request
2025-09-30T14:58:22.281060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:22.289798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:22.295483Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:22.295507Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2879
2025-09-30T14:58:22.295776Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2879 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:22.295815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2879 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:22.295822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2879 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:22.295827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:22.296540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2879 sessionId:  describe result for acl check
2025-09-30T14:58:22.296586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:22.296588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:22.296590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:22.296598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896744781713985:7422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:22.297156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896744781713985:7422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:22.306330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896744781713985:7422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:22.311560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896744781713985:7422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:22.311578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896744781713985:7422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:22.311585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896744781713985:7422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:22.311595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2879 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:22.315497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:22.321292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:22.321532Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:22.321537Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:22.321549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:22.321602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:22.321637Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896744691919404:7746]
2025-09-30T14:58:22.322303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:22.322661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:22.322705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:22.323014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:22.323080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.323081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.323083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.323084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.323085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.323086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.323088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.323090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.323091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.323093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.323094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.323096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.323097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.323099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.323100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.323106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.323117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.323121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.323124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.323127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.323132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.323136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.323140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.323144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.323148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.323153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.323158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.323162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.323166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.323170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.323178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.323187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.323194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.323200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.323205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.323210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.323215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.323221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.323226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.323231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.323236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.323259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.323265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.323271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.323275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.323280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.323285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.323291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.323296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.323301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.323305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.323310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.323315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.323320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.323325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.323330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.323335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.323341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.323346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.323352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.323399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:22.329226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:22.330841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:22.330865Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:22.330868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:22.330872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:22.330879Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2878 [2:7555896744691919404:7746]
2025-09-30T14:58:22.330895Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:22.330914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:22.330917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:22.330921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:22.330923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:22.330941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:22.330950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:22.330957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:22.331023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.331036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.331039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.331042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:22.331045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:22.331123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:22.331136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.331152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.331166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.331182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:22.331204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896744691919399:7746]
2025-09-30T14:58:22.331210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896744691919399:7746]
2025-09-30T14:58:22.331212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896744691919399:7746]
2025-09-30T14:58:22.331226Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:22.331269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:22.331292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:22.331295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:22.331330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:22.331333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896744691919399:7746]
2025-09-30T14:58:22.331336Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:22.331346Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:22.331349Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:22.331356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:22.331410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781713948:2454], now have 1 active actors on pipe
2025-09-30T14:58:22.331420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781714141:7422], now have 1 active actors on pipe
2025-09-30T14:58:22.331791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2878
2025-09-30T14:58:22.331842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2878
2025-09-30T14:58:22.331874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.331889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.331930Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5217de85-733982f1-f6a93438-b512d19b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:22.331940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:22.331943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:22.331946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:22.331958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:22.331971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:22.331998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:22.332572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.332585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.332605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:22.332789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2879 partition: 0 MaxSeqNo: 42 sessionId: src_id|5217de85-733982f1-f6a93438-b512d19b_0
2025-09-30T14:58:22.335701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f9b41eb-5a6e75f2-7325a0ec-2e5393ed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5217de85-733982f1-f6a93438-b512d19b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:22.338791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5217de85-733982f1-f6a93438-b512d19b_0] Write session: try to update token
2025-09-30T14:58:22.338819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5217de85-733982f1-f6a93438-b512d19b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:22.345635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:22.345657Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:22.345668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896744691919399:7746]
2025-09-30T14:58:22.345715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:22.345719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:22.345904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:22.346064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:22.346209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:22.346353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:22.346559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:22.346602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:22.356243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2879 sessionId: src_id|5217de85-733982f1-f6a93438-b512d19b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:22.357476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:22.357499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:22.357502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:22.357504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:22.357513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896744691919399:7746]
2025-09-30T14:58:22.357518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896744691919399:7746]
2025-09-30T14:58:22.357522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896744691919399:7746]
2025-09-30T14:58:22.357563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:22.357564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:22.357569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:22.357570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.357572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:22.357572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:22.357721Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:22.358957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:22.378658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896744781714182:6545]
2025-09-30T14:58:22.378973Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2878, pipe: [1:7555896744781714182:6545]
2025-09-30T14:58:22.481370Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:22.482135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.482155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.482178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781714182:6545], now have 1 active actors on pipe
2025-09-30T14:58:22.482400Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:22.482962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896744781714182:6545]
2025-09-30T14:58:22.482997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:22.483026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:22.483361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2879 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5217de85-733982f1-f6a93438-b512d19b_0
2025-09-30T14:58:22.483851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5217de85-733982f1-f6a93438-b512d19b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:22.483875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5217de85-733982f1-f6a93438-b512d19b_0] Write session will restart in 0.008036s
2025-09-30T14:58:22.483899Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5217de85-733982f1-f6a93438-b512d19b_0] Write session: Do CDS request
2025-09-30T14:58:22.483905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5217de85-733982f1-f6a93438-b512d19b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:22.483533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2879 sessionId: src_id|5217de85-733982f1-f6a93438-b512d19b_0 is DEAD
2025-09-30T14:58:22.492884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5217de85-733982f1-f6a93438-b512d19b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:22.493011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:22.493036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2880
2025-09-30T14:58:22.493286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2880 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:22.493335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2880 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:22.493347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2880 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:22.493352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:22.493944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2880 sessionId:  describe result for acl check
2025-09-30T14:58:22.493981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:22.493987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:22.493989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:22.493996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896744781714231:7430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:22.494553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896744781714231:7430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:22.498626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896744781714231:7430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:22.501647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896744781714231:7430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:22.501665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896744781714231:7430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:22.501668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896744781714231:7430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:22.501676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2880 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:22.503845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:22.508346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:22.508569Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:22.508579Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:22.508591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:22.508644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:22.508684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896744691919625:7750]
2025-09-30T14:58:22.509369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:22.509783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:22.509834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:22.510195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:22.510273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.510280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.510281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.510282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.510284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.510285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.510287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.510288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.510289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.510291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.510292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.510294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.510295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.510296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.510297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.510303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.510315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.510319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.510324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.510328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.510333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.510336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.510340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.510343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.510347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.510351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.510355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.510359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.510362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.510366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.510373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.510381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.510386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.510392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.510397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.510402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.510407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.510411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.510416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.510421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.510425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.510430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.510441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.510446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.510455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.510460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.510464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.510475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.510480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.510489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.510494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.510505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.510510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.510515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.510524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.510529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.510536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.510541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.510548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.510557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.510598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:22.519122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2879
2025-09-30T14:58:22.519164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2879
2025-09-30T14:58:22.521494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2880 partition: 0 MaxSeqNo: 42 sessionId: src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0
2025-09-30T14:58:22.517359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:22.518648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:22.518657Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:22.518661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:22.518666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:22.518674Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2879 [2:7555896744691919625:7750]
2025-09-30T14:58:22.518691Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:22.518711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:22.518715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:22.518718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:22.518721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:22.518737Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:22.518745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:22.518754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:22.518827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.518830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.518833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.518837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:22.518840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:22.523379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5217de85-733982f1-f6a93438-b512d19b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:22.526318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0] Write session: try to update token
2025-09-30T14:58:22.526342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:22.518914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:22.518916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.518935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.518948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.518966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:22.518983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896744691919619:7750]
2025-09-30T14:58:22.518986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896744691919619:7750]
2025-09-30T14:58:22.518988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896744691919619:7750]
2025-09-30T14:58:22.518997Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:22.519009Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:22.519011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781714399:7430], now have 1 active actors on pipe
2025-09-30T14:58:22.519013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:22.519015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:22.519015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781714184:2454], now have 1 active actors on pipe
2025-09-30T14:58:22.519023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:22.519040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:22.519043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:22.519084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896744691919619:7750]
2025-09-30T14:58:22.519093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:22.519101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:22.520643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.520656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.520693Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:22.520703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:22.520709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:22.520712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:22.520724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:22.520739Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:22.520760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:22.521335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.521342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.521365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:22.531840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:22.531862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:22.531874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896744691919619:7750]
2025-09-30T14:58:22.531922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:22.531955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:22.532128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:22.532290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:22.532452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:22.532609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:22.532841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:22.532893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:22.543874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:22.543896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:22.543899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:22.543901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:22.543912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896744691919619:7750]
2025-09-30T14:58:22.543917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896744691919619:7750]
2025-09-30T14:58:22.543921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896744691919619:7750]
2025-09-30T14:58:22.543966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:22.543974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.543978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:22.544140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:22.545831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2880 sessionId: src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:22.547325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:22.547344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:22.547349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:22.548675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:22.584065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896744781714425:6545]
2025-09-30T14:58:22.584403Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2879, pipe: [1:7555896744781714425:6545]
2025-09-30T14:58:22.661060Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:22.661649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.661667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.661688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781714425:6545], now have 1 active actors on pipe
2025-09-30T14:58:22.661965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:22.661978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:22.661999Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:22.662004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:22.662038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896744781714425:6545]
2025-09-30T14:58:22.662066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2880 reason: error at write: Disconnected sessionId: src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0
2025-09-30T14:58:22.662250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2880 sessionId: src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0 is DEAD
2025-09-30T14:58:22.662439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:22.662451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0] Write session will restart in 0.006604s
2025-09-30T14:58:22.662475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0] Write session: Do CDS request
2025-09-30T14:58:22.662484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:22.671698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:22.671755Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:22.671772Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2881
2025-09-30T14:58:22.671965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2881 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:22.672009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2881 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:22.672014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2881 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:22.672019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:22.672502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2881 sessionId:  describe result for acl check
2025-09-30T14:58:22.672542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:22.672550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:22.672552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:22.672559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896744781714458:7446] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:22.673119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896744781714458:7446] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:22.678593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896744781714458:7446] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:22.683702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:22.688640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:22.688901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:22.688915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:22.688928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:22.688972Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896744781714458:7446] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:22.688992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896744781714458:7446] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:22.688998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896744781714458:7446] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:22.689008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2881 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:22.689037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:22.689089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896744691919847:7744]
2025-09-30T14:58:22.689781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:22.690162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:22.690236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:22.690617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:22.690688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.690693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.690695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.690696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.690697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.690698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.690699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.690701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.690702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.690703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.690704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.690706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.690707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.690708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.690709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.690715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.690725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.690730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.690734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.690739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.690743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.690747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.690751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.690756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.690760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.690765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.690769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.690773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.690777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.690781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.690789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.690797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.690803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.690809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.690814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.690820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.690824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.690831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.690836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.690841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.690846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.690851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.690856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.690865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.690869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.690875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.690881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.690886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.690891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.690896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.690901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.690906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.690911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.690916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.690924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.690929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.690941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.690946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.690951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.690961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.691001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:22.697571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:22.699077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:22.699093Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:22.699096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:22.699100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:22.699108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2880 [2:7555896744691919847:7744]
2025-09-30T14:58:22.699127Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:22.699143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:22.699152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:22.699155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:22.699158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:22.699174Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:22.699186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:22.699212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:22.699296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.699304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.699306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.699310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:22.699313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:22.699387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:22.699396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.699410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.699423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.699441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:22.699461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781714646:7446], now have 1 active actors on pipe
2025-09-30T14:58:22.699470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781714426:2454], now have 1 active actors on pipe
2025-09-30T14:58:22.699477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896744691919842:7744]
2025-09-30T14:58:22.699484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896744691919842:7744]
2025-09-30T14:58:22.699487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896744691919842:7744]
2025-09-30T14:58:22.699502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:22.699522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:22.699530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:22.699534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:22.699536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:22.699543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:22.699546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:22.699583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896744691919842:7744]
2025-09-30T14:58:22.699597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:22.699624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:22.699845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.699858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.699889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:22.699902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:22.699906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:22.699908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:22.699918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:22.699602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2880
2025-09-30T14:58:22.699646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2880
2025-09-30T14:58:22.699930Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:22.699953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:22.700140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.700148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.700162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:22.700287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2881 partition: 0 MaxSeqNo: 42 sessionId: src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0
2025-09-30T14:58:22.700688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c6ad1583-115308c2-b72257c0-6a2fbd24_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:22.703582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0] Write session: try to update token
2025-09-30T14:58:22.703606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:22.716597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:22.716622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:22.716633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896744691919842:7744]
2025-09-30T14:58:22.716685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:22.716692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:22.716880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:22.717025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:22.717176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:22.717321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:22.717526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:22.717565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:22.720995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2881 sessionId: src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:22.723726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:22.724327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.724356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.724376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:22.724379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:22.724381Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:22.724383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:22.724392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896744691919842:7744]
2025-09-30T14:58:22.724396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896744691919842:7744]
2025-09-30T14:58:22.724400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896744691919842:7744]
2025-09-30T14:58:22.724440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:22.724447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:22.724454Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:22.724454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.724457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:22.724458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:22.724597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:22.762627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896744781714659:6545]
2025-09-30T14:58:22.762929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2880, pipe: [1:7555896744781714659:6545]
2025-09-30T14:58:22.842577Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:22.843123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:22.843157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781714659:6545], now have 1 active actors on pipe
2025-09-30T14:58:22.843264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:22.843373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:22.843384Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:22.843458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2881 reason: error at write: Disconnected sessionId: src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0
2025-09-30T14:58:22.843601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2881 sessionId: src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0 is DEAD
2025-09-30T14:58:22.843665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896744781714659:6545]
2025-09-30T14:58:22.843690Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:22.843753Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:22.843763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0] Write session will restart in 0.006941s
2025-09-30T14:58:22.843788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0] Write session: Do CDS request
2025-09-30T14:58:22.843794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:22.851735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:22.851880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:22.851895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2882
2025-09-30T14:58:22.852642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2882 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:22.852684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2882 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:22.852689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2882 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:22.852693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:22.856663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2882 sessionId:  describe result for acl check
2025-09-30T14:58:22.856707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:22.856709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:22.856714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:22.856720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896744781714686:7456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:22.857316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896744781714686:7456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:22.863406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896744781714686:7456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:22.867903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896744781714686:7456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:22.867920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896744781714686:7456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:22.867924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896744781714686:7456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:22.867933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2882 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:22.879359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:22.884094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:22.884325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:22.884337Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:22.884349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:22.884409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:22.884460Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896744691920070:7735]
2025-09-30T14:58:22.885146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:22.885535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:22.885619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:22.885985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:22.886073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.886075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.886077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.886078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.886079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.886081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.886083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.886084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.886086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.886088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.886089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.886090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.886092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.886093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.886095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.886102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.886113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.886119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.886124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.886128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.886133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.886137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.886141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.886146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.886152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.886156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.886161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.886166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.886171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.886175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.886183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.886193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:22.886199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.886206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:22.886212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.886218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:22.886223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.886229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:22.886235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.886241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:22.886247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.886253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:22.886258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.886264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:22.886269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.886275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:22.886283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.886289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:22.886294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.886300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:22.886305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.886311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.886316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.886322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.886328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.886334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.886338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.886344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:22.886348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.886354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:22.886400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:22.892241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:22.893659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:22.893665Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:22.893668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:22.893672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:22.893679Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2881 [2:7555896744691920070:7735]
2025-09-30T14:58:22.893695Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:22.893711Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:22.893716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:22.893720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:22.893722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:22.893739Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:22.893749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:22.893756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:22.893819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.893821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.893823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.893827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:22.893829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:22.893905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:22.893908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.893920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:22.893933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:22.893952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:22.893970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781714662:2454], now have 1 active actors on pipe
2025-09-30T14:58:22.893975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781714746:7456], now have 1 active actors on pipe
2025-09-30T14:58:22.893981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896744691920065:7735]
2025-09-30T14:58:22.893983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896744691920065:7735]
2025-09-30T14:58:22.893986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896744691920065:7735]
2025-09-30T14:58:22.894000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:22.894014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:22.894029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:22.894032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:22.894038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:22.894043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:22.894045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:22.894067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896744691920065:7735]
2025-09-30T14:58:22.894070Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:22.894083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:22.894231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.894240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.894274Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:22.894283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:22.894287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:22.894290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:22.894312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:22.894324Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:22.894341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:22.894554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:22.894568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:22.894589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:22.895193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2142a0aa-7c1bc8c-77089381-3328db0e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:22.894123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2881
2025-09-30T14:58:22.894126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2881
2025-09-30T14:58:22.894703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2882 partition: 0 MaxSeqNo: 42 sessionId: src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0
2025-09-30T14:58:22.898154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0] Write session: try to update token
2025-09-30T14:58:22.898177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:22.907004Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:22.907022Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:22.907032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896744691920065:7735]
2025-09-30T14:58:22.907081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:22.907079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:22.907325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:22.907486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:22.907637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:22.907780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:22.907980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:22.908016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:22.918752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2882 sessionId: src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:22.920537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:22.920564Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:22.920567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:22.920569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:22.920581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896744691920065:7735]
2025-09-30T14:58:22.920587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896744691920065:7735]
2025-09-30T14:58:22.920596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896744691920065:7735]
2025-09-30T14:58:22.922160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:22.920645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:22.920662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:22.920666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:22.920667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:22.920674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:22.920679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:22.920877Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:22.943994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896744781714891:6545]
2025-09-30T14:58:22.944338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2881, pipe: [1:7555896744781714891:6545]
2025-09-30T14:58:23.054501Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:23.055090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.055108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.055126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896744781714891:6545], now have 1 active actors on pipe
2025-09-30T14:58:23.060352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:23.059751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:23.059813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:23.059816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:23.059904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2882 reason: error at write: Disconnected sessionId: src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0
2025-09-30T14:58:23.060095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2882 sessionId: src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0 is DEAD
2025-09-30T14:58:23.060161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896744781714891:6545]
2025-09-30T14:58:23.063553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:23.063561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0] Write session will restart in 0.006523s
2025-09-30T14:58:23.063588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0] Write session: Do CDS request
2025-09-30T14:58:23.063597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:23.071831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:23.072155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:23.072171Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2883
2025-09-30T14:58:23.072370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2883 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:23.072402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2883 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:23.072408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2883 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:23.072412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:23.072842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2883 sessionId:  describe result for acl check
2025-09-30T14:58:23.072870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:23.072873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:23.072875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:23.072881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896749076682200:7463] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:23.073418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896749076682200:7463] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:23.076903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896749076682200:7463] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:23.083808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896749076682200:7463] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:23.083826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896749076682200:7463] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:23.083829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896749076682200:7463] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:23.083838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2883 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:23.092259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:23.097693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:23.097937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:23.097947Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:23.097958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:23.098015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:23.098058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896748986887592:7733]
2025-09-30T14:58:23.098755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:23.099125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:23.099171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:23.099537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:23.099608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.099615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.099616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.099617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.099619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.099620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.099621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.099623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.099624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.099626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.099627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.099628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.099630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.099631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.099632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.099638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.099649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.099653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.099657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.099661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.099665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.099669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.099673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.099677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.099682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.099686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.099690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.099694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.099698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.099702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.099709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.099717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.099723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.099729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.099734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.099740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.099744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.099750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.099755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.099761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.099765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.099770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.099775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.099781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.099785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.099791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.099796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.099801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.099806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.099812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.099823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.099829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.099839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.099845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.099855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.099861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.099870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.099876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.099881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.099887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.099933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:23.105699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:23.106833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:23.106854Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:23.106857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:23.106861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:23.106871Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2882 [2:7555896748986887592:7733]
2025-09-30T14:58:23.106888Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:23.106907Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:23.106916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:23.106919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:23.106922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:23.106938Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:23.106950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:23.106958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:23.107023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.107031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.107034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.107037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:23.107040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:23.107111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:23.107120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.107133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.107147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.107167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:23.107191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076682269:7463], now have 1 active actors on pipe
2025-09-30T14:58:23.107201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076682190:2454], now have 1 active actors on pipe
2025-09-30T14:58:23.107207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896748986887586:7733]
2025-09-30T14:58:23.107210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896748986887586:7733]
2025-09-30T14:58:23.107212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896748986887586:7733]
2025-09-30T14:58:23.107334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2882
2025-09-30T14:58:23.107375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2882
2025-09-30T14:58:23.107227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:23.107264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:23.107269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:23.107269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:23.107272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:23.107284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:23.107288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:23.107323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896748986887586:7733]
2025-09-30T14:58:23.107331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:23.107337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:23.107917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.107928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.107958Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:23.107968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:23.107972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:23.107975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:23.107985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:23.107996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:23.108011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:23.108214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.108220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.108234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:23.108716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3a01c9c6-d9827b8c-c6298f03-93ec11f0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:23.108324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2883 partition: 0 MaxSeqNo: 42 sessionId: src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0
2025-09-30T14:58:23.111485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0] Write session: try to update token
2025-09-30T14:58:23.111499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:23.120115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:23.120135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:23.120138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:23.120140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:23.120149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896748986887586:7733]
2025-09-30T14:58:23.120153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896748986887586:7733]
2025-09-30T14:58:23.120157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896748986887586:7733]
2025-09-30T14:58:23.120201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:23.120209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.120211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:23.120212Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:23.120219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:23.120222Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:23.120375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:23.136177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2883 sessionId: src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:23.138947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:23.160487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896749076682424:6545]
2025-09-30T14:58:23.160774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2882, pipe: [1:7555896749076682424:6545]
2025-09-30T14:58:23.236438Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:23.236730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.236745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.236766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076682424:6545], now have 1 active actors on pipe
2025-09-30T14:58:23.237015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896749076682424:6545]
2025-09-30T14:58:23.237052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:23.237055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:23.237115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2883 reason: error at write: Disconnected sessionId: src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0
2025-09-30T14:58:23.237262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:23.237904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:23.237918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0] Write session will restart in 0.009943s
2025-09-30T14:58:23.237943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0] Write session: Do CDS request
2025-09-30T14:58:23.237949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:23.237316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2883 sessionId: src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0 is DEAD
2025-09-30T14:58:23.237450Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:23.248855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:23.248942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:23.248962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2884
2025-09-30T14:58:23.249119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2884 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:23.249172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2884 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:23.249177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2884 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:23.249181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:23.249648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2884 sessionId:  describe result for acl check
2025-09-30T14:58:23.249675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:23.249678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:23.249680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:23.249688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896749076682496:7476] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:23.250239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896749076682496:7476] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:23.253007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896749076682496:7476] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:23.256061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896749076682496:7476] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:23.256079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896749076682496:7476] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:23.256082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896749076682496:7476] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:23.256091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2884 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:23.262158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:23.262702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:23.262866Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:23.262876Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:23.262885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:23.262933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:23.262973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896748986887852:7700]
2025-09-30T14:58:23.263643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:23.263968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:23.264013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:23.264353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:23.264422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.264427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.264429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.264430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.264431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.264433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.264434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.264436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.264437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.264438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.264439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.264440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.264441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.264442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.264444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.264449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.264460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.264463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.264468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.264471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.264475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.264479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.264483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.264487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.264490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.264494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.264498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.264502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.264505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.264509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.264518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.264527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.264532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.264537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.264545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.264550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.264555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.264561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.264565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.264570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.264575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.264580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.264585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.264590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.264595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.264600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.264605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.264611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.264615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.264620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.264625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.264630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.264634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.264640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.264645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.264655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.264660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.264664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.264674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.264679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.264730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:23.270804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:23.272291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:23.272313Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:23.272317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:23.272320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:23.272329Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2883 [2:7555896748986887852:7700]
2025-09-30T14:58:23.272347Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:23.272365Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:23.272369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:23.272373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:23.272375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:23.272394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:23.272407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:23.272414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:23.272484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.272492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.272494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.272497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:23.272500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:23.272577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:23.272587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.272600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.272613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.272636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:23.272662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896748986887847:7700]
2025-09-30T14:58:23.272671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896748986887847:7700]
2025-09-30T14:58:23.272673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896748986887847:7700]
2025-09-30T14:58:23.272686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:23.272701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076682668:7476], now have 1 active actors on pipe
2025-09-30T14:58:23.272709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076682451:2454], now have 1 active actors on pipe
2025-09-30T14:58:23.272713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:23.272717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:23.272718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:23.272720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:23.272733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:23.272737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:23.272780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896748986887847:7700]
2025-09-30T14:58:23.272796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:23.272807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:23.274238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2883
2025-09-30T14:58:23.274279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2883
2025-09-30T14:58:23.274537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.274553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.274587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:23.274602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:23.274613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:23.274616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:23.274629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:23.274662Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:23.274684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:23.274943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.274957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.274982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:23.277643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2884 partition: 0 MaxSeqNo: 42 sessionId: src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0
2025-09-30T14:58:23.278132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c071fee1-2ae3bd42-dc5f9ada-7009ad13_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:23.281316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0] Write session: try to update token
2025-09-30T14:58:23.281340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:23.290610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:23.290636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:23.290647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896748986887847:7700]
2025-09-30T14:58:23.290695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:23.290695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:23.290884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:23.291046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:23.291323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:23.291536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:23.292006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:23.292046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:23.301345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2884 sessionId: src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:23.304579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:23.305871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.305898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.305920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:23.305923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:23.305925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:23.305928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:23.305938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896748986887847:7700]
2025-09-30T14:58:23.305942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896748986887847:7700]
2025-09-30T14:58:23.305946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896748986887847:7700]
2025-09-30T14:58:23.305995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:23.306001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.306004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:23.306019Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:23.306037Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:23.306041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:23.306151Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:23.337804Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896749076682686:6545]
2025-09-30T14:58:23.338068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2883, pipe: [1:7555896749076682686:6545]
2025-09-30T14:58:23.430858Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:23.431443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:23.431500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076682686:6545], now have 1 active actors on pipe
2025-09-30T14:58:23.431736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:23.431839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:23.431847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:23.431921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2884 reason: error at write: Disconnected sessionId: src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0
2025-09-30T14:58:23.432082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2884 sessionId: src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0 is DEAD
2025-09-30T14:58:23.432220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:23.432234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0] Write session will restart in 0.008058s
2025-09-30T14:58:23.432268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0] Write session: Do CDS request
2025-09-30T14:58:23.432273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:23.432291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:23.432342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896749076682686:6545]
2025-09-30T14:58:23.441782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:23.441880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:23.441905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2885
2025-09-30T14:58:23.442054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2885 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:23.442095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2885 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:23.442105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2885 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:23.442110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:23.442625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2885 sessionId:  describe result for acl check
2025-09-30T14:58:23.442659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:23.442666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:23.442672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:23.442678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896749076682708:7494] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:23.443289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896749076682708:7494] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:23.448337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896749076682708:7494] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:23.451835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896749076682708:7494] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:23.451855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896749076682708:7494] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:23.451859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896749076682708:7494] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:23.451867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2885 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:23.456730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:23.461499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:23.461738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:23.461748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:23.461760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:23.461817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:23.461916Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896748986888089:7698]
2025-09-30T14:58:23.462519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:23.462909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:23.462964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:23.463359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:23.463430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.463437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.463438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.463439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.463440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.463441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.463443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.463444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.463446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.463447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.463448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.463449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.463450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.463451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.463452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.463458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.463468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.463472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.463476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.463479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.463483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.463487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.463490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.463494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.463498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.463501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.463504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.463508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.463512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.463515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.463526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.463533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.463539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.463544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.463548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.463553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.463557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.463562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.463567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.463572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.463576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.463582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.463587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.463592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.463596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.463601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.463606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.463611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.463616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.463621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.463626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.463631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.463635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.463640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.463659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.463664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.463669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.463673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.463677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.463682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.463724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:23.469960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:23.471806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:23.471832Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:23.471834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:23.471838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:23.471846Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2884 [2:7555896748986888089:7698]
2025-09-30T14:58:23.471865Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:23.471884Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:23.471887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:23.471890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:23.471893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:23.471912Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:23.471920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:23.471928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:23.471993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.472001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.472003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.472006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:23.472009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:23.472083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:23.472091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.472106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.472121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.472137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:23.472160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896748986888084:7698]
2025-09-30T14:58:23.472169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896748986888084:7698]
2025-09-30T14:58:23.472172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896748986888084:7698]
2025-09-30T14:58:23.472181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:23.472194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:23.472212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:23.472217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:23.472218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:23.472221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:23.472223Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:23.472264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076682881:7494], now have 1 active actors on pipe
2025-09-30T14:58:23.472272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896748986888084:7698]
2025-09-30T14:58:23.472280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:23.472287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076682691:2454], now have 1 active actors on pipe
2025-09-30T14:58:23.472299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:23.472359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2884
2025-09-30T14:58:23.472402Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2884
2025-09-30T14:58:23.472487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.472498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.472529Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:23.472542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:23.472550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:23.472552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:23.472562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:23.472577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:23.472602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:23.472989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.472999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.473017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:23.473139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2885 partition: 0 MaxSeqNo: 42 sessionId: src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0
2025-09-30T14:58:23.473519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f6a96d0-610b6fb9-8de49b8e-adb05736_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:23.476282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0] Write session: try to update token
2025-09-30T14:58:23.476300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:23.498228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2885 sessionId: src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:23.501098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:23.507605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.507644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.507667Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:23.507671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:23.507680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896748986888084:7698]
2025-09-30T14:58:23.507738Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:23.507942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:23.508105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:23.508269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:23.508435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:23.508663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:23.508724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:23.508736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:23.508749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:23.508953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:23.512619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:23.512640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:23.512642Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:23.512644Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:23.512654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896748986888084:7698]
2025-09-30T14:58:23.512658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896748986888084:7698]
2025-09-30T14:58:23.512662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896748986888084:7698]
2025-09-30T14:58:23.512703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:23.512707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:23.512709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.512712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:23.512713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:23.512717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:23.512881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:23.532727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896749076682937:6545]
2025-09-30T14:58:23.533116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2884, pipe: [1:7555896749076682937:6545]
2025-09-30T14:58:23.627504Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:23.635059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.635089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.635270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:23.635340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:23.635405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:23.635474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:23.635961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:23.635975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:23.636050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:23.636127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:23.636195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:23.636272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:23.636325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:23.636332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:23.636407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:23.636479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:23.636546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:23.636614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:23.636660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:23.636667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:23.636742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:23.636824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:23.636890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:23.636957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:23.637002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:23.637008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:23.637077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:23.637141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:23.637207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:23.637275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:23.637328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:23.637336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:23.637412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:23.637484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:23.637563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:23.637636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:23.637690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:23.637697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:23.637771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:23.637833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:23.637914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:23.637983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:23.638031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:23.638037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:23.638108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:23.638172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:23.638238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:23.638350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:23.638396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:23.638404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:23.638480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:23.638543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:23.638608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:23.638679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:23.638726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:23.638734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:23.638804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:23.638865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:23.638935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:23.638999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:23.639042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:23.639051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:23.639130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076682937:6545], now have 1 active actors on pipe
2025-09-30T14:58:23.639390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:23.639405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:23.639436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2885 reason: error at write: Disconnected sessionId: src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0
2025-09-30T14:58:23.639727Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:23.639800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:23.639821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0] Write session will restart in 0.007052s
2025-09-30T14:58:23.639845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0] Write session: Do CDS request
2025-09-30T14:58:23.639851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:23.639628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2885 sessionId: src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0 is DEAD
2025-09-30T14:58:23.639700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:23.639752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896749076682937:6545]
2025-09-30T14:58:23.647810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:23.647895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:23.647913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2886
2025-09-30T14:58:23.648027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2886 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:23.648056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2886 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:23.648061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2886 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:23.648066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:23.648498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2886 sessionId:  describe result for acl check
2025-09-30T14:58:23.648541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:23.648548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:23.648550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:23.648555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896749076682955:7511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:23.649036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896749076682955:7511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:23.651766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896749076682955:7511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:23.658008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896749076682955:7511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:23.658026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896749076682955:7511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:23.658030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896749076682955:7511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:23.658038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2886 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:23.664425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:23.668610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:23.668875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:23.668887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:23.668901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:23.668976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:23.669021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896748986888317:7695]
2025-09-30T14:58:23.669696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:23.670071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:23.670121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:23.670460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:23.670538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.670545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.670546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.670547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.670549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.670550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.670551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.670552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.670553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.670554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.670556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.670557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.670558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.670559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.670560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.670566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.670576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.670579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.670583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.670586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.670590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.670593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.670597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.670600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.670606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.670609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.670613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.670616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.670620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.670623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.670632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.670639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.670646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.670651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.670655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.670659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.670664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.670669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.670677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.670681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.670685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.670689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.670694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.670698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.670703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.670707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.670712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.670717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.670724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.670730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.670736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.670741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.670746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.670751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.670755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.670759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.670775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.670780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.670784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.670790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.670833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:23.676640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:23.678244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:23.678265Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:23.678268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:23.678272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:23.678279Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2885 [2:7555896748986888317:7695]
2025-09-30T14:58:23.678296Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:23.678311Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:23.678315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:23.678318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:23.678321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:23.678336Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:23.678343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:23.678351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:23.678423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.678433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.678436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.678439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:23.678442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:23.678508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:23.678516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.678529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.678547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.678571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:23.678591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896748986888312:7695]
2025-09-30T14:58:23.678598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896748986888312:7695]
2025-09-30T14:58:23.678601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896748986888312:7695]
2025-09-30T14:58:23.678615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:23.678628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:23.678648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:23.678655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:23.678666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:23.678676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:23.678679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:23.678688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896748986888312:7695]
2025-09-30T14:58:23.678697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:23.678769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:23.678851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076682939:2454], now have 1 active actors on pipe
2025-09-30T14:58:23.678866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076683099:7511], now have 1 active actors on pipe
2025-09-30T14:58:23.678957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2885
2025-09-30T14:58:23.678984Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2885
2025-09-30T14:58:23.679066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.679078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.679106Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|771af3f5-9c0b3127-a273388e-95f7647b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:23.679119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:23.679123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:23.679142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:23.679154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:23.679169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:23.679187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:23.679379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.679387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.679403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:23.679625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2886 partition: 0 MaxSeqNo: 42 sessionId: src_id|771af3f5-9c0b3127-a273388e-95f7647b_0
2025-09-30T14:58:23.680036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53953ec0-cd56dcb7-f6f63962-c63bb3f7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|771af3f5-9c0b3127-a273388e-95f7647b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:23.682982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|771af3f5-9c0b3127-a273388e-95f7647b_0] Write session: try to update token
2025-09-30T14:58:23.683003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|771af3f5-9c0b3127-a273388e-95f7647b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:23.691534Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:23.691557Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:23.691559Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:23.691561Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:23.691570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896748986888312:7695]
2025-09-30T14:58:23.691575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896748986888312:7695]
2025-09-30T14:58:23.691580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896748986888312:7695]
2025-09-30T14:58:23.691623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:23.691629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.691632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:23.691631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:23.691641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:23.691646Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:23.691801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:23.698373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2886 sessionId: src_id|771af3f5-9c0b3127-a273388e-95f7647b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:23.701182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:23.740085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896749076683174:6545]
2025-09-30T14:58:23.740456Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2885, pipe: [1:7555896749076683174:6545]
2025-09-30T14:58:23.810004Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:23.810332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.810341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.810382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076683174:6545], now have 1 active actors on pipe
2025-09-30T14:58:23.810872Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:23.810920Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:23.810974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:23.810977Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:23.811042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2886 reason: error at write: Disconnected sessionId: src_id|771af3f5-9c0b3127-a273388e-95f7647b_0
2025-09-30T14:58:23.811441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771af3f5-9c0b3127-a273388e-95f7647b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:23.811453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771af3f5-9c0b3127-a273388e-95f7647b_0] Write session will restart in 0.005599s
2025-09-30T14:58:23.811477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771af3f5-9c0b3127-a273388e-95f7647b_0] Write session: Do CDS request
2025-09-30T14:58:23.811483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771af3f5-9c0b3127-a273388e-95f7647b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:23.811111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896749076683174:6545]
2025-09-30T14:58:23.811254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2886 sessionId: src_id|771af3f5-9c0b3127-a273388e-95f7647b_0 is DEAD
2025-09-30T14:58:23.823767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|771af3f5-9c0b3127-a273388e-95f7647b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:23.823864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:23.823882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2887
2025-09-30T14:58:23.824045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2887 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:23.824081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2887 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:23.824087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2887 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:23.824091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:23.824680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2887 sessionId:  describe result for acl check
2025-09-30T14:58:23.824728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:23.824730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:23.824733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:23.824739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896749076683193:7518] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:23.825368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896749076683193:7518] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:23.828229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896749076683193:7518] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:23.838141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896749076683193:7518] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:23.838158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896749076683193:7518] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:23.838162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896749076683193:7518] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:23.838171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2887 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:23.840834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:23.846405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:23.846650Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:23.846661Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:23.846673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:23.846734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:23.846774Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896748986888545:7689]
2025-09-30T14:58:23.847591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:23.850073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:23.850142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:23.850525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:23.850600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.850601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.850603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.850604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.850605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.850607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.850608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.850609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.850610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.850612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.850614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.850615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.850617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.850618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.850619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.850625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.850636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.850649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.850653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.850657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.850661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.850665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.850669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.850672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.850677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.850681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.850685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.850689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.850692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.850696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.850707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.850715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:23.850721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.850726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:23.850730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.850736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:23.850739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.850744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:23.850749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.850754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:23.850759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.850764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:23.850769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.850774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:23.850778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.850784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:23.850788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.850793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:23.850800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.850805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:23.850810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.850815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.850819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.850824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.850829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.850834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.850838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.850843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:23.850849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.850853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:23.850896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:23.857188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:23.858240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:23.858246Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:23.858249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:23.858254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:23.858262Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2886 [2:7555896748986888545:7689]
2025-09-30T14:58:23.858281Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:23.858299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:23.858303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:23.858306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:23.858309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:23.858325Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:23.858332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:23.858341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:23.858405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.858408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.858410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.858414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:23.858417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:23.858494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:23.858497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.858510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:23.858521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:23.858536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:23.858553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896748986888539:7689]
2025-09-30T14:58:23.858556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896748986888539:7689]
2025-09-30T14:58:23.858559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896748986888539:7689]
2025-09-30T14:58:23.858570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:23.858578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:23.858584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:23.858585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:23.858586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:23.858599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:23.858602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:23.858612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076683177:2454], now have 1 active actors on pipe
2025-09-30T14:58:23.858619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076683398:7518], now have 1 active actors on pipe
2025-09-30T14:58:23.858655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896748986888539:7689]
2025-09-30T14:58:23.858665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:23.858675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:23.858852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2886
2025-09-30T14:58:23.858893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2886
2025-09-30T14:58:23.859168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.859180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.859206Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9581989e-16a80d91-157d1c98-6881d5ab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:23.859214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:23.859217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:23.859219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:23.859229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:23.859258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:23.859273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:23.859783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2887 partition: 0 MaxSeqNo: 42 sessionId: src_id|9581989e-16a80d91-157d1c98-6881d5ab_0
2025-09-30T14:58:23.859629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.859637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.859654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:23.867375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|771af3f5-9c0b3127-a273388e-95f7647b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9581989e-16a80d91-157d1c98-6881d5ab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:23.870310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9581989e-16a80d91-157d1c98-6881d5ab_0] Write session: try to update token
2025-09-30T14:58:23.870334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9581989e-16a80d91-157d1c98-6881d5ab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:23.874290Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:23.874309Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:23.874311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:23.874312Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:23.874320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896748986888539:7689]
2025-09-30T14:58:23.874323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896748986888539:7689]
2025-09-30T14:58:23.874326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896748986888539:7689]
2025-09-30T14:58:23.874359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:23.874365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:23.874366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:23.874499Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:23.876865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:23.876881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:23.876886Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:23.892357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2887 sessionId: src_id|9581989e-16a80d91-157d1c98-6881d5ab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:23.895215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:23.911612Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896749076683414:6545]
2025-09-30T14:58:23.913234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2886, pipe: [1:7555896749076683414:6545]
2025-09-30T14:58:23.996455Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:23.997304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:23.997320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:23.997336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076683414:6545], now have 1 active actors on pipe
2025-09-30T14:58:23.997731Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:23.997639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896749076683414:6545]
2025-09-30T14:58:23.997679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:23.997682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:23.997746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2887 reason: error at write: Disconnected sessionId: src_id|9581989e-16a80d91-157d1c98-6881d5ab_0
2025-09-30T14:58:23.997868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:23.997950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2887 sessionId: src_id|9581989e-16a80d91-157d1c98-6881d5ab_0 is DEAD
2025-09-30T14:58:23.999629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9581989e-16a80d91-157d1c98-6881d5ab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:23.999640Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9581989e-16a80d91-157d1c98-6881d5ab_0] Write session will restart in 0.005048s
2025-09-30T14:58:23.999665Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9581989e-16a80d91-157d1c98-6881d5ab_0] Write session: Do CDS request
2025-09-30T14:58:23.999672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9581989e-16a80d91-157d1c98-6881d5ab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:24.005714Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9581989e-16a80d91-157d1c98-6881d5ab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:24.007533Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:24.007548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2888
2025-09-30T14:58:24.007730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2888 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:24.007759Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2888 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:24.007765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2888 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:24.007769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:24.008200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2888 sessionId:  describe result for acl check
2025-09-30T14:58:24.008230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:24.008232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:24.008235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:24.008241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896753371650739:7533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:24.008763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896753371650739:7533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:24.011227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896753371650739:7533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:24.017402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896753371650739:7533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:24.017419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896753371650739:7533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:24.017423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896753371650739:7533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:24.017433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2888 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:24.036313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:24.044134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:24.044411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:24.044427Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:24.044440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:24.044508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:24.044553Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896753281856069:7692]
2025-09-30T14:58:24.045213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:24.046638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:24.046723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:24.047152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:24.047229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.047238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.047240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.047241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.047256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.047258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.047259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.047261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.047263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.047264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.047266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.047267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.047268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.047270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.047271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.047278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.047289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.047294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.047298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.047303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.047308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.047313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.047318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.047323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.047328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.047332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.047337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.047341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.047345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.047349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.047360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.047369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.047377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.047383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.047389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.047395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.047410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.047423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.047429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.047435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.047440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.047447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.047452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.047459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.047464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.047471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.047476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.047483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.047488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.047495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.047501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.047508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.047513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.047519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.047529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.047535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.047540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.047545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.047551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.047558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.047611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:24.053387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:24.054694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:24.054716Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:24.054719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:24.054724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:24.054732Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2887 [2:7555896753281856069:7692]
2025-09-30T14:58:24.054750Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:24.054765Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:24.054773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:24.054777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:24.054779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:24.054796Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:24.054803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:24.054816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:24.055479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2887
2025-09-30T14:58:24.055514Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2887
2025-09-30T14:58:24.056411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9581989e-16a80d91-157d1c98-6881d5ab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:24.054877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.054884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.054886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.054890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:24.054892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:24.054961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:24.054964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.054977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.054989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.055007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:24.055023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896753281856063:7692]
2025-09-30T14:58:24.055025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896753281856063:7692]
2025-09-30T14:58:24.055028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896753281856063:7692]
2025-09-30T14:58:24.055037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:24.055054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:24.055057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:24.055061Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:24.055063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:24.055069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:24.055072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:24.055081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371650874:7533], now have 1 active actors on pipe
2025-09-30T14:58:24.055085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896749076683418:2454], now have 1 active actors on pipe
2025-09-30T14:58:24.055119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896753281856063:7692]
2025-09-30T14:58:24.055128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:24.055281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:24.055556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.055564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.055587Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:24.055594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:24.055598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:24.055600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:24.055608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:24.055617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:24.055628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:24.055813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.055819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.055840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:24.059132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0] Write session: try to update token
2025-09-30T14:58:24.059149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:24.056005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2888 partition: 0 MaxSeqNo: 42 sessionId: src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0
2025-09-30T14:58:24.072871Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:24.072891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:24.072893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:24.072895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:24.072909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896753281856063:7692]
2025-09-30T14:58:24.072914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896753281856063:7692]
2025-09-30T14:58:24.072917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896753281856063:7692]
2025-09-30T14:58:24.072956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:24.072971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:24.072976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:24.072976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.072979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:24.072987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:24.073135Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:24.075342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2888 sessionId: src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:24.077956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:24.097991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896753371650948:6545]
2025-09-30T14:58:24.098212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2887, pipe: [1:7555896753371650948:6545]
2025-09-30T14:58:24.190839Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:24.191534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.191554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.191600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371650948:6545], now have 1 active actors on pipe
2025-09-30T14:58:24.191853Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:24.192623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:24.192632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0] Write session will restart in 0.008421s
2025-09-30T14:58:24.192656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0] Write session: Do CDS request
2025-09-30T14:58:24.192662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:24.192164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:24.192180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:24.192240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2888 reason: error at write: Disconnected sessionId: src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0
2025-09-30T14:58:24.192408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2888 sessionId: src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0 is DEAD
2025-09-30T14:58:24.192589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896753371650948:6545]
2025-09-30T14:58:24.192605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:24.202775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:24.203137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:24.203156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2889
2025-09-30T14:58:24.203398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2889 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:24.203430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2889 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:24.203435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2889 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:24.203439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:24.203894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2889 sessionId:  describe result for acl check
2025-09-30T14:58:24.203929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:24.203931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:24.203933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:24.203938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896753371650959:7542] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:24.204478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896753371650959:7542] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:24.207439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896753371650959:7542] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:24.213571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896753371650959:7542] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:24.213587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896753371650959:7542] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:24.213591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896753371650959:7542] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:24.213600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2889 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:24.226656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:24.232146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:24.232426Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:24.232443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:24.232457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:24.232543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:24.232591Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896753281856300:7685]
2025-09-30T14:58:24.233311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:24.233958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:24.234036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:24.234444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:24.234525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.234532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.234534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.234535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.234536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.234537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.234539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.234541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.234543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.234544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.234545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.234546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.234548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.234549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.234550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.234557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.234570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.234574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.234578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.234583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.234588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.234591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.234595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.234600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.234605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.234609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.234613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.234618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.234621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.234625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.234635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.234644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.234652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.234659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.234665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.234670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.234674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.234681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.234687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.234693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.234698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.234704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.234709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.234714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.234719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.234724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.234730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.234736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.234742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.234747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.234762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.234768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.234774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.234780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.234786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.234792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.234797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.234803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.234812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.234818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.234871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:24.244071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:24.245384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:24.245407Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:24.245411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:24.245415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:24.245422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2888 [2:7555896753281856300:7685]
2025-09-30T14:58:24.245444Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:24.245461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:24.245465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:24.245469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:24.245471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:24.245491Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:24.245505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:24.245512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:24.245585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.245590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.245592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.245596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:24.245599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:24.245675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:24.245684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.245699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.245711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.245729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:24.245749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371651023:7542], now have 1 active actors on pipe
2025-09-30T14:58:24.245763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371650951:2454], now have 1 active actors on pipe
2025-09-30T14:58:24.245770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896753281856295:7685]
2025-09-30T14:58:24.245778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896753281856295:7685]
2025-09-30T14:58:24.245781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896753281856295:7685]
2025-09-30T14:58:24.245794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:24.245828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:24.245834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:24.245849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:24.245849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:24.245852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:24.245855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:24.245898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896753281856295:7685]
2025-09-30T14:58:24.245910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:24.246164Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:24.246515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.246535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.246568Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bc88278-51a32c01-38e85c16-d271206a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:24.246582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:24.246586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:24.246588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:24.246599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:24.246616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:24.246641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:24.247020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.247037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.247061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:24.245939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2888
2025-09-30T14:58:24.245972Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2888
2025-09-30T14:58:24.247194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2889 partition: 0 MaxSeqNo: 42 sessionId: src_id|1bc88278-51a32c01-38e85c16-d271206a_0
2025-09-30T14:58:24.247698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c004e1-32c2ae5e-ab465f78-da5a52bc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1bc88278-51a32c01-38e85c16-d271206a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:24.250774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc88278-51a32c01-38e85c16-d271206a_0] Write session: try to update token
2025-09-30T14:58:24.250793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc88278-51a32c01-38e85c16-d271206a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:24.263466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:24.263491Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:24.263494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:24.263496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:24.263506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896753281856295:7685]
2025-09-30T14:58:24.263511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896753281856295:7685]
2025-09-30T14:58:24.263515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896753281856295:7685]
2025-09-30T14:58:24.263561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:24.263568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.263576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:24.263737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:24.264338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:24.264356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:24.264360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:24.273733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2889 sessionId: src_id|1bc88278-51a32c01-38e85c16-d271206a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:24.277124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:24.294658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896753371651206:6545]
2025-09-30T14:58:24.298051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2888, pipe: [1:7555896753371651206:6545]
2025-09-30T14:58:24.383627Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:24.383678Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:58:24.384345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.384361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.384380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371651206:6545], now have 1 active actors on pipe
2025-09-30T14:58:24.384603Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:24.384665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896753371651206:6545]
2025-09-30T14:58:24.384702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:24.384802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2889 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1bc88278-51a32c01-38e85c16-d271206a_0
2025-09-30T14:58:24.384959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2889 sessionId: src_id|1bc88278-51a32c01-38e85c16-d271206a_0 is DEAD
2025-09-30T14:58:24.384969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:24.385123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc88278-51a32c01-38e85c16-d271206a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:24.385132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc88278-51a32c01-38e85c16-d271206a_0] Write session will restart in 0.005614s
2025-09-30T14:58:24.385157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc88278-51a32c01-38e85c16-d271206a_0] Write session: Do CDS request
2025-09-30T14:58:24.385164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc88278-51a32c01-38e85c16-d271206a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:24.391762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc88278-51a32c01-38e85c16-d271206a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:24.391838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:24.391858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2890
2025-09-30T14:58:24.392054Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2890 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:24.392096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2890 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:24.392107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2890 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:24.392112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:24.392578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2890 sessionId:  describe result for acl check
2025-09-30T14:58:24.392606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:24.392611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:24.392613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:24.392617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896753371651236:7565] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:24.393179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896753371651236:7565] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:24.395509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896753371651236:7565] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:24.399224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896753371651236:7565] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:24.399259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896753371651236:7565] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:24.399263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896753371651236:7565] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:24.399272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2890 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:24.404905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:24.410273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:24.410577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:24.410588Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:24.410601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:24.410671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:24.410720Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896753281856578:7645]
2025-09-30T14:58:24.411467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:24.411891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:24.411953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:24.412314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:24.412397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.412405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.412406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.412408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.412409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.412411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.412412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.412413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.412414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.412415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.412416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.412418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.412419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.412420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.412422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.412428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.412438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.412442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.412446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.412450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.412454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.412457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.412460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.412464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.412468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.412472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.412476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.412480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.412483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.412487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.412496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.412504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.412511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.412517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.412522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.412533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.412541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.412552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.412557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.412568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.412573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.412578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.412586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.412591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.412596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.412601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.412613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.412618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.412629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.412634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.412652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.412657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.412662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.412667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.412672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.412678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.412683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.412688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.412693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.412700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.412746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:24.418837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:24.419845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:24.419864Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:24.419868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:24.419872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:24.419880Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2889 [2:7555896753281856578:7645]
2025-09-30T14:58:24.419897Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:24.419915Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:24.419918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:24.419922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:24.419924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:24.419941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:24.419953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:24.419960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:24.420031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.420038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.420040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.420044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:24.420047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:24.420109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:24.420120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.420133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.420143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.420159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:24.420175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896753281856573:7645]
2025-09-30T14:58:24.420183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896753281856573:7645]
2025-09-30T14:58:24.420187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896753281856573:7645]
2025-09-30T14:58:24.420200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:24.420210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:24.420213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:24.420215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371651351:7565], now have 1 active actors on pipe
2025-09-30T14:58:24.420216Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:24.420218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371651221:2454], now have 1 active actors on pipe
2025-09-30T14:58:24.420226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:24.420239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:24.420250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:24.420299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2889
2025-09-30T14:58:24.420571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2889
2025-09-30T14:58:24.420285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896753281856573:7645]
2025-09-30T14:58:24.420296Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:24.420331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:24.420997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.421015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.421043Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7380292-83447c2b-c121cc55-d033d357_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:24.421053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:24.421062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:24.421065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:24.421076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:24.421093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:24.421113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:24.421349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.421360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.421379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:24.421498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2890 partition: 0 MaxSeqNo: 42 sessionId: src_id|e7380292-83447c2b-c121cc55-d033d357_0
2025-09-30T14:58:24.421881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc88278-51a32c01-38e85c16-d271206a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e7380292-83447c2b-c121cc55-d033d357_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:24.425459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7380292-83447c2b-c121cc55-d033d357_0] Write session: try to update token
2025-09-30T14:58:24.425483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7380292-83447c2b-c121cc55-d033d357_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:24.435806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:24.435831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:24.435834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:24.435836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:24.435846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896753281856573:7645]
2025-09-30T14:58:24.435852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896753281856573:7645]
2025-09-30T14:58:24.435856Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896753281856573:7645]
2025-09-30T14:58:24.435902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:24.435909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.435908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:24.435912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:24.435916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:24.435921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:24.436073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:24.449441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2890 sessionId: src_id|e7380292-83447c2b-c121cc55-d033d357_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:24.452599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:24.491147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896753371651459:6545]
2025-09-30T14:58:24.496966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2889, pipe: [1:7555896753371651459:6545]
2025-09-30T14:58:24.559488Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:24.559840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.559862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.559893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371651459:6545], now have 1 active actors on pipe
2025-09-30T14:58:24.560213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896753371651459:6545]
2025-09-30T14:58:24.560215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:24.560221Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:24.560256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:24.560282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2890 reason: error at write: Disconnected sessionId: src_id|e7380292-83447c2b-c121cc55-d033d357_0
2025-09-30T14:58:24.560185Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:24.560467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2890 sessionId: src_id|e7380292-83447c2b-c121cc55-d033d357_0 is DEAD
2025-09-30T14:58:24.563479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7380292-83447c2b-c121cc55-d033d357_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:24.563496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7380292-83447c2b-c121cc55-d033d357_0] Write session will restart in 0.006212s
2025-09-30T14:58:24.563523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7380292-83447c2b-c121cc55-d033d357_0] Write session: Do CDS request
2025-09-30T14:58:24.563529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7380292-83447c2b-c121cc55-d033d357_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:24.571282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7380292-83447c2b-c121cc55-d033d357_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:24.571305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:24.571322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2891
2025-09-30T14:58:24.571515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2891 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:24.571550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2891 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:24.571559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2891 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:24.571563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:24.572096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2891 sessionId:  describe result for acl check
2025-09-30T14:58:24.572130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:24.572132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:24.572133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:24.572139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896753371651531:7559] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:24.572674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896753371651531:7559] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:24.575682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896753371651531:7559] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:24.578980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896753371651531:7559] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:24.578997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896753371651531:7559] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:24.579000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896753371651531:7559] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:24.579009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2891 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:24.579662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:24.584400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:24.584664Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:24.584675Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:24.584687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:24.584752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:24.584822Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896753281856811:7643]
2025-09-30T14:58:24.585494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:24.585831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:24.585880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:24.586223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:24.586294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.586299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.586301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.586302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.586303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.586305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.586306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.586307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.586309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.586310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.586312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.586313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.586315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.586316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.586317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.586323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.586335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.586339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.586344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.586347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.586352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.586356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.586361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.586365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.586370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.586374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.586379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.586383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.586387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.586391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.586398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.586406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.586412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.586418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.586423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.586430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.586434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.586440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.586446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.586451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.586456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.586462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.586467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.586473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.586478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.586483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.586488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.586493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.586498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.586506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.586510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.586515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.586520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.586524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.586528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.586533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.586538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.586542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.586546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.586551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.586599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:24.592323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:24.593948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:24.593966Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:24.593969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:24.593972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:24.593980Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2890 [2:7555896753281856811:7643]
2025-09-30T14:58:24.593998Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:24.594015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:24.594024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:24.594027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:24.594029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:24.594047Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:24.594055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:24.594061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:24.594124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.594131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.594133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.594136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:24.594139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:24.594203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:24.594211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.594225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.594241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.594263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:24.594286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896753281856806:7643]
2025-09-30T14:58:24.594289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896753281856806:7643]
2025-09-30T14:58:24.594291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896753281856806:7643]
2025-09-30T14:58:24.594301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:24.594310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:24.594314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:24.594315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371651700:7559], now have 1 active actors on pipe
2025-09-30T14:58:24.594316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:24.594321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371651473:2454], now have 1 active actors on pipe
2025-09-30T14:58:24.594326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:24.594340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:24.594343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:24.594378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896753281856806:7643]
2025-09-30T14:58:24.594386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:24.594397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:24.594360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2890
2025-09-30T14:58:24.594362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2890
2025-09-30T14:58:24.594419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.594431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.594462Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f3ae424-54572889-1d443d95-77f7b1de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:24.594474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:24.594477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:24.594480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:24.594491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:24.594504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:24.594524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:24.594712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.594725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.594747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:24.594852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2891 partition: 0 MaxSeqNo: 42 sessionId: src_id|7f3ae424-54572889-1d443d95-77f7b1de_0
2025-09-30T14:58:24.595299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7380292-83447c2b-c121cc55-d033d357_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7f3ae424-54572889-1d443d95-77f7b1de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:24.598305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3ae424-54572889-1d443d95-77f7b1de_0] Write session: try to update token
2025-09-30T14:58:24.598326Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3ae424-54572889-1d443d95-77f7b1de_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:24.606692Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:24.606715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:24.606726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896753281856806:7643]
2025-09-30T14:58:24.606773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:24.606782Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:24.606957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:24.607116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:24.607306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:24.607458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:24.607671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:24.607718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:24.613782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2891 sessionId: src_id|7f3ae424-54572889-1d443d95-77f7b1de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:24.616645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:24.617816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.617843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.617863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:24.617866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:24.617869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:24.617871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:24.617881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896753281856806:7643]
2025-09-30T14:58:24.617885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896753281856806:7643]
2025-09-30T14:58:24.617889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896753281856806:7643]
2025-09-30T14:58:24.617937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:24.617937Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:24.617948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.617951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:24.617954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:24.617960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:24.618093Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:24.660188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896753371651713:6545]
2025-09-30T14:58:24.660519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2890, pipe: [1:7555896753371651713:6545]
2025-09-30T14:58:24.734993Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:24.735493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:24.735530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371651713:6545], now have 1 active actors on pipe
2025-09-30T14:58:24.736483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:24.736526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:24.736575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:24.736581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896753371651713:6545]
2025-09-30T14:58:24.736584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:24.736656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2891 reason: error at write: Disconnected sessionId: src_id|7f3ae424-54572889-1d443d95-77f7b1de_0
2025-09-30T14:58:24.736798Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2891 sessionId: src_id|7f3ae424-54572889-1d443d95-77f7b1de_0 is DEAD
2025-09-30T14:58:24.736929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3ae424-54572889-1d443d95-77f7b1de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:24.736938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3ae424-54572889-1d443d95-77f7b1de_0] Write session will restart in 0.005710s
2025-09-30T14:58:24.736961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3ae424-54572889-1d443d95-77f7b1de_0] Write session: Do CDS request
2025-09-30T14:58:24.736966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3ae424-54572889-1d443d95-77f7b1de_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:24.743745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3ae424-54572889-1d443d95-77f7b1de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:24.743853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:24.743870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2892
2025-09-30T14:58:24.744009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2892 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:24.744044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2892 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:24.744061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2892 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:24.744064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:24.744514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2892 sessionId:  describe result for acl check
2025-09-30T14:58:24.744547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:24.744549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:24.744551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:24.744557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896753371651731:7580] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:24.745132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896753371651731:7580] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:24.747414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896753371651731:7580] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:24.751023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896753371651731:7580] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:24.751039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896753371651731:7580] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:24.751042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896753371651731:7580] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:24.751049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2892 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:24.760721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:24.761418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:24.761901Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:24.761916Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:24.761931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:24.762005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:24.762050Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896753281857043:7640]
2025-09-30T14:58:24.762725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:24.763069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:24.763123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:24.763512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:24.763588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.763594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.763596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.763597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.763598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.763599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.763601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.763602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.763603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.763604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.763605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.763606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.763607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.763609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.763610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.763616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.763627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.763631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.763635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.763638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.763642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.763645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.763649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.763653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.763660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.763664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.763669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.763673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.763677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.763681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.763689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.763698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.763704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.763710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.763718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.763733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.763737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.763743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.763748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.763752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.763756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.763760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.763764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.763769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.763774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.763780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.763785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.763791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.763795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.763801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.763807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.763813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.763823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.763829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.763835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.763844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.763850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.763861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.763866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.763873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.763922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:24.769578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:24.770921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:24.770939Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:24.770942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:24.770946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:24.770957Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2891 [2:7555896753281857043:7640]
2025-09-30T14:58:24.770975Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:24.770992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:24.771001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:24.771004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:24.771007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:24.771024Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:24.771036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:24.771047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:24.771110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.771117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.771120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.771123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:24.771126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:24.771198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:24.771209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.771222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.771235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.771272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:24.771291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371651715:2454], now have 1 active actors on pipe
2025-09-30T14:58:24.771295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371651857:7580], now have 1 active actors on pipe
2025-09-30T14:58:24.771302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896753281857038:7640]
2025-09-30T14:58:24.771304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896753281857038:7640]
2025-09-30T14:58:24.771306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896753281857038:7640]
2025-09-30T14:58:24.771320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:24.771334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:24.771334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:24.771338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:24.771340Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:24.771350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:24.771354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:24.771387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896753281857038:7640]
2025-09-30T14:58:24.771397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:24.771399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:24.771363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2891
2025-09-30T14:58:24.771406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2891
2025-09-30T14:58:24.771536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.771548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.771571Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:24.771583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:24.771587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:24.771594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:24.771605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:24.771619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:24.771638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:24.771812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.771823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.771836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:24.771949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2892 partition: 0 MaxSeqNo: 42 sessionId: src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0
2025-09-30T14:58:24.772325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f3ae424-54572889-1d443d95-77f7b1de_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:24.775342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0] Write session: try to update token
2025-09-30T14:58:24.775361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:24.783878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:24.783895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:24.783903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896753281857038:7640]
2025-09-30T14:58:24.783948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:24.784119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:24.784254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:24.784394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:24.784535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:24.784733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:24.784767Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:24.787567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:24.794977Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:24.795001Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:24.795004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:24.795006Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:24.795016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896753281857038:7640]
2025-09-30T14:58:24.795021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896753281857038:7640]
2025-09-30T14:58:24.795031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896753281857038:7640]
2025-09-30T14:58:24.795076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:24.795082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.795085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:24.795090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:24.795097Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:24.795102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:24.795231Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:24.797616Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2892 sessionId: src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:24.800638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:24.836880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896753371651957:6545]
2025-09-30T14:58:24.837330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2891, pipe: [1:7555896753371651957:6545]
2025-09-30T14:58:24.927436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:24.927792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.927806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.927840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371651957:6545], now have 1 active actors on pipe
2025-09-30T14:58:24.930605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896753371651957:6545]
2025-09-30T14:58:24.930657Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:24.930662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:24.930728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2892 reason: error at write: Disconnected sessionId: src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0
2025-09-30T14:58:24.930935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2892 sessionId: src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0 is DEAD
2025-09-30T14:58:24.931036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:24.931195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:24.930523Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:24.931212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0] Write session will restart in 0.008068s
2025-09-30T14:58:24.931277Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0] Write session: Do CDS request
2025-09-30T14:58:24.931289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:24.941338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:24.941588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:24.941605Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2893
2025-09-30T14:58:24.941850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2893 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:24.941897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2893 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:24.941912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2893 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:24.941917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:24.942443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2893 sessionId:  describe result for acl check
2025-09-30T14:58:24.942480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:24.942486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:24.942488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:24.942494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896753371651992:7588] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:24.943060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896753371651992:7588] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:24.945841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896753371651992:7588] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:24.953391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896753371651992:7588] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:24.953410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896753371651992:7588] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:24.953413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896753371651992:7588] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:24.953423Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2893 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:24.960430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:24.965016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:24.965199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:24.965207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:24.965215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:24.965255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:24.965288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896753281857278:7638]
2025-09-30T14:58:24.965822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:24.966084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:24.966119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:24.966357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:24.966406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.966412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.966413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.966415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.966416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.966417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.966418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.966420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.966421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.966422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.966423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.966425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.966426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.966427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.966429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.966434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.966442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.966445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.966448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.966450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.966452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.966455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.966458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.966460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.966464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.966466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.966469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.966471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.966473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.966476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.966484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.966489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:24.966492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.966495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:24.966498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.966501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:24.966504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.966507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:24.966510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.966513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:24.966515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.966518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:24.966521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.966524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:24.966527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.966530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:24.966533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.966536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:24.966539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.966542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:24.966545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.966549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.966551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.966554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.966556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.966559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.966561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.966564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:24.966566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.966569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:24.966611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:24.972834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:24.974332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:24.974357Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:24.974361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:24.974366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:24.974374Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2892 [2:7555896753281857278:7638]
2025-09-30T14:58:24.974392Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:24.974411Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:24.974421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:24.974425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:24.974427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:24.974444Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:24.974458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:24.974466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:24.974539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.974548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.974550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.974554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:24.974557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:24.974633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:24.974642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.974659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:24.974675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:24.974698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:24.974724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371651960:2454], now have 1 active actors on pipe
2025-09-30T14:58:24.974733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896753371652126:7588], now have 1 active actors on pipe
2025-09-30T14:58:24.974740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896753281857271:7638]
2025-09-30T14:58:24.974747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896753281857271:7638]
2025-09-30T14:58:24.974750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896753281857271:7638]
2025-09-30T14:58:24.974766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:24.974787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:24.974807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:24.974815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:24.974855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896753281857271:7638]
2025-09-30T14:58:24.974863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:24.974908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:24.974921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:24.974924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:24.974931Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:24.974901Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2892
2025-09-30T14:58:24.974947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2892
2025-09-30T14:58:24.975066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.975078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.975110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:24.975124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:24.975133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:24.975135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:24.975152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:24.975169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:24.975200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:24.975892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2893 partition: 0 MaxSeqNo: 42 sessionId: src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0
2025-09-30T14:58:24.975708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:24.975722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:24.975749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:24.976406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|73a9bb6b-c0aac76d-f60d65e1-fc13aebf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:24.980155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0] Write session: try to update token
2025-09-30T14:58:24.980188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:24.994252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:24.994275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:24.994278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:24.994280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:24.994295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896753281857271:7638]
2025-09-30T14:58:24.994300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896753281857271:7638]
2025-09-30T14:58:24.994304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896753281857271:7638]
2025-09-30T14:58:24.994347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:24.994354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:24.994357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:24.994496Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:24.996992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:24.997012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:24.997017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:25.010749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2893 sessionId: src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:25.013706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:25.027785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896757666619497:6545]
2025-09-30T14:58:25.028400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2892, pipe: [1:7555896757666619497:6545]
2025-09-30T14:58:25.119816Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:25.120149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.120164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.120184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666619497:6545], now have 1 active actors on pipe
2025-09-30T14:58:25.120442Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:25.120477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896757666619497:6545]
2025-09-30T14:58:25.120479Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:25.120514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:25.120517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:25.120594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2893 reason: error at write: Disconnected sessionId: src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0
2025-09-30T14:58:25.120775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2893 sessionId: src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0 is DEAD
2025-09-30T14:58:25.121066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:25.121082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0] Write session will restart in 0.009828s
2025-09-30T14:58:25.121121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0] Write session: Do CDS request
2025-09-30T14:58:25.121133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:25.132789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:25.132842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:25.132861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2894
2025-09-30T14:58:25.133029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2894 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:25.133066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2894 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:25.133077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2894 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:25.133082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:25.133496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2894 sessionId:  describe result for acl check
2025-09-30T14:58:25.133526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:25.133527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:25.133529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:25.133535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896757666619575:7586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:25.134037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896757666619575:7586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:25.136373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896757666619575:7586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:25.139620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896757666619575:7586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:25.139634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896757666619575:7586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:25.139638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896757666619575:7586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:25.139646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2894 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:25.141253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:25.146089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:25.146307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:25.146318Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:25.146329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:25.146388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:25.146432Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896757576824810:7636]
2025-09-30T14:58:25.147135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:25.147463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:25.147517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:25.147865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:25.147929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.147935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.147937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.147938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.147939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.147940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.147942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.147943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.147945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.147946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.147948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.147949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.147951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.147952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.147953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.147960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.147971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.147976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.147981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.147986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.147990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.147995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.147999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.148003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.148009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.148013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.148018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.148022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.148027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.148031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.148041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.148050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.148057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.148063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.148069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.148074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.148086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.148092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.148097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.148103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.148108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.148114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.148119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.148128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.148133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.148139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.148149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.148155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.148164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.148169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.148175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.148185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.148191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.148201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.148206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.148216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.148221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.148231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.148236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.148243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.148296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:25.153929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:25.154838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:25.154856Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:25.154859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:25.154863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:25.154871Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2893 [2:7555896757576824810:7636]
2025-09-30T14:58:25.154891Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:25.154908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:25.154919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:25.154923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:25.154926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:25.154941Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:25.154948Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:25.154955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:25.155022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.155032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.155034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.155041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:25.155045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:25.155114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:25.155122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.155135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.155151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.155174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:25.155198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666619727:7586], now have 1 active actors on pipe
2025-09-30T14:58:25.155206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666619499:2454], now have 1 active actors on pipe
2025-09-30T14:58:25.155213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896757576824805:7636]
2025-09-30T14:58:25.155216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896757576824805:7636]
2025-09-30T14:58:25.155218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896757576824805:7636]
2025-09-30T14:58:25.155230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:25.155261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:25.155267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:25.155271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:25.155273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:25.155284Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:25.155287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:25.155323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896757576824805:7636]
2025-09-30T14:58:25.155332Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:25.155344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:25.155367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.155376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.155404Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:25.155315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2893
2025-09-30T14:58:25.155366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2893
2025-09-30T14:58:25.155417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:25.155426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:25.155428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:25.155438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:25.155453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:25.155467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:25.155694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.155711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.155737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:25.155842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2894 partition: 0 MaxSeqNo: 42 sessionId: src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0
2025-09-30T14:58:25.156219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75263ee2-66aaf3da-43871ff3-9d460a45_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:25.159596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0] Write session: try to update token
2025-09-30T14:58:25.159618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:25.168049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:25.168074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:25.168077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:25.168079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:25.168090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896757576824805:7636]
2025-09-30T14:58:25.168095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896757576824805:7636]
2025-09-30T14:58:25.168099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896757576824805:7636]
2025-09-30T14:58:25.168135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:25.168141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.168143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:25.168157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:25.168171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:25.168175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:25.168289Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:25.180525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2894 sessionId: src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:25.183555Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:25.220842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896757666619742:6545]
2025-09-30T14:58:25.221168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2893, pipe: [1:7555896757666619742:6545]
2025-09-30T14:58:25.284746Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:25.285718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.285736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.285758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666619742:6545], now have 1 active actors on pipe
2025-09-30T14:58:25.285983Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:25.285996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:25.285997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896757666619742:6545]
2025-09-30T14:58:25.286011Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:25.286031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:25.286424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:25.286437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0] Write session will restart in 0.006511s
2025-09-30T14:58:25.286462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0] Write session: Do CDS request
2025-09-30T14:58:25.286468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:25.286076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2894 reason: error at write: Disconnected sessionId: src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0
2025-09-30T14:58:25.286254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2894 sessionId: src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0 is DEAD
2025-09-30T14:58:25.293861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:25.293905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:25.293924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2895
2025-09-30T14:58:25.294142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2895 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:25.294195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2895 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:25.294201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2895 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:25.294205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:25.294705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2895 sessionId:  describe result for acl check
2025-09-30T14:58:25.294739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:25.294741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:25.294743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:25.294749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896757666619763:7591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:25.295296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896757666619763:7591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:25.297984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896757666619763:7591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:25.302428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896757666619763:7591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:25.302445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896757666619763:7591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:25.302449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896757666619763:7591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:25.302458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2895 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:25.309205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:25.314555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:25.314949Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:25.314960Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:25.314973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:25.315038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:25.315094Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896757576825070:7629]
2025-09-30T14:58:25.315802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:25.316167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:25.316229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:25.316587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:25.316651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.316658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.316659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.316660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.316661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.316662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.316664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.316665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.316666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.316667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.316669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.316670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.316671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.316672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.316674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.316679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.316689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.316693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.316697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.316704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.316709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.316713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.316717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.316721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.316725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.316729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.316731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.316734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.316737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.316741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.316750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.316758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.316765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.316771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.316781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.316786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.316796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.316801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.316817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.316822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.316827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.316832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.316836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.316847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.316851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.316855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.316864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.316869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.316878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.316884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.316890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.316895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.316899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.316910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.316914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.316919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.316923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.316928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.316933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.316938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.316977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:25.323188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:25.324453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:25.324472Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:25.324474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:25.324478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:25.324485Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2894 [2:7555896757576825070:7629]
2025-09-30T14:58:25.324504Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:25.324520Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:25.324524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:25.324527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:25.324529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:25.324549Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:25.324556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:25.324562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:25.324637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.324648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.324650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.324653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:25.324655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:25.324728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:25.324736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.324750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.324761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.324779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:25.324802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666619880:7591], now have 1 active actors on pipe
2025-09-30T14:58:25.324829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896757576825065:7629]
2025-09-30T14:58:25.324831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896757576825065:7629]
2025-09-30T14:58:25.324833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896757576825065:7629]
2025-09-30T14:58:25.324848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:25.324858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666619745:2454], now have 1 active actors on pipe
2025-09-30T14:58:25.324866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:25.324870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:25.324876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:25.324882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:25.324890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:25.324893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:25.324934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896757576825065:7629]
2025-09-30T14:58:25.324946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:25.324953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:25.324942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2894
2025-09-30T14:58:25.324980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2894
2025-09-30T14:58:25.325148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.325160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.325188Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|98500b55-aaf6eb49-8d185547-8d48655b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:25.325198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:25.325201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:25.325203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:25.325213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:25.325224Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:25.325240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:25.325410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.325423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.325437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:25.325564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2895 partition: 0 MaxSeqNo: 42 sessionId: src_id|98500b55-aaf6eb49-8d185547-8d48655b_0
2025-09-30T14:58:25.326053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4c3bbd03-d9b8ca5a-2c82175a-baf94f6a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|98500b55-aaf6eb49-8d185547-8d48655b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:25.328897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98500b55-aaf6eb49-8d185547-8d48655b_0] Write session: try to update token
2025-09-30T14:58:25.328918Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98500b55-aaf6eb49-8d185547-8d48655b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:25.337622Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:25.337653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:25.337663Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896757576825065:7629]
2025-09-30T14:58:25.337709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:25.337712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:25.337896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:25.338055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:25.338214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:25.338412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:25.338626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:25.338679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:25.344252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2895 sessionId: src_id|98500b55-aaf6eb49-8d185547-8d48655b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:25.347311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:25.347523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.347546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.347595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:25.349192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:25.349215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:25.349218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:25.349219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:25.349229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896757576825065:7629]
2025-09-30T14:58:25.349233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896757576825065:7629]
2025-09-30T14:58:25.349238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896757576825065:7629]
2025-09-30T14:58:25.349278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:25.349285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.349284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:25.349287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:25.349290Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:25.349293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:25.349432Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:25.347790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:25.386174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896757666620017:6545]
2025-09-30T14:58:25.386440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2894, pipe: [1:7555896757666620017:6545]
2025-09-30T14:58:25.465894Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:25.475644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.475677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.475850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:25.475913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:25.475979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:25.476037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:25.476578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:25.476593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:25.476668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:25.476736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:25.476825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:25.476892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:25.476934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:25.476940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:25.477009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:25.477078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:25.477148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:25.477221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:25.477278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:25.477290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:25.477371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:25.477449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:25.477521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:25.477593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:25.477642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:25.477650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:25.477731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:25.477804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:25.477879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:25.477948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:25.477994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:25.478001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:25.478072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:25.478137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:25.478205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:25.478281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:25.478330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:25.478342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:25.478411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:25.478474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:25.478542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:25.478610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:25.478662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:25.478670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:25.478736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:25.478795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:25.478858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:25.478919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:25.478962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:25.478968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:25.479032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:25.479093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:25.479165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:25.479232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:25.479296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:25.479302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:25.479367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:25.479428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:25.479490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:25.479567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:25.479623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:25.479632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:25.479701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666620017:6545], now have 1 active actors on pipe
2025-09-30T14:58:25.480375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98500b55-aaf6eb49-8d185547-8d48655b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:25.480391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98500b55-aaf6eb49-8d185547-8d48655b_0] Write session will restart in 0.006342s
2025-09-30T14:58:25.480413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98500b55-aaf6eb49-8d185547-8d48655b_0] Write session: Do CDS request
2025-09-30T14:58:25.480418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98500b55-aaf6eb49-8d185547-8d48655b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:25.479978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:25.479993Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896757666620017:6545]
2025-09-30T14:58:25.479998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:25.480024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:25.480030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2895 reason: error at write: Disconnected sessionId: src_id|98500b55-aaf6eb49-8d185547-8d48655b_0
2025-09-30T14:58:25.480218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2895 sessionId: src_id|98500b55-aaf6eb49-8d185547-8d48655b_0 is DEAD
2025-09-30T14:58:25.480482Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:25.487755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|98500b55-aaf6eb49-8d185547-8d48655b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:25.487851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:25.487867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2896
2025-09-30T14:58:25.487985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2896 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:25.488017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2896 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:25.488027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2896 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:25.488031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:25.488521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2896 sessionId:  describe result for acl check
2025-09-30T14:58:25.488562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:25.488564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:25.488566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:25.488572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896757666620031:7629] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:25.489149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896757666620031:7629] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:25.492275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896757666620031:7629] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:25.495135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896757666620031:7629] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:25.495155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896757666620031:7629] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:25.495158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896757666620031:7629] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:25.495166Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2896 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:25.503917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:25.508195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:25.508402Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:25.508410Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:25.508419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:25.508465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:25.508512Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896757576825328:7612]
2025-09-30T14:58:25.509024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:25.509304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:25.509340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:25.509769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:25.509822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.509827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.509828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.509829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.509830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.509830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.509831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.509832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.509833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.509833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.509834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.509835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.509835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.509836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.509837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.509840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.509848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.509850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.509853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.509855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.509857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.509860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.509862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.509864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.509866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.509869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.509871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.509873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.509876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.509878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.509885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.509889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.509894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.509897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.509900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.509903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.509906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.509908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.509911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.509914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.509917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.509920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.509922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.509925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.509928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.509931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.509936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.509939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.509941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.509944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.509947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.509950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.509952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.509955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.509958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.509960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.509963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.509966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.509968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.509971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.509994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:25.515642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:25.517171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:25.517192Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:25.517195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:25.517199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:25.517206Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2895 [2:7555896757576825328:7612]
2025-09-30T14:58:25.517222Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:25.517238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:25.517241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:25.517244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:25.517247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:25.517263Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:25.517269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:25.517276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:25.517344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.517355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.517357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.517361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:25.517364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:25.517434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:25.517443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.517456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.517473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.517496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:25.517520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666620104:7629], now have 1 active actors on pipe
2025-09-30T14:58:25.517530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666620019:2454], now have 1 active actors on pipe
2025-09-30T14:58:25.517536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896757576825323:7612]
2025-09-30T14:58:25.517540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896757576825323:7612]
2025-09-30T14:58:25.517542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896757576825323:7612]
2025-09-30T14:58:25.517556Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:25.517569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:25.517575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:25.517579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:25.517582Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:25.517591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:25.517594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:25.517604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2895
2025-09-30T14:58:25.517627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896757576825323:7612]
2025-09-30T14:58:25.517641Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:25.517642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:25.517667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.517672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.517706Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15580b02-c981d87b-174267fa-b23d47c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:25.517720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:25.517723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:25.517729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:25.517741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:25.517754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:25.517774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:25.517751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2895
2025-09-30T14:58:25.517898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.517907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.517920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:25.517992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2896 partition: 0 MaxSeqNo: 42 sessionId: src_id|15580b02-c981d87b-174267fa-b23d47c4_0
2025-09-30T14:58:25.518367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|98500b55-aaf6eb49-8d185547-8d48655b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|15580b02-c981d87b-174267fa-b23d47c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:25.521253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15580b02-c981d87b-174267fa-b23d47c4_0] Write session: try to update token
2025-09-30T14:58:25.521272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15580b02-c981d87b-174267fa-b23d47c4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:25.529848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:25.529873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:25.529876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:25.529878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:25.529888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896757576825323:7612]
2025-09-30T14:58:25.529893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896757576825323:7612]
2025-09-30T14:58:25.529896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896757576825323:7612]
2025-09-30T14:58:25.529935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:25.529935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:25.529941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:25.529945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:25.529946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.529949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:25.530101Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:25.536062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2896 sessionId: src_id|15580b02-c981d87b-174267fa-b23d47c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:25.538899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:25.580238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896757666620276:6545]
2025-09-30T14:58:25.580490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2895, pipe: [1:7555896757666620276:6545]
2025-09-30T14:58:25.645827Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:25.646144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.646157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.646198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666620276:6545], now have 1 active actors on pipe
2025-09-30T14:58:25.646441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:25.646509Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896757666620276:6545]
2025-09-30T14:58:25.646519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:25.646523Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:25.646542Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:25.646609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2896 reason: error at write: Disconnected sessionId: src_id|15580b02-c981d87b-174267fa-b23d47c4_0
2025-09-30T14:58:25.646795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2896 sessionId: src_id|15580b02-c981d87b-174267fa-b23d47c4_0 is DEAD
2025-09-30T14:58:25.646958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15580b02-c981d87b-174267fa-b23d47c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:25.646966Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15580b02-c981d87b-174267fa-b23d47c4_0] Write session will restart in 0.006672s
2025-09-30T14:58:25.646992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15580b02-c981d87b-174267fa-b23d47c4_0] Write session: Do CDS request
2025-09-30T14:58:25.647002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15580b02-c981d87b-174267fa-b23d47c4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:25.654892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15580b02-c981d87b-174267fa-b23d47c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:25.655374Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:25.655393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2897
2025-09-30T14:58:25.655514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2897 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:25.655545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2897 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:25.655557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2897 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:25.655562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:25.655997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2897 sessionId:  describe result for acl check
2025-09-30T14:58:25.656029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:25.656033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:25.656035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:25.656040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896757666620292:7630] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:25.656585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896757666620292:7630] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:25.658735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896757666620292:7630] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:25.662878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896757666620292:7630] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:25.662898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896757666620292:7630] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:25.662901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896757666620292:7630] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:25.662910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2897 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:25.667619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:25.672631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:25.672906Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:25.672911Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:25.672923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:25.672988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:25.673025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896757576825566:7604]
2025-09-30T14:58:25.673723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:25.674891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:25.674947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:25.675322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:25.675392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.675393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.675395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.675396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.675398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.675400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.675401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.675402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.675404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.675405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.675407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.675408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.675410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.675411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.675413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.675419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.675431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.675437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.675441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.675446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.675451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.675456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.675461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.675465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.675471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.675474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.675478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.675482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.675486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.675490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.675499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.675507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.675515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.675521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.675527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.675533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.675538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.675544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.675550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.675556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.675561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.675567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.675573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.675580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.675585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.675591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.675597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.675603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.675608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.675614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.675619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.675625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.675630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.675636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.675642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.675648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.675653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.675659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.675665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.675670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.675719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:25.681632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:25.683316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:25.683339Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:25.683343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:25.683348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:25.683358Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2896 [2:7555896757576825566:7604]
2025-09-30T14:58:25.683381Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:25.683401Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:25.683410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:25.683414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:25.683418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:25.683436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:25.683444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:25.683455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:25.683532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.683540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.683543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.683546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:25.683549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:25.683620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:25.683628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.683644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.683662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.683685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:25.683714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666620277:2454], now have 1 active actors on pipe
2025-09-30T14:58:25.683721Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896757576825561:7604]
2025-09-30T14:58:25.683724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896757576825561:7604]
2025-09-30T14:58:25.683726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896757576825561:7604]
2025-09-30T14:58:25.683739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:25.683749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666620447:7630], now have 1 active actors on pipe
2025-09-30T14:58:25.683753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:25.683756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:25.683757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:25.683759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:25.683773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:25.683776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:25.683812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896757576825561:7604]
2025-09-30T14:58:25.683824Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:25.683830Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:25.683828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2896
2025-09-30T14:58:25.683831Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2896
2025-09-30T14:58:25.683938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.683949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.683976Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:25.683988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:25.683992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:25.683999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:25.684008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:25.684023Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:25.684044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:25.684222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.684231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.684245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:25.684335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2897 partition: 0 MaxSeqNo: 42 sessionId: src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0
2025-09-30T14:58:25.684743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15580b02-c981d87b-174267fa-b23d47c4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:25.687608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0] Write session: try to update token
2025-09-30T14:58:25.687627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:25.696324Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:25.696348Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:25.696351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:25.696353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:25.696363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896757576825561:7604]
2025-09-30T14:58:25.696368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896757576825561:7604]
2025-09-30T14:58:25.696373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896757576825561:7604]
2025-09-30T14:58:25.696417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:25.696424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.696427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:25.696494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:25.696512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:25.696516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:25.696570Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:25.702823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2897 sessionId: src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:25.705737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:25.746651Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896757666620523:6545]
2025-09-30T14:58:25.747388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2896, pipe: [1:7555896757666620523:6545]
2025-09-30T14:58:25.815293Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:25.815620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.815636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.815679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666620523:6545], now have 1 active actors on pipe
2025-09-30T14:58:25.816143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:25.816157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:25.816218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2897 reason: error at write: Disconnected sessionId: src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0
2025-09-30T14:58:25.816374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2897 sessionId: src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0 is DEAD
2025-09-30T14:58:25.816384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896757666620523:6545]
2025-09-30T14:58:25.816403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:25.816519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:25.816529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0] Write session will restart in 0.008649s
2025-09-30T14:58:25.816546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0] Write session: Do CDS request
2025-09-30T14:58:25.816551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:25.816760Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:25.826729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:25.826866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:25.826894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2898
2025-09-30T14:58:25.827026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2898 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:25.827057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2898 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:25.827063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2898 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:25.827068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:25.827570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2898 sessionId:  describe result for acl check
2025-09-30T14:58:25.827606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:25.827612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:25.827614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:25.827620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896757666620551:7651] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:25.828194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896757666620551:7651] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:25.836426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896757666620551:7651] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:25.843694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896757666620551:7651] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:25.843712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896757666620551:7651] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:25.843718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896757666620551:7651] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:25.843728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2898 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:25.848639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:25.852959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:25.853192Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:25.853205Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:25.853217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:25.853294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:25.853340Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896757576825803:7602]
2025-09-30T14:58:25.854039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:25.854394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:25.854458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:25.854854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:25.855064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.855073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.855075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.855076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.855077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.855078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.855079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.855080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.855082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.855083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.855084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.855085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.855086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.855087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.855088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.855096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.855106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.855109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.855113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.855117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.855120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.855125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.855128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.855132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.855136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.855140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.855144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.855147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.855150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.855154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.855164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.855173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:25.855180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.855186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:25.855191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.855197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:25.855201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.855206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:25.855211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.855216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:25.855221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.855226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:25.855231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.855236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:25.855260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.855267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:25.855272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.855277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:25.855281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.855286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:25.855290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.855295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.855299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.855304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.855321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.855326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.855331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.855337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:25.855353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.855358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:25.855416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:25.861157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:25.862038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:25.862058Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:25.862061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:25.862065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:25.862075Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2897 [2:7555896757576825803:7602]
2025-09-30T14:58:25.862092Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:25.862108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:25.862118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:25.862122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:25.862125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:25.862142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:25.862154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:25.862161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:25.862211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.862217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.862219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.862222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:25.862225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:25.862302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:25.862304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.862317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:25.862329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:25.862347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:25.862363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896757576825798:7602]
2025-09-30T14:58:25.862365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896757576825798:7602]
2025-09-30T14:58:25.862367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896757576825798:7602]
2025-09-30T14:58:25.862383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:25.862394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:25.862404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:25.862406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:25.862406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:25.862410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:25.862413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:25.862434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896757576825798:7602]
2025-09-30T14:58:25.862436Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:25.862473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:25.862635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2897
2025-09-30T14:58:25.862677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2897
2025-09-30T14:58:25.863036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666620728:7651], now have 1 active actors on pipe
2025-09-30T14:58:25.863049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666620526:2454], now have 1 active actors on pipe
2025-09-30T14:58:25.863069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.863074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.863099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:25.863116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:25.863119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:25.863122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:25.863132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:25.863142Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:25.863154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:25.863357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.863365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.863379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:25.863515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2898 partition: 0 MaxSeqNo: 42 sessionId: src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0
2025-09-30T14:58:25.863885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2897bb61-e2ae0e84-6c8d0c97-d2e4dc57_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:25.866813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0] Write session: try to update token
2025-09-30T14:58:25.866831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:25.879382Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:25.879403Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:25.879405Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:25.879407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:25.879417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896757576825798:7602]
2025-09-30T14:58:25.879422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896757576825798:7602]
2025-09-30T14:58:25.879426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896757576825798:7602]
2025-09-30T14:58:25.879466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:25.879474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:25.879476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:25.879475Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:25.879481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:25.879485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:25.879622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:25.883407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2898 sessionId: src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:25.886337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:25.916635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896757666620774:6545]
2025-09-30T14:58:25.917095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2897, pipe: [1:7555896757666620774:6545]
2025-09-30T14:58:25.991628Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:25.992235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:25.992253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:25.992297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666620774:6545], now have 1 active actors on pipe
2025-09-30T14:58:25.993368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896757666620774:6545]
2025-09-30T14:58:25.993390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:25.993395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:25.993399Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:25.993471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2898 reason: error at write: Disconnected sessionId: src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0
2025-09-30T14:58:25.993663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2898 sessionId: src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0 is DEAD
2025-09-30T14:58:25.993423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:25.993875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:25.993885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0] Write session will restart in 0.005670s
2025-09-30T14:58:25.993920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0] Write session: Do CDS request
2025-09-30T14:58:25.993929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:26.000779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:26.001152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:26.001239Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2899
2025-09-30T14:58:26.001517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2899 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:26.001552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2899 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:26.001558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2899 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:26.001562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:26.003258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2899 sessionId:  describe result for acl check
2025-09-30T14:58:26.003298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:26.003300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:26.003302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:26.003308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896761961588082:7655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:26.003854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896761961588082:7655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:26.005948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896761961588082:7655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:26.010674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896761961588082:7655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:26.010692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896761961588082:7655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:26.010696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896761961588082:7655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:26.010703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2899 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:26.027086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:26.028261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:26.028469Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:26.028473Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:26.028483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:26.028528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:26.028558Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896761871793337:7598]
2025-09-30T14:58:26.029133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:26.029464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:26.029503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:26.029841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:26.029896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.029897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.029898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.029900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.029901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.029903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.029904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.029905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.029907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.029908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.029909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.029910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.029912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.029913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.029914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.029920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.029931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.029935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.029940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.029944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.029947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.029951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.029955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.029958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.029964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.029967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.029972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.029976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.029981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.029985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.029995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.030003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.030008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.030015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.030020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.030025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.030030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.030035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.030040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.030046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.030051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.030056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.030061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.030068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.030073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.030078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.030082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.030088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.030093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.030098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.030104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.030109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.030113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.030119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.030123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.030128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.030133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.030139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.030143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.030149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.030193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:26.039207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:26.040890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2898
2025-09-30T14:58:26.040935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2898
2025-09-30T14:58:26.040388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:26.040401Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:26.040403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:26.040406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:26.040412Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2898 [2:7555896761871793337:7598]
2025-09-30T14:58:26.040426Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:26.040440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:26.040444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.040447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.040449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.040466Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:26.040473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:26.040481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:26.040543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.040546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.040548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.040552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:26.040555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:26.040628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:26.040631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.040644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.040656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.040671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:26.040691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961588139:7655], now have 1 active actors on pipe
2025-09-30T14:58:26.040694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896757666620778:2454], now have 1 active actors on pipe
2025-09-30T14:58:26.040701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896761871793332:7598]
2025-09-30T14:58:26.040706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896761871793332:7598]
2025-09-30T14:58:26.040708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896761871793332:7598]
2025-09-30T14:58:26.040721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:26.041694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2899 partition: 0 MaxSeqNo: 42 sessionId: src_id|e343477e-242f3a77-278da8c7-f928baa8_0
2025-09-30T14:58:26.040735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:26.040742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:26.040746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:26.040749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:26.040750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:26.040752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:26.040788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896761871793332:7598]
2025-09-30T14:58:26.040795Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:26.040829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:26.041046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.041056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.041089Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e343477e-242f3a77-278da8c7-f928baa8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:26.041098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.041102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.041105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:26.041120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.041134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:26.041151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:26.041535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.041540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.041558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:26.042112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15185f4c-468b2e2-a0005ea7-6c45fee8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e343477e-242f3a77-278da8c7-f928baa8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:26.045104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e343477e-242f3a77-278da8c7-f928baa8_0] Write session: try to update token
2025-09-30T14:58:26.045123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e343477e-242f3a77-278da8c7-f928baa8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:26.054593Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:26.054613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:26.054616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:26.054618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:26.054627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896761871793332:7598]
2025-09-30T14:58:26.054631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896761871793332:7598]
2025-09-30T14:58:26.054636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896761871793332:7598]
2025-09-30T14:58:26.054676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:26.054683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.054686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:26.054697Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:26.054704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:26.054708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:26.054827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:26.065292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2899 sessionId: src_id|e343477e-242f3a77-278da8c7-f928baa8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:26.068065Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:26.089151Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896761961588321:6545]
2025-09-30T14:58:26.089578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2898, pipe: [1:7555896761961588321:6545]
2025-09-30T14:58:26.168609Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:26.169371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.169390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.169411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961588321:6545], now have 1 active actors on pipe
2025-09-30T14:58:26.169664Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:26.169704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:26.169718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:26.169717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896761961588321:6545]
2025-09-30T14:58:26.169740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:26.169796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2899 reason: error at write: Disconnected sessionId: src_id|e343477e-242f3a77-278da8c7-f928baa8_0
2025-09-30T14:58:26.169964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2899 sessionId: src_id|e343477e-242f3a77-278da8c7-f928baa8_0 is DEAD
2025-09-30T14:58:26.170329Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e343477e-242f3a77-278da8c7-f928baa8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:26.170340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e343477e-242f3a77-278da8c7-f928baa8_0] Write session will restart in 0.005936s
2025-09-30T14:58:26.170364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e343477e-242f3a77-278da8c7-f928baa8_0] Write session: Do CDS request
2025-09-30T14:58:26.170381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e343477e-242f3a77-278da8c7-f928baa8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:26.177880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e343477e-242f3a77-278da8c7-f928baa8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:26.178034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:26.178053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2900
2025-09-30T14:58:26.178232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2900 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:26.178279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2900 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:26.178285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2900 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:26.178290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:26.178823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2900 sessionId:  describe result for acl check
2025-09-30T14:58:26.178864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:26.178875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:26.178877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:26.178883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896761961588332:7681] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:26.179491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896761961588332:7681] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:26.182312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896761961588332:7681] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:26.185503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896761961588332:7681] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:26.185518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896761961588332:7681] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:26.185521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896761961588332:7681] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:26.185529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2900 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:26.194665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:26.199095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:26.199450Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:26.199463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:26.199476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:26.199539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:26.199566Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896761871793578:7584]
2025-09-30T14:58:26.200228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:26.200592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:26.200658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:26.201024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:26.201092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.201101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.201102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.201103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.201105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.201106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.201107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.201109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.201111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.201112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.201113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.201114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.201116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.201117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.201118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.201124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.201135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.201140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.201144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.201148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.201153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.201157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.201161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.201165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.201170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.201174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.201178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.201182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.201186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.201190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.201198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.201207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.201213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.201218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.201223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.201229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.201234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.201239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.201244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.201249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.201254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.201259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.201264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.201270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.201274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.201279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.201284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.201289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.201294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.201299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.201303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.201309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.201314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.201318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.201323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.201331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.201341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.201346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.201353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.201358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.201401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:26.207071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:26.207971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:26.207986Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:26.207989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:26.207993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:26.208001Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2899 [2:7555896761871793578:7584]
2025-09-30T14:58:26.208018Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:26.208036Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:26.208046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.208050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.208052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.208068Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:26.208075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:26.208082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:26.208144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.208152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.208155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.208160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:26.208162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:26.208230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:26.208237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.208250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.208268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.208285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:26.208305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961588323:2454], now have 1 active actors on pipe
2025-09-30T14:58:26.208314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961588385:7681], now have 1 active actors on pipe
2025-09-30T14:58:26.208321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896761871793573:7584]
2025-09-30T14:58:26.208327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896761871793573:7584]
2025-09-30T14:58:26.208330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896761871793573:7584]
2025-09-30T14:58:26.208344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:26.208363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:26.208384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:26.208383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:26.208392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:26.208393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:26.208395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:26.208428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896761871793573:7584]
2025-09-30T14:58:26.208412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2899
2025-09-30T14:58:26.208435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:26.208446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:26.208464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.208470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.208437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2899
2025-09-30T14:58:26.208506Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:26.208516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.208520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.208523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:26.208533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.208543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:26.208565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:26.208828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.208844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.208868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:26.208969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2900 partition: 0 MaxSeqNo: 42 sessionId: src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0
2025-09-30T14:58:26.209355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e343477e-242f3a77-278da8c7-f928baa8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:26.212362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0] Write session: try to update token
2025-09-30T14:58:26.212386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:26.221880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:26.221904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:26.221908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:26.221910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:26.221921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896761871793573:7584]
2025-09-30T14:58:26.221925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896761871793573:7584]
2025-09-30T14:58:26.221931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896761871793573:7584]
2025-09-30T14:58:26.221970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:26.221970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:26.221975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:26.221977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.221979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:26.221981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:26.222122Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:26.246809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2900 sessionId: src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:26.249562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:26.269911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896761961588576:6545]
2025-09-30T14:58:26.270249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2899, pipe: [1:7555896761961588576:6545]
2025-09-30T14:58:26.336662Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:26.337013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.337028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.337047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961588576:6545], now have 1 active actors on pipe
2025-09-30T14:58:26.337420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:26.337481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:26.337489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896761961588576:6545]
2025-09-30T14:58:26.337494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:26.337572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2900 reason: error at write: Disconnected sessionId: src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0
2025-09-30T14:58:26.337584Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:26.337782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2900 sessionId: src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0 is DEAD
2025-09-30T14:58:26.337921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:26.337932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0] Write session will restart in 0.005946s
2025-09-30T14:58:26.337959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0] Write session: Do CDS request
2025-09-30T14:58:26.337965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:26.344799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:26.344939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:26.344957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2901
2025-09-30T14:58:26.345143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2901 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:26.345175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2901 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:26.345180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2901 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:26.345185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:26.345567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2901 sessionId:  describe result for acl check
2025-09-30T14:58:26.345601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:26.345603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:26.345605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:26.345610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896761961588596:7674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:26.346180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896761961588596:7674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:26.348452Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896761961588596:7674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:26.352358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896761961588596:7674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:26.352376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896761961588596:7674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:26.352379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896761961588596:7674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:26.352388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2901 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:26.363390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:26.364405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:26.364587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:26.364597Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:26.364608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:26.364667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:26.364707Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896761871793843:7573]
2025-09-30T14:58:26.365365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:26.365669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:26.365713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:26.365983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:26.366039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.366045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.366046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.366046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.366047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.366048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.366049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.366049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.366050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.366051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.366052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.366055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.366056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.366057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.366057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.366061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.366071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.366076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.366079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.366083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.366088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.366092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.366095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.366099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.366104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.366108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.366112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.366116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.366119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.366123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.366130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.366135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.366138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.366142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.366144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.366148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.366150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.366153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.366156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.366158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.366161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.366163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.366166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.366169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.366171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.366174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.366181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.366186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.366190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.366194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.366198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.366202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.366205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.366209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.366213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.366217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.366220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.366225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.366230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.366236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.366278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:26.371764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:26.373218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2900
2025-09-30T14:58:26.373256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2900
2025-09-30T14:58:26.372872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:26.372891Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:26.372894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:26.372897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:26.372904Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2900 [2:7555896761871793843:7573]
2025-09-30T14:58:26.372918Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:26.372932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:26.372935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.372938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.372941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.372959Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:26.372965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:26.372971Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:26.373026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.373028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.373030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.373034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:26.373037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:26.373100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:26.373104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.373115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.373128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.373146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:26.373164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961588717:7674], now have 1 active actors on pipe
2025-09-30T14:58:26.373167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961588580:2454], now have 1 active actors on pipe
2025-09-30T14:58:26.373173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896761871793838:7573]
2025-09-30T14:58:26.373175Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896761871793838:7573]
2025-09-30T14:58:26.373177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896761871793838:7573]
2025-09-30T14:58:26.373188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:26.373201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:26.373202Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:26.373206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:26.373208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:26.373214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:26.373217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:26.373244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896761871793838:7573]
2025-09-30T14:58:26.373251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:26.373257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:26.373265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.373270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.373313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:26.373321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.373324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.373328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:26.373338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.373345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:26.373368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:26.373562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.373575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.373595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:26.373681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2901 partition: 0 MaxSeqNo: 42 sessionId: src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0
2025-09-30T14:58:26.374029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|514f9678-502ff9b6-3d466a4f-a18c15e3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:26.376912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0] Write session: try to update token
2025-09-30T14:58:26.376930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:26.386597Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:26.386621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:26.386624Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:26.386627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:26.386640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896761871793838:7573]
2025-09-30T14:58:26.386646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896761871793838:7573]
2025-09-30T14:58:26.386653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896761871793838:7573]
2025-09-30T14:58:26.386714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:26.386723Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:26.386731Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:26.386733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.386735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:26.386737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:26.387029Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:26.395801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2901 sessionId: src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:26.398722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:26.437824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896761961588856:6545]
2025-09-30T14:58:26.438161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 2900, pipe: [1:7555896761961588856:6545]
2025-09-30T14:58:26.505314Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:26.505916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.505934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.505966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961588856:6545], now have 1 active actors on pipe
2025-09-30T14:58:26.506197Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:26.506197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:26.506213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:26.506219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896761961588856:6545]
2025-09-30T14:58:26.506241Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:26.506279Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:58:26.506293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2901 reason: error at write: Disconnected sessionId: src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0
2025-09-30T14:58:26.506377Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 29 consumer shared/user session shared/user_1_29_9891895112688442900_v1 is DEAD
2025-09-30T14:58:26.506491Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896688947123797:6527] disconnected; active server actors: 1
2025-09-30T14:58:26.506499Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896688947123797:6527] client user disconnected session shared/user_1_29_9891895112688442900_v1
2025-09-30T14:58:26.506501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2901 sessionId: src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0 is DEAD
2025-09-30T14:58:26.506817Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:26.506817Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:58:26.506833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0] Write session will restart in 0.005967s
2025-09-30T14:58:26.506870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0] Write session: Do CDS request
2025-09-30T14:58:26.506876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:26.506918Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:58:26.506923Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:58:26.506932Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.007001s
2025-09-30T14:58:26.513803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:26.514306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:26.514322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2902
2025-09-30T14:58:26.514483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2902 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:26.514503Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:58:26.514515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2902 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:26.514527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2902 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:26.514531Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:26.514741Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:58:26.514748Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 30
2025-09-30T14:58:26.514866Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 30 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:58:26.514906Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:58:26.514976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2902 sessionId:  describe result for acl check
2025-09-30T14:58:26.514982Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 auth for : user
2025-09-30T14:58:26.515025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:26.515032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:26.515034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:26.515040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896761961588876:7702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:26.515061Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 Handle describe topics response
2025-09-30T14:58:26.515084Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 auth is DEAD
2025-09-30T14:58:26.515103Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:58:26.515361Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:58:26.515451Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_30_8794492065082298093_v1
2025-09-30T14:58:26.515445Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896761961588879:7700] connected; active server actors: 1
2025-09-30T14:58:26.515465Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896761961588879:7700] session shared/user_1_30_8794492065082298093_v1
2025-09-30T14:58:26.515473Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:58:26.515483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:58:26.515489Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_30_8794492065082298093_v1" (Sender=[1:7555896761961588874:7700], Pipe=[1:7555896761961588879:7700], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:58:26.515493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:58:26.515502Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:58:26.515512Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_30_8794492065082298093_v1" (Sender=[1:7555896761961588874:7700], Pipe=[1:7555896761961588879:7700], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:58:26.515522Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_30_8794492065082298093_v1" sender [1:7555896761961588874:7700] lock partition 0 for ReadingSession "shared/user_1_30_8794492065082298093_v1" (Sender=[1:7555896761961588874:7700], Pipe=[1:7555896761961588879:7700], Partitions=[], ActiveFamilyCount=1) generation 1 step 30
2025-09-30T14:58:26.515534Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:58:26.515539Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000033s
2025-09-30T14:58:26.515608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896761961588876:7702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:26.515746Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 30 Session: "shared/user_1_30_8794492065082298093_v1" ClientId: "user" PipeClient { RawX1: 7555896761961588879 RawX2: 4503603922345492 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:58:26.515766Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:58:26.518115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896761961588876:7702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:26.521501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896761961588876:7702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:26.521527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896761961588876:7702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:26.521530Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896761961588876:7702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:26.521538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2902 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:26.531918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:26.532535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:26.532957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:26.532968Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:26.532981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:26.533038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:26.533081Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896761871794109:7555]
2025-09-30T14:58:26.533698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:26.534036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:26.534077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:26.534393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:26.534452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.534453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.534454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.534455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.534456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.534457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.534459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.534460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.534461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.534463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.534464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.534465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.534466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.534467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.534469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.534473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.534483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.534487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.534490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.534494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.534498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.534501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.534505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.534508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.534512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.534516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.534519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.534523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.534527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.534530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.534537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.534546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.534551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.534557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.534561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.534567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.534571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.534576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.534581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.534585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.534590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.534595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.534599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.534604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.534608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.534613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.534617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.534623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.534627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.534632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.534639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.534643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.534648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.534652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.534656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.534661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.534665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.534670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.534674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.534679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.534716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:26.540235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:26.541161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:26.541179Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:26.541182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:26.541186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:26.541192Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2901 [2:7555896761871794109:7555]
2025-09-30T14:58:26.541210Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:26.541226Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:26.541229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.541233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.541235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.541253Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:26.541265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:26.541272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:26.541336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.541346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.541351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.541354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:26.541357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:26.541425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:26.541428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.541438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.541450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.541466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:26.541484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961589018:7702], now have 1 active actors on pipe
2025-09-30T14:58:26.541488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961588857:2454], now have 1 active actors on pipe
2025-09-30T14:58:26.541495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896761871794104:7555]
2025-09-30T14:58:26.541501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896761871794104:7555]
2025-09-30T14:58:26.541503Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896761871794104:7555]
2025-09-30T14:58:26.541516Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:26.541528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961588886:7727], now have 1 active actors on pipe
2025-09-30T14:58:26.541542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:26.541554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:26.541557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:26.541559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:26.541564Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:26.541566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:26.541589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896761871794104:7555]
2025-09-30T14:58:26.541592Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:26.541609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:26.541625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.541631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.541571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2901
2025-09-30T14:58:26.541572Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2901
2025-09-30T14:58:26.541619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 2901, pipe: [1:7555896761961588886:7727]
2025-09-30T14:58:26.541661Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:26.541675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.541679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.541681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:26.541691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.541700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:26.541715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.541717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.541723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_30_8794492065082298093_v1 on pipe: [1:7555896761961588886:7727]
2025-09-30T14:58:26.541747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:26.541763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.541771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.541773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:26.541773Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_30_8794492065082298093_v1:1 with generation 2901
2025-09-30T14:58:26.541785Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_30_8794492065082298093_v1
2025-09-30T14:58:26.541792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.541809Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:58:26.541920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.541927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.541939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:26.542030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2902 partition: 0 MaxSeqNo: 42 sessionId: src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0
2025-09-30T14:58:26.542379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd74706-6471bde5-b7b0be50-1719cf2e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:26.545350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0] Write session: try to update token
2025-09-30T14:58:26.545371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:26.547105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:58:26.547146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:58:26.547155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.547158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.547160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.547180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:58:26.547197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:58:26.547348Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244306541 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:58:26.547371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:58:26.547413Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 sending to client partition status
2025-09-30T14:58:26.553884Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:26.553904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:26.553915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896761871794104:7555]
2025-09-30T14:58:26.553963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:26.553971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:26.554153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:26.554324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:26.554490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:26.554636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:26.554848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:26.554902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:26.562229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2902 sessionId: src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:26.564865Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:26.564886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:26.564888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:26.564891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:26.564901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896761871794104:7555]
2025-09-30T14:58:26.564905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896761871794104:7555]
2025-09-30T14:58:26.564909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896761871794104:7555]
2025-09-30T14:58:26.564949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:26.564957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.564961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:26.564952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:26.564972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:26.564976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:26.565102Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:26.565268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:26.679125Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:26.679972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.679990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.680247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_30_8794492065082298093_v1
2025-09-30T14:58:26.680235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896761961588886:7727]
2025-09-30T14:58:26.680272Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:26.680269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:26.680302Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_30_8794492065082298093_v1
2025-09-30T14:58:26.680272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:26.680344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2902 reason: error at write: Disconnected sessionId: src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0
2025-09-30T14:58:26.680506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:26.680541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2902 sessionId: src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0 is DEAD
2025-09-30T14:58:26.680696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:26.680707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0] Write session will restart in 0.005913s
2025-09-30T14:58:26.680743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0] Write session: Do CDS request
2025-09-30T14:58:26.680749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:26.687782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:26.687910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:26.687927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2903
2025-09-30T14:58:26.688157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2903 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:26.688194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2903 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:26.688205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2903 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:26.688209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:26.688657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2903 sessionId:  describe result for acl check
2025-09-30T14:58:26.688692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:26.688702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:26.688704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:26.688710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896761961589148:7720] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:26.689248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896761961589148:7720] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:26.692065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896761961589148:7720] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:26.695806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896761961589148:7720] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:26.695822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896761961589148:7720] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:26.695826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896761961589148:7720] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:26.695834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2903 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:26.701238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:26.706360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:26.706614Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:26.706628Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:26.706640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:26.706706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:26.706754Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896761871794357:7546]
2025-09-30T14:58:26.707498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:26.707927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:26.707995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:26.708493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:26.708569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.708575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.708576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.708576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.708578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.708579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.708580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.708581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.708581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.708582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.708583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.708584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.708584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.708586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.708586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.708591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.708599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.708602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.708604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.708607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.708609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.708611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.708614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.708616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.708619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.708621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.708623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.708625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.708628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.708630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.708637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.708642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.708647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.708653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.708658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.708663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.708668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.708673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.708679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.708684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.708689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.708693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.708696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.708699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.708701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.708704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.708709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.708712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.708714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.708717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.708720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.708723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.708726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.708729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.708731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.708734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.708737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.708740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.708743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.708745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.708810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:26.714591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:26.715866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:26.715886Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:26.715889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:26.715893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:26.715900Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2902 [2:7555896761871794357:7546]
2025-09-30T14:58:26.715918Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:26.715934Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:26.715937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.715941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.715943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.715959Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:26.715966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:26.715984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:26.716046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.716055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.716058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.716062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:26.716064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:26.716134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:26.716143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.716156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.716169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.716186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:26.716205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961589282:7720], now have 1 active actors on pipe
2025-09-30T14:58:26.716217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896761871794352:7546]
2025-09-30T14:58:26.716219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896761871794352:7546]
2025-09-30T14:58:26.716222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896761871794352:7546]
2025-09-30T14:58:26.716233Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:26.716244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:26.716248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:26.716250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961589132:2454], now have 1 active actors on pipe
2025-09-30T14:58:26.716258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:26.716258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:26.716276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:26.716279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:26.716313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896761871794352:7546]
2025-09-30T14:58:26.716325Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:26.716345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2902
2025-09-30T14:58:26.716389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:26.716389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2902
2025-09-30T14:58:26.716552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.716562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.716588Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3811d133-618b4608-eb7c3470-ddc7a54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:26.716596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.716600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.716603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:26.716613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.716623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:26.716636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:26.717220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.717234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.717256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:26.717374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2903 partition: 0 MaxSeqNo: 42 sessionId: src_id|3811d133-618b4608-eb7c3470-ddc7a54_0
2025-09-30T14:58:26.717733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c59d77d6-7f7eb69b-c4251f49-97e7fa64_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3811d133-618b4608-eb7c3470-ddc7a54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:26.720718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3811d133-618b4608-eb7c3470-ddc7a54_0] Write session: try to update token
2025-09-30T14:58:26.720744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3811d133-618b4608-eb7c3470-ddc7a54_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:26.729686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:26.729712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:26.729715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:26.729718Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:26.729729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896761871794352:7546]
2025-09-30T14:58:26.729734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896761871794352:7546]
2025-09-30T14:58:26.729739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896761871794352:7546]
2025-09-30T14:58:26.729782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:26.729781Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:26.729788Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:26.729792Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:26.729796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.729798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:26.729945Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:26.739752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2903 sessionId: src_id|3811d133-618b4608-eb7c3470-ddc7a54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:26.742462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:26.780367Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896761961589386:7727]
2025-09-30T14:58:26.782189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 2902, pipe: [1:7555896761961589386:7727]
2025-09-30T14:58:26.847857Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:26.848695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.848716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.848738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961589386:7727], now have 1 active actors on pipe
2025-09-30T14:58:26.849001Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:26.849402Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3811d133-618b4608-eb7c3470-ddc7a54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:26.849413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3811d133-618b4608-eb7c3470-ddc7a54_0] Write session will restart in 0.006163s
2025-09-30T14:58:26.849436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3811d133-618b4608-eb7c3470-ddc7a54_0] Write session: Do CDS request
2025-09-30T14:58:26.849442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3811d133-618b4608-eb7c3470-ddc7a54_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:26.848986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:26.849002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:26.849067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2903 reason: error at write: Disconnected sessionId: src_id|3811d133-618b4608-eb7c3470-ddc7a54_0
2025-09-30T14:58:26.849254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2903 sessionId: src_id|3811d133-618b4608-eb7c3470-ddc7a54_0 is DEAD
2025-09-30T14:58:26.849422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:26.849427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896761961589386:7727]
2025-09-30T14:58:26.856862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3811d133-618b4608-eb7c3470-ddc7a54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:26.859598Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:26.859614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2904
2025-09-30T14:58:26.859943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2904 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:26.859991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2904 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:26.859996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2904 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:26.860000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:26.862583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2904 sessionId:  describe result for acl check
2025-09-30T14:58:26.862619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:26.862621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:26.862623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:26.862629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896761961589427:7150] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:26.863181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896761961589427:7150] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:26.866615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896761961589427:7150] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:26.870375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896761961589427:7150] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:26.870392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896761961589427:7150] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:26.870395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896761961589427:7150] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:26.870404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2904 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:26.890820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:26.895843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:26.896052Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:26.896055Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:26.896062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:26.896109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:26.896152Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896761871794601:7541]
2025-09-30T14:58:26.896689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:26.897028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:26.897065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:26.897330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:26.897380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.897381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.897382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.897383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.897384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.897384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.897385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.897387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.897387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.897388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.897389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.897390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.897391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.897392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.897393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.897397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.897404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.897407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.897409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.897412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.897415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.897418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.897420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.897423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.897428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.897432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.897436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.897439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.897443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.897447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.897455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.897463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:26.897470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.897476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:26.897482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.897487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:26.897492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.897497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:26.897502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.897520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:26.897524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.897529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:26.897534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.897540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:26.897545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.897551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:26.897556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.897561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:26.897566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.897571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:26.897576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.897581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.897586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.897591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.897596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.897601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.897606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.897611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:26.897615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.897620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:26.897653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:26.903446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:26.904680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:26.904692Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:26.904694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:26.904697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:26.904703Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2903 [2:7555896761871794601:7541]
2025-09-30T14:58:26.904715Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:26.904729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:26.904731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.904733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.904736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.904748Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:26.904753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:26.904759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:26.904825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.904831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.904833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.904836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:26.904838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:26.904907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:26.904916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.904929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:26.904944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:26.904963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:26.904987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961589388:2454], now have 1 active actors on pipe
2025-09-30T14:58:26.904996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961589488:7150], now have 1 active actors on pipe
2025-09-30T14:58:26.905002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896761871794596:7541]
2025-09-30T14:58:26.905006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896761871794596:7541]
2025-09-30T14:58:26.905008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896761871794596:7541]
2025-09-30T14:58:26.905020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:26.905038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:26.905056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:26.905064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:26.905103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896761871794596:7541]
2025-09-30T14:58:26.905111Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:26.905144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:26.905161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:26.905163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:26.905169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:26.905103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2903
2025-09-30T14:58:26.905152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2903
2025-09-30T14:58:26.905317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.905328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.905350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:26.905363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:26.905371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:26.905374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:26.905384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:26.905398Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:26.905415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:26.905653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:26.905662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:26.905676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:26.905831Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2904 partition: 0 MaxSeqNo: 42 sessionId: src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0
2025-09-30T14:58:26.906204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3811d133-618b4608-eb7c3470-ddc7a54_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:26.909084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0] Write session: try to update token
2025-09-30T14:58:26.909104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:26.918280Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:26.918301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:26.918303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:26.918306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:26.918315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896761871794596:7541]
2025-09-30T14:58:26.918319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896761871794596:7541]
2025-09-30T14:58:26.918323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896761871794596:7541]
2025-09-30T14:58:26.918365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:26.918373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:26.918376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:26.918395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:26.918405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:26.918413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:26.918517Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:26.926717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2904 sessionId: src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:26.929504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:26.954279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896761961589641:7727]
2025-09-30T14:58:26.954602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 2903, pipe: [1:7555896761961589641:7727]
2025-09-30T14:58:27.041721Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:27.042538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.042554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.042592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896761961589641:7727], now have 1 active actors on pipe
2025-09-30T14:58:27.042892Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:27.042855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:27.042903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:27.042907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:27.042922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896761961589641:7727]
2025-09-30T14:58:27.042978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2904 reason: error at write: Disconnected sessionId: src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0
2025-09-30T14:58:27.043170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2904 sessionId: src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0 is DEAD
2025-09-30T14:58:27.043337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:27.043347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0] Write session will restart in 0.007269s
2025-09-30T14:58:27.043371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0] Write session: Do CDS request
2025-09-30T14:58:27.043380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:27.051761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:27.051869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:27.051889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2905
2025-09-30T14:58:27.052060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2905 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:27.052093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2905 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:27.052102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2905 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:27.052106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:27.052646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2905 sessionId:  describe result for acl check
2025-09-30T14:58:27.052692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:27.052700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:27.052702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:27.052708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896766256556955:7739] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:27.053292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896766256556955:7739] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:27.055771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896766256556955:7739] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:27.062581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896766256556955:7739] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:27.062599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896766256556955:7739] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:27.062602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896766256556955:7739] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:27.062611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2905 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:27.072663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:27.078282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:27.078519Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:27.078531Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:27.078542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:27.078602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:27.078662Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896766166762145:7537]
2025-09-30T14:58:27.079389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:27.079717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:27.079769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:27.080122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:27.080191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.080198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.080200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.080201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.080202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.080204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.080206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.080208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.080210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.080211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.080213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.080214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.080216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.080217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.080219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.080224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.080235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.080240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.080245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.080249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.080253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.080258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.080262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.080266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.080271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.080276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.080280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.080285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.080290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.080294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.080302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.080311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.080317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.080323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.080328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.080332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.080337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.080343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.080347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.080353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.080357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.080362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.080368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.080380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.080385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.080391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.080402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.080408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.080413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.080424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.080429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.080436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.080442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.080450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.080457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.080467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.080472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.080477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.080483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.080494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.080543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:27.086143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:27.087030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:27.087054Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:27.087057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:27.087061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:27.087069Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2904 [2:7555896766166762145:7537]
2025-09-30T14:58:27.087088Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:27.087110Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:27.087119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:27.087122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:27.087126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:27.087143Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:27.087150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:27.087158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:27.087231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.087240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.087260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.087269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:27.087272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:27.087342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:27.087349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.087363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.087382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.087405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:27.087424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256556940:2454], now have 1 active actors on pipe
2025-09-30T14:58:27.087434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256557114:7739], now have 1 active actors on pipe
2025-09-30T14:58:27.087441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896766166762139:7537]
2025-09-30T14:58:27.087445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896766166762139:7537]
2025-09-30T14:58:27.087448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896766166762139:7537]
2025-09-30T14:58:27.087464Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:27.087482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:27.087482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:27.087486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:27.087490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:27.087499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:27.087507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:27.087499Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2904
2025-09-30T14:58:27.087541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896766166762139:7537]
2025-09-30T14:58:27.087520Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2904
2025-09-30T14:58:27.087549Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:27.087551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:27.087571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.087580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.087627Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:27.087639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:27.087651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:27.087653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:27.087664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:27.087678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:27.087700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:27.087862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.087871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.087887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:27.087976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2905 partition: 0 MaxSeqNo: 42 sessionId: src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0
2025-09-30T14:58:27.088377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|25da6b57-3ea83238-6989f06f-9b47dc64_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:27.091451Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0] Write session: try to update token
2025-09-30T14:58:27.091478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:27.109672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:27.109692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:27.109695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:27.109697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:27.109708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896766166762139:7537]
2025-09-30T14:58:27.109712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896766166762139:7537]
2025-09-30T14:58:27.109717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896766166762139:7537]
2025-09-30T14:58:27.109762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:27.109771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.109774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:27.109780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:27.109789Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:27.109793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:27.109929Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:27.117259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2905 sessionId: src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:27.120229Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:27.142865Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896766256557193:7727]
2025-09-30T14:58:27.143154Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 2904, pipe: [1:7555896766256557193:7727]
2025-09-30T14:58:27.224501Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:27.225506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.225527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.225569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256557193:7727], now have 1 active actors on pipe
2025-09-30T14:58:27.227515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:27.228020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896766256557193:7727]
2025-09-30T14:58:27.228068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:27.228115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:27.228199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2905 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0
2025-09-30T14:58:27.228425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2905 sessionId: src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0 is DEAD
2025-09-30T14:58:27.228565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:27.228576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0] Write session will restart in 0.009133s
2025-09-30T14:58:27.228600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0] Write session: Do CDS request
2025-09-30T14:58:27.228606Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:27.238797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:27.239405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:27.239422Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2906
2025-09-30T14:58:27.243384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2906 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:27.243448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2906 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:27.243456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2906 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:27.243467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:27.244073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2906 sessionId:  describe result for acl check
2025-09-30T14:58:27.244113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:27.244121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:27.244126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:27.244132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896766256557277:7747] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:27.244775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896766256557277:7747] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:27.247578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896766256557277:7747] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:27.258277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:27.258326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896766256557277:7747] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:27.258349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896766256557277:7747] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:27.258353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896766256557277:7747] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:27.258362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2906 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:27.259050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:27.259281Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:27.259293Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:27.259304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:27.259365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:27.259411Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896766166762391:7524]
2025-09-30T14:58:27.260023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:27.260556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:27.260629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:27.260998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:27.261094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.261101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.261103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.261104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.261105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.261106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.261108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.261109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.261110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.261111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.261112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.261113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.261115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.261116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.261117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.261123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.261135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.261138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.261142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.261146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.261150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.261153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.261157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.261161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.261165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.261169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.261172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.261177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.261180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.261184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.261193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.261200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.261207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.261213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.261218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.261224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.261229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.261234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.261240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.261246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.261252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.261258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.261264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.261269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.261274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.261280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.261285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.261290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.261295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.261300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.261305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.261311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.261316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.261322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.261329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.261335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.261340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.261355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.261360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.261367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.261412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:27.267338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:27.268822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:27.268839Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:27.268842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:27.268846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:27.268854Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2905 [2:7555896766166762391:7524]
2025-09-30T14:58:27.268873Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:27.268896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:27.268899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:27.268902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:27.268905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:27.268921Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:27.268928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:27.268936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:27.269012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.269015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.269017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.269020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:27.269023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:27.269099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:27.269102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.269116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.269129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.269146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:27.269164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896766166762385:7524]
2025-09-30T14:58:27.269176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896766166762385:7524]
2025-09-30T14:58:27.269178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896766166762385:7524]
2025-09-30T14:58:27.269188Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:27.269203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:27.269205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256557196:2454], now have 1 active actors on pipe
2025-09-30T14:58:27.269211Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:27.269215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:27.269217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:27.269225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:27.269228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:27.269234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256557441:7747], now have 1 active actors on pipe
2025-09-30T14:58:27.269269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896766166762385:7524]
2025-09-30T14:58:27.269279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:27.269285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:27.269331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2905
2025-09-30T14:58:27.269338Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2905
2025-09-30T14:58:27.269543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.269557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.269586Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:27.269599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:27.269607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:27.269610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:27.269622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:27.269633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:27.269659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:27.269841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.269849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.269863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:27.270031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2906 partition: 0 MaxSeqNo: 42 sessionId: src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0
2025-09-30T14:58:27.270562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4548e003-4f0426fa-ff90abc4-9d4a5baf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:27.274038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0] Write session: try to update token
2025-09-30T14:58:27.274065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:27.282012Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:27.282035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:27.282037Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:27.282040Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:27.282051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896766166762385:7524]
2025-09-30T14:58:27.282056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896766166762385:7524]
2025-09-30T14:58:27.282061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896766166762385:7524]
2025-09-30T14:58:27.282106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:27.282115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.282115Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:27.282118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:27.282122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:27.282142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:27.282270Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:27.293272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2906 sessionId: src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:27.296859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:27.327675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896766256557457:7727]
2025-09-30T14:58:27.327997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 2905, pipe: [1:7555896766256557457:7727]
2025-09-30T14:58:27.396609Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:27.396940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.396953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.396970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256557457:7727], now have 1 active actors on pipe
2025-09-30T14:58:27.397208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896766256557457:7727]
2025-09-30T14:58:27.397224Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:27.397243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:27.397313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2906 reason: status is not ok: tablet will be restarted right now sessionId: src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0
2025-09-30T14:58:27.397163Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:27.397534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2906 sessionId: src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0 is DEAD
2025-09-30T14:58:27.397854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:27.397865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0] Write session will restart in 0.006822s
2025-09-30T14:58:27.397891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0] Write session: Do CDS request
2025-09-30T14:58:27.397898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:27.405762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:27.405864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:27.405882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2907
2025-09-30T14:58:27.406034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2907 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:27.406072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2907 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:27.406077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2907 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:27.406081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:27.406638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2907 sessionId:  describe result for acl check
2025-09-30T14:58:27.406679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:27.406686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:27.406688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:27.406695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896766256557478:7763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:27.407382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896766256557478:7763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:27.410256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896766256557478:7763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:27.418779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896766256557478:7763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:27.418803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896766256557478:7763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:27.418806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896766256557478:7763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:27.418815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2907 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:27.429143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:27.429988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:27.430438Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:27.430451Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:27.430464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:27.430529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:27.430864Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896766166762663:7532]
2025-09-30T14:58:27.431571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:27.431967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:27.432026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:27.432426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:27.432496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.432497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.432499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.432500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.432504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.432505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.432507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.432508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.432509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.432511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.432513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.432514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.432515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.432516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.432517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.432524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.432534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.432538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.432542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.432546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.432550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.432554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.432557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.432561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.432565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.432569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.432573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.432577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.432581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.432585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.432592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.432599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.432605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.432611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.432615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.432625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.432630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.432635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.432641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.432646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.432650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.432655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.432660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.432665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.432669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.432673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.432678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.432682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.432686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.432691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.432696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.432700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.432705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.432709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.432715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.432720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.432724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.432728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.432732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.432737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.432812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:27.439393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:27.440635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:27.440658Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:27.440661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:27.440665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:27.440672Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2906 [2:7555896766166762663:7532]
2025-09-30T14:58:27.440687Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:27.440706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:27.440709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:27.440712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:27.440714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:27.440730Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:27.440743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:27.440750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:27.440835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.440845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.440847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.440851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:27.440853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:27.440922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:27.440934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.440948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.440960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.440976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:27.440998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256557462:2454], now have 1 active actors on pipe
2025-09-30T14:58:27.441002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256557693:7763], now have 1 active actors on pipe
2025-09-30T14:58:27.441009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896766166762658:7532]
2025-09-30T14:58:27.441011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896766166762658:7532]
2025-09-30T14:58:27.441013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896766166762658:7532]
2025-09-30T14:58:27.441029Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:27.441042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:27.441058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:27.441062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:27.441066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:27.441070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:27.441073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:27.441102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896766166762658:7532]
2025-09-30T14:58:27.441112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:27.441139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:27.441291Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2906
2025-09-30T14:58:27.441350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2906
2025-09-30T14:58:27.442292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2907 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0
2025-09-30T14:58:27.441729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.441746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.441780Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:27.441789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:27.441793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:27.441795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:27.441807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:27.441820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:27.441837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:27.442095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.442099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.442114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:27.442709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81f18d01-b9b79671-93bc44da-ead4d4aa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:27.446140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0] Write session: try to update token
2025-09-30T14:58:27.446162Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:27.460920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:27.460952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:27.460961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896766166762658:7532]
2025-09-30T14:58:27.460998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:27.461005Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:27.461181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:27.461349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:27.461509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:27.461660Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:27.461883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:27.461932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:27.466010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2907 sessionId: src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:27.469182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:27.469456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.469484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.469526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:27.469645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:27.474154Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:27.474178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:27.474181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:27.474183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:27.474193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896766166762658:7532]
2025-09-30T14:58:27.474199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896766166762658:7532]
2025-09-30T14:58:27.474202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896766166762658:7532]
2025-09-30T14:58:27.474245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:27.474258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.474257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:27.474261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:27.474266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:27.474271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:27.474413Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:27.497184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896766256557739:7727]
2025-09-30T14:58:27.497905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 2906, pipe: [1:7555896766256557739:7727]
2025-09-30T14:58:27.598561Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:27.608403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.608441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.608623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.608692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.608755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.608844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.609333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.609347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.609426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.609490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.609559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.609627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.609673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.609682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.609755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.609825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.609893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.609998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.610063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.610073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.610161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.610235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.610307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.610375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.610422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.610430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.610504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.610568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.610638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.610712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.610759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.610770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.610841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.610908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.610976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.611044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.611091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.611099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.611168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.611234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.611325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.611394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.611435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.611446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.611520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.611584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.611654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.611727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.611777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.611781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.611848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.611908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.611973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.612036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.612080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.612083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.612154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.612214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.612280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.612344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.612388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.612392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.612467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256557739:7727], now have 1 active actors on pipe
2025-09-30T14:58:27.614254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:27.614231Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:27.614258Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896766256557739:7727]
2025-09-30T14:58:27.614285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:27.614287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:27.614318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2907 reason: error at write: Disconnected sessionId: src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0
2025-09-30T14:58:27.614505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2907 sessionId: src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0 is DEAD
2025-09-30T14:58:27.614716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:27.614729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0] Write session will restart in 0.005943s
2025-09-30T14:58:27.614754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0] Write session: Do CDS request
2025-09-30T14:58:27.614760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:27.621809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:27.621896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:27.621913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2908
2025-09-30T14:58:27.622067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2908 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:27.622113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2908 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:27.622125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2908 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:27.622129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:27.622592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2908 sessionId:  describe result for acl check
2025-09-30T14:58:27.622626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:27.622631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:27.622633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:27.622639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896766256557769:7787] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:27.623214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896766256557769:7787] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:27.626165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896766256557769:7787] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:27.631793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896766256557769:7787] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:27.631814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896766256557769:7787] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:27.631818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896766256557769:7787] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:27.631828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2908 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:27.637097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:27.642992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:27.643294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:27.643310Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:27.643323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:27.643389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:27.643436Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896766166762937:7504]
2025-09-30T14:58:27.644157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:27.644557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:27.644610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:27.645000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:27.645069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.645075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.645076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.645078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.645079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.645081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.645082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.645083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.645085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.645086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.645088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.645089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.645090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.645092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.645093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.645099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.645111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.645115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.645121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.645125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.645130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.645134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.645138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.645143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.645147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.645151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.645156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.645160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.645164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.645168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.645176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.645184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.645192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.645198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.645203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.645210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.645215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.645221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.645227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.645232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.645237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.645242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.645247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.645253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.645264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.645270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.645279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.645285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.645290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.645295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.645305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.645313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.645318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.645328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.645333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.645339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.645348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.645353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.645363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.645368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.645415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:27.651164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:27.652701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:27.652717Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:27.652720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:27.652725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:27.652732Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2907 [2:7555896766166762937:7504]
2025-09-30T14:58:27.652751Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:27.652767Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:27.652771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:27.652775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:27.652777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:27.652806Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:27.652814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:27.652821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:27.652894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.652903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.652906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.652909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:27.652913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:27.652984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:27.652993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.653006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.653016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.653033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:27.653056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256557945:7787], now have 1 active actors on pipe
2025-09-30T14:58:27.653065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256557754:2454], now have 1 active actors on pipe
2025-09-30T14:58:27.653071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896766166762932:7504]
2025-09-30T14:58:27.653073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896766166762932:7504]
2025-09-30T14:58:27.653075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896766166762932:7504]
2025-09-30T14:58:27.653091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:27.653108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:27.653108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:27.653111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:27.653113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:27.653127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:27.653136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:27.653172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896766166762932:7504]
2025-09-30T14:58:27.653182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:27.653176Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2907
2025-09-30T14:58:27.653178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2907
2025-09-30T14:58:27.653218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:27.653321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.653332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.653360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:27.653372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:27.653376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:27.653378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:27.653388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:27.653402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:27.653417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:27.653585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.653593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.653605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:27.653713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2908 partition: 0 MaxSeqNo: 42 sessionId: src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0
2025-09-30T14:58:27.654118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1d3ab10-e5ce9d2e-45f3b256-5b0f8516_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:27.657171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0] Write session: try to update token
2025-09-30T14:58:27.657193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:27.666493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:27.666521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:27.666535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896766166762932:7504]
2025-09-30T14:58:27.666585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:27.666584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:27.666798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:27.666966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:27.667123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:27.667303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:27.667527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:27.667582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:27.674514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2908 sessionId: src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:27.677392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:27.678915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:27.678695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.678726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.678767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:27.689333Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:27.689361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:27.689363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:27.689366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:27.689378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896766166762932:7504]
2025-09-30T14:58:27.689382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896766166762932:7504]
2025-09-30T14:58:27.689386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896766166762932:7504]
2025-09-30T14:58:27.689428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:27.689435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.689438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:27.689445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:27.689453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:27.689456Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:27.689585Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:27.712198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896766256558011:7727]
2025-09-30T14:58:27.712507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 2907, pipe: [1:7555896766256558011:7727]
2025-09-30T14:58:27.807526Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:27.816147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.816176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.816358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.816431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.816503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.816570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.816619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.816629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.816701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.816767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.816846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.816918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.816969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.816978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.817049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.817112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.817179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.817245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.817290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.817300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.817376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.817442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.817506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.817573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.817621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.817628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.817699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.817763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.817828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.817892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.817944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.817952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.818026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.818092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.818159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.818226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.818274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.818282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.818351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.818417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.818487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.818561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.818610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.818618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.818696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.818758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.818826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.818893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.818940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.818948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.819014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.819079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.819147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.819216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.819284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.819293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.819365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:27.819430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:27.819500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:27.819565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:27.819613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:27.819622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:27.819690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256558011:7727], now have 1 active actors on pipe
2025-09-30T14:58:27.819929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:27.819931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:27.819935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:27.819967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2908 reason: error at write: Disconnected sessionId: src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0
2025-09-30T14:58:27.819992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896766256558011:7727]
2025-09-30T14:58:27.820197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2908 sessionId: src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0 is DEAD
2025-09-30T14:58:27.820324Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:27.820333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0] Write session will restart in 0.009434s
2025-09-30T14:58:27.820357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0] Write session: Do CDS request
2025-09-30T14:58:27.820362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:27.821086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:27.830786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:27.830857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:27.830882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2909
2025-09-30T14:58:27.831012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2909 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:27.831044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2909 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:27.831062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2909 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:27.831070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:27.831564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2909 sessionId:  describe result for acl check
2025-09-30T14:58:27.831595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:27.831601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:27.831603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:27.831608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896766256558065:7814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:27.832152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896766256558065:7814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:27.835890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896766256558065:7814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:27.838923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896766256558065:7814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:27.838945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896766256558065:7814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:27.838949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896766256558065:7814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:27.838957Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2909 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:27.846237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:27.846845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:27.847037Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:27.847048Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:27.847057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:27.847096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:27.847130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896766166763186:7498]
2025-09-30T14:58:27.847677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:27.848007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:27.848075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:27.848446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:27.848520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.848526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.848527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.848529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.848530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.848531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.848533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.848534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.848535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.848537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.848538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.848539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.848540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.848541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.848542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.848548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.848559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.848563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.848568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.848572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.848577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.848581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.848585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.848589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.848594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.848597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.848601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.848605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.848608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.848612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.848619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.848628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:27.848634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.848640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:27.848645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.848656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:27.848661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.848671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:27.848676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.848687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:27.848692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.848701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:27.848707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.848717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:27.848722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.848731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:27.848736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.848741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:27.848751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.848756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:27.848778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.848787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.848791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.848808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.848817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.848822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.848826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.848831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:27.848841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.848846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:27.848896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:27.854537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:27.856314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:27.856332Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:27.856335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:27.856339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:27.856345Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2908 [2:7555896766166763186:7498]
2025-09-30T14:58:27.856360Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:27.856376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:27.856379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:27.856382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:27.856384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:27.856399Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:27.856407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:27.856413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:27.856475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.856484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.856486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.856490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:27.856492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:27.856559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:27.856566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.856579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:27.856596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:27.856617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:27.856636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896766166763181:7498]
2025-09-30T14:58:27.856645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896766166763181:7498]
2025-09-30T14:58:27.856646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896766166763181:7498]
2025-09-30T14:58:27.856657Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:27.856670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:27.856670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:27.856674Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:27.856677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:27.856684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:27.856686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:27.856696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256558257:7814], now have 1 active actors on pipe
2025-09-30T14:58:27.856699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256558015:2454], now have 1 active actors on pipe
2025-09-30T14:58:27.856730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896766166763181:7498]
2025-09-30T14:58:27.856739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:27.856759Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:27.856776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2908
2025-09-30T14:58:27.856788Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2908
2025-09-30T14:58:27.856857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.856870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.856912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6118f91f-55536994-fa20a58a-74db0517_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:27.856927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:27.856932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:27.856934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:27.856946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:27.856957Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:27.856974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:27.857139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.857150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.857181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:27.857291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2909 partition: 0 MaxSeqNo: 42 sessionId: src_id|6118f91f-55536994-fa20a58a-74db0517_0
2025-09-30T14:58:27.857686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ffb390d-674d2c03-d18d453c-7783fdc6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6118f91f-55536994-fa20a58a-74db0517_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:27.860665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6118f91f-55536994-fa20a58a-74db0517_0] Write session: try to update token
2025-09-30T14:58:27.860683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6118f91f-55536994-fa20a58a-74db0517_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:27.870030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:27.870051Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:27.870061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896766166763181:7498]
2025-09-30T14:58:27.870104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:27.870107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:27.870286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:27.870444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:27.870600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:27.870753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:27.871168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:27.871220Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:27.876480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2909 sessionId: src_id|6118f91f-55536994-fa20a58a-74db0517_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:27.879318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:27.879557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:27.879579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:27.879629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:27.879752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:27.881417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:27.881439Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:27.881442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:27.881444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:27.881454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896766166763181:7498]
2025-09-30T14:58:27.881458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896766166763181:7498]
2025-09-30T14:58:27.881462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896766166763181:7498]
2025-09-30T14:58:27.881502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:27.881509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:27.881511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:27.881510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:27.881516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:27.881521Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:27.881649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:27.920044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896766256558273:7727]
2025-09-30T14:58:27.920244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 2908, pipe: [1:7555896766256558273:7727]
2025-09-30T14:58:27.997064Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:28.005381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.005420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.005619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:28.005694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:28.005766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:28.005841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:28.005896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:28.005906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:28.005995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:28.006065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:28.006139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:28.006215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:28.006270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:28.006278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:28.006356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:28.006427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:28.006497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:28.006574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:28.006627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:28.006634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:28.006717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:28.006797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:28.006871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:28.006949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:28.007004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:28.007012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:28.007091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:28.007157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:28.007235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:28.007328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:28.007381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:28.007392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:28.007472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:28.007539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:28.007612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:28.007688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:28.009382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:28.009400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:28.009445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2909 reason: error at write: Disconnected sessionId: src_id|6118f91f-55536994-fa20a58a-74db0517_0
2025-09-30T14:58:28.009479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896766256558273:7727]
2025-09-30T14:58:28.009517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:28.009813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6118f91f-55536994-fa20a58a-74db0517_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:28.009822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6118f91f-55536994-fa20a58a-74db0517_0] Write session will restart in 0.007530s
2025-09-30T14:58:28.009846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6118f91f-55536994-fa20a58a-74db0517_0] Write session: Do CDS request
2025-09-30T14:58:28.009851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6118f91f-55536994-fa20a58a-74db0517_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:28.009635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2909 sessionId: src_id|6118f91f-55536994-fa20a58a-74db0517_0 is DEAD
2025-09-30T14:58:28.007741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:28.007756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:28.007834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:28.007899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:28.007968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:28.008038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:28.008086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:28.008089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:28.008165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:28.008228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:28.008291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:28.008360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:28.008404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:28.008408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:28.008480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:28.008543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:28.008606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:28.008673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:28.008716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:28.008719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:28.008810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:28.008873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:28.008939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:28.009003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:28.009050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:28.009053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:28.009132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896766256558273:7727], now have 1 active actors on pipe
2025-09-30T14:58:28.010681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:28.018812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6118f91f-55536994-fa20a58a-74db0517_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:28.018909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:28.018927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2910
2025-09-30T14:58:28.019455Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2910 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:28.019506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2910 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:28.019517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2910 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:28.019521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:28.019986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2910 sessionId:  describe result for acl check
2025-09-30T14:58:28.020025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:28.020031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:28.020033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:28.020043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896770551525595:7811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:28.020625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896770551525595:7811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:28.025017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896770551525595:7811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:28.029051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896770551525595:7811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:28.029071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896770551525595:7811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:28.029074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896770551525595:7811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:28.029085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2910 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:28.038150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:28.038919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:28.039179Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:28.039193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:28.039217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:28.039311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:28.039408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896770461730732:7502]
2025-09-30T14:58:28.040069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:28.040486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:28.040548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:28.040918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:28.041011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.041018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.041020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.041021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.041023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.041024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.041026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.041027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.041029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.041030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.041032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.041033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.041034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.041036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.041037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.041044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.041056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.041060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.041064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.041068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.041072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.041076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.041080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.041085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.041089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.041093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.041097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.041101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.041105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.041108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.041119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.041128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.041135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.041141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.041145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.041151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.041157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.041162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.041167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.041173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.041185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.041190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.041200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.041205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.041210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.041215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.041220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.041225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.041234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.041242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.041251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.041256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.041262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.041272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.041276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.041280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.041288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.041294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.041303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.041309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.041356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:28.047017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:28.048476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:28.048496Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:28.048500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:28.048504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:28.048511Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2909 [2:7555896770461730732:7502]
2025-09-30T14:58:28.048528Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:28.048544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:28.048547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:28.048549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:28.048551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:28.048566Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:28.048574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:28.048581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:28.048651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.048661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.048663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.048667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:28.048670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:28.048741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:28.048749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.048762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.048773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.048807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:28.048830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551525798:7811], now have 1 active actors on pipe
2025-09-30T14:58:28.048839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551525571:2454], now have 1 active actors on pipe
2025-09-30T14:58:28.048847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896770461730727:7502]
2025-09-30T14:58:28.048850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896770461730727:7502]
2025-09-30T14:58:28.048853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896770461730727:7502]
2025-09-30T14:58:28.048865Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:28.048885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:28.048897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:28.048904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:28.048907Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:28.048908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:28.048911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:28.048945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896770461730727:7502]
2025-09-30T14:58:28.048958Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:28.048944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2909
2025-09-30T14:58:28.048957Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2909
2025-09-30T14:58:28.048972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:28.048993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.048999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.049031Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:28.049046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:28.049050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:28.049052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:28.049062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:28.049073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:28.049088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:28.049261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.049276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.049298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:28.049381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2910 partition: 0 MaxSeqNo: 42 sessionId: src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0
2025-09-30T14:58:28.049771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6118f91f-55536994-fa20a58a-74db0517_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:28.052629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0] Write session: try to update token
2025-09-30T14:58:28.052650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:28.061386Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:28.061407Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:28.061410Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:28.061412Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:28.061422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896770461730727:7502]
2025-09-30T14:58:28.061427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896770461730727:7502]
2025-09-30T14:58:28.061431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896770461730727:7502]
2025-09-30T14:58:28.061469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:28.061472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:28.061476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.061479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:28.061479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:28.061486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:28.061613Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:28.068335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2910 sessionId: src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:28.071314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:28.109499Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896770551525830:7727]
2025-09-30T14:58:28.109767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 2909, pipe: [1:7555896770551525830:7727]
2025-09-30T14:58:28.172359Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:28.173135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.173153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.173172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551525830:7727], now have 1 active actors on pipe
2025-09-30T14:58:28.173359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:28.173378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896770551525830:7727]
2025-09-30T14:58:28.173418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:28.173421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:28.173549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:28.173613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2910 reason: error at write: Disconnected sessionId: src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0
2025-09-30T14:58:28.173750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2910 sessionId: src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0 is DEAD
2025-09-30T14:58:28.173890Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:28.173919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0] Write session will restart in 0.009663s
2025-09-30T14:58:28.173943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0] Write session: Do CDS request
2025-09-30T14:58:28.173948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:28.184752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:28.184873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:28.184892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2911
2025-09-30T14:58:28.185018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2911 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:28.185052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2911 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:28.185057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2911 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:28.185062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:28.185669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2911 sessionId:  describe result for acl check
2025-09-30T14:58:28.185709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:28.185714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:28.185716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:28.185722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896770551525900:7826] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:28.186283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896770551525900:7826] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:28.188358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896770551525900:7826] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:28.191449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896770551525900:7826] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:28.191467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896770551525900:7826] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:28.191471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896770551525900:7826] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:28.191479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2911 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:28.193884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:28.199109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:28.199374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:28.199390Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:28.199402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:28.199463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:28.199511Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896770461730985:7492]
2025-09-30T14:58:28.200216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:28.200583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:28.200634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:28.200996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:28.201065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.201072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.201074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.201075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.201077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.201078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.201080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.201081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.201083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.201084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.201085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.201087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.201088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.201089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.201091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.201097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.201108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.201113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.201118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.201123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.201127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.201132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.201137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.201141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.201147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.201152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.201156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.201160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.201164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.201169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.201177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.201187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.201196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.201208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.201219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.201230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.201241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.201248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.201258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.201269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.201278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.201288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.201294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.201299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.201304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.201310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.201316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.201322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.201327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.201333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.201343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.201353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.201362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.201373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.201382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.201388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.201392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.201399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.201408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.201418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.201472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:28.207286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:28.208266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:28.208287Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:28.208290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:28.208295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:28.208302Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2910 [2:7555896770461730985:7492]
2025-09-30T14:58:28.208321Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:28.208337Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:28.208346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:28.208349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:28.208353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:28.208370Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:28.208377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:28.208387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:28.208453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.208461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.208463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.208466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:28.208469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:28.208744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2910
2025-09-30T14:58:28.208751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2910
2025-09-30T14:58:28.209235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:28.209246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.209264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.209298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.209322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:28.209349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551526080:7826], now have 1 active actors on pipe
2025-09-30T14:58:28.209357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551525834:2454], now have 1 active actors on pipe
2025-09-30T14:58:28.209376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.209385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.209402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896770461730980:7492]
2025-09-30T14:58:28.209409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896770461730980:7492]
2025-09-30T14:58:28.209411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896770461730980:7492]
2025-09-30T14:58:28.209427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:28.209448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:28.209470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:28.209478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:28.209495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:28.209508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:28.209511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:28.209514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:28.209522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:28.209524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:28.209535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:28.209536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:28.209537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:28.209576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896770461730980:7492]
2025-09-30T14:58:28.209588Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:28.209595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:28.209605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:28.209796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.209804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.209818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:28.209974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2911 partition: 0 MaxSeqNo: 42 sessionId: src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0
2025-09-30T14:58:28.210327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ade2334-e92b808d-8faedf91-406d4f0f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:28.213317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0] Write session: try to update token
2025-09-30T14:58:28.213341Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:28.221929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:28.221952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:28.221962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896770461730980:7492]
2025-09-30T14:58:28.222008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:28.222012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:28.222183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:28.222337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:28.222484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:28.222627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:28.222832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:28.222877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:28.229200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2911 sessionId: src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:28.232253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:28.233022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.233053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.233073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:28.233077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:28.233079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:28.233081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:28.233091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896770461730980:7492]
2025-09-30T14:58:28.233095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896770461730980:7492]
2025-09-30T14:58:28.233100Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896770461730980:7492]
2025-09-30T14:58:28.233151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:28.233154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:28.233163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:28.233162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.233166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:28.233167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:28.233325Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:28.273373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896770551526096:7727]
2025-09-30T14:58:28.273687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 2910, pipe: [1:7555896770551526096:7727]
2025-09-30T14:58:28.346532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:28.346794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:28.346826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551526096:7727], now have 1 active actors on pipe
2025-09-30T14:58:28.346940Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:28.347026Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896770551526096:7727]
2025-09-30T14:58:28.347048Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:28.347051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:28.347057Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:28.347126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2911 reason: error at write: Disconnected sessionId: src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0
2025-09-30T14:58:28.347294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2911 sessionId: src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0 is DEAD
2025-09-30T14:58:28.347444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:28.347467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0] Write session will restart in 0.006956s
2025-09-30T14:58:28.347491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0] Write session: Do CDS request
2025-09-30T14:58:28.347496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:28.355799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:28.355859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:28.355877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2912
2025-09-30T14:58:28.356068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2912 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:28.356103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2912 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:28.356109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2912 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:28.356114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:28.356597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2912 sessionId:  describe result for acl check
2025-09-30T14:58:28.356635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:28.356643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:28.356645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:28.356651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896770551526129:7830] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:28.357207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896770551526129:7830] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:28.360774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896770551526129:7830] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:28.363971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896770551526129:7830] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:28.363988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896770551526129:7830] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:28.363991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896770551526129:7830] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:28.364000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2912 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:28.367368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:28.371958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:28.372193Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:28.372207Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:28.372219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:28.372280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:28.372418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896770461731249:7485]
2025-09-30T14:58:28.373149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:28.373487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:28.373533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:28.373873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:28.373942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.373948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.373949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.373951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.373952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.373953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.373955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.373956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.373957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.373958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.373960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.373961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.373962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.373964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.373965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.373971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.373982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.373987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.373991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.373996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.374000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.374005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.374010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.374014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.374019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.374024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.374028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.374033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.374038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.374043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.374052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.374065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.374095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.374107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.374113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.374119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.374123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.374129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.374136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.374142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.374147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.374153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.374164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.374169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.374179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.374186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.374196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.374202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.374211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.374216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.374224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.374234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.374240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.374250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.374256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.374266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.374271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.374281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.374288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.374297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.374351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:28.379805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:28.380717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:28.380746Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:28.380748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:28.380752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:28.380761Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2911 [2:7555896770461731249:7485]
2025-09-30T14:58:28.380777Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:28.380803Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:28.380810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:28.380813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:28.380815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:28.380830Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:28.380841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:28.380853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:28.380917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.380924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.380927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.380930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:28.380933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:28.380996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:28.381004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.381015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.381031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.381051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:28.381075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551526100:2454], now have 1 active actors on pipe
2025-09-30T14:58:28.381084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551526318:7830], now have 1 active actors on pipe
2025-09-30T14:58:28.381090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896770461731244:7485]
2025-09-30T14:58:28.381092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896770461731244:7485]
2025-09-30T14:58:28.381094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896770461731244:7485]
2025-09-30T14:58:28.381107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:28.381125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:28.381139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:28.381143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:28.381146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:28.381149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:28.381152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:28.381143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2911
2025-09-30T14:58:28.381176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896770461731244:7485]
2025-09-30T14:58:28.381179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:28.381194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:28.381153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2911
2025-09-30T14:58:28.381213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.381222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.381252Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:28.381263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:28.381267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:28.381273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:28.381283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:28.381296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:28.381313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:28.381446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.381458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.381471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:28.381665Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2912 partition: 0 MaxSeqNo: 42 sessionId: src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0
2025-09-30T14:58:28.382035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6304a106-6dd8113d-d3ced05a-4f54c418_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:28.384816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0] Write session: try to update token
2025-09-30T14:58:28.384834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:28.393261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:28.393286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:28.393290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:28.393292Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:28.393302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896770461731244:7485]
2025-09-30T14:58:28.393307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896770461731244:7485]
2025-09-30T14:58:28.393312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896770461731244:7485]
2025-09-30T14:58:28.393357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:28.393364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.393367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:28.393369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:28.393377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:28.393381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:28.393508Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:28.399646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2912 sessionId: src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:28.402471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:28.447425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896770551526365:7727]
2025-09-30T14:58:28.447708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 2911, pipe: [1:7555896770551526365:7727]
2025-09-30T14:58:28.512048Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:28.512865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.512882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.512909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551526365:7727], now have 1 active actors on pipe
2025-09-30T14:58:28.513090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896770551526365:7727]
2025-09-30T14:58:28.513125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:28.513128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:28.513118Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:28.513181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2912 reason: error at write: Disconnected sessionId: src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0
2025-09-30T14:58:28.513345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2912 sessionId: src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0 is DEAD
2025-09-30T14:58:28.513507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:28.513518Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0] Write session will restart in 0.008488s
2025-09-30T14:58:28.513543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0] Write session: Do CDS request
2025-09-30T14:58:28.513549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:28.513595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:28.522763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:28.522848Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:28.522863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2913
2025-09-30T14:58:28.523028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2913 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:28.523069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2913 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:28.523077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2913 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:28.523080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:28.523515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2913 sessionId:  describe result for acl check
2025-09-30T14:58:28.523559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:28.523567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:28.523570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:28.523576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896770551526423:7871] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:28.524098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896770551526423:7871] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:28.526632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896770551526423:7871] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:28.529983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896770551526423:7871] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:28.529998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896770551526423:7871] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:28.530002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896770551526423:7871] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:28.530010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2913 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:28.538177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:28.538758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:28.538937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:28.538962Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:28.538974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:28.539033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:28.539077Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896770461731538:7466]
2025-09-30T14:58:28.539780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:28.540146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:28.540218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:28.540600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:28.540694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.540702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.540703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.540704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.540706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.540707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.540708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.540710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.540711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.540712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.540714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.540715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.540716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.540717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.540719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.540725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.540736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.540740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.540745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.540748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.540752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.540756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.540761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.540766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.540773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.540777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.540782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.540786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.540799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.540804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.540814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.540828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.540840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.540846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.540850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.540856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.540866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.540871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.540876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.540881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.540891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.540896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.540901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.540906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.540911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.540915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.540924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.540934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.540943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.540947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.540956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.540966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.540974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.540984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.540992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.541002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.541010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.541016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.541023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.541029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.541075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:28.546541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:28.548108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:28.548132Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:28.548135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:28.548139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:28.548146Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2912 [2:7555896770461731538:7466]
2025-09-30T14:58:28.548163Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:28.548179Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:28.548183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:28.548186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:28.548189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:28.548205Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:28.548212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:28.548219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:28.548284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.548296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.548298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.548303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:28.548306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:28.548374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:28.548381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.548395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.548412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.548435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:28.548458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551526391:2454], now have 1 active actors on pipe
2025-09-30T14:58:28.548467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551526604:7871], now have 1 active actors on pipe
2025-09-30T14:58:28.548474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896770461731533:7466]
2025-09-30T14:58:28.548481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896770461731533:7466]
2025-09-30T14:58:28.548483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896770461731533:7466]
2025-09-30T14:58:28.548494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:28.548508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:28.548513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:28.548526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:28.548528Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:28.548529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:28.548531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:28.548520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2912
2025-09-30T14:58:28.548568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896770461731533:7466]
2025-09-30T14:58:28.548537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2912
2025-09-30T14:58:28.548577Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:28.548581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:28.548608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.548617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.548650Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:28.548663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:28.548666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:28.548668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:28.548678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:28.548692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:28.548709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:28.548912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.548924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.548941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:28.549030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2913 partition: 0 MaxSeqNo: 42 sessionId: src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0
2025-09-30T14:58:28.549386Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c31b7b0-2c45b288-c2dcd645-e63315c2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:28.552298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0] Write session: try to update token
2025-09-30T14:58:28.552316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:28.560705Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:28.560725Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:28.560728Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:28.560731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:28.560740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896770461731533:7466]
2025-09-30T14:58:28.560745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896770461731533:7466]
2025-09-30T14:58:28.560749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896770461731533:7466]
2025-09-30T14:58:28.560787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:28.560802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:28.560809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.560809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:28.560812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:28.560814Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:28.560944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:28.568584Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2913 sessionId: src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:28.571273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:28.613318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896770551526661:7727]
2025-09-30T14:58:28.613608Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 2912, pipe: [1:7555896770551526661:7727]
2025-09-30T14:58:28.668886Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:28.669489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.669507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.669528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551526661:7727], now have 1 active actors on pipe
2025-09-30T14:58:28.669758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:28.669780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896770551526661:7727]
2025-09-30T14:58:28.669807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:28.669809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:28.669883Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:28.669890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2913 reason: error at write: Disconnected sessionId: src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0
2025-09-30T14:58:28.670081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2913 sessionId: src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0 is DEAD
2025-09-30T14:58:28.670240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:28.670249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0] Write session will restart in 0.006298s
2025-09-30T14:58:28.670266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0] Write session: Do CDS request
2025-09-30T14:58:28.670271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:28.677754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:28.677892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:28.677918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2914
2025-09-30T14:58:28.678038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2914 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:28.678070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2914 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:28.678080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2914 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:28.678084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:28.678554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2914 sessionId:  describe result for acl check
2025-09-30T14:58:28.678609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:28.678616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:28.678618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:28.678624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896770551526687:7870] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:28.679192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896770551526687:7870] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:28.681974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896770551526687:7870] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:28.684957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896770551526687:7870] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:28.684973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896770551526687:7870] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:28.684975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896770551526687:7870] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:28.684982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2914 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:28.689066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:28.693636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:28.693842Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:28.693852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:28.693862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:28.693906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:28.693951Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896770461731794:7458]
2025-09-30T14:58:28.694638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:28.694956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:28.694997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:28.695340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:28.695404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.695410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.695411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.695413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.695414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.695415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.695417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.695418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.695419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.695421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.695422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.695423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.695425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.695426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.695427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.695433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.695444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.695449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.695453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.695457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.695462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.695466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.695470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.695474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.695479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.695483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.695488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.695492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.695496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.695500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.695508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.695515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.695521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.695527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.695531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.695537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.695541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.695547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.695558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.695564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.695570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.695580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.695585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.695591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.695601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.695607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.695617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.695622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.695627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.695640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.695647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.695656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.695661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.695668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.695677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.695682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.695687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.695697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.695702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.695712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.695758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:28.701064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:28.701964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:28.701978Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:28.701981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:28.701986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:28.701993Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2913 [2:7555896770461731794:7458]
2025-09-30T14:58:28.702008Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:28.702022Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:28.702030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:28.702034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:28.702036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:28.702053Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:28.702064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:28.702070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:28.702130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.702137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.702139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.702143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:28.702146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:28.702207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:28.702214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.702225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.702240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.702256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:28.702278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551526852:7870], now have 1 active actors on pipe
2025-09-30T14:58:28.702286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551526662:2454], now have 1 active actors on pipe
2025-09-30T14:58:28.702293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896770461731789:7458]
2025-09-30T14:58:28.702296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896770461731789:7458]
2025-09-30T14:58:28.702298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896770461731789:7458]
2025-09-30T14:58:28.702310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:28.702326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:28.702333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:28.702341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:28.702341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:28.702344Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:28.702344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:28.702368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896770461731789:7458]
2025-09-30T14:58:28.702383Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:28.702385Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:28.702379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2913
2025-09-30T14:58:28.702391Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2913
2025-09-30T14:58:28.702969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.702980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.703009Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:28.703020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:28.703029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:28.703036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:28.703044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:28.703056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:28.703070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:28.703267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.703277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.703290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:28.703389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2914 partition: 0 MaxSeqNo: 42 sessionId: src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0
2025-09-30T14:58:28.703759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c1cc5945-18a8ff79-bcf0d9c5-55a4563b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:28.706474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0] Write session: try to update token
2025-09-30T14:58:28.706491Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:28.714418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:28.714447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:28.714450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:28.714452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:28.714462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896770461731789:7458]
2025-09-30T14:58:28.714467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896770461731789:7458]
2025-09-30T14:58:28.714471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896770461731789:7458]
2025-09-30T14:58:28.714517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:28.714525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.714528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:28.714528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:28.714534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:28.714538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:28.714665Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:28.720652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2914 sessionId: src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:28.723353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:28.769987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896770551526928:7727]
2025-09-30T14:58:28.770245Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 2913, pipe: [1:7555896770551526928:7727]
2025-09-30T14:58:28.832560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:28.832879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.832895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.832915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551526928:7727], now have 1 active actors on pipe
2025-09-30T14:58:28.833124Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:28.833157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896770551526928:7727]
2025-09-30T14:58:28.833188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:28.833483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:28.833553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2914 reason: status is not ok: tablet will be restarted right now sessionId: src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0
2025-09-30T14:58:28.833723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2914 sessionId: src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0 is DEAD
2025-09-30T14:58:28.833871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:28.833880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0] Write session will restart in 0.006794s
2025-09-30T14:58:28.833897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0] Write session: Do CDS request
2025-09-30T14:58:28.833901Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:28.841686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:28.841744Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:28.841759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2915
2025-09-30T14:58:28.841908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2915 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:28.841941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2915 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:28.841948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2915 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:28.841951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:28.842314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2915 sessionId:  describe result for acl check
2025-09-30T14:58:28.842344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:28.842351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:28.842353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:28.842358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896770551526964:7880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:28.842868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896770551526964:7880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:28.845717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896770551526964:7880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:28.848272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896770551526964:7880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:28.848284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896770551526964:7880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:28.848286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896770551526964:7880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:28.848293Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2915 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:28.854627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:28.855112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:28.855303Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:28.855315Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:28.855325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:28.855375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:28.855413Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896770461732049:7456]
2025-09-30T14:58:28.856067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:28.856357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:28.856412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:28.856724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:28.856820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.856828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.856830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.856831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.856832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.856833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.856835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.856836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.856837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.856838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.856840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.856841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.856842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.856844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.856845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.856851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.856861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.856865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.856870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.856874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.856878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.856882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.856886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.856890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.856897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.856900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.856904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.856908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.856912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.856917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.856925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.856940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:28.856951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.856956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:28.856963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.856969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:28.856980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.856986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:28.856996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.857002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:28.857006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.857012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:28.857022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.857029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:28.857038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.857045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:28.857055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.857065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:28.857070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.857083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:28.857088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.857094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.857099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.857104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.857110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.857117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.857126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.857131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:28.857140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.857145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:28.857198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:28.862386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:28.863982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:28.864006Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:28.864009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:28.864012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:28.864019Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2914 [2:7555896770461732049:7456]
2025-09-30T14:58:28.864033Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:28.864056Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:28.864064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:28.864067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:28.864069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:28.864086Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:28.864099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:28.864107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:28.864167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.864177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.864179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.864184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:28.864186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:28.864251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:28.864260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.864276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:28.864290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:28.864315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:28.864338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551527173:7880], now have 1 active actors on pipe
2025-09-30T14:58:28.864346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551526929:2454], now have 1 active actors on pipe
2025-09-30T14:58:28.864354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896770461732044:7456]
2025-09-30T14:58:28.864361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896770461732044:7456]
2025-09-30T14:58:28.864363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896770461732044:7456]
2025-09-30T14:58:28.864376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:28.864392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:28.864394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:28.864397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:28.864399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:28.864411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:28.864414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:28.864393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2914
2025-09-30T14:58:28.864449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2914
2025-09-30T14:58:28.864460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.864470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.864481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896770461732044:7456]
2025-09-30T14:58:28.864490Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:28.864499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:28.864524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:28.864536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:28.864540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:28.864547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:28.864558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:28.864572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:28.864592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:28.864730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.864743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.864759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:28.864841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2915 partition: 0 MaxSeqNo: 42 sessionId: src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0
2025-09-30T14:58:28.865143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|419db4e3-6c64f346-9c721cbd-b45cda10_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:28.867928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0] Write session: try to update token
2025-09-30T14:58:28.867943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:28.876467Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:28.876497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:28.876499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:28.876502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:28.876511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896770461732044:7456]
2025-09-30T14:58:28.876516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896770461732044:7456]
2025-09-30T14:58:28.876519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896770461732044:7456]
2025-09-30T14:58:28.876562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:28.876564Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:28.876569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:28.876569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:28.876571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:28.876573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:28.876714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:28.881701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2915 sessionId: src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:28.884406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:28.933271Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896770551527193:7727]
2025-09-30T14:58:28.933518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 2914, pipe: [1:7555896770551527193:7727]
2025-09-30T14:58:28.994566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:28.994868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:28.994885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:28.994928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551527193:7727], now have 1 active actors on pipe
2025-09-30T14:58:28.995177Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:28.995189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896770551527193:7727]
2025-09-30T14:58:28.995219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:28.995370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:28.995446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2915 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0
2025-09-30T14:58:28.995621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2915 sessionId: src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0 is DEAD
2025-09-30T14:58:28.995768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:28.995774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0] Write session will restart in 0.008051s
2025-09-30T14:58:28.995797Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0] Write session: Do CDS request
2025-09-30T14:58:28.995802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:29.004735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.004811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:29.004829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2916
2025-09-30T14:58:29.004979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2916 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.005010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2916 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:29.005019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2916 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:29.005023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:29.005464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2916 sessionId:  describe result for acl check
2025-09-30T14:58:29.005501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:29.005508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:29.005510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:29.005516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896774846494542:7897] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:29.006042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896774846494542:7897] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:29.008650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896774846494542:7897] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:29.010794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896774846494542:7897] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:29.010809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896774846494542:7897] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:29.010811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896774846494542:7897] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:29.010819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2916 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:29.013813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:29.017894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:29.018100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:29.018113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:29.018124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:29.018188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:29.018228Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896774756699601:7438]
2025-09-30T14:58:29.018862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:29.019126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:29.019180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:29.019549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:29.019622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.019630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.019632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.019633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.019634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.019635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.019636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.019637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.019638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.019640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.019641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.019642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.019643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.019644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.019645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.019651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.019661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.019665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.019669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.019673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.019677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.019681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.019685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.019688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.019693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.019697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.019701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.019706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.019710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.019715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.019725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.019733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.019739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.019745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.019750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.019757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.019761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.019767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.019772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.019779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.019783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.019787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.019792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.019798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.019803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.019809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.019814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.019821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.019826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.019832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.019838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.019846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.019859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.019865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.019874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.019880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.019888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.019893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.019898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.019904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.019949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:29.024995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:29.025913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:29.025934Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:29.025937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:29.025941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:29.025948Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2915 [2:7555896774756699601:7438]
2025-09-30T14:58:29.025965Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:29.025980Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:29.025983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:29.025986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:29.025988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:29.026003Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:29.026015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:29.026022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:29.026086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.026094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.026097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.026100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:29.026103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:29.026166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:29.026174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.026188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.026206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.026227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:29.026251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846494720:7897], now have 1 active actors on pipe
2025-09-30T14:58:29.026260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896770551527194:2454], now have 1 active actors on pipe
2025-09-30T14:58:29.026267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896774756699596:7438]
2025-09-30T14:58:29.026269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896774756699596:7438]
2025-09-30T14:58:29.026271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896774756699596:7438]
2025-09-30T14:58:29.026285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:29.026301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:29.026303Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:29.026306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:29.026308Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:29.026320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:29.026323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:29.026304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2915
2025-09-30T14:58:29.026316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2915
2025-09-30T14:58:29.026351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896774756699596:7438]
2025-09-30T14:58:29.026362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:29.026366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:29.026383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.026393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.026440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7aec6bca-1913eafe-49de8435-9352bab6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:29.026451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:29.026456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:29.026458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:29.026467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:29.026481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:29.026502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:29.026631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.026640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.026654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:29.026710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2916 partition: 0 MaxSeqNo: 42 sessionId: src_id|7aec6bca-1913eafe-49de8435-9352bab6_0
2025-09-30T14:58:29.027059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c290541f-2f4cd552-f75abf5-67ee99dd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7aec6bca-1913eafe-49de8435-9352bab6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:29.029487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aec6bca-1913eafe-49de8435-9352bab6_0] Write session: try to update token
2025-09-30T14:58:29.029502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aec6bca-1913eafe-49de8435-9352bab6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:29.038256Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:29.038286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:29.038288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:29.038290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:29.038303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896774756699596:7438]
2025-09-30T14:58:29.038308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896774756699596:7438]
2025-09-30T14:58:29.038312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896774756699596:7438]
2025-09-30T14:58:29.038355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:29.038360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:29.038366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:29.038368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.038369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:29.038370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:29.038513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:29.043934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2916 sessionId: src_id|7aec6bca-1913eafe-49de8435-9352bab6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:29.046446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:29.095590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896774846494755:7727]
2025-09-30T14:58:29.095837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 2915, pipe: [1:7555896774846494755:7727]
2025-09-30T14:58:29.153248Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:29.154052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.154066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.154102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846494755:7727], now have 1 active actors on pipe
2025-09-30T14:58:29.154279Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:29.154383Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:29.154389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896774846494755:7727]
2025-09-30T14:58:29.154409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:29.154471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2916 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7aec6bca-1913eafe-49de8435-9352bab6_0
2025-09-30T14:58:29.154646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2916 sessionId: src_id|7aec6bca-1913eafe-49de8435-9352bab6_0 is DEAD
2025-09-30T14:58:29.154825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aec6bca-1913eafe-49de8435-9352bab6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:29.154838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aec6bca-1913eafe-49de8435-9352bab6_0] Write session will restart in 0.007900s
2025-09-30T14:58:29.154861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aec6bca-1913eafe-49de8435-9352bab6_0] Write session: Do CDS request
2025-09-30T14:58:29.154867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aec6bca-1913eafe-49de8435-9352bab6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:29.163801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7aec6bca-1913eafe-49de8435-9352bab6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.163958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:29.163982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2917
2025-09-30T14:58:29.164140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2917 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.164179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2917 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:29.164207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2917 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:29.164212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:29.164982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2917 sessionId:  describe result for acl check
2025-09-30T14:58:29.165015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:29.165019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:29.165020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:29.165025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896774846494780:7907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:29.165483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896774846494780:7907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:29.168338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896774846494780:7907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:29.172226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896774846494780:7907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:29.172247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896774846494780:7907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:29.172251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896774846494780:7907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:29.172260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2917 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:29.176584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:29.181119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:29.181332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:29.181342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:29.181350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:29.181392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:29.181438Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896774756699860:7451]
2025-09-30T14:58:29.182048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:29.182381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:29.182417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:29.182730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:29.182791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.182798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.182799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.182801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.182802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.182803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.182804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.182805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.182807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.182808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.182810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.182811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.182812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.182813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.182814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.182819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.182830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.182853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.182861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.182863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.182866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.182868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.182871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.182873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.182876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.182878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.182880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.182882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.182887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.182891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.182899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.182913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.182925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.182931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.182941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.182948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.182956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.182962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.182971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.182976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.182981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.182986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.182991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.182996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.183005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.183010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.183019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.183025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.183030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.183040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.183045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.183054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.183059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.183064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.183072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.183078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.183086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.183091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.183097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.183107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.183152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:29.188298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:29.189753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:29.189768Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:29.189770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:29.189773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:29.189778Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2916 [2:7555896774756699860:7451]
2025-09-30T14:58:29.189791Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:29.189804Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:29.189806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:29.189808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:29.189809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:29.189821Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:29.189826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:29.189836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:29.189895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.189903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.189905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.189908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:29.189911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:29.189965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:29.189973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.189986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.190003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.190022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:29.190044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846494756:2454], now have 1 active actors on pipe
2025-09-30T14:58:29.190052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846494952:7907], now have 1 active actors on pipe
2025-09-30T14:58:29.190059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896774756699855:7451]
2025-09-30T14:58:29.190061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896774756699855:7451]
2025-09-30T14:58:29.190063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896774756699855:7451]
2025-09-30T14:58:29.190075Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:29.190090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:29.190093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:29.190097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:29.190099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:29.190111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:29.190115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:29.190145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896774756699855:7451]
2025-09-30T14:58:29.190149Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:29.190155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:29.190128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2916
2025-09-30T14:58:29.190133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2916
2025-09-30T14:58:29.190183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.190191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.190213Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:29.190222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:29.190224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:29.190226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:29.190234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:29.190242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:29.190255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:29.190440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.190448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.190462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:29.190566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2917 partition: 0 MaxSeqNo: 42 sessionId: src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0
2025-09-30T14:58:29.190930Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7aec6bca-1913eafe-49de8435-9352bab6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:29.193820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0] Write session: try to update token
2025-09-30T14:58:29.193844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:29.201853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:29.201877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:29.201880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:29.201882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:29.201892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896774756699855:7451]
2025-09-30T14:58:29.201896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896774756699855:7451]
2025-09-30T14:58:29.201900Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896774756699855:7451]
2025-09-30T14:58:29.201942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:29.201949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.201952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:29.201951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:29.201957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:29.201961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:29.202106Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:29.208192Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2917 sessionId: src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:29.210846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:29.254338Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896774846495022:7727]
2025-09-30T14:58:29.254550Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 2916, pipe: [1:7555896774846495022:7727]
2025-09-30T14:58:29.310746Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:29.311432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.311451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.311489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846495022:7727], now have 1 active actors on pipe
2025-09-30T14:58:29.311665Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:29.311717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:29.311733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:29.311745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896774846495022:7727]
2025-09-30T14:58:29.311766Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:29.311791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2917 reason: error at write: Disconnected sessionId: src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0
2025-09-30T14:58:29.311974Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2917 sessionId: src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0 is DEAD
2025-09-30T14:58:29.312109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:29.312119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0] Write session will restart in 0.006443s
2025-09-30T14:58:29.312136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0] Write session: Do CDS request
2025-09-30T14:58:29.312142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:29.319784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.319828Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:29.319847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2918
2025-09-30T14:58:29.320020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2918 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.320053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2918 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:29.320063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2918 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:29.320068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:29.320440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2918 sessionId:  describe result for acl check
2025-09-30T14:58:29.320476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:29.320479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:29.320481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:29.320486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896774846495043:7916] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:29.320938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896774846495043:7916] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:29.322875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896774846495043:7916] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:29.326095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896774846495043:7916] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:29.326116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896774846495043:7916] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:29.326119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896774846495043:7916] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:29.326127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2918 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:29.332334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:29.336417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:29.336636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:29.336651Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:29.336664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:29.336733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:29.336777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896774756700129:7448]
2025-09-30T14:58:29.337436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:29.337767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:29.337822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:29.338171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:29.338242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.338249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.338251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.338252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.338253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.338255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.338257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.338259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.338260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.338262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.338263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.338264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.338265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.338266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.338268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.338274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.338285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.338289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.338293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.338298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.338302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.338306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.338310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.338315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.338319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.338323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.338327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.338331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.338335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.338339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.338348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.338358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.338364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.338370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.338375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.338380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.338385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.338391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.338401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.338407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.338412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.338422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.338427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.338432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.338437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.338442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.338452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.338458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.338467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.338472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.338484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.338489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.338497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.338503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.338508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.338517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.338522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.338531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.338535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.338540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.338585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:29.344057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:29.345309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:29.345329Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:29.345332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:29.345337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:29.345343Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2917 [2:7555896774756700129:7448]
2025-09-30T14:58:29.345363Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:29.345378Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:29.345382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:29.345385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:29.345387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:29.345402Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:29.345409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:29.345416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:29.345483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.345493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.345496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.345500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:29.345502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:29.345574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:29.345581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.345594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.345605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.345624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:29.345646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896774756700124:7448]
2025-09-30T14:58:29.345652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896774756700124:7448]
2025-09-30T14:58:29.345654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896774756700124:7448]
2025-09-30T14:58:29.345667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:29.345679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:29.345682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846495158:7916], now have 1 active actors on pipe
2025-09-30T14:58:29.345687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846495028:2454], now have 1 active actors on pipe
2025-09-30T14:58:29.345692Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:29.345695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:29.345695Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:29.345709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:29.345712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:29.345745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896774756700124:7448]
2025-09-30T14:58:29.345757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:29.345777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:29.345772Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2917
2025-09-30T14:58:29.345778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2917
2025-09-30T14:58:29.345851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.345861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.345887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:29.345900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:29.345903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:29.345906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:29.345917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:29.345934Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:29.345949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:29.346178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.346189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.346207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:29.346341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2918 partition: 0 MaxSeqNo: 42 sessionId: src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0
2025-09-30T14:58:29.346692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dd232da-1e4372d3-eade0df8-39463e0a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:29.349449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0] Write session: try to update token
2025-09-30T14:58:29.349467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:29.357983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:29.358008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:29.358012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:29.358015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:29.358027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896774756700124:7448]
2025-09-30T14:58:29.358033Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896774756700124:7448]
2025-09-30T14:58:29.358040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896774756700124:7448]
2025-09-30T14:58:29.358085Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:29.358091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:29.358099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:29.358100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.358103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:29.358103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:29.359074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:29.364494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2918 sessionId: src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:29.367164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:29.412042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896774846495298:7727]
2025-09-30T14:58:29.412320Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 2917, pipe: [1:7555896774846495298:7727]
2025-09-30T14:58:29.463301Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:29.464153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.464172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.464194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846495298:7727], now have 1 active actors on pipe
2025-09-30T14:58:29.464411Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:29.464431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896774846495298:7727]
2025-09-30T14:58:29.464456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:29.464461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:29.464466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:29.464545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2918 reason: error at write: Disconnected sessionId: src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0
2025-09-30T14:58:29.464753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2918 sessionId: src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0 is DEAD
2025-09-30T14:58:29.464910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:29.464921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0] Write session will restart in 0.005301s
2025-09-30T14:58:29.464941Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0] Write session: Do CDS request
2025-09-30T14:58:29.464945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:29.471674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.471749Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:29.471765Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2919
2025-09-30T14:58:29.471892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2919 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.471923Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2919 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:29.471933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2919 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:29.471937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:29.472356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2919 sessionId:  describe result for acl check
2025-09-30T14:58:29.472389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:29.472391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:29.472393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:29.472398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896774846495314:7926] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:29.472898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896774846495314:7926] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:29.474943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896774846495314:7926] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:29.477792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896774846495314:7926] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:29.477808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896774846495314:7926] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:29.477811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896774846495314:7926] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:29.477828Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2919 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:29.483716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:29.487964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:29.488189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:29.488200Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:29.488211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:29.488255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:29.488291Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896774756700388:7447]
2025-09-30T14:58:29.488826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:29.489108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:29.489148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:29.489430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:29.489490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.489497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.489499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.489499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.489500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.489501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.489503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.489504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.489505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.489506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.489507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.489508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.489509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.489510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.489511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.489516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.489527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.489531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.489535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.489538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.489541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.489545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.489548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.489551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.489555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.489559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.489562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.489571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.489575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.489582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.489592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.489604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.489614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.489620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.489629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.489639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.489644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.489654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.489659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.489664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.489668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.489674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.489679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.489690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.489694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.489701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.489710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.489716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.489724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.489729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.489737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.489741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.489746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.489755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.489760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.489766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.489773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.489777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.489782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.489787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.489836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:29.494982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:29.495898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:29.495912Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:29.495915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:29.495919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:29.495925Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2918 [2:7555896774756700388:7447]
2025-09-30T14:58:29.495944Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:29.495959Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:29.495967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:29.495970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:29.495973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:29.495987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:29.495994Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:29.496005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:29.496060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.496067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.496070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.496074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:29.496076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:29.496139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:29.496147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.496160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.496176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.496196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:29.496219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846495299:2454], now have 1 active actors on pipe
2025-09-30T14:58:29.496227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846495433:7926], now have 1 active actors on pipe
2025-09-30T14:58:29.496234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896774756700383:7447]
2025-09-30T14:58:29.496236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896774756700383:7447]
2025-09-30T14:58:29.496238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896774756700383:7447]
2025-09-30T14:58:29.496250Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:29.496260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:29.496264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:29.496270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:29.496272Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:29.496277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:29.496280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:29.496308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896774756700383:7447]
2025-09-30T14:58:29.496320Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:29.496296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2918
2025-09-30T14:58:29.496343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:29.496300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2918
2025-09-30T14:58:29.496366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.496375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.496401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:29.496413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:29.496416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:29.496423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:29.496980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:29.497000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:29.497019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:29.497193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.497203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.497218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:29.497296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2919 partition: 0 MaxSeqNo: 42 sessionId: src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0
2025-09-30T14:58:29.497659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b4d3a507-45fb54f-88867302-5f11dc3d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:29.500380Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0] Write session: try to update token
2025-09-30T14:58:29.500396Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:29.513104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:29.513122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:29.513129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896774756700383:7447]
2025-09-30T14:58:29.513172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:29.513199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:29.513339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:29.513486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:29.513613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:29.513741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:29.513929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:29.513965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:29.514606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2919 sessionId: src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:29.517154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:29.517571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.517593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.517609Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:29.517611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:29.517612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:29.517613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:29.517619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896774756700383:7447]
2025-09-30T14:58:29.517622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896774756700383:7447]
2025-09-30T14:58:29.517626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896774756700383:7447]
2025-09-30T14:58:29.517651Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:29.517661Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:29.517663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:29.517665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:29.517670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.517673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:29.517797Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:29.564622Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896774846495601:7727]
2025-09-30T14:58:29.564944Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 2918, pipe: [1:7555896774846495601:7727]
2025-09-30T14:58:29.624281Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:29.624558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:29.624587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846495601:7727], now have 1 active actors on pipe
2025-09-30T14:58:29.624705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:29.624755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896774846495601:7727]
2025-09-30T14:58:29.624775Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:29.624860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:29.624869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:29.624941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2919 reason: error at write: Disconnected sessionId: src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0
2025-09-30T14:58:29.625137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2919 sessionId: src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0 is DEAD
2025-09-30T14:58:29.625256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:29.625267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0] Write session will restart in 0.006781s
2025-09-30T14:58:29.625290Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0] Write session: Do CDS request
2025-09-30T14:58:29.625296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:29.632769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.632890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:29.632910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2920
2025-09-30T14:58:29.633036Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2920 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.633068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2920 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:29.633078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2920 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:29.633082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:29.633582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2920 sessionId:  describe result for acl check
2025-09-30T14:58:29.633619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:29.633621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:29.633625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:29.633630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896774846495620:7942] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:29.634190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896774846495620:7942] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:29.636532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896774846495620:7942] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:29.640037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896774846495620:7942] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:29.640053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896774846495620:7942] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:29.640056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896774846495620:7942] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:29.640064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2920 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:29.652064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:29.652692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:29.652914Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:29.652931Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:29.652945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:29.653021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:29.653075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896774756700686:7424]
2025-09-30T14:58:29.653823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:29.654164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:29.654218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:29.654560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:29.654645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.654654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.654655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.654656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.654658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.654659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.654661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.654662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.654664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.654665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.654666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.654667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.654669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.654670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.654671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.654677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.654688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.654691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.654695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.654699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.654704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.654708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.654712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.654716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.654720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.654724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.654728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.654732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.654736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.654740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.654747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.654756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.654763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.654768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.654773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.654779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.654784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.654790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.654799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.654805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.654810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.654816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.654822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.654827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.654832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.654837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.654845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.654851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.654864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.654870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.654875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.654881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.654885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.654890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.654900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.654906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.654915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.654920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.654928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.654932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.654977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:29.660555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:29.661877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:29.661899Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:29.661903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:29.661907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:29.661913Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2919 [2:7555896774756700686:7424]
2025-09-30T14:58:29.661931Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:29.661947Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:29.661950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:29.661954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:29.661956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:29.661972Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:29.661979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:29.661992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:29.662053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.662062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.662065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.662068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:29.662071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:29.662147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:29.662157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.662172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.662188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.662211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:29.662238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846495748:7942], now have 1 active actors on pipe
2025-09-30T14:58:29.662247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846495602:2454], now have 1 active actors on pipe
2025-09-30T14:58:29.662255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896774756700681:7424]
2025-09-30T14:58:29.662266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896774756700681:7424]
2025-09-30T14:58:29.662269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896774756700681:7424]
2025-09-30T14:58:29.662285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:29.662306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:29.662310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:29.662318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:29.662321Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:29.662327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:29.662331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:29.662373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896774756700681:7424]
2025-09-30T14:58:29.662390Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:29.662346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2919
2025-09-30T14:58:29.662396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:29.662347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2919
2025-09-30T14:58:29.662412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.662423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.662485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|61dec35d-5b4c0307-a023d948-d51687f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:29.662499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:29.662503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:29.662505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:29.662515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:29.662525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:29.662569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:29.663075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.663093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.663127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:29.663262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2920 partition: 0 MaxSeqNo: 42 sessionId: src_id|61dec35d-5b4c0307-a023d948-d51687f8_0
2025-09-30T14:58:29.663641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dbafddc0-1c02d6f-4a23f10b-f2f5631d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|61dec35d-5b4c0307-a023d948-d51687f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:29.666253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61dec35d-5b4c0307-a023d948-d51687f8_0] Write session: try to update token
2025-09-30T14:58:29.666270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61dec35d-5b4c0307-a023d948-d51687f8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:29.675076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:29.675105Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:29.675108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:29.675111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:29.675120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896774756700681:7424]
2025-09-30T14:58:29.675125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896774756700681:7424]
2025-09-30T14:58:29.675129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896774756700681:7424]
2025-09-30T14:58:29.675171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:29.675179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.675179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:29.675182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:29.675188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:29.675193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:29.675356Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:29.682288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2920 sessionId: src_id|61dec35d-5b4c0307-a023d948-d51687f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:29.685209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:29.724908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896774846495871:7727]
2025-09-30T14:58:29.725225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 2919, pipe: [1:7555896774846495871:7727]
2025-09-30T14:58:29.790661Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:29.791178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.791193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.791213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846495871:7727], now have 1 active actors on pipe
2025-09-30T14:58:29.791436Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:29.791510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:29.791525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896774846495871:7727]
2025-09-30T14:58:29.791526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:29.791545Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:29.791590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2920 reason: error at write: Disconnected sessionId: src_id|61dec35d-5b4c0307-a023d948-d51687f8_0
2025-09-30T14:58:29.791807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2920 sessionId: src_id|61dec35d-5b4c0307-a023d948-d51687f8_0 is DEAD
2025-09-30T14:58:29.791981Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61dec35d-5b4c0307-a023d948-d51687f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:29.791989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61dec35d-5b4c0307-a023d948-d51687f8_0] Write session will restart in 0.008927s
2025-09-30T14:58:29.792007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61dec35d-5b4c0307-a023d948-d51687f8_0] Write session: Do CDS request
2025-09-30T14:58:29.792011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61dec35d-5b4c0307-a023d948-d51687f8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:29.801823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|61dec35d-5b4c0307-a023d948-d51687f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.801940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:29.801959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2921
2025-09-30T14:58:29.802079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2921 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.802125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2921 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:29.802135Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2921 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:29.802140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:29.802620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2921 sessionId:  describe result for acl check
2025-09-30T14:58:29.802659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:29.802661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:29.802663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:29.802669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896774846495900:7951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:29.803262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896774846495900:7951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:29.806079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896774846495900:7951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:29.809411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896774846495900:7951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:29.809427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896774846495900:7951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:29.809431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896774846495900:7951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:29.809439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2921 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:29.819806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:29.820487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:29.820694Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:29.820706Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:29.820718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:29.820774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:29.820833Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896774756700947:7423]
2025-09-30T14:58:29.821557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:29.821920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:29.821990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:29.822371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:29.822459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.822467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.822469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.822470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.822471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.822473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.822475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.822476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.822477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.822478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.822480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.822481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.822482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.822484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.822485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.822491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.822502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.822506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.822511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.822528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.822532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.822537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.822541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.822546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.822550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.822554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.822557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.822561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.822565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.822570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.822578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.822586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:29.822593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.822599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:29.822603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.822608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:29.822612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.822617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:29.822623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.822629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:29.822634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.822640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:29.822644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.822650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:29.822655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.822661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:29.822669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.822682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:29.822690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.822696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:29.822700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.822706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.822710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.822716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.822720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.822726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.822730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.822740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:29.822746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.822752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:29.822801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:29.828362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:29.829769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:29.829796Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:29.829798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:29.829803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:29.829810Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2920 [2:7555896774756700947:7423]
2025-09-30T14:58:29.829828Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:29.829846Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:29.829858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:29.829863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:29.829865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:29.829884Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:29.829892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:29.829900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:29.829984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.829993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.829995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.830000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:29.830003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:29.830089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:29.830097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.830111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:29.830125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:29.830149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:29.830177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846495874:2454], now have 1 active actors on pipe
2025-09-30T14:58:29.830181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846496069:7951], now have 1 active actors on pipe
2025-09-30T14:58:29.830188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896774756700942:7423]
2025-09-30T14:58:29.830190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896774756700942:7423]
2025-09-30T14:58:29.830193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896774756700942:7423]
2025-09-30T14:58:29.830208Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:29.830230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:29.830248Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:29.830242Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2920
2025-09-30T14:58:29.830252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:29.830273Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2920
2025-09-30T14:58:29.830255Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:29.830261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:29.830264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:29.830288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896774756700942:7423]
2025-09-30T14:58:29.830292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:29.830294Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:29.830323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.830333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.830374Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:29.830387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:29.830392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:29.830394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:29.830405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:29.830421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:29.830446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:29.830631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.830644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.830663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:29.830789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2921 partition: 0 MaxSeqNo: 42 sessionId: src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0
2025-09-30T14:58:29.831257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|61dec35d-5b4c0307-a023d948-d51687f8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:29.834114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0] Write session: try to update token
2025-09-30T14:58:29.834139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:29.842906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:29.842929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:29.842932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:29.842934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:29.842944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896774756700942:7423]
2025-09-30T14:58:29.842948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896774756700942:7423]
2025-09-30T14:58:29.842952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896774756700942:7423]
2025-09-30T14:58:29.842994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:29.843001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:29.843004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:29.843007Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:29.843014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:29.843018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:29.843138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:29.851182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2921 sessionId: src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:29.854023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:29.891772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896774846496145:7727]
2025-09-30T14:58:29.892259Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 2920, pipe: [1:7555896774846496145:7727]
2025-09-30T14:58:29.964567Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:29.965138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:29.965148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:29.965168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846496145:7727], now have 1 active actors on pipe
2025-09-30T14:58:29.965549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:29.965620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896774846496145:7727]
2025-09-30T14:58:29.965645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:29.965653Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:29.965713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2921 reason: error at write: Disconnected sessionId: src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0
2025-09-30T14:58:29.965902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2921 sessionId: src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0 is DEAD
2025-09-30T14:58:29.966129Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:29.967391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:29.967404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0] Write session will restart in 0.006173s
2025-09-30T14:58:29.967429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0] Write session: Do CDS request
2025-09-30T14:58:29.967438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:29.975681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.976109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:29.976143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2922
2025-09-30T14:58:29.976603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2922 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:29.976646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2922 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:29.976651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2922 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:29.976656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:29.980685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2922 sessionId:  describe result for acl check
2025-09-30T14:58:29.980735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:29.980737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:29.980752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:29.980759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896774846496174:7969] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:29.981368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896774846496174:7969] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:29.987487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896774846496174:7969] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:29.992351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896774846496174:7969] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:29.992368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896774846496174:7969] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:29.992372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896774846496174:7969] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:29.992382Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2922 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:30.020029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:30.020647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:30.020884Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:30.020888Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:30.020902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:30.020965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:30.021009Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896779051668506:7421]
2025-09-30T14:58:30.021970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:30.028830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:30.028958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:30.029459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:30.030148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.030163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.030168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.030170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.030171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.030173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.030174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.030176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.030178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.030180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.030181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.030182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.030183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.030185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.030186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.030196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.030207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.030215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.030219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.030223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.030227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.030231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.030235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.030239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.030244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.030248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.030252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.030256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.030260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.030264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.030275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.030285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.030294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.030300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.030304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.030309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.030314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.030322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.030328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.030333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.030341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.030348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.030353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.030358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.030363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.030369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.030374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.030381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.030386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.030392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.030397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.030403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.030407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.030413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.030418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.030423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.030426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.030432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.030442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.030447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.030490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:30.037827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:30.039272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:30.039296Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:30.039298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:30.039302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:30.039310Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2921 [2:7555896779051668506:7421]
2025-09-30T14:58:30.039332Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:30.039352Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:30.039356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:30.039359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:30.039362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:30.039381Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:30.039388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:30.039395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:30.039474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.039483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.039487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.039493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:30.039497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:30.039573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:30.039582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.039599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.039616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.039639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:30.039662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846496276:7969], now have 1 active actors on pipe
2025-09-30T14:58:30.039670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896779051668501:7421]
2025-09-30T14:58:30.039678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896779051668501:7421]
2025-09-30T14:58:30.039680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896779051668501:7421]
2025-09-30T14:58:30.039698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:30.039710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896774846496149:2454], now have 1 active actors on pipe
2025-09-30T14:58:30.039718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:30.039724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:30.039729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:30.039731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:30.039733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:30.039736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:30.039776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896779051668501:7421]
2025-09-30T14:58:30.039788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:30.039795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:30.039899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2921
2025-09-30T14:58:30.039964Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2921
2025-09-30T14:58:30.040430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2922 partition: 0 MaxSeqNo: 42 sessionId: src_id|a4ddf167-239b411e-2fe711dc-11225615_0
2025-09-30T14:58:30.040026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.040039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.040066Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a4ddf167-239b411e-2fe711dc-11225615_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:30.040073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:30.040077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:30.040079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:30.040090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:30.040100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:30.040114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:30.040317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.040320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.040332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:30.043377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ddd2085e-e66bc837-d2b69fc8-deb8551_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a4ddf167-239b411e-2fe711dc-11225615_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:30.051464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddf167-239b411e-2fe711dc-11225615_0] Write session: try to update token
2025-09-30T14:58:30.051497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddf167-239b411e-2fe711dc-11225615_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:30.053273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:30.053298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:30.053309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896779051668501:7421]
2025-09-30T14:58:30.053355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:30.053545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:30.053704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:30.053862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:30.054012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:30.054213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:30.054254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:30.054366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:30.065862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896779141463713:7727]
2025-09-30T14:58:30.066102Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 2921, pipe: [1:7555896779141463713:7727]
2025-09-30T14:58:30.070119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2922 sessionId: src_id|a4ddf167-239b411e-2fe711dc-11225615_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:30.065696Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:30.065722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:30.065724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:30.065727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:30.065742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896779051668501:7421]
2025-09-30T14:58:30.065747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896779051668501:7421]
2025-09-30T14:58:30.065750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896779051668501:7421]
2025-09-30T14:58:30.065788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:30.065796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.065798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:30.065902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:30.065916Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:30.065925Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:30.065963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:30.073006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:30.182583Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:30.183054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141463713:7727], now have 1 active actors on pipe
2025-09-30T14:58:30.183092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.183099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.183487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:30.183878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:30.183937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896779141463713:7727]
2025-09-30T14:58:30.183961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:30.184031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2922 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a4ddf167-239b411e-2fe711dc-11225615_0
2025-09-30T14:58:30.184206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2922 sessionId: src_id|a4ddf167-239b411e-2fe711dc-11225615_0 is DEAD
2025-09-30T14:58:30.187468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddf167-239b411e-2fe711dc-11225615_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:30.187485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddf167-239b411e-2fe711dc-11225615_0] Write session will restart in 0.006092s
2025-09-30T14:58:30.187511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddf167-239b411e-2fe711dc-11225615_0] Write session: Do CDS request
2025-09-30T14:58:30.187517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddf167-239b411e-2fe711dc-11225615_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:30.194794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddf167-239b411e-2fe711dc-11225615_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:30.197981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:30.197999Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2923
2025-09-30T14:58:30.198178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2923 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:30.198220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2923 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:30.198228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2923 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:30.198233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:30.198725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2923 sessionId:  describe result for acl check
2025-09-30T14:58:30.198754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:30.198756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:30.198759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:30.198765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896779141463742:7971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:30.199380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896779141463742:7971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:30.201814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896779141463742:7971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:30.206819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896779141463742:7971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:30.206840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896779141463742:7971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:30.206843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896779141463742:7971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:30.206853Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2923 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:30.213590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:30.214350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:30.214562Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:30.214571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:30.214582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:30.214632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:30.214673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896779051668771:7418]
2025-09-30T14:58:30.215359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:30.219411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:30.219489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:30.219922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:30.220001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.220009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.220010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.220011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.220012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.220013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.220015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.220016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.220017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.220018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.220020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.220021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.220022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.220023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.220024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.220030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.220042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.220046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.220050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.220054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.220058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.220061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.220064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.220067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.220073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.220076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.220080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.220083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.220086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.220090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.220101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.220109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.220115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.220120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.220124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.220129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.220134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.220139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.220144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.220150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.220155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.220161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.220165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.220171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.220175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.220180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.220187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.220192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.220197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.220202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.220207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.220213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.220217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.220222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.220227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.220233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.220237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.220242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.220247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.220252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.220299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:30.226219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:30.227725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:30.227752Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:30.227755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:30.227759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:30.227765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2922 [2:7555896779051668771:7418]
2025-09-30T14:58:30.227784Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:30.227801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:30.227811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:30.227814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:30.227816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:30.227833Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:30.227844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:30.227852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:30.227942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.227951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.227953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.227957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:30.227960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:30.228035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:30.228048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.228065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.228077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.228094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:30.228116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896779051668766:7418]
2025-09-30T14:58:30.228125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896779051668766:7418]
2025-09-30T14:58:30.228127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896779051668766:7418]
2025-09-30T14:58:30.228140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:30.228161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141463863:7971], now have 1 active actors on pipe
2025-09-30T14:58:30.228170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141463715:2454], now have 1 active actors on pipe
2025-09-30T14:58:30.228179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:30.228198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:30.228202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:30.228242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896779051668766:7418]
2025-09-30T14:58:30.228251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:30.228266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:30.228288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:30.228290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:30.228298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:30.228453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.228465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.228490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:30.228500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:30.228504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:30.228513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:30.228524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:30.228541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:30.228556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:30.228871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.228888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.228914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:30.228273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2922
2025-09-30T14:58:30.228336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2922
2025-09-30T14:58:30.230975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2923 partition: 0 MaxSeqNo: 42 sessionId: src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0
2025-09-30T14:58:30.231399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a4ddf167-239b411e-2fe711dc-11225615_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:30.234277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0] Write session: try to update token
2025-09-30T14:58:30.234297Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:30.240953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:30.240980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:30.240982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:30.240984Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:30.240996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896779051668766:7418]
2025-09-30T14:58:30.241001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896779051668766:7418]
2025-09-30T14:58:30.241005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896779051668766:7418]
2025-09-30T14:58:30.241048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:30.241055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.241057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:30.241062Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:30.241069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:30.241073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:30.241201Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:30.261007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2923 sessionId: src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:30.263756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:30.283960Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896779141463988:7727]
2025-09-30T14:58:30.284346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 2922, pipe: [1:7555896779141463988:7727]
2025-09-30T14:58:30.353663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:30.354168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.354184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.354206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141463988:7727], now have 1 active actors on pipe
2025-09-30T14:58:30.354402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:30.354419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:30.354499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2923 reason: error at write: Disconnected sessionId: src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0
2025-09-30T14:58:30.354437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:30.354707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2923 sessionId: src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0 is DEAD
2025-09-30T14:58:30.354798Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896779141463988:7727]
2025-09-30T14:58:30.354825Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:30.354874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:30.354886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0] Write session will restart in 0.007153s
2025-09-30T14:58:30.354927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0] Write session: Do CDS request
2025-09-30T14:58:30.354936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:30.363777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:30.363985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:30.364002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2924
2025-09-30T14:58:30.364183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2924 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:30.364248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2924 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:30.364259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2924 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:30.364265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:30.366212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2924 sessionId:  describe result for acl check
2025-09-30T14:58:30.366253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:30.366255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:30.366257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:30.366263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896779141464005:7982] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:30.366844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896779141464005:7982] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:30.368880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896779141464005:7982] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:30.372117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896779141464005:7982] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:30.372136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896779141464005:7982] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:30.372140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896779141464005:7982] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:30.372149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2924 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:30.396338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:30.397315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:30.397538Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:30.397562Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:30.397575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:30.397648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:30.397692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896779051669047:7417]
2025-09-30T14:58:30.398388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:30.402759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:30.402854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:30.403275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:30.403367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.403374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.403376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.403378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.403380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.403381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.403383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.403384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.403386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.403387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.403389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.403390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.403391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.403393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.403394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.403402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.403414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.403419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.403424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.403429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.403434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.403439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.403443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.403448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.403453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.403458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.403463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.403467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.403472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.403477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.403486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.403495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.403507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.403513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.403521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.403527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.403537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.403544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.403554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.403560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.403565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.403570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.403576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.403582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.403587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.403593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.403598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.403608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.403616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.403626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.403633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.403644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.403649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.403655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.403665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.403671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.403679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.403685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.403690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.403701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.403751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:30.409922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:30.410814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:30.410833Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:30.410836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:30.410840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:30.410848Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2923 [2:7555896779051669047:7417]
2025-09-30T14:58:30.410868Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:30.410886Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:30.410895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:30.410900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:30.410902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:30.410918Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:30.410931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:30.410938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:30.411012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.411020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.411022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.411026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:30.411029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:30.411103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:30.411111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.411125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.411144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.411166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:30.411190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141464046:7982], now have 1 active actors on pipe
2025-09-30T14:58:30.411199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141463996:2454], now have 1 active actors on pipe
2025-09-30T14:58:30.411207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896779051669042:7417]
2025-09-30T14:58:30.411210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896779051669042:7417]
2025-09-30T14:58:30.411213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896779051669042:7417]
2025-09-30T14:58:30.411228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:30.411269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:30.411291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:30.411299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:30.411337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896779051669042:7417]
2025-09-30T14:58:30.411346Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:30.411364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:30.411374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:30.411377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:30.411384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:30.411339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2923
2025-09-30T14:58:30.411412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.411421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.411339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2923
2025-09-30T14:58:30.411450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:30.411463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:30.411472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:30.411474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:30.411484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:30.411499Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:30.411517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:30.411703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.411714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.411731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:30.411863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2924 partition: 0 MaxSeqNo: 42 sessionId: src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0
2025-09-30T14:58:30.412297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a983249e-8ddcf915-8e61aa6f-a321bb06_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:30.415479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0] Write session: try to update token
2025-09-30T14:58:30.415507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:30.423967Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:30.423987Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:30.423998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896779051669042:7417]
2025-09-30T14:58:30.424048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:30.424055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:30.424224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:30.424377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:30.424530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:30.424690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:30.424922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:30.424975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:30.435383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2924 sessionId: src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:30.438383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:30.438644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.438681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.438729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:30.440535Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:30.442043Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:30.442060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:30.442063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:30.442065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:30.442075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896779051669042:7417]
2025-09-30T14:58:30.442079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896779051669042:7417]
2025-09-30T14:58:30.442084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896779051669042:7417]
2025-09-30T14:58:30.442128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:30.442135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.442138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:30.442185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:30.442198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:30.442202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:30.442275Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:30.455003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896779141464269:7727]
2025-09-30T14:58:30.458797Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 2923, pipe: [1:7555896779141464269:7727]
2025-09-30T14:58:30.564062Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:30.564496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141464269:7727], now have 1 active actors on pipe
2025-09-30T14:58:30.572580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.572603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.572798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.572871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.572947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.573019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.573067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.573077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.573148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.573210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.573274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.573357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.573403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.573411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.573481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.573548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.573615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.573685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.573730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.573737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.573804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.573873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.573940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.574004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.574049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.574057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.574128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.574231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.574294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.574359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.574405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.574413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.574478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.574540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.574614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.574677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.574748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.574756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.574819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.574880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.574947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.575016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.575090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.575098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.575164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.575226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.575306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.575371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.575419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.575425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.575495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.575565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.575635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.575706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.575839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.575849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.575920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.575985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.576055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.576122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.576185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.576193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.577118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896779141464269:7727]
2025-09-30T14:58:30.577159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:30.577162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:30.577187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2924 reason: error at write: Disconnected sessionId: src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0
2025-09-30T14:58:30.577399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2924 sessionId: src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0 is DEAD
2025-09-30T14:58:30.577648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:30.577661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0] Write session will restart in 0.006145s
2025-09-30T14:58:30.577686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0] Write session: Do CDS request
2025-09-30T14:58:30.577692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:30.577745Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:30.577855Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:30.584812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:30.584877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:30.584893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2925
2025-09-30T14:58:30.585030Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2925 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:30.585075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2925 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:30.585085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2925 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:30.585089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:30.585487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2925 sessionId:  describe result for acl check
2025-09-30T14:58:30.585520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:30.585526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:30.585531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:30.585536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896779141464312:7999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:30.586048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896779141464312:7999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:30.592136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896779141464312:7999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:30.596113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896779141464312:7999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:30.596132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896779141464312:7999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:30.596135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896779141464312:7999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:30.596143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2925 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:30.606116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:30.606755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:30.606944Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:30.606953Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:30.606964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:30.607016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:30.607058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896779051669350:7400]
2025-09-30T14:58:30.607746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:30.608032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:30.608073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:30.608403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:30.608473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.608479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.608481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.608482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.608484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.608485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.608486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.608488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.608490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.608491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.608492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.608494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.608495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.608497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.608499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.608504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.608516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.608520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.608524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.608529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.608533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.608537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.608542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.608546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.608551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.608555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.608559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.608563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.608567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.608572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.608580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.608588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.608594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.608600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.608607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.608612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.608617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.608623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.608628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.608634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.608638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.608643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.608648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.608654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.608658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.608665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.608677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.608681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.608685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.608690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.608694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.608701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.608705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.608711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.608716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.608721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.608726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.608731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.608736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.608741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.608800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:30.614442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:30.615611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:30.615631Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:30.615634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:30.615637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:30.615649Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2924 [2:7555896779051669350:7400]
2025-09-30T14:58:30.615666Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:30.615683Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:30.615686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:30.615689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:30.615691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:30.615711Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:30.615720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:30.615731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:30.615793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.615800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.615803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.615806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:30.615808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:30.615878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:30.615886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.615900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.615913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.615930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:30.615949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896779051669345:7400]
2025-09-30T14:58:30.615957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896779051669345:7400]
2025-09-30T14:58:30.615959Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896779051669345:7400]
2025-09-30T14:58:30.615972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:30.615987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141464490:7999], now have 1 active actors on pipe
2025-09-30T14:58:30.615996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141464297:2454], now have 1 active actors on pipe
2025-09-30T14:58:30.616004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:30.616019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:30.616023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:30.616026Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:30.616030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:30.616033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:30.616062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896779051669345:7400]
2025-09-30T14:58:30.616069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:30.616071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:30.616029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2924
2025-09-30T14:58:30.616032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2924
2025-09-30T14:58:30.616101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.616110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.616144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:30.616151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:30.616162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:30.616164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:30.616174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:30.616186Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:30.616207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:30.616327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.616334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.616348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:30.616441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2925 partition: 0 MaxSeqNo: 42 sessionId: src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0
2025-09-30T14:58:30.616836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|881bc044-8c7ccb9e-c30b67fe-be140496_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:30.619710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0] Write session: try to update token
2025-09-30T14:58:30.619733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:30.629182Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:30.629204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:30.629206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:30.629208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:30.629220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896779051669345:7400]
2025-09-30T14:58:30.629224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896779051669345:7400]
2025-09-30T14:58:30.629228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896779051669345:7400]
2025-09-30T14:58:30.629268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:30.629279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.629278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:30.629283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:30.629288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:30.629293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:30.629429Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:30.636662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2925 sessionId: src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:30.639547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:30.677181Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896779141464579:7727]
2025-09-30T14:58:30.677411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 2924, pipe: [1:7555896779141464579:7727]
2025-09-30T14:58:30.737723Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:30.738503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.738517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.738535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141464579:7727], now have 1 active actors on pipe
2025-09-30T14:58:30.738770Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:30.738771Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:30.738772Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:30.738777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:30.738832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896779141464579:7727]
2025-09-30T14:58:30.738834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2925 reason: error at write: Disconnected sessionId: src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0
2025-09-30T14:58:30.739010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2925 sessionId: src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0 is DEAD
2025-09-30T14:58:30.739159Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:30.739172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0] Write session will restart in 0.008297s
2025-09-30T14:58:30.739196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0] Write session: Do CDS request
2025-09-30T14:58:30.739207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:30.748726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:30.748857Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:30.748876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2926
2025-09-30T14:58:30.748985Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2926 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:30.749017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2926 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:30.749026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2926 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:30.749031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:30.749585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2926 sessionId:  describe result for acl check
2025-09-30T14:58:30.749623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:30.749631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:30.749633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:30.749639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896779141464622:8006] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:30.750184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896779141464622:8006] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:30.753135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896779141464622:8006] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:30.756631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896779141464622:8006] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:30.756646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896779141464622:8006] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:30.756650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896779141464622:8006] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:30.756657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2926 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:30.764804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:30.765318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:30.765451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:30.765458Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:30.765465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:30.765496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:30.765520Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896779051669615:7392]
2025-09-30T14:58:30.765964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:30.766180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:30.766207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:30.766416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:30.766450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.766455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.766456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.766456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.766458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.766458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.766459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.766460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.766461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.766461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.766462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.766463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.766463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.766464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.766465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.766468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.766474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.766477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.766479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.766482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.766485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.766487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.766490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.766492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.766495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.766497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.766500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.766502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.766504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.766506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.766512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.766516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.766520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.766524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.766527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.766530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.766533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.766536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.766538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.766542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.766545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.766548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.766551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.766554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.766556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.766559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.766563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.766567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.766569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.766572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.766574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.766577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.766579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.766582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.766584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.766587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.766590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.766593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.766595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.766599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.766624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:30.772197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:30.773333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:30.773346Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:30.773348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:30.773351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:30.773355Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2925 [2:7555896779051669615:7392]
2025-09-30T14:58:30.773365Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:30.773376Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:30.773378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:30.773380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:30.773381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:30.773393Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:30.773397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:30.773402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:30.773448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.773449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.773450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.773453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:30.773454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:30.773502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:30.773508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.773516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.773522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.773531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:30.773544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896779051669610:7392]
2025-09-30T14:58:30.773545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896779051669610:7392]
2025-09-30T14:58:30.773547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896779051669610:7392]
2025-09-30T14:58:30.773553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:30.773562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:30.773570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:30.773573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:30.773573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:30.773574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:30.773574Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:30.773581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141464581:2454], now have 1 active actors on pipe
2025-09-30T14:58:30.773584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141464814:8006], now have 1 active actors on pipe
2025-09-30T14:58:30.773607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896779051669610:7392]
2025-09-30T14:58:30.773612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:30.773617Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:30.773677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2925
2025-09-30T14:58:30.773679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2925
2025-09-30T14:58:30.773733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.773740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.773758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:30.773766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:30.773768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:30.773770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:30.773776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:30.773783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:30.773795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:30.773950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.773956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.773965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:30.774063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2926 partition: 0 MaxSeqNo: 42 sessionId: src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0
2025-09-30T14:58:30.774415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11257d41-5a8d11c0-3c1884e5-6fbf1624_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:30.776972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0] Write session: try to update token
2025-09-30T14:58:30.776989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:30.785666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:30.785682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:30.785691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896779051669610:7392]
2025-09-30T14:58:30.785732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:30.785734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:30.785896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:30.786053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:30.786194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:30.786328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:30.786510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:30.786547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:30.790646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2926 sessionId: src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:30.793265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:30.793459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.793487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.793519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:30.793591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:30.796757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:30.796769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:30.796771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:30.796774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:30.796802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896779051669610:7392]
2025-09-30T14:58:30.796807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896779051669610:7392]
2025-09-30T14:58:30.796811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896779051669610:7392]
2025-09-30T14:58:30.796846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:30.796853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.796856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:30.796855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:30.796861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:30.796865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:30.796997Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:30.838975Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896779141464857:7727]
2025-09-30T14:58:30.839270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 2925, pipe: [1:7555896779141464857:7727]
2025-09-30T14:58:30.905709Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:30.912929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.912953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.913102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.913157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.913214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.913271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.913313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.913320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.913381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.913438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.913500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.913572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.913616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.913623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.913682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.913736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.913797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.913854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.913898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.913900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.913963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.914022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.914079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.914134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.914173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.914178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.914236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.914291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.914349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.914418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.914458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.914464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.914522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.914576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.914632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.914688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.914733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.914739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.914798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.914851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.914912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.914968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.915006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.915012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.915072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.915126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.915182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.915258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.915311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.915317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.915377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.915428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.915485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.915543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.915588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.915593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.915652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:30.915707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:30.915765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:30.915822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:30.915860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:30.915866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:30.915903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141464857:7727], now have 1 active actors on pipe
2025-09-30T14:58:30.916167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:30.916173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:30.916183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:30.916223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2926 reason: error at write: Disconnected sessionId: src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0
2025-09-30T14:58:30.916226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896779141464857:7727]
2025-09-30T14:58:30.916405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2926 sessionId: src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0 is DEAD
2025-09-30T14:58:30.916569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:30.916581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0] Write session will restart in 0.007102s
2025-09-30T14:58:30.916604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0] Write session: Do CDS request
2025-09-30T14:58:30.916610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:30.916774Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:30.924758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:30.924939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:30.924955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2927
2025-09-30T14:58:30.925077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2927 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:30.925107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2927 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:30.925117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2927 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:30.925122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:30.925695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2927 sessionId:  describe result for acl check
2025-09-30T14:58:30.925732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:30.925740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:30.925742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:30.925747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896779141464897:8017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:30.926280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896779141464897:8017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:30.930274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896779141464897:8017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:30.932843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896779141464897:8017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:30.932857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896779141464897:8017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:30.932860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896779141464897:8017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:30.932869Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2927 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:30.939573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:30.940047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:30.940203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:30.940214Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:30.940223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:30.940264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:30.940303Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896779051669881:7387]
2025-09-30T14:58:30.940922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:30.941202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:30.941242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:30.941547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:30.941597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.941602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.941604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.941605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.941606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.941607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.941608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.941610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.941611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.941613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.941614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.941615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.941617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.941618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.941619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.941625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.941636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.941640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.941644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.941647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.941652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.941659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.941664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.941672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.941676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.941684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.941688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.941691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.941700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.941703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.941712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.941723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:30.941728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.941734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:30.941738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.941744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:30.941752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.941757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:30.941765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.941771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:30.941779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.941784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:30.941793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.941803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:30.941811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.941816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:30.941820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.941825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:30.941834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.941840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:30.941851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.941860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.941868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.941873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.941881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.941886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.941890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.941895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:30.941904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.941913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:30.941958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:30.947202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:30.948051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:30.948068Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:30.948070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:30.948074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:30.948079Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2926 [2:7555896779051669881:7387]
2025-09-30T14:58:30.948094Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:30.948108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:30.948111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:30.948114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:30.948116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:30.948131Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:30.948137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:30.948143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:30.948205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.948214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.948216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.948219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:30.948221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:30.948289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:30.948296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.948307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:30.948317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:30.948336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:30.948356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896779051669876:7387]
2025-09-30T14:58:30.948363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896779051669876:7387]
2025-09-30T14:58:30.948365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896779051669876:7387]
2025-09-30T14:58:30.948375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:30.948384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:30.948387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:30.948389Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:30.948392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141464859:2454], now have 1 active actors on pipe
2025-09-30T14:58:30.948396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896779141465117:8017], now have 1 active actors on pipe
2025-09-30T14:58:30.948404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:30.948421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:30.948428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:30.948457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896779051669876:7387]
2025-09-30T14:58:30.948469Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:30.948462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2926
2025-09-30T14:58:30.948491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:30.948760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2926
2025-09-30T14:58:30.948833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.948846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.948870Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:30.948883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:30.948890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:30.948892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:30.948902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:30.948916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:30.948932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:30.949120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:30.949133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:30.949149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:30.949232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2927 partition: 0 MaxSeqNo: 42 sessionId: src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0
2025-09-30T14:58:30.949629Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10a0d2aa-f232bc58-292aa30f-e4c6e13e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:30.952860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0] Write session: try to update token
2025-09-30T14:58:30.952882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:30.960230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:30.960247Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:30.960250Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:30.960252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:30.960261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896779051669876:7387]
2025-09-30T14:58:30.960265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896779051669876:7387]
2025-09-30T14:58:30.960269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896779051669876:7387]
2025-09-30T14:58:30.960308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:30.960315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:30.960318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:30.960323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:30.960330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:30.960334Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:30.960448Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:30.968502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2927 sessionId: src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:30.971187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:31.016607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896783436432439:7727]
2025-09-30T14:58:31.016814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 2926, pipe: [1:7555896783436432439:7727]
2025-09-30T14:58:31.062917Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:31.063467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.063482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.063499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436432439:7727], now have 1 active actors on pipe
2025-09-30T14:58:31.063708Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:31.063727Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:31.063739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:31.063743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:31.063790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896783436432439:7727]
2025-09-30T14:58:31.063814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2927 reason: error at write: Disconnected sessionId: src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0
2025-09-30T14:58:31.064009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2927 sessionId: src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0 is DEAD
2025-09-30T14:58:31.064123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:31.064133Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0] Write session will restart in 0.006607s
2025-09-30T14:58:31.064151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0] Write session: Do CDS request
2025-09-30T14:58:31.064158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:31.071805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:31.071836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:31.071853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2928
2025-09-30T14:58:31.072065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2928 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:31.072096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2928 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:31.072101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2928 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:31.072104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:31.072462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2928 sessionId:  describe result for acl check
2025-09-30T14:58:31.072497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:31.072498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:31.072499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:31.072503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896783436432455:8030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:31.072921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896783436432455:8030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:31.074703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896783436432455:8030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:31.078295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896783436432455:8030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:31.078310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896783436432455:8030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:31.078313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896783436432455:8030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:31.078320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2928 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:31.084467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:31.089106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:31.089318Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:31.089328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:31.089339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:31.089394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:31.089435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896783346637447:7385]
2025-09-30T14:58:31.090113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:31.090389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:31.090447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:31.090695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:31.090742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.090746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.090747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.090748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.090749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.090750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.090750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.090751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.090752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.090753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.090753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.090754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.090755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.090756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.090756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.090760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.090767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.090770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.090772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.090774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.090777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.090779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.090782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.090784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.090786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.090789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.090791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.090794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.090796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.090798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.090805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.090810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.090814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.090818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.090821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.090824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.090827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.090830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.090833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.090836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.090838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.090842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.090844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.090848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.090850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.090854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.090857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.090860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.090863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.090866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.090868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.090873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.090876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.090879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.090882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.090885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.090888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.090891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.090894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.090897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.090920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:31.096209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:31.097030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:31.097047Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:31.097050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:31.097053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:31.097061Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2927 [2:7555896783346637447:7385]
2025-09-30T14:58:31.097079Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:31.097094Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:31.097103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:31.097106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:31.097108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:31.097123Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:31.097134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:31.097141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:31.097200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.097208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.097211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.097215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:31.097217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:31.097285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:31.097293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.097331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.097352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.097371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:31.097390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436432579:8030], now have 1 active actors on pipe
2025-09-30T14:58:31.097404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436432440:2454], now have 1 active actors on pipe
2025-09-30T14:58:31.097416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896783346637442:7385]
2025-09-30T14:58:31.097423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896783346637442:7385]
2025-09-30T14:58:31.097426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896783346637442:7385]
2025-09-30T14:58:31.097441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:31.097461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:31.097453Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2927
2025-09-30T14:58:31.097478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:31.097456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2927
2025-09-30T14:58:31.097481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:31.097484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:31.097488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:31.097491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:31.097517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896783346637442:7385]
2025-09-30T14:58:31.097520Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:31.097523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:31.097536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.097546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.097592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6dc033bc-f355205-62c70e97-cb8f0480_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:31.097604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:31.097608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:31.097610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:31.097620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:31.097634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:31.097662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:31.097787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.097795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.097808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:31.097888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2928 partition: 0 MaxSeqNo: 42 sessionId: src_id|6dc033bc-f355205-62c70e97-cb8f0480_0
2025-09-30T14:58:31.098224Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b93f0387-383d5ce4-dd2d348a-2a052e2d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6dc033bc-f355205-62c70e97-cb8f0480_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:31.100680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dc033bc-f355205-62c70e97-cb8f0480_0] Write session: try to update token
2025-09-30T14:58:31.100695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dc033bc-f355205-62c70e97-cb8f0480_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:31.109717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:31.109739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:31.109742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:31.109744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:31.109756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896783346637442:7385]
2025-09-30T14:58:31.109761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896783346637442:7385]
2025-09-30T14:58:31.109765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896783346637442:7385]
2025-09-30T14:58:31.109804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:31.109807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:31.109810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.109813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:31.109813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:31.109817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:31.109961Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:31.114610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2928 sessionId: src_id|6dc033bc-f355205-62c70e97-cb8f0480_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:31.117594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:31.164091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896783436432719:7727]
2025-09-30T14:58:31.164394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 2927, pipe: [1:7555896783436432719:7727]
2025-09-30T14:58:31.226707Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:31.227553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.227564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.227597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436432719:7727], now have 1 active actors on pipe
2025-09-30T14:58:31.228354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dc033bc-f355205-62c70e97-cb8f0480_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:31.228365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dc033bc-f355205-62c70e97-cb8f0480_0] Write session will restart in 0.008603s
2025-09-30T14:58:31.228390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dc033bc-f355205-62c70e97-cb8f0480_0] Write session: Do CDS request
2025-09-30T14:58:31.228395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dc033bc-f355205-62c70e97-cb8f0480_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:31.227939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896783436432719:7727]
2025-09-30T14:58:31.227980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:31.227983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:31.228040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2928 reason: error at write: Disconnected sessionId: src_id|6dc033bc-f355205-62c70e97-cb8f0480_0
2025-09-30T14:58:31.228117Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:31.228214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2928 sessionId: src_id|6dc033bc-f355205-62c70e97-cb8f0480_0 is DEAD
2025-09-30T14:58:31.228437Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:31.237849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6dc033bc-f355205-62c70e97-cb8f0480_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:31.237927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:31.237945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2929
2025-09-30T14:58:31.238084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2929 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:31.238114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2929 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:31.238119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2929 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:31.238124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:31.238604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2929 sessionId:  describe result for acl check
2025-09-30T14:58:31.238647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:31.238654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:31.238656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:31.238662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896783436432732:8048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:31.239178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896783436432732:8048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:31.241104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896783436432732:8048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:31.243921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896783436432732:8048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:31.243939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896783436432732:8048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:31.243943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896783436432732:8048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:31.243951Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2929 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:31.272436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:31.272947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:31.273143Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:31.273153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:31.273163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:31.273218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:31.273262Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896783346637715:7377]
2025-09-30T14:58:31.273880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:31.278482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:31.278568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:31.278994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:31.279067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.279075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.279077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.279078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.279079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.279081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.279082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.279084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.279085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.279086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.279088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.279089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.279091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.279092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.279093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.279101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.279111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.279117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.279122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.279126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.279131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.279135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.279139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.279144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.279149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.279154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.279158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.279163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.279168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.279172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.279181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.279190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.279195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.279201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.279207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.279212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.279217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.279222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.279228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.279235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.279240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.279264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.279270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.279276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.279283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.279295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.279300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.279306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.279311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.279317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.279322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.279328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.279332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.279337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.279343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.279349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.279360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.279365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.279374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.279385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.279434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:31.287738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:31.288652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:31.288670Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:31.288673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:31.288678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:31.288684Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2928 [2:7555896783346637715:7377]
2025-09-30T14:58:31.288703Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:31.288720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:31.288724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:31.288727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:31.288729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:31.288747Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:31.288754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:31.288761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:31.288843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.288855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.288857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.288861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:31.288864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:31.288935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:31.288943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.288955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.288965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.288980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:31.289002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896783346637710:7377]
2025-09-30T14:58:31.289009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896783346637710:7377]
2025-09-30T14:58:31.289011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896783346637710:7377]
2025-09-30T14:58:31.289027Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:31.289038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:31.289047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436432720:2454], now have 1 active actors on pipe
2025-09-30T14:58:31.289048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:31.289050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:31.289052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436432776:8048], now have 1 active actors on pipe
2025-09-30T14:58:31.289061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:31.289074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:31.289082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:31.289117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896783346637710:7377]
2025-09-30T14:58:31.289132Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:31.289171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:31.289141Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2928
2025-09-30T14:58:31.289185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2928
2025-09-30T14:58:31.289406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.289422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.289450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5fda91d0-58420b0c-443c38b-6b795cad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:31.289464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:31.289469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:31.289472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:31.289483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:31.289495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:31.289510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:31.290223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2929 partition: 0 MaxSeqNo: 42 sessionId: src_id|5fda91d0-58420b0c-443c38b-6b795cad_0
2025-09-30T14:58:31.289972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.289983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.289998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:31.290737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6dc033bc-f355205-62c70e97-cb8f0480_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5fda91d0-58420b0c-443c38b-6b795cad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:31.293585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fda91d0-58420b0c-443c38b-6b795cad_0] Write session: try to update token
2025-09-30T14:58:31.293607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fda91d0-58420b0c-443c38b-6b795cad_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:31.301998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:31.302015Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:31.302018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:31.302019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:31.302028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896783346637710:7377]
2025-09-30T14:58:31.302032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896783346637710:7377]
2025-09-30T14:58:31.302037Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896783346637710:7377]
2025-09-30T14:58:31.302081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:31.302092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.302095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:31.302100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:31.302107Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:31.302111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:31.302238Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:31.319389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2929 sessionId: src_id|5fda91d0-58420b0c-443c38b-6b795cad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:31.322352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:31.327948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896783436433003:7727]
2025-09-30T14:58:31.328262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 2928, pipe: [1:7555896783436433003:7727]
2025-09-30T14:58:31.434183Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:31.434242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896783436433003:7727]
2025-09-30T14:58:31.434262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:31.434269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:31.434328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2929 reason: error at write: Disconnected sessionId: src_id|5fda91d0-58420b0c-443c38b-6b795cad_0
2025-09-30T14:58:31.434501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2929 sessionId: src_id|5fda91d0-58420b0c-443c38b-6b795cad_0 is DEAD
2025-09-30T14:58:31.433206Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:31.433732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.433741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.433761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436433003:7727], now have 1 active actors on pipe
2025-09-30T14:58:31.434359Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:31.437682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fda91d0-58420b0c-443c38b-6b795cad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:31.437695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fda91d0-58420b0c-443c38b-6b795cad_0] Write session will restart in 0.006650s
2025-09-30T14:58:31.437721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fda91d0-58420b0c-443c38b-6b795cad_0] Write session: Do CDS request
2025-09-30T14:58:31.437728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fda91d0-58420b0c-443c38b-6b795cad_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:31.446022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5fda91d0-58420b0c-443c38b-6b795cad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:31.447555Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:31.447574Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2930
2025-09-30T14:58:31.447743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2930 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:31.447774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2930 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:31.447780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2930 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:31.447785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:31.451730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2930 sessionId:  describe result for acl check
2025-09-30T14:58:31.451805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:31.451812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:31.451814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:31.451821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896783436433025:8052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:31.452397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896783436433025:8052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:31.472966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896783436433025:8052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:31.484568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896783436433025:8052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:31.484588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896783436433025:8052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:31.484592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896783436433025:8052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:31.484601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2930 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:31.497820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:31.505001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:31.505237Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:31.505241Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:31.505253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:31.505310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:31.505836Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896783346637996:7373]
2025-09-30T14:58:31.506550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:31.507146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:31.507195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:31.507552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:31.507628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.507629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.507631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.507632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.507633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.507635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.507637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.507638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.507639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.507641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.507642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.507643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.507645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.507646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.507647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.507654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.507665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.507670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.507675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.507679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.507684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.507688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.507692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.507695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.507699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.507703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.507707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.507711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.507715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.507718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.507729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.507737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.507742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.507748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.507752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.507757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.507762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.507766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.507772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.507777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.507781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.507804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.507810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.507816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.507820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.507825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.507830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.507837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.507841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.507845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.507850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.507854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.507858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.507864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.507868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.507873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.507877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.507882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.507888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.507893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.507935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:31.528594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:31.529541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:31.529547Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:31.529550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:31.529555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:31.529563Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2929 [2:7555896783346637996:7373]
2025-09-30T14:58:31.529582Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:31.529600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:31.529604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:31.529608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:31.529611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:31.529629Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:31.529636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:31.529644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:31.529716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.529719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.529721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.529725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:31.529727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:31.529809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:31.529813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.529827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.529838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.529855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:31.529874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896783346637990:7373]
2025-09-30T14:58:31.529877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896783346637990:7373]
2025-09-30T14:58:31.529880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896783346637990:7373]
2025-09-30T14:58:31.529894Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:31.529911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:31.529927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:31.529931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:31.529974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896783346637990:7373]
2025-09-30T14:58:31.529977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:31.531256Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2929
2025-09-30T14:58:31.531295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2929
2025-09-30T14:58:31.530424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:31.530432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:31.530434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:31.530440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:31.531672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436433009:2454], now have 1 active actors on pipe
2025-09-30T14:58:31.531682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436433219:8052], now have 1 active actors on pipe
2025-09-30T14:58:31.531697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.531703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.531733Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:31.531742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:31.531747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:31.531750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:31.531762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:31.531776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:31.531796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:31.532409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.532417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.532432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:31.532612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2930 partition: 0 MaxSeqNo: 42 sessionId: src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0
2025-09-30T14:58:31.534257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896783436433285:7727]
2025-09-30T14:58:31.534624Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 2929, pipe: [1:7555896783436433285:7727]
2025-09-30T14:58:31.534701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436433285:7727], now have 1 active actors on pipe
2025-09-30T14:58:31.535357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5fda91d0-58420b0c-443c38b-6b795cad_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:31.538223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0] Write session: try to update token
2025-09-30T14:58:31.538243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:31.552941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:31.552959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:31.552962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:31.552965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:31.552974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896783346637990:7373]
2025-09-30T14:58:31.552979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896783346637990:7373]
2025-09-30T14:58:31.552984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896783346637990:7373]
2025-09-30T14:58:31.553022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:31.553029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.553033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:31.553183Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:31.555474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:31.555485Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:31.555490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:31.572895Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2930 sessionId: src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:31.575686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:31.712789Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:31.713355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.713368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.713669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:31.714044Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:31.714116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2930 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0
2025-09-30T14:58:31.714294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2930 sessionId: src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0 is DEAD
2025-09-30T14:58:31.714700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:31.714710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0] Write session will restart in 0.008488s
2025-09-30T14:58:31.714733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0] Write session: Do CDS request
2025-09-30T14:58:31.714739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:31.714451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:31.714485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896783436433285:7727]
2025-09-30T14:58:31.724752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:31.724928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:31.724945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2931
2025-09-30T14:58:31.725391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2931 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:31.725429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2931 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:31.725435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2931 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:31.725439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:31.727004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2931 sessionId:  describe result for acl check
2025-09-30T14:58:31.727035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:31.727037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:31.727038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:31.727044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896783436433351:8064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:31.727491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896783436433351:8064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:31.731113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896783436433351:8064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:31.744126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896783436433351:8064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:31.744149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896783436433351:8064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:31.744153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896783436433351:8064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:31.744162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2931 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:31.751318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:31.755802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:31.755999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:31.756010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:31.756020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:31.756073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:31.756116Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896783346638306:7350]
2025-09-30T14:58:31.756584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:31.756882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:31.756927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:31.757181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:31.757241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.757246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.757247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.757248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.757250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.757251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.757252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.757253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.757255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.757257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.757258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.757259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.757261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.757262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.757263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.757268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.757279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.757284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.757289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.757292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.757296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.757301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.757304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.757309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.757313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.757318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.757323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.757327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.757332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.757335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.757344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.757353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.757365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.757375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.757381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.757390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.757394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.757401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.757406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.757411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.757417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.757426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.757431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.757440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.757445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.757454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.757459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.757468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.757474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.757479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.757484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.757489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.757493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.757498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.757503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.757509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.757514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.757527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.757532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.757537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.757576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:31.763856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:31.765294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:31.765311Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:31.765314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:31.765319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:31.765326Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2930 [2:7555896783346638306:7350]
2025-09-30T14:58:31.765343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:31.765359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:31.765363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:31.765366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:31.765369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:31.765385Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:31.765392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:31.765402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:31.765461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.765464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.765466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.765470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:31.765473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:31.765536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:31.765539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.765552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.765562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.765577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:31.765593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896783346638301:7350]
2025-09-30T14:58:31.765595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896783346638301:7350]
2025-09-30T14:58:31.765597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896783346638301:7350]
2025-09-30T14:58:31.765614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:31.765627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:31.765642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:31.765644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:31.765676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896783346638301:7350]
2025-09-30T14:58:31.765678Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:31.766114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:31.766117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:31.766119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:31.766126Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:31.766392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436433327:2454], now have 1 active actors on pipe
2025-09-30T14:58:31.766397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436433514:8064], now have 1 active actors on pipe
2025-09-30T14:58:31.766709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2930
2025-09-30T14:58:31.766760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2930
2025-09-30T14:58:31.767306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.767319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.767350Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|245061c4-801234f0-10daf754-8426eb6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:31.767359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:31.767363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:31.767366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:31.767379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:31.767391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:31.767407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:31.771064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.771078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.771104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:31.771674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b99bb451-dc0f6ab1-1f18ac56-e15e921f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|245061c4-801234f0-10daf754-8426eb6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:31.771295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2931 partition: 0 MaxSeqNo: 42 sessionId: src_id|245061c4-801234f0-10daf754-8426eb6a_0
2025-09-30T14:58:31.774584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245061c4-801234f0-10daf754-8426eb6a_0] Write session: try to update token
2025-09-30T14:58:31.774604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245061c4-801234f0-10daf754-8426eb6a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:31.786338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:31.786356Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:31.786359Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:31.786361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:31.786370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896783346638301:7350]
2025-09-30T14:58:31.786374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896783346638301:7350]
2025-09-30T14:58:31.786378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896783346638301:7350]
2025-09-30T14:58:31.786417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:31.786423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.786426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:31.786557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:31.787409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:31.787420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:31.787424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:31.802074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2931 sessionId: src_id|245061c4-801234f0-10daf754-8426eb6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:31.805098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:31.814862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896783436433609:7727]
2025-09-30T14:58:31.815099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 2930, pipe: [1:7555896783436433609:7727]
2025-09-30T14:58:31.904953Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:31.905269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.905288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.905331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436433609:7727], now have 1 active actors on pipe
2025-09-30T14:58:31.905794Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:31.905699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896783436433609:7727]
2025-09-30T14:58:31.905741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:31.905777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:31.905779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:31.905852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2931 reason: error at write: Disconnected sessionId: src_id|245061c4-801234f0-10daf754-8426eb6a_0
2025-09-30T14:58:31.906013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2931 sessionId: src_id|245061c4-801234f0-10daf754-8426eb6a_0 is DEAD
2025-09-30T14:58:31.907384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245061c4-801234f0-10daf754-8426eb6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:31.907397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245061c4-801234f0-10daf754-8426eb6a_0] Write session will restart in 0.009023s
2025-09-30T14:58:31.907423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245061c4-801234f0-10daf754-8426eb6a_0] Write session: Do CDS request
2025-09-30T14:58:31.907432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245061c4-801234f0-10daf754-8426eb6a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:31.917801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|245061c4-801234f0-10daf754-8426eb6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:31.917920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:31.917939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2932
2025-09-30T14:58:31.918077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2932 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:31.918106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2932 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:31.918111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2932 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:31.918116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:31.918528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2932 sessionId:  describe result for acl check
2025-09-30T14:58:31.918554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:31.918556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:31.918558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:31.918563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896783436433627:8086] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:31.919122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896783436433627:8086] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:31.931740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896783436433627:8086] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:31.937636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896783436433627:8086] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:31.937661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896783436433627:8086] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:31.937665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896783436433627:8086] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:31.937674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2932 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:31.949890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:31.955632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:31.955889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:31.955894Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:31.955907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:31.955972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:31.956016Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896783346638579:7348]
2025-09-30T14:58:31.956691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:31.957472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:31.957530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:31.957860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:31.957940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.957942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.957943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.957944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.957946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.957947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.957948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.957950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.957952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.957953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.957955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.957956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.957957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.957959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.957960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.957966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.957977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.957982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.957986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.957991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.957995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.958000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.958004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.958008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.958014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.958018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.958022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.958026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.958031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.958035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.958044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.958051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:31.958057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.958063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:31.958068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.958073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:31.958078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.958084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:31.958089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.958094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:31.958099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.958105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:31.958110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.958115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:31.958120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.958125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:31.958130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.958136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:31.958143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.958148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:31.958152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.958156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.958160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.958166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.958170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.958176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.958179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.958184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:31.958188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.958193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:31.958236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:31.965071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:31.966629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:31.966646Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:31.966649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:31.966653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:31.966660Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2931 [2:7555896783346638579:7348]
2025-09-30T14:58:31.966678Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:31.966696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:31.966701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:31.966705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:31.966707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:31.966725Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:31.966737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:31.966745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:31.966817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.966826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.966828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.966833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:31.966835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:31.966908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:31.966916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.966932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:31.966946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:31.966971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:31.966993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896783346638574:7348]
2025-09-30T14:58:31.966999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896783346638574:7348]
2025-09-30T14:58:31.967001Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896783346638574:7348]
2025-09-30T14:58:31.967021Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:31.967034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:31.967060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:31.967059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:31.967064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:31.967066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:31.967067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:31.967103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896783346638574:7348]
2025-09-30T14:58:31.967112Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:31.967116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:31.967134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436433802:8086], now have 1 active actors on pipe
2025-09-30T14:58:31.967139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896783436433611:2454], now have 1 active actors on pipe
2025-09-30T14:58:31.967876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.967894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.967921Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:31.967939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:31.967943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:31.967946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:31.967957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:31.967969Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:31.967994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:31.968332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:31.968342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:31.968359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:31.968889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|245061c4-801234f0-10daf754-8426eb6a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:31.967541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2931
2025-09-30T14:58:31.967582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2931
2025-09-30T14:58:31.968498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2932 partition: 0 MaxSeqNo: 42 sessionId: src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0
2025-09-30T14:58:31.971988Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0] Write session: try to update token
2025-09-30T14:58:31.972011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:31.981009Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:31.981032Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:31.981035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:31.981038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:31.981047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896783346638574:7348]
2025-09-30T14:58:31.981052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896783346638574:7348]
2025-09-30T14:58:31.981056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896783346638574:7348]
2025-09-30T14:58:31.981143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:31.981155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:31.981158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:31.981170Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:31.981178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:31.981182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:31.981315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:31.989222Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2932 sessionId: src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:31.992463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:32.003360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896787731401188:7727]
2025-09-30T14:58:32.003786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 2931, pipe: [1:7555896787731401188:7727]
2025-09-30T14:58:32.103616Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:32.104262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.104277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.104296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731401188:7727], now have 1 active actors on pipe
2025-09-30T14:58:32.104515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:32.104571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:32.104578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896787731401188:7727]
2025-09-30T14:58:32.104588Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:32.104597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:32.104649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2932 reason: error at write: Disconnected sessionId: src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0
2025-09-30T14:58:32.104856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2932 sessionId: src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0 is DEAD
2025-09-30T14:58:32.105241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:32.105253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0] Write session will restart in 0.008840s
2025-09-30T14:58:32.105288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0] Write session: Do CDS request
2025-09-30T14:58:32.105297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:32.115903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:32.115994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:32.116013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2933
2025-09-30T14:58:32.116135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2933 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:32.116169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2933 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:32.116187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2933 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:32.116197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:32.116724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2933 sessionId:  describe result for acl check
2025-09-30T14:58:32.116765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:32.116767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:32.116769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:32.116790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896787731401239:8096] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:32.117405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896787731401239:8096] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:32.119987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896787731401239:8096] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:32.126063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896787731401239:8096] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:32.126085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896787731401239:8096] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:32.126097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896787731401239:8096] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:32.126106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2933 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:32.135559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:32.136454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:32.136699Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:32.136704Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:32.136715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:32.136806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:32.136846Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896787641606150:7343]
2025-09-30T14:58:32.137819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:32.138767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:32.138828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:32.139207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:32.139296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.139302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.139304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.139305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.139307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.139308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.139309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.139311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.139312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.139314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.139315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.139317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.139318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.139320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.139321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.139328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.139339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.139344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.139349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.139352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.139356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.139360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.139363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.139367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.139374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.139378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.139383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.139388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.139392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.139395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.139405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.139413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.139418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.139425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.139432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.139438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.139443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.139449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.139455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.139461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.139466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.139473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.139482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.139488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.139493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.139499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.139510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.139515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.139519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.139524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.139528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.139534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.139537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.139542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.139545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.139550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.139555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.139560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.139564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.139569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.139610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:32.145398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:32.146274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:32.146292Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:32.146295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:32.146299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:32.146306Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2932 [2:7555896787641606150:7343]
2025-09-30T14:58:32.146324Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:32.146340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:32.146348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:32.146352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:32.146354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:32.146370Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:32.146378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:32.146385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:32.146446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.146454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.146457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.146460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:32.146464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:32.146532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:32.146540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.146553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.146564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.146585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:32.146608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896787641606145:7343]
2025-09-30T14:58:32.146615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896787641606145:7343]
2025-09-30T14:58:32.146618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896787641606145:7343]
2025-09-30T14:58:32.146631Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:32.146645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:32.146647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731401190:2454], now have 1 active actors on pipe
2025-09-30T14:58:32.146651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731401456:8096], now have 1 active actors on pipe
2025-09-30T14:58:32.146655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:32.146657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:32.146659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:32.146673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:32.146677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:32.146711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896787641606145:7343]
2025-09-30T14:58:32.146728Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:32.146751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:32.146710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2932
2025-09-30T14:58:32.146750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2932
2025-09-30T14:58:32.146799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.146808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.146833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:32.146845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:32.146849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:32.146851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:32.146862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:32.146871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:32.147293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:32.150198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.150218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.150260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:32.150424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2933 partition: 0 MaxSeqNo: 42 sessionId: src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0
2025-09-30T14:58:32.150885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff0f18ed-f36c1709-dacc468c-38b257f0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:32.153894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0] Write session: try to update token
2025-09-30T14:58:32.153919Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:32.166291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:32.166313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:32.166324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896787641606145:7343]
2025-09-30T14:58:32.166373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:32.166383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:32.166553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:32.166704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:32.166862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:32.167011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:32.167219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:32.167282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:32.173910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2933 sessionId: src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:32.172024Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:32.172045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:32.172047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:32.172050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:32.172062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896787641606145:7343]
2025-09-30T14:58:32.172065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896787641606145:7343]
2025-09-30T14:58:32.172070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896787641606145:7343]
2025-09-30T14:58:32.172120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:32.172128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.172131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:32.172144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:32.172152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:32.172157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:32.172284Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:32.176974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:32.204446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896787731401472:7727]
2025-09-30T14:58:32.204718Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 2932, pipe: [1:7555896787731401472:7727]
2025-09-30T14:58:32.287194Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:32.287691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.287705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.287728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731401472:7727], now have 1 active actors on pipe
2025-09-30T14:58:32.287936Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:32.288031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:32.288097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:32.288107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896787731401472:7727]
2025-09-30T14:58:32.288185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2933 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0
2025-09-30T14:58:32.288357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2933 sessionId: src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0 is DEAD
2025-09-30T14:58:32.288550Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:32.288561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0] Write session will restart in 0.009789s
2025-09-30T14:58:32.288585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0] Write session: Do CDS request
2025-09-30T14:58:32.288591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:32.299853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:32.299916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:32.299936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2934
2025-09-30T14:58:32.303495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2934 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:32.303559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2934 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:32.303571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2934 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:32.303576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:32.304219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2934 sessionId:  describe result for acl check
2025-09-30T14:58:32.304267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:32.304270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:32.304272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:32.304279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896787731401600:10239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:32.304864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896787731401600:10239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:32.307402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896787731401600:10239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:32.310814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896787731401600:10239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:32.310832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896787731401600:10239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:32.310836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896787731401600:10239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:32.310844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2934 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:32.317891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:32.318628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:32.319289Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:32.319300Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:32.319315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:32.319397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:32.319445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896787641606436:7323]
2025-09-30T14:58:32.320116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:32.320449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:32.320496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:32.320832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:32.320898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.320907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.320908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.320909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.320910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.320912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.320913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.320914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.320915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.320917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.320918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.320920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.320921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.320922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.320924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.320929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.320940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.320945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.320950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.320954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.320958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.320962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.320966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.320970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.320975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.320979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.320983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.320986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.320991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.320995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.321004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.321013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.321020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.321025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.321031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.321037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.321041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.321047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.321051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.321057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.321062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.321068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.321073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.321078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.321082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.321088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.321092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.321097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.321101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.321112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.321117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.321122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.321129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.321139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.321144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.321150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.321159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.321164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.321169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.321175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.321223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:32.326921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:32.328115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:32.328131Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:32.328134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:32.328137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:32.328143Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2933 [2:7555896787641606436:7323]
2025-09-30T14:58:32.328161Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:32.328178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:32.328182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:32.328185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:32.328188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:32.328205Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:32.328218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:32.328225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:32.328296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.328304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.328306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.328309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:32.328311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:32.328381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:32.328389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.328402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.328418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.328440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:32.328464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731401750:10239], now have 1 active actors on pipe
2025-09-30T14:58:32.328473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731401478:2454], now have 1 active actors on pipe
2025-09-30T14:58:32.328479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896787641606426:7323]
2025-09-30T14:58:32.328481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896787641606426:7323]
2025-09-30T14:58:32.328483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896787641606426:7323]
2025-09-30T14:58:32.328494Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:32.328508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:32.328511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:32.328515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:32.328517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:32.328526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:32.328529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:32.328566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896787641606426:7323]
2025-09-30T14:58:32.328578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:32.328585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:32.328592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2933
2025-09-30T14:58:32.328602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2933
2025-09-30T14:58:32.328732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.328741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.328768Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:32.328793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:32.328801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:32.328803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:32.328814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:32.328825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:32.328847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:32.329165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.329175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.329191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:32.329316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2934 partition: 0 MaxSeqNo: 42 sessionId: src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0
2025-09-30T14:58:32.329655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bcfd9a2-14abaf31-636801da-ca199b6c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:32.332639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0] Write session: try to update token
2025-09-30T14:58:32.332660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:32.343168Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:32.343187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:32.343198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896787641606426:7323]
2025-09-30T14:58:32.343237Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:32.343238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:32.343442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:32.343591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:32.343741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:32.343886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:32.344088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:32.344131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:32.347265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2934 sessionId: src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:32.350096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:32.350323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.350359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.350398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:32.350493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:32.354091Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:32.354109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:32.354112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:32.354114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:32.354124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896787641606426:7323]
2025-09-30T14:58:32.354128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896787641606426:7323]
2025-09-30T14:58:32.354132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896787641606426:7323]
2025-09-30T14:58:32.354170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:32.354172Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:32.354178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.354181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:32.354181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:32.354186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:32.354364Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:32.388298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896787731401767:7727]
2025-09-30T14:58:32.388631Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 2933, pipe: [1:7555896787731401767:7727]
2025-09-30T14:58:32.463567Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:32.471622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.471649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.471803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:32.471876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:32.471950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:32.472030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:32.472077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:32.472086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:32.472164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:32.472225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:32.472292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:32.472362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:32.472531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:32.472542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:32.472612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:32.472676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:32.472744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:32.472836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:32.472886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:32.472892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:32.472968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:32.473041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:32.473103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:32.473169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:32.473216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:32.473223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:32.473293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:32.473358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:32.473423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:32.473490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:32.473536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:32.473543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:32.473612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:32.473673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:32.473737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:32.473799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:32.473848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:32.473855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:32.473923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:32.473983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:32.474054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:32.474118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:32.474161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:32.474168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:32.474235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:32.474303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:32.474372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:32.474437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:32.474483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:32.474489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:32.474558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:32.474622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:32.474683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:32.474748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:32.474794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:32.474801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:32.474868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:32.474931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:32.474999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:32.475063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:32.475108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:32.475116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:32.475183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731401767:7727], now have 1 active actors on pipe
2025-09-30T14:58:32.475483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896787731401767:7727]
2025-09-30T14:58:32.475522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:32.475527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:32.475533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:32.475558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2934 reason: error at write: Disconnected sessionId: src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0
2025-09-30T14:58:32.475748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2934 sessionId: src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0 is DEAD
2025-09-30T14:58:32.475910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:32.475921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0] Write session will restart in 0.009846s
2025-09-30T14:58:32.475945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0] Write session: Do CDS request
2025-09-30T14:58:32.475951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:32.476423Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:32.486765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:32.486899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:32.486917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2935
2025-09-30T14:58:32.487037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2935 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:32.487071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2935 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:32.487076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2935 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:32.487079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:32.487487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2935 sessionId:  describe result for acl check
2025-09-30T14:58:32.487524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:32.487531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:32.487532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:32.487538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896787731401786:10228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:32.487959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896787731401786:10228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:32.491893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896787731401786:10228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:32.495360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896787731401786:10228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:32.495375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896787731401786:10228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:32.495378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896787731401786:10228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:32.495386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2935 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:32.501082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:32.505511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:32.505721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:32.505731Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:32.505743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:32.505795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:32.505838Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896787641606711:7319]
2025-09-30T14:58:32.506488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:32.506816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:32.506861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:32.507189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:32.507272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.507278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.507279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.507280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.507281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.507282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.507283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.507285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.507286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.507287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.507288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.507289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.507291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.507292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.507293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.507299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.507309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.507313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.507317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.507322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.507326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.507330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.507334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.507338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.507343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.507348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.507352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.507356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.507360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.507364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.507373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.507380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.507387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.507393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.507404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.507409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.507414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.507424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.507429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.507438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.507442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.507448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.507457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.507462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.507471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.507477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.507482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.507491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.507496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.507502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.507508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.507513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.507518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.507528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.507533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.507540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.507544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.507553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.507557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.507566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.507609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:32.513148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:32.514523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:32.514537Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:32.514539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:32.514542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:32.514548Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2934 [2:7555896787641606711:7319]
2025-09-30T14:58:32.514560Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:32.514573Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:32.514576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:32.514578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:32.514580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:32.514593Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:32.514600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:32.514607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:32.514668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.514675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.514676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.514679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:32.514680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:32.514736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:32.514742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.514751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.514761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.514783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:32.514803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896787641606706:7319]
2025-09-30T14:58:32.514809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896787641606706:7319]
2025-09-30T14:58:32.514811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896787641606706:7319]
2025-09-30T14:58:32.514828Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:32.514840Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:32.514845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731401769:2454], now have 1 active actors on pipe
2025-09-30T14:58:32.514849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:32.514849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731401948:10228], now have 1 active actors on pipe
2025-09-30T14:58:32.514851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:32.514857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:32.514869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:32.514871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:32.514899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896787641606706:7319]
2025-09-30T14:58:32.514911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:32.514937Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:32.514997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.515007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.515033Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:32.515043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:32.515046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:32.515048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:32.515059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:32.515073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:32.515087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:32.515207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.515215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.515227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:32.515646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38678705-54b75ec5-a5f11bda-10e3bb81_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:32.514913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2934
2025-09-30T14:58:32.514944Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2934
2025-09-30T14:58:32.515337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2935 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0
2025-09-30T14:58:32.518258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0] Write session: try to update token
2025-09-30T14:58:32.518273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:32.527134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:32.527154Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:32.527157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:32.527159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:32.527167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896787641606706:7319]
2025-09-30T14:58:32.527172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896787641606706:7319]
2025-09-30T14:58:32.527177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896787641606706:7319]
2025-09-30T14:58:32.527218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:32.527225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.527225Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:32.527228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:32.527234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:32.527239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:32.527389Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:32.532747Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2935 sessionId: src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:32.535533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:32.575675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896787731402065:7727]
2025-09-30T14:58:32.576032Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 2934, pipe: [1:7555896787731402065:7727]
2025-09-30T14:58:32.641861Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:32.642618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.642638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.642695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731402065:7727], now have 1 active actors on pipe
2025-09-30T14:58:32.642968Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:32.643048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:32.643081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896787731402065:7727]
2025-09-30T14:58:32.643107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:32.643111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:32.643180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2935 reason: error at write: Disconnected sessionId: src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0
2025-09-30T14:58:32.643413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2935 sessionId: src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0 is DEAD
2025-09-30T14:58:32.643794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:32.643806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0] Write session will restart in 0.006036s
2025-09-30T14:58:32.643832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0] Write session: Do CDS request
2025-09-30T14:58:32.643840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:32.650787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:32.650866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:32.650882Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2936
2025-09-30T14:58:32.650981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2936 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:32.651007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2936 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:32.651014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2936 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:32.651017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:32.651439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2936 sessionId:  describe result for acl check
2025-09-30T14:58:32.651470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:32.651475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:32.651477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:32.651481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896787731402076:10224] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:32.652016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896787731402076:10224] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:32.653759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896787731402076:10224] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:32.656661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896787731402076:10224] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:32.656675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896787731402076:10224] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:32.656678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896787731402076:10224] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:32.656686Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2936 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:32.668160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:32.673472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:32.673696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:32.673707Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:32.673719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:32.673778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:32.673825Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896787641606989:7298]
2025-09-30T14:58:32.674509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:32.674870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:32.674916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:32.675277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:32.675358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.675365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.675366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.675367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.675368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.675370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.675371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.675373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.675374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.675375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.675377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.675378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.675380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.675381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.675382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.675388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.675399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.675404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.675409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.675414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.675418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.675423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.675427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.675431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.675436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.675440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.675444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.675448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.675453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.675457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.675466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.675475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.675481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.675487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.675492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.675497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.675501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.675507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.675513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.675518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.675523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.675528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.675533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.675538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.675549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.675554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.675560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.675565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.675570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.675575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.675585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.675590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.675595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.675600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.675605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.675610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.675621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.675628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.675633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.675639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.675686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:32.681451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:32.682938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:32.682958Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:32.682961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:32.682964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:32.682972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2935 [2:7555896787641606989:7298]
2025-09-30T14:58:32.682987Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:32.683003Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:32.683011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:32.683015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:32.683017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:32.683034Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:32.683046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:32.683053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:32.683122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.683131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.683134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.683138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:32.683140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:32.683211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:32.683218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.683232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.683264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.683291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:32.683310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731402128:10224], now have 1 active actors on pipe
2025-09-30T14:58:32.683318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731402066:2454], now have 1 active actors on pipe
2025-09-30T14:58:32.683325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896787641606984:7298]
2025-09-30T14:58:32.683327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896787641606984:7298]
2025-09-30T14:58:32.683329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896787641606984:7298]
2025-09-30T14:58:32.683343Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:32.683358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:32.683360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:32.683364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:32.683365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:32.683380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:32.683383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:32.683394Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2935
2025-09-30T14:58:32.683397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2935
2025-09-30T14:58:32.683421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896787641606984:7298]
2025-09-30T14:58:32.683434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:32.683459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:32.683487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.683497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.683526Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:32.683539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:32.683543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:32.683545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:32.683557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:32.683571Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:32.683591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:32.683717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.683723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.683736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:32.683834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2936 partition: 0 MaxSeqNo: 42 sessionId: src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0
2025-09-30T14:58:32.684231Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d2b9e2f-1434872c-8c571c01-3af0e729_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:32.687328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0] Write session: try to update token
2025-09-30T14:58:32.687352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:32.695809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:32.695827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:32.695838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896787641606984:7298]
2025-09-30T14:58:32.695883Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:32.695885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:32.696067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:32.696222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:32.696369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:32.696523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:32.696721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:32.696765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:32.702730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2936 sessionId: src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:32.705449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:32.706549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.706571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.706590Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:32.706593Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:32.706595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:32.706597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:32.706605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896787641606984:7298]
2025-09-30T14:58:32.706609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896787641606984:7298]
2025-09-30T14:58:32.706613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896787641606984:7298]
2025-09-30T14:58:32.706655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:32.706659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:32.706664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.706667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:32.706669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:32.706673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:32.706799Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:32.743091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896787731402364:7727]
2025-09-30T14:58:32.743336Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 2935, pipe: [1:7555896787731402364:7727]
2025-09-30T14:58:32.820713Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:32.821026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:32.821063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731402364:7727], now have 1 active actors on pipe
2025-09-30T14:58:32.821160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:32.821234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896787731402364:7727]
2025-09-30T14:58:32.821276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:32.821327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:32.821338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:32.821356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2936 reason: error at write: Disconnected sessionId: src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0
2025-09-30T14:58:32.821498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2936 sessionId: src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0 is DEAD
2025-09-30T14:58:32.821634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:32.821647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0] Write session will restart in 0.007038s
2025-09-30T14:58:32.821672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0] Write session: Do CDS request
2025-09-30T14:58:32.821678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:32.829769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:32.829899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:32.829915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2937
2025-09-30T14:58:32.830012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2937 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:32.830047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2937 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:32.830052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2937 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:32.830057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:32.830519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2937 sessionId:  describe result for acl check
2025-09-30T14:58:32.830556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:32.830562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:32.830564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:32.830570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896787731402395:10210] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:32.831098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896787731402395:10210] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:32.833758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896787731402395:10210] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:32.837901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896787731402395:10210] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:32.837923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896787731402395:10210] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:32.837926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896787731402395:10210] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:32.837934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2937 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:32.842894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:32.847448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:32.847677Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:32.847689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:32.847701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:32.847756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:32.847798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896787641607302:7294]
2025-09-30T14:58:32.848513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:32.848911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:32.848965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:32.849315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:32.849377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.849384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.849385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.849386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.849388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.849389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.849390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.849392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.849393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.849395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.849396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.849397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.849399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.849400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.849402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.849408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.849419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.849424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.849429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.849433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.849438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.849442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.849446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.849451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.849457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.849461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.849466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.849470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.849475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.849480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.849488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.849496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:32.849503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.849510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:32.849516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.849521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:32.849526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.849533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:32.849537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.849544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:32.849552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.849558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:32.849563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.849575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:32.849580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.849591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:32.849596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.849604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:32.849613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.849620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:32.849626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.849636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.849641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.849647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.849653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.849663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.849667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.849678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:32.849683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.849688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:32.849742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:32.855396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:32.856687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:32.856706Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:32.856709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:32.856714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:32.856721Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2936 [2:7555896787641607302:7294]
2025-09-30T14:58:32.856737Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:32.856753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:32.856757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:32.856761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:32.856764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:32.856795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:32.856802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:32.856817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:32.856886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.856895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.856898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.856901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:32.856904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:32.856974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:32.856983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.856997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:32.857014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:32.857033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:32.857057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731402551:10210], now have 1 active actors on pipe
2025-09-30T14:58:32.857066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731402378:2454], now have 1 active actors on pipe
2025-09-30T14:58:32.857072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896787641607297:7294]
2025-09-30T14:58:32.857075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896787641607297:7294]
2025-09-30T14:58:32.857077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896787641607297:7294]
2025-09-30T14:58:32.857093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:32.857112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:32.857113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:32.857117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:32.857120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:32.857133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:32.857136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:32.857171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896787641607297:7294]
2025-09-30T14:58:32.857183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:32.857190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:32.857205Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2936
2025-09-30T14:58:32.857212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2936
2025-09-30T14:58:32.857284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.857294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.857321Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:32.857332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:32.857336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:32.857338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:32.857351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:32.857366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:32.857388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:32.857542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.857549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.857563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:32.857764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2937 partition: 0 MaxSeqNo: 42 sessionId: src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0
2025-09-30T14:58:32.858137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05e7f6c-3f6f358b-22c17034-b4c7192b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:32.861030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0] Write session: try to update token
2025-09-30T14:58:32.861051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:32.869507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:32.869525Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:32.869528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:32.869530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:32.869539Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896787641607297:7294]
2025-09-30T14:58:32.869544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896787641607297:7294]
2025-09-30T14:58:32.869548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896787641607297:7294]
2025-09-30T14:58:32.869589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:32.869595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:32.869598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:32.869600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:32.869607Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:32.869611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:32.869733Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:32.876038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2937 sessionId: src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:32.878817Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:32.923347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896787731402663:7727]
2025-09-30T14:58:32.923634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 2936, pipe: [1:7555896787731402663:7727]
2025-09-30T14:58:32.982966Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:32.983650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:32.983671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:32.983710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731402663:7727], now have 1 active actors on pipe
2025-09-30T14:58:32.983958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:32.983962Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896787731402663:7727]
2025-09-30T14:58:32.983976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:32.983986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:32.984044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2937 reason: error at write: Disconnected sessionId: src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0
2025-09-30T14:58:32.984234Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:32.984233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2937 sessionId: src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0 is DEAD
2025-09-30T14:58:32.984374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:32.984385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0] Write session will restart in 0.008708s
2025-09-30T14:58:32.984420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0] Write session: Do CDS request
2025-09-30T14:58:32.984426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:32.994790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:32.994888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:32.994908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2938
2025-09-30T14:58:32.995022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2938 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:32.995052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2938 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:32.995057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2938 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:32.995061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:32.995596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2938 sessionId:  describe result for acl check
2025-09-30T14:58:32.995643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:32.995648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:32.995650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:32.995656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896787731402700:10205] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:32.996174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896787731402700:10205] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:32.999228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896787731402700:10205] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:33.002341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896787731402700:10205] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:33.002357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896787731402700:10205] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:33.002361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896787731402700:10205] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:33.002369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2938 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:33.007267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:33.012476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:33.012716Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:33.012726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:33.012738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:33.012810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:33.013190Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896791936574876:7289]
2025-09-30T14:58:33.013911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:33.014348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:33.014415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:33.014810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:33.014886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.014893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.014894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.014895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.014897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.014899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.014900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.014902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.014903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.014904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.014905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.014907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.014908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.014910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.014911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.014918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.014929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.014933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.014937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.014941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.014946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.014951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.014955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.014959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.014965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.014969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.014973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.014977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.014981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.014986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.014996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.015004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.015011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.015017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.015022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.015028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.015033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.015038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.015044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.015049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.015054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.015059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.015068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.015073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.015078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.015084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.015089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.015097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.015102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.015107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.015112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.015118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.015122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.015128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.015133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.015138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.015142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.015148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.015152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.015157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.015199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:33.021083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:33.022465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:33.022481Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:33.022483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:33.022486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:33.022491Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2937 [2:7555896791936574876:7289]
2025-09-30T14:58:33.022505Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:33.022519Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:33.022521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:33.022524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:33.022526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:33.022538Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:33.022543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:33.022549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:33.022598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.022606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.022608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.022615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:33.022617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:33.022680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:33.022688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.022697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.022703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.022713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:33.022725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896791936574871:7289]
2025-09-30T14:58:33.022732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896791936574871:7289]
2025-09-30T14:58:33.022735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896791936574871:7289]
2025-09-30T14:58:33.022745Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:33.022760Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:33.022763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:33.022769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:33.022772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:33.022779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:33.022781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:33.022816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026370166:10205], now have 1 active actors on pipe
2025-09-30T14:58:33.022823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896787731402665:2454], now have 1 active actors on pipe
2025-09-30T14:58:33.022824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896791936574871:7289]
2025-09-30T14:58:33.022830Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:33.022858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:33.022917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2937
2025-09-30T14:58:33.022932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2937
2025-09-30T14:58:33.023043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.023055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.023083Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:33.023091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:33.023100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:33.023102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:33.023112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:33.023139Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:33.023158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:33.023368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.023389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.023414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:33.023523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2938 partition: 0 MaxSeqNo: 42 sessionId: src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0
2025-09-30T14:58:33.023875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce68af86-5bd99c0e-3b55cebf-986882e9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:33.026708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0] Write session: try to update token
2025-09-30T14:58:33.026726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:33.035277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:33.035296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:33.035308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896791936574871:7289]
2025-09-30T14:58:33.035355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:33.035370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:33.035548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:33.035708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:33.035867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:33.036022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:33.036312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:33.036365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:33.042987Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2938 sessionId: src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:33.045870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:33.046286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.046308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.046326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:33.046329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:33.046331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:33.046332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:33.046342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896791936574871:7289]
2025-09-30T14:58:33.046345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896791936574871:7289]
2025-09-30T14:58:33.046348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896791936574871:7289]
2025-09-30T14:58:33.046379Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:33.046385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:33.046390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:33.046390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.046392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:33.046392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:33.046514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:33.084107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896792026370247:7727]
2025-09-30T14:58:33.084398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 2937, pipe: [1:7555896792026370247:7727]
2025-09-30T14:58:33.162414Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:33.163184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:33.163225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026370247:7727], now have 1 active actors on pipe
2025-09-30T14:58:33.163387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:33.163499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:33.163509Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:33.163583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2938 reason: error at write: Disconnected sessionId: src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0
2025-09-30T14:58:33.163787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2938 sessionId: src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0 is DEAD
2025-09-30T14:58:33.163841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:33.163895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896792026370247:7727]
2025-09-30T14:58:33.164211Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:33.164221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0] Write session will restart in 0.009781s
2025-09-30T14:58:33.164246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0] Write session: Do CDS request
2025-09-30T14:58:33.164251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:33.174810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:33.174856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:33.174873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2939
2025-09-30T14:58:33.175059Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2939 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:33.175095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2939 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:33.175104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2939 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:33.175109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:33.175607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2939 sessionId:  describe result for acl check
2025-09-30T14:58:33.175646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:33.175653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:33.175655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:33.175661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896792026370279:10196] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:33.176217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896792026370279:10196] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:33.180377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896792026370279:10196] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:33.183985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896792026370279:10196] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:33.184002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896792026370279:10196] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:33.184005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896792026370279:10196] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:33.184014Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2939 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:33.191706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:33.197300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:33.197992Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:33.198003Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:33.198016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:33.198081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:33.198115Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896791936575158:7277]
2025-09-30T14:58:33.198651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:33.199040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:33.199094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:33.199441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:33.199505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.199519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.199520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.199522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.199523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.199525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.199526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.199527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.199528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.199530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.199531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.199532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.199534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.199535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.199536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.199541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.199553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.199557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.199561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.199565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.199569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.199573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.199577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.199582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.199586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.199590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.199594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.199598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.199602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.199606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.199613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.199621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.199627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.199633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.199638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.199643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.199647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.199653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.199658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.199673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.199677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.199683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.199688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.199693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.199698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.199703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.199717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.199722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.199725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.199730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.199734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.199738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.199742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.199747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.199751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.199756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.199760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.199764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.199779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.199791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.199836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:33.205381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:33.206278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:33.206298Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:33.206301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:33.206305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:33.206312Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2938 [2:7555896791936575158:7277]
2025-09-30T14:58:33.206329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:33.206346Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:33.206349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:33.206352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:33.206354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:33.206372Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:33.206380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:33.206388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:33.206453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.206460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.206462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.206467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:33.206470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:33.206537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:33.206546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.206557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.206568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.206584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:33.206603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026370408:10196], now have 1 active actors on pipe
2025-09-30T14:58:33.206612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026370252:2454], now have 1 active actors on pipe
2025-09-30T14:58:33.206618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896791936575152:7277]
2025-09-30T14:58:33.206621Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896791936575152:7277]
2025-09-30T14:58:33.206624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896791936575152:7277]
2025-09-30T14:58:33.206635Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:33.206647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:33.206649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:33.206652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:33.206653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:33.206670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:33.206678Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:33.206709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896791936575152:7277]
2025-09-30T14:58:33.206722Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:33.206726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:33.206693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2938
2025-09-30T14:58:33.206704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2938
2025-09-30T14:58:33.206968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.206980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.207024Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ad0f54d-778228af-a461efca-eded9fb6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:33.207036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:33.207041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:33.207044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:33.207054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:33.207070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:33.207087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:33.208490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.208516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.208542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:33.208674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2939 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ad0f54d-778228af-a461efca-eded9fb6_0
2025-09-30T14:58:33.209176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f93064-8b1afe24-358d51ed-c79f34ac_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ad0f54d-778228af-a461efca-eded9fb6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:33.212178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad0f54d-778228af-a461efca-eded9fb6_0] Write session: try to update token
2025-09-30T14:58:33.212199Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad0f54d-778228af-a461efca-eded9fb6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:33.219751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:33.219780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:33.219791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896791936575152:7277]
2025-09-30T14:58:33.219848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:33.219863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:33.220051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:33.220218Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:33.220384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:33.220538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:33.220754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:33.220827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:33.231844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:33.231865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:33.231868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:33.231870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:33.231882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896791936575152:7277]
2025-09-30T14:58:33.231887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896791936575152:7277]
2025-09-30T14:58:33.231891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896791936575152:7277]
2025-09-30T14:58:33.231937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:33.231950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.231957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:33.231962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:33.231978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:33.231985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:33.232121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:33.236155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2939 sessionId: src_id|8ad0f54d-778228af-a461efca-eded9fb6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:33.239103Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:33.264280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896792026370544:7727]
2025-09-30T14:58:33.264614Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 2938, pipe: [1:7555896792026370544:7727]
2025-09-30T14:58:33.347341Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:33.347927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.347938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.347960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026370544:7727], now have 1 active actors on pipe
2025-09-30T14:58:33.348329Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896792026370544:7727]
2025-09-30T14:58:33.348383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:33.348386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:33.348448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2939 reason: error at write: Disconnected sessionId: src_id|8ad0f54d-778228af-a461efca-eded9fb6_0
2025-09-30T14:58:33.348242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:33.348655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2939 sessionId: src_id|8ad0f54d-778228af-a461efca-eded9fb6_0 is DEAD
2025-09-30T14:58:33.348851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:33.351443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad0f54d-778228af-a461efca-eded9fb6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:33.351456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad0f54d-778228af-a461efca-eded9fb6_0] Write session will restart in 0.005823s
2025-09-30T14:58:33.351481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad0f54d-778228af-a461efca-eded9fb6_0] Write session: Do CDS request
2025-09-30T14:58:33.351490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad0f54d-778228af-a461efca-eded9fb6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:33.358812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad0f54d-778228af-a461efca-eded9fb6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:33.358925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:33.358950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2940
2025-09-30T14:58:33.359109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2940 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:33.359167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2940 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:33.359177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2940 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:33.359181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:33.359642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2940 sessionId:  describe result for acl check
2025-09-30T14:58:33.359686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:33.359694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:33.359700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:33.359706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896792026370577:10187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:33.360275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896792026370577:10187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:33.367189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896792026370577:10187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:33.370739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896792026370577:10187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:33.370760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896792026370577:10187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:33.370763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896792026370577:10187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:33.370772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2940 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:33.378138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:33.384037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:33.384795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:33.384813Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:33.384830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:33.384917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:33.384959Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896791936575451:7280]
2025-09-30T14:58:33.385584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:33.386068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:33.386132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:33.386461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:33.386544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.386546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.386547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.386548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.386550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.386552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.386553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.386555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.386556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.386557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.386559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.386560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.386561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.386562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.386563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.386569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.386578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.386582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.386586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.386590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.386595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.386599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.386602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.386606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.386613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.386616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.386620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.386624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.386627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.386630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.386639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.386646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.386652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.386658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.386662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.386667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.386672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.386677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.386685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.386690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.386694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.386700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.386704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.386708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.386713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.386718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.386725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.386743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.386747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.386751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.386755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.386760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.386764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.386768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.386773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.386777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.386782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.386786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.386790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.386795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.386832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:33.393015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:33.393917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:33.393935Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:33.393938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:33.393943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:33.393951Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2939 [2:7555896791936575451:7280]
2025-09-30T14:58:33.393970Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:33.393988Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:33.393997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:33.394001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:33.394004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:33.394020Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:33.394028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:33.394041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:33.394111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.394123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.394125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.394128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:33.394132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:33.394214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:33.394223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.394239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.394256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.394278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:33.394302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026370552:2454], now have 1 active actors on pipe
2025-09-30T14:58:33.394309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026370774:10187], now have 1 active actors on pipe
2025-09-30T14:58:33.394316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896791936575446:7280]
2025-09-30T14:58:33.394322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896791936575446:7280]
2025-09-30T14:58:33.394325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896791936575446:7280]
2025-09-30T14:58:33.394340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:33.394358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:33.394379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:33.394386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:33.394408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:33.394419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:33.394423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896791936575446:7280]
2025-09-30T14:58:33.394426Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:33.394422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:33.394449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:33.394403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2939
2025-09-30T14:58:33.394406Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2939
2025-09-30T14:58:33.394596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.394609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.394649Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|10fe3451-30b6e11a-bba9b018-3603b63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:33.394662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:33.394670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:33.394672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:33.394685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:33.394702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:33.394730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:33.395070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.395081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.395112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:33.395237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2940 partition: 0 MaxSeqNo: 42 sessionId: src_id|10fe3451-30b6e11a-bba9b018-3603b63_0
2025-09-30T14:58:33.395656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ad0f54d-778228af-a461efca-eded9fb6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|10fe3451-30b6e11a-bba9b018-3603b63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:33.398872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10fe3451-30b6e11a-bba9b018-3603b63_0] Write session: try to update token
2025-09-30T14:58:33.398898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10fe3451-30b6e11a-bba9b018-3603b63_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:33.408157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:33.408183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:33.408195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896791936575446:7280]
2025-09-30T14:58:33.408248Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:33.408257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:33.408455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:33.408628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:33.408817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:33.408986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:33.409214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:33.409261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:33.424754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:33.424796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:33.424799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:33.424801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:33.424812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896791936575446:7280]
2025-09-30T14:58:33.424816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896791936575446:7280]
2025-09-30T14:58:33.424821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896791936575446:7280]
2025-09-30T14:58:33.424868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:33.424876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.424880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:33.424950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:33.424958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:33.424962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:33.425039Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:33.430652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2940 sessionId: src_id|10fe3451-30b6e11a-bba9b018-3603b63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:33.433706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:33.448365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896792026370841:7727]
2025-09-30T14:58:33.451732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 2939, pipe: [1:7555896792026370841:7727]
2025-09-30T14:58:33.548029Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:33.548925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.548939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.548960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026370841:7727], now have 1 active actors on pipe
2025-09-30T14:58:33.549239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896792026370841:7727]
2025-09-30T14:58:33.549260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:33.549207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:33.549281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:33.549366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2940 reason: status is not ok: tablet will be restarted right now sessionId: src_id|10fe3451-30b6e11a-bba9b018-3603b63_0
2025-09-30T14:58:33.549542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2940 sessionId: src_id|10fe3451-30b6e11a-bba9b018-3603b63_0 is DEAD
2025-09-30T14:58:33.549702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fe3451-30b6e11a-bba9b018-3603b63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:33.549711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fe3451-30b6e11a-bba9b018-3603b63_0] Write session will restart in 0.005256s
2025-09-30T14:58:33.549736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fe3451-30b6e11a-bba9b018-3603b63_0] Write session: Do CDS request
2025-09-30T14:58:33.549741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fe3451-30b6e11a-bba9b018-3603b63_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:33.555802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|10fe3451-30b6e11a-bba9b018-3603b63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:33.555844Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:33.555861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2941
2025-09-30T14:58:33.556044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2941 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:33.556076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2941 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:33.556086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2941 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:33.556089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:33.556555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2941 sessionId:  describe result for acl check
2025-09-30T14:58:33.556603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:33.556610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:33.556612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:33.556618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896792026370869:10179] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:33.557130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896792026370869:10179] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:33.558838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896792026370869:10179] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:33.561764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896792026370869:10179] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:33.561783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896792026370869:10179] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:33.561786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896792026370869:10179] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:33.561795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2941 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:33.575822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:33.581813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:33.582057Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:33.582070Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:33.582081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:33.582136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:33.582177Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896791936575732:7274]
2025-09-30T14:58:33.582882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:33.583293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:33.583343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:33.583686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:33.583750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.583756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.583757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.583759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.583760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.583762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.583763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.583764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.583766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.583767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.583768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.583770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.583771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.583773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.583774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.583780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.583791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.583796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.583801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.583806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.583810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.583815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.583819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.583824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.583831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.583835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.583839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.583842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.583846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.583851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.583859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.583874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.583885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.583891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.583901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.583907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.583918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.583923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.583928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.583934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.583938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.583944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.583949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.583960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.583965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.583975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.583981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.583991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.583997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.584007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.584013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.584023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.584028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.584034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.584044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.584051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.584061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.584067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.584078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.584083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.584136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:33.589920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:33.590786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:33.590805Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:33.590809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:33.590813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:33.590820Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2940 [2:7555896791936575732:7274]
2025-09-30T14:58:33.590841Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:33.590858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:33.590861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:33.590866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:33.590868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:33.590885Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:33.590892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:33.590906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:33.590971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.590979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.590982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.590986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:33.590989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:33.591060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:33.591068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.591083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.591102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.591237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2940
2025-09-30T14:58:33.591259Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2940
2025-09-30T14:58:33.591122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:33.591150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026370938:10179], now have 1 active actors on pipe
2025-09-30T14:58:33.591155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026370844:2454], now have 1 active actors on pipe
2025-09-30T14:58:33.591162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896791936575727:7274]
2025-09-30T14:58:33.591165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896791936575727:7274]
2025-09-30T14:58:33.591167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896791936575727:7274]
2025-09-30T14:58:33.591180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:33.591194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:33.591208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:33.591210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:33.591211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:33.591214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:33.591214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:33.591267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896791936575727:7274]
2025-09-30T14:58:33.591271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:33.591279Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:33.591315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.591320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.591349Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:33.591355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:33.591359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:33.591362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:33.591372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:33.591380Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:33.591394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:33.591622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.591636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.591660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:33.591756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2941 partition: 0 MaxSeqNo: 42 sessionId: src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0
2025-09-30T14:58:33.592142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|10fe3451-30b6e11a-bba9b018-3603b63_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:33.594937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0] Write session: try to update token
2025-09-30T14:58:33.594955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:33.604050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:33.604074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:33.604076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:33.604079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:33.604093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896791936575727:7274]
2025-09-30T14:58:33.604097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896791936575727:7274]
2025-09-30T14:58:33.604102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896791936575727:7274]
2025-09-30T14:58:33.604146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:33.604153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.604156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:33.604300Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:33.607409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:33.607431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:33.607436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:33.612031Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2941 sessionId: src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:33.614925Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:33.651380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896792026371145:7727]
2025-09-30T14:58:33.655376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 2940, pipe: [1:7555896792026371145:7727]
2025-09-30T14:58:33.741919Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:33.742523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.742541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.742589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026371145:7727], now have 1 active actors on pipe
2025-09-30T14:58:33.742806Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:33.743434Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:33.743446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0] Write session will restart in 0.009384s
2025-09-30T14:58:33.743471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0] Write session: Do CDS request
2025-09-30T14:58:33.742948Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:33.743000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896792026371145:7727]
2025-09-30T14:58:33.743020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:33.743022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:33.743081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2941 reason: error at write: Disconnected sessionId: src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0
2025-09-30T14:58:33.743292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2941 sessionId: src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0 is DEAD
2025-09-30T14:58:33.743477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:33.756358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:33.759565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:33.759581Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2942
2025-09-30T14:58:33.759766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2942 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:33.759786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2942 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:33.759789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2942 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:33.759792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:33.761505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2942 sessionId:  describe result for acl check
2025-09-30T14:58:33.761545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:33.761548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:33.761549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:33.761555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896792026371177:10167] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:33.761966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896792026371177:10167] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:33.778839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896792026371177:10167] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:33.782989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896792026371177:10167] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:33.783010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896792026371177:10167] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:33.783013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896792026371177:10167] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:33.783022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2942 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:33.821075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:33.830835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:33.831385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:33.831398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:33.831414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:33.831499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:33.831537Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896791936576052:7267]
2025-09-30T14:58:33.832220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:33.835012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:33.835075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:33.835489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:33.835561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.835562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.835563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.835565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.835567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.835569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.835570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.835572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.835573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.835575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.835576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.835577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.835579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.835580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.835581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.835588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.835598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.835602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.835607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.835611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.835615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.835619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.835624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.835628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.835632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.835636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.835641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.835645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.835649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.835653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.835661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.835669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:33.835675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.835680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:33.835685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.835691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:33.835696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.835701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:33.835706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.835711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:33.835715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.835721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:33.835725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.835731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:33.835736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.835741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:33.835745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.835751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:33.835756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.835761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:33.835767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.835772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.835777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.835782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.835790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.835795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.835800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.835805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:33.835812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.835818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:33.835862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:33.843378Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896792026371457:7727]
2025-09-30T14:58:33.843385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:33.844899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2941
2025-09-30T14:58:33.844939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2941
2025-09-30T14:58:33.844965Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 2941, pipe: [1:7555896792026371457:7727]
2025-09-30T14:58:33.845902Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2942 partition: 0 MaxSeqNo: 42 sessionId: src_id|38815c26-e5f841c8-a292bd11-4eec5244_0
2025-09-30T14:58:33.844326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:33.844341Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:33.844344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:33.844349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:33.844356Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2941 [2:7555896791936576052:7267]
2025-09-30T14:58:33.844374Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:33.844390Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:33.844394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:33.844398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:33.844400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:33.844417Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:33.844424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:33.844431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:33.844504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.844506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.844512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.844516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:33.844519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:33.844585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:33.844588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.844602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:33.844616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:33.844635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:33.844652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896791936576046:7267]
2025-09-30T14:58:33.844655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896791936576046:7267]
2025-09-30T14:58:33.844657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896791936576046:7267]
2025-09-30T14:58:33.844666Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:33.844676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:33.844680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:33.844682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026371234:10167], now have 1 active actors on pipe
2025-09-30T14:58:33.844683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:33.844687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026371148:2454], now have 1 active actors on pipe
2025-09-30T14:58:33.844693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026371457:7727], now have 1 active actors on pipe
2025-09-30T14:58:33.844699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:33.844715Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:33.844719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:33.844756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896791936576046:7267]
2025-09-30T14:58:33.844764Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:33.845067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:33.845264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.845271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.845295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38815c26-e5f841c8-a292bd11-4eec5244_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:33.845302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:33.845305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:33.845306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:33.845314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:33.847505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0e0945e-e13524bc-c2632191-5b5ec2cf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|38815c26-e5f841c8-a292bd11-4eec5244_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:33.845323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:33.845338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:33.845771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.845778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.845801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:33.850545Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38815c26-e5f841c8-a292bd11-4eec5244_0] Write session: try to update token
2025-09-30T14:58:33.850566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38815c26-e5f841c8-a292bd11-4eec5244_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:33.857936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:33.857956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:33.857959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:33.857961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:33.857974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896791936576046:7267]
2025-09-30T14:58:33.857978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896791936576046:7267]
2025-09-30T14:58:33.857982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896791936576046:7267]
2025-09-30T14:58:33.858023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:33.858030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:33.858033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:33.858191Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:33.861496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:33.861516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:33.861520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:33.884335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2942 sessionId: src_id|38815c26-e5f841c8-a292bd11-4eec5244_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:33.886966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:33.983696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:33.984368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:33.984387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:33.984728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:33.984732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:33.984737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:33.984809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896792026371457:7727]
2025-09-30T14:58:33.984864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2942 reason: error at write: Disconnected sessionId: src_id|38815c26-e5f841c8-a292bd11-4eec5244_0
2025-09-30T14:58:33.985096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2942 sessionId: src_id|38815c26-e5f841c8-a292bd11-4eec5244_0 is DEAD
2025-09-30T14:58:33.985268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38815c26-e5f841c8-a292bd11-4eec5244_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:33.985279Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38815c26-e5f841c8-a292bd11-4eec5244_0] Write session will restart in 0.008256s
2025-09-30T14:58:33.985303Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38815c26-e5f841c8-a292bd11-4eec5244_0] Write session: Do CDS request
2025-09-30T14:58:33.985308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38815c26-e5f841c8-a292bd11-4eec5244_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:33.985963Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:33.994805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38815c26-e5f841c8-a292bd11-4eec5244_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:33.994859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:33.994876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2943
2025-09-30T14:58:33.995046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2943 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:33.995098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2943 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:33.995109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2943 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:33.995114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:33.995613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2943 sessionId:  describe result for acl check
2025-09-30T14:58:33.995649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:33.995651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:33.995653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:33.995669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896792026371493:10155] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:33.996227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896792026371493:10155] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:34.000073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896792026371493:10155] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:34.008141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896792026371493:10155] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:34.008162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896792026371493:10155] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:34.008165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896792026371493:10155] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:34.008174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2943 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:34.009468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:34.015158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:34.015433Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:34.015448Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:34.015461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:34.015524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:34.015956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896796231543631:7250]
2025-09-30T14:58:34.016661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:34.017109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:34.017159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:34.017507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:34.017576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.017586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.017587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.017588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.017590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.017591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.017593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.017594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.017596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.017597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.017599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.017600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.017601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.017603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.017604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.017611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.017622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.017627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.017632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.017637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.017642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.017646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.017650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.017655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.017660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.017664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.017669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.017674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.017678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.017696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.017706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.017720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.017727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.017734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.017745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.017751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.017761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.017767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.017781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.017791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.017806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.017817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.017822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.017833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.017838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.017848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.017853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.017859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.017869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.017876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.017884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.017891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.017900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.017905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.017915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.017921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.017926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.017932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.017938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.017958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.018009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:34.023820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:34.025272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:34.025291Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:34.025293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:34.025297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:34.025308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2942 [2:7555896796231543631:7250]
2025-09-30T14:58:34.025324Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:34.025341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:34.025344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:34.025349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:34.025351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:34.025368Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:34.025376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:34.025392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:34.025458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.025467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.025470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.025473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:34.025477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:34.025549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:34.025557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.025573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.025590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.025614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:34.025632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321339038:10155], now have 1 active actors on pipe
2025-09-30T14:58:34.025636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896792026371468:2454], now have 1 active actors on pipe
2025-09-30T14:58:34.025643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896796231543626:7250]
2025-09-30T14:58:34.025645Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896796231543626:7250]
2025-09-30T14:58:34.025647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896796231543626:7250]
2025-09-30T14:58:34.025656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:34.025668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:34.025679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:34.025685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:34.025685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:34.025687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:34.025689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:34.025723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896796231543626:7250]
2025-09-30T14:58:34.025727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:34.025749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:34.025770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.025774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.025799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|171504dc-c1a82618-42b5b773-964c6461_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:34.025807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:34.025812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:34.025815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:34.025825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:34.025835Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:34.025851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:34.026167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.026177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.026190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:34.026760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38815c26-e5f841c8-a292bd11-4eec5244_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|171504dc-c1a82618-42b5b773-964c6461_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:34.025700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2942
2025-09-30T14:58:34.025710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2942
2025-09-30T14:58:34.026303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2943 partition: 0 MaxSeqNo: 42 sessionId: src_id|171504dc-c1a82618-42b5b773-964c6461_0
2025-09-30T14:58:34.030011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|171504dc-c1a82618-42b5b773-964c6461_0] Write session: try to update token
2025-09-30T14:58:34.030034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|171504dc-c1a82618-42b5b773-964c6461_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:34.041641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:34.041663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:34.041675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896796231543626:7250]
2025-09-30T14:58:34.041733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:34.041806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:34.041915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:34.042091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:34.042243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:34.042388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:34.042588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:34.042624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:34.060721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2943 sessionId: src_id|171504dc-c1a82618-42b5b773-964c6461_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:34.065417Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:34.065438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:34.065440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:34.065442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:34.065452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896796231543626:7250]
2025-09-30T14:58:34.065457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896796231543626:7250]
2025-09-30T14:58:34.065461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896796231543626:7250]
2025-09-30T14:58:34.065504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:34.065511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.065514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:34.065662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:34.068890Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:34.068914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:34.068918Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:34.069092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:34.085062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896796321339054:7727]
2025-09-30T14:58:34.085478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 2942, pipe: [1:7555896796321339054:7727]
2025-09-30T14:58:34.204726Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:34.205305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.205324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.205345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321339054:7727], now have 1 active actors on pipe
2025-09-30T14:58:34.205591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896796321339054:7727]
2025-09-30T14:58:34.205603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:34.205607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:34.205626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:34.205669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2943 reason: error at write: Disconnected sessionId: src_id|171504dc-c1a82618-42b5b773-964c6461_0
2025-09-30T14:58:34.205847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2943 sessionId: src_id|171504dc-c1a82618-42b5b773-964c6461_0 is DEAD
2025-09-30T14:58:34.205953Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:34.205977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|171504dc-c1a82618-42b5b773-964c6461_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:34.205999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|171504dc-c1a82618-42b5b773-964c6461_0] Write session will restart in 0.009427s
2025-09-30T14:58:34.206024Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|171504dc-c1a82618-42b5b773-964c6461_0] Write session: Do CDS request
2025-09-30T14:58:34.206033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|171504dc-c1a82618-42b5b773-964c6461_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:34.216839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|171504dc-c1a82618-42b5b773-964c6461_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:34.216958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:34.216978Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2944
2025-09-30T14:58:34.217119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2944 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:34.217153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2944 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:34.217163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2944 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:34.217167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:34.217737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2944 sessionId:  describe result for acl check
2025-09-30T14:58:34.217780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:34.217781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:34.217783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:34.217790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896796321339112:10151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:34.218503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896796321339112:10151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:34.220984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896796321339112:10151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:34.223585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896796321339112:10151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:34.223602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896796321339112:10151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:34.223605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896796321339112:10151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:34.223614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2944 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:34.233658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:34.235129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:34.235362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:34.235380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:34.235394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:34.235454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:34.235506Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896796231543919:7247]
2025-09-30T14:58:34.236162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:34.236516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:34.236568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:34.236958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:34.237033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.237039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.237040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.237041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.237042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.237044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.237046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.237046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.237048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.237049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.237050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.237051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.237052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.237054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.237055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.237061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.237071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.237076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.237079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.237083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.237087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.237091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.237094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.237099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.237103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.237107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.237111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.237115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.237119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.237123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.237132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.237140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.237147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.237152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.237157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.237163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.237167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.237173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.237181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.237186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.237190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.237195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.237200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.237205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.237210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.237215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.237221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.237229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.237234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.237239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.237245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.237251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.237255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.237261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.237266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.237271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.237277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.237283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.237287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.237293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.237342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:34.243691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:34.245199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:34.245215Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:34.245218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:34.245222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:34.245229Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2943 [2:7555896796231543919:7247]
2025-09-30T14:58:34.245246Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:34.245264Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:34.245269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:34.245272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:34.245274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:34.245291Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:34.245297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:34.245314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:34.245377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.245385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.245387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.245390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:34.245392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:34.245455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:34.245463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.245476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.245486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.245502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:34.245524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896796231543914:7247]
2025-09-30T14:58:34.245527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896796231543914:7247]
2025-09-30T14:58:34.245529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896796231543914:7247]
2025-09-30T14:58:34.245539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:34.245553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:34.245568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:34.245575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:34.245615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896796231543914:7247]
2025-09-30T14:58:34.245617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:34.251793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:34.251815Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:34.251817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:34.251826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:34.252217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321339354:10151], now have 1 active actors on pipe
2025-09-30T14:58:34.252227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321339059:2454], now have 1 active actors on pipe
2025-09-30T14:58:34.255524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2943
2025-09-30T14:58:34.255569Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2943
2025-09-30T14:58:34.255826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.255849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.255890Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:34.255903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:34.255909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:34.255913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:34.255927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:34.255946Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:34.255974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:34.256541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2944 partition: 0 MaxSeqNo: 42 sessionId: src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0
2025-09-30T14:58:34.256970Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|171504dc-c1a82618-42b5b773-964c6461_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:34.256355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.256371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.256394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:34.260197Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0] Write session: try to update token
2025-09-30T14:58:34.260218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:34.269890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:34.269921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:34.269923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:34.269925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:34.269935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896796231543914:7247]
2025-09-30T14:58:34.269940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896796231543914:7247]
2025-09-30T14:58:34.269945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896796231543914:7247]
2025-09-30T14:58:34.269990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:34.269998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.270001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:34.270006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:34.270013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:34.270017Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:34.270155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:34.281121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2944 sessionId: src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:34.284158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:34.305831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896796321339585:7727]
2025-09-30T14:58:34.306172Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 2943, pipe: [1:7555896796321339585:7727]
2025-09-30T14:58:34.391727Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:34.392083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.392099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.392119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321339585:7727], now have 1 active actors on pipe
2025-09-30T14:58:34.392478Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:34.392540Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:34.392558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:34.392624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2944 reason: error at write: Disconnected sessionId: src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0
2025-09-30T14:58:34.392812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896796321339585:7727]
2025-09-30T14:58:34.392826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2944 sessionId: src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0 is DEAD
2025-09-30T14:58:34.392832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:34.393263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:34.393276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0] Write session will restart in 0.009158s
2025-09-30T14:58:34.393302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0] Write session: Do CDS request
2025-09-30T14:58:34.393312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:34.403795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:34.403994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:34.404011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2945
2025-09-30T14:58:34.407622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2945 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:34.407679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2945 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:34.407686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2945 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:34.407692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:34.408219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2945 sessionId:  describe result for acl check
2025-09-30T14:58:34.408257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:34.408263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:34.408265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:34.408272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896796321339745:10141] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:34.408858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896796321339745:10141] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:34.411672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896796321339745:10141] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:34.414991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896796321339745:10141] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:34.415012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896796321339745:10141] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:34.415070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896796321339745:10141] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:34.415079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2945 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:34.427945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:34.428634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:34.428838Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:34.428842Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:34.428854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:34.428906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:34.428945Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896796231544216:7246]
2025-09-30T14:58:34.429686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:34.430184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:34.430235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:34.430608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:34.430673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.430680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.430681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.430682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.430684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.430686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.430687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.430688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.430690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.430692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.430693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.430695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.430696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.430698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.430699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.430705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.430717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.430722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.430726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.430731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.430736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.430740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.430745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.430749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.430754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.430759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.430763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.430768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.430772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.430777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.430786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.430794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.430800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.430806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.430823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.430829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.430834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.430840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.430851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.430857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.430862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.430869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.430878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.430884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.430894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.430900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.430911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.430918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.430928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.430933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.430939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.430950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.430956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.430966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.430971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.430982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.430986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.430993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.430999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.431009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.431061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:34.438437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:34.439357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:34.439365Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:34.439369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:34.439373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:34.439382Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2944 [2:7555896796231544216:7246]
2025-09-30T14:58:34.439400Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:34.439418Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:34.439421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:34.439425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:34.439428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:34.439447Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:34.439455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:34.439464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:34.439528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.439531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.439533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.439538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:34.439541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:34.439618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:34.439621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.439637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.439651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.439671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:34.439689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896796231544211:7246]
2025-09-30T14:58:34.439692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896796231544211:7246]
2025-09-30T14:58:34.439695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896796231544211:7246]
2025-09-30T14:58:34.439709Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:34.439723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:34.439740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:34.439744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:34.439783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896796231544211:7246]
2025-09-30T14:58:34.439786Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:34.440119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:34.440128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:34.440130Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:34.440136Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:34.440458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321339914:10141], now have 1 active actors on pipe
2025-09-30T14:58:34.440465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321339591:2454], now have 1 active actors on pipe
2025-09-30T14:58:34.440468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2944
2025-09-30T14:58:34.440469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2944
2025-09-30T14:58:34.440961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.440972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.441001Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:34.441010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:34.441015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:34.441018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:34.441030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:34.441042Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:34.441060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:34.441617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.441627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.441646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:34.441792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2945 partition: 0 MaxSeqNo: 42 sessionId: src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0
2025-09-30T14:58:34.442192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8566910-795ddb6d-15a9fb64-e975d6bf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:34.445058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0] Write session: try to update token
2025-09-30T14:58:34.445080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:34.455211Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:34.455234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:34.455236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:34.455239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:34.455269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896796231544211:7246]
2025-09-30T14:58:34.455274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896796231544211:7246]
2025-09-30T14:58:34.455278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896796231544211:7246]
2025-09-30T14:58:34.455324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:34.455336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.455339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:34.455342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:34.455349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:34.455356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:34.455495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:34.470503Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2945 sessionId: src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:34.473447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:34.491582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896796321340112:7727]
2025-09-30T14:58:34.492047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 2944, pipe: [1:7555896796321340112:7727]
2025-09-30T14:58:34.582633Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:34.583316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.583337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.583358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321340112:7727], now have 1 active actors on pipe
2025-09-30T14:58:34.583607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:34.583683Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896796321340112:7727]
2025-09-30T14:58:34.583735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:34.583737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:34.583797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2945 reason: error at write: Disconnected sessionId: src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0
2025-09-30T14:58:34.583800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:34.583965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2945 sessionId: src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0 is DEAD
2025-09-30T14:58:34.584442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:34.584451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0] Write session will restart in 0.007735s
2025-09-30T14:58:34.584473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0] Write session: Do CDS request
2025-09-30T14:58:34.584483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:34.595860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:34.596091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:34.596108Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2946
2025-09-30T14:58:34.599378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2946 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:34.599429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2946 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:34.599434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2946 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:34.599440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:34.599999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2946 sessionId:  describe result for acl check
2025-09-30T14:58:34.600034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:34.600036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:34.600038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:34.600043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896796321340141:10132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:34.600601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896796321340141:10132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:34.615783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896796321340141:10132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:34.621669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896796321340141:10132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:34.621692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896796321340141:10132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:34.621697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896796321340141:10132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:34.621705Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2946 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:34.634940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:34.635526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:34.635730Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:34.635742Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:34.635752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:34.635805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:34.635858Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896796231544504:7237]
2025-09-30T14:58:34.636544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:34.636900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:34.636948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:34.637264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:34.637317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.637323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.637323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.637324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.637325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.637326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.637327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.637327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.637328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.637329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.637330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.637330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.637331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.637332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.637333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.637336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.637344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.637347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.637349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.637352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.637354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.637357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.637359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.637361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.637365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.637368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.637370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.637373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.637375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.637377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.637383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.637389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.637393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.637396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.637399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.637403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.637406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.637409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.637412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.637414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.637417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.637420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.637424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.637427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.637430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.637435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.637440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.637445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.637449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.637454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.637463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.637468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.637472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.637474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.637477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.637480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.637483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.637486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.637489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.637492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.637537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:34.643302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:34.645045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:34.645068Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:34.645071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:34.645075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:34.645081Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2945 [2:7555896796231544504:7237]
2025-09-30T14:58:34.645099Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:34.645118Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:34.645121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:34.645124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:34.645126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:34.645144Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:34.645159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:34.645165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:34.645243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.645252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.645253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.645256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:34.645259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:34.645333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:34.645341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.645356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.645366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.645381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:34.645398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896796231544499:7237]
2025-09-30T14:58:34.645401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896796231544499:7237]
2025-09-30T14:58:34.645403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896796231544499:7237]
2025-09-30T14:58:34.645411Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:34.645425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:34.645424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:34.645429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:34.645431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:34.645439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:34.645441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:34.645452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321340322:10132], now have 1 active actors on pipe
2025-09-30T14:58:34.645455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321340127:2454], now have 1 active actors on pipe
2025-09-30T14:58:34.645489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896796231544499:7237]
2025-09-30T14:58:34.645497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:34.645511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:34.645538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2945
2025-09-30T14:58:34.645578Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2945
2025-09-30T14:58:34.645690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.645706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.645750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:34.645775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:34.645787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:34.645790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:34.645802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:34.645819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:34.645854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:34.646150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.646161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.646183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:34.646340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2946 partition: 0 MaxSeqNo: 42 sessionId: src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0
2025-09-30T14:58:34.646748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3849e28e-167d05c9-54e7a1ba-d09b4636_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:34.649886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0] Write session: try to update token
2025-09-30T14:58:34.649909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:34.658217Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:34.658238Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:34.658248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896796231544499:7237]
2025-09-30T14:58:34.658309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:34.658312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:34.658499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:34.658659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:34.658812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:34.658973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:34.659181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:34.659221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:34.669372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2946 sessionId: src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:34.670716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:34.670735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:34.670738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:34.670740Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:34.670750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896796231544499:7237]
2025-09-30T14:58:34.670754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896796231544499:7237]
2025-09-30T14:58:34.670758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896796231544499:7237]
2025-09-30T14:58:34.670798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:34.670809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.670814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:34.670822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:34.670838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:34.670842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:34.670958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:34.672173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:34.684126Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896796321340650:7727]
2025-09-30T14:58:34.684451Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 2945, pipe: [1:7555896796321340650:7727]
2025-09-30T14:58:34.788916Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:34.789858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.789868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.789890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321340650:7727], now have 1 active actors on pipe
2025-09-30T14:58:34.790136Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:34.790137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896796321340650:7727]
2025-09-30T14:58:34.790149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:34.790184Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:34.790187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:34.790249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2946 reason: error at write: Disconnected sessionId: src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0
2025-09-30T14:58:34.790447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2946 sessionId: src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0 is DEAD
2025-09-30T14:58:34.790781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:34.790791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0] Write session will restart in 0.008720s
2025-09-30T14:58:34.790815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0] Write session: Do CDS request
2025-09-30T14:58:34.790824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:34.801832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:34.802624Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:34.802643Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2947
2025-09-30T14:58:34.802860Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2947 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:34.802890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2947 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:34.802895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2947 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:34.802899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:34.803692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2947 sessionId:  describe result for acl check
2025-09-30T14:58:34.803732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:34.803735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:34.803737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:34.803746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896796321340742:10126] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:34.804297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896796321340742:10126] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:34.807630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896796321340742:10126] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:34.812446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896796321340742:10126] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:34.812461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896796321340742:10126] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:34.812464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896796321340742:10126] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:34.812473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2947 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:34.838017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:34.840041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:34.840336Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:34.840340Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:34.840351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:34.840404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:34.840437Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896796231544804:7233]
2025-09-30T14:58:34.841110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:34.841538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:34.841595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:34.841926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:34.841974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.841975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.841976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.841977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.841978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.841979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.841991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.841992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.841994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.841995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.841996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.841997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.841998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.841999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.842000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.842005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.842013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.842017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.842023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.842027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.842031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.842034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.842038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.842041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.842045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.842049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.842053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.842056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.842060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.842063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.842068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.842075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:34.842081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.842087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:34.842091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.842095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:34.842099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.842103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:34.842108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.842112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:34.842116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.842121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:34.842125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.842129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:34.842133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.842137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:34.842145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.842149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:34.842153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.842161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:34.842165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.842169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.842173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.842177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.842181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.842185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.842189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.842193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:34.842198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.842203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:34.842250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:34.848661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:34.849962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:34.849978Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:34.849981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:34.849985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:34.849991Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2946 [2:7555896796231544804:7233]
2025-09-30T14:58:34.850007Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:34.850021Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:34.850025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:34.850028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:34.850032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:34.850048Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:34.850057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:34.850063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:34.850124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.850131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.850132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.850135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:34.850138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:34.850204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:34.850212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.850225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:34.850242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:34.850265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:34.850286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896796231544798:7233]
2025-09-30T14:58:34.850293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896796231544798:7233]
2025-09-30T14:58:34.850294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896796231544798:7233]
2025-09-30T14:58:34.850305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:34.850315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:34.850318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:34.850326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:34.850328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:34.850334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:34.850336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:34.850346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321340654:2454], now have 1 active actors on pipe
2025-09-30T14:58:34.850357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321340881:10126], now have 1 active actors on pipe
2025-09-30T14:58:34.850390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896796231544798:7233]
2025-09-30T14:58:34.850397Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:34.850406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:34.850603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2946
2025-09-30T14:58:34.850652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2946
2025-09-30T14:58:34.850684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.850696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.850719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:34.850733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:34.850741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:34.850743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:34.850753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:34.850767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:34.850787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:34.850937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.850942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.850963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:34.851073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2947 partition: 0 MaxSeqNo: 42 sessionId: src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0
2025-09-30T14:58:34.851438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d4ac0bc-79868b98-2265a652-4eed590d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:34.854259Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0] Write session: try to update token
2025-09-30T14:58:34.854276Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:34.863105Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:34.863125Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:34.863134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896796231544798:7233]
2025-09-30T14:58:34.863177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:34.863375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:34.863523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:34.863671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:34.863810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:34.864006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:34.864043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:34.864178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:34.875063Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:34.875082Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:34.875084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:34.875085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:34.875094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896796231544798:7233]
2025-09-30T14:58:34.875099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896796231544798:7233]
2025-09-30T14:58:34.875103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896796231544798:7233]
2025-09-30T14:58:34.875141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:34.875148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:34.875150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:34.875303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:34.875319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:34.875325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:34.875477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:34.877820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2947 sessionId: src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:34.880491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:34.890438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896796321341200:7727]
2025-09-30T14:58:34.890728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 2946, pipe: [1:7555896796321341200:7727]
2025-09-30T14:58:34.987865Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:34.988810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:34.988825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:34.988843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321341200:7727], now have 1 active actors on pipe
2025-09-30T14:58:34.989058Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:34.989161Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896796321341200:7727]
2025-09-30T14:58:34.989190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:34.989208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:34.989271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2947 reason: status is not ok: tablet will be restarted right now sessionId: src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0
2025-09-30T14:58:34.989639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:34.989650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0] Write session will restart in 0.008193s
2025-09-30T14:58:34.989461Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2947 sessionId: src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0 is DEAD
2025-09-30T14:58:34.989673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0] Write session: Do CDS request
2025-09-30T14:58:34.989679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:34.998776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:34.998877Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:34.998899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2948
2025-09-30T14:58:34.999067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2948 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:34.999103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2948 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:34.999114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2948 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:34.999119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:34.999645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2948 sessionId:  describe result for acl check
2025-09-30T14:58:34.999681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:34.999688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:34.999691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:34.999697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896796321341286:10112] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:35.000254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896796321341286:10112] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:35.002867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896796321341286:10112] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:35.006013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896796321341286:10112] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:35.006028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896796321341286:10112] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:35.006032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896796321341286:10112] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:35.006040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2948 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:35.013206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:35.013956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:35.014166Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:35.014180Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:35.014190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:35.014247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:35.014293Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896800526512411:7185]
2025-09-30T14:58:35.014919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:35.015265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:35.015317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:35.015670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:35.015746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.015753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.015754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.015755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.015756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.015758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.015759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.015760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.015761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.015763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.015764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.015765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.015766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.015767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.015768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.015774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.015786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.015790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.015794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.015798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.015801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.015805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.015808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.015812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.015818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.015822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.015825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.015829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.015832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.015836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.015844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.015852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.015858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.015863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.015868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.015873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.015877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.015882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.015887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.015892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.015896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.015901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.015905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.015910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.015914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.015919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.015924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.015928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.015933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.015938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.015943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.015949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.015953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.015957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.015961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.015979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.015984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.015989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.015993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.015997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.016037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:35.021657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:35.022978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:35.022992Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:35.022994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:35.022997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:35.023002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2947 [2:7555896800526512411:7185]
2025-09-30T14:58:35.023014Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:35.023027Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:35.023029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:35.023032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:35.023034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:35.023050Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:35.023058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:35.023066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:35.023117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.023119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.023121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.023125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:35.023128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:35.023192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:35.023202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.023215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.023227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.023263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:35.023281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616308889:10112], now have 1 active actors on pipe
2025-09-30T14:58:35.023292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896796321341204:2454], now have 1 active actors on pipe
2025-09-30T14:58:35.023297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896800526512406:7185]
2025-09-30T14:58:35.023300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896800526512406:7185]
2025-09-30T14:58:35.023301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896800526512406:7185]
2025-09-30T14:58:35.023318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:35.023332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:35.023353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:35.023358Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:35.023360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:35.023363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:35.023365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:35.023395Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896800526512406:7185]
2025-09-30T14:58:35.023408Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:35.023413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:35.023414Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2947
2025-09-30T14:58:35.023456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.023467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.023489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:35.023500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:35.023503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:35.023505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:35.023514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:35.023524Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:35.023538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:35.023597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2947
2025-09-30T14:58:35.023700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.023715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.023742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:35.023817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2948 partition: 0 MaxSeqNo: 42 sessionId: src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0
2025-09-30T14:58:35.024216Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|22d742a-54f82885-edb4b26f-e5cc3fa2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:35.027096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0] Write session: try to update token
2025-09-30T14:58:35.027114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:35.047093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:35.047114Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:35.047124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896800526512406:7185]
2025-09-30T14:58:35.047167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:35.047173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:35.047362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:35.047511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:35.047649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:35.047791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:35.047987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:35.048033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:35.055593Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2948 sessionId: src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:35.058359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:35.058204Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:35.058223Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:35.058225Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:35.058227Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:35.058237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896800526512406:7185]
2025-09-30T14:58:35.058241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896800526512406:7185]
2025-09-30T14:58:35.058246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896800526512406:7185]
2025-09-30T14:58:35.058287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:35.058294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.058293Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:35.058296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:35.058300Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:35.058303Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:35.058430Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:35.089099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896800616309022:7727]
2025-09-30T14:58:35.089434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 2947, pipe: [1:7555896800616309022:7727]
2025-09-30T14:58:35.180496Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:35.181083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.181099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.181121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616309022:7727], now have 1 active actors on pipe
2025-09-30T14:58:35.181371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:35.181385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:35.181390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:35.181427Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896800616309022:7727]
2025-09-30T14:58:35.181471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2948 reason: error at write: Disconnected sessionId: src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0
2025-09-30T14:58:35.181664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2948 sessionId: src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0 is DEAD
2025-09-30T14:58:35.181810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:35.181819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0] Write session will restart in 0.007192s
2025-09-30T14:58:35.181843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0] Write session: Do CDS request
2025-09-30T14:58:35.181849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:35.181418Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:35.189765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:35.189872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:35.189889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2949
2025-09-30T14:58:35.190034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2949 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:35.190075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2949 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:35.190085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2949 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:35.190090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:35.190563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2949 sessionId:  describe result for acl check
2025-09-30T14:58:35.190597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:35.190601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:35.190604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:35.190609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896800616309076:10107] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:35.191148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896800616309076:10107] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:35.193556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896800616309076:10107] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:35.195748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896800616309076:10107] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:35.195764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896800616309076:10107] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:35.195767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896800616309076:10107] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:35.195775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2949 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:35.206245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:35.206932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:35.207148Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:35.207172Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:35.207187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:35.207270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:35.207315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896800526512703:7197]
2025-09-30T14:58:35.207989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:35.208302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:35.208359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:35.208727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:35.208834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.208844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.208845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.208847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.208848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.208850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.208851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.208853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.208854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.208856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.208858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.208859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.208861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.208863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.208864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.208871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.208884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.208889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.208893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.208899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.208904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.208909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.208914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.208919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.208924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.208927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.208931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.208935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.208940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.208943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.208952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.208961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.208974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.208980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.208985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.208990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.208995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.209005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.209011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.209016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.209021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.209027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.209031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.209037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.209042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.209047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.209054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.209060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.209069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.209074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.209079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.209089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.209094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.209103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.209108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.209115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.209120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.209130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.209138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.209150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.209199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:35.215420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:35.216982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:35.216997Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:35.216999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:35.217003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:35.217009Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2948 [2:7555896800526512703:7197]
2025-09-30T14:58:35.217022Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:35.217035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:35.217038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:35.217040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:35.217042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:35.217056Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:35.217062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:35.217067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:35.217120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.217126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.217129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.217131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:35.217133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:35.217189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:35.217191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.217200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.217206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.217216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:35.217229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896800526512698:7197]
2025-09-30T14:58:35.217231Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896800526512698:7197]
2025-09-30T14:58:35.217232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896800526512698:7197]
2025-09-30T14:58:35.217240Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:35.217251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:35.217256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:35.217260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:35.217263Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:35.217266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:35.217266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:35.217306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616309300:10107], now have 1 active actors on pipe
2025-09-30T14:58:35.217308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896800526512698:7197]
2025-09-30T14:58:35.217419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2948
2025-09-30T14:58:35.217314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:35.217318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616309025:2454], now have 1 active actors on pipe
2025-09-30T14:58:35.217356Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:35.217503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2948
2025-09-30T14:58:35.217589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.217596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.217615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:35.217622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:35.217625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:35.217626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:35.217635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:35.217642Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:35.217653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:35.217840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.217845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.217855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:35.217937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2949 partition: 0 MaxSeqNo: 42 sessionId: src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0
2025-09-30T14:58:35.218295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ff51ceb-38b4d07e-201c8c18-ad93c3b6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:35.221079Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0] Write session: try to update token
2025-09-30T14:58:35.221100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:35.231069Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:35.231094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:35.231096Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:35.231098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:35.231109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896800526512698:7197]
2025-09-30T14:58:35.231114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896800526512698:7197]
2025-09-30T14:58:35.231119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896800526512698:7197]
2025-09-30T14:58:35.231161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:35.231168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.231171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:35.231178Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:35.231185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:35.231192Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:35.231334Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:35.238906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2949 sessionId: src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:35.241626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:35.281623Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896800616309552:7727]
2025-09-30T14:58:35.281936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 2948, pipe: [1:7555896800616309552:7727]
2025-09-30T14:58:35.356658Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:35.357361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.357381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.357403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616309552:7727], now have 1 active actors on pipe
2025-09-30T14:58:35.357645Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:35.357735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:35.357736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896800616309552:7727]
2025-09-30T14:58:35.357753Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:35.357760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:35.357828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2949 reason: error at write: Disconnected sessionId: src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0
2025-09-30T14:58:35.358268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:35.358280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0] Write session will restart in 0.006466s
2025-09-30T14:58:35.358305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0] Write session: Do CDS request
2025-09-30T14:58:35.358312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:35.358018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2949 sessionId: src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0 is DEAD
2025-09-30T14:58:35.365821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:35.365927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:35.365948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2950
2025-09-30T14:58:35.366067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2950 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:35.366103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2950 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:35.366108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2950 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:35.366113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:35.366606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2950 sessionId:  describe result for acl check
2025-09-30T14:58:35.366645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:35.366652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:35.366654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:35.366660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896800616309576:10099] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:35.367217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896800616309576:10099] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:35.369766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896800616309576:10099] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:35.374038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896800616309576:10099] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:35.374054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896800616309576:10099] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:35.374058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896800616309576:10099] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:35.374067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2950 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:35.385910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:35.388538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:35.388771Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:35.388792Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:35.388804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:35.388864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:35.388924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896800526513006:7194]
2025-09-30T14:58:35.389566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:35.389897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:35.389947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:35.390280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:35.390355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.390362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.390363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.390365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.390366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.390367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.390368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.390369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.390371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.390372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.390374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.390375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.390376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.390377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.390379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.390385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.390395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.390399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.390403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.390407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.390411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.390416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.390420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.390424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.390429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.390433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.390438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.390442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.390446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.390450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.390458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.390467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.390473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.390479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.390483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.390489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.390501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.390506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.390511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.390517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.390522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.390528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.390533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.390538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.390542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.390548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.390553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.390559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.390563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.390569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.390574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.390580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.390587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.390592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.390598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.390603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.390607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.390613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.390618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.390623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.390668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:35.396177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:35.397372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:35.397398Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:35.397403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:35.397408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:35.397418Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2949 [2:7555896800526513006:7194]
2025-09-30T14:58:35.397440Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:35.397461Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:35.397465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:35.397469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:35.397472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:35.397491Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:35.397509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:35.397517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:35.397596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.397606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.397609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.397614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:35.397617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:35.397712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:35.397723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.397740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.397760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.397782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:35.397810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616309802:10099], now have 1 active actors on pipe
2025-09-30T14:58:35.397820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616309560:2454], now have 1 active actors on pipe
2025-09-30T14:58:35.397828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896800526513001:7194]
2025-09-30T14:58:35.397835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896800526513001:7194]
2025-09-30T14:58:35.397838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896800526513001:7194]
2025-09-30T14:58:35.397852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:35.397873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:35.397874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:35.397878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:35.397883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:35.397894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:35.397898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:35.397946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896800526513001:7194]
2025-09-30T14:58:35.397963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:35.397969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:35.398097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2949
2025-09-30T14:58:35.398147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2949
2025-09-30T14:58:35.398476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.398492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.398521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:35.398535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:35.398540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:35.398543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:35.398555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:35.398573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:35.398600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:35.399124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2950 partition: 0 MaxSeqNo: 42 sessionId: src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0
2025-09-30T14:58:35.399562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e3fa1ae-b9bc4cea-27839349-8bd2f6ac_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:35.398836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.398851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.398872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:35.402517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0] Write session: try to update token
2025-09-30T14:58:35.402538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:35.416710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:35.416732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:35.416742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896800526513001:7194]
2025-09-30T14:58:35.416809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:35.416808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:35.416984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:35.417120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:35.417275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:35.417408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:35.417594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:35.417628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:35.422362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2950 sessionId: src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:35.423480Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:35.423501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:35.423503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:35.423505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:35.423514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896800526513001:7194]
2025-09-30T14:58:35.423517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896800526513001:7194]
2025-09-30T14:58:35.423521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896800526513001:7194]
2025-09-30T14:58:35.423566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:35.423581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.423584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:35.423609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:35.423639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:35.423650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:35.423739Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:35.425459Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:35.457750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896800616310087:7727]
2025-09-30T14:58:35.458139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 2949, pipe: [1:7555896800616310087:7727]
2025-09-30T14:58:35.549025Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:35.549628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.549644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.549667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616310087:7727], now have 1 active actors on pipe
2025-09-30T14:58:35.550290Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:35.550844Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:35.550858Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0] Write session will restart in 0.007102s
2025-09-30T14:58:35.550892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0] Write session: Do CDS request
2025-09-30T14:58:35.550898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:35.550363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:35.550416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896800616310087:7727]
2025-09-30T14:58:35.550443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:35.550446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:35.550507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2950 reason: error at write: Disconnected sessionId: src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0
2025-09-30T14:58:35.550686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2950 sessionId: src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0 is DEAD
2025-09-30T14:58:35.559068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:35.561759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:35.561783Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2951
2025-09-30T14:58:35.562107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2951 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:35.562154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2951 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:35.562165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2951 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:35.562169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:35.563352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2951 sessionId:  describe result for acl check
2025-09-30T14:58:35.563407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:35.563415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:35.563424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:35.563431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896800616310133:10087] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:35.564067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896800616310133:10087] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:35.570637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896800616310133:10087] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:35.576148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896800616310133:10087] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:35.576169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896800616310133:10087] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:35.576172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896800616310133:10087] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:35.576182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2951 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:35.608380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:35.612409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:35.612642Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:35.612654Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:35.612665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:35.612716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:35.612771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896800526513299:7188]
2025-09-30T14:58:35.613482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:35.613911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:35.613978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:35.614364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:35.614470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.614472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.614473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.614474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.614476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.614477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.614479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.614481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.614482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.614483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.614485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.614486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.614487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.614489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.614491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.614497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.614508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.614513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.614517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.614521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.614526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.614530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.614533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.614537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.614541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.614546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.614549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.614554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.614558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.614562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.614572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.614581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.614587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.614593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.614598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.614603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.614609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.614617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.614622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.614627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.614632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.614637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.614643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.614649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.614654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.614659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.614664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.614669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.614675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.614681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.614685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.614690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.614696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.614700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.614705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.614714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.614720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.614725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.614729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.614734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.614778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:35.620660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:35.622087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:35.622101Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:35.622103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:35.622107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:35.622113Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2950 [2:7555896800526513299:7188]
2025-09-30T14:58:35.622126Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:35.622141Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:35.622143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:35.622145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:35.622146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:35.622159Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:35.622167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:35.622172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:35.622224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.622230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.622231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.622233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:35.622235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:35.622596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2950
2025-09-30T14:58:35.622825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2950
2025-09-30T14:58:35.622294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:35.622299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.622311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.622323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.622339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:35.622354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896800526513294:7188]
2025-09-30T14:58:35.622355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896800526513294:7188]
2025-09-30T14:58:35.622357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896800526513294:7188]
2025-09-30T14:58:35.622369Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:35.622380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:35.622388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:35.622390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:35.622419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896800526513294:7188]
2025-09-30T14:58:35.622421Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:35.622451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616310090:2454], now have 1 active actors on pipe
2025-09-30T14:58:35.622560Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:35.622563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:35.622566Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:35.622572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:35.628943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616310204:10087], now have 1 active actors on pipe
2025-09-30T14:58:35.628997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.629004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.629047Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:35.629068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:35.629075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:35.629078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:35.629089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:35.629106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:35.629125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:35.629407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.629431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.629457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:35.629585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2951 partition: 0 MaxSeqNo: 42 sessionId: src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0
2025-09-30T14:58:35.630036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8bf35d7d-e4144df7-dc6cf3c9-3b95e05c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:35.633471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0] Write session: try to update token
2025-09-30T14:58:35.633494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:35.640905Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:35.640926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:35.640928Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:35.640931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:35.640941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896800526513294:7188]
2025-09-30T14:58:35.640946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896800526513294:7188]
2025-09-30T14:58:35.640950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896800526513294:7188]
2025-09-30T14:58:35.640995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:35.641002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.641005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:35.641162Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:35.643600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:35.643619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:35.643624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:35.650103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2951 sessionId: src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:35.650753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896800616310628:7727]
2025-09-30T14:58:35.650963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 2950, pipe: [1:7555896800616310628:7727]
2025-09-30T14:58:35.653265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:35.762810Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:35.763121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616310628:7727], now have 1 active actors on pipe
2025-09-30T14:58:35.763176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.763189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.763439Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:35.763443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:35.763460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:35.763534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2951 reason: error at write: Disconnected sessionId: src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0
2025-09-30T14:58:35.763573Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896800616310628:7727]
2025-09-30T14:58:35.763600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:35.763732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2951 sessionId: src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0 is DEAD
2025-09-30T14:58:35.763874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:35.763884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0] Write session will restart in 0.009106s
2025-09-30T14:58:35.763919Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0] Write session: Do CDS request
2025-09-30T14:58:35.763925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:35.773783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:35.773936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:35.773954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2952
2025-09-30T14:58:35.774086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2952 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:35.774118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2952 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:35.774123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2952 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:35.774128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:35.774539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2952 sessionId:  describe result for acl check
2025-09-30T14:58:35.774573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:35.774575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:35.774576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:35.774582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896800616310732:10078] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:35.775106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896800616310732:10078] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:35.777066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896800616310732:10078] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:35.779521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896800616310732:10078] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:35.779536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896800616310732:10078] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:35.779540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896800616310732:10078] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:35.779549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2952 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:35.787945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:35.788513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:35.788726Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:35.788735Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:35.788746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:35.788821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:35.788883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896800526513591:7190]
2025-09-30T14:58:35.789581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:35.789902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:35.789946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:35.790285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:35.790345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.790351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.790352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.790354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.790355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.790356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.790358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.790359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.790361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.790362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.790363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.790365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.790366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.790368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.790369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.790374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.790386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.790390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.790395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.790399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.790404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.790408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.790413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.790418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.790423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.790427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.790431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.790438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.790442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.790447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.790453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.790462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.790468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.790474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.790480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.790485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.790492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.790498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.790503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.790509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.790513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.790524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.790530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.790540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.790546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.790556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.790560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.790571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.790576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.790586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.790591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.790600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.790605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.790615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.790619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.790629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.790633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.790639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.790644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.790650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.790698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:35.796113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:35.797470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:35.797489Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:35.797492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:35.797497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:35.797504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2951 [2:7555896800526513591:7190]
2025-09-30T14:58:35.797520Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:35.797537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:35.797540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:35.797543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:35.797546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:35.797562Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:35.797576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:35.797583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:35.797646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.797655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.797657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.797661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:35.797664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:35.797734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:35.797742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.797755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.797774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.797797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:35.797819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616310633:2454], now have 1 active actors on pipe
2025-09-30T14:58:35.797828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616311005:10078], now have 1 active actors on pipe
2025-09-30T14:58:35.797834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896800526513586:7190]
2025-09-30T14:58:35.797841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896800526513586:7190]
2025-09-30T14:58:35.797845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896800526513586:7190]
2025-09-30T14:58:35.797858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:35.797875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:35.797881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:35.797886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:35.797888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:35.797896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:35.797898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:35.797931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896800526513586:7190]
2025-09-30T14:58:35.797939Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:35.797941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:35.797908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2951
2025-09-30T14:58:35.797934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2951
2025-09-30T14:58:35.797978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.797986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.798014Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|168683f7-1770ee6b-ed54158a-c188b298_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:35.798029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:35.798037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:35.798039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:35.798047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:35.798056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:35.798073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:35.798209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.798216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.798229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:35.798316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2952 partition: 0 MaxSeqNo: 42 sessionId: src_id|168683f7-1770ee6b-ed54158a-c188b298_0
2025-09-30T14:58:35.798688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3bf40330-511158f0-7735e9c1-b1cbb614_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|168683f7-1770ee6b-ed54158a-c188b298_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:35.801415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|168683f7-1770ee6b-ed54158a-c188b298_0] Write session: try to update token
2025-09-30T14:58:35.801434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|168683f7-1770ee6b-ed54158a-c188b298_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:35.810071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:35.810094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:35.810097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:35.810099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:35.810113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896800526513586:7190]
2025-09-30T14:58:35.810118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896800526513586:7190]
2025-09-30T14:58:35.810122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896800526513586:7190]
2025-09-30T14:58:35.810166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:35.810174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.810176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:35.810183Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:35.810190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:35.810194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:35.810316Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:35.816112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2952 sessionId: src_id|168683f7-1770ee6b-ed54158a-c188b298_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:35.818915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:35.863759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896800616311162:7727]
2025-09-30T14:58:35.864108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 2951, pipe: [1:7555896800616311162:7727]
2025-09-30T14:58:35.931299Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:35.931592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.931611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.931644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616311162:7727], now have 1 active actors on pipe
2025-09-30T14:58:35.931779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896800616311162:7727]
2025-09-30T14:58:35.931801Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:35.931824Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:35.931828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:35.931890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2952 reason: error at write: Disconnected sessionId: src_id|168683f7-1770ee6b-ed54158a-c188b298_0
2025-09-30T14:58:35.932061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2952 sessionId: src_id|168683f7-1770ee6b-ed54158a-c188b298_0 is DEAD
2025-09-30T14:58:35.932195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168683f7-1770ee6b-ed54158a-c188b298_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:35.932207Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168683f7-1770ee6b-ed54158a-c188b298_0] Write session will restart in 0.009433s
2025-09-30T14:58:35.932238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168683f7-1770ee6b-ed54158a-c188b298_0] Write session: Do CDS request
2025-09-30T14:58:35.932244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168683f7-1770ee6b-ed54158a-c188b298_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:35.932448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:35.942828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|168683f7-1770ee6b-ed54158a-c188b298_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:35.942915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:35.942934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2953
2025-09-30T14:58:35.943080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2953 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:35.943115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2953 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:35.943121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2953 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:35.943125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:35.943667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2953 sessionId:  describe result for acl check
2025-09-30T14:58:35.943706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:35.943709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:35.943711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:35.943718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896800616311284:10065] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:35.944302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896800616311284:10065] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:35.946992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896800616311284:10065] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:35.950461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896800616311284:10065] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:35.950479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896800616311284:10065] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:35.950484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896800616311284:10065] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:35.950494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2953 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:35.961190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:35.961795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:35.962241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:35.962253Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:35.962268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:35.962334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:35.962374Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896800526513920:7168]
2025-09-30T14:58:35.963105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:35.963434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:35.963481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:35.963823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:35.963885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.963892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.963893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.963894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.963896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.963900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.963901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.963903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.963904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.963905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.963906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.963908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.963909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.963910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.963911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.963917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.963929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.963934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.963938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.963943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.963948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.963952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.963956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.963961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.963967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.963972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.963977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.963981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.963987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.963992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.964000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.964009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:35.964015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.964026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:35.964031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.964037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:35.964042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.964053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:35.964060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.964066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:35.964075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.964080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:35.964086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.964092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:35.964097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.964103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:35.964111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.964117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:35.964126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.964132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:35.964141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.964147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.964156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.964162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.964171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.964176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.964185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.964191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:35.964201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.964207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:35.964256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:35.969666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:35.970884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:35.970898Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:35.970901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:35.970905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:35.970912Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2952 [2:7555896800526513920:7168]
2025-09-30T14:58:35.970927Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:35.970942Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:35.970946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:35.970949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:35.970952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:35.970968Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:35.970976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:35.970988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:35.971049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.971057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.971060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.971064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:35.971066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:35.971133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:35.971141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.971156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:35.971174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:35.971200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:35.971223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616311542:10065], now have 1 active actors on pipe
2025-09-30T14:58:35.971232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896800616311188:2454], now have 1 active actors on pipe
2025-09-30T14:58:35.971239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896800526513915:7168]
2025-09-30T14:58:35.971266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896800526513915:7168]
2025-09-30T14:58:35.971268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896800526513915:7168]
2025-09-30T14:58:35.971281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:35.971295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:35.971296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:35.971299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:35.971301Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:35.971311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:35.971314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:35.971303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2952
2025-09-30T14:58:35.971345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896800526513915:7168]
2025-09-30T14:58:35.971362Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:35.971383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:35.971382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2952
2025-09-30T14:58:35.971483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.971492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.971694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:35.971708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:35.971711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:35.971714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:35.971723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:35.971734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:35.971751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:35.971946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:35.971968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:35.971995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:35.972091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2953 partition: 0 MaxSeqNo: 42 sessionId: src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0
2025-09-30T14:58:35.972478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|168683f7-1770ee6b-ed54158a-c188b298_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:35.975466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0] Write session: try to update token
2025-09-30T14:58:35.975492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:35.983908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:35.983931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:35.983935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:35.983937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:35.983948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896800526513915:7168]
2025-09-30T14:58:35.983957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896800526513915:7168]
2025-09-30T14:58:35.983962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896800526513915:7168]
2025-09-30T14:58:35.984003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:35.984010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:35.984014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:35.984154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:35.987336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:35.987358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:35.987364Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:35.991459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2953 sessionId: src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:35.994800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:36.032202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896804911279011:7727]
2025-09-30T14:58:36.032506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 2952, pipe: [1:7555896804911279011:7727]
2025-09-30T14:58:36.100659Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:36.100980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.100999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.101038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911279011:7727], now have 1 active actors on pipe
2025-09-30T14:58:36.101272Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:36.101304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896804911279011:7727]
2025-09-30T14:58:36.101306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:36.101310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:36.101352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:36.101400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2953 reason: error at write: Disconnected sessionId: src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0
2025-09-30T14:58:36.101592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2953 sessionId: src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0 is DEAD
2025-09-30T14:58:36.101761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:36.101769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0] Write session will restart in 0.008648s
2025-09-30T14:58:36.101787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0] Write session: Do CDS request
2025-09-30T14:58:36.101794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:36.111765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:36.111845Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:36.111862Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2954
2025-09-30T14:58:36.111994Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2954 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:36.112044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2954 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:36.112054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2954 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:36.112059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:36.112529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2954 sessionId:  describe result for acl check
2025-09-30T14:58:36.112569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:36.112571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:36.112573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:36.112579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896804911279166:10059] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:36.113060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896804911279166:10059] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:36.115480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896804911279166:10059] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:36.118557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896804911279166:10059] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:36.118576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896804911279166:10059] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:36.118579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896804911279166:10059] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:36.118588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2954 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:36.126632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:36.128258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:36.128466Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:36.128478Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:36.128490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:36.128546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:36.128584Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896804821481512:7164]
2025-09-30T14:58:36.129271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:36.129596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:36.129644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:36.130002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:36.130086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.130092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.130094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.130095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.130096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.130097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.130099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.130100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.130102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.130103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.130104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.130105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.130107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.130108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.130110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.130115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.130126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.130130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.130135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.130140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.130144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.130148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.130152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.130156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.130161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.130165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.130169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.130173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.130177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.130180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.130189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.130197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.130204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.130210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.130215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.130220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.130227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.130232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.130238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.130243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.130247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.130252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.130258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.130263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.130268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.130273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.130279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.130285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.130289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.130294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.130306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.130312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.130317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.130321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.130326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.130331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.130335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.130340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.130346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.130350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.130395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:36.135975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:36.137171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:36.137185Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:36.137187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:36.137190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:36.137195Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2953 [2:7555896804821481512:7164]
2025-09-30T14:58:36.137207Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:36.137222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:36.137224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:36.137226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:36.137227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:36.137239Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:36.137244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:36.137249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:36.137299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.137305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.137307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.137310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:36.137312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:36.137365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:36.137371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.137380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.137386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.137404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:36.137426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896804821481507:7164]
2025-09-30T14:58:36.137433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896804821481507:7164]
2025-09-30T14:58:36.137435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896804821481507:7164]
2025-09-30T14:58:36.137450Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:36.137462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:36.137469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911279013:2454], now have 1 active actors on pipe
2025-09-30T14:58:36.137474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:36.137476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911279412:10059], now have 1 active actors on pipe
2025-09-30T14:58:36.137477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:36.137481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:36.137548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2953
2025-09-30T14:58:36.137560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2953
2025-09-30T14:58:36.137497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:36.137512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:36.137547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896804821481507:7164]
2025-09-30T14:58:36.137554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:36.137572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:36.137604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.137609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.137637Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:36.137644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:36.137647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:36.137649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:36.137660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:36.137669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:36.137682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:36.137825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.137837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.137853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:36.137939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2954 partition: 0 MaxSeqNo: 42 sessionId: src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0
2025-09-30T14:58:36.138272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd5ba6e4-8c792923-30e0a963-8e0f54c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:36.141100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0] Write session: try to update token
2025-09-30T14:58:36.141120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:36.155745Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:36.155768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:36.155778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896804821481507:7164]
2025-09-30T14:58:36.155832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:36.155831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:36.156060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:36.156102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2954 sessionId: src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:36.156238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:36.156450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:36.156642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:36.156954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:36.157022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:36.159132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:36.159378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.159400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.160641Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:36.160661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:36.160663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:36.160665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:36.160679Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896804821481507:7164]
2025-09-30T14:58:36.160683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896804821481507:7164]
2025-09-30T14:58:36.160688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896804821481507:7164]
2025-09-30T14:58:36.160725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:36.160738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:36.160745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:36.160748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:36.160749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:36.160767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.160770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:36.160847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:36.160913Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:36.201691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896804911279544:7727]
2025-09-30T14:58:36.202035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 2953, pipe: [1:7555896804911279544:7727]
2025-09-30T14:58:36.278623Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:36.287443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.287475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.287657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:36.287721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:36.287789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:36.287860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:36.287911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:36.287921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:36.287993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:36.288055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:36.288117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:36.288188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:36.288235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:36.288243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:36.288312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:36.288376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:36.291089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:36.291119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896804911279544:7727]
2025-09-30T14:58:36.291149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:36.291152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:36.288449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:36.288526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:36.288566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:36.288569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:36.288638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:36.288701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:36.288775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:36.288835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:36.288875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:36.288878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:36.288946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:36.289001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:36.289061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:36.289122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:36.289186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:36.289189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:36.289256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:36.289316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:36.289379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:36.289441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:36.289484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:36.289487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:36.289555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:36.289615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:36.289676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:36.289736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:36.289778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:36.289781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:36.289849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:36.289908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:36.289967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:36.290027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:36.290075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:36.290078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:36.290146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:36.290204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:36.290264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:36.290330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:36.290378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:36.290380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:36.290453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:36.290515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:36.290578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:36.290641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:36.290684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:36.290687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:36.290762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911279544:7727], now have 1 active actors on pipe
2025-09-30T14:58:36.291190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2954 reason: error at write: Disconnected sessionId: src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0
2025-09-30T14:58:36.291392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2954 sessionId: src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0 is DEAD
2025-09-30T14:58:36.292225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:36.292236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0] Write session will restart in 0.005990s
2025-09-30T14:58:36.292262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0] Write session: Do CDS request
2025-09-30T14:58:36.292269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:36.292296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:36.299810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:36.299879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:36.299906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2955
2025-09-30T14:58:36.300045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2955 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:36.300076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2955 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:36.300095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2955 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:36.300100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:36.300547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2955 sessionId:  describe result for acl check
2025-09-30T14:58:36.300587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:36.300590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:36.300592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:36.300608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896804911279566:10055] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:36.301172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896804911279566:10055] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:36.304349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896804911279566:10055] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:36.308428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896804911279566:10055] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:36.308445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896804911279566:10055] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:36.308449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896804911279566:10055] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:36.308458Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2955 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:36.330866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:36.331604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:36.331774Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:36.331778Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:36.331788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:36.331827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:36.331866Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896804821481807:7162]
2025-09-30T14:58:36.332564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:36.333242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:36.333315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:36.333743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:36.333842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.333851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.333855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.333856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.333857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.333858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.333859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.333861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.333862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.333863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.333864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.333865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.333867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.333868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.333869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.333876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.333887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.333891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.333895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.333898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.333904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.333910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.333914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.333918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.333921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.333926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.333930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.333933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.333938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.333942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.333953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.333961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.333966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.333972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.333977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.333991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.333995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.334000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.334005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.334018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.334023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.334029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.334038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.334043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.334048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.334058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.334063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.334073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.334077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.334087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.334095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.334106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.334111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.334120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.334125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.334130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.334139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.334145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.334154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.334159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.334209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:36.342218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:36.343059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:36.343073Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:36.343076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:36.343079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:36.343085Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2954 [2:7555896804821481807:7162]
2025-09-30T14:58:36.343100Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:36.343114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:36.343116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:36.343119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:36.343120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:36.343133Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:36.343138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:36.343143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:36.343200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.343202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.343204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.343209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:36.343211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:36.343689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2954
2025-09-30T14:58:36.343730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2954
2025-09-30T14:58:36.343293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:36.343303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.343316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.343329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.343348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:36.343364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896804821481802:7162]
2025-09-30T14:58:36.343367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896804821481802:7162]
2025-09-30T14:58:36.343369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896804821481802:7162]
2025-09-30T14:58:36.343381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:36.343395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:36.343409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:36.343412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:36.343452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896804821481802:7162]
2025-09-30T14:58:36.343456Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:36.343483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:36.343487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:36.343489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:36.343495Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:36.343623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911279619:10055], now have 1 active actors on pipe
2025-09-30T14:58:36.343628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911279548:2454], now have 1 active actors on pipe
2025-09-30T14:58:36.343785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.343791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.343820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:36.343828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:36.343832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:36.343834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:36.343845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:36.343856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:36.343871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:36.344069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.344073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.344090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:36.344361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2955 partition: 0 MaxSeqNo: 42 sessionId: src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0
2025-09-30T14:58:36.344716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e61c6aaf-377f216a-58f75637-3bafab1c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:36.347643Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0] Write session: try to update token
2025-09-30T14:58:36.347662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:36.356209Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:36.356233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:36.356245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896804821481802:7162]
2025-09-30T14:58:36.356297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:36.356382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:36.356507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:36.356671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:36.356843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:36.357003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:36.357215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:36.357318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:36.369474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:36.369497Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:36.369501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:36.369503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:36.369514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896804821481802:7162]
2025-09-30T14:58:36.369519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896804821481802:7162]
2025-09-30T14:58:36.369524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896804821481802:7162]
2025-09-30T14:58:36.369567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:36.369592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.369599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:36.369760Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:36.367299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2955 sessionId: src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:36.370285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:36.370593Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:36.370606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:36.370616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:36.391434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896804911280086:7727]
2025-09-30T14:58:36.403354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 2954, pipe: [1:7555896804911280086:7727]
2025-09-30T14:58:36.500645Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:36.501244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.501261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.501282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911280086:7727], now have 1 active actors on pipe
2025-09-30T14:58:36.501534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:36.501496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:36.501968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:36.501976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0] Write session will restart in 0.008039s
2025-09-30T14:58:36.501511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:36.502000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0] Write session: Do CDS request
2025-09-30T14:58:36.501539Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896804911280086:7727]
2025-09-30T14:58:36.502006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:36.501560Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:36.501575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2955 reason: error at write: Disconnected sessionId: src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0
2025-09-30T14:58:36.501776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2955 sessionId: src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0 is DEAD
2025-09-30T14:58:36.514177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:36.514252Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:36.514274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2956
2025-09-30T14:58:36.514384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2956 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:36.514416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2956 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:36.514427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2956 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:36.514431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:36.514850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2956 sessionId:  describe result for acl check
2025-09-30T14:58:36.514887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:36.514895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:36.514897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:36.514903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896804911280195:10047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:36.515463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896804911280195:10047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:36.519667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896804911280195:10047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:36.523291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896804911280195:10047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:36.523305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896804911280195:10047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:36.523310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896804911280195:10047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:36.523318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2956 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:36.536584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:36.539049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:36.539342Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:36.539352Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:36.539363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:36.539423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:36.539470Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896804821482116:7152]
2025-09-30T14:58:36.540090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:36.540406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:36.540454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:36.540786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:36.540842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.540843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.540844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.540845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.540846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.540847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.540848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.540849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.540850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.540852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.540853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.540854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.540855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.540856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.540857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.540862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.540871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.540875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.540878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.540882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.540886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.540889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.540892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.540895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.540900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.540903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.540907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.540910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.540913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.540916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.540924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.540931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.540936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.540942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.540945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.540950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.540955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.540959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.540963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.540968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.540972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.540977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.540982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.540987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.540991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.540996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.541002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.541007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.541014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.541019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.541023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.541028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.541032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.541037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.541041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.541045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.541049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.541054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.541058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.541063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.541102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:36.547012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:36.548620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:36.548635Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:36.548637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:36.548641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:36.548649Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2955 [2:7555896804821482116:7152]
2025-09-30T14:58:36.548664Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:36.548681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:36.548684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:36.548687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:36.548689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:36.548706Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:36.548712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:36.548719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:36.548795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.548803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.548805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.548809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:36.548812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:36.548877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:36.548886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.548900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.548913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.548930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:36.548949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911280376:10047], now have 1 active actors on pipe
2025-09-30T14:58:36.548963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896804821482111:7152]
2025-09-30T14:58:36.548966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896804821482111:7152]
2025-09-30T14:58:36.548969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896804821482111:7152]
2025-09-30T14:58:36.548985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:36.548995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911280089:2454], now have 1 active actors on pipe
2025-09-30T14:58:36.549001Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:36.549003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:36.549011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:36.549013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:36.549018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:36.549021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:36.549054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896804821482111:7152]
2025-09-30T14:58:36.549065Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:36.549070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:36.549706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2955
2025-09-30T14:58:36.549762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2955
2025-09-30T14:58:36.553408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.553428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.553462Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:36.553474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:36.553478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:36.553482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:36.553496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:36.553510Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:36.553529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:36.557320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.557339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.557373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:36.562490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:36.562506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:36.562514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896804821482111:7152]
2025-09-30T14:58:36.562557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:36.562571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:36.562719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:36.562846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:36.562969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:36.563097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:36.563314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:36.563348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:36.563336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2956 partition: 0 MaxSeqNo: 42 sessionId: src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0
2025-09-30T14:58:36.563804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|14c0436e-13c4ba9c-f0b0a25e-e9257ca2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:36.566637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0] Write session: try to update token
2025-09-30T14:58:36.566655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:36.575796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:36.575823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:36.575825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:36.575827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:36.575838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896804821482111:7152]
2025-09-30T14:58:36.575843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896804821482111:7152]
2025-09-30T14:58:36.575847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896804821482111:7152]
2025-09-30T14:58:36.575891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:36.575899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.575912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:36.576070Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:36.578832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:36.578855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:36.578859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:36.590664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2956 sessionId: src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:36.593522Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:36.601515Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896804911280633:7727]
2025-09-30T14:58:36.602109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 2955, pipe: [1:7555896804911280633:7727]
2025-09-30T14:58:36.703181Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:36.703685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.703704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.703725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911280633:7727], now have 1 active actors on pipe
2025-09-30T14:58:36.703994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:36.704023Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896804911280633:7727]
2025-09-30T14:58:36.704046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:36.704129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2956 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0
2025-09-30T14:58:36.703942Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:36.704310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2956 sessionId: src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0 is DEAD
2025-09-30T14:58:36.704748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:36.704766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0] Write session will restart in 0.005441s
2025-09-30T14:58:36.704796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0] Write session: Do CDS request
2025-09-30T14:58:36.704802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:36.711781Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:36.712143Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:36.712160Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2957
2025-09-30T14:58:36.712514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2957 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:36.712574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2957 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:36.712592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2957 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:36.712598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:36.713083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2957 sessionId:  describe result for acl check
2025-09-30T14:58:36.713123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:36.713128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:36.713131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:36.713138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896804911280670:10039] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:36.713714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896804911280670:10039] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:36.715746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896804911280670:10039] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:36.718528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896804911280670:10039] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:36.718545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896804911280670:10039] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:36.718548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896804911280670:10039] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:36.718556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2957 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:36.729234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:36.731391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:36.731618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:36.731631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:36.731643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:36.731710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:36.731753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896804821482417:7150]
2025-09-30T14:58:36.732441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:36.732801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:36.732861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:36.733244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:36.733324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.733330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.733332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.733332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.733334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.733336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.733337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.733339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.733341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.733342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.733343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.733345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.733346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.733348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.733349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.733356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.733367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.733371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.733376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.733380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.733385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.733390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.733394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.733398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.733403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.733407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.733411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.733415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.733420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.733424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.733432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.733441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.733447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.733454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.733458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.733464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.733469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.733481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.733486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.733491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.733499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.733504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.733514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.733520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.733524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.733536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.733546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.733552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.733560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.733566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.733571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.733581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.733586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.733591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.733600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.733606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.733614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.733620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.733624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.733630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.733679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:36.739342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:36.740278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:36.740295Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:36.740297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:36.740301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:36.740308Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2956 [2:7555896804821482417:7150]
2025-09-30T14:58:36.740325Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:36.740341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:36.740344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:36.740347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:36.740350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:36.740366Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:36.740372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:36.740378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:36.740441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.740452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.740454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.740457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:36.740460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:36.740528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:36.740536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.740547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.740562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.740577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:36.740600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911280821:10039], now have 1 active actors on pipe
2025-09-30T14:58:36.740609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911280637:2454], now have 1 active actors on pipe
2025-09-30T14:58:36.740615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896804821482412:7150]
2025-09-30T14:58:36.740617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896804821482412:7150]
2025-09-30T14:58:36.740620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896804821482412:7150]
2025-09-30T14:58:36.740636Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:36.740651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:36.740670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:36.740673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:36.740705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896804821482412:7150]
2025-09-30T14:58:36.740708Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:36.740704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2956
2025-09-30T14:58:36.740712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2956
2025-09-30T14:58:36.740726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:36.740740Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:36.740742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:36.740764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:36.740896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.740914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.740949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:36.740963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:36.740969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:36.740971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:36.740984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:36.740996Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:36.741012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:36.741203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.741215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.741237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:36.741402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2957 partition: 0 MaxSeqNo: 42 sessionId: src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0
2025-09-30T14:58:36.741790Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2cc9c7d-ad1a7e39-852d5360-dae7b12_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:36.744596Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0] Write session: try to update token
2025-09-30T14:58:36.744615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:36.753287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:36.753314Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:36.753324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896804821482412:7150]
2025-09-30T14:58:36.753373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:36.753383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:36.753560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:36.753711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:36.753854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:36.754005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:36.754206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:36.754254Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:36.764588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2957 sessionId: src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:36.767384Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:36.767406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:36.767408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:36.767411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:36.767421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896804821482412:7150]
2025-09-30T14:58:36.767426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896804821482412:7150]
2025-09-30T14:58:36.767431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896804821482412:7150]
2025-09-30T14:58:36.767471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:36.767477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.767478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:36.767480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:36.767484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:36.767488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:36.767486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:36.767619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:36.804305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896804911281172:7727]
2025-09-30T14:58:36.804811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 2956, pipe: [1:7555896804911281172:7727]
2025-09-30T14:58:36.888912Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:36.889500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.889519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.889541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911281172:7727], now have 1 active actors on pipe
2025-09-30T14:58:36.889968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:36.890062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2957 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0
2025-09-30T14:58:36.890119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896804911281172:7727]
2025-09-30T14:58:36.889772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:36.890146Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:36.890255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2957 sessionId: src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0 is DEAD
2025-09-30T14:58:36.890408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:36.890420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0] Write session will restart in 0.009824s
2025-09-30T14:58:36.890454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0] Write session: Do CDS request
2025-09-30T14:58:36.890461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:36.903752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:36.904091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:36.904109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2958
2025-09-30T14:58:36.907364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2958 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:36.907415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2958 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:36.907421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2958 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:36.907425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:36.907838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2958 sessionId:  describe result for acl check
2025-09-30T14:58:36.907865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:36.907882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:36.907884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:36.907889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896804911281239:10033] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:36.908416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896804911281239:10033] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:36.911907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896804911281239:10033] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:36.914771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896804911281239:10033] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:36.914787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896804911281239:10033] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:36.914791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896804911281239:10033] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:36.914831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2958 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:36.933721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:36.934360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:36.934560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:36.934571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:36.934582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:36.934642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:36.934684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896804821482719:7147]
2025-09-30T14:58:36.935391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:36.936648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:36.936715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:36.937103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:36.937175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.937183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.937184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.937186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.937187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.937188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.937189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.937190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.937192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.937193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.937194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.937195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.937196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.937197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.937199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.937204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.937214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.937218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.937223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.937227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.937231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.937235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.937239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.937244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.937249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.937254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.937258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.937262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.937267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.937271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.937282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.937290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:36.937297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.937304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:36.937309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.937315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:36.937319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.937326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:36.937331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.937337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:36.937342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.937348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:36.937353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.937359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:36.937364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.937370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:36.937375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.937381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:36.937395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.937403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:36.937408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.937414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.937419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.937424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.937429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.937435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.937440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.937445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:36.937451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.937457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:36.937508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:36.945488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:36.946413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:36.946436Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:36.946440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:36.946445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:36.946452Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2957 [2:7555896804821482719:7147]
2025-09-30T14:58:36.946469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:36.946491Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:36.946502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:36.946505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:36.946508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:36.946525Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:36.946532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:36.946539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:36.946612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.946621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.946625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.946629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:36.946632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:36.946703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:36.946711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.946725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:36.946744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:36.946767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:36.946792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911281175:2454], now have 1 active actors on pipe
2025-09-30T14:58:36.946802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911281465:10033], now have 1 active actors on pipe
2025-09-30T14:58:36.946809Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896804821482714:7147]
2025-09-30T14:58:36.946818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896804821482714:7147]
2025-09-30T14:58:36.946820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896804821482714:7147]
2025-09-30T14:58:36.946836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:36.946853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:36.946874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:36.946877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:36.946880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:36.946882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:36.946882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:36.946921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896804821482714:7147]
2025-09-30T14:58:36.946930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:36.946933Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:36.947016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.947028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.947052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:36.947066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:36.947072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:36.947074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:36.947085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:36.947100Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:36.947119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:36.946895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2957
2025-09-30T14:58:36.946950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2957
2025-09-30T14:58:36.947507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:36.947520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:36.947542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:36.947656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2958 partition: 0 MaxSeqNo: 42 sessionId: src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0
2025-09-30T14:58:36.948046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cbe2b9a2-d9463a2-9e67e1e-7ea85604_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:36.951120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0] Write session: try to update token
2025-09-30T14:58:36.951141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:36.961556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:36.961584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:36.961586Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:36.961589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:36.961599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896804821482714:7147]
2025-09-30T14:58:36.961603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896804821482714:7147]
2025-09-30T14:58:36.961608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896804821482714:7147]
2025-09-30T14:58:36.961649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:36.961653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:36.961656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:36.961659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:36.961659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:36.961662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:36.961801Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:36.968042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2958 sessionId: src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:36.971071Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:36.990366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896804911281727:7727]
2025-09-30T14:58:36.990878Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 2957, pipe: [1:7555896804911281727:7727]
2025-09-30T14:58:37.089507Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:37.090234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.090252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.090294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896804911281727:7727], now have 1 active actors on pipe
2025-09-30T14:58:37.091489Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:37.092060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:37.092072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0] Write session will restart in 0.007648s
2025-09-30T14:58:37.092103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0] Write session: Do CDS request
2025-09-30T14:58:37.092110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:37.091529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896804911281727:7727]
2025-09-30T14:58:37.091566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:37.091615Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:37.091698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2958 reason: status is not ok: tablet will be restarted right now sessionId: src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0
2025-09-30T14:58:37.091873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2958 sessionId: src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0 is DEAD
2025-09-30T14:58:37.100795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:37.100901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:37.100918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2959
2025-09-30T14:58:37.101040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2959 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:37.101074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2959 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:37.101084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2959 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:37.101088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:37.101587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2959 sessionId:  describe result for acl check
2025-09-30T14:58:37.101623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:37.101626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:37.101628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:37.101634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896809206249045:10020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:37.102194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896809206249045:10020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:37.104227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896809206249045:10020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:37.107295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896809206249045:10020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:37.107310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896809206249045:10020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:37.107313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896809206249045:10020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:37.107322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2959 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:37.126613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:37.127122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:37.127360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:37.127380Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:37.127392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:37.127449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:37.127502Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896809116450348:7130]
2025-09-30T14:58:37.128194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:37.128510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:37.128563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:37.129229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:37.129311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.129318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.129319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.129321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.129322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.129323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.129325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.129327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.129328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.129329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.129330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.129332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.129333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.129334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.129336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.129341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.129352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.129356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.129361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.129366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.129370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.129374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.129379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.129383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.129388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.129392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.129396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.129401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.129405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.129410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.129420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.129429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.129440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.129447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.129458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.129470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.129475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.129481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.129490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.129496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.129501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.129511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.129516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.129521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.129525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.129530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.129535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.129542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.129552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.129557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.129565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.129570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.129580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.129585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.129594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.129600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.129609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.129615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.129621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.129626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.129675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:37.135456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:37.136381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:37.136399Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:37.136402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:37.136407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:37.136413Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2958 [2:7555896809116450348:7130]
2025-09-30T14:58:37.136432Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:37.136456Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:37.136460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:37.136464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:37.136467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:37.136484Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:37.136491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:37.136498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:37.136563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.136575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.136578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.136581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:37.136584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:37.136662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:37.136671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.136700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.136714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.136833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2958
2025-09-30T14:58:37.136858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2958
2025-09-30T14:58:37.136738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:37.136776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206249030:2454], now have 1 active actors on pipe
2025-09-30T14:58:37.136780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206249116:10020], now have 1 active actors on pipe
2025-09-30T14:58:37.136786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896809116450343:7130]
2025-09-30T14:58:37.136789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896809116450343:7130]
2025-09-30T14:58:37.136792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896809116450343:7130]
2025-09-30T14:58:37.136806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:37.136823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:37.136828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:37.136833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:37.136836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:37.136838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:37.136841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:37.136876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896809116450343:7130]
2025-09-30T14:58:37.136879Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:37.136883Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:37.137430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.137449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.137487Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:37.137501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:37.137504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:37.137507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:37.137517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:37.137527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:37.137546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:37.137737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.137754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.137779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:37.137886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2959 partition: 0 MaxSeqNo: 42 sessionId: src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0
2025-09-30T14:58:37.138258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|701e48e6-71c3bc0-a79155e6-3e1e1b56_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:37.141347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0] Write session: try to update token
2025-09-30T14:58:37.141368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:37.150797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:37.150823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:37.150825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:37.150827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:37.150837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896809116450343:7130]
2025-09-30T14:58:37.150842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896809116450343:7130]
2025-09-30T14:58:37.150847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896809116450343:7130]
2025-09-30T14:58:37.150887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:37.150894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.150897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:37.150904Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:37.150910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:37.150919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:37.151032Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:37.162535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2959 sessionId: src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:37.165544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:37.191849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896809206249566:7727]
2025-09-30T14:58:37.192137Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 2958, pipe: [1:7555896809206249566:7727]
2025-09-30T14:58:37.311033Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:37.311757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.311787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.311811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206249566:7727], now have 1 active actors on pipe
2025-09-30T14:58:37.312202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:37.312216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:37.312220Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:37.312279Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896809206249566:7727]
2025-09-30T14:58:37.312282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2959 reason: error at write: Disconnected sessionId: src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0
2025-09-30T14:58:37.312455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2959 sessionId: src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0 is DEAD
2025-09-30T14:58:37.312643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:37.312650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0] Write session will restart in 0.006102s
2025-09-30T14:58:37.312674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0] Write session: Do CDS request
2025-09-30T14:58:37.312679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:37.313187Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:37.322201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:37.322267Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:37.322287Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2960
2025-09-30T14:58:37.322482Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2960 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:37.322534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2960 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:37.322543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2960 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:37.322548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:37.323092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2960 sessionId:  describe result for acl check
2025-09-30T14:58:37.323136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:37.323144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:37.323146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:37.323152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896809206249624:10015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:37.323732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896809206249624:10015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:37.325986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896809206249624:10015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:37.329092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896809206249624:10015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:37.329110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896809206249624:10015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:37.329114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896809206249624:10015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:37.329122Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2960 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:37.342791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:37.343444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:37.343636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:37.343648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:37.343659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:37.343717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:37.343765Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896809116450660:7125]
2025-09-30T14:58:37.344413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:37.344788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:37.344860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:37.345207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:37.345304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.345311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.345313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.345314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.345316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.345317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.345319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.345320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.345322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.345323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.345325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.345326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.345328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.345329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.345330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.345336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.345347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.345351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.345356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.345360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.345364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.345369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.345373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.345377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.345382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.345386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.345390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.345394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.345398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.345402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.345410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.345419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.345425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.345431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.345436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.345442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.345447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.345450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.345453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.345457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.345460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.345463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.345469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.345472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.345475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.345478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.345481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.345484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.345486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.345489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.345493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.345496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.345499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.345502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.345505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.345508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.345510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.345513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.345516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.345519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.345544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:37.350876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:37.352299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:37.352317Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:37.352320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:37.352324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:37.352331Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2959 [2:7555896809116450660:7125]
2025-09-30T14:58:37.352346Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:37.352361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:37.352368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:37.352372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:37.352374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:37.352387Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:37.352392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:37.352397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:37.352454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.352464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.352466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.352469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:37.352471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:37.352531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:37.352540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.352550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.352559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.352574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:37.352592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896809116450655:7125]
2025-09-30T14:58:37.352599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896809116450655:7125]
2025-09-30T14:58:37.352602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896809116450655:7125]
2025-09-30T14:58:37.352610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:37.352621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:37.352624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:37.352624Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:37.352635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:37.352639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:37.352641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:37.352651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206249842:10015], now have 1 active actors on pipe
2025-09-30T14:58:37.352654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206249573:2454], now have 1 active actors on pipe
2025-09-30T14:58:37.352734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2959
2025-09-30T14:58:37.352740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2959
2025-09-30T14:58:37.352684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896809116450655:7125]
2025-09-30T14:58:37.352698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:37.352707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:37.352890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.352899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.352932Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|526dcce-b70a7997-34ae6edb-73585000_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:37.352948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:37.352956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:37.352959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:37.352970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:37.352988Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:37.353008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:37.353170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.353181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.353197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:37.353288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2960 partition: 0 MaxSeqNo: 42 sessionId: src_id|526dcce-b70a7997-34ae6edb-73585000_0
2025-09-30T14:58:37.353681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|91a746c-5ccc9c74-8ca3f5f8-4c123359_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|526dcce-b70a7997-34ae6edb-73585000_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:37.356507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|526dcce-b70a7997-34ae6edb-73585000_0] Write session: try to update token
2025-09-30T14:58:37.356524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|526dcce-b70a7997-34ae6edb-73585000_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:37.365016Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:37.365041Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:37.365043Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:37.365046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:37.365055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896809116450655:7125]
2025-09-30T14:58:37.365062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896809116450655:7125]
2025-09-30T14:58:37.365067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896809116450655:7125]
2025-09-30T14:58:37.365113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:37.365126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.365129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:37.365138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:37.365156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:37.365161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:37.365279Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:37.371772Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2960 sessionId: src_id|526dcce-b70a7997-34ae6edb-73585000_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:37.374603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:37.412566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896809206250113:7727]
2025-09-30T14:58:37.412874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 2959, pipe: [1:7555896809206250113:7727]
2025-09-30T14:58:37.485325Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:37.485736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.485761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.485813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206250113:7727], now have 1 active actors on pipe
2025-09-30T14:58:37.486117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896809206250113:7727]
2025-09-30T14:58:37.486159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:37.486162Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:37.486227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2960 reason: error at write: Disconnected sessionId: src_id|526dcce-b70a7997-34ae6edb-73585000_0
2025-09-30T14:58:37.486105Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:37.486345Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:37.486423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2960 sessionId: src_id|526dcce-b70a7997-34ae6edb-73585000_0 is DEAD
2025-09-30T14:58:37.486772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526dcce-b70a7997-34ae6edb-73585000_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:37.486784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526dcce-b70a7997-34ae6edb-73585000_0] Write session will restart in 0.007329s
2025-09-30T14:58:37.486810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526dcce-b70a7997-34ae6edb-73585000_0] Write session: Do CDS request
2025-09-30T14:58:37.486818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526dcce-b70a7997-34ae6edb-73585000_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:37.495751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|526dcce-b70a7997-34ae6edb-73585000_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:37.496006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:37.496025Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2961
2025-09-30T14:58:37.496164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2961 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:37.496197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2961 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:37.496203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2961 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:37.496208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:37.496796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2961 sessionId:  describe result for acl check
2025-09-30T14:58:37.496843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:37.496846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:37.496847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:37.496858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896809206250130:10007] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:37.497418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896809206250130:10007] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:37.499968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896809206250130:10007] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:37.505177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896809206250130:10007] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:37.505196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896809206250130:10007] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:37.505200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896809206250130:10007] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:37.505209Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2961 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:37.540264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:37.544040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:37.544314Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:37.544319Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:37.544330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:37.544394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:37.544445Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896809116450961:7121]
2025-09-30T14:58:37.545189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:37.545641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:37.545699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:37.546059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:37.546126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.546127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.546128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.546130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.546131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.546132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.546134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.546135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.546136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.546138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.546139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.546140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.546142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.546143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.546145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.546151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.546161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.546165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.546168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.546172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.546176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.546179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.546183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.546187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.546193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.546197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.546200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.546203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.546207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.546210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.546218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.546226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.546232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.546237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.546242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.546248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.546254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.546260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.546267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.546273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.546279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.546284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.546290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.546296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.546302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.546307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.546313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.546318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.546322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.546330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.546336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.546341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.546346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.546350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.546355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.546360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.546365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.546370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.546395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.546401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.546447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:37.552703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:37.554716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:37.555348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2960
2025-09-30T14:58:37.555388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2960
2025-09-30T14:58:37.554724Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:37.554727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:37.554731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:37.554739Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2960 [2:7555896809116450961:7121]
2025-09-30T14:58:37.554756Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:37.554776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:37.554781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:37.554784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:37.554786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:37.554804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:37.554811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:37.554819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:37.554890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.554893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.554895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.554899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:37.554902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:37.554981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:37.554984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.555000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.555013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.555032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:37.555049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896809116450956:7121]
2025-09-30T14:58:37.555052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896809116450956:7121]
2025-09-30T14:58:37.555054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896809116450956:7121]
2025-09-30T14:58:37.555063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:37.555077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:37.555093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:37.555096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:37.555103Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:37.555110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:37.555113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:37.555135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896809116450956:7121]
2025-09-30T14:58:37.555139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:37.555142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:37.555149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206250207:10007], now have 1 active actors on pipe
2025-09-30T14:58:37.555152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206250114:2454], now have 1 active actors on pipe
2025-09-30T14:58:37.555734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.555752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.555783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:37.555792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:37.555798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:37.555800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:37.555812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:37.555824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:37.555843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:37.556132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.556151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.556170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:37.558085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2961 partition: 0 MaxSeqNo: 42 sessionId: src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0
2025-09-30T14:58:37.561934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|526dcce-b70a7997-34ae6edb-73585000_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:37.565188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0] Write session: try to update token
2025-09-30T14:58:37.565213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:37.569684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:37.569712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:37.569716Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:37.569723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:37.569733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896809116450956:7121]
2025-09-30T14:58:37.569737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896809116450956:7121]
2025-09-30T14:58:37.569741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896809116450956:7121]
2025-09-30T14:58:37.569785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:37.569793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.569795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:37.569804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:37.569813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:37.569819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:37.569952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:37.586124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896809206250674:7727]
2025-09-30T14:58:37.586540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 2960, pipe: [1:7555896809206250674:7727]
2025-09-30T14:58:37.591969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2961 sessionId: src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:37.594651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:37.688005Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:37.688360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206250674:7727], now have 1 active actors on pipe
2025-09-30T14:58:37.688392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.688401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.688718Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:37.689579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:37.689666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2961 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0
2025-09-30T14:58:37.689855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2961 sessionId: src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0 is DEAD
2025-09-30T14:58:37.690070Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:37.690169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896809206250674:7727]
2025-09-30T14:58:37.691557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:37.691567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0] Write session will restart in 0.007265s
2025-09-30T14:58:37.691588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0] Write session: Do CDS request
2025-09-30T14:58:37.691593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:37.703567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:37.703656Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:37.703671Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2962
2025-09-30T14:58:37.703793Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2962 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:37.703819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2962 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:37.703826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2962 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:37.703830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:37.704147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2962 sessionId:  describe result for acl check
2025-09-30T14:58:37.704169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:37.704170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:37.704172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:37.704176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896809206250688:9996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:37.704711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896809206250688:9996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:37.707178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896809206250688:9996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:37.717311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896809206250688:9996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:37.717336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896809206250688:9996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:37.717340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896809206250688:9996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:37.717349Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2962 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:37.766312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:37.769281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:37.769500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:37.769512Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:37.769523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:37.769576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:37.769617Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896809116451267:7115]
2025-09-30T14:58:37.770294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:37.770737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:37.770787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:37.771107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:37.771174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.771176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.771177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.771178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.771180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.771181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.771182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.771183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.771185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.771186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.771188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.771189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.771190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.771191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.771192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.771198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.771208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.771212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.771217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.771221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.771225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.771229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.771234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.771238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.771279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.771284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.771287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.771291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.771296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.771300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.771309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.771317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.771324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.771330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.771335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.771340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.771345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.771351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.771360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.771365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.771369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.771374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.771379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.771384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.771390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.771396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.771401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.771406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.771410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.771416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.771421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.771427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.771431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.771436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.771440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.771446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.771450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.771454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.771462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.771467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.771507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:37.777085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:37.778509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:37.778526Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:37.778528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:37.778532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:37.778540Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2961 [2:7555896809116451267:7115]
2025-09-30T14:58:37.778555Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:37.778571Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:37.778575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:37.778577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:37.778580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:37.778594Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:37.778600Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:37.778607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:37.778672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.778683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.778686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.778690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:37.778692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:37.778758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:37.778761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.778774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.778787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.778806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:37.778822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896809116451262:7115]
2025-09-30T14:58:37.778825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896809116451262:7115]
2025-09-30T14:58:37.778827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896809116451262:7115]
2025-09-30T14:58:37.778835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:37.778847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:37.778849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:37.778850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:37.778852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:37.778865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:37.778869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:37.778879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206250677:2454], now have 1 active actors on pipe
2025-09-30T14:58:37.778884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206250726:9996], now have 1 active actors on pipe
2025-09-30T14:58:37.778915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896809116451262:7115]
2025-09-30T14:58:37.778926Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:37.778958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:37.779140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.779158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.779190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:37.779205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:37.779230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:37.779232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:37.779258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:37.779277Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:37.779298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:37.779457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.779466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.779480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:37.778963Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2961
2025-09-30T14:58:37.779020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2961
2025-09-30T14:58:37.779573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2962 partition: 0 MaxSeqNo: 42 sessionId: src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0
2025-09-30T14:58:37.779958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a009b917-61a86b5f-c53b60bf-ccfaa131_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:37.783027Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0] Write session: try to update token
2025-09-30T14:58:37.783047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:37.790401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896809206251217:7727]
2025-09-30T14:58:37.790661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 2961, pipe: [1:7555896809206251217:7727]
2025-09-30T14:58:37.791278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206251217:7727], now have 1 active actors on pipe
2025-09-30T14:58:37.791303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:37.791307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:37.791315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896809116451262:7115]
2025-09-30T14:58:37.791357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:37.791372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:37.791535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:37.791670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:37.791804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:37.791947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:37.792139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:37.792171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:37.806042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2962 sessionId: src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:37.809034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:37.813064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:37.811577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.811605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.812861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:37.812891Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:37.812895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:37.812897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:37.812899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:37.812908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896809116451262:7115]
2025-09-30T14:58:37.812913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896809116451262:7115]
2025-09-30T14:58:37.812917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896809116451262:7115]
2025-09-30T14:58:37.812956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:37.812965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:37.812967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.812970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:37.812970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:37.812973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:37.813119Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:37.949818Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:37.959433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:37.959472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:37.959665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:37.959738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:37.959812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:37.959885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:37.959935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:37.959945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:37.960025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:37.960096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:37.960166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:37.960238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:37.960296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:37.960305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:37.960385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:37.960460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:37.960533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:37.960606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:37.960655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:37.960663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:37.960741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:37.960830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:37.960900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:37.960973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:37.961023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:37.961038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:37.961116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:37.961185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:37.961264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:37.961330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:37.961375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:37.961378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:37.961451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:37.961515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:37.961580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:37.961651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:37.961697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:37.961701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:37.961775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:37.961836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:37.961903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:37.961967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:37.962010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:37.962014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:37.962091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:37.962154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:37.962221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:37.962288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:37.962335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:37.962338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:37.962410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:37.962470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:37.962537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:37.962607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:37.962658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:37.962661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:37.962734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:37.963355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896809206251217:7727]
2025-09-30T14:58:37.962796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:37.963390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:37.962859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:37.962927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:37.962970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:37.963436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:37.963438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:37.962974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:37.963465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2962 reason: error at write: Disconnected sessionId: src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0
2025-09-30T14:58:37.963937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:37.963948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0] Write session will restart in 0.009645s
2025-09-30T14:58:37.963973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0] Write session: Do CDS request
2025-09-30T14:58:37.963979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:37.963651Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2962 sessionId: src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0 is DEAD
2025-09-30T14:58:37.964614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:37.974736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:37.974858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:37.974878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2963
2025-09-30T14:58:37.975045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2963 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:37.975079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2963 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:37.975090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2963 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:37.975095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:37.975532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2963 sessionId:  describe result for acl check
2025-09-30T14:58:37.975565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:37.975572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:37.975574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:37.975581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896809206251293:9994] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:37.976136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896809206251293:9994] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:37.978802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896809206251293:9994] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:37.981924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896809206251293:9994] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:37.981941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896809206251293:9994] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:37.981945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896809206251293:9994] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:37.981954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2963 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:37.994839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:37.996562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:37.996813Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:37.996825Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:37.996837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:37.996897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:37.996942Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896809116451574:7099]
2025-09-30T14:58:37.997596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:37.997902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:37.997953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:37.998296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:37.998377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.998385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.998386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.998387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.998389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.998391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.998392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.998393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.998395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.998396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.998398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.998399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.998400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.998402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.998403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.998409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.998419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.998423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.998428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.998433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.998437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.998442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.998446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.998450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.998455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.998459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.998464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.998468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.998472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.998477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.998484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.998493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:37.998499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.998505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:37.998511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.998522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:37.998527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.998538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:37.998544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.998554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:37.998559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.998570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:37.998582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.998588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:37.998593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.998597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:37.998603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.998608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:37.998613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.998618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:37.998624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.998636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:37.998641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.998651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:37.998658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.998668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:37.998673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.998684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:37.998690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.998701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:37.998772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:38.004488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:38.005629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:38.005650Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:38.005653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:38.005657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:38.005663Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2962 [2:7555896809116451574:7099]
2025-09-30T14:58:38.005681Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:38.005696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:38.005704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:38.005708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:38.005711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:38.005726Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:38.005737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:38.005745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:38.005814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.005821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.005823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.005826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:38.005829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:38.005903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:38.005911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.005925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.005942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.005963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:38.005984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896809116451567:7099]
2025-09-30T14:58:38.005989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896809116451567:7099]
2025-09-30T14:58:38.005991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896809116451567:7099]
2025-09-30T14:58:38.005999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:38.006010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:38.006013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:38.006013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:38.006016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:38.006029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:38.006032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:38.006043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206251540:9994], now have 1 active actors on pipe
2025-09-30T14:58:38.006052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896809206251223:2454], now have 1 active actors on pipe
2025-09-30T14:58:38.006084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896809116451567:7099]
2025-09-30T14:58:38.006096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:38.006109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:38.008408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2962
2025-09-30T14:58:38.008445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2962
2025-09-30T14:58:38.008739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.008768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.008799Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:38.008816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:38.008820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:38.008824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:38.008836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:38.008863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:38.008885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:38.009124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.009144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.009168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:38.009275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2963 partition: 0 MaxSeqNo: 42 sessionId: src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0
2025-09-30T14:58:38.009685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b00d8c9-862bcce6-62b8012b-28aef2dd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:38.012590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0] Write session: try to update token
2025-09-30T14:58:38.012611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:38.030356Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2963 sessionId: src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:38.033825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:38.034893Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:38.034919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:38.034929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896809116451567:7099]
2025-09-30T14:58:38.034972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:38.034976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:38.035166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:38.035361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:38.035517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:38.035673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:38.035890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:38.035935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:38.036401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.036423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.036460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:38.036594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:38.057144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:38.057169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:38.057172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:38.057174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:38.057184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896809116451567:7099]
2025-09-30T14:58:38.057189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896809116451567:7099]
2025-09-30T14:58:38.057194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896809116451567:7099]
2025-09-30T14:58:38.057234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:38.057240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.057243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:38.057251Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:38.057258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:38.057262Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:38.057384Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:38.063673Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896813501219077:7727]
2025-09-30T14:58:38.064820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 2962, pipe: [1:7555896813501219077:7727]
2025-09-30T14:58:38.171200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:38.181094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.181129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.181310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.181388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.181460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.181536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.181586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.181596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.181670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.181740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.181809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.181887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.181939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.181952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.182033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.182099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.182169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.182237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.182282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.182285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.182361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.182428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.182497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.182562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.182606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.182609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.182684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.182752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.182821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.182892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.182934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.182937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.183010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.183071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.183136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.183207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.183435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.183452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.183525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.183594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.183672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.183749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.183801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.183812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.183882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.183940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.184017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.184087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.184135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.184143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.184215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.184280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.184347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.184414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.184464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.184473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.184543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.184609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.184680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.184767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.184822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.184831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.184909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501219077:7727], now have 1 active actors on pipe
2025-09-30T14:58:38.185262Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896813501219077:7727]
2025-09-30T14:58:38.185269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:38.185274Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:38.185300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:38.185316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2963 reason: error at write: Disconnected sessionId: src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0
2025-09-30T14:58:38.185795Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2963 sessionId: src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0 is DEAD
2025-09-30T14:58:38.185824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:38.185836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0] Write session will restart in 0.009877s
2025-09-30T14:58:38.185872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0] Write session: Do CDS request
2025-09-30T14:58:38.185879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:38.186466Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:38.196804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:38.196833Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:38.196849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2964
2025-09-30T14:58:38.197068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2964 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:38.197100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2964 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:38.197110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2964 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:38.197115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:38.197604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2964 sessionId:  describe result for acl check
2025-09-30T14:58:38.197642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:38.197652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:38.197656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:38.197661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896813501219100:9979] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:38.198274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896813501219100:9979] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:38.200873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896813501219100:9979] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:38.204108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896813501219100:9979] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:38.204125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896813501219100:9979] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:38.204129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896813501219100:9979] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:38.204138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2964 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:38.232010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:38.232810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:38.233001Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:38.233023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:38.233033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:38.233095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:38.233135Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896813411419210:7085]
2025-09-30T14:58:38.233820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:38.234397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:38.234449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:38.234815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:38.234874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.234875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.234876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.234877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.234879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.234881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.234882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.234883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.234885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.234886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.234887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.234889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.234890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.234891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.234892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.234899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.234910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.234915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.234920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.234925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.234929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.234934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.234938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.234943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.234948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.234952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.234956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.234960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.234965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.234969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.234979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.234988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.234994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.234999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.235003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.235009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.235013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.235019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.235025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.235031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.235036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.235043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.235048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.235055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.235059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.235065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.235069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.235074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.235079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.235084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.235092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.235097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.235114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.235119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.235124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.235129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.235134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.235139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.235144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.235150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.235195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:38.241353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:38.242923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:38.242946Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:38.242949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:38.242953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:38.242960Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2963 [2:7555896813411419210:7085]
2025-09-30T14:58:38.242976Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:38.242994Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:38.242997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:38.243001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:38.243003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:38.243020Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:38.243027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:38.243033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:38.243097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.243100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.243102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.243105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:38.243108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:38.243183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:38.243194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.243209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.243222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.243240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:38.243277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501219207:9979], now have 1 active actors on pipe
2025-09-30T14:58:38.243281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501219084:2454], now have 1 active actors on pipe
2025-09-30T14:58:38.243288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896813411419205:7085]
2025-09-30T14:58:38.243291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896813411419205:7085]
2025-09-30T14:58:38.243293Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896813411419205:7085]
2025-09-30T14:58:38.243302Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:38.243313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:38.243315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:38.243316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:38.243319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:38.243330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:38.243333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:38.243368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896813411419205:7085]
2025-09-30T14:58:38.243376Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:38.243662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2963
2025-09-30T14:58:38.243669Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2963
2025-09-30T14:58:38.243525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:38.244178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.244195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.244234Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:38.244247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:38.244256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:38.244259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:38.244268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:38.244278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:38.244309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:38.244763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.244779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.244801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:38.245318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|851c07c7-35dcf5b0-9bc8f5c7-c2e7aede_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:38.244942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2964 partition: 0 MaxSeqNo: 42 sessionId: src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0
2025-09-30T14:58:38.248339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0] Write session: try to update token
2025-09-30T14:58:38.248360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:38.257179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:38.257205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:38.257208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:38.257210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:38.257219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896813411419205:7085]
2025-09-30T14:58:38.257223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896813411419205:7085]
2025-09-30T14:58:38.257228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896813411419205:7085]
2025-09-30T14:58:38.257269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:38.257274Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:38.257276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.257279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:38.257281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:38.257286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:38.257418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:38.268945Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2964 sessionId: src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:38.271798Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:38.287362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896813501219628:7727]
2025-09-30T14:58:38.287659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 2963, pipe: [1:7555896813501219628:7727]
2025-09-30T14:58:38.374290Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:38.375070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.375089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.375109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501219628:7727], now have 1 active actors on pipe
2025-09-30T14:58:38.375350Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:38.375787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:38.375795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0] Write session will restart in 0.009496s
2025-09-30T14:58:38.375813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0] Write session: Do CDS request
2025-09-30T14:58:38.375826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:38.375391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:38.375407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:38.375409Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:38.375466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896813501219628:7727]
2025-09-30T14:58:38.375474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2964 reason: error at write: Disconnected sessionId: src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0
2025-09-30T14:58:38.375645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2964 sessionId: src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0 is DEAD
2025-09-30T14:58:38.386870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:38.386887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:38.386907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2965
2025-09-30T14:58:38.387110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2965 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:38.387148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2965 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:38.387159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2965 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:38.387163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:38.387587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2965 sessionId:  describe result for acl check
2025-09-30T14:58:38.387623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:38.387627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:38.387629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:38.387635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896813501219653:9971] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:38.388211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896813501219653:9971] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:38.390392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896813501219653:9971] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:38.393481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896813501219653:9971] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:38.393498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896813501219653:9971] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:38.393502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896813501219653:9971] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:38.393510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2965 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:38.406889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:38.407239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:38.407442Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:38.407453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:38.407463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:38.407551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:38.407594Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896813411419536:7083]
2025-09-30T14:58:38.408277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:38.408578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:38.408622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:38.408940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:38.409015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.409022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.409023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.409024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.409025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.409027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.409028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.409029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.409030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.409031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.409033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.409034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.409035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.409036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.409037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.409042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.409051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.409055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.409059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.409062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.409066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.409069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.409073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.409076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.409080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.409084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.409087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.409091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.409094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.409098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.409105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.409113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.409119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.409125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.409131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.409136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.409141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.409145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.409151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.409155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.409159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.409164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.409168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.409173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.409177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.409181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.409186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.409191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.409195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.409200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.409204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.409209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.409213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.409218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.409230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.409235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.409239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.409244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.409249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.409253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.409294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:38.414780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:38.415764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:38.415782Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:38.415784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:38.415788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:38.415799Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2964 [2:7555896813411419536:7083]
2025-09-30T14:58:38.415824Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:38.415844Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:38.415852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:38.415856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:38.415858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:38.415874Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:38.415888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:38.415896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:38.415962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.415971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.415974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.415977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:38.415980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:38.416048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:38.416056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.416068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.416083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.416106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:38.416128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501219637:2454], now have 1 active actors on pipe
2025-09-30T14:58:38.416136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501219844:9971], now have 1 active actors on pipe
2025-09-30T14:58:38.416142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896813411419527:7083]
2025-09-30T14:58:38.416145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896813411419527:7083]
2025-09-30T14:58:38.416148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896813411419527:7083]
2025-09-30T14:58:38.416165Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:38.416188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:38.416192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:38.416197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:38.416200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:38.416203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:38.416206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:38.416200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2964
2025-09-30T14:58:38.416243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896813411419527:7083]
2025-09-30T14:58:38.416251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:38.416222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2964
2025-09-30T14:58:38.416269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:38.416271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.416279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.416322Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:38.416334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:38.416338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:38.416340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:38.416350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:38.416358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:38.416382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:38.416555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.416563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.416576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:38.416658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2965 partition: 0 MaxSeqNo: 42 sessionId: src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0
2025-09-30T14:58:38.417068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|186aa977-8a089327-d5e7d4a1-e595d1b0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:38.419920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0] Write session: try to update token
2025-09-30T14:58:38.419947Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:38.428715Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:38.428739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:38.428742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:38.428744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:38.428766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896813411419527:7083]
2025-09-30T14:58:38.428772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896813411419527:7083]
2025-09-30T14:58:38.428776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896813411419527:7083]
2025-09-30T14:58:38.428817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:38.428824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.428827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:38.428826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:38.428833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:38.428838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:38.428957Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:38.436217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2965 sessionId: src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:38.438962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:38.475438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896813501220181:7727]
2025-09-30T14:58:38.475721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 2964, pipe: [1:7555896813501220181:7727]
2025-09-30T14:58:38.540555Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:38.540911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.540929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.540950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501220181:7727], now have 1 active actors on pipe
2025-09-30T14:58:38.541162Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:38.541169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896813501220181:7727]
2025-09-30T14:58:38.541170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:38.541175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:38.541211Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:38.541252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2965 reason: error at write: Disconnected sessionId: src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0
2025-09-30T14:58:38.541430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2965 sessionId: src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0 is DEAD
2025-09-30T14:58:38.541584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:38.541595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0] Write session will restart in 0.006478s
2025-09-30T14:58:38.541616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0] Write session: Do CDS request
2025-09-30T14:58:38.541622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:38.549769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:38.549749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:38.549842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:38.549859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2966
2025-09-30T14:58:38.550019Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2966 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:38.550073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2966 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:38.550085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2966 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:38.550090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:38.550563Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2966 sessionId:  describe result for acl check
2025-09-30T14:58:38.550605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:38.550614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:38.550617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:38.550624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896813501220203:9963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:38.550871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:38.551043Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:38.551055Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:38.551064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:38.551112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:38.551153Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896813411419591:7081]
2025-09-30T14:58:38.551187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896813501220203:9963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:38.551854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:38.552187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:38.552250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:38.552603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:38.552666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.552672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.552674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.552675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.552676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.552677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.552678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.552680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.552681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.552683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.552684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.552685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.552686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.552687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.552689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.552695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.552704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.552708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.552712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.552716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.552720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.552724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.552729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.552733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.552736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.552740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.552744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.552765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.552770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.552774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.552781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.552788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.552794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.552799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.552804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.552808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.552813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.552819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.552825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.552830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.552833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.552839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.552843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.552849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.552853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.552859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.552864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.552870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.552877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.552882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.552886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.552895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.552900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.552908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.552919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.552925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.552932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.552936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.552946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.552953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.553007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:38.553185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896813501220203:9963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:38.557916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896813501220203:9963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:38.557935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896813501220203:9963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:38.557939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896813501220203:9963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:38.557948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2966 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:38.558308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:38.559193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:38.559211Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:38.559214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:38.559218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:38.559224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2965 [2:7555896813411419591:7081]
2025-09-30T14:58:38.559240Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:38.559270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:38.559279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:38.559283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:38.559286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:38.559302Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:38.559309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:38.559315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:38.559376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.559386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.559388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.559391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:38.559393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:38.559599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2965
2025-09-30T14:58:38.559602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2965
2025-09-30T14:58:38.559779Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:38.559789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.559802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.559812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.559836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:38.559867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501220183:2454], now have 1 active actors on pipe
2025-09-30T14:58:38.559870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501220242:9963], now have 1 active actors on pipe
2025-09-30T14:58:38.559892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.559900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.559915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896813411419586:7081]
2025-09-30T14:58:38.559922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896813411419586:7081]
2025-09-30T14:58:38.559925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896813411419586:7081]
2025-09-30T14:58:38.559938Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:38.559955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:38.559966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:38.559970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:38.559972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:38.559972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:38.559976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:38.559994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:38.560005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:38.560008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:38.560012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:38.560023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:38.560035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:38.560069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896813411419586:7081]
2025-09-30T14:58:38.560087Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:38.560099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:38.560107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:38.560316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.560331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.560353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:38.560489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2966 partition: 0 MaxSeqNo: 42 sessionId: src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0
2025-09-30T14:58:38.560888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a74dfa-e766e587-b9ddfb12-450d91e8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:38.563741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0] Write session: try to update token
2025-09-30T14:58:38.563759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:38.572116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:38.572139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:38.572149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896813411419586:7081]
2025-09-30T14:58:38.572195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:38.572205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:38.572371Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:38.572517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:38.572667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:38.572826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:38.573023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:38.573064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:38.578592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2966 sessionId: src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:38.581230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:38.581421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.581448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.581481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:38.581579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:38.583073Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:38.583089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:38.583091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:38.583092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:38.583099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896813411419586:7081]
2025-09-30T14:58:38.583106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896813411419586:7081]
2025-09-30T14:58:38.583108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896813411419586:7081]
2025-09-30T14:58:38.583137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:38.583142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.583143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:38.583156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:38.583174Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:38.583179Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:38.583295Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:38.641361Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896813501220261:7727]
2025-09-30T14:58:38.641671Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 2965, pipe: [1:7555896813501220261:7727]
2025-09-30T14:58:38.697337Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:38.705521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.705555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.705727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.705796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.705866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.705930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.705974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.705987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.706065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.706127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.706198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.706269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.706314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.706322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.706387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.706449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.706515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.706582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.706627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.706634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.706701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.706775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.706841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.706907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.706951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.706959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.707024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.707090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.707228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.707374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.707418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.707427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.707495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.707556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.707620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.707685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.707731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.707741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.707810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.707872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.707937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.708000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.708043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.708052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.708122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.708186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.708252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.708317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.708361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.708364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.708431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.708488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.708559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.708627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.708672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.708680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.708762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:38.708826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:38.708894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:38.708960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:38.709006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:38.709013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:38.709081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501220261:7727], now have 1 active actors on pipe
2025-09-30T14:58:38.709331Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896813501220261:7727]
2025-09-30T14:58:38.709349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:38.709375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:38.709378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:38.709408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2966 reason: error at write: Disconnected sessionId: src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0
2025-09-30T14:58:38.709603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2966 sessionId: src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0 is DEAD
2025-09-30T14:58:38.709735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:38.709767Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0] Write session will restart in 0.008998s
2025-09-30T14:58:38.709793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0] Write session: Do CDS request
2025-09-30T14:58:38.709798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:38.710170Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:38.715829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:38.716619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:38.716822Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:38.716835Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:38.716847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:38.716909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:38.716956Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896813411419651:7082]
2025-09-30T14:58:38.717587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:38.717879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:38.717931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:38.718257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:38.718308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.718313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.718314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.718315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.718315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.718316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.718317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.718318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.718319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.718319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.718320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.718321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.718321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.718322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.718323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.718326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.718333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.718335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.718339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.718342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.718344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.718346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.718349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.718351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.718353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.718355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.718358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.718360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.718362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.718365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.718371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.718376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.718379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.718383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.718386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.718389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.718392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.718395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.718399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.718402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.718404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.718408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.718410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.718413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.718415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.718418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.718421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.718424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.718426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.718430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.718432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.718435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.718438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.718441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.718443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.718446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.718448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.718452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.718454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.718457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.718482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:38.719696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:38.719798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:38.719819Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2967
2025-09-30T14:58:38.719935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2967 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:38.719972Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2967 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:38.719977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2967 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:38.719981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:38.720407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2967 sessionId:  describe result for acl check
2025-09-30T14:58:38.720445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:38.720453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:38.720455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:38.720461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896813501220288:9954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:38.721057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896813501220288:9954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:38.723310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896813501220288:9954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:38.723361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:38.724285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:38.724301Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:38.724304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:38.724307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:38.724313Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2966 [2:7555896813411419651:7082]
2025-09-30T14:58:38.724326Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:38.724340Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:38.724344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:38.724347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:38.724349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:38.724363Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:38.724369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:38.724376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:38.724435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.724444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.724446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.724449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:38.724451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:38.724510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:38.724518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.724530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.724543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.724566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:38.724591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501220263:2454], now have 1 active actors on pipe
2025-09-30T14:58:38.724601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896813411419646:7082]
2025-09-30T14:58:38.724603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896813411419646:7082]
2025-09-30T14:58:38.724605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896813411419646:7082]
2025-09-30T14:58:38.724592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2966
2025-09-30T14:58:38.724617Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:38.724625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:38.724628Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:38.724630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:38.724632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:38.724647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:38.724649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:38.724678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896813411419646:7082]
2025-09-30T14:58:38.724690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:38.724700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:38.729222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896813501220288:9954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:38.729247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896813501220288:9954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:38.729251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896813501220288:9954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:38.729259Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2967 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:38.729602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501220327:9954], now have 1 active actors on pipe
2025-09-30T14:58:38.729652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2966
2025-09-30T14:58:38.729711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.729722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.729749Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|45f92296-304fd7b1-94f033dd-e943ba63_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:38.729764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:38.729773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:38.729776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:38.729788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:38.729802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:38.729836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:38.730055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.730064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.730076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:38.730141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2967 partition: 0 MaxSeqNo: 42 sessionId: src_id|45f92296-304fd7b1-94f033dd-e943ba63_0
2025-09-30T14:58:38.730499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|956d50f5-ab2a419f-46adab3e-fe3f19d5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|45f92296-304fd7b1-94f033dd-e943ba63_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:38.733274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45f92296-304fd7b1-94f033dd-e943ba63_0] Write session: try to update token
2025-09-30T14:58:38.733294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45f92296-304fd7b1-94f033dd-e943ba63_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:38.736088Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:38.736108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:38.736110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:38.736112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:38.736120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896813411419646:7082]
2025-09-30T14:58:38.736124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896813411419646:7082]
2025-09-30T14:58:38.736128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896813411419646:7082]
2025-09-30T14:58:38.736164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:38.736168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:38.736171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.736173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:38.736176Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:38.736180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:38.736298Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:38.748297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2967 sessionId: src_id|45f92296-304fd7b1-94f033dd-e943ba63_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:38.750979Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:38.809292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896813501220332:7727]
2025-09-30T14:58:38.809665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 2966, pipe: [1:7555896813501220332:7727]
2025-09-30T14:58:38.849740Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:38.850152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.850168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.850187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501220332:7727], now have 1 active actors on pipe
2025-09-30T14:58:38.850443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:38.850458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:38.850488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:38.850519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2967 reason: error at write: Disconnected sessionId: src_id|45f92296-304fd7b1-94f033dd-e943ba63_0
2025-09-30T14:58:38.850545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896813501220332:7727]
2025-09-30T14:58:38.850702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2967 sessionId: src_id|45f92296-304fd7b1-94f033dd-e943ba63_0 is DEAD
2025-09-30T14:58:38.850439Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:38.850950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f92296-304fd7b1-94f033dd-e943ba63_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:38.850961Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f92296-304fd7b1-94f033dd-e943ba63_0] Write session will restart in 0.008177s
2025-09-30T14:58:38.850986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f92296-304fd7b1-94f033dd-e943ba63_0] Write session: Do CDS request
2025-09-30T14:58:38.851001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f92296-304fd7b1-94f033dd-e943ba63_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:38.858115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:38.858656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:38.858844Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:38.858854Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:38.858874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:38.858932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:38.858976Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896813411419710:7073]
2025-09-30T14:58:38.859714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:38.860039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:38.860090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:38.860444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:38.860520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.860528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.860529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.860530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.860532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.860533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.860534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.860536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.860537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.860541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.860542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.860543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.860544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.860545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.860546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.860551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.860562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.860566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.860570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.860574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.860579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.860584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.860588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.860592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.860596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.860600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.860604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.860608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.860612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.860616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.860625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.860634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:38.860653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.860668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:38.860673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.860679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:38.860683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.860688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:38.860694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.860701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:38.860706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.860711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:38.860716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.860721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:38.860726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.860733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:38.860738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.860757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:38.860761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.860816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|45f92296-304fd7b1-94f033dd-e943ba63_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:38.860767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:38.860772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.860777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.860782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.860788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.860793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.860798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.860802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.860807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:38.860811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.860817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:38.860864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:38.860915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:38.860933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2968
2025-09-30T14:58:38.861093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2968 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:38.861127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2968 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:38.861132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2968 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:38.861137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:38.861581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2968 sessionId:  describe result for acl check
2025-09-30T14:58:38.861608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:38.861610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:38.861611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:38.861617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896813501220359:9953] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:38.862158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896813501220359:9953] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:38.864721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896813501220359:9953] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:38.866487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:38.867484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:38.867502Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:38.867504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:38.867508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:38.867514Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2967 [2:7555896813411419710:7073]
2025-09-30T14:58:38.867533Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:38.867547Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:38.867551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:38.867554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:38.867556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:38.867575Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:38.867581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:38.867588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:38.867645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.867646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.867648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.867654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:38.867656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:38.867717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:38.867720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.867732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:38.867742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:38.867758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:38.867773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896813411419705:7073]
2025-09-30T14:58:38.867775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896813411419705:7073]
2025-09-30T14:58:38.867777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896813411419705:7073]
2025-09-30T14:58:38.867785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:38.867797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:38.867808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:38.867810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:38.867841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896813411419705:7073]
2025-09-30T14:58:38.867843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:38.867955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:38.867970Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:38.867972Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:38.867977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:38.867976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896813501220359:9953] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:38.867994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896813501220359:9953] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:38.867997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896813501220359:9953] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:38.868006Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2968 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:38.868161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2967
2025-09-30T14:58:38.868432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2967
2025-09-30T14:58:38.868390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501220334:2454], now have 1 active actors on pipe
2025-09-30T14:58:38.868417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501220394:9953], now have 1 active actors on pipe
2025-09-30T14:58:38.868508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.868517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.868538Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:38.868552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:38.868555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:38.868559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:38.868568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:38.868578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:38.868591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:38.868839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.868850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.868864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:38.868991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2968 partition: 0 MaxSeqNo: 42 sessionId: src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0
2025-09-30T14:58:38.869396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|45f92296-304fd7b1-94f033dd-e943ba63_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:38.872371Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0] Write session: try to update token
2025-09-30T14:58:38.872393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:38.883238Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:38.883283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:38.883286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:38.883288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:38.883298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896813411419705:7073]
2025-09-30T14:58:38.883303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896813411419705:7073]
2025-09-30T14:58:38.883308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896813411419705:7073]
2025-09-30T14:58:38.883350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:38.883358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:38.883360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:38.883517Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:38.886108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:38.886120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:38.886125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:38.888244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2968 sessionId: src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:38.890967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:38.950915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896813501220401:7727]
2025-09-30T14:58:38.951414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 2967, pipe: [1:7555896813501220401:7727]
2025-09-30T14:58:38.997712Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:38.997985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:38.998008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:38.998051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501220401:7727], now have 1 active actors on pipe
2025-09-30T14:58:38.998335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:38.998353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896813501220401:7727]
2025-09-30T14:58:38.998357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:38.998377Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:38.998422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2968 reason: error at write: Disconnected sessionId: src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0
2025-09-30T14:58:38.998630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2968 sessionId: src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0 is DEAD
2025-09-30T14:58:38.998676Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:38.998750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:38.998760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0] Write session will restart in 0.006496s
2025-09-30T14:58:38.998783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0] Write session: Do CDS request
2025-09-30T14:58:38.998792Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:39.005195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:39.006107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:39.006300Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:39.006311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:39.006322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:39.006373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:39.006418Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896817706387066:7077]
2025-09-30T14:58:39.006799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:39.006934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:39.006955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2969
2025-09-30T14:58:39.007062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:39.007109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2969 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:39.007141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2969 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:39.007146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2969 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:39.007150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:39.007426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:39.007488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:39.007616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2969 sessionId:  describe result for acl check
2025-09-30T14:58:39.007652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:39.007659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:39.007661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:39.007666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896817796187722:9938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:39.007848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:39.007914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.007920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.007922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.007923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.007925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.007926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.007928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.007929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.007930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.007932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.007933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.007935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.007936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.007938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.007939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.007945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.007954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.007959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.007965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.007970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.007975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.007979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.007985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.007988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.007993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.007998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.008002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.008007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.008011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.008015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.008023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.008031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.008038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.008044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.008049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.008055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.008060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.008066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.008071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.008077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.008081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.008087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.008092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.008097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.008103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.008114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.008119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.008124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.008134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.008140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.008150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.008155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.008164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.008170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.008180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.008186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.008195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.008200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.008209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.008214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.008249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896817796187722:9938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:39.008266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:39.010403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896817796187722:9938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:39.013476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896817796187722:9938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:39.013492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896817796187722:9938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:39.013498Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896817796187722:9938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:39.013505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2969 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:39.013684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:39.014523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:39.014544Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:39.014546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:39.014552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:39.014558Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2968 [2:7555896817706387066:7077]
2025-09-30T14:58:39.014573Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:39.014586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:39.014589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:39.014593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:39.014595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:39.014610Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:39.014622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:39.014628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:39.014685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.014693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.014695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.014699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:39.014702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:39.014768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:39.014777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.014790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.014804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.014830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:39.014853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796187772:9938], now have 1 active actors on pipe
2025-09-30T14:58:39.014861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896813501220402:2454], now have 1 active actors on pipe
2025-09-30T14:58:39.014867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896817706387061:7077]
2025-09-30T14:58:39.014869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896817706387061:7077]
2025-09-30T14:58:39.014871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896817706387061:7077]
2025-09-30T14:58:39.014882Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:39.014871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2968
2025-09-30T14:58:39.014897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:39.014905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2968
2025-09-30T14:58:39.014898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:39.014901Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:39.014903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:39.014915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:39.014919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:39.014960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.014970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.014981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896817706387061:7077]
2025-09-30T14:58:39.014992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:39.015002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:39.015025Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:39.015040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:39.015044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:39.015046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:39.015056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:39.015064Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:39.015087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:39.015227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.015237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.015263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:39.015388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2969 partition: 0 MaxSeqNo: 42 sessionId: src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0
2025-09-30T14:58:39.015721Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f4f5375e-5c3c889e-8aedc6b6-b0ab4b14_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:39.018652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0] Write session: try to update token
2025-09-30T14:58:39.018671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:39.028215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:39.028241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:39.028244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:39.028246Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:39.028256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896817706387061:7077]
2025-09-30T14:58:39.028261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896817706387061:7077]
2025-09-30T14:58:39.028265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896817706387061:7077]
2025-09-30T14:58:39.028306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:39.028314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.028317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:39.028361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:39.028369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:39.028373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:39.028473Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:39.034433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2969 sessionId: src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:39.037218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:39.099370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896817796187793:7727]
2025-09-30T14:58:39.099699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 2968, pipe: [1:7555896817796187793:7727]
2025-09-30T14:58:39.142459Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:39.142777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.142799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.142838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796187793:7727], now have 1 active actors on pipe
2025-09-30T14:58:39.143066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:39.143068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:39.143082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:39.143115Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896817796187793:7727]
2025-09-30T14:58:39.143157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2969 reason: error at write: Disconnected sessionId: src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0
2025-09-30T14:58:39.143361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2969 sessionId: src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0 is DEAD
2025-09-30T14:58:39.143535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:39.143548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0] Write session will restart in 0.009523s
2025-09-30T14:58:39.143068Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:39.143572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0] Write session: Do CDS request
2025-09-30T14:58:39.143578Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:39.150858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:39.151686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:39.151887Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:39.151901Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:39.151913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:39.151983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:39.152026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896817706387165:7054]
2025-09-30T14:58:39.152732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:39.153128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:39.153194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:39.153549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:39.153630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.153637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.153641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.153642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.153643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.153645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.153649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.153650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.153652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.153653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.153654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.153655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.153656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.153657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.153658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.153665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.153676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.153680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.153684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.153689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.153693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.153697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.153701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.153704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.153709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.153712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.153716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.153721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.153725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.153729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.153738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.153746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.153753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.153759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.153764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.153769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.153774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.153780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.153786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.153792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.153806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.153812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.153822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.153828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.153832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.153837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.153842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.153847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.153901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.153907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.153912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.153918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.153923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.153928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.153933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.153938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.153943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.153948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.153952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.153957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.154007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:39.154778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:39.154936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:39.154953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2970
2025-09-30T14:58:39.155338Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2970 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:39.155390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2970 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:39.155400Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2970 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:39.155406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:39.155787Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2970 sessionId:  describe result for acl check
2025-09-30T14:58:39.155825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:39.155834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:39.155836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:39.155842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896817796187831:9930] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:39.156406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896817796187831:9930] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:39.158304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896817796187831:9930] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:39.160907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:39.161843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:39.161866Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:39.161871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:39.161875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:39.161883Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2969 [2:7555896817706387165:7054]
2025-09-30T14:58:39.161901Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:39.161923Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:39.161928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:39.161931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:39.161933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:39.161950Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:39.161964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:39.161972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:39.162032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.162040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.162043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.162046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:39.162049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:39.162119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:39.162128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.162141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.162159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.162183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:39.162210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796187803:2454], now have 1 active actors on pipe
2025-09-30T14:58:39.162222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896817706387160:7054]
2025-09-30T14:58:39.162224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896817706387160:7054]
2025-09-30T14:58:39.162227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896817706387160:7054]
2025-09-30T14:58:39.162241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:39.162251Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:39.162255Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:39.162257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:39.162261Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:39.162237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2969
2025-09-30T14:58:39.162278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:39.162285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:39.162327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896817706387160:7054]
2025-09-30T14:58:39.162345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:39.162360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:39.163767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896817796187831:9930] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:39.163784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896817796187831:9930] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:39.163787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896817796187831:9930] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:39.163795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2970 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:39.164058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796187870:9930], now have 1 active actors on pipe
2025-09-30T14:58:39.164109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2969
2025-09-30T14:58:39.164191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.164203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.164228Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:39.164248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:39.164255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:39.164258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:39.164269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:39.164281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:39.164302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:39.164442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.164450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.164461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:39.164553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2970 partition: 0 MaxSeqNo: 42 sessionId: src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0
2025-09-30T14:58:39.164939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eab7cee0-bcb4ffca-c0c929e9-3e7c1cb9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:39.167950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0] Write session: try to update token
2025-09-30T14:58:39.167974Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:39.178169Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:39.178198Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:39.178211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896817706387160:7054]
2025-09-30T14:58:39.178256Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:39.178255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:39.178445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:39.178588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:39.178721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:39.178854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:39.179141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:39.179177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:39.184178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2970 sessionId: src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:39.187024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:39.187438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:39.187287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.187316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.187354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:39.196855Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:39.196882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:39.196884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:39.196887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:39.196901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896817706387160:7054]
2025-09-30T14:58:39.196906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896817706387160:7054]
2025-09-30T14:58:39.196910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896817706387160:7054]
2025-09-30T14:58:39.196951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:39.196958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.196961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:39.197100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:39.199308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:39.199315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:39.199320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:39.243473Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896817796187874:7727]
2025-09-30T14:58:39.244051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 2969, pipe: [1:7555896817796187874:7727]
2025-09-30T14:58:39.317054Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:39.325218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.325250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.325427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.325493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.325565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.325634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.325682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.325692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.325760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.325815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.325893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.325963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.326007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.326015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.326081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.326139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.326210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.326278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.326324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.326332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.326403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.326460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.326529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.326596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.326645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.326652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.326721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.326785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.326851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.326918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.326966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.326969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.327036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.327093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.327152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.327329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.327375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.327386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.327453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.327513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.327582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.327644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.327693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.327701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.327774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.327845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.327920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.327987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.328032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.328039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.328105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.328165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.328227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.328292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.328339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.328346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.328415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.328482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.328551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.328626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.328669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.328672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.328752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796187874:7727], now have 1 active actors on pipe
2025-09-30T14:58:39.330015Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:39.332366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:39.332383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0] Write session will restart in 0.006311s
2025-09-30T14:58:39.332406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0] Write session: Do CDS request
2025-09-30T14:58:39.332412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:39.329030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:39.329090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896817796187874:7727]
2025-09-30T14:58:39.329115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:39.329118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:39.329149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2970 reason: error at write: Disconnected sessionId: src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0
2025-09-30T14:58:39.329361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2970 sessionId: src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0 is DEAD
2025-09-30T14:58:39.338039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:39.339026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:39.339219Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:39.339230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:39.339258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:39.339312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:39.339353Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896817706387227:7052]
2025-09-30T14:58:39.339721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:39.340011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:39.340339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:39.340385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:39.340700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:39.340775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.340783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.340784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.340785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.340786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.340787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.340788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.340790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.340791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.340792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.340793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.340794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.340795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.340796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.340797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.340802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.340813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.340817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.340821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.340826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.340830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.340834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.340840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.340844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.340849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.340853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.340857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.340861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.340865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.340869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.340876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.340884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.340891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.340897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.340901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.340906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.340910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.340916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.340920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.340926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.340931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.340936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.340941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.340946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.340950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.340955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.340960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.340965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.340971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.340981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.340985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.340990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.340995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.341001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.341011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.341015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.341019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.341023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.341032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.341038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.341083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:39.346452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:39.343385Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:39.343403Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2971
2025-09-30T14:58:39.343537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2971 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:39.343558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2971 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:39.343561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2971 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:39.343565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:39.344079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2971 sessionId:  describe result for acl check
2025-09-30T14:58:39.344108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:39.344110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:39.344112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:39.344129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896817796187912:9925] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:39.344648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896817796187912:9925] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:39.347435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:39.347453Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:39.347456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:39.347460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:39.347466Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2970 [2:7555896817706387227:7052]
2025-09-30T14:58:39.347481Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:39.347497Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:39.347499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:39.347503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:39.347505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:39.347521Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:39.347527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:39.347534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:39.347587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.347596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.347598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.347601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:39.347607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:39.347671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:39.347674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.347685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.347696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.347711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:39.347728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896817706387222:7052]
2025-09-30T14:58:39.347732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896817706387222:7052]
2025-09-30T14:58:39.347734Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896817706387222:7052]
2025-09-30T14:58:39.347748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:39.347761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:39.347774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:39.347777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:39.347808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896817706387222:7052]
2025-09-30T14:58:39.347810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:39.347886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:39.347889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:39.347892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:39.347898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:39.348017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796187883:2454], now have 1 active actors on pipe
2025-09-30T14:58:39.347801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896817796187912:9925] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:39.348075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2970
2025-09-30T14:58:39.353208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896817796187912:9925] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:39.353227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896817796187912:9925] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:39.353230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896817796187912:9925] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:39.353240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2971 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:39.353728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796187950:9925], now have 1 active actors on pipe
2025-09-30T14:58:39.353918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2970
2025-09-30T14:58:39.353995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.354010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.354048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:39.354066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:39.354070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:39.354073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:39.354087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:39.354111Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:39.354133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:39.354311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.354322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.354334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:39.354454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2971 partition: 0 MaxSeqNo: 42 sessionId: src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0
2025-09-30T14:58:39.354827Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a5c5a1a8-aee36780-c0ea5ee0-b1c67fd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:39.357736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0] Write session: try to update token
2025-09-30T14:58:39.357757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:39.366251Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:39.366281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:39.366284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:39.366287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:39.366304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896817706387222:7052]
2025-09-30T14:58:39.366311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896817706387222:7052]
2025-09-30T14:58:39.366318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896817706387222:7052]
2025-09-30T14:58:39.366372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:39.366391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:39.366393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.366397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:39.366407Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:39.366411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:39.366610Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:39.374979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2971 sessionId: src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:39.378512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:39.431344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896817796187957:7727]
2025-09-30T14:58:39.431690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 2970, pipe: [1:7555896817796187957:7727]
2025-09-30T14:58:39.485898Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:39.486321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.486342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.486382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796187957:7727], now have 1 active actors on pipe
2025-09-30T14:58:39.486713Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:39.487314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:39.487380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896817796187957:7727]
2025-09-30T14:58:39.487389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2971 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0
2025-09-30T14:58:39.487410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:39.487552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2971 sessionId: src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0 is DEAD
2025-09-30T14:58:39.488011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:39.488020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0] Write session will restart in 0.008092s
2025-09-30T14:58:39.488042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0] Write session: Do CDS request
2025-09-30T14:58:39.488047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:39.497730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:39.497825Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:39.497842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2972
2025-09-30T14:58:39.497972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2972 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:39.498007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2972 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:39.498019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2972 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:39.498023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:39.498473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2972 sessionId:  describe result for acl check
2025-09-30T14:58:39.498511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:39.498518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:39.498521Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:39.498527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896817796187968:9921] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:39.499095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896817796187968:9921] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:39.502241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896817796187968:9921] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:39.512934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:39.515798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896817796187968:9921] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:39.515819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896817796187968:9921] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:39.515822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896817796187968:9921] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:39.515831Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2972 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:39.516463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:39.516700Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:39.516705Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:39.516716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:39.516785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:39.516823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896817706387304:7049]
2025-09-30T14:58:39.517517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:39.521841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:39.521957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:39.522405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:39.522481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.522488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.522489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.522490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.522491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.522493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.522494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.522496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.522497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.522498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.522499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.522500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.522502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.522503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.522504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.522511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.522521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.522525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.522529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.522533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.522538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.522542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.522546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.522550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.522555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.522558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.522562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.522566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.522570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.522574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.522583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.522597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.522604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.522609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.522614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.522620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.522624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.522629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.522637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.522642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.522647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.522652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.522657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.522662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.522667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.522672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.522678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.522683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.522687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.522692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.522697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.522704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.522709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.522719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.522725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.522735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.522740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.522745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.522754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.522761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.522807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:39.528889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:39.529801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:39.529821Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:39.529827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:39.529832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:39.529838Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2971 [2:7555896817706387304:7049]
2025-09-30T14:58:39.529856Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:39.529873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:39.529875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:39.529879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:39.529881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:39.529897Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:39.529909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:39.529916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:39.529987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.529998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.530000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.530004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:39.530006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:39.530071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:39.530079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.530093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.530111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.530135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:39.530157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896817706387297:7049]
2025-09-30T14:58:39.530163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896817706387297:7049]
2025-09-30T14:58:39.530167Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896817706387297:7049]
2025-09-30T14:58:39.530179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:39.530193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:39.530209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:39.530217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:39.530251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896817706387297:7049]
2025-09-30T14:58:39.530262Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:39.530363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:39.530371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:39.530373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:39.530379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:39.530663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2971
2025-09-30T14:58:39.530678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796187960:2454], now have 1 active actors on pipe
2025-09-30T14:58:39.530695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2971
2025-09-30T14:58:39.530688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796188018:9921], now have 1 active actors on pipe
2025-09-30T14:58:39.530964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.530977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.531006Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:39.531014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:39.531018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:39.531020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:39.531030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:39.531040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:39.531062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:39.531229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.531237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.531304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:39.531779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2972 partition: 0 MaxSeqNo: 42 sessionId: src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0
2025-09-30T14:58:39.532261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9efc1b37-ccbd3530-19383149-b2abc23c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:39.535690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0] Write session: try to update token
2025-09-30T14:58:39.535709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:39.542882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:39.542906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:39.542916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896817706387297:7049]
2025-09-30T14:58:39.542951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:39.542973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:39.543149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:39.543313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:39.543469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:39.543619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:39.543820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:39.543870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:39.552163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2972 sessionId: src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:39.554878Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:39.555099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.555124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.555154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:39.555279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:39.556321Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:39.556341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:39.556344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:39.556345Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:39.556355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896817706387297:7049]
2025-09-30T14:58:39.556362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896817706387297:7049]
2025-09-30T14:58:39.556366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896817706387297:7049]
2025-09-30T14:58:39.556403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:39.556405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:39.556411Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:39.556411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.556414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:39.556415Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:39.556549Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:39.587524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896817796188042:7727]
2025-09-30T14:58:39.587910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 2971, pipe: [1:7555896817796188042:7727]
2025-09-30T14:58:39.670812Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:39.679611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.679647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.679836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.679906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.679977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.680047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.680096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.680106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.680186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.680251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.680320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.680400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.680445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.680454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.680528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.680587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.680650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.680718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.680776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.680779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.680855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.680923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.680993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.681060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.681108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.681112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.681184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.681245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.681305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.681371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.681411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.681414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.681483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.681544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.681605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.681666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.681710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.681713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.681783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.681841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.681906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.681970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.682011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.682018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.682088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.682151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.682211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.682270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.682311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.682317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.682386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.682444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.682504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.682566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.682606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.682609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.682675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:39.682740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:39.682806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:39.682873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:39.682917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:39.682920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:39.683002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796188042:7727], now have 1 active actors on pipe
2025-09-30T14:58:39.684003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:39.684016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0] Write session will restart in 0.009966s
2025-09-30T14:58:39.684052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0] Write session: Do CDS request
2025-09-30T14:58:39.684058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:39.683544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:39.683588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896817796188042:7727]
2025-09-30T14:58:39.683605Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:39.683608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:39.683630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2972 reason: error at write: Disconnected sessionId: src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0
2025-09-30T14:58:39.683811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2972 sessionId: src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0 is DEAD
2025-09-30T14:58:39.688513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:39.694841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:39.696518Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:39.696536Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2973
2025-09-30T14:58:39.696898Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2973 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:39.696943Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2973 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:39.696948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2973 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:39.696953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:39.697565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2973 sessionId:  describe result for acl check
2025-09-30T14:58:39.697606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:39.697608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:39.697611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:39.697616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896817796188058:9913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:39.698196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896817796188058:9913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:39.709478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896817796188058:9913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:39.711897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:39.714118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896817796188058:9913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:39.714137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896817796188058:9913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:39.714140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896817796188058:9913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:39.714148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2973 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:39.715969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:39.716210Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:39.716223Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:39.716233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:39.716294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:39.716330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896817706387370:7048]
2025-09-30T14:58:39.716961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:39.717737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:39.717814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:39.718222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:39.718295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.718302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.718304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.718305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.718306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.718308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.718310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.718313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.718314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.718316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.718318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.718319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.718323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.718324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.718325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.718332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.718343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.718347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.718351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.718355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.718358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.718362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.718367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.718372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.718376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.718381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.718385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.718390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.718395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.718399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.718408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.718423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.718434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.718440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.718450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.718455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.718465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.718471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.718479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.718485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.718495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.718501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.718511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.718518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.718524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.718529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.718533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.718538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.718543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.718555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.718559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.718563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.718567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.718571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.718575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.718580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.718583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.718588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.718592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.718597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.718641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:39.725509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:39.726390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:39.726410Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:39.726413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:39.726417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:39.726424Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2972 [2:7555896817706387370:7048]
2025-09-30T14:58:39.726442Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:39.726465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:39.726478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:39.726481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:39.726483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:39.726499Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:39.726509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:39.726516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:39.726574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.726582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.726584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.726587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:39.726590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:39.726662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:39.726670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.726682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.726692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.726712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:39.726731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896817706387363:7048]
2025-09-30T14:58:39.726739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896817706387363:7048]
2025-09-30T14:58:39.726742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896817706387363:7048]
2025-09-30T14:58:39.726755Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:39.726769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:39.726782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:39.726790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:39.726827Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896817706387363:7048]
2025-09-30T14:58:39.726835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:39.727022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:39.727031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:39.727033Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:39.727038Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:39.727795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2972
2025-09-30T14:58:39.727838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2972
2025-09-30T14:58:39.731882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796188045:2454], now have 1 active actors on pipe
2025-09-30T14:58:39.731908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796188105:9913], now have 1 active actors on pipe
2025-09-30T14:58:39.731934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.731942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.731977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e8797-db930452-2562221d-33ba443f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:39.731997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:39.732004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:39.732007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:39.732019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:39.732034Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:39.732059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:39.733797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.733816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.733841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:39.734818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2973 partition: 0 MaxSeqNo: 42 sessionId: src_id|7e8797-db930452-2562221d-33ba443f_0
2025-09-30T14:58:39.735325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1359a05e-cdb12b23-24f451ce-4f7b6b36_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7e8797-db930452-2562221d-33ba443f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:39.738120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8797-db930452-2562221d-33ba443f_0] Write session: try to update token
2025-09-30T14:58:39.738143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8797-db930452-2562221d-33ba443f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:39.745057Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:39.745085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:39.745087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:39.745093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:39.745108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896817706387363:7048]
2025-09-30T14:58:39.745113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896817706387363:7048]
2025-09-30T14:58:39.745118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896817706387363:7048]
2025-09-30T14:58:39.745162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:39.745171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.745174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:39.745326Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:39.747603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:39.747620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:39.747626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:39.756671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2973 sessionId: src_id|7e8797-db930452-2562221d-33ba443f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:39.759275Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:39.791410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896817796188119:7727]
2025-09-30T14:58:39.791879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 2972, pipe: [1:7555896817796188119:7727]
2025-09-30T14:58:39.886545Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:39.887094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.887114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.887155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796188119:7727], now have 1 active actors on pipe
2025-09-30T14:58:39.887413Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:39.887426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:39.887441Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:39.887446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:39.887489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896817796188119:7727]
2025-09-30T14:58:39.887521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2973 reason: error at write: Disconnected sessionId: src_id|7e8797-db930452-2562221d-33ba443f_0
2025-09-30T14:58:39.887698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2973 sessionId: src_id|7e8797-db930452-2562221d-33ba443f_0 is DEAD
2025-09-30T14:58:39.891650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8797-db930452-2562221d-33ba443f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:39.891664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8797-db930452-2562221d-33ba443f_0] Write session will restart in 0.006372s
2025-09-30T14:58:39.891689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8797-db930452-2562221d-33ba443f_0] Write session: Do CDS request
2025-09-30T14:58:39.891700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8797-db930452-2562221d-33ba443f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:39.895946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:39.898122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:39.898320Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:39.898332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:39.898343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:39.898392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:39.898435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896817706387433:7040]
2025-09-30T14:58:39.899115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:39.899854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8797-db930452-2562221d-33ba443f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:39.899505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:39.899554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:39.899928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:39.899995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.899996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.899997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.899998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.899999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.900000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.900002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.900003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.900004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.900005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.900006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.900008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.900009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.900010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.900011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.900017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.900026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.900031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.900035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.900039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.900044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.900048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.900052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.900057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.900062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.900066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.900070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.900075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.900079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.900084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.900094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.900102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:39.900109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.900115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:39.900122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.900128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:39.900132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.900138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:39.900142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.900148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:39.900153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.900159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:39.900163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.900169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:39.900175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.900180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:39.900184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.900190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:39.900195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.900200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:39.900205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.900210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.900215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.900220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.900225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.900231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.900237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.900243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:39.900247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.900254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:39.900299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:39.901293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:39.901308Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2974
2025-09-30T14:58:39.901648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2974 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:39.901682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2974 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:39.901688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2974 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:39.901692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:39.902281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2974 sessionId:  describe result for acl check
2025-09-30T14:58:39.902318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:39.902320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:39.902321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:39.902327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896817796188154:9906] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:39.902880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896817796188154:9906] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:39.906387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:39.907350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:39.907374Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:39.907377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:39.907382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:39.907388Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2973 [2:7555896817706387433:7040]
2025-09-30T14:58:39.907405Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:39.907428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:39.907435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:39.907439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:39.907442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:39.907459Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:39.907470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:39.907477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:39.907545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.907554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.907556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.907559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:39.907562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:39.907635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:39.907643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.907656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:39.907672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:39.907692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:39.907716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796188122:2454], now have 1 active actors on pipe
2025-09-30T14:58:39.907728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896817706387428:7040]
2025-09-30T14:58:39.907739Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896817706387428:7040]
2025-09-30T14:58:39.907743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896817706387428:7040]
2025-09-30T14:58:39.907760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:39.907781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:39.907796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:39.907804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:39.907835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896817706387428:7040]
2025-09-30T14:58:39.907838Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:39.907935Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:39.907946Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:39.907949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:39.907955Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:39.908121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896817796188154:9906] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:39.908196Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2973
2025-09-30T14:58:39.912830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896817796188154:9906] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:39.912844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896817796188154:9906] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:39.912848Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896817796188154:9906] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:39.912857Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2974 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:39.913718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796188191:9906], now have 1 active actors on pipe
2025-09-30T14:58:39.913732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2973
2025-09-30T14:58:39.913896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.913909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.913935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:39.913950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:39.913959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:39.913962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:39.913973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:39.913992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:39.914010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:39.914276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:39.914286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:39.914303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:39.914448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2974 partition: 0 MaxSeqNo: 42 sessionId: src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0
2025-09-30T14:58:39.915628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8797-db930452-2562221d-33ba443f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:39.918455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0] Write session: try to update token
2025-09-30T14:58:39.918476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:39.920141Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:39.920168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:39.920171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:39.920174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:39.920183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896817706387428:7040]
2025-09-30T14:58:39.920188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896817706387428:7040]
2025-09-30T14:58:39.920195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896817706387428:7040]
2025-09-30T14:58:39.920238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:39.920244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:39.920247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:39.920387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:39.922780Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:39.922798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:39.922803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:39.935884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2974 sessionId: src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:39.938660Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:39.987910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896817796188195:7727]
2025-09-30T14:58:39.988253Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 2973, pipe: [1:7555896817796188195:7727]
2025-09-30T14:58:40.041592Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:40.041955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.041971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.041991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896817796188195:7727], now have 1 active actors on pipe
2025-09-30T14:58:40.042311Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:40.042972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:40.042984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0] Write session will restart in 0.006600s
2025-09-30T14:58:40.043006Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0] Write session: Do CDS request
2025-09-30T14:58:40.043012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:40.042274Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896817796188195:7727]
2025-09-30T14:58:40.042275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:40.042315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:40.042318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:40.042381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2974 reason: error at write: Disconnected sessionId: src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0
2025-09-30T14:58:40.042566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2974 sessionId: src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0 is DEAD
2025-09-30T14:58:40.049564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:40.050618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:40.050752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.050800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:40.050815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:40.050836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:40.050889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:40.050895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:40.050931Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896822001354795:7036]
2025-09-30T14:58:40.050911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2975
2025-09-30T14:58:40.051023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2975 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.051054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2975 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:40.051066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2975 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:40.051071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:40.051457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2975 sessionId:  describe result for acl check
2025-09-30T14:58:40.051484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:40.051485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:40.051487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:40.051491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896822091155521:9899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:40.051639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:40.051953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:40.051998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:40.052022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896822091155521:9899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:40.052360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:40.052427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.052434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.052435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.052437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.052438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.052439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.052441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.052443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.052444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.052445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.052447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.052448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.052449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.052451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.052452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.052461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.052471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.052476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.052481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.052485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.052490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.052494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.052499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.052503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.052508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.052513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.052517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.052521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.052525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.052530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.052538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.052551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.052562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.052568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.052577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.052583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.052593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.052598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.052608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.052614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.052634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.052645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.052649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.052660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.052664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.052674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.052679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.052685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.052689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.052695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.052700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.052704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.052709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.052719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.052728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.052734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.052752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.052762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.052767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.052776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.052821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:40.053900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896822091155521:9899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:40.057584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896822091155521:9899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:40.057608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896822091155521:9899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:40.057612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896822091155521:9899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:40.057622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2975 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:40.057974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:40.058894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:40.058912Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:40.058915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:40.058919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:40.058925Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2974 [2:7555896822001354795:7036]
2025-09-30T14:58:40.058941Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:40.058954Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:40.058957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:40.058961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:40.058966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:40.058981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:40.058987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:40.058993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:40.059049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.059058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.059060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.059062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:40.059064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:40.059128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:40.059135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.059145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.059155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.059170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:40.059190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155560:9899], now have 1 active actors on pipe
2025-09-30T14:58:40.059198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155493:2454], now have 1 active actors on pipe
2025-09-30T14:58:40.059204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896822001354790:7036]
2025-09-30T14:58:40.059206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896822001354790:7036]
2025-09-30T14:58:40.059207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896822001354790:7036]
2025-09-30T14:58:40.059219Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:40.059239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:40.059223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2974
2025-09-30T14:58:40.059228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2974
2025-09-30T14:58:40.059271Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:40.059274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:40.059277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:40.059285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:40.059287Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:40.059324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.059335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.059346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896822001354790:7036]
2025-09-30T14:58:40.059359Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:40.059367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:40.059392Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:40.059399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:40.059402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:40.059404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:40.059415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:40.059424Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:40.059448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:40.059755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.059767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.059783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:40.059867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2975 partition: 0 MaxSeqNo: 42 sessionId: src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0
2025-09-30T14:58:40.060232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6d19f262-4f2e864-8b109dd4-6e631bfe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:40.063015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0] Write session: try to update token
2025-09-30T14:58:40.063031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:40.071716Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:40.071739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:40.071741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:40.071744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:40.071754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896822001354790:7036]
2025-09-30T14:58:40.071759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896822001354790:7036]
2025-09-30T14:58:40.071763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896822001354790:7036]
2025-09-30T14:58:40.071804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:40.071811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.071814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:40.071948Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:40.071955Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:40.071973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:40.071977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:40.079755Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2975 sessionId: src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:40.082383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:40.142681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896822091155580:7727]
2025-09-30T14:58:40.142968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 2974, pipe: [1:7555896822091155580:7727]
2025-09-30T14:58:40.190514Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:40.190831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.190852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.190894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155580:7727], now have 1 active actors on pipe
2025-09-30T14:58:40.191137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:40.191179Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896822091155580:7727]
2025-09-30T14:58:40.191166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:40.191197Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:40.191199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:40.191280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2975 reason: error at write: Disconnected sessionId: src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0
2025-09-30T14:58:40.191463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2975 sessionId: src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0 is DEAD
2025-09-30T14:58:40.195465Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:40.195477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0] Write session will restart in 0.006328s
2025-09-30T14:58:40.195503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0] Write session: Do CDS request
2025-09-30T14:58:40.195513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:40.201854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:40.202810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.202868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:40.202886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2976
2025-09-30T14:58:40.203034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2976 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.203065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2976 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:40.203075Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2976 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:40.203080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:40.203162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:40.203384Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:40.203396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:40.203407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:40.203459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:40.203498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896822001354901:7018]
2025-09-30T14:58:40.203521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2976 sessionId:  describe result for acl check
2025-09-30T14:58:40.203558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:40.203564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:40.203566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:40.203572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896822091155621:9885] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:40.204082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896822091155621:9885] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:40.204141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:40.204461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:40.204524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:40.204927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:40.205005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.205014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.205015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.205017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.205018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.205019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.205021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.205022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.205023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.205024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.205026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.205027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.205028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.205030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.205031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.205037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.205047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.205052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.205056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.205060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.205065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.205069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.205073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.205077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.205082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.205086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.205091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.205094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.205099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.205105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.205113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.205121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.205133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.205139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.205150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.205155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.205160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.205169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.205173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.205180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.205188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.205193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.205197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.205206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.205210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.205214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.205219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.205228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.205231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.205237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.205244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.205249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.205253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.205257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.205262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.205267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.205271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.205275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.205283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.205288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.205326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:40.206547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896822091155621:9885] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:40.210130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896822091155621:9885] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:40.210162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896822091155621:9885] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:40.210166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896822091155621:9885] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:40.210175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2976 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:40.210491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:40.211401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:40.211417Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:40.211423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:40.211427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:40.211433Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2975 [2:7555896822001354901:7018]
2025-09-30T14:58:40.211451Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:40.211465Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:40.211468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:40.211471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:40.211473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:40.211486Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:40.211493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:40.211499Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:40.211551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.211559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.211561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.211564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:40.211566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:40.211633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:40.211643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.211654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.211666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.211682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:40.211696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896822001354895:7018]
2025-09-30T14:58:40.211709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896822001354895:7018]
2025-09-30T14:58:40.211711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896822001354895:7018]
2025-09-30T14:58:40.211721Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:40.211728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:40.211732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:40.211733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:40.211734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:40.211747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:40.211749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:40.211758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155591:2454], now have 1 active actors on pipe
2025-09-30T14:58:40.211763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155659:9885], now have 1 active actors on pipe
2025-09-30T14:58:40.211790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896822001354895:7018]
2025-09-30T14:58:40.211796Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2975
2025-09-30T14:58:40.211800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:40.211817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:40.211812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2975
2025-09-30T14:58:40.211919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.211928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.211953Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:40.211964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:40.211967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:40.211969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:40.211977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:40.211992Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:40.212009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:40.212200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.212207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.212218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:40.212329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2976 partition: 0 MaxSeqNo: 42 sessionId: src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0
2025-09-30T14:58:40.212699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3740010-cc6f4f4-d8c3d8f5-85708213_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:40.215621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0] Write session: try to update token
2025-09-30T14:58:40.215641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:40.224528Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:40.224548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:40.224550Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:40.224552Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:40.224560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896822001354895:7018]
2025-09-30T14:58:40.224564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896822001354895:7018]
2025-09-30T14:58:40.224569Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896822001354895:7018]
2025-09-30T14:58:40.224609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:40.224614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:40.224616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.224618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:40.224621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:40.224626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:40.224785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:40.231023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2976 sessionId: src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:40.234015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:40.291554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896822091155668:7727]
2025-09-30T14:58:40.291912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 2975, pipe: [1:7555896822091155668:7727]
2025-09-30T14:58:40.336220Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:40.336553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.336567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.336586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155668:7727], now have 1 active actors on pipe
2025-09-30T14:58:40.336856Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:40.336984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896822091155668:7727]
2025-09-30T14:58:40.336983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:40.337023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:40.337026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:40.337085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2976 reason: error at write: Disconnected sessionId: src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0
2025-09-30T14:58:40.337428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:40.337441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0] Write session will restart in 0.008443s
2025-09-30T14:58:40.337474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0] Write session: Do CDS request
2025-09-30T14:58:40.337479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:40.337267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2976 sessionId: src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0 is DEAD
2025-09-30T14:58:40.346173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:40.346786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.346831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:40.346861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2977
2025-09-30T14:58:40.347075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2977 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.347113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2977 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:40.347125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2977 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:40.347129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:40.347608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2977 sessionId:  describe result for acl check
2025-09-30T14:58:40.347664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:40.347673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:40.347675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:40.347681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896822091155702:9879] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:40.347674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:40.347910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:40.347935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:40.347948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:40.348015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:40.348073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896822001354980:7009]
2025-09-30T14:58:40.348222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896822091155702:9879] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:40.348698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:40.349060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:40.349120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:40.349480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:40.349571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.349580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.349584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.349585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.349587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.349588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.349590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.349591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.349592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.349594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.349595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.349596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.349598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.349599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.349600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.349608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.349618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.349623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.349628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.349632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.349636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.349640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.349643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.349647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.349652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.349656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.349660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.349664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.349669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.349673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.349680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.349688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.349695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.349702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.349706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.349712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.349717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.349723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.349729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.349735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.349740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.349745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.349751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.349762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.349768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.349773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.349783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.349788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.349795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.349806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.349812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.349818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.349823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.349829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.349834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.349841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.349851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.349856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.349861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.349867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.349921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:40.352772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896822091155702:9879] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:40.355280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896822091155702:9879] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:40.355295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896822091155702:9879] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:40.355298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896822091155702:9879] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:40.355308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2977 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:40.355542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:40.356444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:40.356463Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:40.356466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:40.356470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:40.356480Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2976 [2:7555896822001354980:7009]
2025-09-30T14:58:40.356497Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:40.356516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:40.356524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:40.356528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:40.356531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:40.356546Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:40.356552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:40.356559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:40.356627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.356635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.356637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.356641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:40.356644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:40.356707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:40.356716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.356731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.356758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.356778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:40.356801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155742:9879], now have 1 active actors on pipe
2025-09-30T14:58:40.356812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155672:2454], now have 1 active actors on pipe
2025-09-30T14:58:40.356819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896822001354975:7009]
2025-09-30T14:58:40.356821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896822001354975:7009]
2025-09-30T14:58:40.356824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896822001354975:7009]
2025-09-30T14:58:40.356842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:40.356855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:40.356871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:40.356874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:40.356846Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2976
2025-09-30T14:58:40.356854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2976
2025-09-30T14:58:40.356903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:40.356908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896822001354975:7009]
2025-09-30T14:58:40.356911Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:40.356913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:40.356915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:40.356921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:40.356937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.356941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.356977Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:40.357006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:40.357015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:40.357018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:40.357027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:40.357040Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:40.357062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:40.357238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.357249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.357264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:40.357354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2977 partition: 0 MaxSeqNo: 42 sessionId: src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0
2025-09-30T14:58:40.357742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cd1a78f7-7e489102-1f15a0a2-13a32794_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:40.360726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0] Write session: try to update token
2025-09-30T14:58:40.360766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:40.369580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:40.369604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:40.369607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:40.369609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:40.369619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896822001354975:7009]
2025-09-30T14:58:40.369623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896822001354975:7009]
2025-09-30T14:58:40.369627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896822001354975:7009]
2025-09-30T14:58:40.369670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:40.369679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:40.369681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.369684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:40.369686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:40.369690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:40.369827Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:40.376813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2977 sessionId: src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:40.379412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:40.436935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896822091155752:7727]
2025-09-30T14:58:40.437234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 2976, pipe: [1:7555896822091155752:7727]
2025-09-30T14:58:40.479830Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:40.480266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.480283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.480302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155752:7727], now have 1 active actors on pipe
2025-09-30T14:58:40.480532Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:40.480575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:40.480590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896822091155752:7727]
2025-09-30T14:58:40.480592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:40.480609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:40.480653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2977 reason: error at write: Disconnected sessionId: src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0
2025-09-30T14:58:40.480854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2977 sessionId: src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0 is DEAD
2025-09-30T14:58:40.480999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:40.481007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0] Write session will restart in 0.009565s
2025-09-30T14:58:40.481030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0] Write session: Do CDS request
2025-09-30T14:58:40.481036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:40.487587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:40.488719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:40.488929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:40.488940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:40.488951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:40.489016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:40.489071Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896822001355049:7002]
2025-09-30T14:58:40.489740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:40.490034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:40.490083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:40.490416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:40.490490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.490497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.490499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.490500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.490501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.490502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.490503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.490504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.490505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.490506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.490507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.490509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.490510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.490511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.490512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.490520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.490531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.490535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.490539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.490544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.490548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.490553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.490557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.490561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.490566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.490569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.490573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.490578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.490582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.490587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.490595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.490603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.490609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.490615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.490622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.490632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.490636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.490642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.490647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.490652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.490661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.490666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.490670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.490680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.490684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.490690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.490695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.490701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.490710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.490715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.490723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.490732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.490737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.490742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.490751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.490757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.490761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.490766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.490774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.490779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.490828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:40.491819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.491929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:40.491945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2978
2025-09-30T14:58:40.492099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2978 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.492141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2978 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:40.492151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2978 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:40.492155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:40.492568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2978 sessionId:  describe result for acl check
2025-09-30T14:58:40.492602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:40.492609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:40.492611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:40.492616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896822091155789:9875] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:40.493176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896822091155789:9875] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:40.495069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896822091155789:9875] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:40.496115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:40.496991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:40.497010Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:40.497012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:40.497016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:40.497022Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2977 [2:7555896822001355049:7002]
2025-09-30T14:58:40.497037Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:40.497052Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:40.497055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:40.497058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:40.497061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:40.497076Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:40.497088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:40.497094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:40.497153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.497164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.497166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.497170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:40.497172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:40.497238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:40.497245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.497258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.497274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.497296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:40.497319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155753:2454], now have 1 active actors on pipe
2025-09-30T14:58:40.497332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896822001355044:7002]
2025-09-30T14:58:40.497334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896822001355044:7002]
2025-09-30T14:58:40.497337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896822001355044:7002]
2025-09-30T14:58:40.497350Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:40.497363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:40.497369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:40.497374Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:40.497377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:40.497344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2977
2025-09-30T14:58:40.497383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:40.497386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:40.497420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896822001355044:7002]
2025-09-30T14:58:40.497431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:40.497442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:40.497633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896822091155789:9875] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:40.497648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896822091155789:9875] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:40.497651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896822091155789:9875] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:40.497659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2978 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:40.497880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155825:9875], now have 1 active actors on pipe
2025-09-30T14:58:40.497923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2977
2025-09-30T14:58:40.498006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.498016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.498054Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:40.498067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:40.498071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:40.498073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:40.498084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:40.498095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:40.498113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:40.498291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.498303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.498316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:40.498428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2978 partition: 0 MaxSeqNo: 42 sessionId: src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0
2025-09-30T14:58:40.498756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc00c27-8a14f1a4-cb27536f-c8d33b76_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:40.501503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0] Write session: try to update token
2025-09-30T14:58:40.501523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:40.515049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:40.515075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:40.515085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896822001355044:7002]
2025-09-30T14:58:40.515135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:40.515138Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:40.515333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:40.515485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:40.515709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:40.515680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2978 sessionId: src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:40.515858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:40.516062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:40.516106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:40.518360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:40.518559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.518577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.518613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:40.518702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:40.519952Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:40.519966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:40.519967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:40.519969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:40.519978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896822001355044:7002]
2025-09-30T14:58:40.519981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896822001355044:7002]
2025-09-30T14:58:40.519983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896822001355044:7002]
2025-09-30T14:58:40.520011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:40.520016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.520020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:40.520031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:40.520038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:40.520043Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:40.520140Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:40.580823Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896822091155831:7727]
2025-09-30T14:58:40.581119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 2977, pipe: [1:7555896822091155831:7727]
2025-09-30T14:58:40.639427Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:40.648435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.648467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.648656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:40.648730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:40.648812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:40.648882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:40.648931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:40.648943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:40.649015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:40.649130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:40.649200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:40.649277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:40.649328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:40.649340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:40.649412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:40.649479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:40.649549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:40.649618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:40.649663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:40.649671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:40.649740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:40.649811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:40.649878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:40.649946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:40.649994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:40.650004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:40.650075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:40.650143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:40.650211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:40.650279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:40.650327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:40.650335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:40.650404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:40.650469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:40.650536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:40.650605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:40.650652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:40.650660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:40.650729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:40.650798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:40.650869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:40.650943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:40.650992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:40.651002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:40.651076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:40.651146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:40.651217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:40.651318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:40.651368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:40.651375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:40.651444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:40.651508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:40.651575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:40.651644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:40.651691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:40.651699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:40.652413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:40.652473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:40.652482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:40.652494Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896822091155831:7727]
2025-09-30T14:58:40.652511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2978 reason: error at write: Disconnected sessionId: src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0
2025-09-30T14:58:40.652728Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2978 sessionId: src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0 is DEAD
2025-09-30T14:58:40.652876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:40.652888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0] Write session will restart in 0.005376s
2025-09-30T14:58:40.652915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0] Write session: Do CDS request
2025-09-30T14:58:40.652921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:40.651771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:40.651842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:40.651903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:40.651966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:40.652009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:40.652012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:40.652092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155831:7727], now have 1 active actors on pipe
2025-09-30T14:58:40.653357Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:40.659845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.660106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:40.660126Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2979
2025-09-30T14:58:40.660276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2979 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.660318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2979 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:40.660324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2979 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:40.660328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:40.660829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2979 sessionId:  describe result for acl check
2025-09-30T14:58:40.660870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:40.660877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:40.660880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:40.660885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896822091155851:9865] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:40.661463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896822091155851:9865] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:40.664019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896822091155851:9865] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:40.667228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896822091155851:9865] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:40.667266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896822091155851:9865] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:40.667271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896822091155851:9865] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:40.667281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2979 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:40.669341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:40.670751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:40.671011Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:40.671016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:40.671027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:40.671083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:40.671141Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896822001355123:6987]
2025-09-30T14:58:40.671818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:40.672187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:40.672239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:40.672611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:40.672667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.672669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.672670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.672672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.672673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.672675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.672676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.672677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.672678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.672679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.672681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.672682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.672684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.672685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.672687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.672693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.672704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.672708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.672715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.672720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.672725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.672730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.672747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.672751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.672756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.672761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.672765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.672769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.672773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.672777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.672786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.672794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.672801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.672807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.672812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.672818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.672824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.672830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.672836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.672842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.672846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.672852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.672858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.672863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.672868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.672873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.672878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.672885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.672890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.672899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.672904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.672910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.672915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.672921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.672926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.672932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.672936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.672941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.672946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.672952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.673001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:40.679793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:40.680702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:40.680719Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:40.680723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:40.680730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:40.680756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2978 [2:7555896822001355123:6987]
2025-09-30T14:58:40.680774Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:40.680802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:40.680810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:40.680815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:40.680817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:40.680834Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:40.680846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:40.680854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:40.680926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.680934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.680936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.680939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:40.680941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:40.681018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:40.681026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.681039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.681054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.681075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:40.681098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155904:9865], now have 1 active actors on pipe
2025-09-30T14:58:40.681102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155844:2454], now have 1 active actors on pipe
2025-09-30T14:58:40.681108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896822001355118:6987]
2025-09-30T14:58:40.681111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896822001355118:6987]
2025-09-30T14:58:40.681113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896822001355118:6987]
2025-09-30T14:58:40.681124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:40.681147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:40.681165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:40.681172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:40.681209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896822001355118:6987]
2025-09-30T14:58:40.681215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:40.681480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:40.681493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:40.681498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:40.681504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:40.681687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.681698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.681728Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:40.681750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:40.681758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:40.681761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:40.681773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:40.681790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:40.681810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:40.682466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.682473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.682489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:40.683069Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ac744c0-cf6bf612-5f9d9717-2e4d5ba6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:40.685904Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0] Write session: try to update token
2025-09-30T14:58:40.685927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:40.681175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2978
2025-09-30T14:58:40.681216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2978
2025-09-30T14:58:40.682603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2979 partition: 0 MaxSeqNo: 42 sessionId: src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0
2025-09-30T14:58:40.703597Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2979 sessionId: src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:40.706439Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:40.707875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.707904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.707929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:40.707932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:40.707934Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:40.707937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:40.707946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896822001355118:6987]
2025-09-30T14:58:40.707951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896822001355118:6987]
2025-09-30T14:58:40.707955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896822001355118:6987]
2025-09-30T14:58:40.707999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:40.708004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:40.708013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.708013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:40.708016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:40.708018Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:40.708163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:40.752840Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896822091155924:7727]
2025-09-30T14:58:40.753561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 2978, pipe: [1:7555896822091155924:7727]
2025-09-30T14:58:40.820096Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:40.820388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:40.820440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155924:7727], now have 1 active actors on pipe
2025-09-30T14:58:40.820544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:40.820635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:40.820644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:40.820646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:40.820696Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896822091155924:7727]
2025-09-30T14:58:40.820716Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2979 reason: error at write: Disconnected sessionId: src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0
2025-09-30T14:58:40.820884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2979 sessionId: src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0 is DEAD
2025-09-30T14:58:40.821066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:40.821078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0] Write session will restart in 0.009837s
2025-09-30T14:58:40.821101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0] Write session: Do CDS request
2025-09-30T14:58:40.821106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:40.827827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:40.829363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:40.829567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:40.829581Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:40.829593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:40.829651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:40.829696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896822001355192:6996]
2025-09-30T14:58:40.830352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:40.830643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:40.830683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:40.831018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:40.831080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.831086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.831088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.831089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.831090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.831092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.831093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.831095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.831096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.831097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.831099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.831100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.831101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.831103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.831104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.831110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.831121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.831125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.831130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.831134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.831138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.831143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.831147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.831151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.831157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.831163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.831167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.831171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.831175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.831179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.831187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.831194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:40.831201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.831207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:40.831212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.831218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:40.831222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.831227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:40.831233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.831239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:40.831259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.831264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:40.831270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.831276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:40.831282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.831293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:40.831299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.831308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:40.831312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.831318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:40.831327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.831332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.831339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.831344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.831353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.831358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.831363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.831368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:40.831372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.831383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:40.831429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:40.831768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.831854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:40.831869Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2980
2025-09-30T14:58:40.831981Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2980 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.832020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2980 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:40.832030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2980 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:40.832034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:40.832367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2980 sessionId:  describe result for acl check
2025-09-30T14:58:40.832391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:40.832396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:40.832397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:40.832402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896822091155966:9856] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:40.832918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896822091155966:9856] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:40.834971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896822091155966:9856] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:40.837528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896822091155966:9856] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:40.837545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896822091155966:9856] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:40.837548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896822091155966:9856] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:40.837556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2980 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:40.838778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2979
2025-09-30T14:58:40.838794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2979
2025-09-30T14:58:40.837528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:40.838417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:40.838422Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:40.838425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:40.838428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:40.838436Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2979 [2:7555896822001355192:6996]
2025-09-30T14:58:40.838452Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:40.838469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:40.838472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:40.838476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:40.838478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:40.838495Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:40.838502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:40.838508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:40.838567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.838569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.838571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.838574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:40.838580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:40.838655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:40.838657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.838669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:40.838680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:40.838696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:40.838713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091155927:2454], now have 1 active actors on pipe
2025-09-30T14:58:40.838717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091156000:9856], now have 1 active actors on pipe
2025-09-30T14:58:40.838722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896822001355187:6996]
2025-09-30T14:58:40.838724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896822001355187:6996]
2025-09-30T14:58:40.838726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896822001355187:6996]
2025-09-30T14:58:40.838738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:40.838752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:40.838753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:40.838756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:40.838758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:40.838768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:40.838772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:40.838803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896822001355187:6996]
2025-09-30T14:58:40.838806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:40.838811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:40.838827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.838832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.838868Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d109802-120788f8-b16aa764-c217ecf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:40.838875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:40.838879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:40.838881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:40.838889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:40.838898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:40.838915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:40.839372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.839381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.839397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:40.839546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2980 partition: 0 MaxSeqNo: 42 sessionId: src_id|d109802-120788f8-b16aa764-c217ecf8_0
2025-09-30T14:58:40.839910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83f4cfce-9acdc360-f84c6b86-a93b6e70_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d109802-120788f8-b16aa764-c217ecf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:40.842713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d109802-120788f8-b16aa764-c217ecf8_0] Write session: try to update token
2025-09-30T14:58:40.842733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d109802-120788f8-b16aa764-c217ecf8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:40.854648Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:40.854670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:40.854673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:40.854678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:40.854692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896822001355187:6996]
2025-09-30T14:58:40.854696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896822001355187:6996]
2025-09-30T14:58:40.854702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896822001355187:6996]
2025-09-30T14:58:40.854741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:40.854748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:40.854751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:40.854752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:40.854758Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:40.854763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:40.854890Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:40.866333Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2980 sessionId: src_id|d109802-120788f8-b16aa764-c217ecf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:40.869043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:40.920799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896822091156008:7727]
2025-09-30T14:58:40.921300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 2979, pipe: [1:7555896822091156008:7727]
2025-09-30T14:58:40.978815Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:40.979291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:40.979310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:40.979332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091156008:7727], now have 1 active actors on pipe
2025-09-30T14:58:40.979635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:40.979660Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896822091156008:7727]
2025-09-30T14:58:40.979692Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:40.979739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:40.979743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:40.979807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2980 reason: error at write: Disconnected sessionId: src_id|d109802-120788f8-b16aa764-c217ecf8_0
2025-09-30T14:58:40.979989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2980 sessionId: src_id|d109802-120788f8-b16aa764-c217ecf8_0 is DEAD
2025-09-30T14:58:40.980153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d109802-120788f8-b16aa764-c217ecf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:40.980165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d109802-120788f8-b16aa764-c217ecf8_0] Write session will restart in 0.006727s
2025-09-30T14:58:40.980184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d109802-120788f8-b16aa764-c217ecf8_0] Write session: Do CDS request
2025-09-30T14:58:40.980188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d109802-120788f8-b16aa764-c217ecf8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:40.987774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d109802-120788f8-b16aa764-c217ecf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.987899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:40.987917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2981
2025-09-30T14:58:40.988058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2981 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:40.988091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2981 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:40.988101Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2981 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:40.988114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:40.995991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2981 sessionId:  describe result for acl check
2025-09-30T14:58:40.996037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:40.996040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:40.996042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:40.996049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896822091156026:9854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:40.996636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896822091156026:9854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:41.001824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896822091156026:9854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:41.003745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:41.008428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896822091156026:9854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:41.008448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896822091156026:9854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:41.008460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896822091156026:9854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:41.008469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2981 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:41.008106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:41.008360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:41.008364Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:41.008375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:41.008445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:41.008485Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896826296322562:6988]
2025-09-30T14:58:41.009204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:41.009652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:41.009719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:41.010099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:41.010158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.010159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.010161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.010162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.010163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.010165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.010166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.010168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.010169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.010170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.010172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.010173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.010174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.010175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.010177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.010182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.010194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.010199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.010204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.010208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.010213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.010218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.010222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.010227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.010231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.010235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.010240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.010244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.010251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.010256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.010266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.010275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.010282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.010288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.010295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.010301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.010305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.010311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.010316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.010322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.010327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.010333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.010338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.010344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.010350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.010357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.010361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.010367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.010372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.010378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.010384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.010390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.010394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.010401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.010407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.010413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.010417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.010423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.010427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.010435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.010482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:41.019928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2980
2025-09-30T14:58:41.019982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2980
2025-09-30T14:58:41.018521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:41.019521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:41.019526Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:41.019537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:41.019540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:41.019547Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2980 [2:7555896826296322562:6988]
2025-09-30T14:58:41.019565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:41.019580Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:41.019584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:41.019587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:41.019589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:41.019603Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:41.019610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:41.019617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:41.019680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.019682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.019684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.019687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:41.019690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:41.019760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:41.019763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.019774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.019784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.019803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:41.019819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896826296322556:6988]
2025-09-30T14:58:41.019821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896826296322556:6988]
2025-09-30T14:58:41.019823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896826296322556:6988]
2025-09-30T14:58:41.019831Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:41.019842Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:41.019846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:41.019847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:41.019849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:41.019861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:41.019863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:41.019886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896822091156010:2454], now have 1 active actors on pipe
2025-09-30T14:58:41.019890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123378:9854], now have 1 active actors on pipe
2025-09-30T14:58:41.019918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896826296322556:6988]
2025-09-30T14:58:41.019925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:41.019942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:41.020177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.020185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.020215Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|543df31f-460a9590-87ac0605-7c3ad011_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:41.020227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:41.020231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:41.020236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:41.020247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:41.020272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:41.020287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:41.020490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.020503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.020524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:41.020664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2981 partition: 0 MaxSeqNo: 42 sessionId: src_id|543df31f-460a9590-87ac0605-7c3ad011_0
2025-09-30T14:58:41.021059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d109802-120788f8-b16aa764-c217ecf8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|543df31f-460a9590-87ac0605-7c3ad011_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:41.024053Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|543df31f-460a9590-87ac0605-7c3ad011_0] Write session: try to update token
2025-09-30T14:58:41.024073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|543df31f-460a9590-87ac0605-7c3ad011_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:41.039724Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:41.039747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:41.039750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:41.039752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:41.039764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896826296322556:6988]
2025-09-30T14:58:41.039768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896826296322556:6988]
2025-09-30T14:58:41.039772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896826296322556:6988]
2025-09-30T14:58:41.039814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:41.039827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:41.039840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.039840Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:41.039843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:41.039844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:41.040002Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:41.041914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2981 sessionId: src_id|543df31f-460a9590-87ac0605-7c3ad011_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:41.044831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:41.078989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896826386123392:7727]
2025-09-30T14:58:41.079842Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 2980, pipe: [1:7555896826386123392:7727]
2025-09-30T14:58:41.156508Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:41.156903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.156917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.156958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123392:7727], now have 1 active actors on pipe
2025-09-30T14:58:41.157289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:41.157303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:41.157306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:41.157352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896826386123392:7727]
2025-09-30T14:58:41.157352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:41.157378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2981 reason: error at write: Disconnected sessionId: src_id|543df31f-460a9590-87ac0605-7c3ad011_0
2025-09-30T14:58:41.157596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2981 sessionId: src_id|543df31f-460a9590-87ac0605-7c3ad011_0 is DEAD
2025-09-30T14:58:41.157754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543df31f-460a9590-87ac0605-7c3ad011_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:41.157764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543df31f-460a9590-87ac0605-7c3ad011_0] Write session will restart in 0.008321s
2025-09-30T14:58:41.157787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543df31f-460a9590-87ac0605-7c3ad011_0] Write session: Do CDS request
2025-09-30T14:58:41.157795Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543df31f-460a9590-87ac0605-7c3ad011_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:41.168176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:41.171681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|543df31f-460a9590-87ac0605-7c3ad011_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:41.172008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:41.172028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2982
2025-09-30T14:58:41.172795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:41.173035Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:41.173047Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:41.173058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:41.173121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:41.173164Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896826296322650:6978]
2025-09-30T14:58:41.173890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:41.175383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2982 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:41.175440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2982 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:41.175445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2982 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:41.175451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:41.175872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2982 sessionId:  describe result for acl check
2025-09-30T14:58:41.175912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:41.175914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:41.175916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:41.175921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896826386123445:9843] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:41.176450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896826386123445:9843] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:41.177959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:41.178044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:41.178791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896826386123445:9843] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:41.178450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:41.178522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.178524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.178525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.178527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.178528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.178529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.178531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.178532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.178534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.178535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.178536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.178538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.178539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.178540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.178542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.178548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.178558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.178563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.178568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.178575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.178579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.178583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.178586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.178589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.178593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.178596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.178599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.178604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.178608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.178613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.178621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.178630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.178637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.178644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.178649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.178655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.178660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.178666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.178673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.178678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.178683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.178689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.178695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.178701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.178707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.178713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.178718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.178724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.178729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.178735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.178741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.178747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.178752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.178759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.178766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.178771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.178777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.178783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.178788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.178794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.178870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:41.185497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896826386123445:9843] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:41.185527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896826386123445:9843] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:41.185533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896826386123445:9843] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:41.185541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2982 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:41.185779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:41.186798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:41.186814Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:41.186817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:41.186822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:41.186828Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2981 [2:7555896826296322650:6978]
2025-09-30T14:58:41.186844Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:41.186859Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:41.186863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:41.186866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:41.186868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:41.186884Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:41.186900Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:41.186910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:41.186974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.186983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.186984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.186987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:41.186990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:41.187057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:41.187064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.187078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.187091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.187116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:41.187136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123482:9843], now have 1 active actors on pipe
2025-09-30T14:58:41.187142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896826296322644:6978]
2025-09-30T14:58:41.187150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896826296322644:6978]
2025-09-30T14:58:41.187152Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896826296322644:6978]
2025-09-30T14:58:41.187168Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:41.187182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123395:2454], now have 1 active actors on pipe
2025-09-30T14:58:41.187204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:41.187225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:41.187232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:41.187293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2981
2025-09-30T14:58:41.187282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896826296322644:6978]
2025-09-30T14:58:41.187292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:41.187324Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2981
2025-09-30T14:58:41.187330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:41.187334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:41.187337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:41.187343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:41.187415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.187426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.187450Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:41.187459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:41.187462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:41.187466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:41.187476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:41.187487Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:41.187514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:41.187728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.187734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.187747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:41.187866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2982 partition: 0 MaxSeqNo: 42 sessionId: src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0
2025-09-30T14:58:41.191505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|543df31f-460a9590-87ac0605-7c3ad011_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:41.194542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0] Write session: try to update token
2025-09-30T14:58:41.194567Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:41.209130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:41.209153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:41.209162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896826296322644:6978]
2025-09-30T14:58:41.209205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:41.209215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:41.209389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:41.209550Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:41.209699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:41.209846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:41.210163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:41.210206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:41.224817Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2982 sessionId: src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:41.227458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:41.227632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:41.227648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:41.227651Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:41.227653Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:41.227662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896826296322644:6978]
2025-09-30T14:58:41.227670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896826296322644:6978]
2025-09-30T14:58:41.227673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896826296322644:6978]
2025-09-30T14:58:41.227719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.227722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:41.227729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.227729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:41.227733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:41.227747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:41.227753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.227756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:41.227901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:41.261685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896826386123500:7727]
2025-09-30T14:58:41.262007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 2981, pipe: [1:7555896826386123500:7727]
2025-09-30T14:58:41.347192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:41.347681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123500:7727], now have 1 active actors on pipe
2025-09-30T14:58:41.347894Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:41.349674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:41.349684Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0] Write session will restart in 0.009323s
2025-09-30T14:58:41.349710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0] Write session: Do CDS request
2025-09-30T14:58:41.349716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:41.347925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896826386123500:7727]
2025-09-30T14:58:41.347930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:41.347957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:41.347959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:41.348016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2982 reason: error at write: Disconnected sessionId: src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0
2025-09-30T14:58:41.348199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2982 sessionId: src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0 is DEAD
2025-09-30T14:58:41.357710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:41.359735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:41.359962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:41.359985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2983
2025-09-30T14:58:41.360156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2983 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:41.360190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2983 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:41.360196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2983 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:41.360200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:41.359157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:41.359378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:41.359381Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:41.359393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:41.359447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:41.359495Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896826296322758:6953]
2025-09-30T14:58:41.360195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:41.360709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2983 sessionId:  describe result for acl check
2025-09-30T14:58:41.360754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:41.360757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:41.360759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:41.360765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896826386123547:9829] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:41.361321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896826386123547:9829] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:41.360921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:41.360974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:41.361335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:41.361393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.361394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.361396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.361398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.361399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.361401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.361402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.361404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.361406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.361407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.361409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.361410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.361412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.361413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.361414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.361421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.361431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.361436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.361441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.361445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.361451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.361456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.361460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.361464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.361470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.361474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.361479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.361484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.361488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.361492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.361499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.361507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.361514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.361519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.361526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.361533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.361537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.361541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.361546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.361551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.361556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.361562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.361567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.361572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.361576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.361581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.361586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.361592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.361597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.361603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.361607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.361613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.361620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.361625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.361631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.361637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.361642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.361648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.361653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.361659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.361710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:41.364512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896826386123547:9829] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:41.367939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:41.368037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896826386123547:9829] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:41.368054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896826386123547:9829] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:41.368058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896826386123547:9829] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:41.368067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2983 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:41.368910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:41.368927Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:41.368930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:41.368935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:41.368942Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2982 [2:7555896826296322758:6953]
2025-09-30T14:58:41.368958Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:41.368971Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:41.368980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:41.368983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:41.368986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:41.369002Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:41.369009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:41.369015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:41.369068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.369073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.369075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.369077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:41.369079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:41.369139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:41.369147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.369161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.369174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.369196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:41.369219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123586:9829], now have 1 active actors on pipe
2025-09-30T14:58:41.369224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123507:2454], now have 1 active actors on pipe
2025-09-30T14:58:41.369230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896826296322753:6953]
2025-09-30T14:58:41.369233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896826296322753:6953]
2025-09-30T14:58:41.369235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896826296322753:6953]
2025-09-30T14:58:41.369247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:41.369279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2982
2025-09-30T14:58:41.369311Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2982
2025-09-30T14:58:41.369267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:41.369279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:41.369280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:41.369283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:41.369293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:41.369296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:41.369330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896826296322753:6953]
2025-09-30T14:58:41.369339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:41.369347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:41.369352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.369357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.369397Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:41.369409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:41.369413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:41.369416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:41.369426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:41.369435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:41.369457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:41.369650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.369660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.369678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:41.369785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2983 partition: 0 MaxSeqNo: 42 sessionId: src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0
2025-09-30T14:58:41.370984Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5ae16d-5c14ea0a-8a45abcf-9843529b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:41.373877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0] Write session: try to update token
2025-09-30T14:58:41.373898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:41.388033Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:41.388055Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:41.388057Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:41.388060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:41.388073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896826296322753:6953]
2025-09-30T14:58:41.388078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896826296322753:6953]
2025-09-30T14:58:41.388087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896826296322753:6953]
2025-09-30T14:58:41.388130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:41.388138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.388141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:41.388143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:41.388150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:41.388154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:41.388286Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:41.388988Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2983 sessionId: src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:41.391785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:41.448092Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896826386123593:7727]
2025-09-30T14:58:41.448388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 2982, pipe: [1:7555896826386123593:7727]
2025-09-30T14:58:41.511343Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:41.511821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.511834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.511878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123593:7727], now have 1 active actors on pipe
2025-09-30T14:58:41.512098Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:41.512560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896826386123593:7727]
2025-09-30T14:58:41.512595Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:41.512669Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2983 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0
2025-09-30T14:58:41.512844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2983 sessionId: src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0 is DEAD
2025-09-30T14:58:41.513017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:41.515474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:41.515488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0] Write session will restart in 0.007769s
2025-09-30T14:58:41.515512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0] Write session: Do CDS request
2025-09-30T14:58:41.515517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:41.526951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:41.528871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:41.529064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:41.529073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:41.529082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:41.529131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:41.529171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896826296322837:6947]
2025-09-30T14:58:41.529852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:41.530180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:41.530220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:41.530561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:41.530624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.530631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.530632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.530633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.530634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.530636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.530637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.530638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.530639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.530640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.530642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.530643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.530644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.530645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.530647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.530653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.530663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.530668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.530672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.530676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.530680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.530684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.530691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.530695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.530700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.530704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.530708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.530712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.530715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.530719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.530726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.530735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.530742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.530747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.530752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.530757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.530762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.530767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.530772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.530778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.530783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.530788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.530792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.530798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.530803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.530808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.530813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.530818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.530822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.530827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.530839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.530844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.530849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.530856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.530861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.530865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.530869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.530875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.530901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.530906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.530951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:41.531472Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:41.531615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:41.531632Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2984
2025-09-30T14:58:41.531819Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2984 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:41.531862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2984 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:41.531867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2984 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:41.531871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:41.532318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2984 sessionId:  describe result for acl check
2025-09-30T14:58:41.532343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:41.532345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:41.532347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:41.532353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896826386123638:9820] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:41.532929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896826386123638:9820] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:41.535379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896826386123638:9820] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:41.536957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:41.537942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:41.537960Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:41.537963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:41.537969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:41.537978Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2983 [2:7555896826296322837:6947]
2025-09-30T14:58:41.537994Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:41.538008Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:41.538012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:41.538015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:41.538017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:41.538033Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:41.538040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:41.538054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:41.538117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.538125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.538126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.538129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:41.538132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:41.538195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:41.538202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.538212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.538223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.538237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:41.538258Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896826296322832:6947]
2025-09-30T14:58:41.538265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896826296322832:6947]
2025-09-30T14:58:41.538266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896826296322832:6947]
2025-09-30T14:58:41.538280Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:41.538628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896826386123638:9820] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:41.538647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896826386123638:9820] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:41.538650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896826386123638:9820] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:41.538659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2984 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:41.538795Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2983
2025-09-30T14:58:41.538293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:41.538312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:41.538316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:41.538316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:41.538320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:41.538322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:41.538348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896826296322832:6947]
2025-09-30T14:58:41.538351Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:41.538393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:41.538451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123594:2454], now have 1 active actors on pipe
2025-09-30T14:58:41.539647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2983
2025-09-30T14:58:41.539611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123673:9820], now have 1 active actors on pipe
2025-09-30T14:58:41.540285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.540300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.540328Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:41.540338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:41.540343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:41.540345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:41.540353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:41.540364Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:41.540380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:41.540823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.540834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.540850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:41.540954Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2984 partition: 0 MaxSeqNo: 42 sessionId: src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0
2025-09-30T14:58:41.541353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a02a01e3-637421a5-792e8f73-9e80aa51_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:41.544332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0] Write session: try to update token
2025-09-30T14:58:41.544352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:41.553686Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:41.553707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:41.553717Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896826296322832:6947]
2025-09-30T14:58:41.553763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:41.553772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:41.553938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:41.554122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:41.554272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:41.554409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:41.554601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:41.554637Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:41.568155Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2984 sessionId: src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:41.570751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:41.571364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.571388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.571427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:41.574394Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:41.574419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:41.574422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:41.574424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:41.574435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896826296322832:6947]
2025-09-30T14:58:41.574440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896826296322832:6947]
2025-09-30T14:58:41.574448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896826296322832:6947]
2025-09-30T14:58:41.571541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:41.574483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:41.574497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.574498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:41.574500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:41.574505Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:41.574510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:41.574702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:41.612431Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896826386123691:7727]
2025-09-30T14:58:41.612966Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 2983, pipe: [1:7555896826386123691:7727]
2025-09-30T14:58:41.690416Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:41.709314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.709342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.709557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:41.709617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:41.709680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:41.709739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:41.709784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:41.709789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:41.709863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:41.709923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:41.709982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:41.710045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:41.710088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:41.710091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:41.710183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:41.710241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:41.710302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:41.710367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:41.710407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:41.710412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:41.710483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:41.710543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:41.710600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:41.710657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:41.710696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:41.710699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:41.710769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:41.710826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:41.710903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:41.710965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:41.711008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:41.711011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:41.711077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:41.711133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:41.711190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:41.711610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:41.711657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:41.711665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:41.711735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:41.711800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:41.713911Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896826386123691:7727]
2025-09-30T14:58:41.713951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:41.713954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:41.713992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2984 reason: error at write: Disconnected sessionId: src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0
2025-09-30T14:58:41.714185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2984 sessionId: src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0 is DEAD
2025-09-30T14:58:41.714323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:41.714592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:41.714607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0] Write session will restart in 0.007519s
2025-09-30T14:58:41.714632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0] Write session: Do CDS request
2025-09-30T14:58:41.714638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:41.711865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:41.711934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:41.711977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:41.711981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:41.712047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:41.712105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:41.712164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:41.712224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:41.712264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:41.712269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:41.712334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:41.712396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:41.712455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:41.712516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:41.712556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:41.712559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:41.712623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:41.712680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:41.712755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:41.712816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:41.712859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:41.712862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:41.712931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123691:7727], now have 1 active actors on pipe
2025-09-30T14:58:41.714207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:41.723749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:41.723860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:41.723892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2985
2025-09-30T14:58:41.724117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2985 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:41.724151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2985 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:41.724162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2985 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:41.724168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:41.724576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2985 sessionId:  describe result for acl check
2025-09-30T14:58:41.724606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:41.724608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:41.724614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:41.724615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:41.724621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896826386123731:9811] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:41.725192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896826386123731:9811] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:41.726174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:41.726371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:41.726382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:41.726393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:41.726440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:41.726475Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896826296322916:6933]
2025-09-30T14:58:41.727289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896826386123731:9811] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:41.727022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:41.727449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:41.727486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:41.727769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:41.727828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.727835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.727836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.727837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.727838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.727839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.727840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.727841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.727842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.727843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.727844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.727845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.727846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.727847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.727848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.727852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.727861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.727864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.727868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.727871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.727875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.727877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.727881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.727883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.727887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.727890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.727893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.727896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.727899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.727905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.727911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.727918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.727922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.727927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.727930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.727934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.727938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.727942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.727946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.727950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.727956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.727959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.727963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.727968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.727972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.727976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.727981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.727985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.727988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.727992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.727996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.728000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.728003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.728007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.728011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.728015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.728020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.728024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.728027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.728031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.728066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:41.733399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896826386123731:9811] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:41.733418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896826386123731:9811] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:41.733421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896826386123731:9811] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:41.733428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2985 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:41.733861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:41.734734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:41.734750Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:41.734754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:41.734760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:41.734767Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2984 [2:7555896826296322916:6933]
2025-09-30T14:58:41.734782Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:41.734798Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:41.734801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:41.734804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:41.734806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:41.734824Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:41.734831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:41.734843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:41.734903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.734910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.734913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.734916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:41.734918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:41.734989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:41.734997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.735010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.735027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.735050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:41.735071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896826296322910:6933]
2025-09-30T14:58:41.735080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896826296322910:6933]
2025-09-30T14:58:41.735083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896826296322910:6933]
2025-09-30T14:58:41.735098Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:41.735116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:41.735135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:41.735143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:41.735174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896826296322910:6933]
2025-09-30T14:58:41.735180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:41.735199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:41.735200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123770:9811], now have 1 active actors on pipe
2025-09-30T14:58:41.735209Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:41.735210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123694:2454], now have 1 active actors on pipe
2025-09-30T14:58:41.735211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:41.735219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:41.735311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2984
2025-09-30T14:58:41.735346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2984
2025-09-30T14:58:41.735415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.735428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.735452Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:41.735464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:41.735468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:41.735470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:41.735480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:41.735489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:41.735507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:41.735737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.735746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.735759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:41.735858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2985 partition: 0 MaxSeqNo: 42 sessionId: src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0
2025-09-30T14:58:41.736194Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ac5ec00e-3df3e37a-12e1bb50-cc3c76d2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:41.746915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0] Write session: try to update token
2025-09-30T14:58:41.746942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:41.748553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:41.748572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:41.748575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:41.748577Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:41.748587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896826296322910:6933]
2025-09-30T14:58:41.748591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896826296322910:6933]
2025-09-30T14:58:41.748600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896826296322910:6933]
2025-09-30T14:58:41.748636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:41.748644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.748649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:41.748806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:41.750791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:41.750802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:41.750805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:41.768065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2985 sessionId: src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:41.773426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:41.814247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896826386123780:7727]
2025-09-30T14:58:41.814555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 2984, pipe: [1:7555896826386123780:7727]
2025-09-30T14:58:41.867546Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:41.867957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.867968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.867989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123780:7727], now have 1 active actors on pipe
2025-09-30T14:58:41.868276Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:41.868960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:41.868971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0] Write session will restart in 0.008227s
2025-09-30T14:58:41.868994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0] Write session: Do CDS request
2025-09-30T14:58:41.868999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:41.868295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896826386123780:7727]
2025-09-30T14:58:41.868327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:41.868360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:41.868363Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:41.868424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2985 reason: error at write: Disconnected sessionId: src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0
2025-09-30T14:58:41.868570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2985 sessionId: src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0 is DEAD
2025-09-30T14:58:41.878590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:41.878757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:41.879681Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:41.879701Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2986
2025-09-30T14:58:41.879832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2986 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:41.879865Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2986 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:41.879875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2986 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:41.879879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:41.879799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:41.879991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:41.879994Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:41.880005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:41.880049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:41.880088Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896826296322993:6928]
2025-09-30T14:58:41.880759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:41.881203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:41.881257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:41.881590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:41.881653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.881655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.881656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.881657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.881658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.881659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.881660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.881661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.881663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.881664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.881665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.881666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.881667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.881669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.881670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.881676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.881687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.881691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.881696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.881700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.881704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.881709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.881713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.881717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.881725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.881729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.881733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.881737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.881741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.881745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.881753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.881761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:41.881768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.881774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:41.881780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.881786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:41.881793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.881798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:41.881804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.881810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:41.881815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.881820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:41.881827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.881834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:41.881839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.881844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:41.881848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.881853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:41.881857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.881862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:41.881867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.881872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.881876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.881881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.881886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.881894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.881898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.881904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:41.881909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.881914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:41.881961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:41.882729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2986 sessionId:  describe result for acl check
2025-09-30T14:58:41.882772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:41.882774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:41.882775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:41.882782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896826386123834:9809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:41.883297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896826386123834:9809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:41.885415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896826386123834:9809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:41.889312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896826386123834:9809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:41.889331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896826386123834:9809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:41.889333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896826386123834:9809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:41.889339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2986 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:41.889962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:41.890842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:41.890849Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:41.890852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:41.890856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:41.890864Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2985 [2:7555896826296322993:6928]
2025-09-30T14:58:41.890882Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:41.890898Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:41.891352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2985
2025-09-30T14:58:41.890901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:41.891387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2985
2025-09-30T14:58:41.890906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:41.890908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:41.890924Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:41.890931Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:41.890938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:41.891004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.891007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.891008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.891013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:41.891016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:41.891089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:41.891091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.891104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:41.891116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:41.891132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:41.891148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896826296322988:6928]
2025-09-30T14:58:41.891151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896826296322988:6928]
2025-09-30T14:58:41.891153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896826296322988:6928]
2025-09-30T14:58:41.891160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:41.891170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:41.891174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:41.891176Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:41.891177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123867:9809], now have 1 active actors on pipe
2025-09-30T14:58:41.891183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123782:2454], now have 1 active actors on pipe
2025-09-30T14:58:41.891189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:41.891202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:41.891205Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:41.891239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896826296322988:6928]
2025-09-30T14:58:41.891282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:41.891316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:41.891487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.891492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.891518Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:41.891526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:41.891531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:41.891533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:41.891543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:41.891568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:41.891585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:41.891847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:41.891860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:41.891894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:41.892005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2986 partition: 0 MaxSeqNo: 42 sessionId: src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0
2025-09-30T14:58:41.892350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b016108c-520d8d1d-884d09b2-d33c4e5b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:41.895207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0] Write session: try to update token
2025-09-30T14:58:41.895227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:41.909014Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:41.909035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:41.909038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:41.909046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:41.909057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896826296322988:6928]
2025-09-30T14:58:41.909062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896826296322988:6928]
2025-09-30T14:58:41.909070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896826296322988:6928]
2025-09-30T14:58:41.909119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:41.909130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:41.909133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:41.909156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:41.909169Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:41.909173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:41.909302Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:41.917295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2986 sessionId: src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:41.921393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:41.967796Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896826386123875:7727]
2025-09-30T14:58:41.968311Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 2985, pipe: [1:7555896826386123875:7727]
2025-09-30T14:58:42.033099Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:42.033549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.033571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.033610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896826386123875:7727], now have 1 active actors on pipe
2025-09-30T14:58:42.033874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:42.033893Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:42.033908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896826386123875:7727]
2025-09-30T14:58:42.033911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:42.033926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:42.033975Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2986 reason: error at write: Disconnected sessionId: src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0
2025-09-30T14:58:42.034151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2986 sessionId: src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0 is DEAD
2025-09-30T14:58:42.034284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:42.034295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0] Write session will restart in 0.007135s
2025-09-30T14:58:42.034332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0] Write session: Do CDS request
2025-09-30T14:58:42.034342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:42.041422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:42.042779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:42.042834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:42.042850Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2987
2025-09-30T14:58:42.042963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:42.043004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2987 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:42.043046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2987 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:42.043056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2987 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:42.043063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:42.043183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:42.043197Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:42.043209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:42.043290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:42.043335Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896830591290366:6924]
2025-09-30T14:58:42.043529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2987 sessionId:  describe result for acl check
2025-09-30T14:58:42.043562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:42.043569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:42.043571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:42.043577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896830681091213:9801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:42.043987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:42.044105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896830681091213:9801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:42.044300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:42.044351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:42.044684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:42.044769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.044779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.044780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.044782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.044783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.044784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.044786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.044787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.044788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.044789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.044790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.044792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.044793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.044794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.044795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.044801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.044811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.044816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.044820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.044824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.044830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.044834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.044838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.044842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.044846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.044850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.044854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.044857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.044860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.044864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.044871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.044878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.044884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.044889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.044894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.044900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.044905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.044910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.044916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.044922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.044927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.044932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.044937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.044942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.044954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.044960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.044966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.044971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.044983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.044988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.044998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.045005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.045014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.045020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.045024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.045030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.045034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.045039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.045045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.045049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.045092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:42.045785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896830681091213:9801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:42.050135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896830681091213:9801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:42.050159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896830681091213:9801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:42.050169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896830681091213:9801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:42.050181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2987 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:42.050496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:42.051434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:42.051452Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:42.051455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:42.051458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:42.051465Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2986 [2:7555896830591290366:6924]
2025-09-30T14:58:42.051483Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:42.051501Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:42.051504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:42.051506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:42.051508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:42.051524Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:42.051537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:42.051543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:42.051621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.051629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.051631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.051634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:42.051636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:42.051732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:42.051740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.051752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.051769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.051791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:42.051815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091173:2454], now have 1 active actors on pipe
2025-09-30T14:58:42.051824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091252:9801], now have 1 active actors on pipe
2025-09-30T14:58:42.051831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896830591290361:6924]
2025-09-30T14:58:42.051838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896830591290361:6924]
2025-09-30T14:58:42.051840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896830591290361:6924]
2025-09-30T14:58:42.051854Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:42.051873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:42.051895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:42.051903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:42.051940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896830591290361:6924]
2025-09-30T14:58:42.051947Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:42.051946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2986
2025-09-30T14:58:42.051975Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2986
2025-09-30T14:58:42.052056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:42.052067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:42.052070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:42.052077Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:42.052149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.052166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.052193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:42.052207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:42.052210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:42.052212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:42.052219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:42.052228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:42.052239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:42.052434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.052447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.052472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:42.052580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2987 partition: 0 MaxSeqNo: 42 sessionId: src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0
2025-09-30T14:58:42.053026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|445b6bfb-e69e10dd-bb8b1f2c-d307427d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:42.055906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0] Write session: try to update token
2025-09-30T14:58:42.055925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:42.064347Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:42.064365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:42.064375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896830591290361:6924]
2025-09-30T14:58:42.064421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:42.064422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:42.064595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:42.064768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:42.064937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:42.065085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:42.065283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:42.065330Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:42.070590Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2987 sessionId: src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:42.073816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:42.074025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.074056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.074091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:42.074199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:42.079774Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:42.079792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:42.079795Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:42.079798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:42.079808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896830591290361:6924]
2025-09-30T14:58:42.079813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896830591290361:6924]
2025-09-30T14:58:42.079818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896830591290361:6924]
2025-09-30T14:58:42.079862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:42.079870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.079873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:42.079885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:42.079892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:42.079897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:42.080022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:42.134226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896830681091259:7727]
2025-09-30T14:58:42.134501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 2986, pipe: [1:7555896830681091259:7727]
2025-09-30T14:58:42.195983Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:42.204754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.204787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.204968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.205033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.205102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.205171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.205222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.205234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.205305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.205367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.205434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.205510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.205556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.205569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.205637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.205699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.205767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.205837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.205881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.205889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.205957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.206027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.206090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.206155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.206276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.206287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.206354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.206420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.206488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.206558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.206604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.206613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.206682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.206748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.206815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.206881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.206926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.206934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.207003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.207068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.207137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.207201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.207263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.207274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.207342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.207405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.207470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.207534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.207583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.207590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.207657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.207722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.207788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.207848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.207898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.207905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.207971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.208036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.208106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.208168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.208215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.208222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.208284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091259:7727], now have 1 active actors on pipe
2025-09-30T14:58:42.208556Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:42.208561Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:42.208568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:42.208609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2987 reason: error at write: Disconnected sessionId: src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0
2025-09-30T14:58:42.208626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896830681091259:7727]
2025-09-30T14:58:42.208832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2987 sessionId: src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0 is DEAD
2025-09-30T14:58:42.209453Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:42.211464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:42.211474Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0] Write session will restart in 0.006677s
2025-09-30T14:58:42.211514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0] Write session: Do CDS request
2025-09-30T14:58:42.211520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:42.217383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:42.219289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:42.219556Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:42.219568Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:42.219580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:42.219640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:42.219679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:42.219677Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896830591290460:6920]
2025-09-30T14:58:42.220384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:42.220700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:42.220768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:42.221160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:42.221240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.221248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.221249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.221251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.221253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.221254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.221255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.221257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.221258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.221259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.221260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.221261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.221263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.221264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.221265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.221274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.221285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.221290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.221295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.221300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.221307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.221312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.221317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.221321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.221325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.221329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.221334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.221339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.221343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.221347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.221356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.221364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.221371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.221378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.221383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.221389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.221394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.221400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.221407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.221413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.221418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.221424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.221432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.221437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.221441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.221447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.221452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.221458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.221466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.221471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.221478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.221486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.221491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.221497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.221502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.221520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.221525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.221531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.221536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.221543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.221593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:42.223597Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:42.223615Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2988
2025-09-30T14:58:42.223784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2988 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:42.223826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2988 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:42.223835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2988 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:42.223840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:42.224234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2988 sessionId:  describe result for acl check
2025-09-30T14:58:42.224269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:42.224274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:42.224276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:42.224282Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896830681091322:9781] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:42.224850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896830681091322:9781] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:42.227001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896830681091322:9781] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:42.228770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:42.229724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896830681091322:9781] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:42.229741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896830681091322:9781] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:42.229744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896830681091322:9781] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:42.229752Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2988 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:42.230144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2987
2025-09-30T14:58:42.229787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:42.229807Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:42.229810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:42.229813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:42.230278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2987
2025-09-30T14:58:42.229820Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2987 [2:7555896830591290460:6920]
2025-09-30T14:58:42.229835Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:42.229852Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:42.229855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:42.229857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:42.229863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:42.229881Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:42.229888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:42.229895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:42.229949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.229951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.229953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.229957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:42.229959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:42.230025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:42.230028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.230043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.230057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.230076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:42.230095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091261:2454], now have 1 active actors on pipe
2025-09-30T14:58:42.230102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896830591290448:6920]
2025-09-30T14:58:42.230104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896830591290448:6920]
2025-09-30T14:58:42.230106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896830591290448:6920]
2025-09-30T14:58:42.230128Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:42.230142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:42.230145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:42.230149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:42.230151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:42.230157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:42.230160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:42.230195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896830591290448:6920]
2025-09-30T14:58:42.230198Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:42.230200Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:42.230210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091355:9781], now have 1 active actors on pipe
2025-09-30T14:58:42.230422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.230437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.230460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:42.230466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:42.230470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:42.230472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:42.230481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:42.230490Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:42.230508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:42.230661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.230669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.230683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:42.230786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2988 partition: 0 MaxSeqNo: 42 sessionId: src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0
2025-09-30T14:58:42.231157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ab1a195d-b6e68254-8edbb938-aafce8a9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:42.234218Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0] Write session: try to update token
2025-09-30T14:58:42.234239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:42.243521Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:42.243542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:42.243552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896830591290448:6920]
2025-09-30T14:58:42.243602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:42.243635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:42.243789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:42.244121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:42.244282Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:42.244434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:42.244635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:42.244687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:42.250805Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2988 sessionId: src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:42.253647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:42.254263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.254286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.255839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:42.255876Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:42.255878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:42.255880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:42.255882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:42.255891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896830591290448:6920]
2025-09-30T14:58:42.255894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896830591290448:6920]
2025-09-30T14:58:42.255897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896830591290448:6920]
2025-09-30T14:58:42.255926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:42.255934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.255937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:42.256078Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:42.258736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:42.258749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:42.258753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:42.259361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:42.311389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896830681091377:7727]
2025-09-30T14:58:42.311746Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 2987, pipe: [1:7555896830681091377:7727]
2025-09-30T14:58:42.377160Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:42.385956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.385991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.386177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.386255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.386319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.386394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.386861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.386877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.386958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.387026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.387102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.387185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.387236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.387264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.387344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.387415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.387487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.387557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.387606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.387614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.387686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.387761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.387836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.387909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.387960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.387969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.388046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.388122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.388200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.388273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.388330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.388340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.388415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.388488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.388567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.388637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.388709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.388719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.388817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.388889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.388964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.389043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.389093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.389101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.389178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.389248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.389317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.389391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.389443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.389451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.389530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.389602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.389675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.389751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.389800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.389808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.389881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.389951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.390023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.390096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.390387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.390397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.390468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091377:7727], now have 1 active actors on pipe
2025-09-30T14:58:42.391266Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:42.390990Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:42.390848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:42.391291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0] Write session will restart in 0.006590s
2025-09-30T14:58:42.390851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:42.390856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:42.390889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2988 reason: error at write: Disconnected sessionId: src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0
2025-09-30T14:58:42.390923Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896830681091377:7727]
2025-09-30T14:58:42.391090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2988 sessionId: src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0 is DEAD
2025-09-30T14:58:42.391347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0] Write session: Do CDS request
2025-09-30T14:58:42.391354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:42.398760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:42.399110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:42.399128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2989
2025-09-30T14:58:42.399226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2989 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:42.399266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2989 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:42.399271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2989 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:42.399275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:42.399674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2989 sessionId:  describe result for acl check
2025-09-30T14:58:42.399698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:42.399700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:42.399703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:42.399709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896830681091422:9776] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:42.400239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896830681091422:9776] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:42.402965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896830681091422:9776] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:42.406164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896830681091422:9776] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:42.406184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896830681091422:9776] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:42.406187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896830681091422:9776] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:42.406195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2989 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:42.404056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:42.405997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:42.406252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:42.406257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:42.406269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:42.406331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:42.406370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896830591290575:6904]
2025-09-30T14:58:42.407047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:42.407422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:42.407483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:42.407832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:42.407913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.407914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.407916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.407917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.407918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.407920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.407921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.407922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.407923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.407924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.407926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.407927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.407928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.407929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.407931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.407937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.407947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.407951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.407955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.407959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.407963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.407967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.407971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.407975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.407982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.407986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.407990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.407994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.407998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.408002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.408011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.408019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.408026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.408032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.408036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.408042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.408047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.408052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.408058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.408063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.408067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.408072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.408078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.408083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.408087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.408093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.408098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.408102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.408106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.408112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.408118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.408124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.408128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.408133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.408138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.408145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.408150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.408155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.408160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.408165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.408206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:42.414091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:42.415278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:42.415294Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:42.415300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:42.415304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:42.415311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2988 [2:7555896830591290575:6904]
2025-09-30T14:58:42.415330Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:42.415347Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:42.415354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:42.415357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:42.415359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:42.415379Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:42.415386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:42.415393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:42.415462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.415471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.415473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.415476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:42.415479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:42.415552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:42.415562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.415577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.415588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.415604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:42.415624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896830591290570:6904]
2025-09-30T14:58:42.415630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896830591290570:6904]
2025-09-30T14:58:42.415632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896830591290570:6904]
2025-09-30T14:58:42.415649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:42.415672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091382:2454], now have 1 active actors on pipe
2025-09-30T14:58:42.415675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:42.415679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:42.415680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091460:9776], now have 1 active actors on pipe
2025-09-30T14:58:42.415681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:42.415686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:42.415699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:42.415702Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:42.415738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896830591290570:6904]
2025-09-30T14:58:42.415751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:42.415747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2988
2025-09-30T14:58:42.415802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2988
2025-09-30T14:58:42.415789Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:42.416013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.416019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.416048Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:42.416076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:42.416079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:42.416081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:42.416093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:42.416103Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:42.416118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:42.416396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.416408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.416430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:42.416578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2989 partition: 0 MaxSeqNo: 42 sessionId: src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0
2025-09-30T14:58:42.417013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a3cb19bf-235ca28-afe97b68-dc656f2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:42.419859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0] Write session: try to update token
2025-09-30T14:58:42.419880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:42.430390Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:42.430423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:42.430427Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:42.430429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:42.430441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896830591290570:6904]
2025-09-30T14:58:42.430445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896830591290570:6904]
2025-09-30T14:58:42.430449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896830591290570:6904]
2025-09-30T14:58:42.430504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:42.430513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.430516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:42.430743Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:42.431304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:42.431320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:42.431326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:42.438692Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2989 sessionId: src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:42.441641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:42.491083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896830681091471:7727]
2025-09-30T14:58:42.491405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 2988, pipe: [1:7555896830681091471:7727]
2025-09-30T14:58:42.551068Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:42.551596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.551617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.551641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091471:7727], now have 1 active actors on pipe
2025-09-30T14:58:42.551896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:42.551909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896830681091471:7727]
2025-09-30T14:58:42.551945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:42.551948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:42.552032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2989 reason: error at write: Disconnected sessionId: src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0
2025-09-30T14:58:42.552220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2989 sessionId: src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0 is DEAD
2025-09-30T14:58:42.552416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:42.552427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0] Write session will restart in 0.005720s
2025-09-30T14:58:42.552449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0] Write session: Do CDS request
2025-09-30T14:58:42.552456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:42.552205Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:42.559763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:42.559996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:42.560016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2990
2025-09-30T14:58:42.560169Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2990 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:42.560203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2990 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:42.560214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2990 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:42.560235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:42.560688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2990 sessionId:  describe result for acl check
2025-09-30T14:58:42.560721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:42.560743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:42.560747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:42.560753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896830681091514:9763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:42.561353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896830681091514:9763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:42.561586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:42.561798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:42.561991Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:42.562011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:42.562027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:42.562134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:42.562222Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896830591290652:6897]
2025-09-30T14:58:42.562995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:42.563625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896830681091514:9763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:42.563967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:42.564028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:42.564642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:42.564754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.564762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.564764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.564765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.564766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.564768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.564769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.564770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.564772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.564773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.564774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.564776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.564777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.564778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.564782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.564790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.564801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.564805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.564810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.564814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.564819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.564822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.564826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.564829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.564833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.564836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.564840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.564844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.564848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.564851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.564858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.564866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.564872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.564877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.564881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.564886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.564889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.564894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.564898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.564903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.564906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.564911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.564916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.564921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.564925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.564930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.564934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.564939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.564943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.564949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.564959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.564965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.564973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.564978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.564983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.564988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.564993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.564997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.565003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.565008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.565056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:42.568284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896830681091514:9763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:42.568306Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896830681091514:9763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:42.568311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896830681091514:9763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:42.568320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2990 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:42.570874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:42.572147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:42.572168Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:42.572171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:42.572175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:42.572182Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2989 [2:7555896830591290652:6897]
2025-09-30T14:58:42.572199Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:42.572222Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:42.572230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:42.572233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:42.572236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:42.572253Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:42.572260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:42.572274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:42.572346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.572354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.572356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.572360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:42.572362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:42.572433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:42.572441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.572455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.572469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.572491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:42.572513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896830591290649:6897]
2025-09-30T14:58:42.572515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896830591290649:6897]
2025-09-30T14:58:42.572517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896830591290649:6897]
2025-09-30T14:58:42.572526Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:42.572540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:42.572560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:42.572568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:42.572585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:42.572597Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:42.572599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:42.572603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896830591290649:6897]
2025-09-30T14:58:42.572606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:42.572613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:42.572623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091473:2454], now have 1 active actors on pipe
2025-09-30T14:58:42.572639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091555:9763], now have 1 active actors on pipe
2025-09-30T14:58:42.573017Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2989
2025-09-30T14:58:42.573066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2989
2025-09-30T14:58:42.573115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.573127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.573154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19d5b779-412017b7-45963466-18a6389d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:42.573166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:42.573170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:42.573178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:42.573188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:42.573203Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:42.573222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:42.573412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.573424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.573439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:42.573545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2990 partition: 0 MaxSeqNo: 42 sessionId: src_id|19d5b779-412017b7-45963466-18a6389d_0
2025-09-30T14:58:42.573925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e7dc62c-34cb4d4c-63f0e1b8-1b7adc34_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|19d5b779-412017b7-45963466-18a6389d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:42.576827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19d5b779-412017b7-45963466-18a6389d_0] Write session: try to update token
2025-09-30T14:58:42.576846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19d5b779-412017b7-45963466-18a6389d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:42.589143Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:42.589168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:42.589171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:42.589172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:42.589181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896830591290649:6897]
2025-09-30T14:58:42.589185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896830591290649:6897]
2025-09-30T14:58:42.589189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896830591290649:6897]
2025-09-30T14:58:42.589228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:42.589234Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.589237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:42.589240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:42.589248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:42.589257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:42.589762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:42.598410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2990 sessionId: src_id|19d5b779-412017b7-45963466-18a6389d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:42.601413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:42.651860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896830681091574:7727]
2025-09-30T14:58:42.652139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 2989, pipe: [1:7555896830681091574:7727]
2025-09-30T14:58:42.702697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:42.703156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.703173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.703192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091574:7727], now have 1 active actors on pipe
2025-09-30T14:58:42.703687Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:42.704011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896830681091574:7727]
2025-09-30T14:58:42.704059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:42.704090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:42.704092Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:42.704167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2990 reason: error at write: Disconnected sessionId: src_id|19d5b779-412017b7-45963466-18a6389d_0
2025-09-30T14:58:42.704340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2990 sessionId: src_id|19d5b779-412017b7-45963466-18a6389d_0 is DEAD
2025-09-30T14:58:42.704761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d5b779-412017b7-45963466-18a6389d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:42.704772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d5b779-412017b7-45963466-18a6389d_0] Write session will restart in 0.005233s
2025-09-30T14:58:42.704796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d5b779-412017b7-45963466-18a6389d_0] Write session: Do CDS request
2025-09-30T14:58:42.704802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d5b779-412017b7-45963466-18a6389d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:42.710795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19d5b779-412017b7-45963466-18a6389d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:42.711144Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:42.711162Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2991
2025-09-30T14:58:42.711380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2991 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:42.711424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2991 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:42.711429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2991 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:42.711433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:42.711952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2991 sessionId:  describe result for acl check
2025-09-30T14:58:42.711991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:42.711993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:42.711995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:42.712001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896830681091591:9761] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:42.712570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896830681091591:9761] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:42.717766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896830681091591:9761] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:42.719823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:42.722708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:42.722952Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:42.722956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:42.722968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:42.723030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:42.723066Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896830591290738:6893]
2025-09-30T14:58:42.723737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:42.724122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896830681091591:9761] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:42.724142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896830681091591:9761] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:42.724146Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896830681091591:9761] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:42.724154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2991 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:42.724328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:42.724386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:42.724812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:42.724890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.724897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.724898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.724899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.724901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.724902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.724903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.724904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.724906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.724907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.724908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.724909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.724910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.724911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.724912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.724920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.724932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.724937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.724942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.724946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.724950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.724955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.724959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.724964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.724969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.724974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.724978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.724982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.724986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.724990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.724998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.725006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.725013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.725019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.725025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.725031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.725035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.725041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.725047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.725054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.725059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.725065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.725078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.725085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.725090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.725095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.725101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.725107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.725111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.725117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.725122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.725127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.725132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.725138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.725150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.725156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.725160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.725165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.725171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.725176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.725226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:42.732939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:42.733941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:42.733957Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:42.733960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:42.733964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:42.733972Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2990 [2:7555896830591290738:6893]
2025-09-30T14:58:42.733991Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:42.734007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:42.734011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:42.734013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:42.734015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:42.734032Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:42.734039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:42.734045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:42.734114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.734124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.734126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.734130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:42.734132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:42.734207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:42.734214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.734226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.734241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.734261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:42.734284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091657:9761], now have 1 active actors on pipe
2025-09-30T14:58:42.734292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091576:2454], now have 1 active actors on pipe
2025-09-30T14:58:42.734302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896830591290733:6893]
2025-09-30T14:58:42.734308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896830591290733:6893]
2025-09-30T14:58:42.734310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896830591290733:6893]
2025-09-30T14:58:42.734323Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:42.734336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:42.734341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:42.734347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:42.734350Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:42.734350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:42.734353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:42.734389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896830591290733:6893]
2025-09-30T14:58:42.734404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:42.734411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:42.734396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2990
2025-09-30T14:58:42.734398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2990
2025-09-30T14:58:42.734565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.734581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.734620Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:42.734634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:42.734643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:42.734646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:42.734661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:42.734678Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:42.734706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:42.734955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.734965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.734984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:42.735065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2991 partition: 0 MaxSeqNo: 42 sessionId: src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0
2025-09-30T14:58:42.735451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19d5b779-412017b7-45963466-18a6389d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:42.738402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0] Write session: try to update token
2025-09-30T14:58:42.738423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:42.754177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2991 sessionId: src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:42.754195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:42.754217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:42.754227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896830591290733:6893]
2025-09-30T14:58:42.754276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:42.754278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:42.754472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:42.754632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:42.754772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:42.754918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:42.755126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:42.755164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:42.757150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:42.757358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.757379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.757412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:42.757503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:42.762011Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:42.762028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:42.762031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:42.762033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:42.762043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896830591290733:6893]
2025-09-30T14:58:42.762050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896830591290733:6893]
2025-09-30T14:58:42.762055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896830591290733:6893]
2025-09-30T14:58:42.762097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:42.762102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:42.762109Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:42.762110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.762112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:42.762113Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:42.762251Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:42.803917Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896830681091668:7727]
2025-09-30T14:58:42.804446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 2990, pipe: [1:7555896830681091668:7727]
2025-09-30T14:58:42.876107Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:42.884241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.884269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.884460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.884528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.884602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.884675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.884737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.884749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.884838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.884908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.884984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.885058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.885107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.885115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.885190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.885258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.885330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.885396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.885441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.885448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.885518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.885591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.885702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.885812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.886148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.886159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.886234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.886321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.886395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.886478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.886615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.886623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.886706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.886775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.886845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.886944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.886990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.886999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.887114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.887561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.887691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.887787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.887849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.887852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.887963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.888059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.888131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.888203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.888342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.888346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.888419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.888483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.888549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.888617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.888682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.888685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.888784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:42.888847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:42.888912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:42.888976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:42.889021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:42.889025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:42.889151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091668:7727], now have 1 active actors on pipe
2025-09-30T14:58:42.890379Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:42.891336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:42.891399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896830681091668:7727]
2025-09-30T14:58:42.891420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:42.891459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2991 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0
2025-09-30T14:58:42.891636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2991 sessionId: src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0 is DEAD
2025-09-30T14:58:42.894118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:42.894131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0] Write session will restart in 0.007806s
2025-09-30T14:58:42.894155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0] Write session: Do CDS request
2025-09-30T14:58:42.894162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:42.903020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:42.903910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:42.906532Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:42.906552Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2992
2025-09-30T14:58:42.906749Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2992 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:42.906784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2992 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:42.906789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2992 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:42.906794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:42.907216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2992 sessionId:  describe result for acl check
2025-09-30T14:58:42.907263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:42.907266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:42.907268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:42.907274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896830681091717:9752] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:42.907846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896830681091717:9752] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:42.910459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:42.910676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:42.910681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:42.910691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:42.910744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:42.910783Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896830591290820:6888]
2025-09-30T14:58:42.911458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:42.911847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:42.911901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:42.912235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:42.912302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.912304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.912305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.912307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.912308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.912310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.912311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.912312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.912313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.912314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.912316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.912317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.912318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.912319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.912321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.912326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.912338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.912342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.912347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.912351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.912356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.912360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.912364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.912368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.912372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.912377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.912381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.912385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.912390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.912394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.912401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.912410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:42.912416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.912422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:42.912430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.912435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:42.912441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.912447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:42.912452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.912457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:42.912463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.912468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:42.912474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.912479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:42.912484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.912489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:42.912493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.912499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:42.912503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.912509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:42.912513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.912518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.912523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.912528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.912533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.912539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.912543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.912550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:42.912555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.912560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:42.912606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:42.911858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896830681091717:9752] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:42.920230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896830681091717:9752] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:42.920251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896830681091717:9752] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:42.920256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896830681091717:9752] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:42.920265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2992 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:42.921501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:42.922465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:42.922484Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:42.922488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:42.922492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:42.922498Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2991 [2:7555896830591290820:6888]
2025-09-30T14:58:42.922518Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:42.922535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:42.922538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:42.922541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:42.922543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:42.922560Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:42.922569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:42.922582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:42.922650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.922658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.922660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.922663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:42.922666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:42.922735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:42.922742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.922758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:42.922770Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:42.922787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:42.922807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091673:2454], now have 1 active actors on pipe
2025-09-30T14:58:42.922812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091755:9752], now have 1 active actors on pipe
2025-09-30T14:58:42.922821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896830591290814:6888]
2025-09-30T14:58:42.922824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896830591290814:6888]
2025-09-30T14:58:42.922826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896830591290814:6888]
2025-09-30T14:58:42.922840Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:42.922858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:42.922873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:42.922877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:42.922913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896830591290814:6888]
2025-09-30T14:58:42.922915Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:42.922953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:42.922959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:42.922962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:42.922969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:42.923314Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2991
2025-09-30T14:58:42.923361Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2991
2025-09-30T14:58:42.923611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.923627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.923659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:42.923670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:42.923681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:42.923683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:42.923697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:42.923715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:42.923739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:42.924171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:42.924182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:42.924197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:42.924280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2992 partition: 0 MaxSeqNo: 42 sessionId: src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0
2025-09-30T14:58:42.924701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a19d4c36-94fdb1fc-42005cdd-64c37ce6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:42.927631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0] Write session: try to update token
2025-09-30T14:58:42.927651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:42.945153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:42.945174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:42.945176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:42.945179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:42.945188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896830591290814:6888]
2025-09-30T14:58:42.945194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896830591290814:6888]
2025-09-30T14:58:42.945199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896830591290814:6888]
2025-09-30T14:58:42.945238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:42.945245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:42.945253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:42.945406Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:42.945733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:42.945742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:42.945746Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:42.953586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2992 sessionId: src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:42.956386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:42.995330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896830681091762:7727]
2025-09-30T14:58:42.995774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 2991, pipe: [1:7555896830681091762:7727]
2025-09-30T14:58:43.077816Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:43.078454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.078476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.078516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896830681091762:7727], now have 1 active actors on pipe
2025-09-30T14:58:43.078737Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:43.079022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896830681091762:7727]
2025-09-30T14:58:43.079059Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:43.079062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:43.079139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2992 reason: status is not ok: tablet will be restarted right now sessionId: src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0
2025-09-30T14:58:43.079514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:43.079527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0] Write session will restart in 0.007912s
2025-09-30T14:58:43.079553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0] Write session: Do CDS request
2025-09-30T14:58:43.079559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:43.079333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2992 sessionId: src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0 is DEAD
2025-09-30T14:58:43.088943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:43.089104Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:43.089124Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2993
2025-09-30T14:58:43.089281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2993 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:43.089313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2993 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:43.089324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2993 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:43.089328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:43.089965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2993 sessionId:  describe result for acl check
2025-09-30T14:58:43.090006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:43.090014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:43.090016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:43.090022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896834976059076:9745] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:43.090610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896834976059076:9745] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:43.093665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896834976059076:9745] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:43.094654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:43.096151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:43.096607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896834976059076:9745] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:43.096633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896834976059076:9745] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:43.096637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896834976059076:9745] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:43.096646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2993 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:43.096371Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:43.096382Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:43.096393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:43.096449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:43.096496Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896834886258201:6871]
2025-09-30T14:58:43.097179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:43.097528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:43.097574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:43.097935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:43.098002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.098012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.098013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.098014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.098016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.098017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.098018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.098020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.098021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.098022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.098023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.098024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.098025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.098026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.098027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.098033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.098044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.098048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.098053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.098056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.098061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.098065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.098069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.098073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.098078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.098083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.098087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.098091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.098095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.098099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.098106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.098114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.098121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.098127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.098132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.098138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.098144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.098150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.098155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.098160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.098166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.098172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.098176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.098181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.098186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.098197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.098202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.098207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.098212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.098222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.098227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.098232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.098240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.098244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.098248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.098253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.098258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.098262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.098266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.098271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.098310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:43.104295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:43.105211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:43.105228Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:43.105232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:43.105242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:43.105249Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2992 [2:7555896834886258201:6871]
2025-09-30T14:58:43.105268Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:43.105285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:43.105288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:43.105292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:43.105295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:43.105311Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:43.105320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:43.105334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:43.105407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.105415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.105417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.105420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:43.105422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:43.105493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:43.105501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.105516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.105527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.105543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:43.105564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896834886258196:6871]
2025-09-30T14:58:43.105567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896834886258196:6871]
2025-09-30T14:58:43.105570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896834886258196:6871]
2025-09-30T14:58:43.105580Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:43.105593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:43.105610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:43.105614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:43.105617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:43.105618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:43.105621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:43.105627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059141:9745], now have 1 active actors on pipe
2025-09-30T14:58:43.105662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059061:2454], now have 1 active actors on pipe
2025-09-30T14:58:43.105672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896834886258196:6871]
2025-09-30T14:58:43.105680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:43.105770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2992
2025-09-30T14:58:43.105815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2992
2025-09-30T14:58:43.105734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:43.105960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.105978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.106006Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:43.106018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:43.106022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:43.106024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:43.106036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:43.106055Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:43.106080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:43.106260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.106268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.106282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:43.106600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2993 partition: 0 MaxSeqNo: 42 sessionId: src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0
2025-09-30T14:58:43.111485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19b5cbb6-6396ce37-e7e9459a-787737c2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:43.114379Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0] Write session: try to update token
2025-09-30T14:58:43.114403Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:43.125150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:43.125169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:43.125172Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:43.125174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:43.125184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896834886258196:6871]
2025-09-30T14:58:43.125188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896834886258196:6871]
2025-09-30T14:58:43.125192Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896834886258196:6871]
2025-09-30T14:58:43.125235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:43.125245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.125251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:43.125260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:43.125266Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:43.125271Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:43.125447Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:43.138868Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2993 sessionId: src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:43.141997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:43.179414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896834976059156:7727]
2025-09-30T14:58:43.179781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 2992, pipe: [1:7555896834976059156:7727]
2025-09-30T14:58:43.244791Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:43.245270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.245282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.245305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059156:7727], now have 1 active actors on pipe
2025-09-30T14:58:43.245600Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:43.246499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:43.246606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2993 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0
2025-09-30T14:58:43.246778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2993 sessionId: src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0 is DEAD
2025-09-30T14:58:43.246924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:43.246968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896834976059156:7727]
2025-09-30T14:58:43.247339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:43.247352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0] Write session will restart in 0.009818s
2025-09-30T14:58:43.247377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0] Write session: Do CDS request
2025-09-30T14:58:43.247383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:43.258868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:43.259407Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:43.259428Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2994
2025-09-30T14:58:43.259585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2994 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:43.259619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2994 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:43.259624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2994 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:43.259629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:43.260176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2994 sessionId:  describe result for acl check
2025-09-30T14:58:43.260213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:43.260215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:43.260221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:43.260227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896834976059177:9738] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:43.260810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896834976059177:9738] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:43.265084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896834976059177:9738] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:43.266148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:43.267933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:43.268189Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:43.268201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:43.268213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:43.268274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:43.268303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896834976059177:9738] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:43.268326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896834976059177:9738] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:43.268329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896834976059177:9738] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:43.268342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2994 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:43.268316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896834886258289:6884]
2025-09-30T14:58:43.268987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:43.269456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:43.269525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:43.269867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:43.269939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.269946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.269947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.269949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.269950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.269951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.269952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.269954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.269955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.269956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.269957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.269958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.269959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.269961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.269962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.269969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.269977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.269981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.269984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.269988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.269992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.269995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.269999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.270002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.270006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.270010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.270014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.270018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.270022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.270025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.270034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.270041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.270049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.270055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.270061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.270066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.270070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.270075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.270085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.270090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.270094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.270100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.270103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.270108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.270112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.270117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.270122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.270127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.270137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.270142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.270146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.270151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.270159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.270167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.270172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.270183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.270188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.270197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.270201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.270206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.270248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:43.281171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2993
2025-09-30T14:58:43.281212Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2993
2025-09-30T14:58:43.282453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2994 partition: 0 MaxSeqNo: 42 sessionId: src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0
2025-09-30T14:58:43.279646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:43.280632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:43.280640Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:43.280643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:43.280647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:43.280655Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2993 [2:7555896834886258289:6884]
2025-09-30T14:58:43.280674Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:43.280690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:43.280694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:43.280697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:43.280700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:43.280718Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:43.280745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:43.280751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:43.280825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.280828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.280831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.280835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:43.280838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:43.280914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:43.280919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.280937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.280948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.280964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:43.280985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896834886258279:6884]
2025-09-30T14:58:43.280988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896834886258279:6884]
2025-09-30T14:58:43.280990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896834886258279:6884]
2025-09-30T14:58:43.280999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:43.281017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:43.281030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:43.281032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:43.281034Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:43.281035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:43.281036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:43.281080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896834886258279:6884]
2025-09-30T14:58:43.281093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:43.281093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:43.281102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059244:9738], now have 1 active actors on pipe
2025-09-30T14:58:43.281106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059158:2454], now have 1 active actors on pipe
2025-09-30T14:58:43.281800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.281812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.281844Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:43.281853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:43.281857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:43.281860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:43.281870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:43.281885Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:43.281902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:43.282201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.282208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.282245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:43.283610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6290152d-e0ecd3cd-f5ec916f-fbb6e7d3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:43.286368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0] Write session: try to update token
2025-09-30T14:58:43.286391Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:43.307230Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:43.307269Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:43.307272Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:43.307274Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:43.307283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896834886258279:6884]
2025-09-30T14:58:43.307291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896834886258279:6884]
2025-09-30T14:58:43.307295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896834886258279:6884]
2025-09-30T14:58:43.307348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:43.307355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.307357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:43.307362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:43.307370Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:43.307377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:43.307682Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:43.308735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2994 sessionId: src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:43.311668Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:43.346635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896834976059281:7727]
2025-09-30T14:58:43.348603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 2993, pipe: [1:7555896834976059281:7727]
2025-09-30T14:58:43.423067Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:43.423510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.423531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.423574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059281:7727], now have 1 active actors on pipe
2025-09-30T14:58:43.427580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896834976059281:7727]
2025-09-30T14:58:43.427585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:43.427590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:43.427628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:43.427660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2994 reason: error at write: Disconnected sessionId: src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0
2025-09-30T14:58:43.428021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:43.428034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0] Write session will restart in 0.007247s
2025-09-30T14:58:43.427677Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:43.428059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0] Write session: Do CDS request
2025-09-30T14:58:43.428065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:43.427848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2994 sessionId: src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0 is DEAD
2025-09-30T14:58:43.436796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:43.436874Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:43.436894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2995
2025-09-30T14:58:43.437052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2995 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:43.437083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2995 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:43.437089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2995 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:43.437093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:43.437532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2995 sessionId:  describe result for acl check
2025-09-30T14:58:43.437579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:43.437584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:43.437586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:43.437593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896834976059334:9716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:43.438113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896834976059334:9716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:43.437440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:43.438926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:43.439129Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:43.439133Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:43.439143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:43.439192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:43.439516Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896834886258419:6854]
2025-09-30T14:58:43.440101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:43.440448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896834976059334:9716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:43.440469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:43.440593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:43.441066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:43.441193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.441201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.441202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.441203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.441205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.441206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.441207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.441209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.441210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.441211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.441212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.441214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.441215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.441216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.441217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.441224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.441234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.441238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.441242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.441245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.441249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.441254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.441258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.441262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.441267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.441271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.441274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.441278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.441282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.441286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.441295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.441303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.441311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.441316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.441322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.441329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.441334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.441341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.441346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.441353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.441359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.441365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.441372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.441378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.441384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.441390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.441395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.441401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.441405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.441411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.441416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.441422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.441427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.441433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.441439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.441444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.441449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.441467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.441473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.441489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.441534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:43.447161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896834976059334:9716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:43.447186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896834976059334:9716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:43.447194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896834976059334:9716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:43.447204Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2995 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:43.447483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:43.448458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:43.448464Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:43.448467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:43.448917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2994
2025-09-30T14:58:43.448472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:43.448480Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2994 [2:7555896834886258419:6854]
2025-09-30T14:58:43.448953Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2994
2025-09-30T14:58:43.448499Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:43.448515Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:43.448518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:43.448521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:43.448524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:43.448539Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:43.448546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:43.448553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:43.448619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.448622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.448624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.448627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:43.448630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:43.448715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:43.448719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.448746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.448759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.448778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:43.448799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059286:2454], now have 1 active actors on pipe
2025-09-30T14:58:43.448803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059373:9716], now have 1 active actors on pipe
2025-09-30T14:58:43.448811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896834886258414:6854]
2025-09-30T14:58:43.448813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896834886258414:6854]
2025-09-30T14:58:43.448815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896834886258414:6854]
2025-09-30T14:58:43.448825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:43.448840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:43.448851Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:43.448855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:43.448855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:43.448858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:43.448859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:43.448893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896834886258414:6854]
2025-09-30T14:58:43.448902Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:43.448921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:43.449081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.449088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.449115Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:43.449122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:43.449137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:43.449145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:43.449156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:43.449171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:43.449189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:43.449574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.449581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.449594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:43.449682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2995 partition: 0 MaxSeqNo: 42 sessionId: src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0
2025-09-30T14:58:43.450056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aabbd3f-7201bbb9-716dd159-ea2dcc34_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:43.453074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0] Write session: try to update token
2025-09-30T14:58:43.453095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:43.469625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:43.469649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:43.469659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896834886258414:6854]
2025-09-30T14:58:43.469708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:43.469964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:43.470113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:43.470258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:43.470409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:43.470608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:43.470653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:43.470738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:43.474967Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2995 sessionId: src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:43.476588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:43.476613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:43.476616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:43.476618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:43.476632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896834886258414:6854]
2025-09-30T14:58:43.476636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896834886258414:6854]
2025-09-30T14:58:43.476640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896834886258414:6854]
2025-09-30T14:58:43.476681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:43.476697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.476700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:43.476849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:43.476864Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:43.476869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:43.476881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:43.477676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:43.528069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896834976059382:7727]
2025-09-30T14:58:43.530790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 2994, pipe: [1:7555896834976059382:7727]
2025-09-30T14:58:43.599025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896834976059382:7727]
2025-09-30T14:58:43.599062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:43.599091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:43.599158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2995 reason: status is not ok: tablet will be restarted right now sessionId: src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0
2025-09-30T14:58:43.597383Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:43.597927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.597938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.597959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059382:7727], now have 1 active actors on pipe
2025-09-30T14:58:43.598180Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:43.599373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2995 sessionId: src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0 is DEAD
2025-09-30T14:58:43.599576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:43.599589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0] Write session will restart in 0.006506s
2025-09-30T14:58:43.599613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0] Write session: Do CDS request
2025-09-30T14:58:43.599619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:43.607843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:43.608248Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:43.608268Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2996
2025-09-30T14:58:43.608439Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2996 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:43.608474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2996 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:43.608479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2996 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:43.608484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:43.608934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2996 sessionId:  describe result for acl check
2025-09-30T14:58:43.608975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:43.608979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:43.608981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:43.608987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896834976059408:9715] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:43.609540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896834976059408:9715] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:43.611936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896834976059408:9715] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:43.614888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:43.616807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896834976059408:9715] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:43.616828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896834976059408:9715] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:43.616832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896834976059408:9715] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:43.616841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2996 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:43.616315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:43.616522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:43.616526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:43.616537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:43.616591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:43.616627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896834886258509:6851]
2025-09-30T14:58:43.617324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:43.617652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:43.617710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:43.618063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:43.618136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.618137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.618139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.618140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.618142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.618143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.618144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.618146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.618147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.618148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.618150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.618151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.618152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.618153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.618156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.618163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.618175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.618180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.618183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.618187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.618191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.618196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.618200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.618204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.618209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.618212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.618216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.618220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.618224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.618228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.618236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.618246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.618251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.618256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.618262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.618266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.618271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.618277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.618282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.618287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.618293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.618298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.618303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.618308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.618314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.618321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.618326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.618330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.618335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.618341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.618345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.618351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.618356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.618362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.618367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.618373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.618380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.618385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.618391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.618397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.618447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:43.625947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:43.627140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:43.627161Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:43.627164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:43.627169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:43.627177Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2995 [2:7555896834886258509:6851]
2025-09-30T14:58:43.627194Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:43.627214Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:43.627218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:43.627221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:43.627223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:43.627664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2995
2025-09-30T14:58:43.627691Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2995
2025-09-30T14:58:43.627265Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:43.627278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:43.627286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:43.627364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.627366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.627368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.627372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:43.627377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:43.627458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:43.627461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.627475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.627486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.627503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:43.627520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896834886258504:6851]
2025-09-30T14:58:43.627521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896834886258504:6851]
2025-09-30T14:58:43.627523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896834886258504:6851]
2025-09-30T14:58:43.627532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:43.627544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:43.627547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:43.627547Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:43.627549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:43.627562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:43.627564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:43.627573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059383:2454], now have 1 active actors on pipe
2025-09-30T14:58:43.627577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059479:9715], now have 1 active actors on pipe
2025-09-30T14:58:43.627613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896834886258504:6851]
2025-09-30T14:58:43.627620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:43.627633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:43.627778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.627785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.627812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:43.627820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:43.627824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:43.627830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:43.627842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:43.627854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:43.627875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:43.628181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.628194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.628217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:43.628367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2996 partition: 0 MaxSeqNo: 42 sessionId: src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0
2025-09-30T14:58:43.628745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|55c055da-4b446aad-406ea9e9-ecd58dc0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:43.631564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0] Write session: try to update token
2025-09-30T14:58:43.631582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:43.640649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:43.640670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:43.640680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896834886258504:6851]
2025-09-30T14:58:43.640739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:43.640738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:43.640930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:43.641088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:43.641252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:43.641400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:43.641602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:43.641645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:43.649662Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2996 sessionId: src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:43.652601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:43.652852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.652882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.652919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:43.653000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:43.654490Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:43.654510Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:43.654513Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:43.654515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:43.654544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896834886258504:6851]
2025-09-30T14:58:43.654548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896834886258504:6851]
2025-09-30T14:58:43.654551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896834886258504:6851]
2025-09-30T14:58:43.654588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:43.654602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.654604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:43.654610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:43.654616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:43.654620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:43.654759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:43.700907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896834976059492:7727]
2025-09-30T14:58:43.701298Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 2995, pipe: [1:7555896834976059492:7727]
2025-09-30T14:58:43.772847Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:43.782341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.782392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.782729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:43.782978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:43.783055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:43.783124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:43.783857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:43.783870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:43.783958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:43.784022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:43.784092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:43.784358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:43.784411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:43.784416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:43.784489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:43.784557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:43.784626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:43.784891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:43.784931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:43.784933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:43.785191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:43.785251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:43.785309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:43.785373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:43.785435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:43.785438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:43.785529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:43.785628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:43.785726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:43.785800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:43.785861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:43.785864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:43.785941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:43.786208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:43.786462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:43.786718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:43.786761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:43.786764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:43.786831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:43.786895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:43.786972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:43.787034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:43.787074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:43.787077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:43.787154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:43.787219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:43.787309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:43.787385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:43.787429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:43.787432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:43.789242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896834976059492:7727]
2025-09-30T14:58:43.789260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:43.789289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:43.789297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:43.789327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2996 reason: error at write: Disconnected sessionId: src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0
2025-09-30T14:58:43.789535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2996 sessionId: src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0 is DEAD
2025-09-30T14:58:43.789683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:43.789696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0] Write session will restart in 0.008707s
2025-09-30T14:58:43.789722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0] Write session: Do CDS request
2025-09-30T14:58:43.789728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:43.787506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:43.787579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:43.787643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:43.787911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:43.787955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:43.787958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:43.788225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:43.788483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:43.788773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:43.788837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:43.788891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:43.788895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:43.788987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059492:7727], now have 1 active actors on pipe
2025-09-30T14:58:43.789649Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:43.799873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:43.800453Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:43.800473Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2997
2025-09-30T14:58:43.800631Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2997 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:43.800670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2997 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:43.800676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2997 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:43.800681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:43.801239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2997 sessionId:  describe result for acl check
2025-09-30T14:58:43.801276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:43.801283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:43.801284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:43.801290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896834976059543:9709] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:43.801911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896834976059543:9709] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:43.804031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:43.805314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896834976059543:9709] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:43.806312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:43.806560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:43.806570Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:43.806582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:43.806642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:43.806687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896834886258597:6845]
2025-09-30T14:58:43.807425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:43.807817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:43.807896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:43.808312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:43.808415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.808422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.808423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.808424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.808426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.808427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.808428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.808432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.808443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.808444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.808445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.808446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.808447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.808448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.808450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.808457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.808468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.808472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.808476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.808479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.808484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.808488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.808492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.808496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.808500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.808505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.808509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.808513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.808517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.808521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.808528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.808537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.808543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.808549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.808554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.808343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896834976059543:9709] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:43.808367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896834976059543:9709] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:43.808560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.808564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.808570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.808371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896834976059543:9709] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:43.808380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2997 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:43.808578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.808582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.808587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.808592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.808597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.808601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.808606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.808611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.808616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.808621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.808626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.808631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.808636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.808641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.808646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.808652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.808657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.808663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.808667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.808671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.808676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.808682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.808747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:43.814508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:43.815778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:43.815798Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:43.815802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:43.815806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:43.815813Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2996 [2:7555896834886258597:6845]
2025-09-30T14:58:43.815833Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:43.815850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:43.815853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:43.815857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:43.815859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:43.815880Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:43.815888Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:43.815894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:43.815962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.815972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.815975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.815978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:43.815981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:43.816048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:43.816060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.816076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.816089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.816257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2996
2025-09-30T14:58:43.816109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:43.816276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2996
2025-09-30T14:58:43.816127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896834886258592:6845]
2025-09-30T14:58:43.816129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896834886258592:6845]
2025-09-30T14:58:43.816131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896834886258592:6845]
2025-09-30T14:58:43.816139Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:43.816156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:43.816152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:43.816166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:43.816168Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:43.816169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:43.816171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:43.816181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059496:2454], now have 1 active actors on pipe
2025-09-30T14:58:43.816185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059583:9709], now have 1 active actors on pipe
2025-09-30T14:58:43.816228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896834886258592:6845]
2025-09-30T14:58:43.816236Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:43.816273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:43.816487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.816503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.816533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:43.816543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:43.816550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:43.816552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:43.816563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:43.816573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:43.816591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:43.816782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.816789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.816803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:43.816924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2997 partition: 0 MaxSeqNo: 42 sessionId: src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0
2025-09-30T14:58:43.817322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d68bd01b-9619a0e7-84f21c78-62dd394d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:43.820386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0] Write session: try to update token
2025-09-30T14:58:43.820411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:43.832064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:43.832087Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:43.832097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896834886258592:6845]
2025-09-30T14:58:43.832154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:43.832157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:43.832374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:43.832541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:43.832700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:43.832869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:43.833092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:43.833133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:43.839304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2997 sessionId: src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:43.840934Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:43.840959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:43.840961Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:43.840968Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:43.840978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896834886258592:6845]
2025-09-30T14:58:43.840983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896834886258592:6845]
2025-09-30T14:58:43.840989Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896834886258592:6845]
2025-09-30T14:58:43.841030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:43.841037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.841040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:43.841039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:43.841051Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:43.841055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:43.841197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:43.842180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:43.889819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896834976059593:7727]
2025-09-30T14:58:43.890233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 2996, pipe: [1:7555896834976059593:7727]
2025-09-30T14:58:43.961289Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:43.961611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.961626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.961649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059593:7727], now have 1 active actors on pipe
2025-09-30T14:58:43.961890Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:43.961922Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:43.961961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:43.961966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:43.961995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896834976059593:7727]
2025-09-30T14:58:43.962054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2997 reason: error at write: Disconnected sessionId: src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0
2025-09-30T14:58:43.962233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2997 sessionId: src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0 is DEAD
2025-09-30T14:58:43.962413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:43.962425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0] Write session will restart in 0.005888s
2025-09-30T14:58:43.962449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0] Write session: Do CDS request
2025-09-30T14:58:43.962469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:43.969761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:43.969872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:43.969892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2998
2025-09-30T14:58:43.970040Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2998 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:43.970086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2998 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:43.970097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2998 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:43.970102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:43.970657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2998 sessionId:  describe result for acl check
2025-09-30T14:58:43.971372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:43.970698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:43.970705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:43.970707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:43.970713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896834976059646:9705] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:43.971392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896834976059646:9705] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:43.973000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:43.973182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:43.973193Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:43.973204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:43.973256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:43.973309Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896834886258685:6846]
2025-09-30T14:58:43.973558Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896834976059646:9705] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:43.973919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:43.974222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:43.974289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:43.974637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:43.974694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.974703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.974704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.974705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.974706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.974707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.974708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.974709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.974713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.974714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.974715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.974716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.974717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.974719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.974720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.974725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.974735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.974739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.974743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.974745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.974748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.974750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.974753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.974755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.974758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.974760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.974762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.974765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.974767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.974769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.974776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.974780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:43.974784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.974788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:43.974791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.974794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:43.974796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.974799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:43.974802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.974807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:43.974809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.974812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:43.974815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.974818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:43.974820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.974825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:43.974828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.974831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:43.974833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.974836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:43.974838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.974841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.974844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.974846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.974849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.974852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.974854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.974857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:43.974860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.974862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:43.974889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:43.979745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896834976059646:9705] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:43.979763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896834976059646:9705] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:43.979766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896834976059646:9705] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:43.979787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2998 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:43.980434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:43.981410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:43.981434Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:43.981437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:43.981442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:43.981449Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2997 [2:7555896834886258685:6846]
2025-09-30T14:58:43.981466Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:43.981489Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:43.981493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:43.981496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:43.981502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:43.981519Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:43.981526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:43.981539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:43.981616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.981624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.981626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.981630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:43.981632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:43.981705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:43.981713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.981727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:43.981746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:43.981768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:43.981791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896834886258680:6846]
2025-09-30T14:58:43.981799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896834886258680:6846]
2025-09-30T14:58:43.981801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896834886258680:6846]
2025-09-30T14:58:43.981815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:43.981833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:43.981855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:43.981865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:43.981867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:43.981869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:43.981872Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:43.981902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896834886258680:6846]
2025-09-30T14:58:43.981905Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:43.981948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:43.982361Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2997
2025-09-30T14:58:43.982407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2997
2025-09-30T14:58:43.982670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059684:9705], now have 1 active actors on pipe
2025-09-30T14:58:43.982681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896834976059597:2454], now have 1 active actors on pipe
2025-09-30T14:58:43.982823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.982833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.982860Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5aed46e2-82f7b40a-58962b85-3a454014_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:43.982873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:43.982876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:43.982879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:43.982889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:43.982905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:43.982925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:43.983123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:43.983132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:43.983146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:43.983294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2998 partition: 0 MaxSeqNo: 42 sessionId: src_id|5aed46e2-82f7b40a-58962b85-3a454014_0
2025-09-30T14:58:43.983762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c86b007-9e87481e-fc8b0580-8f6e1bed_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5aed46e2-82f7b40a-58962b85-3a454014_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:43.986519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aed46e2-82f7b40a-58962b85-3a454014_0] Write session: try to update token
2025-09-30T14:58:43.986537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aed46e2-82f7b40a-58962b85-3a454014_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:43.994799Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:43.994822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:43.994825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:43.994827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:43.994837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896834886258680:6846]
2025-09-30T14:58:43.994841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896834886258680:6846]
2025-09-30T14:58:43.994849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896834886258680:6846]
2025-09-30T14:58:43.994891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:43.994898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:43.994900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:43.994913Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:43.994919Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:43.994924Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:43.995096Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:44.004651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2998 sessionId: src_id|5aed46e2-82f7b40a-58962b85-3a454014_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:44.007604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:44.062404Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896839271026988:7727]
2025-09-30T14:58:44.062862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 2997, pipe: [1:7555896839271026988:7727]
2025-09-30T14:58:44.124654Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:44.125101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.125118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.125138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271026988:7727], now have 1 active actors on pipe
2025-09-30T14:58:44.125382Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:44.125469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:44.125592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2998 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5aed46e2-82f7b40a-58962b85-3a454014_0
2025-09-30T14:58:44.125750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:44.125791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2998 sessionId: src_id|5aed46e2-82f7b40a-58962b85-3a454014_0 is DEAD
2025-09-30T14:58:44.125812Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896839271026988:7727]
2025-09-30T14:58:44.125959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aed46e2-82f7b40a-58962b85-3a454014_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:44.125969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aed46e2-82f7b40a-58962b85-3a454014_0] Write session will restart in 0.008477s
2025-09-30T14:58:44.125993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aed46e2-82f7b40a-58962b85-3a454014_0] Write session: Do CDS request
2025-09-30T14:58:44.126000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aed46e2-82f7b40a-58962b85-3a454014_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:44.134727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:44.135810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5aed46e2-82f7b40a-58962b85-3a454014_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:44.135914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:44.135933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2999
2025-09-30T14:58:44.136156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2999 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:44.136202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2999 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:44.136220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2999 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:44.136232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:44.136581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:44.136739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2999 sessionId:  describe result for acl check
2025-09-30T14:58:44.136783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:44.136785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:44.136787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:44.136793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896839271027042:9702] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:44.136845Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:44.136855Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:44.136867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:44.136924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:44.136963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896839181226073:6837]
2025-09-30T14:58:44.137405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896839271027042:9702] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:44.137635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:44.137998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:44.138043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:44.138396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:44.138464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.138473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.138474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.138476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.138477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.138479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.138480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.138481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.138483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.138484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.138485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.138486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.138487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.138488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.138489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.138495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.138506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.138511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.138515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.138520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.138525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.138529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.138534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.138539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.138543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.138548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.138552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.138556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.138561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.138565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.138572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.138586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.138599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.138610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.138616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.138627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.138632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.138642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.138647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.138653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.138659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.138665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.138670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.138675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.138681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.138692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.138697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.138708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.138713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.138725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.138734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.138740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.138749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.138754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.138763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.138769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.138777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.138783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.138790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.138795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.138851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:44.140214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896839271027042:9702] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:44.144071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896839271027042:9702] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:44.144090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896839271027042:9702] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:44.144097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896839271027042:9702] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:44.144106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2999 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:44.144573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:44.145473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:44.145492Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:44.145495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:44.145502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:44.145510Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2998 [2:7555896839181226073:6837]
2025-09-30T14:58:44.145527Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:44.145543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:44.145546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:44.145550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:44.145554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:44.145571Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:44.145584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:44.145592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:44.145652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.145661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.145663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.145666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:44.145669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:44.145739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:44.145747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.145760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.145773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.145792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:44.145815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271026990:2454], now have 1 active actors on pipe
2025-09-30T14:58:44.145826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027080:9702], now have 1 active actors on pipe
2025-09-30T14:58:44.145832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896839181226068:6837]
2025-09-30T14:58:44.145835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896839181226068:6837]
2025-09-30T14:58:44.145837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896839181226068:6837]
2025-09-30T14:58:44.145855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:44.145871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:44.145874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:44.145881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:44.145884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:44.145887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:44.145863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2998
2025-09-30T14:58:44.145874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2998
2025-09-30T14:58:44.145890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:44.145943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.145953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.145967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896839181226068:6837]
2025-09-30T14:58:44.145980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:44.146008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:44.146015Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|366e1b7-6f7a7305-6974d714-526a4699_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:44.146022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:44.146026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:44.146031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:44.146040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:44.146049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:44.146078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:44.146351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.146366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.146392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:44.146507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2999 partition: 0 MaxSeqNo: 42 sessionId: src_id|366e1b7-6f7a7305-6974d714-526a4699_0
2025-09-30T14:58:44.146833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5aed46e2-82f7b40a-58962b85-3a454014_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|366e1b7-6f7a7305-6974d714-526a4699_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:44.149814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|366e1b7-6f7a7305-6974d714-526a4699_0] Write session: try to update token
2025-09-30T14:58:44.149837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|366e1b7-6f7a7305-6974d714-526a4699_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:44.159051Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:44.159072Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:44.159075Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:44.159077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:44.159088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896839181226068:6837]
2025-09-30T14:58:44.159092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896839181226068:6837]
2025-09-30T14:58:44.159098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896839181226068:6837]
2025-09-30T14:58:44.159137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:44.159141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:44.159149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:44.159153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.159154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:44.159156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:44.159379Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:44.166910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2999 sessionId: src_id|366e1b7-6f7a7305-6974d714-526a4699_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:44.169776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:44.225739Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896839271027089:7727]
2025-09-30T14:58:44.226046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 2998, pipe: [1:7555896839271027089:7727]
2025-09-30T14:58:44.272262Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:44.272585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.272608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.272670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027089:7727], now have 1 active actors on pipe
2025-09-30T14:58:44.272903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:44.272984Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:44.273000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896839271027089:7727]
2025-09-30T14:58:44.273027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:44.273098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 2999 reason: status is not ok: tablet will be restarted right now sessionId: src_id|366e1b7-6f7a7305-6974d714-526a4699_0
2025-09-30T14:58:44.273285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2999 sessionId: src_id|366e1b7-6f7a7305-6974d714-526a4699_0 is DEAD
2025-09-30T14:58:44.273485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366e1b7-6f7a7305-6974d714-526a4699_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:44.273498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366e1b7-6f7a7305-6974d714-526a4699_0] Write session will restart in 0.008335s
2025-09-30T14:58:44.273524Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366e1b7-6f7a7305-6974d714-526a4699_0] Write session: Do CDS request
2025-09-30T14:58:44.273530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366e1b7-6f7a7305-6974d714-526a4699_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:44.282108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:44.282839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|366e1b7-6f7a7305-6974d714-526a4699_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:44.282922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:44.282945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3000
2025-09-30T14:58:44.283061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3000 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:44.283094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3000 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:44.283104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3000 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:44.283108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:44.283580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3000 sessionId:  describe result for acl check
2025-09-30T14:58:44.283574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:44.283620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:44.283630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:44.283632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:44.283639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896839271027145:9688] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:44.283803Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:44.283815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:44.283827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:44.283901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:44.283949Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896839181226164:6830]
2025-09-30T14:58:44.284261Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896839271027145:9688] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:44.284649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:44.285099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:44.285180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:44.285570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:44.285674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.285684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.285685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.285687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.285688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.285689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.285690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.285692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.285694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.285695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.285696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.285697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.285698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.285699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.285700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.285707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.285716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.285720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.285723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.285727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.285732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.285736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.285739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.285743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.285747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.285750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.285753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.285757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.285760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.285764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.285772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.285780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.285787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.285792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.285797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.285803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.285807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.285812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.285817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.285822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.285826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.285831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.285837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.285842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.285846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.285852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.285856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.285860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.285865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.285871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.285877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.285882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.285886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.285891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.285899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.285904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.285908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.285913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.285917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.285922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.285965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:44.286688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896839271027145:9688] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:44.291431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896839271027145:9688] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:44.291455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896839271027145:9688] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:44.291459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896839271027145:9688] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:44.291469Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3000 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:44.291969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:44.292920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:44.292943Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:44.292945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:44.292954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:44.292961Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 2999 [2:7555896839181226164:6830]
2025-09-30T14:58:44.292977Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:44.292992Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:44.292996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:44.292999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:44.293001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:44.293017Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:44.293023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:44.293031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:44.293098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.293106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.293108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.293111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:44.293114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:44.293183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:44.293194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.293207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.293225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.293249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:44.293275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027184:9688], now have 1 active actors on pipe
2025-09-30T14:58:44.293283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027090:2454], now have 1 active actors on pipe
2025-09-30T14:58:44.293290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896839181226159:6830]
2025-09-30T14:58:44.293292Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896839181226159:6830]
2025-09-30T14:58:44.293295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896839181226159:6830]
2025-09-30T14:58:44.293311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:44.293329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:44.293332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:44.293336Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:44.293339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:44.293348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:44.293352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:44.293392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896839181226159:6830]
2025-09-30T14:58:44.293406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:44.293454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:44.293415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 2999
2025-09-30T14:58:44.293462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 2999
2025-09-30T14:58:44.293596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.293609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.293639Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:44.293653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:44.293659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:44.293666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:44.293676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:44.293692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:44.293710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:44.293905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.293915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.293929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:44.294038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3000 partition: 0 MaxSeqNo: 42 sessionId: src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0
2025-09-30T14:58:44.294485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|366e1b7-6f7a7305-6974d714-526a4699_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:44.297593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0] Write session: try to update token
2025-09-30T14:58:44.297615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:44.313261Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:44.313286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:44.313297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896839181226159:6830]
2025-09-30T14:58:44.313353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:44.313356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:44.313562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:44.313729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:44.313890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:44.314052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:44.314281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:44.314320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:44.319220Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:44.319240Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:44.319266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:44.319268Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:44.319278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896839181226159:6830]
2025-09-30T14:58:44.319281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896839181226159:6830]
2025-09-30T14:58:44.319289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896839181226159:6830]
2025-09-30T14:58:44.319331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:44.319345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.319347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:44.319348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:44.319356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:44.319371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:44.319489Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:44.324789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3000 sessionId: src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:44.331516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:44.373147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896839271027211:7727]
2025-09-30T14:58:44.373434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 2999, pipe: [1:7555896839271027211:7727]
2025-09-30T14:58:44.435116Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:44.435758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.435779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.435803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027211:7727], now have 1 active actors on pipe
2025-09-30T14:58:44.436552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:44.436563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0] Write session will restart in 0.008784s
2025-09-30T14:58:44.436588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0] Write session: Do CDS request
2025-09-30T14:58:44.436594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:44.436065Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:44.436077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:44.436082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896839271027211:7727]
2025-09-30T14:58:44.436112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:44.436115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:44.436191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3000 reason: error at write: Disconnected sessionId: src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0
2025-09-30T14:58:44.436389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3000 sessionId: src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0 is DEAD
2025-09-30T14:58:44.446912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:44.447563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:44.447580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3001
2025-09-30T14:58:44.447721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3001 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:44.447788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3001 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:44.447799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3001 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:44.447804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:44.448748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3001 sessionId:  describe result for acl check
2025-09-30T14:58:44.448783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:44.448785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:44.448787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:44.448793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896839271027272:9676] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:44.449344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896839271027272:9676] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:44.450119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:44.451913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896839271027272:9676] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:44.452081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:44.455361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896839271027272:9676] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:44.452324Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:44.452329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:44.452354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:44.452424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:44.452467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896839181226305:6812]
2025-09-30T14:58:44.453139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:44.453683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:44.453747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:44.454105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:44.455379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896839271027272:9676] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:44.454169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.455383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896839271027272:9676] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:44.454170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.455392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3001 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:44.454171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.454173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.454174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.454178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.454179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.454180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.454182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.454183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.454184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.454186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.454187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.454189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.454189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.454196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.454207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.454211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.454216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.454220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.454224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.454228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.454233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.454237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.454241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.454245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.454249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.454253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.454259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.454264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.454271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.454279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.454285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.454290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.454296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.454302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.454310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.454315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.454321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.454326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.454331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.454336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.454340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.454346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.454352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.454357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.454362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.454368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.454374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.454380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.454385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.454391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.454395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.454400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.454405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.454410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.454414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.454420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.454424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.454430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.454476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:44.460070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:44.461066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:44.461090Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:44.461092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:44.461096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:44.461104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3000 [2:7555896839181226305:6812]
2025-09-30T14:58:44.461123Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:44.461140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:44.461147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:44.461150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:44.461152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:44.461171Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:44.461185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:44.461193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:44.461263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.461270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.461273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.461276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:44.461279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:44.461348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:44.461361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.461374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.461384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.461400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:44.461421Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896839181226300:6812]
2025-09-30T14:58:44.461428Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896839181226300:6812]
2025-09-30T14:58:44.461430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896839181226300:6812]
2025-09-30T14:58:44.461439Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:44.461454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:44.461458Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:44.461462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:44.461464Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:44.461468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:44.461471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:44.461482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027221:2454], now have 1 active actors on pipe
2025-09-30T14:58:44.461492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027314:9676], now have 1 active actors on pipe
2025-09-30T14:58:44.461526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896839181226300:6812]
2025-09-30T14:58:44.461539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:44.461650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3000
2025-09-30T14:58:44.461704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3000
2025-09-30T14:58:44.461839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:44.462095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.462108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.462152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:44.462166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:44.462176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:44.462179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:44.462190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:44.462206Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:44.462232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:44.462396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.462407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.462420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:44.462504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3001 partition: 0 MaxSeqNo: 42 sessionId: src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0
2025-09-30T14:58:44.462883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d1dbcc9b-1019927b-efe4bc6d-a9254833_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:44.465872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0] Write session: try to update token
2025-09-30T14:58:44.465894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:44.485181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3001 sessionId: src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:44.486312Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:44.486332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:44.486334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:44.486337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:44.486346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896839181226300:6812]
2025-09-30T14:58:44.486351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896839181226300:6812]
2025-09-30T14:58:44.486355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896839181226300:6812]
2025-09-30T14:58:44.486400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:44.486408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.486411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:44.486560Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:44.489060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:44.489235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:44.489255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:44.489260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:44.536007Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896839271027322:7727]
2025-09-30T14:58:44.536365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3000, pipe: [1:7555896839271027322:7727]
2025-09-30T14:58:44.598724Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:44.599137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.599146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.599184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027322:7727], now have 1 active actors on pipe
2025-09-30T14:58:44.599897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896839271027322:7727]
2025-09-30T14:58:44.599945Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:44.599981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:44.600067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3001 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0
2025-09-30T14:58:44.600278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3001 sessionId: src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0 is DEAD
2025-09-30T14:58:44.600439Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:58:44.600495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:44.600513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0] Write session will restart in 0.008059s
2025-09-30T14:58:44.600545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0] Write session: Do CDS request
2025-09-30T14:58:44.600553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:44.600557Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 30 consumer shared/user session shared/user_1_30_8794492065082298093_v1 is DEAD
2025-09-30T14:58:44.600712Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:58:44.600707Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896761961588879:7700] disconnected; active server actors: 1
2025-09-30T14:58:44.600732Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896761961588879:7700] client user disconnected session shared/user_1_30_8794492065082298093_v1
2025-09-30T14:58:44.600783Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:58:44.600788Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:58:44.600811Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.009935s
2025-09-30T14:58:44.599476Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:44.609832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:44.610667Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:44.610684Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3002
2025-09-30T14:58:44.611529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3002 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:44.611544Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:58:44.611566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3002 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:44.611573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3002 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:44.611577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:44.611995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3002 sessionId:  describe result for acl check
2025-09-30T14:58:44.612030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:44.612032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:44.612033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:44.612037Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896839271027387:9670] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:44.612463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896839271027387:9670] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:44.615741Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:58:44.615749Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 31
2025-09-30T14:58:44.616384Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 31 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:58:44.616438Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:58:44.616528Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 auth for : user
2025-09-30T14:58:44.616489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:44.616890Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 Handle describe topics response
2025-09-30T14:58:44.616909Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 auth is DEAD
2025-09-30T14:58:44.616923Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:58:44.617179Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:58:44.617374Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_31_7051171975186204941_v1
2025-09-30T14:58:44.617816Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896839271027405:9660] connected; active server actors: 1
2025-09-30T14:58:44.617989Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896839271027405:9660] session shared/user_1_31_7051171975186204941_v1
2025-09-30T14:58:44.618003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:58:44.618011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:58:44.618017Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_31_7051171975186204941_v1" (Sender=[1:7555896839271027397:9660], Pipe=[1:7555896839271027405:9660], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:58:44.618019Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:58:44.617878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:44.618028Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:58:44.618020Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:44.618034Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_31_7051171975186204941_v1" (Sender=[1:7555896839271027397:9660], Pipe=[1:7555896839271027405:9660], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:58:44.618023Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:44.618041Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_31_7051171975186204941_v1" sender [1:7555896839271027397:9660] lock partition 0 for ReadingSession "shared/user_1_31_7051171975186204941_v1" (Sender=[1:7555896839271027397:9660], Pipe=[1:7555896839271027405:9660], Partitions=[], ActiveFamilyCount=1) generation 1 step 31
2025-09-30T14:58:44.618030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:44.618047Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:58:44.618052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000019s
2025-09-30T14:58:44.618285Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 31 Session: "shared/user_1_31_7051171975186204941_v1" ClientId: "user" PipeClient { RawX1: 7555896839271027405 RawX2: 4503603922347452 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:58:44.618300Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:58:44.618066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:44.618098Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896839181226400:6807]
2025-09-30T14:58:44.618592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:44.618855Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896839271027387:9670] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:44.619314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:44.619352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:44.619581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:44.619617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.619618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.619619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.619620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.619620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.619621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.619622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.619623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.619624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.619624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.619625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.619626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.619627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.619628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.619628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.619633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.619639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.619641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.619644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.619646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.619648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.619651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.619653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.619656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.619658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.619661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.619663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.619665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.619669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.619672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.619677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.619682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.619686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.619689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.619692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.619695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.619698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.619701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.619704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.619707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.619709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.619713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.619716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.619719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.619722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.619725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.619728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.619731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.619733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.619737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.619751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.619754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.619756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.619759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.619762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.619765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.619767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.619770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.619775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.619779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.619806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:44.625355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896839271027387:9670] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:44.625374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896839271027387:9670] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:44.625377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896839271027387:9670] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:44.625386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3002 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:44.625608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:44.626552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:44.626569Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:44.626571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:44.626574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:44.626580Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3001 [2:7555896839181226400:6807]
2025-09-30T14:58:44.626596Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:44.626618Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:44.626626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:44.626629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:44.626632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:44.626647Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:44.626652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:44.626659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:44.626717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.626722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.626723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.626728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:44.626731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:44.626782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:44.626788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.626796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.626803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.627061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3001, pipe: [1:7555896839271027415:9657]
2025-09-30T14:58:44.627090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3001
2025-09-30T14:58:44.627108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3001
2025-09-30T14:58:44.626815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:44.626835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027415:9657], now have 1 active actors on pipe
2025-09-30T14:58:44.626838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027323:2454], now have 1 active actors on pipe
2025-09-30T14:58:44.626839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027435:9670], now have 1 active actors on pipe
2025-09-30T14:58:44.626843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896839181226394:6807]
2025-09-30T14:58:44.626845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896839181226394:6807]
2025-09-30T14:58:44.626846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896839181226394:6807]
2025-09-30T14:58:44.626856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:44.626868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:44.626876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:44.626879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:44.626882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:44.626882Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:44.626885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:44.626917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896839181226394:6807]
2025-09-30T14:58:44.626925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:44.626929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:44.627325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.627335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.627344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_31_7051171975186204941_v1 on pipe: [1:7555896839271027415:9657]
2025-09-30T14:58:44.627369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.627372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.627383Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_31_7051171975186204941_v1:1 with generation 3001
2025-09-30T14:58:44.627385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:44.627391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:44.627393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:44.627413Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_31_7051171975186204941_v1
2025-09-30T14:58:44.627415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:44.627464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:44.627472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:58:44.627475Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:58:44.629985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:58:44.630015Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:58:44.630022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:44.630026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:44.630028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:44.630038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:44.630049Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:44.630055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:58:44.630064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:58:44.630073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:44.630325Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244324626 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:58:44.630345Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:58:44.630402Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 sending to client partition status
2025-09-30T14:58:44.630820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.630838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.630861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:44.631032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3002 partition: 0 MaxSeqNo: 42 sessionId: src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0
2025-09-30T14:58:44.631294Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9d25f49-740097a0-95824fa-2e51a2dd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:44.633970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0] Write session: try to update token
2025-09-30T14:58:44.633986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:44.645587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:44.645605Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:44.645613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896839181226394:6807]
2025-09-30T14:58:44.645653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:44.645815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:44.645955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:44.646095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:44.646224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:44.646416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:44.646460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:44.646772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:44.656780Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:44.656802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:44.656805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:44.656808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:44.656818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896839181226394:6807]
2025-09-30T14:58:44.656823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896839181226394:6807]
2025-09-30T14:58:44.656828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896839181226394:6807]
2025-09-30T14:58:44.656868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:44.656875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.656881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:44.656976Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:44.656990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:44.656994Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:44.657058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:44.657652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3002 sessionId: src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:44.660557Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:44.773473Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:44.773949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.773967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.774195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896839271027415:9657]
2025-09-30T14:58:44.774240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:44.774289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:44.774305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:44.774390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3002 reason: error at write: Disconnected sessionId: src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0
2025-09-30T14:58:44.774579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3002 sessionId: src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0 is DEAD
2025-09-30T14:58:44.774263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_31_7051171975186204941_v1
2025-09-30T14:58:44.774286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:44.774700Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_31_7051171975186204941_v1
2025-09-30T14:58:44.774730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:44.774779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0] Write session will restart in 0.009348s
2025-09-30T14:58:44.774814Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0] Write session: Do CDS request
2025-09-30T14:58:44.774819Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:44.784057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:44.785584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:44.785816Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:44.785830Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:44.785842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:44.785907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:44.785948Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896839181226496:6801]
2025-09-30T14:58:44.786667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:44.786983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:44.787032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:44.787389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:44.787486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.787494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.787495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.787497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.787498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.787500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.787501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.787502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.787504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.787505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.787506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.787507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.787508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.787510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.787511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.787517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.787529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.787533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.787538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.787542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.787546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.787550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.787554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.787558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.787563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.787567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.787571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.787575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.787579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.787583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.787608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.787622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.787630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.787635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.787641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.787652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.787657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.787662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.787672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.787677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.787688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.787693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.787698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.787705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.787714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.787719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.787724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.787730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.787735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.787740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.787745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.787751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.787760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.787766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.787775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.787781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.787785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.787795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.787800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.787806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.787852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:44.787896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:44.788012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:44.788031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3003
2025-09-30T14:58:44.788207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3003 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:44.788261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3003 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:44.788271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3003 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:44.788276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:44.788769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3003 sessionId:  describe result for acl check
2025-09-30T14:58:44.788828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:44.788836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:44.788839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:44.788847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896839271027509:9653] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:44.789571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896839271027509:9653] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:44.791913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896839271027509:9653] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:44.793873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:44.794990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896839271027509:9653] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:44.795009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896839271027509:9653] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:44.795013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896839271027509:9653] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:44.795022Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3003 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:44.795339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:44.795361Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:44.795363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:44.795368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:44.795375Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3002 [2:7555896839181226496:6801]
2025-09-30T14:58:44.795391Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:44.795408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:44.795419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:44.795423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:44.795426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:44.795444Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:44.795458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:44.795472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:44.795551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.795560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.795563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.795568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:44.795571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:44.795668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:44.795681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.795696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.795715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.795740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:44.795769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027446:2454], now have 1 active actors on pipe
2025-09-30T14:58:44.795773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027542:9653], now have 1 active actors on pipe
2025-09-30T14:58:44.795780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896839181226491:6801]
2025-09-30T14:58:44.795784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896839181226491:6801]
2025-09-30T14:58:44.795759Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3002
2025-09-30T14:58:44.795786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896839181226491:6801]
2025-09-30T14:58:44.795778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3002
2025-09-30T14:58:44.795800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:44.795817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:44.795831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:44.795841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:44.795853Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:44.795856Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:44.795858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:44.795883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896839181226491:6801]
2025-09-30T14:58:44.795900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:44.795907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:44.795932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.795943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.795995Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e989d87-21e229b1-adcc3936-e803f645_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:44.796007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:44.796011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:44.796013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:44.796027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:44.796043Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:44.796068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:44.796285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.796306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.796329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:44.796425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3003 partition: 0 MaxSeqNo: 42 sessionId: src_id|9e989d87-21e229b1-adcc3936-e803f645_0
2025-09-30T14:58:44.796826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d0cd79e7-cd88de96-da2f2c18-da0607e2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9e989d87-21e229b1-adcc3936-e803f645_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:44.799780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e989d87-21e229b1-adcc3936-e803f645_0] Write session: try to update token
2025-09-30T14:58:44.799795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e989d87-21e229b1-adcc3936-e803f645_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:44.809730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:44.809753Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:44.809756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:44.809758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:44.809769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896839181226491:6801]
2025-09-30T14:58:44.809775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896839181226491:6801]
2025-09-30T14:58:44.809779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896839181226491:6801]
2025-09-30T14:58:44.809823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:44.809831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.809834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:44.809835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:44.809869Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:44.809874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:44.810026Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:44.818809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3003 sessionId: src_id|9e989d87-21e229b1-adcc3936-e803f645_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:44.821930Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:44.874422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896839271027551:9657]
2025-09-30T14:58:44.877846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3002, pipe: [1:7555896839271027551:9657]
2025-09-30T14:58:44.932951Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:44.933361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.933377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.933424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027551:9657], now have 1 active actors on pipe
2025-09-30T14:58:44.935614Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:44.936125Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e989d87-21e229b1-adcc3936-e803f645_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:44.936138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e989d87-21e229b1-adcc3936-e803f645_0] Write session will restart in 0.009889s
2025-09-30T14:58:44.936168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e989d87-21e229b1-adcc3936-e803f645_0] Write session: Do CDS request
2025-09-30T14:58:44.936174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e989d87-21e229b1-adcc3936-e803f645_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:44.935621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896839271027551:9657]
2025-09-30T14:58:44.935673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:44.935676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:44.935712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:44.935747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3003 reason: error at write: Disconnected sessionId: src_id|9e989d87-21e229b1-adcc3936-e803f645_0
2025-09-30T14:58:44.935942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3003 sessionId: src_id|9e989d87-21e229b1-adcc3936-e803f645_0 is DEAD
2025-09-30T14:58:44.946878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e989d87-21e229b1-adcc3936-e803f645_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:44.949965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:44.947271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:44.947291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3004
2025-09-30T14:58:44.947416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3004 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:44.947442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3004 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:44.947448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3004 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:44.947452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:44.947867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3004 sessionId:  describe result for acl check
2025-09-30T14:58:44.947894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:44.947896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:44.947898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:44.947904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896839271027603:9648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:44.948466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896839271027603:9648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:44.951443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:44.951639Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:44.951648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:44.951658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:44.951705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:44.951746Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896839181226592:6802]
2025-09-30T14:58:44.952408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:44.952714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:44.952769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:44.953090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:44.953153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.953160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.953161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.953162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.953163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.953164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.953165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.953166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.953167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.953168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.953169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.953170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.953172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.953172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.953174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.953178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.953187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.953191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.953194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.953198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.953202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.953206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.953210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.953214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.953218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.953221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.953225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.953228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.953232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.953235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.953245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.953253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:44.953258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.953264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:44.953268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.953273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:44.953277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.953282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:44.953286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.953290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:44.953294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.953298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:44.953303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.953307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:44.953311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.953315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:44.953320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.953324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:44.953329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.953333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:44.953338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.953342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.953347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.953351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.953356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.953361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.953365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.953369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:44.953375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.953380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:44.953417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:44.953707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896839271027603:9648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:44.958901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896839271027603:9648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:44.958925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896839271027603:9648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:44.958929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896839271027603:9648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:44.958938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3004 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:44.959226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:44.960186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:44.960207Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:44.960211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:44.960215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:44.960230Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3003 [2:7555896839181226592:6802]
2025-09-30T14:58:44.960248Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:44.960264Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:44.960268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:44.960272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:44.960274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:44.960291Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:44.960303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:44.960310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:44.960376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.960384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.960386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.960390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:44.960392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:44.960463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:44.960471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.960483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:44.960499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:44.960520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:44.960536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896839181226587:6802]
2025-09-30T14:58:44.960547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896839181226587:6802]
2025-09-30T14:58:44.960549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896839181226587:6802]
2025-09-30T14:58:44.960564Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:44.960577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:44.960596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:44.960604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:44.960636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896839181226587:6802]
2025-09-30T14:58:44.960643Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:44.960644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:44.960648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:44.960650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:44.960653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027552:2454], now have 1 active actors on pipe
2025-09-30T14:58:44.960656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896839271027648:9648], now have 1 active actors on pipe
2025-09-30T14:58:44.960657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:44.960776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3003
2025-09-30T14:58:44.960781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3003
2025-09-30T14:58:44.960901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.960911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.960935Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:44.960947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:44.960951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:44.960953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:44.960963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:44.960976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:44.960994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:44.961170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:44.961177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:44.961192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:44.961741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e989d87-21e229b1-adcc3936-e803f645_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:44.964828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0] Write session: try to update token
2025-09-30T14:58:44.964849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:44.961325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3004 partition: 0 MaxSeqNo: 42 sessionId: src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0
2025-09-30T14:58:44.976598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:44.976626Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:44.976628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:44.976631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:44.976641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896839181226587:6802]
2025-09-30T14:58:44.976651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896839181226587:6802]
2025-09-30T14:58:44.976656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896839181226587:6802]
2025-09-30T14:58:44.976704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:44.976709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:44.976732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:44.976736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:44.976739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:44.976742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:44.976987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:44.984618Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3004 sessionId: src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:44.987489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:45.035714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896843565994952:9657]
2025-09-30T14:58:45.035981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3003, pipe: [1:7555896843565994952:9657]
2025-09-30T14:58:45.100267Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:45.100801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.100811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.100833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565994952:9657], now have 1 active actors on pipe
2025-09-30T14:58:45.101772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:45.107347Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:45.107355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896843565994952:9657]
2025-09-30T14:58:45.107386Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:45.107468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3004 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0
2025-09-30T14:58:45.107658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3004 sessionId: src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0 is DEAD
2025-09-30T14:58:45.108030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:45.108040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0] Write session will restart in 0.007261s
2025-09-30T14:58:45.108066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0] Write session: Do CDS request
2025-09-30T14:58:45.108071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:45.119670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:45.127344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:45.127365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3005
2025-09-30T14:58:45.130601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:45.131330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3005 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:45.131393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3005 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:45.131398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3005 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:45.131403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:45.131927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3005 sessionId:  describe result for acl check
2025-09-30T14:58:45.131956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:45.131958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:45.131959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:45.131965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896843565995011:9644] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:45.132502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896843565995011:9644] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:45.134494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:45.134749Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:45.134754Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:45.134766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:45.134833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:45.134873Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896843476193986:6799]
2025-09-30T14:58:45.135561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:45.136885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:45.136954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:45.137339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:45.137417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.137418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.137420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.137421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.137423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.137424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.137426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.137427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.137429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.137430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.137432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.137433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.137434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.137436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.137437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.137444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.137453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.137457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.137461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.137465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.137469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.137476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.137479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.137483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.137488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.137491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.137494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.137498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.137501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.137505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.137513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.137521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.137526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.137532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.137540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.137545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.137549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.137557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.137562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.137567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.137572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.137577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.137582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.137587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.137620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.137626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.137632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.137638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.137643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.137649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.137654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.137660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.137668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.137673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.137678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.137684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.137688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.137693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.137698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.137703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.137745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:45.138582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896843565995011:9644] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:45.145089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896843565995011:9644] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:45.145112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896843565995011:9644] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:45.145116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896843565995011:9644] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:45.145127Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3005 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:45.147104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:45.148283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:45.148290Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:45.148293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:45.148298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:45.148305Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3004 [2:7555896843476193986:6799]
2025-09-30T14:58:45.148323Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:45.148343Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:45.148347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:45.148351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:45.148353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:45.148370Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:45.148379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:45.148388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:45.148453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.148455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.148457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.148461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:45.148463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:45.148542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:45.148545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.148558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.148569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.148588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:45.148605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896843476193980:6799]
2025-09-30T14:58:45.148607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896843476193980:6799]
2025-09-30T14:58:45.148609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896843476193980:6799]
2025-09-30T14:58:45.148623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:45.148638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:45.148654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:45.148656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:45.148657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:45.148660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:45.148663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:45.148667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995048:9644], now have 1 active actors on pipe
2025-09-30T14:58:45.148671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565994955:2454], now have 1 active actors on pipe
2025-09-30T14:58:45.148707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896843476193980:6799]
2025-09-30T14:58:45.148729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:45.148737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:45.148776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3004
2025-09-30T14:58:45.148832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3004
2025-09-30T14:58:45.148916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.148946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.148975Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|892710a1-519b0110-85d7cde2-cc113a5a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:45.148985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:45.148989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:45.148992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:45.149004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:45.149017Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:45.149039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:45.149372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.149381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.149398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:45.149548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3005 partition: 0 MaxSeqNo: 42 sessionId: src_id|892710a1-519b0110-85d7cde2-cc113a5a_0
2025-09-30T14:58:45.150213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e565dd9f-6981ddd6-ec25c52a-f1e02950_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|892710a1-519b0110-85d7cde2-cc113a5a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:45.153418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|892710a1-519b0110-85d7cde2-cc113a5a_0] Write session: try to update token
2025-09-30T14:58:45.153446Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|892710a1-519b0110-85d7cde2-cc113a5a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:45.163118Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:45.163143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:45.163146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:45.163149Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:45.163159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896843476193980:6799]
2025-09-30T14:58:45.163164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896843476193980:6799]
2025-09-30T14:58:45.163169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896843476193980:6799]
2025-09-30T14:58:45.163215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:45.163223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.163226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:45.163417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:45.164707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:45.164727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:45.164732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:45.178840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3005 sessionId: src_id|892710a1-519b0110-85d7cde2-cc113a5a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:45.181676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:45.207950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896843565995057:9657]
2025-09-30T14:58:45.208654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3004, pipe: [1:7555896843565995057:9657]
2025-09-30T14:58:45.288585Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:45.289158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.289175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.289218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995057:9657], now have 1 active actors on pipe
2025-09-30T14:58:45.289492Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:45.289552Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896843565995057:9657]
2025-09-30T14:58:45.289566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:45.289571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:45.289599Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:45.289654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3005 reason: error at write: Disconnected sessionId: src_id|892710a1-519b0110-85d7cde2-cc113a5a_0
2025-09-30T14:58:45.289912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3005 sessionId: src_id|892710a1-519b0110-85d7cde2-cc113a5a_0 is DEAD
2025-09-30T14:58:45.290121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|892710a1-519b0110-85d7cde2-cc113a5a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:45.290129Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|892710a1-519b0110-85d7cde2-cc113a5a_0] Write session will restart in 0.005932s
2025-09-30T14:58:45.290154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|892710a1-519b0110-85d7cde2-cc113a5a_0] Write session: Do CDS request
2025-09-30T14:58:45.290164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|892710a1-519b0110-85d7cde2-cc113a5a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:45.297817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|892710a1-519b0110-85d7cde2-cc113a5a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:45.297935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:45.297957Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3006
2025-09-30T14:58:45.298140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3006 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:45.298242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3006 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:45.298255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3006 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:45.298263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:45.298935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3006 sessionId:  describe result for acl check
2025-09-30T14:58:45.298973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:45.298980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:45.298982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:45.298989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896843565995095:9634] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:45.299645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896843565995095:9634] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:45.302904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896843565995095:9634] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:45.302938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:45.304774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:45.305018Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:45.305031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:45.305043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:45.305097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:45.305150Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896843476194083:6797]
2025-09-30T14:58:45.305852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:45.306321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:45.306465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:45.306860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:45.306940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.306947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.306948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.306950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.306951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.306952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.306954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.306955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.306956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.306957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.306958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.306960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.306961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.306962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.306963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.306981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.306992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.306997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.307001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.307005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.307010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.307014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.307018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.307022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.307026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.307030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.307034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.307038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.307042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.307046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.307055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.307065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.307073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.307080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.307086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.307092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.307098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.307104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.307109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.307114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.307119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.307124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.307129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.307134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.307140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.307145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.307150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.307155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.307161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.307166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.307171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.307177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.307182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.307187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.307191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.307211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.307216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.307221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.307230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.307235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.307298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:45.307537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896843565995095:9634] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:45.307562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896843565995095:9634] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:45.307567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896843565995095:9634] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:45.307576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3006 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:45.313742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:45.314895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:45.314921Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:45.314924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:45.314929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:45.314941Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3005 [2:7555896843476194083:6797]
2025-09-30T14:58:45.314967Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:45.314987Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:45.314997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:45.315000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:45.315003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:45.315022Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:45.315030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:45.315037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:45.315109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.315117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.315120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.315124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:45.315127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:45.315205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:45.315215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.315230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.315266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.315294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:45.315326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995162:9634], now have 1 active actors on pipe
2025-09-30T14:58:45.315335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995062:2454], now have 1 active actors on pipe
2025-09-30T14:58:45.315343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896843476194078:6797]
2025-09-30T14:58:45.315345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896843476194078:6797]
2025-09-30T14:58:45.315349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896843476194078:6797]
2025-09-30T14:58:45.315365Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:45.315378Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:45.315380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:45.315396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:45.315399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:45.315399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:45.315401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:45.315445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896843476194078:6797]
2025-09-30T14:58:45.315460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:45.315483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:45.315524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3005
2025-09-30T14:58:45.315571Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3005
2025-09-30T14:58:45.315590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.315623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.315665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e547943-3bba22de-ee5df738-fad9e39f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:45.315681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:45.315686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:45.315688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:45.315701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:45.315714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:45.315732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:45.315926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.315935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.315951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:45.316053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3006 partition: 0 MaxSeqNo: 42 sessionId: src_id|4e547943-3bba22de-ee5df738-fad9e39f_0
2025-09-30T14:58:45.316455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|892710a1-519b0110-85d7cde2-cc113a5a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4e547943-3bba22de-ee5df738-fad9e39f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:45.319537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e547943-3bba22de-ee5df738-fad9e39f_0] Write session: try to update token
2025-09-30T14:58:45.319564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e547943-3bba22de-ee5df738-fad9e39f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:45.335665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:45.335697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:45.335711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896843476194078:6797]
2025-09-30T14:58:45.335771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:45.335783Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:45.336087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:45.336312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:45.336524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:45.336758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:45.337037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:45.337130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:45.339652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3006 sessionId: src_id|4e547943-3bba22de-ee5df738-fad9e39f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:45.342860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:45.339858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:45.339882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:45.339889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:45.339981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:45.339991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896843476194078:6797]
2025-09-30T14:58:45.339997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896843476194078:6797]
2025-09-30T14:58:45.340005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896843476194078:6797]
2025-09-30T14:58:45.340054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:45.340056Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:45.340061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.340063Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:45.340064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:45.340067Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:45.340228Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:45.389484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896843565995187:9657]
2025-09-30T14:58:45.389708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3005, pipe: [1:7555896843565995187:9657]
2025-09-30T14:58:45.457563Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:45.457934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.457949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.457971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995187:9657], now have 1 active actors on pipe
2025-09-30T14:58:45.458203Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:45.458669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:45.458764Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896843565995187:9657]
2025-09-30T14:58:45.458770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3006 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4e547943-3bba22de-ee5df738-fad9e39f_0
2025-09-30T14:58:45.458781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:45.458957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3006 sessionId: src_id|4e547943-3bba22de-ee5df738-fad9e39f_0 is DEAD
2025-09-30T14:58:45.459452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e547943-3bba22de-ee5df738-fad9e39f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:45.459461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e547943-3bba22de-ee5df738-fad9e39f_0] Write session will restart in 0.009922s
2025-09-30T14:58:45.459478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e547943-3bba22de-ee5df738-fad9e39f_0] Write session: Do CDS request
2025-09-30T14:58:45.459483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e547943-3bba22de-ee5df738-fad9e39f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:45.470826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e547943-3bba22de-ee5df738-fad9e39f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:45.470930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:45.470950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3007
2025-09-30T14:58:45.471540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3007 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:45.471583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3007 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:45.471597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3007 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:45.471607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:45.472027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3007 sessionId:  describe result for acl check
2025-09-30T14:58:45.472072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:45.472074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:45.472077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:45.472083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896843565995208:9619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:45.472671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896843565995208:9619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:45.477352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896843565995208:9619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:45.480747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896843565995208:9619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:45.480768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896843565995208:9619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:45.480771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896843565995208:9619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:45.480780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3007 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:45.489259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:45.491385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:45.491663Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:45.491674Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:45.491694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:45.491764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:45.491809Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896843476194230:6766]
2025-09-30T14:58:45.492512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:45.492997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:45.493051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:45.493409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:45.493483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.493490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.493491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.493493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.493494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.493496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.493497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.493499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.493500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.493502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.493503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.493504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.493505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.493507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.493508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.493514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.493524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.493529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.493534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.493538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.493543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.493547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.493552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.493556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.493561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.493565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.493569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.493573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.493577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.493582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.493590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.493599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.493605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.493612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.493617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.493623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.493628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.493634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.493657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.493665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.493674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.493680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.493685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.493695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.493700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.493706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.493711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.493721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.493727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.493732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.493740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.493744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.493749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.493755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.493760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.493764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.493769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.493774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.493779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.493789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.493838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:45.499740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:45.500703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:45.500742Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:45.500745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:45.500749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:45.500756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3006 [2:7555896843476194230:6766]
2025-09-30T14:58:45.500776Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:45.500791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:45.500800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:45.500803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:45.500806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:45.500828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:45.500952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:45.500965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:45.501039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.501046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.501048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.501051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:45.501054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:45.501126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:45.501134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.501148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.501166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.501189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:45.501212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896843476194225:6766]
2025-09-30T14:58:45.501221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896843476194225:6766]
2025-09-30T14:58:45.501223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896843476194225:6766]
2025-09-30T14:58:45.501232Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:45.501252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:45.501275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:45.501285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:45.501324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896843476194225:6766]
2025-09-30T14:58:45.501330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:45.501486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:45.501493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:45.501496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:45.501501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:45.501766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995200:2454], now have 1 active actors on pipe
2025-09-30T14:58:45.501781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995246:9619], now have 1 active actors on pipe
2025-09-30T14:58:45.501868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3006
2025-09-30T14:58:45.501895Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3006
2025-09-30T14:58:45.501984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.501992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.502016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:45.502031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:45.502038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:45.502042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:45.502051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:45.502065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:45.502082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:45.502347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.502361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.502388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:45.502527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3007 partition: 0 MaxSeqNo: 42 sessionId: src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0
2025-09-30T14:58:45.502975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e547943-3bba22de-ee5df738-fad9e39f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:45.506123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0] Write session: try to update token
2025-09-30T14:58:45.506147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:45.518224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:45.518253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:45.518255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:45.518257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:45.518267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896843476194225:6766]
2025-09-30T14:58:45.518273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896843476194225:6766]
2025-09-30T14:58:45.518278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896843476194225:6766]
2025-09-30T14:58:45.518323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:45.518336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.518339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:45.518534Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:45.522554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:45.522584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:45.522589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:45.544217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3007 sessionId: src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:45.546976Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:45.556949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896843565995304:9657]
2025-09-30T14:58:45.557334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3006, pipe: [1:7555896843565995304:9657]
2025-09-30T14:58:45.638407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:45.638476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896843565995304:9657]
2025-09-30T14:58:45.638499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:45.638511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:45.638597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3007 reason: error at write: Disconnected sessionId: src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0
2025-09-30T14:58:45.638810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3007 sessionId: src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0 is DEAD
2025-09-30T14:58:45.638988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:45.639001Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0] Write session will restart in 0.005788s
2025-09-30T14:58:45.639027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0] Write session: Do CDS request
2025-09-30T14:58:45.639033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:45.637572Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:45.638083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.638092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.638109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995304:9657], now have 1 active actors on pipe
2025-09-30T14:58:45.639236Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:45.645794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:45.646176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:45.646196Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3008
2025-09-30T14:58:45.646380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3008 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:45.646409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3008 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:45.646414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3008 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:45.646419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:45.646909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3008 sessionId:  describe result for acl check
2025-09-30T14:58:45.646957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:45.646976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:45.646978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:45.646985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896843565995333:9612] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:45.647602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896843565995333:9612] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:45.649591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896843565995333:9612] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:45.652025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:45.653662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:45.653885Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:45.653895Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:45.653906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:45.654025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896843565995333:9612] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:45.654048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896843565995333:9612] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:45.654052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896843565995333:9612] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:45.654061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3008 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:45.653974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:45.654020Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896843476194330:6763]
2025-09-30T14:58:45.654737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:45.655079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:45.655130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:45.655538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:45.655607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.655614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.655616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.655617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.655619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.655620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.655621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.655623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.655625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.655626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.655627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.655628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.655629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.655630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.655632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.655637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.655648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.655652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.655656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.655661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.655665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.655669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.655674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.655678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.655682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.655685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.655689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.655693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.655696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.655699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.655709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.655718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.655725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.655730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.655735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.655739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.655744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.655750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.655756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.655770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.655780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.655785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.655795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.655801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.655811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.655816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.655821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.655832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.655838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.655849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.655854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.655860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.655866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.655877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.655882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.655892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.655897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.655907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.655912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.655917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.655971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:45.662096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:45.663204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:45.663223Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:45.663227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:45.663231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:45.663240Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3007 [2:7555896843476194330:6763]
2025-09-30T14:58:45.663290Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:45.663318Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:45.663329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:45.663332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:45.663336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:45.663353Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:45.663361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:45.663373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:45.663447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.663459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.663462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.663466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:45.663469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:45.663546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:45.663556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.663573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.663589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.663610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:45.663634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896843476194325:6763]
2025-09-30T14:58:45.663641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896843476194325:6763]
2025-09-30T14:58:45.663644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896843476194325:6763]
2025-09-30T14:58:45.663654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:45.663670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:45.663674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:45.663683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:45.663686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:45.663689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:45.663692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:45.663703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995414:9612], now have 1 active actors on pipe
2025-09-30T14:58:45.663707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995318:2454], now have 1 active actors on pipe
2025-09-30T14:58:45.663814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3007
2025-09-30T14:58:45.663864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3007
2025-09-30T14:58:45.663748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896843476194325:6763]
2025-09-30T14:58:45.663763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:45.663769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:45.663977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.663992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.664026Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:45.664041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:45.664050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:45.664052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:45.664065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:45.664083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:45.664119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:45.664355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.664366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.664385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:45.664487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3008 partition: 0 MaxSeqNo: 42 sessionId: src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0
2025-09-30T14:58:45.664908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|169a18a8-384fe9c7-e5c6741f-9f055a2d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:45.668195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0] Write session: try to update token
2025-09-30T14:58:45.668221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:45.677808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:45.677830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:45.677837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:45.677839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:45.677851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896843476194325:6763]
2025-09-30T14:58:45.677855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896843476194325:6763]
2025-09-30T14:58:45.677858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896843476194325:6763]
2025-09-30T14:58:45.677902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:45.677903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:45.677908Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:45.677909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.677912Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:45.677912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:45.678071Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:45.693245Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3008 sessionId: src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:45.696155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:45.739392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896843565995426:9657]
2025-09-30T14:58:45.741606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3007, pipe: [1:7555896843565995426:9657]
2025-09-30T14:58:45.804709Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:45.805121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.805144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.805177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995426:9657], now have 1 active actors on pipe
2025-09-30T14:58:45.805843Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:45.806312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:45.806397Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:45.806479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3008 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0
2025-09-30T14:58:45.806674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3008 sessionId: src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0 is DEAD
2025-09-30T14:58:45.806947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896843565995426:9657]
2025-09-30T14:58:45.807186Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:45.807197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0] Write session will restart in 0.008357s
2025-09-30T14:58:45.807221Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0] Write session: Do CDS request
2025-09-30T14:58:45.807227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:45.817889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:45.819375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:45.819599Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:45.819608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:45.819620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:45.819692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:45.819720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:45.819740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896843476194430:6762]
2025-09-30T14:58:45.820425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:45.820872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:45.820922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:45.821291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:45.821357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.821363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.821365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.821366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.821367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.821368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.821369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.821371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.821372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.821374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.821375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.821376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.821378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.821379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.821380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.821386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.821397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.821401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.821405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.821409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.821412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.821416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.821421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.821425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.821429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.821434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.821437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.821440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.821444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.821449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.821458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.821466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.821472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.821456Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:45.821478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.821477Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3009
2025-09-30T14:58:45.821485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.821491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.821495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.821501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.821506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.821511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.821516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.821521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.821527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.821532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.821537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.821554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.821564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.821570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.821578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.821584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.821593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.821600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.821605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.821611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.821620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.821626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.821634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.821639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.821648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.821655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.821710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:45.821727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3009 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:45.821782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3009 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:45.821792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3009 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:45.821797Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:45.822252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3009 sessionId:  describe result for acl check
2025-09-30T14:58:45.822289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:45.822296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:45.822298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:45.822304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896843565995497:9605] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:45.822833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896843565995497:9605] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:45.825275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896843565995497:9605] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:45.827355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:45.828235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896843565995497:9605] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:45.828252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896843565995497:9605] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:45.828256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896843565995497:9605] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:45.828265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3009 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:45.828288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:45.828313Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:45.828317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:45.828320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:45.828326Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3008 [2:7555896843476194430:6762]
2025-09-30T14:58:45.828343Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:45.828361Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:45.828364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:45.828367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:45.828370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:45.828387Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:45.828398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:45.828406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:45.828478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.828486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.828488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.828492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:45.828494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:45.828571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:45.828578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.828590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.828603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.828622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:45.828647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995429:2454], now have 1 active actors on pipe
2025-09-30T14:58:45.828654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896843476194424:6762]
2025-09-30T14:58:45.828656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896843476194424:6762]
2025-09-30T14:58:45.828659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896843476194424:6762]
2025-09-30T14:58:45.828672Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:45.828685Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:45.828688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:45.828700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:45.828703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:45.828706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:45.828709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:45.828758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896843476194424:6762]
2025-09-30T14:58:45.828766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:45.828768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:45.828772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995530:9605], now have 1 active actors on pipe
2025-09-30T14:58:45.828709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3008
2025-09-30T14:58:45.828921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3008
2025-09-30T14:58:45.828957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.828966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.828989Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:45.828997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:45.829012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:45.829015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:45.829026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:45.829035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:45.829049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:45.829188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.829201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.829218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:45.829333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3009 partition: 0 MaxSeqNo: 42 sessionId: src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0
2025-09-30T14:58:45.829697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef3d8b3-86de9808-2d0c8d5-8c677ae9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:45.832808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0] Write session: try to update token
2025-09-30T14:58:45.832832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:45.842889Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:45.842910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:45.842913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:45.842915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:45.842928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896843476194424:6762]
2025-09-30T14:58:45.842933Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896843476194424:6762]
2025-09-30T14:58:45.842937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896843476194424:6762]
2025-09-30T14:58:45.842980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:45.842985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:45.842988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.842990Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:45.842991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:45.842995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:45.843150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:45.848922Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3009 sessionId: src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:45.852003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:45.907170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896843565995539:9657]
2025-09-30T14:58:45.907632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3008, pipe: [1:7555896843565995539:9657]
2025-09-30T14:58:45.958281Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:45.958666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.958685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.958732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995539:9657], now have 1 active actors on pipe
2025-09-30T14:58:45.958980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:45.959027Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:45.959051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:45.959057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:45.959087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896843565995539:9657]
2025-09-30T14:58:45.959125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3009 reason: error at write: Disconnected sessionId: src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0
2025-09-30T14:58:45.959347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3009 sessionId: src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0 is DEAD
2025-09-30T14:58:45.959488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:45.959508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0] Write session will restart in 0.008368s
2025-09-30T14:58:45.959532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0] Write session: Do CDS request
2025-09-30T14:58:45.959537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:45.968836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:45.968710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:45.968929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:45.968948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3010
2025-09-30T14:58:45.969079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3010 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:45.969120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3010 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:45.969132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3010 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:45.969136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:45.969628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3010 sessionId:  describe result for acl check
2025-09-30T14:58:45.969663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:45.969670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:45.969675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:45.969681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896843565995606:9602] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:45.970251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896843565995606:9602] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:45.970319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:45.970494Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:45.970507Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:45.970517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:45.970562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:45.970606Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896843476194530:6755]
2025-09-30T14:58:45.971265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:45.971521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:45.971561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:45.971900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:45.971960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.971966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.971968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.971969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.971970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.971971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.971972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.971974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.971975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.971977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.971978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.971979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.971980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.971981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.971982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.971988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.971998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.972002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.972007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.972011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.972015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.972018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.972022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.972027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.972031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.972036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.972040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.972044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.972048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.972051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.972058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.972066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:45.972073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.972078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:45.972083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.972088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:45.972093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.972097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:45.972108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.972113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:45.972117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.972123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:45.972127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.972132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:45.972136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.972146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:45.972151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.972156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:45.972166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.972171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:45.972182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.972187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.972196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.972202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.972206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.972211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.972220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.972225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:45.972237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.972243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:45.972287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:45.972473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896843565995606:9602] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:45.976977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896843565995606:9602] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:45.976995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896843565995606:9602] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:45.976998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896843565995606:9602] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:45.977007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3010 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:45.977777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:45.978838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:45.978859Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:45.978866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:45.978871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:45.978877Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3009 [2:7555896843476194530:6755]
2025-09-30T14:58:45.978896Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:45.978914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:45.978918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:45.978921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:45.978924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:45.978942Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:45.978957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:45.978964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:45.979039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.979047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.979049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.979053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:45.979056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:45.979135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:45.979144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:45.979160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:45.979172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:45.979190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:45.979210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896843476194525:6755]
2025-09-30T14:58:45.979218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896843476194525:6755]
2025-09-30T14:58:45.979220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896843476194525:6755]
2025-09-30T14:58:45.979237Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:45.979269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:45.979291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:45.979294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:45.979299Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:45.979312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:45.979314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:45.979337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896843476194525:6755]
2025-09-30T14:58:45.979345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:45.979404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:45.979447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995543:2454], now have 1 active actors on pipe
2025-09-30T14:58:45.979482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896843565995641:9602], now have 1 active actors on pipe
2025-09-30T14:58:45.979558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3009
2025-09-30T14:58:45.979597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3009
2025-09-30T14:58:45.979717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.979728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.979775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:45.979791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:45.979800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:45.979802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:45.979824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:45.979843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:45.979862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:45.982038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:45.982066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:45.982095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:45.982277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3010 partition: 0 MaxSeqNo: 42 sessionId: src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0
2025-09-30T14:58:45.982678Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b324dd4d-8ec1be2-8f5e572b-d0fc1186_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:45.985751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0] Write session: try to update token
2025-09-30T14:58:45.985774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:45.991791Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:45.991812Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:45.991822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896843476194525:6755]
2025-09-30T14:58:45.991871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:45.991878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:45.992049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:45.992200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:45.992388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:45.992564Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:45.992843Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:45.992892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:46.003260Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:46.003281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:46.003284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:46.003286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:46.003297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896843476194525:6755]
2025-09-30T14:58:46.003302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896843476194525:6755]
2025-09-30T14:58:46.003307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896843476194525:6755]
2025-09-30T14:58:46.003350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:46.003359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.003367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:46.003366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:46.003373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:46.003382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:46.003516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:46.006483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3010 sessionId: src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:46.010051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:46.059434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896847860962946:9657]
2025-09-30T14:58:46.059774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3009, pipe: [1:7555896847860962946:9657]
2025-09-30T14:58:46.117133Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:46.117520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.117539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.117562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860962946:9657], now have 1 active actors on pipe
2025-09-30T14:58:46.117872Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:46.117929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:46.117942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896847860962946:9657]
2025-09-30T14:58:46.117968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:46.117971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:46.118037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3010 reason: error at write: Disconnected sessionId: src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0
2025-09-30T14:58:46.118222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3010 sessionId: src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0 is DEAD
2025-09-30T14:58:46.118442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:46.118455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0] Write session will restart in 0.009427s
2025-09-30T14:58:46.118480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0] Write session: Do CDS request
2025-09-30T14:58:46.118489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:46.129982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:46.130053Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:46.130075Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3011
2025-09-30T14:58:46.130206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3011 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:46.130234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3011 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:46.130239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3011 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:46.130244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:46.130749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3011 sessionId:  describe result for acl check
2025-09-30T14:58:46.130781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:46.130786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:46.130788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:46.130795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896847860963012:9586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:46.132431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:46.134636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:46.134890Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:46.134902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:46.134914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:46.134977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:46.135025Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896847771161931:6751]
2025-09-30T14:58:46.131408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896847860963012:9586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:46.134023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896847860963012:9586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:46.135691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:46.136452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:46.136516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:46.136926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:46.137005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.137006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.137008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.137009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.137011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.137012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.137014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.137016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.137018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.137019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.137020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.137022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.137023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.137024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.137026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.137033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.137045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.137050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.137055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.137060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.137065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.137070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.137075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.137079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.137083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.137088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.137093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.137098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.137102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.137107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.137115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.137124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.137130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.137135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.137140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.137144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.137149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.137153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.137158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.137164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.137173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.137179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.137184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.137188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.137193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.137198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.137202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.137208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.137213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.137218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.137222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.137228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.137233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.137238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.137243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.137247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.137255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.137261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.137265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.137271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.137318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:46.136846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896847860963012:9586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:46.136861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896847860963012:9586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:46.136864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896847860963012:9586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:46.136872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3011 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:46.143135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:46.144291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:46.144318Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:46.144322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:46.144350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:46.144362Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3010 [2:7555896847771161931:6751]
2025-09-30T14:58:46.144382Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:46.144405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:46.144409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:46.144413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:46.144416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:46.144435Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:46.144450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:46.144458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:46.144529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.144536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.144540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.144544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:46.144546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:46.144630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:46.144641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.144657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.144669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.144686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:46.144705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896847771161926:6751]
2025-09-30T14:58:46.144726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896847771161926:6751]
2025-09-30T14:58:46.144729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896847771161926:6751]
2025-09-30T14:58:46.144741Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:46.144759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963048:9586], now have 1 active actors on pipe
2025-09-30T14:58:46.144771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:46.144770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:46.144775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:46.144778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:46.144785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:46.144788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:46.144793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860962948:2454], now have 1 active actors on pipe
2025-09-30T14:58:46.144831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896847771161926:6751]
2025-09-30T14:58:46.144842Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:46.144852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:46.144881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3010
2025-09-30T14:58:46.144925Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3010
2025-09-30T14:58:46.145034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.145062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.145097Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:46.145113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:46.145123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:46.145126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:46.145137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:46.145160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:46.145176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:46.145395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.145410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.145441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:46.145579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3011 partition: 0 MaxSeqNo: 42 sessionId: src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0
2025-09-30T14:58:46.146020Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee01b8ae-4f0030a1-d09eeffe-296548b6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:46.149013Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0] Write session: try to update token
2025-09-30T14:58:46.149034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:46.157314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:46.157335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:46.157344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896847771161926:6751]
2025-09-30T14:58:46.157392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:46.157408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:46.157574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:46.157753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:46.157949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:46.158106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:46.158311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:46.158362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:46.166097Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3011 sessionId: src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:46.168962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:46.168994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:46.168997Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:46.168999Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:46.169011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896847771161926:6751]
2025-09-30T14:58:46.169019Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896847771161926:6751]
2025-09-30T14:58:46.169023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896847771161926:6751]
2025-09-30T14:58:46.169064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:46.169072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:46.169077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:46.169083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:46.169090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.169093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:46.169261Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:46.169348Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:46.217932Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896847860963059:9657]
2025-09-30T14:58:46.218312Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3010, pipe: [1:7555896847860963059:9657]
2025-09-30T14:58:46.281136Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:46.281433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.281446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.281468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963059:9657], now have 1 active actors on pipe
2025-09-30T14:58:46.281750Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:46.282350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896847860963059:9657]
2025-09-30T14:58:46.282390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:46.282422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:46.282503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3011 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0
2025-09-30T14:58:46.282696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3011 sessionId: src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0 is DEAD
2025-09-30T14:58:46.283147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:46.283160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0] Write session will restart in 0.007555s
2025-09-30T14:58:46.283185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0] Write session: Do CDS request
2025-09-30T14:58:46.283192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:46.291775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:46.292131Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:46.292151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3012
2025-09-30T14:58:46.292343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3012 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:46.292386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3012 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:46.292397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3012 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:46.292401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:46.292847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3012 sessionId:  describe result for acl check
2025-09-30T14:58:46.292885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:46.292888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:46.292890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:46.292897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896847860963121:9589] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:46.293436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896847860963121:9589] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:46.295398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:46.297198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:46.297411Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:46.297416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:46.297428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:46.297487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:46.297526Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896847771162033:6749]
2025-09-30T14:58:46.298205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:46.298881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:46.298947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:46.299327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:46.299401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.299402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.299403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.299404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.299405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.299407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.299408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.299409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.299410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.299411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.299412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.299413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.299415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.299416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.299417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.299423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.299435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.299440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.299446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.299450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.299455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.299460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.299464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.299468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.299474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.299478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.299482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.299486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.299490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.299495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.299504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.299513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.299520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.299525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.299533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.299538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.299542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.299551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.299556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.299560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.299564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.299569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.299573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.299578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.299582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.299586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.299590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.299594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.299598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.299603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.299608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.299614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.299618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.299623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.299628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.299633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.299637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.299642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.299647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.299653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.299701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:46.301276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896847860963121:9589] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:46.308087Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896847860963121:9589] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:46.308110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896847860963121:9589] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:46.308115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896847860963121:9589] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:46.308125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3012 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:46.306808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:46.308025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:46.308035Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:46.308038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:46.308043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:46.308054Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3011 [2:7555896847771162033:6749]
2025-09-30T14:58:46.308072Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:46.308088Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:46.308091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:46.308095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:46.308097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:46.308114Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:46.308122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:46.308132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:46.308203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.308205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.308206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.308210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:46.308213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:46.308290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:46.308293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.308308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.308320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.308337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:46.308354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896847771162027:6749]
2025-09-30T14:58:46.308356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896847771162027:6749]
2025-09-30T14:58:46.308358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896847771162027:6749]
2025-09-30T14:58:46.308371Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:46.308386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:46.308400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:46.308403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:46.308441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896847771162027:6749]
2025-09-30T14:58:46.308444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:46.308892Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:46.308904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:46.308908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:46.308915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:46.309311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963062:2454], now have 1 active actors on pipe
2025-09-30T14:58:46.309321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963170:9589], now have 1 active actors on pipe
2025-09-30T14:58:46.309353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3011
2025-09-30T14:58:46.309413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3011
2025-09-30T14:58:46.309590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.309602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.309632Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:46.309643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:46.309647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:46.309650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:46.309662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:46.309677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:46.309701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:46.309924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.309937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.309961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:46.310064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3012 partition: 0 MaxSeqNo: 42 sessionId: src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0
2025-09-30T14:58:46.310511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5cbc2c92-b53e3349-a7599a73-1695cb38_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:46.313514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0] Write session: try to update token
2025-09-30T14:58:46.313541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:46.328235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:46.328261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:46.328264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:46.328267Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:46.328279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896847771162027:6749]
2025-09-30T14:58:46.328283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896847771162027:6749]
2025-09-30T14:58:46.328287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896847771162027:6749]
2025-09-30T14:58:46.328329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:46.328338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.328341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:46.328486Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:46.331550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:46.331575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:46.331580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:46.338525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3012 sessionId: src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:46.341311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:46.382772Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896847860963182:9657]
2025-09-30T14:58:46.383085Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3011, pipe: [1:7555896847860963182:9657]
2025-09-30T14:58:46.443213Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:46.443636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.443656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.443675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963182:9657], now have 1 active actors on pipe
2025-09-30T14:58:46.443922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:46.444447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:46.444459Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0] Write session will restart in 0.007769s
2025-09-30T14:58:46.444481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0] Write session: Do CDS request
2025-09-30T14:58:46.444487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:46.443921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:46.443989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:46.443992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:46.444061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3012 reason: error at write: Disconnected sessionId: src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0
2025-09-30T14:58:46.444281Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3012 sessionId: src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0 is DEAD
2025-09-30T14:58:46.444485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896847860963182:9657]
2025-09-30T14:58:46.453801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:46.453953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:46.453987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3013
2025-09-30T14:58:46.454121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3013 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:46.454159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3013 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:46.454164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3013 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:46.454168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:46.454590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3013 sessionId:  describe result for acl check
2025-09-30T14:58:46.454625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:46.454628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:46.454630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:46.454636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896847860963212:9575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:46.455433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896847860963212:9575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:46.457704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896847860963212:9575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:46.458751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:46.459483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:46.459676Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:46.459679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:46.459690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:46.459737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:46.459769Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896847771162163:6741]
2025-09-30T14:58:46.460432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:46.460862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:46.460923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:46.461238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896847860963212:9575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:46.461260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896847860963212:9575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:46.461264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896847860963212:9575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:46.461273Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3013 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:46.461341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:46.461444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.461455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.461456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.461457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.461458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.461460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.461461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.461462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.461463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.461465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.461466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.461468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.461469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.461470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.461472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.461478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.461487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.461491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.461495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.461499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.461503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.461506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.461510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.461514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.461518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.461523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.461527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.461531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.461534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.461537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.461547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.461556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.461562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.461567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.461571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.461592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.461600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.461604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.461610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.461615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.461620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.461626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.461632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.461638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.461648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.461654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.461686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.461692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.461705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.461709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.461714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.461718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.461723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.461727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.461733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.461738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.461743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.461748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.461752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.461757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.461810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:46.467451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:46.468524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:46.468544Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:46.468992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3012
2025-09-30T14:58:46.469035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3012
2025-09-30T14:58:46.468547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:46.468550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:46.468557Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3012 [2:7555896847771162163:6741]
2025-09-30T14:58:46.468572Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:46.468586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:46.468590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:46.468593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:46.468595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:46.468613Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:46.468620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:46.468626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:46.468688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.468690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.468691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.468697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:46.468702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:46.468785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:46.468787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.468800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.468810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.468824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:46.468841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896847771162158:6741]
2025-09-30T14:58:46.468843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896847771162158:6741]
2025-09-30T14:58:46.468845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896847771162158:6741]
2025-09-30T14:58:46.468853Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:46.468863Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:46.468867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:46.468868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963187:2454], now have 1 active actors on pipe
2025-09-30T14:58:46.468870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:46.468874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:46.468886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:46.468889Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:46.468894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963298:9575], now have 1 active actors on pipe
2025-09-30T14:58:46.468927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896847771162158:6741]
2025-09-30T14:58:46.468937Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:46.468943Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:46.469192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.469198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.469225Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:46.469233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:46.469237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:46.469239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:46.469249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:46.469262Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:46.469277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:46.469532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.469550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.469575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:46.469735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3013 partition: 0 MaxSeqNo: 42 sessionId: src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0
2025-09-30T14:58:46.470154Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3793c549-fa1e000e-b1eb1732-a7cab672_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:46.473281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0] Write session: try to update token
2025-09-30T14:58:46.473301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:46.484334Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:46.484362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:46.484372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896847771162158:6741]
2025-09-30T14:58:46.484420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:46.484436Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:46.484593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:46.484759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:46.484902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:46.485038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:46.485227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:46.485268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:46.494365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3013 sessionId: src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:46.495976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:46.496002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:46.496004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:46.496005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:46.496015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896847771162158:6741]
2025-09-30T14:58:46.496018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896847771162158:6741]
2025-09-30T14:58:46.496021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896847771162158:6741]
2025-09-30T14:58:46.496059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:46.496062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:46.496064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:46.496070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:46.496073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.496077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:46.496230Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:46.497230Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:46.544592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896847860963318:9657]
2025-09-30T14:58:46.545004Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3012, pipe: [1:7555896847860963318:9657]
2025-09-30T14:58:46.615362Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:46.615788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.615806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.615834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963318:9657], now have 1 active actors on pipe
2025-09-30T14:58:46.616215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:46.616439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:46.616486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:46.616555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3013 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0
2025-09-30T14:58:46.616770Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3013 sessionId: src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0 is DEAD
2025-09-30T14:58:46.616910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896847860963318:9657]
2025-09-30T14:58:46.619353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:46.619369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0] Write session will restart in 0.007845s
2025-09-30T14:58:46.619397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0] Write session: Do CDS request
2025-09-30T14:58:46.619403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:46.629880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:46.629905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:46.629991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:46.630010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3014
2025-09-30T14:58:46.630189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3014 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:46.630225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3014 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:46.630238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3014 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:46.630242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:46.630663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3014 sessionId:  describe result for acl check
2025-09-30T14:58:46.630702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:46.630704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:46.630706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:46.630713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896847860963400:9569] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:46.631302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896847860963400:9569] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:46.631883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:46.632119Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:46.632130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:46.632142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:46.632204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:46.632256Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896847771162294:6718]
2025-09-30T14:58:46.632942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:46.633371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:46.633439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:46.633794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:46.633864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.633873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.633874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.633875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.633877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.633878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.633880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.633881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.633882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.633883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.633884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.633886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.633887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.633888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.633890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.633896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.633906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.633910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.633914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.633918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.633922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.633926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.633931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.633935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.633939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.633943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.633947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.633951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.633956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.633959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.633967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.633975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.633981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.633987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.633992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.633997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.634001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.634007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.634012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.634018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.634023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.634027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.634033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.634039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.634021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896847860963400:9569] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:46.634044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.634055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.634061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.634066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.634070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.634075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.634099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.634109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.634113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.634118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.634129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.634134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.634139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.634144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.634148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.634152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.634202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:46.640747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896847860963400:9569] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:46.640770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896847860963400:9569] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:46.640774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896847860963400:9569] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:46.640784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3014 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:46.640117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:46.641452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:46.641459Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:46.641463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:46.641468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:46.641476Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3013 [2:7555896847771162294:6718]
2025-09-30T14:58:46.641494Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:46.641512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:46.641516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:46.641518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:46.641521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:46.641539Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:46.641546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:46.641552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:46.641615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.641617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.641620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.641623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:46.641626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:46.641701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:46.641704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.641720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.641733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.641753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:46.641769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896847771162289:6718]
2025-09-30T14:58:46.641771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896847771162289:6718]
2025-09-30T14:58:46.641774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896847771162289:6718]
2025-09-30T14:58:46.641788Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:46.641801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:46.641817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:46.641820Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:46.641861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896847771162289:6718]
2025-09-30T14:58:46.641863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:46.642247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:46.642259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:46.642261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:46.642268Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:46.642449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963331:2454], now have 1 active actors on pipe
2025-09-30T14:58:46.642456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963438:9569], now have 1 active actors on pipe
2025-09-30T14:58:46.642432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3013
2025-09-30T14:58:46.642470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3013
2025-09-30T14:58:46.642665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.642691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.642718Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:46.642733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:46.642737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:46.642739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:46.642761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:46.642779Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:46.642801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:46.643113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.643127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.643148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:46.643380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3014 partition: 0 MaxSeqNo: 42 sessionId: src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0
2025-09-30T14:58:46.643813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2b3e537b-39bba4b3-dfdf9c6e-2c92772_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:46.646883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0] Write session: try to update token
2025-09-30T14:58:46.646906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:46.661314Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:46.661342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:46.661352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896847771162289:6718]
2025-09-30T14:58:46.661407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:46.661605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:46.661770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:46.661918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:46.662086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:46.662297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:46.662346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:46.662707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:46.671277Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:46.671298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:46.671300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:46.671301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:46.671312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896847771162289:6718]
2025-09-30T14:58:46.671315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896847771162289:6718]
2025-09-30T14:58:46.671319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896847771162289:6718]
2025-09-30T14:58:46.671353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:46.671359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.671361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:46.671388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:46.671396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:46.671400Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:46.671520Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:46.679872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3014 sessionId: src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:46.682868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:46.717139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896847860963446:9657]
2025-09-30T14:58:46.719563Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3013, pipe: [1:7555896847860963446:9657]
2025-09-30T14:58:46.785842Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:46.786182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.786198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.786218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963446:9657], now have 1 active actors on pipe
2025-09-30T14:58:46.786440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:46.786469Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896847860963446:9657]
2025-09-30T14:58:46.786500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:46.786503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:46.786582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3014 reason: error at write: Disconnected sessionId: src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0
2025-09-30T14:58:46.786786Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3014 sessionId: src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0 is DEAD
2025-09-30T14:58:46.786464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:46.786977Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:46.786991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0] Write session will restart in 0.006785s
2025-09-30T14:58:46.787017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0] Write session: Do CDS request
2025-09-30T14:58:46.787039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:46.795554Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:46.795685Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:46.795707Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3015
2025-09-30T14:58:46.795942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3015 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:46.795983Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3015 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:46.795992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3015 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:46.795997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:46.796472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3015 sessionId:  describe result for acl check
2025-09-30T14:58:46.796515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:46.796522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:46.796525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:46.796533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896847860963515:9552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:46.796964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:46.797124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896847860963515:9552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:46.798648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:46.798919Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:46.798932Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:46.798945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:46.799008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:46.799051Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896847771162400:6719]
2025-09-30T14:58:46.799075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896847860963515:9552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:46.799696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:46.800083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:46.800123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:46.800445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:46.800514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.800520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.800521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.800523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.800524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.800526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.800527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.800529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.800530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.800531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.800533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.800534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.800536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.800537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.800538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.800544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.800556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.800561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.800566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.800571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.800575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.800579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.800583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.800588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.800593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.800597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.800602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.800606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.800611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.800615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.800624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.800633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.800639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.800646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.800651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.800659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.800664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.800671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.800676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.800681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.800686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.800692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.800701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.800725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.800730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.800736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.800742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.800748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.800753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.800759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.800764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.800769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.800774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.800779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.800784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.800790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.800795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.800801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.800806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.800812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.800861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:46.804030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896847860963515:9552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:46.804052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896847860963515:9552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:46.804059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896847860963515:9552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:46.804069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3015 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:46.807932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:46.809073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:46.809092Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:46.809095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:46.809098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:46.809105Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3014 [2:7555896847771162400:6719]
2025-09-30T14:58:46.809123Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:46.809142Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:46.809146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:46.809148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:46.809151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:46.809166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:46.809179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:46.809186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:46.809253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.809261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.809265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.809269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:46.809272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:46.809353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:46.809361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.809374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.809384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.809398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:46.809431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896847771162394:6719]
2025-09-30T14:58:46.809441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896847771162394:6719]
2025-09-30T14:58:46.809443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896847771162394:6719]
2025-09-30T14:58:46.809460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:46.809479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:46.809500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:46.809502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:46.809506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:46.809508Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:46.809508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:46.809550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896847771162394:6719]
2025-09-30T14:58:46.809559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:46.809606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:46.809807Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3014
2025-09-30T14:58:46.809846Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3014
2025-09-30T14:58:46.810997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963449:2454], now have 1 active actors on pipe
2025-09-30T14:58:46.811026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963555:9552], now have 1 active actors on pipe
2025-09-30T14:58:46.811050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.811062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.811103Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e5d389c0-bc102790-206a91d7-c482f32d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:46.811118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:46.811127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:46.811131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:46.811144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:46.811171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:46.811198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:46.811799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.811814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.811837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:46.811966Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3015 partition: 0 MaxSeqNo: 42 sessionId: src_id|e5d389c0-bc102790-206a91d7-c482f32d_0
2025-09-30T14:58:46.812432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c26326ce-7e10b2-23d4e3c4-db3e04cd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e5d389c0-bc102790-206a91d7-c482f32d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:46.815273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d389c0-bc102790-206a91d7-c482f32d_0] Write session: try to update token
2025-09-30T14:58:46.815292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d389c0-bc102790-206a91d7-c482f32d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:46.823355Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:58:46.823388Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 17
2025-09-30T14:58:46.823748Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:58:46.824103Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 22 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:58:46.824154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:58:46.829592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3015 sessionId: src_id|e5d389c0-bc102790-206a91d7-c482f32d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:46.832465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:46.830890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:46.830913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:46.830916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:46.830919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:46.830929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896847771162394:6719]
2025-09-30T14:58:46.830934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896847771162394:6719]
2025-09-30T14:58:46.830939Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896847771162394:6719]
2025-09-30T14:58:46.830987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:46.830995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.830995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:46.830998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:46.831006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:46.831011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:46.831150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:46.886699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896847860963569:9657]
2025-09-30T14:58:46.886982Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3014, pipe: [1:7555896847860963569:9657]
2025-09-30T14:58:46.952019Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:46.952459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.952470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.952506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963569:9657], now have 1 active actors on pipe
2025-09-30T14:58:46.953828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:46.953003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:46.953031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-09-30T14:58:46.953066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:46.953069Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:46.953142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3015 reason: error at write: Disconnected sessionId: src_id|e5d389c0-bc102790-206a91d7-c482f32d_0
2025-09-30T14:58:46.953332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3015 sessionId: src_id|e5d389c0-bc102790-206a91d7-c482f32d_0 is DEAD
2025-09-30T14:58:46.955525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d389c0-bc102790-206a91d7-c482f32d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:46.953418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896847860963569:9657]
2025-09-30T14:58:46.955539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d389c0-bc102790-206a91d7-c482f32d_0] Write session will restart in 0.005416s
2025-09-30T14:58:46.955568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d389c0-bc102790-206a91d7-c482f32d_0] Write session: Do CDS request
2025-09-30T14:58:46.955574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d389c0-bc102790-206a91d7-c482f32d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:46.961785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d389c0-bc102790-206a91d7-c482f32d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:46.961964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:46.961987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3016
2025-09-30T14:58:46.962111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3016 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:46.962146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3016 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:46.962157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3016 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:46.962160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:46.962619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3016 sessionId:  describe result for acl check
2025-09-30T14:58:46.962663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:46.962671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:46.962672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:46.962679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896847860963591:9555] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:46.963333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896847860963591:9555] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:46.966466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896847860963591:9555] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:46.967574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:46.968990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:46.969184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:46.969199Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:46.969211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:46.969281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:46.969329Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896847771162508:6714]
2025-09-30T14:58:46.969350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896847860963591:9555] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:46.969366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896847860963591:9555] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:46.969370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896847860963591:9555] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:46.969379Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3016 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:46.969975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:46.970283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:46.970335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:46.970670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:46.970739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.970746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.970747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.970748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.970749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.970751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.970752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.970754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.970755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.970756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.970757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.970758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.970759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.970760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.970762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.970767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.970778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.970783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.970788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.970792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.970797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.970801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.970806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.970810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.970815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.970819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.970823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.970828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.970832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.970836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.970846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.970854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:46.970860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.970866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:46.970872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.970877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:46.970882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.970888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:46.970899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.970906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:46.970911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.970917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:46.970922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.970929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:46.970933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.970938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:46.970944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.970953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:46.970959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.970964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:46.970969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.970974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.970981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.970986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.970991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.970996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.971005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.971011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:46.971016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.971022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:46.971070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:46.976576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:46.977480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:46.977497Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:46.977500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:46.977505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:46.977512Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3015 [2:7555896847771162508:6714]
2025-09-30T14:58:46.977530Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:46.977546Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:46.977549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:46.977553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:46.977556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:46.977572Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:46.977580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:46.977588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:46.977649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.977660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.977662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.977667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:46.977670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:46.977738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:46.977747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:46.977759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:46.977773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:46.977790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:46.977813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963576:2454], now have 1 active actors on pipe
2025-09-30T14:58:46.977818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896847860963677:9555], now have 1 active actors on pipe
2025-09-30T14:58:46.977824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896847771162503:6714]
2025-09-30T14:58:46.977828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896847771162503:6714]
2025-09-30T14:58:46.977830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896847771162503:6714]
2025-09-30T14:58:46.977843Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:46.977860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:46.977861Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:46.977868Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:46.977873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:46.977882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:46.977886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:46.977917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896847771162503:6714]
2025-09-30T14:58:46.977930Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:46.977939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3015
2025-09-30T14:58:46.977961Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:46.978019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3015
2025-09-30T14:58:46.978077Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:58:46.978106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.978116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.978138Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5971919-91b8119e-83aad6dd-de4605f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:46.978150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:46.978158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:46.978161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:46.978169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:46.978182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:46.978197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:46.978392Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 23 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:58:46.978437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:58:46.979314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:46.979326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:46.979356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:46.979476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3016 partition: 0 MaxSeqNo: 42 sessionId: src_id|d5971919-91b8119e-83aad6dd-de4605f8_0
2025-09-30T14:58:46.979875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e5d389c0-bc102790-206a91d7-c482f32d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d5971919-91b8119e-83aad6dd-de4605f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:46.982678Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5971919-91b8119e-83aad6dd-de4605f8_0] Write session: try to update token
2025-09-30T14:58:46.982698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5971919-91b8119e-83aad6dd-de4605f8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:46.989938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:46.989963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:46.989974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896847771162503:6714]
2025-09-30T14:58:46.990014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:46.990038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:46.990187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:46.990333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:46.990496Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:46.990650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:46.990847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:46.990892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:46.997383Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3016 sessionId: src_id|d5971919-91b8119e-83aad6dd-de4605f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:47.000211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:47.001234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:47.001269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:47.001297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:47.001301Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:47.001304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:47.001306Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:47.001318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896847771162503:6714]
2025-09-30T14:58:47.001324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896847771162503:6714]
2025-09-30T14:58:47.001331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896847771162503:6714]
2025-09-30T14:58:47.001389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:47.001388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:47.001395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:47.001399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:47.001409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.001412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:47.001558Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:47.052501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896852155930988:9657]
2025-09-30T14:58:47.052872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3015, pipe: [1:7555896852155930988:9657]
2025-09-30T14:58:47.113021Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:47.113339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:47.113377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155930988:9657], now have 1 active actors on pipe
2025-09-30T14:58:47.113671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:47.114123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:47.114167Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896852155930988:9657]
2025-09-30T14:58:47.125526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:47.127430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:47.127662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:47.127673Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:47.127684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:47.127736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:47.127784Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896852066129915:6711]
2025-09-30T14:58:47.128055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:47.128077Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:47.128102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3016 reason: error at write: Disconnected sessionId: src_id|d5971919-91b8119e-83aad6dd-de4605f8_0
2025-09-30T14:58:47.128476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:47.128537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3016 sessionId: src_id|d5971919-91b8119e-83aad6dd-de4605f8_0 is DEAD
2025-09-30T14:58:47.137180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:47.137280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:47.137723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:47.137825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.137826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.137828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.137829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.137830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.137832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.137833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.137835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.137836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.137838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.137852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.137853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.137855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.137856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.137858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.137866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.137877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.137882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.137887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.137891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.137896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.137900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.137904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.137908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.137912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.137916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.137920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.137924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.137928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.137932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.137942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.137951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.137958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.137967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.137974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.137980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.137987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.137993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.137998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.138003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.138007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.138013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.138017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.138022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.138027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.138033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.138038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.138045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.138050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.138054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.138059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.138065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.138070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.138075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.138083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.138087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.138092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.138098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.138103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.138110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.138155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:47.143436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5971919-91b8119e-83aad6dd-de4605f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:47.143455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5971919-91b8119e-83aad6dd-de4605f8_0] Write session will restart in 0.008004s
2025-09-30T14:58:47.143483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5971919-91b8119e-83aad6dd-de4605f8_0] Write session: Do CDS request
2025-09-30T14:58:47.143489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5971919-91b8119e-83aad6dd-de4605f8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:47.144204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:47.145286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:47.145294Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:47.145298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:47.145304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:47.145314Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3016 [2:7555896852066129915:6711]
2025-09-30T14:58:47.145333Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:47.145351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:47.145354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:47.145357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:47.145360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:47.145377Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:47.145387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:47.145395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:47.145459Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.145461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.145463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.145467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:47.145469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:47.145551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:47.145554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.145567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.145579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.145595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:47.145614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155930992:2454], now have 1 active actors on pipe
2025-09-30T14:58:47.145622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896852066129909:6711]
2025-09-30T14:58:47.145624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896852066129909:6711]
2025-09-30T14:58:47.145625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896852066129909:6711]
2025-09-30T14:58:47.145644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:47.145658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:47.145662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:47.145666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:47.145668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:47.145676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:47.145679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:47.145723Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896852066129909:6711]
2025-09-30T14:58:47.145733Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:47.145743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:47.146118Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3016
2025-09-30T14:58:47.152819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5971919-91b8119e-83aad6dd-de4605f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:47.152975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:47.152997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3017
2025-09-30T14:58:47.153132Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3017 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:47.153174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3017 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:47.153185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3017 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:47.153190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:47.153689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3017 sessionId:  describe result for acl check
2025-09-30T14:58:47.153734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:47.153741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:47.153746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:47.153752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896852155931073:9550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:47.154361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896852155931073:9550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:47.158706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:47.158731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:47.158734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:47.158735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:47.158744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896852066129909:6711]
2025-09-30T14:58:47.158749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896852066129909:6711]
2025-09-30T14:58:47.158754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896852066129909:6711]
2025-09-30T14:58:47.158794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:47.158795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:47.158799Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:47.158803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.158805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:47.158811Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:47.158875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896852155931073:9550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:47.158943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:47.165767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896852155931073:9550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:47.165791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896852155931073:9550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:47.165798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896852155931073:9550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:47.165808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3017 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:47.166235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3016
2025-09-30T14:58:47.218216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896852155931110:9657]
2025-09-30T14:58:47.223496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3016, pipe: [1:7555896852155931110:9657]
2025-09-30T14:58:47.277749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:47.278100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931109:9550], now have 1 active actors on pipe
2025-09-30T14:58:47.278130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:47.278136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:47.278171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931110:9657], now have 1 active actors on pipe
2025-09-30T14:58:47.278434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:47.278489Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:47.278509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3017 reason: pipe to partition's 0 tablet is dead #2 sessionId: 
2025-09-30T14:58:47.278715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3017 sessionId:  is DEAD
2025-09-30T14:58:47.278885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896852155931110:9657]
2025-09-30T14:58:47.278965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:47.283361Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5971919-91b8119e-83aad6dd-de4605f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-09-30T14:58:47.283381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5971919-91b8119e-83aad6dd-de4605f8_0] Write session will restart in 0.010015s
2025-09-30T14:58:47.283417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5971919-91b8119e-83aad6dd-de4605f8_0] Write session: Do CDS request
2025-09-30T14:58:47.283424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5971919-91b8119e-83aad6dd-de4605f8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:47.295539Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5971919-91b8119e-83aad6dd-de4605f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:47.295745Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:47.295763Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3018
2025-09-30T14:58:47.295877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3018 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:47.295903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3018 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:47.295908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3018 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:47.295913Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:47.297037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3018 sessionId:  describe result for acl check
2025-09-30T14:58:47.297075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:47.297078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:47.297080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:47.297086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896852155931173:9539] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:47.297625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896852155931173:9539] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:47.302527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896852155931173:9539] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:47.305841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:47.312608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:47.312871Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:47.312875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:47.312886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:47.312939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:47.312981Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896852066130024:6709]
2025-09-30T14:58:47.313620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:47.314072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:47.314235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:47.314573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:47.314632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.314633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.314634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.314635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.314637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.314638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.314639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.314640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.314641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.314642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.314644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.314645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.314646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.314647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.314648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.314653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.314664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.314668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.314671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.314676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.314680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.314684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.314687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.314691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.314695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.314698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.314702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.314705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.314708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.314713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.314721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.314729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.314737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.314742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.314746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.314751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.314756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.314761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.314766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.314771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.314775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.314780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.314785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.314789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.314793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.314798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.314803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.314808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.314812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.314817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.314821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.314827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.314832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.314836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.314841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.314846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.314850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.314855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.314861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.314868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.314906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:47.315708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896852155931173:9539] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:47.315746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896852155931173:9539] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:47.315750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896852155931173:9539] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:47.315759Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3018 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:47.327930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:47.328962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:47.328970Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:47.328972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:47.328977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:47.328984Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3017 [2:7555896852066130024:6709]
2025-09-30T14:58:47.329003Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:47.329021Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:47.329025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:47.329029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:47.329031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:47.329048Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:47.329056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:47.329067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:47.329137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.329139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.329141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.329145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:47.329148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:47.329226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:47.329228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.329241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.329253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.329269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:47.329288Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896852066130018:6709]
2025-09-30T14:58:47.329289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896852066130018:6709]
2025-09-30T14:58:47.329291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896852066130018:6709]
2025-09-30T14:58:47.329300Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:47.329313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:47.329326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:47.329329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:47.329368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896852066130018:6709]
2025-09-30T14:58:47.329370Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:47.329397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:47.329400Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:47.329402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:47.329408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:47.329443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931225:9539], now have 1 active actors on pipe
2025-09-30T14:58:47.329447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931113:2454], now have 1 active actors on pipe
2025-09-30T14:58:47.330162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3017
2025-09-30T14:58:47.330208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3017
2025-09-30T14:58:47.335352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:47.335382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:47.335419Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:47.335435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:47.335447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:47.335451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:47.335465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:47.335485Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:47.335504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:47.335969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:47.335980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:47.335999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:47.339373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3018 partition: 0 MaxSeqNo: 42 sessionId: src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0
2025-09-30T14:58:47.339789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5971919-91b8119e-83aad6dd-de4605f8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:47.342673Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0] Write session: try to update token
2025-09-30T14:58:47.342696Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:47.355368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:47.355395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:47.355399Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:47.355401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:47.355411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896852066130018:6709]
2025-09-30T14:58:47.355422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896852066130018:6709]
2025-09-30T14:58:47.355427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896852066130018:6709]
2025-09-30T14:58:47.355477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:47.355492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.355496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:47.355650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:47.359310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:47.359337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:47.359341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:47.375395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3018 sessionId: src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:47.378379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:47.382322Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896852155931237:9657]
2025-09-30T14:58:47.390465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3017, pipe: [1:7555896852155931237:9657]
2025-09-30T14:58:47.483704Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:47.484128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:47.484137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:47.484157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931237:9657], now have 1 active actors on pipe
2025-09-30T14:58:47.484946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896852155931237:9657]
2025-09-30T14:58:47.484980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:47.484983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:47.485042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3018 reason: error at write: Disconnected sessionId: src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0
2025-09-30T14:58:47.485357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:47.485366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0] Write session will restart in 0.007256s
2025-09-30T14:58:47.485391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0] Write session: Do CDS request
2025-09-30T14:58:47.485397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:47.485485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3018 sessionId: src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0 is DEAD
2025-09-30T14:58:47.485677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:47.486448Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:47.494926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:47.495937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:47.495955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3019
2025-09-30T14:58:47.496160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3019 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:47.496196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3019 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:47.496202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3019 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:47.496208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:47.497249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3019 sessionId:  describe result for acl check
2025-09-30T14:58:47.497285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:47.497287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:47.497289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:47.497295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896852155931268:9535] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:47.497696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896852155931268:9535] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:47.502526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896852155931268:9535] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:47.512762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896852155931268:9535] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:47.512784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896852155931268:9535] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:47.512788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896852155931268:9535] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:47.512798Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3019 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:47.512973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:47.515199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:47.515481Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:47.515500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:47.515515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:47.515596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:47.515645Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896852066130160:6708]
2025-09-30T14:58:47.516327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:47.517117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:47.517177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:47.517566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:47.517641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.517642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.517644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.517645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.517647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.517648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.517649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.517651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.517652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.517653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.517655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.517656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.517657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.517658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.517659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.517667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.517677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.517681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.517686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.517691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.517696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.517700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.517705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.517710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.517715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.517720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.517724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.517729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.517734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.517738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.517749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.517758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.517765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.517772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.517778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.517784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.517790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.517796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.517806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.517812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.517816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.517822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.517828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.517834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.517840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.517845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.517850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.517857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.517861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.517867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.517872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.517878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.517883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.517887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.517893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.517899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.517905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.517911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.517916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.517923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.517970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:47.523907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:47.525060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:47.525086Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:47.525089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:47.525093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:47.525101Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3018 [2:7555896852066130160:6708]
2025-09-30T14:58:47.525117Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:47.525133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:47.525140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:47.525143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:47.525145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:47.525161Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:47.525170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:47.525182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:47.525244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.525252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.525254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.525258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:47.525260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:47.525330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:47.525338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.525353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.525371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.525392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:47.525410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896852066130153:6708]
2025-09-30T14:58:47.525417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896852066130153:6708]
2025-09-30T14:58:47.525419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896852066130153:6708]
2025-09-30T14:58:47.525434Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:47.525453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:47.525469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:47.525472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:47.525477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:47.525480Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:47.525482Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:47.525507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896852066130153:6708]
2025-09-30T14:58:47.525514Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:47.525567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:47.525920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931358:9535], now have 1 active actors on pipe
2025-09-30T14:58:47.525934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931240:2454], now have 1 active actors on pipe
2025-09-30T14:58:47.526306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3018
2025-09-30T14:58:47.526339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3018
2025-09-30T14:58:47.529144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:47.529162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:47.529199Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:47.529211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:47.529216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:47.529219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:47.529231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:47.529247Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:47.529265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:47.529947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3019 partition: 0 MaxSeqNo: 42 sessionId: src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0
2025-09-30T14:58:47.529741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:47.529759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:47.529780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:47.531591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f54b5e21-59b9e590-1fc3abf1-254284d4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:47.534661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0] Write session: try to update token
2025-09-30T14:58:47.534683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:47.543174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:47.543196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:47.543200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:47.543202Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:47.543211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896852066130153:6708]
2025-09-30T14:58:47.543214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896852066130153:6708]
2025-09-30T14:58:47.543218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896852066130153:6708]
2025-09-30T14:58:47.543278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:47.543285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.543287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:47.543439Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:47.545423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:47.545441Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:47.545446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:47.564820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3019 sessionId: src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:47.567640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:47.584977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896852155931380:9657]
2025-09-30T14:58:47.585328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3018, pipe: [1:7555896852155931380:9657]
2025-09-30T14:58:47.664945Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:47.665434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:47.665446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:47.665468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931380:9657], now have 1 active actors on pipe
2025-09-30T14:58:47.665764Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:47.666116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:47.666139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:47.666203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3019 reason: error at write: Disconnected sessionId: src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0
2025-09-30T14:58:47.666607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:47.666620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0] Write session will restart in 0.005011s
2025-09-30T14:58:47.666643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0] Write session: Do CDS request
2025-09-30T14:58:47.666650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:47.666272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896852155931380:9657]
2025-09-30T14:58:47.666299Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:47.666392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3019 sessionId: src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0 is DEAD
2025-09-30T14:58:47.675823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:47.677103Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:47.677122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3020
2025-09-30T14:58:47.677709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3020 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:47.677744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3020 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:47.677749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3020 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:47.677753Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:47.678660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3020 sessionId:  describe result for acl check
2025-09-30T14:58:47.678693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:47.678696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:47.678697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:47.678704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896852155931402:9511] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:47.679846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896852155931402:9511] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:47.685002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896852155931402:9511] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:47.690966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896852155931402:9511] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:47.690987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896852155931402:9511] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:47.690990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896852155931402:9511] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:47.690999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3020 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:47.720552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:47.724012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:47.724299Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:47.724303Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:47.724315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:47.724376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:47.724416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896852066130295:6683]
2025-09-30T14:58:47.725153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:47.725687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:47.725746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:47.726116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:47.726388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.726389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.726390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.726392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.726394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.726396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.726397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.726398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.726400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.726401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.726403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.726404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.726406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.726407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.726408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.726416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.726428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.726433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.726438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.726443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.726447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.726452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.726458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.726463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.726468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.726473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.726478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.726482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.726487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.726492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.726504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.726514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.726521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.726528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.726537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.726543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.726550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.726557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.726577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.726583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.726588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.726594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.726600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.726605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.726611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.726618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.726624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.726630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.726635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.726642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.726647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.726653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.726668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.726674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.726680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.726685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.726689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.726695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.726703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.726708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.726753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:47.733563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:47.734607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:47.734629Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:47.734632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:47.734636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:47.734643Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3019 [2:7555896852066130295:6683]
2025-09-30T14:58:47.734661Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:47.734678Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:47.734681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:47.734689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:47.734691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:47.734708Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:47.734716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:47.734723Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:47.734786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.734789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.734791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.734797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:47.734799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:47.734865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:47.734868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.734883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.734897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.734914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:47.734931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896852066130290:6683]
2025-09-30T14:58:47.734934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896852066130290:6683]
2025-09-30T14:58:47.734936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896852066130290:6683]
2025-09-30T14:58:47.734953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:47.734967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:47.734982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:47.734985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:47.735022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896852066130290:6683]
2025-09-30T14:58:47.735032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:47.735273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:47.735283Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:47.735284Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:47.735289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:47.736219Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3019
2025-09-30T14:58:47.736270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3019
2025-09-30T14:58:47.736952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931442:9511], now have 1 active actors on pipe
2025-09-30T14:58:47.736967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931394:2454], now have 1 active actors on pipe
2025-09-30T14:58:47.738420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:47.738440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:47.738475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:47.738486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:47.738495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:47.738501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:47.738514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:47.738531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:47.738550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:47.739138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:47.739152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:47.739171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:47.739363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3020 partition: 0 MaxSeqNo: 42 sessionId: src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0
2025-09-30T14:58:47.739780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d080c62f-b6356cd7-1c048ac6-bf60d7ce_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:47.742776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0] Write session: try to update token
2025-09-30T14:58:47.742801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:47.750849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:47.750874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:47.750876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:47.750877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:47.750886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896852066130290:6683]
2025-09-30T14:58:47.750891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896852066130290:6683]
2025-09-30T14:58:47.750896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896852066130290:6683]
2025-09-30T14:58:47.750939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:47.750946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.750948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:47.751094Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:47.754397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:47.754418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:47.754422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:47.761812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3020 sessionId: src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:47.764618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:47.766711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896852155931514:9657]
2025-09-30T14:58:47.767288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3019, pipe: [1:7555896852155931514:9657]
2025-09-30T14:58:47.868468Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:47.868867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:47.868882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:47.868924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931514:9657], now have 1 active actors on pipe
2025-09-30T14:58:47.869333Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:47.870350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:47.870362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0] Write session will restart in 0.006591s
2025-09-30T14:58:47.870387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0] Write session: Do CDS request
2025-09-30T14:58:47.870392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:47.869669Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896852155931514:9657]
2025-09-30T14:58:47.869707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:47.869800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3020 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0
2025-09-30T14:58:47.870018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3020 sessionId: src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0 is DEAD
2025-09-30T14:58:47.870164Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:47.877826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:47.877922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:47.877945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3021
2025-09-30T14:58:47.878113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3021 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:47.878149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3021 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:47.878154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3021 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:47.878159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:47.878679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3021 sessionId:  describe result for acl check
2025-09-30T14:58:47.878719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:47.878722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:47.878723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:47.878729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896852155931533:9512] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:47.879333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896852155931533:9512] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:47.883471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896852155931533:9512] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:47.888161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896852155931533:9512] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:47.888182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896852155931533:9512] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:47.888186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896852155931533:9512] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:47.888195Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3021 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:47.891132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:47.893298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:47.893733Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:47.893749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:47.893765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:47.893847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:47.893896Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896852066130406:6681]
2025-09-30T14:58:47.894588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:47.895093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:47.895166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:47.895589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:47.895664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.895671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.895673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.895675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.895676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.895678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.895680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.895682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.895683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.895684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.895686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.895687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.895689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.895690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.895691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.895697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.895709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.895714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.895718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.895723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.895727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.895732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.895737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.895741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.895746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.895750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.895754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.895759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.895763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.895767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.895777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.895786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:47.895794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.895800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:47.895805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.895822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:47.895828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.895834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:47.895842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.895848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:47.895854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.895860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:47.895865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.895870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:47.895875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.895881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:47.895892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.895897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:47.895914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.895923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:47.895929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.895939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.895944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.895949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.895955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.895965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.895970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.895976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:47.895984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.895990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:47.896036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:47.902407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:47.903409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:47.903425Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:47.903429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:47.903433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:47.903440Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3020 [2:7555896852066130406:6681]
2025-09-30T14:58:47.903457Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:47.903474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:47.903478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:47.903481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:47.903535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:47.903562Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:47.903568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:47.903575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:47.903640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.903648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.903650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.903654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:47.903656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:47.903734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:47.903736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.903753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:47.903773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:47.903792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:47.903808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896852066130401:6681]
2025-09-30T14:58:47.903811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896852066130401:6681]
2025-09-30T14:58:47.903812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896852066130401:6681]
2025-09-30T14:58:47.903821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:47.903831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:47.903834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:47.903835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:47.903838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:47.903847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:47.903850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:47.903858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931631:9512], now have 1 active actors on pipe
2025-09-30T14:58:47.903862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931521:2454], now have 1 active actors on pipe
2025-09-30T14:58:47.903897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896852066130401:6681]
2025-09-30T14:58:47.903903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:47.903950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:47.904108Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3020
2025-09-30T14:58:47.904112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3020
2025-09-30T14:58:47.904176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:47.904184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:47.904222Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:47.904229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:47.904232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:47.904234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:47.904243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:47.904253Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:47.904268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:47.904485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:47.904495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:47.904511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:47.904692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3021 partition: 0 MaxSeqNo: 42 sessionId: src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0
2025-09-30T14:58:47.907651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e5c0a05-23147eb6-33ccaa94-479feee6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:47.910681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0] Write session: try to update token
2025-09-30T14:58:47.910703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:47.922317Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:47.922337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:47.922340Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:47.922342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:47.922353Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896852066130401:6681]
2025-09-30T14:58:47.922358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896852066130401:6681]
2025-09-30T14:58:47.922363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896852066130401:6681]
2025-09-30T14:58:47.922405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:47.922414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:47.922417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:47.922418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:47.922425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:47.922430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:47.922569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:47.939875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3021 sessionId: src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:47.942739Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:47.970113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896852155931646:9657]
2025-09-30T14:58:47.970626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3020, pipe: [1:7555896852155931646:9657]
2025-09-30T14:58:48.044701Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:48.045070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.045086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.045108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896852155931646:9657], now have 1 active actors on pipe
2025-09-30T14:58:48.045335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:48.045365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896852155931646:9657]
2025-09-30T14:58:48.045390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:48.045406Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:48.045506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3021 reason: error at write: Disconnected sessionId: src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0
2025-09-30T14:58:48.045725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3021 sessionId: src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0 is DEAD
2025-09-30T14:58:48.045859Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:48.045869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0] Write session will restart in 0.008874s
2025-09-30T14:58:48.045905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0] Write session: Do CDS request
2025-09-30T14:58:48.045912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:48.046223Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:48.055895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:48.056095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:48.056115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3022
2025-09-30T14:58:48.056240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3022 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:48.056275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3022 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:48.056286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3022 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:48.056291Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:48.056802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3022 sessionId:  describe result for acl check
2025-09-30T14:58:48.056842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:48.056852Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:48.056854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:48.056860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896856450899019:9508] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:48.057032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:48.057473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896856450899019:9508] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:48.059286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:48.059587Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:48.059598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:48.059611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:48.059706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:48.059755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896856361097813:6675]
2025-09-30T14:58:48.059893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896856450899019:9508] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:48.060413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:48.060763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:48.060839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:48.061218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:48.061295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.061297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.061298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.061299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.061301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.061302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.061303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.061304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.061306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.061307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.061308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.061309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.061310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.061311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.061312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.061318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.061328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.061332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.061336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.061341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.061346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.061351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.061355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.061359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.061363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.061367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.061371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.061375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.061379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.061382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.061391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.061399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.061405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.061410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.061415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.061421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.061425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.061430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.061437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.061442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.061447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.061452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.061457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.061462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.061466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.061471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.061476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.061482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.061486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.061491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.061497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.061502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.061507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.061511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.061516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.061520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.061524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.061530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.061534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.061539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.061588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:48.067287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896856450899019:9508] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:48.067311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896856450899019:9508] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:48.067314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896856450899019:9508] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:48.067324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3022 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:48.069338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:48.070362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:48.070381Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:48.070384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:48.070389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:48.070397Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3021 [2:7555896856361097813:6675]
2025-09-30T14:58:48.070415Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:48.070432Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:48.070440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:48.070447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:48.070449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:48.070465Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:48.070476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:48.070484Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:48.070558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.070568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.070571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.070574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:48.070577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:48.070642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:48.070651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.070665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.070681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.070702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:48.070725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896856361097807:6675]
2025-09-30T14:58:48.070732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896856361097807:6675]
2025-09-30T14:58:48.070733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896856361097807:6675]
2025-09-30T14:58:48.070743Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:48.070755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:48.070758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:48.070761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:48.070761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:48.070835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3021
2025-09-30T14:58:48.070847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3021
2025-09-30T14:58:48.071444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3022 partition: 0 MaxSeqNo: 42 sessionId: src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0
2025-09-30T14:58:48.071809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5e87fdcb-74832e9b-912a1c27-bb0c1ed8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:48.074779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0] Write session: try to update token
2025-09-30T14:58:48.074804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:48.070778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:48.070789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:48.070799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450898944:2454], now have 1 active actors on pipe
2025-09-30T14:58:48.070803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899059:9508], now have 1 active actors on pipe
2025-09-30T14:58:48.070841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896856361097807:6675]
2025-09-30T14:58:48.070852Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:48.070890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:48.070975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.070980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.071016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:48.071023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:48.071028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:48.071031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:48.071041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:48.071051Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:48.071064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:48.071311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.071319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.071343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:48.083665Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:48.083684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:48.083687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:48.083689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:48.083698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896856361097807:6675]
2025-09-30T14:58:48.083705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896856361097807:6675]
2025-09-30T14:58:48.083710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896856361097807:6675]
2025-09-30T14:58:48.083750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:48.083756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.083759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:48.083905Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:48.085381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:48.085396Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:48.085402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:48.091201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3022 sessionId: src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:48.094089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:48.145569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896856450899069:9657]
2025-09-30T14:58:48.145909Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3021, pipe: [1:7555896856450899069:9657]
2025-09-30T14:58:48.203014Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:48.203481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.203500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.203520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899069:9657], now have 1 active actors on pipe
2025-09-30T14:58:48.203999Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:48.205459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:48.205525Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896856450899069:9657]
2025-09-30T14:58:48.205552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:48.205630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3022 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0
2025-09-30T14:58:48.205812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3022 sessionId: src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0 is DEAD
2025-09-30T14:58:48.206151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:48.206164Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0] Write session will restart in 0.008350s
2025-09-30T14:58:48.206187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0] Write session: Do CDS request
2025-09-30T14:58:48.206192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:48.215752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:48.216776Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:48.216795Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3023
2025-09-30T14:58:48.216944Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3023 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:48.216981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3023 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:48.216987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3023 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:48.216991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:48.217381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3023 sessionId:  describe result for acl check
2025-09-30T14:58:48.217408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:48.217412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:48.217413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:48.217420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896856450899146:9498] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:48.217971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896856450899146:9498] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:48.217338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:48.219331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:48.219564Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:48.219575Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:48.219586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:48.219645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:48.219684Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896856361097928:6676]
2025-09-30T14:58:48.220312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:48.220653Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896856450899146:9498] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:48.221186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:48.221246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:48.221630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:48.221711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.221718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.221719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.221721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.221722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.221724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.221725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.221727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.221729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.221730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.221732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.221733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.221735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.221736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.221738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.221744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.221753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.221757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.221761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.221765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.221770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.221775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.221780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.221784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.221788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.221792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.221795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.221798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.221802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.221806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.221816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.221825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.221830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.221836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.221840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.221853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.221859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.221864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.221868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.221873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.221879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.221883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.221889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.221894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.221900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.221906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.221911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.221918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.221923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.221929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.221934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.221939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.221944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.221949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.221955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.221961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.221966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.221972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.221978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.221984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.222038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:48.227334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896856450899146:9498] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:48.227355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896856450899146:9498] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:48.227359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896856450899146:9498] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:48.227368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3023 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:48.227673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:48.228790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:48.228805Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:48.228808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:48.228814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:48.228820Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3022 [2:7555896856361097928:6676]
2025-09-30T14:58:48.228836Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:48.228849Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:48.228851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:48.228854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:48.228856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:48.228872Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:48.228878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:48.228885Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:48.228939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.228947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.228949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.228952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:48.228954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:48.229028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:48.229036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.229048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.229058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.229078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:48.229103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899073:2454], now have 1 active actors on pipe
2025-09-30T14:58:48.229106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899186:9498], now have 1 active actors on pipe
2025-09-30T14:58:48.229112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896856361097922:6676]
2025-09-30T14:58:48.229113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896856361097922:6676]
2025-09-30T14:58:48.229116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896856361097922:6676]
2025-09-30T14:58:48.229130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:48.229147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:48.229154Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:48.229158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:48.229160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:48.229166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:48.229169Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:48.229175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3022
2025-09-30T14:58:48.229202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896856361097922:6676]
2025-09-30T14:58:48.229209Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:48.229217Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3022
2025-09-30T14:58:48.229217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:48.229246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.229256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.229280Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e705b807-8ccc67ae-38238f73-c26e3373_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:48.229291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:48.229294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:48.229296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:48.229305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:48.229317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:48.229334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:48.229537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.229552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.229577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:48.229711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3023 partition: 0 MaxSeqNo: 42 sessionId: src_id|e705b807-8ccc67ae-38238f73-c26e3373_0
2025-09-30T14:58:48.230061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ca9d16-fced4f8a-eb4958e0-e70060bc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e705b807-8ccc67ae-38238f73-c26e3373_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:48.232960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e705b807-8ccc67ae-38238f73-c26e3373_0] Write session: try to update token
2025-09-30T14:58:48.232981Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e705b807-8ccc67ae-38238f73-c26e3373_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:48.242974Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:48.242996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:48.243007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896856361097922:6676]
2025-09-30T14:58:48.243056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:48.243274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:48.243440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:48.243599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:48.243757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:48.243984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:48.244038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:48.244406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:48.250304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3023 sessionId: src_id|e705b807-8ccc67ae-38238f73-c26e3373_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:48.253527Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:48.254681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.254707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.254730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:48.254734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:48.254736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:48.254738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:48.254747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896856361097922:6676]
2025-09-30T14:58:48.254754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896856361097922:6676]
2025-09-30T14:58:48.254758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896856361097922:6676]
2025-09-30T14:58:48.254811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:48.254824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.254826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:48.254830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:48.254835Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:48.254849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:48.254964Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:48.307402Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896856450899195:9657]
2025-09-30T14:58:48.307806Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3022, pipe: [1:7555896856450899195:9657]
2025-09-30T14:58:48.375661Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:48.376112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:48.376164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899195:9657], now have 1 active actors on pipe
2025-09-30T14:58:48.376454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:48.376576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:48.376587Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:48.376657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3023 reason: error at write: Disconnected sessionId: src_id|e705b807-8ccc67ae-38238f73-c26e3373_0
2025-09-30T14:58:48.376747Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:48.376800Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896856450899195:9657]
2025-09-30T14:58:48.376810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3023 sessionId: src_id|e705b807-8ccc67ae-38238f73-c26e3373_0 is DEAD
2025-09-30T14:58:48.376998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e705b807-8ccc67ae-38238f73-c26e3373_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:48.377008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e705b807-8ccc67ae-38238f73-c26e3373_0] Write session will restart in 0.006998s
2025-09-30T14:58:48.377031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e705b807-8ccc67ae-38238f73-c26e3373_0] Write session: Do CDS request
2025-09-30T14:58:48.377036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e705b807-8ccc67ae-38238f73-c26e3373_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:48.385011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e705b807-8ccc67ae-38238f73-c26e3373_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:48.385222Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:48.385250Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3024
2025-09-30T14:58:48.385394Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3024 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:48.385439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3024 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:48.385445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3024 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:48.385449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:48.385932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3024 sessionId:  describe result for acl check
2025-09-30T14:58:48.385971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:48.385979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:48.385980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:48.385986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896856450899256:9491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:48.386571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896856450899256:9491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:48.389705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896856450899256:9491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:48.390634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:48.392174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:48.392392Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:48.392404Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:48.392415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:48.392477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:48.392522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896856361098054:6670]
2025-09-30T14:58:48.393132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:48.393280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896856450899256:9491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:48.393308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896856450899256:9491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:48.393313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896856450899256:9491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:48.393321Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3024 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:48.393514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:48.393562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:48.393908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:48.393990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.393996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.393997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.393999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.394000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.394001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.394002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.394004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.394005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.394006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.394007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.394008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.394009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.394011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.394012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.394019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.394029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.394032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.394036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.394040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.394044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.394048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.394052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.394056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.394060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.394064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.394067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.394071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.394075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.394078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.394088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.394095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.394101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.394107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.394112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.394117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.394121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.394126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.394130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.394135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.394139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.394144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.394148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.394152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.394157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.394162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.394167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.394172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.394175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.394180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.394184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.394188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.394192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.394197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.394202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.394207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.394211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.394216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.394220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.394225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.394267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:48.400453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:48.401615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:48.401634Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:48.401638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:48.401642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:48.401653Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3023 [2:7555896856361098054:6670]
2025-09-30T14:58:48.401672Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:48.401691Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:48.401694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:48.401697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:48.401699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:48.401717Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:48.401731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:48.401742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:48.401817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.401825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.401828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.401831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:48.401834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:48.401913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:48.401921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.401937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.401951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.401971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:48.401993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896856361098041:6670]
2025-09-30T14:58:48.402000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896856361098041:6670]
2025-09-30T14:58:48.402002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896856361098041:6670]
2025-09-30T14:58:48.402014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:48.402091Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3023
2025-09-30T14:58:48.402136Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3023
2025-09-30T14:58:48.402027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:48.402029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899203:2454], now have 1 active actors on pipe
2025-09-30T14:58:48.402033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899318:9491], now have 1 active actors on pipe
2025-09-30T14:58:48.402035Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:48.402037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:48.402041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:48.402057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:48.402060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:48.402097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896856361098041:6670]
2025-09-30T14:58:48.402105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:48.402117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:48.403354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.403370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.403401Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:48.403427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:48.403438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:48.403441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:48.403454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:48.403470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:48.403488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:48.403778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.403788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.403804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:48.403951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3024 partition: 0 MaxSeqNo: 42 sessionId: src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0
2025-09-30T14:58:48.404362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e705b807-8ccc67ae-38238f73-c26e3373_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:48.407362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0] Write session: try to update token
2025-09-30T14:58:48.407386Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:48.414835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:48.414854Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:48.414865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896856361098041:6670]
2025-09-30T14:58:48.414915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:48.414923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:48.415137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:48.415334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:48.415520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:48.415707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:48.415961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:48.416004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:48.426955Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:48.426978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:48.426986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:48.426989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:48.426999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896856361098041:6670]
2025-09-30T14:58:48.427003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896856361098041:6670]
2025-09-30T14:58:48.427007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896856361098041:6670]
2025-09-30T14:58:48.427051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:48.427060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.427063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:48.427074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:48.427082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:48.427098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:48.427208Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:48.427800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3024 sessionId: src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:48.430707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:48.476881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896856450899327:9657]
2025-09-30T14:58:48.477321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3023, pipe: [1:7555896856450899327:9657]
2025-09-30T14:58:48.547804Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:48.548372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.548385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.548408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899327:9657], now have 1 active actors on pipe
2025-09-30T14:58:48.548815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:48.548881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:48.548888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:48.548971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3024 reason: error at write: Disconnected sessionId: src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0
2025-09-30T14:58:48.549174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3024 sessionId: src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0 is DEAD
2025-09-30T14:58:48.549618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:48.549626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0] Write session will restart in 0.009615s
2025-09-30T14:58:48.549651Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0] Write session: Do CDS request
2025-09-30T14:58:48.549657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:48.549242Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896856450899327:9657]
2025-09-30T14:58:48.549567Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:48.561983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:48.562360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:48.562381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3025
2025-09-30T14:58:48.563153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3025 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:48.563192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3025 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:48.563198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3025 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:48.563201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:48.563904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3025 sessionId:  describe result for acl check
2025-09-30T14:58:48.563938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:48.563940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:48.563942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:48.563949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896856450899344:9484] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:48.564497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896856450899344:9484] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:48.568930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896856450899344:9484] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:48.574758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896856450899344:9484] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:48.574779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896856450899344:9484] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:48.574783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896856450899344:9484] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:48.574794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3025 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:48.590524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:48.595596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:48.595848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:48.595853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:48.595864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:48.595924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:48.595961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896856361098183:6656]
2025-09-30T14:58:48.596718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:48.597963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:48.598042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:48.598443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:48.598511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.598512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.598514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.598515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.598516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.598518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.598519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.598521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.598523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.598524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.598526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.598527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.598529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.598530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.598531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.598538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.598551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.598555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.598560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.598564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.598569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.598574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.598578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.598583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.598590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.598595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.598599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.598604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.598609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.598614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.598624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.598634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.598640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.598647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.598652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.598658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.598663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.598668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.598674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.598680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.598685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.598691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.598696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.598702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.598707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.598713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.598719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.598725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.598730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.598736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.598741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.598747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.598752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.598759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.598764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.598773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.598778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.598784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.598789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.598795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.598846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:48.605435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:48.606482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:48.606490Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:48.606493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:48.606497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:48.606504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3024 [2:7555896856361098183:6656]
2025-09-30T14:58:48.606521Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:48.606537Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:48.606540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:48.606543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:48.606545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:48.606563Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:48.606571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:48.606579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:48.606648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.606651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.606652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.606655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:48.606658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:48.606740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:48.606743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.606757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.606768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.606785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:48.606803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896856361098177:6656]
2025-09-30T14:58:48.606806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896856361098177:6656]
2025-09-30T14:58:48.606808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896856361098177:6656]
2025-09-30T14:58:48.606822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:48.606836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:48.606851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:48.606853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:48.606893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896856361098177:6656]
2025-09-30T14:58:48.606896Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:48.607267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:48.607274Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:48.607276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:48.607282Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:48.610075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3024
2025-09-30T14:58:48.610121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3024
2025-09-30T14:58:48.609858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899329:2454], now have 1 active actors on pipe
2025-09-30T14:58:48.609875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899392:9484], now have 1 active actors on pipe
2025-09-30T14:58:48.610364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.610372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.610403Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:48.610415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:48.610419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:48.610422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:48.610435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:48.610451Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:48.610469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:48.610932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.610937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.610953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:48.611100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3025 partition: 0 MaxSeqNo: 42 sessionId: src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0
2025-09-30T14:58:48.611573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d4f5aaf-8a66c13d-7b4d44d3-33195922_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:48.614761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0] Write session: try to update token
2025-09-30T14:58:48.614795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:48.630753Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:48.630773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:48.630775Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:48.630778Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:48.630786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896856361098177:6656]
2025-09-30T14:58:48.630791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896856361098177:6656]
2025-09-30T14:58:48.630796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896856361098177:6656]
2025-09-30T14:58:48.630839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:48.630847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.630850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:48.631012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:48.635417Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:48.635430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:48.635435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:48.648903Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896856450899487:9657]
2025-09-30T14:58:48.649421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3024, pipe: [1:7555896856450899487:9657]
2025-09-30T14:58:48.655594Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3025 sessionId: src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:48.658815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:48.774730Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:48.775059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899487:9657], now have 1 active actors on pipe
2025-09-30T14:58:48.775121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.775128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.775969Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:48.775517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:48.775522Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:48.775537Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:48.775582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896856450899487:9657]
2025-09-30T14:58:48.775617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3025 reason: error at write: Disconnected sessionId: src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0
2025-09-30T14:58:48.775835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3025 sessionId: src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0 is DEAD
2025-09-30T14:58:48.783364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:48.783382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0] Write session will restart in 0.008544s
2025-09-30T14:58:48.783413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0] Write session: Do CDS request
2025-09-30T14:58:48.783422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:48.793981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:48.795800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:48.795919Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:48.795939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3026
2025-09-30T14:58:48.796074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3026 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:48.796109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3026 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:48.796121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3026 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:48.796126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:48.796307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:48.796530Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:48.796535Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:48.796546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:48.796600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:48.796641Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896856361098326:6648]
2025-09-30T14:58:48.797354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:48.796649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3026 sessionId:  describe result for acl check
2025-09-30T14:58:48.796687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:48.796690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:48.796695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:48.796713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896856450899573:9465] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:48.797305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896856450899573:9465] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:48.799475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:48.800210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896856450899573:9465] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:48.799552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:48.800153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:48.800232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.800234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.800235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.800237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.800239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.800241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.800242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.800244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.800246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.800248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.800249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.800252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.800254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.800255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.800256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.800264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.800276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.800281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.800286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.800291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.800296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.800301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.800306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.800310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.800315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.800320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.800325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.800329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.800334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.800339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.800367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.800377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.800384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.800390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.800396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.800402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.800406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.800413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.800419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.800425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.800430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.800436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.800442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.800449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.800454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.800460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.800466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.800472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.800477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.800482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.800488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.800493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.800499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.800505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.800513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.800519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.800524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.800531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.800535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.800541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.800595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:48.806501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896856450899573:9465] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:48.806523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896856450899573:9465] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:48.806527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896856450899573:9465] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:48.806539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3026 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:48.807396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:48.808612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:48.808622Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:48.808626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:48.808630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:48.808638Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3025 [2:7555896856361098326:6648]
2025-09-30T14:58:48.808656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:48.808673Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:48.808678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:48.808682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:48.808684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:48.808721Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:48.808728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:48.808735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:48.808796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.808799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.808801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.808805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:48.808808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:48.808885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:48.808888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.808903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.808917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.808937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:48.808959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899610:9465], now have 1 active actors on pipe
2025-09-30T14:58:48.808966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896856361098320:6648]
2025-09-30T14:58:48.808969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896856361098320:6648]
2025-09-30T14:58:48.808971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896856361098320:6648]
2025-09-30T14:58:48.808985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:48.808995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899491:2454], now have 1 active actors on pipe
2025-09-30T14:58:48.809004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:48.809012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:48.809016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:48.809076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3025
2025-09-30T14:58:48.809124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3025
2025-09-30T14:58:48.809019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:48.809021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:48.809025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:48.809060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896856361098320:6648]
2025-09-30T14:58:48.809072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:48.809080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:48.809250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.809265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.809295Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fedd2854-f40111d6-d24325da-6d347fc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:48.809303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:48.809308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:48.809318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:48.809332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:48.809345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:48.809362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:48.809794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.809808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.809843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:48.809995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3026 partition: 0 MaxSeqNo: 42 sessionId: src_id|fedd2854-f40111d6-d24325da-6d347fc3_0
2025-09-30T14:58:48.810477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a34ff986-a2b8fca9-1f9bca16-a444c88e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fedd2854-f40111d6-d24325da-6d347fc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:48.813577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd2854-f40111d6-d24325da-6d347fc3_0] Write session: try to update token
2025-09-30T14:58:48.813605Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd2854-f40111d6-d24325da-6d347fc3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:48.823031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:48.823050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:48.823061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896856361098320:6648]
2025-09-30T14:58:48.823115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:48.823120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:48.823332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:48.823480Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:48.823641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:48.823795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:48.823995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:48.824027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:48.835322Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:48.835339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:48.835342Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:48.835344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:48.835359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896856361098320:6648]
2025-09-30T14:58:48.835364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896856361098320:6648]
2025-09-30T14:58:48.835368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896856361098320:6648]
2025-09-30T14:58:48.835412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:48.835419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.835418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:48.835425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:48.835425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:48.835429Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:48.835566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:48.842241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3026 sessionId: src_id|fedd2854-f40111d6-d24325da-6d347fc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:48.845279Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:48.875750Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896856450899619:9657]
2025-09-30T14:58:48.878048Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3025, pipe: [1:7555896856450899619:9657]
2025-09-30T14:58:48.962345Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:48.963058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.963076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.963101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899619:9657], now have 1 active actors on pipe
2025-09-30T14:58:48.963387Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:48.963833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd2854-f40111d6-d24325da-6d347fc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:48.963845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd2854-f40111d6-d24325da-6d347fc3_0] Write session will restart in 0.006653s
2025-09-30T14:58:48.963868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd2854-f40111d6-d24325da-6d347fc3_0] Write session: Do CDS request
2025-09-30T14:58:48.963875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd2854-f40111d6-d24325da-6d347fc3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:48.963398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:48.963419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:48.963488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3026 reason: error at write: Disconnected sessionId: src_id|fedd2854-f40111d6-d24325da-6d347fc3_0
2025-09-30T14:58:48.963683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3026 sessionId: src_id|fedd2854-f40111d6-d24325da-6d347fc3_0 is DEAD
2025-09-30T14:58:48.963870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896856450899619:9657]
2025-09-30T14:58:48.963887Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:48.971789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd2854-f40111d6-d24325da-6d347fc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:48.972163Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:48.972182Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3027
2025-09-30T14:58:48.972365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3027 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:48.972397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3027 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:48.972403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3027 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:48.972408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:48.972847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3027 sessionId:  describe result for acl check
2025-09-30T14:58:48.972875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:48.972877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:48.972879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:48.972884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896856450899656:9461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:48.973462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896856450899656:9461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:48.975756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896856450899656:9461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:48.978645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:48.979006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896856450899656:9461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:48.979029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896856450899656:9461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:48.979033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896856450899656:9461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:48.979043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3027 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:48.980483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:48.980758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:48.980765Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:48.980777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:48.980846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:48.980886Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896856361098445:6644]
2025-09-30T14:58:48.981581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:48.982025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:48.982075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:48.982432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:48.982499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.982501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.982502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.982504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.982505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.982507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.982508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.982509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.982510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.982512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.982513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.982514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.982516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.982517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.982518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.982524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.982535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.982539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.982542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.982546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.982550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.982553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.982557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.982563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.982568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.982572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.982576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.982580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.982585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.982590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.982597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.982606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:48.982613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.982619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:48.982623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.982628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:48.982635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.982640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:48.982644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.982650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:48.982655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.982662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:48.982667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.982673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:48.982678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.982684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:48.982689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.982695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:48.982700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.982706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:48.982712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.982718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.982724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.982730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.982745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.982751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.982756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.982762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:48.982767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.982773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:48.982830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:48.989250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:48.990352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:48.990372Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:48.990376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:48.990380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:48.990386Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3026 [2:7555896856361098445:6644]
2025-09-30T14:58:48.990405Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:48.990430Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:48.990439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:48.990443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:48.990445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:48.990463Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:48.990470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:48.990489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:48.990558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.990566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.990568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.990572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:48.990574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:48.990653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:48.990664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:48.990678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:48.990696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:48.990720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:48.990743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896856361098439:6644]
2025-09-30T14:58:48.990751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896856361098439:6644]
2025-09-30T14:58:48.990754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896856361098439:6644]
2025-09-30T14:58:48.990770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:48.990790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:48.990811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:48.990818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:48.990861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896856361098439:6644]
2025-09-30T14:58:48.990865Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:48.990868Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:48.990869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:48.990871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:48.990877Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:48.990879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899734:9461], now have 1 active actors on pipe
2025-09-30T14:58:48.990883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896856450899623:2454], now have 1 active actors on pipe
2025-09-30T14:58:48.991291Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3026
2025-09-30T14:58:48.991333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3026
2025-09-30T14:58:48.991709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.991725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.991757Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:48.991771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:48.991781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:48.991784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:48.991796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:48.991815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:48.991839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:48.992117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:48.992127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:48.992145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:48.992297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3027 partition: 0 MaxSeqNo: 42 sessionId: src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0
2025-09-30T14:58:48.992683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fedd2854-f40111d6-d24325da-6d347fc3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:48.995709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0] Write session: try to update token
2025-09-30T14:58:48.995731Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:49.004874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:49.004898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:49.004909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896856361098439:6644]
2025-09-30T14:58:49.004963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:49.004967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:49.005171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:49.005372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:49.005555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:49.005754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:49.006016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:49.006077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:49.012792Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3027 sessionId: src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:49.015995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:49.017049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.017076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.017098Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:49.017101Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:49.017104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:49.017106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:49.017118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896856361098439:6644]
2025-09-30T14:58:49.017122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896856361098439:6644]
2025-09-30T14:58:49.017126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896856361098439:6644]
2025-09-30T14:58:49.017175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:49.017175Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:49.017182Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:49.017186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:49.017188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.017190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:49.017344Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:49.063646Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896860745867043:9657]
2025-09-30T14:58:49.064128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3026, pipe: [1:7555896860745867043:9657]
2025-09-30T14:58:49.135206Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:49.135699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:49.135737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867043:9657], now have 1 active actors on pipe
2025-09-30T14:58:49.139428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:49.139546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:49.139554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:49.139624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3027 reason: error at write: Disconnected sessionId: src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0
2025-09-30T14:58:49.139776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3027 sessionId: src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0 is DEAD
2025-09-30T14:58:49.139782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896860745867043:9657]
2025-09-30T14:58:49.139806Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:49.143516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:49.143530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0] Write session will restart in 0.005356s
2025-09-30T14:58:49.143556Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0] Write session: Do CDS request
2025-09-30T14:58:49.143562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:49.149834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:49.151390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:49.151409Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3028
2025-09-30T14:58:49.151815Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3028 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:49.151862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3028 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:49.151874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3028 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:49.151879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:49.152719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3028 sessionId:  describe result for acl check
2025-09-30T14:58:49.152764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:49.152766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:49.152769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:49.152776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896860745867097:9452] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:49.153415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896860745867097:9452] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:49.156270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896860745867097:9452] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:49.157905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:49.160125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:49.160453Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:49.160467Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:49.160478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:49.160544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:49.160592Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896860656065861:6637]
2025-09-30T14:58:49.161292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:49.161673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:49.161744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:49.162150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:49.162246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.162253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.162255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.162256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.162258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.162259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.162260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.162262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.162263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.162264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.162265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.162266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.162268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.162269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.162271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.162278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.162289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.162293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.162298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.162303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.162307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.162311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.162316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.162320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.162325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.162329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.162333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.162337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.162340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.162344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.162359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.162367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.162374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.162380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.162386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.162391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.162396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.162400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.162405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.162410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.162415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.162420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.162425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.162431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.162435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.162441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.162446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.162453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.162457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.162464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.162469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.162477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.162492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.162498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.162504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.162509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.162514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.162519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.162524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.162529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.162578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:49.166182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896860745867097:9452] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:49.166205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896860745867097:9452] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:49.166209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896860745867097:9452] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:49.166217Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3028 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:49.169746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:49.170863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:49.170883Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:49.170887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:49.170891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:49.170899Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3027 [2:7555896860656065861:6637]
2025-09-30T14:58:49.170917Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:49.170936Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:49.170940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:49.170955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:49.170958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:49.170978Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:49.170990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:49.170998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:49.171069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.171077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.171080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.171084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:49.171087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:49.171162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:49.171169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.171185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.171204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.171224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:49.171257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896860656065856:6637]
2025-09-30T14:58:49.171260Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896860656065856:6637]
2025-09-30T14:58:49.171266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896860656065856:6637]
2025-09-30T14:58:49.171276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:49.171303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:49.171320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:49.171319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:49.171322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:49.171324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:49.171324Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:49.171365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896860656065856:6637]
2025-09-30T14:58:49.171373Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:49.171384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867165:9452], now have 1 active actors on pipe
2025-09-30T14:58:49.171390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867045:2454], now have 1 active actors on pipe
2025-09-30T14:58:49.171561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:49.171632Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3027
2025-09-30T14:58:49.171682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3027
2025-09-30T14:58:49.171774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.171787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.171814Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:49.171826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:49.171834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:49.171844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:49.171854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:49.171867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:49.171884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:49.172093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.172102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.172115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:49.172216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3028 partition: 0 MaxSeqNo: 42 sessionId: src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0
2025-09-30T14:58:49.173468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|67d2dbe4-bf30448f-1d176ac2-9904ff03_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:49.176507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0] Write session: try to update token
2025-09-30T14:58:49.176537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:49.184464Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:49.184485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:49.184487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:49.184490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:49.184499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896860656065856:6637]
2025-09-30T14:58:49.184504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896860656065856:6637]
2025-09-30T14:58:49.184513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896860656065856:6637]
2025-09-30T14:58:49.184557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:49.184564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.184567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:49.184752Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:49.187013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:49.187061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:49.187070Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:49.207558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3028 sessionId: src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:49.210541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:49.239225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896860745867173:9657]
2025-09-30T14:58:49.239576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3027, pipe: [1:7555896860745867173:9657]
2025-09-30T14:58:49.301884Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:49.302309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.302328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.302351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867173:9657], now have 1 active actors on pipe
2025-09-30T14:58:49.302592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:49.302756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896860745867173:9657]
2025-09-30T14:58:49.302799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:49.302834Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:49.302912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3028 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0
2025-09-30T14:58:49.303163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3028 sessionId: src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0 is DEAD
2025-09-30T14:58:49.303257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:49.303270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0] Write session will restart in 0.007605s
2025-09-30T14:58:49.303297Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0] Write session: Do CDS request
2025-09-30T14:58:49.303304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:49.311825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:49.313361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:49.313380Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3029
2025-09-30T14:58:49.313539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3029 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:49.313574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3029 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:49.313585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3029 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:49.313589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:49.314059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3029 sessionId:  describe result for acl check
2025-09-30T14:58:49.314116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:49.314124Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:49.314125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:49.314132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896860745867196:9450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:49.314779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896860745867196:9450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:49.317364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896860745867196:9450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:49.319625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:49.319957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896860745867196:9450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:49.319976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896860745867196:9450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:49.319980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896860745867196:9450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:49.319989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3029 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:49.321482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:49.321795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:49.321807Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:49.321821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:49.321894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:49.321942Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896860656065982:6635]
2025-09-30T14:58:49.322627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:49.323121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:49.323240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:49.323717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:49.323814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.323820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.323822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.323823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.323825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.323826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.323828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.323830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.323831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.323833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.323834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.323836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.323837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.323839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.323840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.323847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.323858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.323863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.323867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.323872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.323876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.323880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.323885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.323889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.323893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.323897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.323901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.323905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.323910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.323914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.323925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.323934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.323941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.323947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.323952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.323958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.323962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.323968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.323976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.323987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.323992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.324010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.324015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.324022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.324029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.324034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.324039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.324043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.324047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.324063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.324069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.324074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.324079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.324084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.324089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.324094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.324099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.324104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.324109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.324113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.324161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:49.330153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:49.331327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:49.331346Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:49.331350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:49.331355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:49.331363Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3028 [2:7555896860656065982:6635]
2025-09-30T14:58:49.331384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:49.331404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:49.331408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:49.331411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:49.331414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:49.331431Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:49.331448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:49.331458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:49.331536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.331544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.331546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.331550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:49.331553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:49.331859Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3028
2025-09-30T14:58:49.331910Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3028
2025-09-30T14:58:49.331632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:49.331644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.331658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.331669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.331686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:49.331704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896860656065976:6635]
2025-09-30T14:58:49.331707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896860656065976:6635]
2025-09-30T14:58:49.331709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896860656065976:6635]
2025-09-30T14:58:49.331719Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:49.331736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:49.331739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:49.331743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:49.331746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:49.331754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:49.331758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:49.331770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867178:2454], now have 1 active actors on pipe
2025-09-30T14:58:49.331774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867298:9450], now have 1 active actors on pipe
2025-09-30T14:58:49.331816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896860656065976:6635]
2025-09-30T14:58:49.331827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:49.331834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:49.332150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.332166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.332190Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:49.332205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:49.332214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:49.332216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:49.332227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:49.332244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:49.332265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:49.332514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.332527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.332552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:49.332769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3029 partition: 0 MaxSeqNo: 42 sessionId: src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0
2025-09-30T14:58:49.333208Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e7905d54-dbb3b5a3-fe7b935f-a1bf719d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:49.336324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0] Write session: try to update token
2025-09-30T14:58:49.336350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:49.346031Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:49.346053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:49.346056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:49.346059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:49.346071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896860656065976:6635]
2025-09-30T14:58:49.346077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896860656065976:6635]
2025-09-30T14:58:49.346082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896860656065976:6635]
2025-09-30T14:58:49.346133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:49.346137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:49.346143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.346145Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:49.346146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:49.346151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:49.346307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:49.357456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3029 sessionId: src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:49.360641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:49.402725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896860745867313:9657]
2025-09-30T14:58:49.403072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3028, pipe: [1:7555896860745867313:9657]
2025-09-30T14:58:49.471050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:49.471547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.471561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.471583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867313:9657], now have 1 active actors on pipe
2025-09-30T14:58:49.471949Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:49.472037Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896860745867313:9657]
2025-09-30T14:58:49.472064Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:49.472072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:49.472140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3029 reason: error at write: Disconnected sessionId: src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0
2025-09-30T14:58:49.472335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3029 sessionId: src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0 is DEAD
2025-09-30T14:58:49.472049Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:49.475632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:49.475648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0] Write session will restart in 0.006331s
2025-09-30T14:58:49.475674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0] Write session: Do CDS request
2025-09-30T14:58:49.475682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:49.482906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:49.483284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:49.483309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3030
2025-09-30T14:58:49.483517Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3030 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:49.483567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3030 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:49.483578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3030 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:49.483583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:49.483970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3030 sessionId:  describe result for acl check
2025-09-30T14:58:49.484006Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:49.484008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:49.484010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:49.484016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896860745867331:9444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:49.484597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896860745867331:9444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:49.489814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896860745867331:9444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:49.494665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896860745867331:9444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:49.494686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896860745867331:9444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:49.494692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896860745867331:9444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:49.494708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3030 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:49.494638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:49.497080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:49.497301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:49.497309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:49.497320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:49.497380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:49.497433Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896860656066115:6629]
2025-09-30T14:58:49.498090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:49.498471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:49.498541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:49.498835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:49.498908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.498912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.498913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.498915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.498916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.498918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.498919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.498920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.498922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.498923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.498924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.498926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.498927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.498928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.498929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.498935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.498945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.498947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.498950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.498953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.498955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.498958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.498960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.498963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.498967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.498969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.498971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.498974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.498977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.498979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.498986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.498992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.499000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.499003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.499006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.499010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.499013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.499016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.499020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.499026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.499030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.499035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.499040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.499058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.499062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.499067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.499072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.499077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.499082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.499087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.499094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.499099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.499105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.499111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.499116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.499122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.499126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.499131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.499136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.499142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.499190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:49.506010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:49.507091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:49.507109Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:49.507113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:49.507117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:49.507124Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3029 [2:7555896860656066115:6629]
2025-09-30T14:58:49.507143Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:49.507159Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:49.507163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:49.507167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:49.507169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:49.507186Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:49.507199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:49.507206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:49.507292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.507300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.507303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.507306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:49.507310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:49.507378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:49.507388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.507402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.507416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.507433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:49.507842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3029
2025-09-30T14:58:49.507894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3029
2025-09-30T14:58:49.507450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896860656066109:6629]
2025-09-30T14:58:49.507460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896860656066109:6629]
2025-09-30T14:58:49.507462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896860656066109:6629]
2025-09-30T14:58:49.507476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:49.507491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:49.507508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:49.507511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:49.507549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896860656066109:6629]
2025-09-30T14:58:49.507552Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:49.507709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:49.507712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:49.507715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:49.507720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:49.508053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867314:2454], now have 1 active actors on pipe
2025-09-30T14:58:49.508065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867431:9444], now have 1 active actors on pipe
2025-09-30T14:58:49.508078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.508083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.508112Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:49.508124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:49.508129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:49.508131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:49.508143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:49.508160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:49.508184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:49.508471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.508478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.508491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:49.509003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3030 partition: 0 MaxSeqNo: 42 sessionId: src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0
2025-09-30T14:58:49.509391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffa115ba-7c8b932d-58e8dc27-feb17475_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:49.512348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0] Write session: try to update token
2025-09-30T14:58:49.512376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:49.522054Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:49.522081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:49.522084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:49.522086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:49.522098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896860656066109:6629]
2025-09-30T14:58:49.522104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896860656066109:6629]
2025-09-30T14:58:49.522108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896860656066109:6629]
2025-09-30T14:58:49.522157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:49.522170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.522173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:49.522187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:49.522202Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:49.522207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:49.522358Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:49.532512Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3030 sessionId: src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:49.535641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:49.572010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896860745867445:9657]
2025-09-30T14:58:49.572505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3029, pipe: [1:7555896860745867445:9657]
2025-09-30T14:58:49.647904Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:49.648387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.648410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.648431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867445:9657], now have 1 active actors on pipe
2025-09-30T14:58:49.648770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896860745867445:9657]
2025-09-30T14:58:49.648815Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:49.648772Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:49.648855Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:49.648936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3030 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0
2025-09-30T14:58:49.649146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3030 sessionId: src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0 is DEAD
2025-09-30T14:58:49.649325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:49.649339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0] Write session will restart in 0.008877s
2025-09-30T14:58:49.649364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0] Write session: Do CDS request
2025-09-30T14:58:49.649370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:49.663358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:49.663894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:49.663914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3031
2025-09-30T14:58:49.664648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:49.664134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3031 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:49.664169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3031 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:49.664175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3031 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:49.664179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:49.664588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3031 sessionId:  describe result for acl check
2025-09-30T14:58:49.664620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:49.664625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:49.664627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:49.664633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896860745867556:9429] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:49.665218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896860745867556:9429] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:49.666301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:49.666522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:49.666527Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:49.666538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:49.666597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:49.666638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896860656066251:6627]
2025-09-30T14:58:49.667392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:49.667827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:49.667888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:49.668256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:49.668348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.668356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.668357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.668358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.668359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.668361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.668362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.668363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.668364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.668366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.668367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.668369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.668370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.668371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.668373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.668379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.668391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.668395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.668399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.668403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.668407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.668411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.668415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.668419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.668423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.668427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.668431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.668435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.668439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.668442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.668451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.668459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.668466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.668471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.668477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.668482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.668487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.668493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.668498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.668504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.668508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.668513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.668518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.668524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.668528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.668535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.668540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.668546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.668551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.668557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.668562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.668568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.668573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.668598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.668611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.668617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.668623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.668634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.668640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.668646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.668717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:49.674590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:49.675751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:49.675775Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:49.675778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:49.675782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:49.675790Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3030 [2:7555896860656066251:6627]
2025-09-30T14:58:49.675807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:49.675837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:49.675841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:49.675844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:49.675849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:49.675864Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:49.675872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:49.675878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:49.675943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.675952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.675953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.675957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:49.675960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:49.676027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:49.676035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.676049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.676062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.676088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:49.676111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896860656066246:6627]
2025-09-30T14:58:49.676117Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896860656066246:6627]
2025-09-30T14:58:49.676120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896860656066246:6627]
2025-09-30T14:58:49.676134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:49.676152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:49.676170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:49.676173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:49.676176Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:49.676181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:49.676185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:49.676212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896860656066246:6627]
2025-09-30T14:58:49.676220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:49.676246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:49.676386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867458:2454], now have 1 active actors on pipe
2025-09-30T14:58:49.676844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3030
2025-09-30T14:58:49.677770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896860745867556:9429] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:49.684777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896860745867556:9429] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:49.684805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896860745867556:9429] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:49.684810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896860745867556:9429] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:49.684821Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3031 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:49.685773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867599:9429], now have 1 active actors on pipe
2025-09-30T14:58:49.685838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3030
2025-09-30T14:58:49.686038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.686053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.686085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f3a293f-3d804a80-2d6d6b4b-d72f73e0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:49.686100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:49.686106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:49.686109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:49.686125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:49.686153Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:49.686186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:49.690492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.690517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.690538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:49.690540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:49.690542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:49.690543Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:49.690551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896860656066246:6627]
2025-09-30T14:58:49.690555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896860656066246:6627]
2025-09-30T14:58:49.690559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896860656066246:6627]
2025-09-30T14:58:49.690610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:49.690614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:49.690618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:49.690623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.690625Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:49.690625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:49.690768Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:49.749208Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896860745867612:9657]
2025-09-30T14:58:49.749487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3030, pipe: [1:7555896860745867612:9657]
2025-09-30T14:58:49.808391Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:49.808923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:49.808984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867612:9657], now have 1 active actors on pipe
2025-09-30T14:58:49.809621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfb9ebe3-daa2807e-122598ae-d9324d1e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4f3a293f-3d804a80-2d6d6b4b-d72f73e0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:49.809200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3031 partition: 0 MaxSeqNo: 42 sessionId: src_id|4f3a293f-3d804a80-2d6d6b4b-d72f73e0_0
2025-09-30T14:58:49.809438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:49.809442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:49.809462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3031 reason: pipe to partition's 0 tablet is dead #2 sessionId: src_id|4f3a293f-3d804a80-2d6d6b4b-d72f73e0_0
2025-09-30T14:58:49.809534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3031 sessionId: src_id|4f3a293f-3d804a80-2d6d6b4b-d72f73e0_0 is DEAD
2025-09-30T14:58:49.810052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896860745867612:9657]
2025-09-30T14:58:49.810081Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:49.813073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3a293f-3d804a80-2d6d6b4b-d72f73e0_0] Write session: try to update token
2025-09-30T14:58:49.813096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3a293f-3d804a80-2d6d6b4b-d72f73e0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:49.818486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3a293f-3d804a80-2d6d6b4b-d72f73e0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: pipe to partition's 0 tablet is dead #2, code: 500027 
2025-09-30T14:58:49.818503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3a293f-3d804a80-2d6d6b4b-d72f73e0_0] Write session will restart in 0.005587s
2025-09-30T14:58:49.818531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3a293f-3d804a80-2d6d6b4b-d72f73e0_0] Write session: Do CDS request
2025-09-30T14:58:49.818537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3a293f-3d804a80-2d6d6b4b-d72f73e0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:49.825837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3a293f-3d804a80-2d6d6b4b-d72f73e0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:49.825925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:49.825948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3032
2025-09-30T14:58:49.826141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3032 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:49.826176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3032 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:49.826183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3032 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:49.826187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:49.826788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3032 sessionId:  describe result for acl check
2025-09-30T14:58:49.826829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:49.826836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:49.826838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:49.826845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896860745867631:9421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:49.827449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896860745867631:9421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:49.830650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896860745867631:9421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:49.835352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896860745867631:9421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:49.835375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896860745867631:9421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:49.835378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896860745867631:9421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:49.835388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3032 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:49.836971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:49.840312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:49.840611Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:49.840622Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:49.840646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:49.840735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:49.840772Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896860656066398:6607]
2025-09-30T14:58:49.842040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:49.842527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:49.842578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:49.842881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:49.842942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.842943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.842945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.842946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.842948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.842949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.842950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.842950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.842951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.842952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.842953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.842954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.842955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.842956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.842957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.842961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.842967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.842970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.842973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.842975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.842978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.842981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.842984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.842986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.842989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.842991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.842994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.842997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.842999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.843002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.843010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.843016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:49.843019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.843023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:49.843026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.843030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:49.843034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.843037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:49.843041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.843044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:49.843047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.843050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:49.843056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.843060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:49.843063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.843066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:49.843069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.843073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:49.843078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.843084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:49.843090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.843096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.843101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.843106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.843108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.843111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.843117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.843123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:49.843127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.843132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:49.843174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:49.851321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:49.852388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:49.852395Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:49.852398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:49.852402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:49.852410Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3031 [2:7555896860656066398:6607]
2025-09-30T14:58:49.852430Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:49.852448Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:49.852452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:49.852455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:49.852460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:49.852477Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:49.852485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:49.852491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:49.852557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.852560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.852562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.852566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:49.852569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:49.852635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:49.852638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.852653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:49.852668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:49.852687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:49.852719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896860656066392:6607]
2025-09-30T14:58:49.852722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896860656066392:6607]
2025-09-30T14:58:49.852724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896860656066392:6607]
2025-09-30T14:58:49.852740Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:49.852755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:49.852771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:49.852775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:49.852805Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:49.852810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:49.852812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896860656066392:6607]
2025-09-30T14:58:49.852813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:49.852815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:49.852820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:49.855606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867617:2454], now have 1 active actors on pipe
2025-09-30T14:58:49.855626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867732:9421], now have 1 active actors on pipe
2025-09-30T14:58:49.856416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.856430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.856458Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:49.856475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:49.856480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:49.856483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:49.856496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:49.856511Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:49.856527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:49.856999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:49.857013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:49.857035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:49.855723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3031
2025-09-30T14:58:49.855732Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3031
2025-09-30T14:58:49.857158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3032 partition: 0 MaxSeqNo: 42 sessionId: src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0
2025-09-30T14:58:49.857533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f3a293f-3d804a80-2d6d6b4b-d72f73e0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:49.860650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0] Write session: try to update token
2025-09-30T14:58:49.860670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:49.884363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3032 sessionId: src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:49.884852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:49.884873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:49.884876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:49.884878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:49.884887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896860656066392:6607]
2025-09-30T14:58:49.884892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896860656066392:6607]
2025-09-30T14:58:49.884897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896860656066392:6607]
2025-09-30T14:58:49.884943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:49.884946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:49.884950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:49.884952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:49.884953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:49.884961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:49.885105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:49.887317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:49.909953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896860745867747:9657]
2025-09-30T14:58:49.910715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3031, pipe: [1:7555896860745867747:9657]
2025-09-30T14:58:50.008774Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:50.009159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.009169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.009212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896860745867747:9657], now have 1 active actors on pipe
2025-09-30T14:58:50.009649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:50.009654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896860745867747:9657]
2025-09-30T14:58:50.009677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:50.009680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:50.009758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3032 reason: error at write: Disconnected sessionId: src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0
2025-09-30T14:58:50.009942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3032 sessionId: src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0 is DEAD
2025-09-30T14:58:50.010104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:50.010128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0] Write session will restart in 0.008408s
2025-09-30T14:58:50.010152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0] Write session: Do CDS request
2025-09-30T14:58:50.010157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:50.009728Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:50.019816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:50.019892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:50.019922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3033
2025-09-30T14:58:50.020177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3033 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:50.020223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3033 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:50.020235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3033 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:50.020239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:50.020750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3033 sessionId:  describe result for acl check
2025-09-30T14:58:50.020788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:50.020790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:50.020792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:50.020799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896865040835123:9409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:50.021368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896865040835123:9409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:50.025422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896865040835123:9409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:50.027166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:50.030294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896865040835123:9409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:50.030327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896865040835123:9409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:50.030330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896865040835123:9409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:50.030339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3033 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:50.029460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:50.029758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:50.029763Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:50.029775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:50.029832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:50.029870Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896864951033817:6605]
2025-09-30T14:58:50.030551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:50.030892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:50.030938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:50.031300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:50.031368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.031369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.031370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.031372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.031373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.031375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.031377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.031378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.031379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.031380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.031381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.031383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.031385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.031386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.031387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.031393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.031405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.031409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.031414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.031418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.031422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.031428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.031432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.031436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.031440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.031445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.031448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.031452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.031457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.031461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.031468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.031477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.031484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.031491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.031497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.031503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.031509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.031515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.031520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.031526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.031530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.031535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.031541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.031546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.031551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.031568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.031573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.031579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.031585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.031591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.031596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.031601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.031605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.031610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.031615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.031621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.031625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.031630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.031635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.031641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.031686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:50.037808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:50.038924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:50.038938Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:50.038941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:50.038944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:50.038950Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3032 [2:7555896864951033817:6605]
2025-09-30T14:58:50.038965Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:50.038981Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:50.038983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:50.038986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:50.038988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:50.039005Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:50.039013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:50.039023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:50.039100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.039102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.039104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.039111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:50.039114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:50.039196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:50.039204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.039217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.039228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.039257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:50.039275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896864951033811:6605]
2025-09-30T14:58:50.039278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896864951033811:6605]
2025-09-30T14:58:50.039280Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896864951033811:6605]
2025-09-30T14:58:50.039301Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:50.039322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:50.039338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:50.039345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:50.039390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896864951033811:6605]
2025-09-30T14:58:50.039392Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:50.039402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835167:9409], now have 1 active actors on pipe
2025-09-30T14:58:50.039407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:50.039411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:50.039413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:50.039418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835046:2454], now have 1 active actors on pipe
2025-09-30T14:58:50.039421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:50.040718Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3032
2025-09-30T14:58:50.040738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3032
2025-09-30T14:58:50.040833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.040852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.040884Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:50.040901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:50.040910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:50.040913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:50.040929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:50.040948Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:50.040972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:50.041770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.041784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.041808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:50.042412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|28ebc3c4-5ec9684-4652a53f-f2e3d73e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:50.041959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3033 partition: 0 MaxSeqNo: 42 sessionId: src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0
2025-09-30T14:58:50.045342Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0] Write session: try to update token
2025-09-30T14:58:50.045376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:50.054379Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:50.054400Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:50.054402Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:50.054404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:50.054415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896864951033811:6605]
2025-09-30T14:58:50.054420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896864951033811:6605]
2025-09-30T14:58:50.054423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896864951033811:6605]
2025-09-30T14:58:50.054467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:50.054475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.054478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:50.054478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:50.054484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:50.054501Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:50.054625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:50.065274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3033 sessionId: src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:50.068455Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:50.109711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896865040835178:9657]
2025-09-30T14:58:50.110293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3032, pipe: [1:7555896865040835178:9657]
2025-09-30T14:58:50.173235Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:50.173666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.173680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.173720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835178:9657], now have 1 active actors on pipe
2025-09-30T14:58:50.173935Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:50.173949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896865040835178:9657]
2025-09-30T14:58:50.173965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:50.173970Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:50.173997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:50.174051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3033 reason: error at write: Disconnected sessionId: src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0
2025-09-30T14:58:50.174226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3033 sessionId: src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0 is DEAD
2025-09-30T14:58:50.174380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:50.174391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0] Write session will restart in 0.005027s
2025-09-30T14:58:50.174415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0] Write session: Do CDS request
2025-09-30T14:58:50.174421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:50.180819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:50.181217Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:50.181237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3034
2025-09-30T14:58:50.181370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3034 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:50.181407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3034 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:50.181413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3034 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:50.181417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:50.181850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3034 sessionId:  describe result for acl check
2025-09-30T14:58:50.181892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:50.181899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:50.181901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:50.181908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896865040835204:9412] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:50.182447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896865040835204:9412] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:50.186467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896865040835204:9412] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:50.187902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:50.190063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:50.190270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:50.190282Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:50.190293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:50.190323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896865040835204:9412] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:50.190342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896865040835204:9412] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:50.190345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:50.190346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896865040835204:9412] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:50.190355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3034 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:50.190388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896864951033944:6586]
2025-09-30T14:58:50.191076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:50.191434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:50.191511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:50.191899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:50.192000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.192012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.192014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.192015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.192017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.192018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.192019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.192020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.192022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.192023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.192024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.192025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.192027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.192028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.192029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.192036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.192046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.192049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.192053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.192057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.192060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.192064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.192069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.192073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.192077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.192081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.192085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.192089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.192093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.192096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.192105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.192114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.192120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.192125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.192131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.192136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.192141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.192147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.192153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.192158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.192163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.192168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.192174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.192179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.192184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.192191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.192196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.192202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.192207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.192213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.192227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.192234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.192243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.192249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.192256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.192265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.192269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.192275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.192283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.192289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.192335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:50.198340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:50.199476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:50.199491Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:50.199494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:50.199498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:50.199505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3033 [2:7555896864951033944:6586]
2025-09-30T14:58:50.199531Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:50.199548Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:50.199557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:50.199560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:50.199563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:50.199582Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:50.199594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:50.199603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:50.199666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.199673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.199676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.199679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:50.199682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:50.199752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:50.199759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.199773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.199791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.199810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:50.199832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835302:9412], now have 1 active actors on pipe
2025-09-30T14:58:50.199841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835180:2454], now have 1 active actors on pipe
2025-09-30T14:58:50.199847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896864951033939:6586]
2025-09-30T14:58:50.199853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896864951033939:6586]
2025-09-30T14:58:50.199861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896864951033939:6586]
2025-09-30T14:58:50.199878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:50.199895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:50.199902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:50.199907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:50.199909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:50.199915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:50.199919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:50.199917Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3033
2025-09-30T14:58:50.199935Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3033
2025-09-30T14:58:50.199957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896864951033939:6586]
2025-09-30T14:58:50.199966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:50.199977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:50.199988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.199993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.200040Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:50.200052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:50.200055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:50.200058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:50.200068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:50.200084Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:50.200102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:50.200355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.200372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.200399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:50.200506Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3034 partition: 0 MaxSeqNo: 42 sessionId: src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0
2025-09-30T14:58:50.200982Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6aaecde7-510b91d5-524fbf43-e1d1b3c9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:50.203819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0] Write session: try to update token
2025-09-30T14:58:50.203839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:50.212874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:50.212895Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:50.212897Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:50.212899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:50.212909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896864951033939:6586]
2025-09-30T14:58:50.212914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896864951033939:6586]
2025-09-30T14:58:50.212917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896864951033939:6586]
2025-09-30T14:58:50.212958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:50.212965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.212968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:50.212970Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:50.212978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:50.212982Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:50.213118Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:50.219753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3034 sessionId: src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:50.222768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:50.274033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896865040835313:9657]
2025-09-30T14:58:50.278318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3033, pipe: [1:7555896865040835313:9657]
2025-09-30T14:58:50.330302Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:50.330798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.330809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.330850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835313:9657], now have 1 active actors on pipe
2025-09-30T14:58:50.331122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896865040835313:9657]
2025-09-30T14:58:50.331155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:50.331159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:50.331160Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:50.331223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3034 reason: error at write: Disconnected sessionId: src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0
2025-09-30T14:58:50.331218Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:50.331419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3034 sessionId: src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0 is DEAD
2025-09-30T14:58:50.331738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:50.331748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0] Write session will restart in 0.006658s
2025-09-30T14:58:50.331773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0] Write session: Do CDS request
2025-09-30T14:58:50.331781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:50.339783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:50.339891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:50.339909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3035
2025-09-30T14:58:50.340062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3035 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:50.340098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3035 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:50.340102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3035 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:50.340107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:50.340634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3035 sessionId:  describe result for acl check
2025-09-30T14:58:50.340683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:50.340706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:50.340708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:50.340715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896865040835377:9406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:50.341320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896865040835377:9406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:50.343631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896865040835377:9406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:50.344657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:50.346171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:50.346409Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:50.346421Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:50.346434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:50.346497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:50.346529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896865040835377:9406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:50.346550Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896864951034070:6595]
2025-09-30T14:58:50.346543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896865040835377:9406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:50.346546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896865040835377:9406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:50.346560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3035 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:50.347221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:50.347573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:50.347649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:50.347998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:50.348095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.348105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.348106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.348107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.348109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.348110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.348112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.348113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.348115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.348116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.348117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.348119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.348121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.348122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.348123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.348131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.348143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.348148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.348153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.348158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.348163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.348168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.348173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.348178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.348183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.348187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.348191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.348195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.348199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.348204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.348212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.348222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.348229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.348235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.348246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.348252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.348262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.348268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.348277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.348284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.348293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.348298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.348303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.348314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.348321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.348330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.348335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.348341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.348350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.348356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.348368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.348378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.348384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.348394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.348399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.348410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.348415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.348425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.348430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.348436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.348489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:50.354146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:50.355294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:50.355311Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:50.355314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:50.355318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:50.355326Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3034 [2:7555896864951034070:6595]
2025-09-30T14:58:50.355346Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:50.355364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:50.355374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:50.355378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:50.355381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:50.355398Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:50.355410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:50.355422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:50.355491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.355499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.355501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.355505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:50.355508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:50.355584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:50.355592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.355608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.355626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.355648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:50.355672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835319:2454], now have 1 active actors on pipe
2025-09-30T14:58:50.355680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835443:9406], now have 1 active actors on pipe
2025-09-30T14:58:50.355686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896864951034065:6595]
2025-09-30T14:58:50.355690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896864951034065:6595]
2025-09-30T14:58:50.355693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896864951034065:6595]
2025-09-30T14:58:50.355706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:50.355724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:50.355748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:50.355756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:50.355738Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3034
2025-09-30T14:58:50.355769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:50.355767Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3034
2025-09-30T14:58:50.355780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:50.355782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:50.355794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896864951034065:6595]
2025-09-30T14:58:50.355797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:50.355802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:50.355934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.355945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.355980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fade6fab-3576465c-bb7d6be5-66694381_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:50.355993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:50.355997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:50.355999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:50.356010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:50.356020Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:50.356036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:50.356187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.356201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.356223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:50.356334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3035 partition: 0 MaxSeqNo: 42 sessionId: src_id|fade6fab-3576465c-bb7d6be5-66694381_0
2025-09-30T14:58:50.356682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e07da2d-266b3b3c-f9197a9f-4013a102_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fade6fab-3576465c-bb7d6be5-66694381_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:50.359512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fade6fab-3576465c-bb7d6be5-66694381_0] Write session: try to update token
2025-09-30T14:58:50.359532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fade6fab-3576465c-bb7d6be5-66694381_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:50.368881Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:50.368904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:50.368907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:50.368909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:50.368919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896864951034065:6595]
2025-09-30T14:58:50.368923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896864951034065:6595]
2025-09-30T14:58:50.368929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896864951034065:6595]
2025-09-30T14:58:50.368983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:50.368990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.368997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:50.369155Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:50.371304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:50.371322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:50.371327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:50.380838Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3035 sessionId: src_id|fade6fab-3576465c-bb7d6be5-66694381_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:50.383813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:50.431466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896865040835457:9657]
2025-09-30T14:58:50.431847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3034, pipe: [1:7555896865040835457:9657]
2025-09-30T14:58:50.483029Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:50.483499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.483510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.483527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835457:9657], now have 1 active actors on pipe
2025-09-30T14:58:50.483701Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:50.484140Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896865040835457:9657]
2025-09-30T14:58:50.484140Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:50.484172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:50.484221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3035 reason: status is not ok: tablet will be restarted right now sessionId: src_id|fade6fab-3576465c-bb7d6be5-66694381_0
2025-09-30T14:58:50.484543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fade6fab-3576465c-bb7d6be5-66694381_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:50.484552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fade6fab-3576465c-bb7d6be5-66694381_0] Write session will restart in 0.008293s
2025-09-30T14:58:50.484571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fade6fab-3576465c-bb7d6be5-66694381_0] Write session: Do CDS request
2025-09-30T14:58:50.484575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fade6fab-3576465c-bb7d6be5-66694381_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:50.484395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3035 sessionId: src_id|fade6fab-3576465c-bb7d6be5-66694381_0 is DEAD
2025-09-30T14:58:50.493828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fade6fab-3576465c-bb7d6be5-66694381_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:50.494012Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:50.494032Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3036
2025-09-30T14:58:50.494150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3036 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:50.494183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3036 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:50.494189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3036 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:50.494193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:50.494704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3036 sessionId:  describe result for acl check
2025-09-30T14:58:50.494743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:50.494746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:50.494748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:50.494754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896865040835473:9402] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:50.495336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896865040835473:9402] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:50.498734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896865040835473:9402] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:50.502482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:50.508969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:50.509226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:50.509247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:50.509260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:50.509321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:50.509368Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896864951034209:6593]
2025-09-30T14:58:50.509343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896865040835473:9402] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:50.509364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896865040835473:9402] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:50.509372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896865040835473:9402] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:50.509400Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3036 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:50.510068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:50.510476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:50.510528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:50.510878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:50.511024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.511033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.511034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.511035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.511037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.511038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.511039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.511041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.511042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.511043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.511044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.511046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.511047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.511048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.511049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.511057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.511067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.511070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.511074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.511077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.511081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.511085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.511089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.511093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.511100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.511105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.511109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.511113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.511118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.511122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.511132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.511139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.511147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.511153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.511159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.511164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.511169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.511174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.511179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.511185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.511189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.511194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.511200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.511205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.511210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.511222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.511227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.511235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.511239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.511266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.511272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.511277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.511282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.511292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.511296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.511302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.511307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.511315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.511324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.511333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.511373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:50.519383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:50.520497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:50.520513Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:50.520516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:50.520520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:50.520530Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3035 [2:7555896864951034209:6593]
2025-09-30T14:58:50.520548Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:50.520565Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:50.520568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:50.520572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:50.520574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:50.520594Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:50.520601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:50.520612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:50.520680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.520682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.520684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.520688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:50.520704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:50.520774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:50.520777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.520789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.520807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.520825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:50.520842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896864951034204:6593]
2025-09-30T14:58:50.520849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896864951034204:6593]
2025-09-30T14:58:50.520851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896864951034204:6593]
2025-09-30T14:58:50.520863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:50.520881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:50.520899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:50.520903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:50.520941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896864951034204:6593]
2025-09-30T14:58:50.520951Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:50.521285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:50.521293Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:50.521295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:50.521300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:50.521410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3035
2025-09-30T14:58:50.521449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3035
2025-09-30T14:58:50.521549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835582:9402], now have 1 active actors on pipe
2025-09-30T14:58:50.521558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835458:2454], now have 1 active actors on pipe
2025-09-30T14:58:50.521571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.521583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.521613Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:50.521624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:50.521628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:50.521632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:50.521642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:50.521657Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:50.521677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:50.521994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.522008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.522033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:50.522287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3036 partition: 0 MaxSeqNo: 42 sessionId: src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0
2025-09-30T14:58:50.523517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fade6fab-3576465c-bb7d6be5-66694381_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:50.526459Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0] Write session: try to update token
2025-09-30T14:58:50.526481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:50.546612Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:50.546637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:50.546648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896864951034204:6593]
2025-09-30T14:58:50.546700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:50.546901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:50.547098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:50.547330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:50.547412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:50.547595Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:50.548079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:50.548126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:50.545587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3036 sessionId: src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:50.548359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:50.548624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.548639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.548674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:50.548794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:50.560273Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:50.560295Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:50.560298Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:50.560300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:50.560312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896864951034204:6593]
2025-09-30T14:58:50.560316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896864951034204:6593]
2025-09-30T14:58:50.560320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896864951034204:6593]
2025-09-30T14:58:50.560364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:50.560371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.560373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:50.560377Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:50.560385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:50.560389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:50.560529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:50.583753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896865040835594:9657]
2025-09-30T14:58:50.584098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3035, pipe: [1:7555896865040835594:9657]
2025-09-30T14:58:50.678582Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:50.687711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.687743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.687937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:50.688005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:50.688078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:50.688148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:50.688744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:50.688750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:50.688832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:50.688890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:50.688954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:50.689021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:50.689063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:50.689066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:50.689141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:50.689207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:50.689271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:50.689334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:50.689374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:50.689376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:50.689447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:50.689517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:50.689588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:50.689655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:50.689696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:50.689699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:50.689775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:50.689838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:50.689904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:50.689970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:50.690016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:50.690018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:50.690095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:50.690161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:50.690228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:50.690296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:50.690339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:50.690341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:50.690418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:50.690479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:50.690547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:50.690616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:50.690660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:50.690662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:50.690738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:50.690801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:50.690865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:50.690928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:50.691068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:50.691072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:50.691145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:50.691209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:50.691548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:50.691631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:50.691681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:50.691684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:50.691756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:50.691819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:50.691888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:50.691956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:50.691999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:50.692002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:50.692075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835594:9657], now have 1 active actors on pipe
2025-09-30T14:58:50.692766Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:50.693052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:50.693064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0] Write session will restart in 0.007560s
2025-09-30T14:58:50.693099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0] Write session: Do CDS request
2025-09-30T14:58:50.693105Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:50.692610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:50.692640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:50.692672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3036 reason: error at write: Disconnected sessionId: src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0
2025-09-30T14:58:50.692941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3036 sessionId: src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0 is DEAD
2025-09-30T14:58:50.692956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:50.692997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896865040835594:9657]
2025-09-30T14:58:50.701841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:50.701938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:50.701956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3037
2025-09-30T14:58:50.702133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3037 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:50.702168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3037 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:50.702183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3037 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:50.702188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:50.702633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3037 sessionId:  describe result for acl check
2025-09-30T14:58:50.702661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:50.702665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:50.702670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:50.702679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896865040835622:9391] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:50.703217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896865040835622:9391] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:50.707122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896865040835622:9391] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:50.710756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896865040835622:9391] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:50.710781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896865040835622:9391] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:50.710785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896865040835622:9391] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:50.710795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3037 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:50.730236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:50.735819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:50.736126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:50.736136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:50.736148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:50.736212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:50.736259Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896864951034353:6590]
2025-09-30T14:58:50.736960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:50.737375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:50.737428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:50.737799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:50.737878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.737885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.737886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.737888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.737889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.737890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.737892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.737893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.737894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.737895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.737897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.737898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.737899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.737901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.737902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.737909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.737919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.737924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.737928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.737932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.737937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.737941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.737945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.737949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.737954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.737959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.737963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.737968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.737972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.737976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.737986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.737994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.738000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.738006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.738011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.738016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.738023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.738027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.738032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.738037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.738041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.738047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.738051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.738056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.738061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.738067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.738072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.738078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.738082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.738089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.738099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.738105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.738109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.738114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.738119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.738125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.738130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.738135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.738141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.738146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.738207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:50.748464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:50.749451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:50.749469Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:50.749472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:50.749476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:50.749482Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3036 [2:7555896864951034353:6590]
2025-09-30T14:58:50.749498Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:50.749512Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:50.749516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:50.749520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:50.749522Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:50.749537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:50.749544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:50.749552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:50.749778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.749788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.749791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.749795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:50.749799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:50.749892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:50.749899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.749913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.749928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.749950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:50.749970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896864951034348:6590]
2025-09-30T14:58:50.749972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896864951034348:6590]
2025-09-30T14:58:50.749974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896864951034348:6590]
2025-09-30T14:58:50.749982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:50.749989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:50.749992Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:50.749995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:50.749998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:50.750013Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:50.750019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:50.750029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835609:2454], now have 1 active actors on pipe
2025-09-30T14:58:50.750037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835667:9391], now have 1 active actors on pipe
2025-09-30T14:58:50.750072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896864951034348:6590]
2025-09-30T14:58:50.750083Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:50.750093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:50.751427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3036
2025-09-30T14:58:50.751481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3036
2025-09-30T14:58:50.752069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.752094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.752121Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:50.752136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:50.752143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:50.752145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:50.752154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:50.752166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:50.752179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:50.757103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3037 partition: 0 MaxSeqNo: 42 sessionId: src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0
2025-09-30T14:58:50.756764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.756784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.756816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:50.757527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d07a5d95-c9a9ad5f-466074dc-556662c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:50.760522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0] Write session: try to update token
2025-09-30T14:58:50.760548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:50.772598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:50.772622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:50.772625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:50.772627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:50.772637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896864951034348:6590]
2025-09-30T14:58:50.772642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896864951034348:6590]
2025-09-30T14:58:50.772646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896864951034348:6590]
2025-09-30T14:58:50.772705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:50.772712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.772715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:50.772786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:50.772797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:50.772802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:50.772855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:50.793157Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896865040835769:9657]
2025-09-30T14:58:50.796008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3036, pipe: [1:7555896865040835769:9657]
2025-09-30T14:58:50.797840Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3037 sessionId: src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:50.800986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:50.887560Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:50.887985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835769:9657], now have 1 active actors on pipe
2025-09-30T14:58:50.888017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.888024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.888906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:50.890198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896865040835769:9657]
2025-09-30T14:58:50.890247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:50.890299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:50.890369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3037 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0
2025-09-30T14:58:50.890542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3037 sessionId: src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0 is DEAD
2025-09-30T14:58:50.890924Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:50.890944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0] Write session will restart in 0.007615s
2025-09-30T14:58:50.890980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0] Write session: Do CDS request
2025-09-30T14:58:50.890988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:50.900206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:50.900674Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:50.900712Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3038
2025-09-30T14:58:50.900969Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3038 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:50.901019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3038 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:50.901025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3038 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:50.901030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:50.901504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3038 sessionId:  describe result for acl check
2025-09-30T14:58:50.901543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:50.901546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:50.901548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:50.901560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896865040835787:9373] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:50.902182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896865040835787:9373] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:50.910910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896865040835787:9373] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:50.917887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896865040835787:9373] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:50.917910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896865040835787:9373] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:50.917914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896865040835787:9373] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:50.917923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3038 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:50.921822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:50.922342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:50.922567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:50.922571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:50.922582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:50.922636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:50.922670Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896864951034505:6562]
2025-09-30T14:58:50.923282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:50.923831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:50.923886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:50.924285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:50.924354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.924356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.924357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.924359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.924360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.924362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.924363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.924365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.924366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.924368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.924369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.924371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.924373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.924374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.924375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.924382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.924394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.924399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.924404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.924408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.924412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.924416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.924420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.924424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.924429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.924432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.924437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.924441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.924445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.924450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.924459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.924468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:50.924475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.924482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:50.924488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.924493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:50.924499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.924505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:50.924510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.924516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:50.924521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.924527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:50.924534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.924540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:50.924545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.924552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:50.924557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.924564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:50.924569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.924577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:50.924584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.924589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.924596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.924601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.924607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.924613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.924619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.924626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:50.924632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.924638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:50.924685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:50.932680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:50.934115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:50.934128Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:50.934133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:50.934137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:50.934145Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3037 [2:7555896864951034505:6562]
2025-09-30T14:58:50.934164Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:50.934185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:50.934189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:50.934193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:50.934196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:50.934217Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:50.934226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:50.934235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:50.934319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.934323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.934325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.934330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:50.934334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:50.934438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:50.934442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.934463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:50.934475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:50.934492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:50.934514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896864951034500:6562]
2025-09-30T14:58:50.934517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896864951034500:6562]
2025-09-30T14:58:50.934520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896864951034500:6562]
2025-09-30T14:58:50.934530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:50.934549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:50.934565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:50.934565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:50.934569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:50.934570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:50.934572Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:50.934581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835774:2454], now have 1 active actors on pipe
2025-09-30T14:58:50.934622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896864951034500:6562]
2025-09-30T14:58:50.934630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:50.934634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:50.934636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835895:9373], now have 1 active actors on pipe
2025-09-30T14:58:50.934827Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3037
2025-09-30T14:58:50.934832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3037
2025-09-30T14:58:50.934999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.935019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.935064Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd85e138-651803a4-201418da-4efce594_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:50.935077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:50.935081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:50.935089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:50.935103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:50.935120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:50.935143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:50.935573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:50.935588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:50.935615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:50.935824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3038 partition: 0 MaxSeqNo: 42 sessionId: src_id|bd85e138-651803a4-201418da-4efce594_0
2025-09-30T14:58:50.936244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ce39c57-f74674f1-c990b83c-1bfa1eba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bd85e138-651803a4-201418da-4efce594_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:50.939427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd85e138-651803a4-201418da-4efce594_0] Write session: try to update token
2025-09-30T14:58:50.939449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd85e138-651803a4-201418da-4efce594_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:50.957339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:50.957360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:50.957363Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:50.957365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:50.957376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896864951034500:6562]
2025-09-30T14:58:50.957382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896864951034500:6562]
2025-09-30T14:58:50.957386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896864951034500:6562]
2025-09-30T14:58:50.957434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:50.957442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:50.957444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:50.957609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:50.959338Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:50.959356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:50.959361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:50.963479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3038 sessionId: src_id|bd85e138-651803a4-201418da-4efce594_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:50.966484Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:50.990281Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896865040835910:9657]
2025-09-30T14:58:50.990576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3037, pipe: [1:7555896865040835910:9657]
2025-09-30T14:58:51.081914Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:51.082295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.082308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.082348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896865040835910:9657], now have 1 active actors on pipe
2025-09-30T14:58:51.082585Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:51.082596Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896865040835910:9657]
2025-09-30T14:58:51.082652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:51.082732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3038 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bd85e138-651803a4-201418da-4efce594_0
2025-09-30T14:58:51.082929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3038 sessionId: src_id|bd85e138-651803a4-201418da-4efce594_0 is DEAD
2025-09-30T14:58:51.083066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd85e138-651803a4-201418da-4efce594_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:51.083079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd85e138-651803a4-201418da-4efce594_0] Write session will restart in 0.009819s
2025-09-30T14:58:51.083102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd85e138-651803a4-201418da-4efce594_0] Write session: Do CDS request
2025-09-30T14:58:51.083108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd85e138-651803a4-201418da-4efce594_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:51.083239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:51.093853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd85e138-651803a4-201418da-4efce594_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:51.093982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:51.094002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3039
2025-09-30T14:58:51.093995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:51.094143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3039 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:51.094199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3039 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:51.094210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3039 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:51.094214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:51.094664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3039 sessionId:  describe result for acl check
2025-09-30T14:58:51.094701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:51.094709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:51.094713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:51.094718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896869335803305:9370] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:51.095304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896869335803305:9370] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:51.095937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:51.096262Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:51.096273Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:51.096288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:51.096378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:51.096416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896869246001931:6556]
2025-09-30T14:58:51.097053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:51.097147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896869335803305:9370] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:51.097399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:51.097450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:51.097782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:51.097844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.097850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.097851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.097852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.097854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.097855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.097857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.097858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.097860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.097861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.097862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.097863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.097864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.097865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.097866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.097872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.097882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.097886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.097891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.097895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.097900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.097904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.097908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.097912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.097918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.097922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.097926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.097930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.097933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.097937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.097946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.097953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.097959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.097964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.097972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.097977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.097982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.097987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.097993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.097999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.098003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.098008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.098014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.098019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.098023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.098028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.098032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.098038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.098052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.098058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.098063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.098069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.098073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.098077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.098082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.098088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.098092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.098098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.098102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.098107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.098148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:51.103789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:51.103884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896869335803305:9370] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:51.103907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896869335803305:9370] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:51.103911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896869335803305:9370] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:51.103919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3039 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:51.104760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:51.104776Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:51.104779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:51.104783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:51.104791Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3038 [2:7555896869246001931:6556]
2025-09-30T14:58:51.104808Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:51.104824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:51.104828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:51.104831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:51.104834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:51.104850Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:51.104857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:51.104869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:51.104934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.104941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.104943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.104949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:51.104952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:51.105020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:51.105027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.105042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.105058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.105081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:51.105102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803344:9370], now have 1 active actors on pipe
2025-09-30T14:58:51.105110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803213:2454], now have 1 active actors on pipe
2025-09-30T14:58:51.105116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896869246001925:6556]
2025-09-30T14:58:51.105118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896869246001925:6556]
2025-09-30T14:58:51.105120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896869246001925:6556]
2025-09-30T14:58:51.105134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:51.105150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:51.105149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:51.105153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:51.105155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:51.105168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:51.105172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:51.105204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896869246001925:6556]
2025-09-30T14:58:51.105212Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:51.105189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3038
2025-09-30T14:58:51.105226Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:51.105191Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3038
2025-09-30T14:58:51.105250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.105260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.105284Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3941291-20c16923-776f19b7-1b6e889a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:51.105295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:51.105298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:51.105300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:51.105309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:51.105323Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:51.105340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:51.105497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.105506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.105520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:51.105602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3039 partition: 0 MaxSeqNo: 42 sessionId: src_id|c3941291-20c16923-776f19b7-1b6e889a_0
2025-09-30T14:58:51.105971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd85e138-651803a4-201418da-4efce594_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c3941291-20c16923-776f19b7-1b6e889a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:51.108775Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3941291-20c16923-776f19b7-1b6e889a_0] Write session: try to update token
2025-09-30T14:58:51.108794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3941291-20c16923-776f19b7-1b6e889a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:51.118150Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:51.118169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:51.118171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:51.118176Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:51.118186Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896869246001925:6556]
2025-09-30T14:58:51.118190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896869246001925:6556]
2025-09-30T14:58:51.118194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896869246001925:6556]
2025-09-30T14:58:51.118231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:51.118238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.118246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:51.118248Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:51.118255Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:51.118260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:51.118385Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:51.129583Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3039 sessionId: src_id|c3941291-20c16923-776f19b7-1b6e889a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:51.132304Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:51.182809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896869335803352:9657]
2025-09-30T14:58:51.183098Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3038, pipe: [1:7555896869335803352:9657]
2025-09-30T14:58:51.232975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:51.233393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.233415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.233436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803352:9657], now have 1 active actors on pipe
2025-09-30T14:58:51.233686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:51.233689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896869335803352:9657]
2025-09-30T14:58:51.233704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:51.233721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:51.233788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3039 reason: error at write: Disconnected sessionId: src_id|c3941291-20c16923-776f19b7-1b6e889a_0
2025-09-30T14:58:51.233965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3039 sessionId: src_id|c3941291-20c16923-776f19b7-1b6e889a_0 is DEAD
2025-09-30T14:58:51.233682Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:51.234117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3941291-20c16923-776f19b7-1b6e889a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:51.234128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3941291-20c16923-776f19b7-1b6e889a_0] Write session will restart in 0.009059s
2025-09-30T14:58:51.234152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3941291-20c16923-776f19b7-1b6e889a_0] Write session: Do CDS request
2025-09-30T14:58:51.234158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3941291-20c16923-776f19b7-1b6e889a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:51.244963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3941291-20c16923-776f19b7-1b6e889a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:51.245152Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:51.245173Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3040
2025-09-30T14:58:51.245323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3040 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:51.245365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3040 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:51.245378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3040 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:51.245387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:51.246186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3040 sessionId:  describe result for acl check
2025-09-30T14:58:51.246222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:51.246224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:51.246237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:51.246243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896869335803406:9363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:51.246843Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896869335803406:9363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:51.251440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896869335803406:9363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:51.252211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:51.254372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:51.254669Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:51.254681Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:51.254695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:51.254765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:51.254807Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896869246002064:6550]
2025-09-30T14:58:51.254875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896869335803406:9363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:51.254904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896869335803406:9363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:51.254909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896869335803406:9363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:51.254918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3040 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:51.255471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:51.255910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:51.255979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:51.256392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:51.256487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.256496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.256497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.256498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.256500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.256501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.256502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.256504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.256505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.256507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.256508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.256510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.256511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.256512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.256514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.256521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.256532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.256536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.256541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.256544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.256549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.256553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.256558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.256562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.256566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.256570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.256575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.256579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.256584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.256588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.256597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.256605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.256612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.256626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.256632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.256645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.256650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.256656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.256664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.256670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.256676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.256682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.256702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.256708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.256713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.256718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.256723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.256729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.256733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.256739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.256744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.256750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.256755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.256770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.256774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.256780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.256790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.256795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.256805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.256811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.256864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:51.262601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:51.263706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:51.263727Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:51.263730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:51.263734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:51.263742Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3039 [2:7555896869246002064:6550]
2025-09-30T14:58:51.263759Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:51.263778Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:51.263781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:51.263785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:51.263787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:51.263804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:51.263819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:51.263827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:51.263895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.263898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.263901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.263905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:51.263907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:51.263979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:51.263991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.264006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.264021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.264046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:51.264069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896869246002059:6550]
2025-09-30T14:58:51.264077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896869246002059:6550]
2025-09-30T14:58:51.264079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896869246002059:6550]
2025-09-30T14:58:51.264088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:51.264108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:51.264117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:51.264120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:51.264122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:51.264125Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:51.264128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:51.264171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803480:9363], now have 1 active actors on pipe
2025-09-30T14:58:51.264175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803353:2454], now have 1 active actors on pipe
2025-09-30T14:58:51.264179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896869246002059:6550]
2025-09-30T14:58:51.264182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:51.264296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:51.264662Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3039
2025-09-30T14:58:51.264719Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3039
2025-09-30T14:58:51.265030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.265045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.265079Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27332f31-28306c5d-efd8e372-8302bcc5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:51.265093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:51.265098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:51.265101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:51.265114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:51.265134Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:51.265151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:51.265396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.265410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.265432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:51.265533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3040 partition: 0 MaxSeqNo: 42 sessionId: src_id|27332f31-28306c5d-efd8e372-8302bcc5_0
2025-09-30T14:58:51.265958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3941291-20c16923-776f19b7-1b6e889a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|27332f31-28306c5d-efd8e372-8302bcc5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:51.269006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27332f31-28306c5d-efd8e372-8302bcc5_0] Write session: try to update token
2025-09-30T14:58:51.269028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27332f31-28306c5d-efd8e372-8302bcc5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:51.286397Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:51.286421Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:51.286435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896869246002059:6550]
2025-09-30T14:58:51.286494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:51.286515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:51.286680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:51.286838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:51.287014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:51.287170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:51.287406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:51.287454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:51.292418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:51.292438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:51.292441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:51.292443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:51.292453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896869246002059:6550]
2025-09-30T14:58:51.292458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896869246002059:6550]
2025-09-30T14:58:51.292462Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896869246002059:6550]
2025-09-30T14:58:51.292505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:51.292513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.292516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:51.292527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:51.292535Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:51.292539Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:51.292662Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:51.293586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3040 sessionId: src_id|27332f31-28306c5d-efd8e372-8302bcc5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:51.296536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:51.333910Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896869335803497:9657]
2025-09-30T14:58:51.334235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3039, pipe: [1:7555896869335803497:9657]
2025-09-30T14:58:51.414453Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:51.414806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.414817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.414834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803497:9657], now have 1 active actors on pipe
2025-09-30T14:58:51.415198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896869335803497:9657]
2025-09-30T14:58:51.415265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:51.415268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:51.415342Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3040 reason: error at write: Disconnected sessionId: src_id|27332f31-28306c5d-efd8e372-8302bcc5_0
2025-09-30T14:58:51.415565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3040 sessionId: src_id|27332f31-28306c5d-efd8e372-8302bcc5_0 is DEAD
2025-09-30T14:58:51.415740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:51.415106Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:51.418195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27332f31-28306c5d-efd8e372-8302bcc5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:51.418202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27332f31-28306c5d-efd8e372-8302bcc5_0] Write session will restart in 0.006545s
2025-09-30T14:58:51.418234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27332f31-28306c5d-efd8e372-8302bcc5_0] Write session: Do CDS request
2025-09-30T14:58:51.418242Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27332f31-28306c5d-efd8e372-8302bcc5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:51.427793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27332f31-28306c5d-efd8e372-8302bcc5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:51.427928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:51.427948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3041
2025-09-30T14:58:51.428671Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3041 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:51.428731Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3041 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:51.428738Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3041 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:51.428742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:51.429232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3041 sessionId:  describe result for acl check
2025-09-30T14:58:51.429268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:51.429270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:51.429272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:51.429279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896869335803519:9360] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:51.429822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896869335803519:9360] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:51.439294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:51.441563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:51.442002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896869335803519:9360] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:51.441788Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:51.441798Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:51.441810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:51.442030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:51.442075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896869246002208:6531]
2025-09-30T14:58:51.442711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:51.443120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:51.443154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:51.443529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:51.443607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.443619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.443621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.443622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.443624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.443625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.443626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.443627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.443629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.443631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.443632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.443633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.443635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.443636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.443637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.443643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.443654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.443658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.443663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.443667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.443672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.443676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.443680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.443684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.443688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.443692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.443698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.443702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.443707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.443710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.443720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.443727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.443733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.443739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.443743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.443749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.443753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.443758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.443763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.443768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.443785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.443795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.443801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.443807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.443811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.443822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.443827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.443831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.443841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.443846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.443851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.443856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.443866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.443870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.443875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.443880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.443890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.443896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.443905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.443910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.443960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:51.449280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896869335803519:9360] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:51.449304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896869335803519:9360] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:51.449308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896869335803519:9360] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:51.449317Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3041 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:51.449664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:51.450632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:51.450654Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:51.450657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:51.450661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:51.450738Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3040 [2:7555896869246002208:6531]
2025-09-30T14:58:51.450762Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:51.450779Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:51.450789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:51.450792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:51.450794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:51.450811Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:51.450824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:51.450832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:51.450900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.450908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.450911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.450915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:51.450918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:51.451001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:51.451013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.451027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.451039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.451055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:51.451074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803503:2454], now have 1 active actors on pipe
2025-09-30T14:58:51.451078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803636:9360], now have 1 active actors on pipe
2025-09-30T14:58:51.451084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896869246002203:6531]
2025-09-30T14:58:51.451086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896869246002203:6531]
2025-09-30T14:58:51.451088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896869246002203:6531]
2025-09-30T14:58:51.451104Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:51.451121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:51.451140Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:51.451152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:51.451195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896869246002203:6531]
2025-09-30T14:58:51.451203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:51.451335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3040
2025-09-30T14:58:51.451391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3040
2025-09-30T14:58:51.451256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:51.451265Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:51.451267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:51.451275Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:51.451462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.451473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.451502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37078e4d-270981b8-f0caf35c-3de47cab_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:51.451511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:51.451514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:51.451516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:51.451529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:51.451543Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:51.451559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:51.451939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.451953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.451972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:51.452077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3041 partition: 0 MaxSeqNo: 42 sessionId: src_id|37078e4d-270981b8-f0caf35c-3de47cab_0
2025-09-30T14:58:51.452464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27332f31-28306c5d-efd8e372-8302bcc5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|37078e4d-270981b8-f0caf35c-3de47cab_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:51.455415Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37078e4d-270981b8-f0caf35c-3de47cab_0] Write session: try to update token
2025-09-30T14:58:51.455437Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37078e4d-270981b8-f0caf35c-3de47cab_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:51.464281Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:51.464307Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:51.464319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896869246002203:6531]
2025-09-30T14:58:51.464366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:51.464703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:51.468566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:51.468773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:51.468950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:51.469118Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:51.469358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:51.469412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:51.480662Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:51.480685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:51.480701Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:51.480703Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:51.480712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896869246002203:6531]
2025-09-30T14:58:51.480716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896869246002203:6531]
2025-09-30T14:58:51.480719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896869246002203:6531]
2025-09-30T14:58:51.480758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:51.480764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:51.480766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.480768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:51.480769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:51.480773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:51.480900Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:51.481605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3041 sessionId: src_id|37078e4d-270981b8-f0caf35c-3de47cab_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:51.484385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:51.515572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896869335803644:9657]
2025-09-30T14:58:51.516044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3040, pipe: [1:7555896869335803644:9657]
2025-09-30T14:58:51.600038Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:51.600569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.600579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.600601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803644:9657], now have 1 active actors on pipe
2025-09-30T14:58:51.600997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:51.601036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896869335803644:9657]
2025-09-30T14:58:51.601088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:51.601091Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:51.601166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3041 reason: error at write: Disconnected sessionId: src_id|37078e4d-270981b8-f0caf35c-3de47cab_0
2025-09-30T14:58:51.601370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3041 sessionId: src_id|37078e4d-270981b8-f0caf35c-3de47cab_0 is DEAD
2025-09-30T14:58:51.601381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:51.603497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37078e4d-270981b8-f0caf35c-3de47cab_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:51.603506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37078e4d-270981b8-f0caf35c-3de47cab_0] Write session will restart in 0.005529s
2025-09-30T14:58:51.603532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37078e4d-270981b8-f0caf35c-3de47cab_0] Write session: Do CDS request
2025-09-30T14:58:51.603543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37078e4d-270981b8-f0caf35c-3de47cab_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:51.611047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37078e4d-270981b8-f0caf35c-3de47cab_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:51.611178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:51.611210Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3042
2025-09-30T14:58:51.611414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3042 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:51.611468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3042 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:51.611481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3042 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:51.611487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:51.611994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3042 sessionId:  describe result for acl check
2025-09-30T14:58:51.612042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:51.612050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:51.612052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:51.612058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896869335803662:9356] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:51.612637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896869335803662:9356] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:51.615113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896869335803662:9356] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:51.618879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896869335803662:9356] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:51.618906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896869335803662:9356] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:51.618909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896869335803662:9356] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:51.618918Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3042 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:51.621383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:51.623271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:51.623545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:51.623555Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:51.623566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:51.623637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:51.623681Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896869246002344:6540]
2025-09-30T14:58:51.624344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:51.624811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:51.624883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:51.625246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:51.625325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.625331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.625332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.625334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.625335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.625336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.625338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.625339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.625341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.625342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.625344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.625345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.625346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.625347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.625348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.625354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.625365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.625369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.625374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.625378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.625383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.625387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.625391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.625395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.625400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.625404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.625407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.625410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.625414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.625417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.625426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.625434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.625440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.625446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.625450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.625455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.625460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.625465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.625469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.625474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.625479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.625483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.625488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.625492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.625509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.625514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.625519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.625524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.625528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.625533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.625540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.625545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.625549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.625554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.625559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.625563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.625567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.625572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.625577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.625582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.625632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:51.633300Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3041
2025-09-30T14:58:51.633349Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3041
2025-09-30T14:58:51.631709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:51.632903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:51.632912Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:51.632915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:51.632920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:51.632928Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3041 [2:7555896869246002344:6540]
2025-09-30T14:58:51.632946Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:51.632969Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:51.632974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:51.632978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:51.632981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:51.632999Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:51.633009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:51.633018Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:51.633092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.633095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.633097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.633101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:51.633104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:51.633180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:51.633183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.633198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.633212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.633231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:51.633251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803771:9356], now have 1 active actors on pipe
2025-09-30T14:58:51.633255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803647:2454], now have 1 active actors on pipe
2025-09-30T14:58:51.633261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896869246002339:6540]
2025-09-30T14:58:51.633264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896869246002339:6540]
2025-09-30T14:58:51.633265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896869246002339:6540]
2025-09-30T14:58:51.633282Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:51.633297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:51.633312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:51.633316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:51.633323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:51.633329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:51.633331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:51.633356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896869246002339:6540]
2025-09-30T14:58:51.633358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:51.633371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:51.633374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.633380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.633438Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:51.633450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:51.633454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:51.633456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:51.633468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:51.633480Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:51.633507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:51.633734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.633743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.633774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:51.633916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3042 partition: 0 MaxSeqNo: 42 sessionId: src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0
2025-09-30T14:58:51.634319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37078e4d-270981b8-f0caf35c-3de47cab_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:51.637467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0] Write session: try to update token
2025-09-30T14:58:51.637490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:51.648844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:51.648866Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:51.648870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:51.648872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:51.648882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896869246002339:6540]
2025-09-30T14:58:51.648887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896869246002339:6540]
2025-09-30T14:58:51.648891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896869246002339:6540]
2025-09-30T14:58:51.648935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:51.648942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.648945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:51.648950Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:51.648958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:51.648964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:51.649139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:51.661008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3042 sessionId: src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:51.663959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:51.701022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896869335803801:9657]
2025-09-30T14:58:51.701307Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3041, pipe: [1:7555896869335803801:9657]
2025-09-30T14:58:51.784676Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:51.785055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.785071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.785091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803801:9657], now have 1 active actors on pipe
2025-09-30T14:58:51.785354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896869335803801:9657]
2025-09-30T14:58:51.785404Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:51.785407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:51.785504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3042 reason: error at write: Disconnected sessionId: src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0
2025-09-30T14:58:51.785724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3042 sessionId: src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0 is DEAD
2025-09-30T14:58:51.785885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:51.785897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0] Write session will restart in 0.009612s
2025-09-30T14:58:51.785902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:51.785922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0] Write session: Do CDS request
2025-09-30T14:58:51.785929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:51.786135Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:51.797788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:51.797983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:51.798017Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3043
2025-09-30T14:58:51.802808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:51.798168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3043 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:51.798214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3043 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:51.798220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3043 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:51.798224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:51.798646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3043 sessionId:  describe result for acl check
2025-09-30T14:58:51.798677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:51.798680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:51.798682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:51.798689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896869335803859:9336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:51.799300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896869335803859:9336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:51.805408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896869335803859:9336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:51.806807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:51.807077Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:51.807089Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:51.807100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:51.807165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:51.807213Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896869246002490:6538]
2025-09-30T14:58:51.807997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:51.808330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:51.808386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:51.808740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:51.808371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896869335803859:9336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:51.808823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.808830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.808831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.808394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896869335803859:9336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:51.808833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.808834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.808836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.808398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896869335803859:9336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:51.808837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.808406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3043 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:51.808839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.808840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.808842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.808843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.808845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.808847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.808848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.808850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.808855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.808865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.808870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.808875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.808879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.808884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.808888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.808892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.808896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.808901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.808905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.808909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.808913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.808918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.808921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.808931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.808939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.808945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.808951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.808956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.808962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.808970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.808976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.808982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.808987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.808993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.808999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.809004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.809009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.809014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.809019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.809025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.809031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.809036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.809042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.809047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.809054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.809062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.809068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.809074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.809081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.809085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.809091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.809096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.809108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.809169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:51.816545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:51.817474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:51.817481Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:51.817487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:51.817491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:51.817497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3042 [2:7555896869246002490:6538]
2025-09-30T14:58:51.817513Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:51.817530Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:51.817534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:51.817537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:51.817539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:51.817556Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:51.817562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:51.817568Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:51.817635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.817637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.817640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.817643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:51.817646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:51.817728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:51.817730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.817748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.817761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.817778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:51.817797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896869246002483:6538]
2025-09-30T14:58:51.817800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896869246002483:6538]
2025-09-30T14:58:51.817802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896869246002483:6538]
2025-09-30T14:58:51.817813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:51.817827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:51.817829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:51.817833Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:51.817836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:51.817842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:51.817844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:51.817854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803807:2454], now have 1 active actors on pipe
2025-09-30T14:58:51.817858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803950:9336], now have 1 active actors on pipe
2025-09-30T14:58:51.817946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896869246002483:6538]
2025-09-30T14:58:51.817960Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:51.818215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:51.822238Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3042
2025-09-30T14:58:51.822294Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3042
2025-09-30T14:58:51.822471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.822490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.822533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|93715393-64d83c95-cf2b0164-ed4a8764_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:51.822545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:51.822557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:51.822560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:51.822573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:51.822588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:51.822613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:51.822903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.822914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.822929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:51.823081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3043 partition: 0 MaxSeqNo: 42 sessionId: src_id|93715393-64d83c95-cf2b0164-ed4a8764_0
2025-09-30T14:58:51.823547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83efd4ea-2b60a881-1ec31fbb-f74caaff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|93715393-64d83c95-cf2b0164-ed4a8764_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:51.826559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93715393-64d83c95-cf2b0164-ed4a8764_0] Write session: try to update token
2025-09-30T14:58:51.826581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93715393-64d83c95-cf2b0164-ed4a8764_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:51.836093Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:51.836111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:51.836119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896869246002483:6538]
2025-09-30T14:58:51.836166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:51.836180Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:51.836347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:51.836518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:51.836683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:51.836933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:51.837142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:51.837194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:51.848409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:51.848433Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:51.848436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:51.848438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:51.848451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896869246002483:6538]
2025-09-30T14:58:51.848456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896869246002483:6538]
2025-09-30T14:58:51.848461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896869246002483:6538]
2025-09-30T14:58:51.848505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:51.848513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.848516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:51.848515Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:51.848524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:51.848530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:51.848670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:51.853744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3043 sessionId: src_id|93715393-64d83c95-cf2b0164-ed4a8764_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:51.856802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:51.884730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896869335803970:9657]
2025-09-30T14:58:51.885187Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3042, pipe: [1:7555896869335803970:9657]
2025-09-30T14:58:51.965183Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:51.965888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.965901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.965919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803970:9657], now have 1 active actors on pipe
2025-09-30T14:58:51.966199Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:51.966634Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93715393-64d83c95-cf2b0164-ed4a8764_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:51.966647Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93715393-64d83c95-cf2b0164-ed4a8764_0] Write session will restart in 0.009411s
2025-09-30T14:58:51.966675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93715393-64d83c95-cf2b0164-ed4a8764_0] Write session: Do CDS request
2025-09-30T14:58:51.966681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93715393-64d83c95-cf2b0164-ed4a8764_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:51.966182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:51.966211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896869335803970:9657]
2025-09-30T14:58:51.966231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:51.966234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:51.966293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3043 reason: error at write: Disconnected sessionId: src_id|93715393-64d83c95-cf2b0164-ed4a8764_0
2025-09-30T14:58:51.966462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3043 sessionId: src_id|93715393-64d83c95-cf2b0164-ed4a8764_0 is DEAD
2025-09-30T14:58:51.977815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|93715393-64d83c95-cf2b0164-ed4a8764_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:51.977811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:51.977892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:51.977910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3044
2025-09-30T14:58:51.978070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3044 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:51.978116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3044 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:51.978128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3044 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:51.978132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:51.978554Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3044 sessionId:  describe result for acl check
2025-09-30T14:58:51.978588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:51.978596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:51.978598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:51.978604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896869335804072:9330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:51.979161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896869335804072:9330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:51.979555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:51.979775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:51.979785Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:51.979796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:51.979851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:51.979890Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896869246002649:6504]
2025-09-30T14:58:51.980535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:51.980868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:51.980913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:51.981278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:51.981343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.981349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.981350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.981351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.981353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.981354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.981374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896869335804072:9330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:51.981355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.981357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.981358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.981359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.981361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.981363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.981364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.981365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.981366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.981372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.981383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.981387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.981392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.981396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.981400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.981405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.981409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.981413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.981418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.981422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.981426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.981430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.981434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.981438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.981445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.981454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:51.981460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.981466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:51.981472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.981477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:51.981482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.981488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:51.981493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.981499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:51.981504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.981509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:51.981514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.981520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:51.981526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.981531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:51.981536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.981554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:51.981559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.981564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:51.981569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.981574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.981579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.981584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.981591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.981597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.981601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.981607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:51.981612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.981620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:51.981669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:51.986909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896869335804072:9330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:51.986929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896869335804072:9330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:51.986932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896869335804072:9330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:51.986941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3044 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:51.987178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:51.988485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:51.988502Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:51.988505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:51.988509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:51.988516Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3043 [2:7555896869246002649:6504]
2025-09-30T14:58:51.988536Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:51.988549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:51.988552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:51.988555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:51.988557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:51.988572Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:51.988579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:51.988585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:51.988643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.988657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.988659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.988662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:51.988664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:51.988741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:51.988749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:51.988760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:51.988774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:51.988790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:51.988811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335804106:9330], now have 1 active actors on pipe
2025-09-30T14:58:51.988821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896869335803974:2454], now have 1 active actors on pipe
2025-09-30T14:58:51.988826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896869246002643:6504]
2025-09-30T14:58:51.988830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896869246002643:6504]
2025-09-30T14:58:51.988832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896869246002643:6504]
2025-09-30T14:58:51.988847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:51.988858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:51.988870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:51.988875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:51.988877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:51.988859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3043
2025-09-30T14:58:51.988886Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:51.988898Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3043
2025-09-30T14:58:51.988894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:51.988922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.988927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.988938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896869246002643:6504]
2025-09-30T14:58:51.988946Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:51.988968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:51.988970Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb92970-b866729f-c8720238-3d284d5e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:51.988976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:51.988981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:51.988983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:51.988992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:51.989000Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:51.989022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:51.989312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:51.989325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:51.989347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:51.989441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3044 partition: 0 MaxSeqNo: 42 sessionId: src_id|bb92970-b866729f-c8720238-3d284d5e_0
2025-09-30T14:58:51.989843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|93715393-64d83c95-cf2b0164-ed4a8764_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bb92970-b866729f-c8720238-3d284d5e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:51.992638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb92970-b866729f-c8720238-3d284d5e_0] Write session: try to update token
2025-09-30T14:58:51.992656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb92970-b866729f-c8720238-3d284d5e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:52.005086Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:52.005107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:52.005110Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:52.005112Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:52.005122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896869246002643:6504]
2025-09-30T14:58:52.005128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896869246002643:6504]
2025-09-30T14:58:52.005132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896869246002643:6504]
2025-09-30T14:58:52.005198Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:52.005205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:52.005209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:52.005246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:52.005263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.005266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:52.005443Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:52.008310Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3044 sessionId: src_id|bb92970-b866729f-c8720238-3d284d5e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:52.011222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:52.066523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896873630771411:9657]
2025-09-30T14:58:52.067826Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3043, pipe: [1:7555896873630771411:9657]
2025-09-30T14:58:52.122386Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:52.122812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.122823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.122865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630771411:9657], now have 1 active actors on pipe
2025-09-30T14:58:52.123367Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:52.124411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb92970-b866729f-c8720238-3d284d5e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:52.124423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb92970-b866729f-c8720238-3d284d5e_0] Write session will restart in 0.008665s
2025-09-30T14:58:52.124447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb92970-b866729f-c8720238-3d284d5e_0] Write session: Do CDS request
2025-09-30T14:58:52.124453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb92970-b866729f-c8720238-3d284d5e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:52.123408Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:52.123428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:52.123494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3044 reason: error at write: Disconnected sessionId: src_id|bb92970-b866729f-c8720238-3d284d5e_0
2025-09-30T14:58:52.123623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:52.123665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896873630771411:9657]
2025-09-30T14:58:52.123670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3044 sessionId: src_id|bb92970-b866729f-c8720238-3d284d5e_0 is DEAD
2025-09-30T14:58:52.134839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb92970-b866729f-c8720238-3d284d5e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:52.134986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:52.135007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3045
2025-09-30T14:58:52.139369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3045 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:52.139422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3045 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:52.139428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3045 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:52.139433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:52.140149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3045 sessionId:  describe result for acl check
2025-09-30T14:58:52.140187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:52.140194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:52.140196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:52.140202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896873630771510:9323] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:52.140870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896873630771510:9323] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:52.143821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896873630771510:9323] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:52.146231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:52.148608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:52.148792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896873630771510:9323] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:52.148813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896873630771510:9323] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:52.148816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896873630771510:9323] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:52.148826Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3045 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:52.148924Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:52.148935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:52.148948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:52.149015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:52.149058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896873540970082:6505]
2025-09-30T14:58:52.149777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:52.150176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:52.150261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:52.150625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:52.150723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.150733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.150734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.150736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.150737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.150739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.150741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.150742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.150744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.150745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.150747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.150749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.150750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.150752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.150753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.150760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.150771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.150776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.150780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.150785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.150789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.150794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.150799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.150804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.150810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.150815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.150819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.150823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.150827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.150832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.150849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.150862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.150873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.150879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.150890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.150894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.150903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.150909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.150915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.150925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.150931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.150940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.150945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.150950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.150955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.150965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.150974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.150983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.150988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.150999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.151004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.151013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.151018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.151027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.151032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.151038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.151042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.151047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.151054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.151059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.151114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:52.156933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:52.158006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:52.158022Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:52.158025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:52.158500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3044
2025-09-30T14:58:52.158029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:52.158037Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3044 [2:7555896873540970082:6505]
2025-09-30T14:58:52.158056Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:52.158500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3044
2025-09-30T14:58:52.158074Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:52.158078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:52.158082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:52.158088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:52.158105Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:52.158112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:52.158121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:52.158180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.158182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.158184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.158188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:52.158190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:52.158265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:52.158268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.158281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.158292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.158308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:52.158324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630771546:9323], now have 1 active actors on pipe
2025-09-30T14:58:52.158331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896873540970076:6505]
2025-09-30T14:58:52.158334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896873540970076:6505]
2025-09-30T14:58:52.158336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896873540970076:6505]
2025-09-30T14:58:52.158352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:52.158362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630771413:2454], now have 1 active actors on pipe
2025-09-30T14:58:52.158370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:52.158384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:52.158387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:52.158384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:52.158397Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:52.158399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:52.158422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896873540970076:6505]
2025-09-30T14:58:52.158425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:52.158428Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:52.158954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.158965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.158991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:52.158999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:52.159006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:52.159009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:52.159019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:52.159029Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:52.159048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:52.159281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.159292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.159307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:52.159386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3045 partition: 0 MaxSeqNo: 42 sessionId: src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0
2025-09-30T14:58:52.159748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb92970-b866729f-c8720238-3d284d5e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:52.162649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0] Write session: try to update token
2025-09-30T14:58:52.162669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:52.171861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:52.171885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:52.171899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896873540970076:6505]
2025-09-30T14:58:52.171953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:52.172013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:52.172200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:52.172381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:52.172554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:52.172761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:52.173014Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:52.173057Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:52.179048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3045 sessionId: src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:52.182996Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:52.187495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.187523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.187578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:52.187714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:52.190050Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:52.190074Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:52.190077Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:52.190079Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:52.190093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896873540970076:6505]
2025-09-30T14:58:52.190176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896873540970076:6505]
2025-09-30T14:58:52.190187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896873540970076:6505]
2025-09-30T14:58:52.190232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:52.190244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.190247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:52.190245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:52.190253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:52.190257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:52.190394Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:52.223701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896873630771558:9657]
2025-09-30T14:58:52.224017Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3044, pipe: [1:7555896873630771558:9657]
2025-09-30T14:58:52.327106Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:52.341366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.341400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.341632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:52.341715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:52.342423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:52.342508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:52.343275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:52.343289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:52.343383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:52.343446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:52.343518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:52.343591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:52.343637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:52.343640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:52.343719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:52.343785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:52.343856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:52.343931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:52.343983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:52.343987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:52.344063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:52.344138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:52.344219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:52.344290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:52.344336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:52.344339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:52.344430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:52.344527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:52.344611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:52.344722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:52.344786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:52.344791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:52.344899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:52.344984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:52.345063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:52.345149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:52.345203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:52.345206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:52.345923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:52.347311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:52.347397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:52.347475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:52.347541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:52.347545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:52.347628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:52.347698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:52.347766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:52.347834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:52.347882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:52.347886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:52.347973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:52.348038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:52.348125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:52.348191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:52.348240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:52.348242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:52.348322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:58:52.348392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:58:52.348459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:58:52.348534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:58:52.348581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:58:52.348585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:58:52.348676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630771558:9657], now have 1 active actors on pipe
2025-09-30T14:58:52.349794Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:52.350199Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896873630771558:9657]
2025-09-30T14:58:52.350247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:52.350286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3045 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0
2025-09-30T14:58:52.350471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3045 sessionId: src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0 is DEAD
2025-09-30T14:58:52.350615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:52.350880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:52.350888Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0] Write session will restart in 0.007818s
2025-09-30T14:58:52.350914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0] Write session: Do CDS request
2025-09-30T14:58:52.350921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:52.359961Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:52.360450Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:52.360470Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3046
2025-09-30T14:58:52.360708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3046 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:52.360749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3046 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:52.360752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3046 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:52.360755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:52.362084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3046 sessionId:  describe result for acl check
2025-09-30T14:58:52.362123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:52.362131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:52.362132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:52.362150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896873630771574:9318] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:52.362695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896873630771574:9318] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:52.379777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896873630771574:9318] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:52.382700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896873630771574:9318] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:52.382718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896873630771574:9318] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:52.382720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896873630771574:9318] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:52.382727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3046 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:52.389184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:52.391501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:52.391738Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:52.391748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:52.391759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:52.391815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:52.391852Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896873540970219:6513]
2025-09-30T14:58:52.392519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:52.392815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:52.392873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:52.393223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:52.393281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.393282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.393283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.393285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.393286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.393288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.393289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.393291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.393293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.393294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.393296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.393297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.393298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.393300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.393301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.393308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.393319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.393324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.393329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.393334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.393339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.393345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.393349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.393354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.393359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.393364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.393369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.393374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.393379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.393384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.393392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.393401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.393407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.393414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.393420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.393426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.393432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.393438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.393444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.393451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.393456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.393462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.393468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.393474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.393479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.393487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.393493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.393499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.393505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.393511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.393516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.393524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.393530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.393535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.393544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.393550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.393557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.393564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.393570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.393576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.393621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:52.400091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:52.401345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:52.401372Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:52.401375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:52.401380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:52.401388Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3045 [2:7555896873540970219:6513]
2025-09-30T14:58:52.401411Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:52.401431Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:52.401434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:52.401438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:52.401441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:52.401459Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:52.401469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:52.401482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:52.401555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.401566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.401568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.401572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:52.401574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:52.401654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:52.401662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.401680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.401697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.401720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:52.401745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630771566:2454], now have 1 active actors on pipe
2025-09-30T14:58:52.401754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630771645:9318], now have 1 active actors on pipe
2025-09-30T14:58:52.401763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896873540970213:6513]
2025-09-30T14:58:52.401769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896873540970213:6513]
2025-09-30T14:58:52.401771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896873540970213:6513]
2025-09-30T14:58:52.401787Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:52.401809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:52.401829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:52.401836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:52.401876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896873540970213:6513]
2025-09-30T14:58:52.401883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:52.401929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:52.401950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:52.401952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:52.401960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:52.402128Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3045
2025-09-30T14:58:52.402188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3045
2025-09-30T14:58:52.402309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.402322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.402352Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:52.402361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:52.402366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:52.402369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:52.402382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:52.402396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:52.402415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:52.402589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.402600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.402635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:52.402755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3046 partition: 0 MaxSeqNo: 42 sessionId: src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0
2025-09-30T14:58:52.403188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c2166c41-a7ec7867-c453517c-cb51b46d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:52.406433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0] Write session: try to update token
2025-09-30T14:58:52.406462Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:52.415291Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:52.415311Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:52.415323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896873540970213:6513]
2025-09-30T14:58:52.415370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:52.415563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:52.415726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:52.415786Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:52.415879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:52.416054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:52.416516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:52.416571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:52.429183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:52.429206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:52.429209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:52.429215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:52.429226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896873540970213:6513]
2025-09-30T14:58:52.429234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896873540970213:6513]
2025-09-30T14:58:52.429238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896873540970213:6513]
2025-09-30T14:58:52.429281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:52.429287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.429289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:52.429294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:52.429304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:52.429308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:52.429436Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:52.431735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3046 sessionId: src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:52.434938Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:52.448529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896873630771714:9657]
2025-09-30T14:58:52.449922Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3045, pipe: [1:7555896873630771714:9657]
2025-09-30T14:58:52.547314Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:52.547769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.547786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.547808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630771714:9657], now have 1 active actors on pipe
2025-09-30T14:58:52.548563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:52.548667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3046 reason: status is not ok: tablet will be restarted right now sessionId: src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0
2025-09-30T14:58:52.548857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3046 sessionId: src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0 is DEAD
2025-09-30T14:58:52.549041Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:52.549054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0] Write session will restart in 0.006390s
2025-09-30T14:58:52.549009Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896873630771714:9657]
2025-09-30T14:58:52.549029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:52.549080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0] Write session: Do CDS request
2025-09-30T14:58:52.549086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:52.548039Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:52.557347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:52.557454Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:52.557476Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3047
2025-09-30T14:58:52.557640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3047 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:52.557674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3047 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:52.557679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3047 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:52.557685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:52.558154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3047 sessionId:  describe result for acl check
2025-09-30T14:58:52.558192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:52.558195Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:52.558197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:52.558202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896873630771732:9308] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:52.558740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896873630771732:9308] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:52.562906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896873630771732:9308] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:52.567582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:52.568271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896873630771732:9308] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:52.568292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896873630771732:9308] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:52.568295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896873630771732:9308] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:52.568304Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3047 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:52.569609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:52.569835Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:52.569839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:52.569849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:52.569901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:52.569960Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896873540970368:6506]
2025-09-30T14:58:52.570635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:52.571013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:52.571064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:52.571434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:52.571508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.571510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.571511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.571512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.571514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.571515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.571517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.571518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.571519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.571521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.571523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.571524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.571525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.571526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.571527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.571533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.571544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.571549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.571553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.571557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.571561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.571564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.571567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.571571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.571575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.571579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.571582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.571586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.571590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.571594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.571602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.571611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.571618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.571624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.571631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.571637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.571641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.571647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.571653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.571658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.571664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.571670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.571675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.571680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.571685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.571691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.571696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.571702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.571706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.571713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.571718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.571723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.571729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.571755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.571775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.571780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.571786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.571791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.571797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.571802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.571851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:52.581520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:52.582661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:52.582669Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:52.582672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:52.582676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:52.582684Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3046 [2:7555896873540970368:6506]
2025-09-30T14:58:52.582702Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:52.582720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:52.582723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:52.582727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:52.582729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:52.582749Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:52.582756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:52.582764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:52.582836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.582840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.582842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.582846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:52.582848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:52.582928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:52.582931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.582947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.582959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.582979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:52.583000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630771717:2454], now have 1 active actors on pipe
2025-09-30T14:58:52.583007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896873540970362:6506]
2025-09-30T14:58:52.583010Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896873540970362:6506]
2025-09-30T14:58:52.583012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896873540970362:6506]
2025-09-30T14:58:52.583020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:52.583035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:52.583046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:52.583051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:52.583052Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:52.583053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:52.583055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:52.583060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630771852:9308], now have 1 active actors on pipe
2025-09-30T14:58:52.583102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896873540970362:6506]
2025-09-30T14:58:52.583110Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:52.583196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:52.583323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3046
2025-09-30T14:58:52.583374Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3046
2025-09-30T14:58:52.583763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.583778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.583816Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b36ab99-34319b2d-b402c461-bf67569e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:52.583829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:52.583837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:52.583839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:52.583851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:52.583868Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:52.583884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:52.584351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.584361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.584382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:52.584477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3047 partition: 0 MaxSeqNo: 42 sessionId: src_id|9b36ab99-34319b2d-b402c461-bf67569e_0
2025-09-30T14:58:52.587570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|327f351e-ccfb1c7b-9189511c-b1f20935_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9b36ab99-34319b2d-b402c461-bf67569e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:52.590588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b36ab99-34319b2d-b402c461-bf67569e_0] Write session: try to update token
2025-09-30T14:58:52.590615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b36ab99-34319b2d-b402c461-bf67569e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:52.598569Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:52.598594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:52.598596Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:52.598599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:52.598609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896873540970362:6506]
2025-09-30T14:58:52.598614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896873540970362:6506]
2025-09-30T14:58:52.598620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896873540970362:6506]
2025-09-30T14:58:52.598664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:52.598669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:52.598672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.598675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:52.598675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:52.598679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:52.598823Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:52.618442Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3047 sessionId: src_id|9b36ab99-34319b2d-b402c461-bf67569e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:52.621760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:52.649165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896873630771875:9657]
2025-09-30T14:58:52.649763Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3046, pipe: [1:7555896873630771875:9657]
2025-09-30T14:58:52.723297Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:52.723751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.723761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.723783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630771875:9657], now have 1 active actors on pipe
2025-09-30T14:58:52.724062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896873630771875:9657]
2025-09-30T14:58:52.724078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:52.724109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:52.724111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:52.724179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3047 reason: error at write: Disconnected sessionId: src_id|9b36ab99-34319b2d-b402c461-bf67569e_0
2025-09-30T14:58:52.724373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3047 sessionId: src_id|9b36ab99-34319b2d-b402c461-bf67569e_0 is DEAD
2025-09-30T14:58:52.724080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:52.724738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b36ab99-34319b2d-b402c461-bf67569e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:52.724746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b36ab99-34319b2d-b402c461-bf67569e_0] Write session will restart in 0.009126s
2025-09-30T14:58:52.724771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b36ab99-34319b2d-b402c461-bf67569e_0] Write session: Do CDS request
2025-09-30T14:58:52.724780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b36ab99-34319b2d-b402c461-bf67569e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:52.734858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b36ab99-34319b2d-b402c461-bf67569e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:52.734934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:52.734955Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3048
2025-09-30T14:58:52.735118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3048 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:52.735166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3048 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:52.735177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3048 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:52.735181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:52.735748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3048 sessionId:  describe result for acl check
2025-09-30T14:58:52.735797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:52.735805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:52.735807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:52.735814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896873630771894:9302] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:52.736391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896873630771894:9302] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:52.739130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896873630771894:9302] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:52.743705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896873630771894:9302] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:52.743730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896873630771894:9302] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:52.743733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896873630771894:9302] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:52.743769Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3048 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:52.749227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:52.751306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:52.751528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:52.751546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:52.751559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:52.751612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:52.751659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896873540970508:6507]
2025-09-30T14:58:52.752367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:52.752746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:52.752803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:52.753143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:52.753210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.753218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.753219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.753220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.753221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.753223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.753224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.753226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.753227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.753228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.753230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.753231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.753232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.753233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.753235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.753241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.753252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.753256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.753261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.753265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.753270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.753274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.753278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.753282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.753287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.753292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.753296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.753300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.753303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.753308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.753315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.753323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.753330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.753336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.753341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.753346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.753351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.753357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.753362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.753368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.753373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.753378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.753385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.753391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.753395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.753401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.753406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.753413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.753419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.753432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.753439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.753445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.753450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.753456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.753460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.753466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.753470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.753474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.753478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.753483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.753519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:52.759440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:52.760751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:52.760769Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:52.760772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:52.760776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:52.760783Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3047 [2:7555896873540970508:6507]
2025-09-30T14:58:52.760800Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:52.760819Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:52.760822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:52.760826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:52.760829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:52.760848Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:52.760855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:52.760863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:52.760926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.760936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.760938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.760943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:52.760946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:52.761020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:52.761029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.761042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.761062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.761078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:52.761096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630771877:2454], now have 1 active actors on pipe
2025-09-30T14:58:52.761105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630771990:9302], now have 1 active actors on pipe
2025-09-30T14:58:52.761111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896873540970503:6507]
2025-09-30T14:58:52.761113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896873540970503:6507]
2025-09-30T14:58:52.761116Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896873540970503:6507]
2025-09-30T14:58:52.761130Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:52.761150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:52.761153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:52.761153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:52.761155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:52.761154Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3047
2025-09-30T14:58:52.761168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:52.761171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:52.761161Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3047
2025-09-30T14:58:52.761214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896873540970503:6507]
2025-09-30T14:58:52.761221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:52.761228Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:52.761235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.761240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.761285Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:52.761295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:52.761298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:52.761300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:52.761308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:52.761317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:52.761334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:52.761531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.761546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.761569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:52.762310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3048 partition: 0 MaxSeqNo: 42 sessionId: src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0
2025-09-30T14:58:52.762681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b36ab99-34319b2d-b402c461-bf67569e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:52.765599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0] Write session: try to update token
2025-09-30T14:58:52.765619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:52.775147Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:52.775167Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:52.775169Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:52.775170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:52.775177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896873540970503:6507]
2025-09-30T14:58:52.775181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896873540970503:6507]
2025-09-30T14:58:52.775184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896873540970503:6507]
2025-09-30T14:58:52.775224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:52.775232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.775235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:52.775240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:52.775263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:52.775267Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:52.775387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:52.789198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3048 sessionId: src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:52.792382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:52.824272Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896873630772027:9657]
2025-09-30T14:58:52.824577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3047, pipe: [1:7555896873630772027:9657]
2025-09-30T14:58:52.890576Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:52.890921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.890934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.890951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630772027:9657], now have 1 active actors on pipe
2025-09-30T14:58:52.891126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:52.891132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:52.891184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896873630772027:9657]
2025-09-30T14:58:52.891200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:52.891282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3048 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0
2025-09-30T14:58:52.891482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3048 sessionId: src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0 is DEAD
2025-09-30T14:58:52.891781Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:52.891793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0] Write session will restart in 0.006469s
2025-09-30T14:58:52.891818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0] Write session: Do CDS request
2025-09-30T14:58:52.891824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:52.899835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:52.900956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:52.900976Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3049
2025-09-30T14:58:52.901154Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3049 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:52.901212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3049 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:52.901223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3049 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:52.901228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:52.901709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3049 sessionId:  describe result for acl check
2025-09-30T14:58:52.901750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:52.901757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:52.901759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:52.901765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896873630772154:9288] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:52.902295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896873630772154:9288] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:52.902346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:52.904441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896873630772154:9288] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:52.904509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:52.904825Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:52.904836Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:52.904849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:52.904910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:52.904950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896873540970683:6485]
2025-09-30T14:58:52.905618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:52.905911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:52.905950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:52.906279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:52.906336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.906343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.906344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.906345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.906347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.906348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.906350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.906351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.906353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.906354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.906355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.906356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.906357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.906358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.906360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.906365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.906375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.906379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.906384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.906388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.906392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.906396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.906402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.906406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.906410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.906414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.906418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.906422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.906426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.906430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.906438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.906445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:52.906456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.906462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:52.906471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.906476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:52.906481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.906486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:52.906493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.906502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:52.906509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.906518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:52.906523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.906533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:52.906537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.906545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:52.906549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.906559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:52.906564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.906569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:52.906574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.906584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.906588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.906594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.906599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.906604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.906608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.906613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:52.906622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.906627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:52.906676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:52.907556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896873630772154:9288] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:52.907573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896873630772154:9288] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:52.907577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896873630772154:9288] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:52.907585Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3049 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:52.912166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:52.913200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:52.913216Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:52.913218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:52.913223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:52.913230Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3048 [2:7555896873540970683:6485]
2025-09-30T14:58:52.913247Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:52.913263Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:52.913266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:52.913269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:52.913272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:52.913287Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:52.913299Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:52.913307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:52.913382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.913404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.913412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.913415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:52.913418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:52.913491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:52.913499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.913515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:52.913527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:52.913545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:52.913565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630772192:9288], now have 1 active actors on pipe
2025-09-30T14:58:52.913575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630772054:2454], now have 1 active actors on pipe
2025-09-30T14:58:52.913581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896873540970677:6485]
2025-09-30T14:58:52.913588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896873540970677:6485]
2025-09-30T14:58:52.913590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896873540970677:6485]
2025-09-30T14:58:52.913604Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:52.913617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:52.913625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:52.913629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:52.913631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:52.913635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:52.913638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:52.913676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3048
2025-09-30T14:58:52.913716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3048
2025-09-30T14:58:52.913731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896873540970677:6485]
2025-09-30T14:58:52.913742Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:52.913747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:52.913771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.913776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.913815Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:52.913830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:52.913835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:52.913837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:52.913848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:52.913863Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:52.913886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:52.914137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:52.914144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:52.914159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:52.914491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3049 partition: 0 MaxSeqNo: 42 sessionId: src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0
2025-09-30T14:58:52.914871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1da2eea6-ecfc0ea3-6e3419ff-1a9c0c4b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:52.917971Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0] Write session: try to update token
2025-09-30T14:58:52.918000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:52.929079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:52.929106Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:52.929108Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:52.929111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:52.929122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896873540970677:6485]
2025-09-30T14:58:52.929128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896873540970677:6485]
2025-09-30T14:58:52.929133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896873540970677:6485]
2025-09-30T14:58:52.929179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:52.929186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:52.929189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:52.929201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:52.929209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:52.929213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:52.929397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:52.936068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3049 sessionId: src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:52.939012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:52.991163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896873630772199:9657]
2025-09-30T14:58:52.991467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3048, pipe: [1:7555896873630772199:9657]
2025-09-30T14:58:53.045748Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:53.046116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.046127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.046587Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:53.046593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:53.046598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:53.046661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896873630772199:9657]
2025-09-30T14:58:53.046671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3049 reason: error at write: Disconnected sessionId: src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0
2025-09-30T14:58:53.046171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896873630772199:9657], now have 1 active actors on pipe
2025-09-30T14:58:53.046675Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:53.047005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:53.047013Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0] Write session will restart in 0.005426s
2025-09-30T14:58:53.047036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0] Write session: Do CDS request
2025-09-30T14:58:53.047042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:53.046850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3049 sessionId: src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0 is DEAD
2025-09-30T14:58:53.053784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:53.053900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:53.053921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3050
2025-09-30T14:58:53.057677Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3050 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:53.057735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3050 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:53.057741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3050 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:53.057745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:53.059193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3050 sessionId:  describe result for acl check
2025-09-30T14:58:53.059258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:53.059264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:53.059265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:53.059271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896877925739576:9281] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:53.059777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896877925739576:9281] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:53.062383Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896877925739576:9281] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:53.064446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:53.066898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896877925739576:9281] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:53.066916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896877925739576:9281] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:53.066920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896877925739576:9281] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:53.066930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3050 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:53.066670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:53.066889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:53.066893Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:53.066904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:53.066955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:53.066990Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896877835938120:6479]
2025-09-30T14:58:53.067603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:53.067972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:53.068034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:53.068395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:53.068652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.068666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.068667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.068668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.068670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.068671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.068673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.068674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.068675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.068677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.068690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.068692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.068693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.068695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.068696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.068702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.068715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.068720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.068725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.068729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.068734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.068739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.068743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.068747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.068752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.068757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.068762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.068767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.068771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.068783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.068792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.068803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.068810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.068816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.068827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.068834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.068845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.068855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.068861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.068872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.068881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.068891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.068896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.068902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.068906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.068916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.068926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.068936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.068945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.068951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.068961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.068971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.068975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.068986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.068995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.069005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.069013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.069019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.069028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.069038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.069085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:53.075624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:53.076510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:53.076530Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:53.076533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:53.076538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:53.076545Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3049 [2:7555896877835938120:6479]
2025-09-30T14:58:53.076562Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:53.076585Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:53.076596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:53.076599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:53.076601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:53.076618Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:53.076624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:53.076631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:53.076715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.076722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.076727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.076731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:53.076734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:53.076806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:53.076813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.076825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.076840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.076855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:53.076873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896877835938115:6479]
2025-09-30T14:58:53.076875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896877835938115:6479]
2025-09-30T14:58:53.076877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896877835938115:6479]
2025-09-30T14:58:53.076887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:53.076902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:53.076915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:53.076914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:53.076918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:53.076920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:53.076923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:53.076927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925739497:2454], now have 1 active actors on pipe
2025-09-30T14:58:53.076932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925739636:9281], now have 1 active actors on pipe
2025-09-30T14:58:53.076963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896877835938115:6479]
2025-09-30T14:58:53.076977Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:53.077011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:53.077144Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3049
2025-09-30T14:58:53.077200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3049
2025-09-30T14:58:53.077310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.077324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.077356Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:53.077369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:53.077377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:53.077380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:53.077391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:53.077411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:53.077426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:53.077871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.077884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.077904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:53.078090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3050 partition: 0 MaxSeqNo: 42 sessionId: src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0
2025-09-30T14:58:53.078479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37db54c4-b10bea98-9a96ceb7-f7f9988d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:53.081351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0] Write session: try to update token
2025-09-30T14:58:53.081372Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:53.092355Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:53.092376Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:53.092379Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:53.092382Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:53.092393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896877835938115:6479]
2025-09-30T14:58:53.092398Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896877835938115:6479]
2025-09-30T14:58:53.092403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896877835938115:6479]
2025-09-30T14:58:53.092450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:53.092457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.092460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:53.092481Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:53.092490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:53.092495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:53.092621Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:53.105141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3050 sessionId: src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:53.108267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:53.146849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896877925739650:9657]
2025-09-30T14:58:53.147325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3049, pipe: [1:7555896877925739650:9657]
2025-09-30T14:58:53.212016Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:53.212484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.212498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.212518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925739650:9657], now have 1 active actors on pipe
2025-09-30T14:58:53.213376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:53.213430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896877925739650:9657]
2025-09-30T14:58:53.213450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:53.213453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:53.213515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3050 reason: error at write: Disconnected sessionId: src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0
2025-09-30T14:58:53.213711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3050 sessionId: src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0 is DEAD
2025-09-30T14:58:53.215369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:53.215383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0] Write session will restart in 0.007070s
2025-09-30T14:58:53.215408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0] Write session: Do CDS request
2025-09-30T14:58:53.215413Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:53.214632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:53.223765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:53.224057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:53.224078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3051
2025-09-30T14:58:53.224233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3051 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:53.224264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3051 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:53.224270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3051 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:53.224275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:53.225323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3051 sessionId:  describe result for acl check
2025-09-30T14:58:53.225362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:53.225364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:53.225366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:53.225371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896877925739660:9277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:53.225938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896877925739660:9277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:53.229226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896877925739660:9277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:53.236307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896877925739660:9277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:53.236326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896877925739660:9277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:53.236329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896877925739660:9277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:53.236346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3051 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:53.251638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:53.254184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:53.254572Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:53.254580Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:53.254598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:53.254697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:53.254736Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896877835938265:6468]
2025-09-30T14:58:53.255413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:53.255824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:53.255888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:53.256267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:53.256331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.256332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.256334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.256335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.256337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.256338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.256340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.256341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.256342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.256343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.256344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.256346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.256347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.256348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.256350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.256356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.256368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.256372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.256376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.256380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.256384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.256388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.256393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.256397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.256402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.256406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.256410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.256414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.256419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.256424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.256433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.256442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.256449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.256456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.256463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.256470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.256475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.256480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.256487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.256492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.256497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.256502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.256508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.256514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.256519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.256524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.256530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.256536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.256541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.256546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.256552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.256557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.256561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.256567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.256573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.256579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.256584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.256590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.256597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.256602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.256652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:53.265359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:53.266343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:53.266358Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:53.266361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:53.266364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:53.266370Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3050 [2:7555896877835938265:6468]
2025-09-30T14:58:53.266383Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:53.266397Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:53.266399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:53.266402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:53.266404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:53.266419Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:53.266424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:53.266430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:53.266480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.266485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.266486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.266489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:53.266491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:53.266603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:53.266606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.266614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.266621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.266632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:53.266646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896877835938259:6468]
2025-09-30T14:58:53.266647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896877835938259:6468]
2025-09-30T14:58:53.266648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896877835938259:6468]
2025-09-30T14:58:53.266654Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:53.267011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3050
2025-09-30T14:58:53.267058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3050
2025-09-30T14:58:53.266665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:53.266671Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:53.266674Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:53.266675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:53.266676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:53.266678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:53.266683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925739652:2454], now have 1 active actors on pipe
2025-09-30T14:58:53.266686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925739706:9277], now have 1 active actors on pipe
2025-09-30T14:58:53.266714Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896877835938259:6468]
2025-09-30T14:58:53.266720Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:53.266879Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:53.267823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3051 partition: 0 MaxSeqNo: 42 sessionId: src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0
2025-09-30T14:58:53.268283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|29a115f8-12b3a379-ab2c20ef-811cf24b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:53.267363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.267389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.267418Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:53.267427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:53.267431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:53.267434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:53.267446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:53.267466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:53.267482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:53.267686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.267691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.267711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:53.271331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0] Write session: try to update token
2025-09-30T14:58:53.271350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:53.279929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:53.279949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:53.279952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:53.279957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:53.279966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896877835938259:6468]
2025-09-30T14:58:53.279971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896877835938259:6468]
2025-09-30T14:58:53.279976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896877835938259:6468]
2025-09-30T14:58:53.280016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:53.280023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.280026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:53.280173Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:53.283560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:53.283585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:53.283590Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:53.293275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3051 sessionId: src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:53.296432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:53.310816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896877925739804:9657]
2025-09-30T14:58:53.311138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3050, pipe: [1:7555896877925739804:9657]
2025-09-30T14:58:53.399483Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:53.399905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.399926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.399951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925739804:9657], now have 1 active actors on pipe
2025-09-30T14:58:53.400841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:53.400853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0] Write session will restart in 0.008270s
2025-09-30T14:58:53.400879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0] Write session: Do CDS request
2025-09-30T14:58:53.400885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:53.400417Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:53.400241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896877925739804:9657]
2025-09-30T14:58:53.400256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:53.400295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:53.400298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:53.400390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3051 reason: error at write: Disconnected sessionId: src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0
2025-09-30T14:58:53.400583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3051 sessionId: src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0 is DEAD
2025-09-30T14:58:53.411142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:53.411270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:53.411290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3052
2025-09-30T14:58:53.411412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3052 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:53.411445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3052 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:53.411457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3052 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:53.411462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:53.411924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3052 sessionId:  describe result for acl check
2025-09-30T14:58:53.411965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:53.411967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:53.411969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:53.411977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896877925739915:9268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:53.412568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896877925739915:9268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:53.412860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:53.414398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896877925739915:9268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:53.414764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:53.414956Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:53.414967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:53.414977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:53.415025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:53.415067Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896877835938419:6463]
2025-09-30T14:58:53.415785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:53.416128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:53.416194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:53.416588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:53.416657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.416658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.416659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.416660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.416662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.416663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.416665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.416667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.416668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.416669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.416670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.416671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.416672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.416673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.416675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.416692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.416702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.416706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.416710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.416714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.416718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.416722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.416726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.416729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.416734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.416737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.416741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.416745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.416748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.416752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.416773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.416781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.416788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.416793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.416797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.416803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.416807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.416812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.416817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.416823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.416827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.416832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.416840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.416845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.416849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.416854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.416859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.416863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.416868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.416872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.416877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.416878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896877925739915:9268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:53.416907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896877925739915:9268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:53.416911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896877925739915:9268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:53.416919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3052 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:53.416882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.416894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.416899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.416903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.416907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.416912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.416917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.416922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.416927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.416973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:53.424505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3051
2025-09-30T14:58:53.424514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3051
2025-09-30T14:58:53.422701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:53.424045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:53.424052Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:53.424056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:53.424061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:53.424068Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3051 [2:7555896877835938419:6463]
2025-09-30T14:58:53.424084Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:53.424101Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:53.424104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:53.424108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:53.424112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:53.424129Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:53.424136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:53.424146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:53.424218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.424221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.424223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.424227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:53.424230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:53.424320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:53.424323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.424338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.424352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.424371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:53.424390Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896877835938414:6463]
2025-09-30T14:58:53.424393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896877835938414:6463]
2025-09-30T14:58:53.424394Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896877835938414:6463]
2025-09-30T14:58:53.424404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:53.424415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:53.424418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:53.424419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:53.424421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:53.424432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:53.424436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:53.424446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925739813:2454], now have 1 active actors on pipe
2025-09-30T14:58:53.424450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925739955:9268], now have 1 active actors on pipe
2025-09-30T14:58:53.424486Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896877835938414:6463]
2025-09-30T14:58:53.424496Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:53.424500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:53.424802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.424821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.424856Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e09aadaa-4cd47c62-69de3da8-58884428_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:53.424869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:53.424876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:53.424879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:53.424891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:53.424904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:53.424924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:53.425099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.425113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.425136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:53.425241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3052 partition: 0 MaxSeqNo: 42 sessionId: src_id|e09aadaa-4cd47c62-69de3da8-58884428_0
2025-09-30T14:58:53.425643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eba007c5-dc1daccd-9530b5d1-2ac423ec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e09aadaa-4cd47c62-69de3da8-58884428_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:53.428858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e09aadaa-4cd47c62-69de3da8-58884428_0] Write session: try to update token
2025-09-30T14:58:53.428877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e09aadaa-4cd47c62-69de3da8-58884428_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:53.443104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:53.443127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:53.443130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:53.443132Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:53.443146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896877835938414:6463]
2025-09-30T14:58:53.443151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896877835938414:6463]
2025-09-30T14:58:53.443155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896877835938414:6463]
2025-09-30T14:58:53.443199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:53.443209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.443211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:53.443393Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:53.446802Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:53.446824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:53.446829Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:53.449702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3052 sessionId: src_id|e09aadaa-4cd47c62-69de3da8-58884428_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:53.453085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:53.500640Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896877925739964:9657]
2025-09-30T14:58:53.500997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3051, pipe: [1:7555896877925739964:9657]
2025-09-30T14:58:53.558097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:53.558397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.558417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.558460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925739964:9657], now have 1 active actors on pipe
2025-09-30T14:58:53.558667Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:53.558692Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:53.558701Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:53.558738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896877925739964:9657]
2025-09-30T14:58:53.558768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3052 reason: error at write: Disconnected sessionId: src_id|e09aadaa-4cd47c62-69de3da8-58884428_0
2025-09-30T14:58:53.558676Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:53.559102Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09aadaa-4cd47c62-69de3da8-58884428_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:53.559112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09aadaa-4cd47c62-69de3da8-58884428_0] Write session will restart in 0.009422s
2025-09-30T14:58:53.559136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09aadaa-4cd47c62-69de3da8-58884428_0] Write session: Do CDS request
2025-09-30T14:58:53.559141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09aadaa-4cd47c62-69de3da8-58884428_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:53.558958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3052 sessionId: src_id|e09aadaa-4cd47c62-69de3da8-58884428_0 is DEAD
2025-09-30T14:58:53.569796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e09aadaa-4cd47c62-69de3da8-58884428_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:53.569938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:53.569977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3053
2025-09-30T14:58:53.570152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3053 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:53.570199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3053 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:53.570205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3053 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:53.570209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:53.570701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3053 sessionId:  describe result for acl check
2025-09-30T14:58:53.570741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:53.570744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:53.570745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:53.570751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896877925740016:9260] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:53.571348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896877925740016:9260] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:53.574017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896877925740016:9260] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:53.575327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:53.575920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:53.576130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:53.576138Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:53.576147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:53.576203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:53.576237Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896877835938563:6446]
2025-09-30T14:58:53.576791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:53.577548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:53.577605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:53.577930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896877925740016:9260] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:53.577948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:53.577949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896877925740016:9260] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:53.577953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896877925740016:9260] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:53.577962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3053 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:53.578010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.578019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.578021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.578022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.578023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.578025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.578026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.578027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.578029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.578030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.578031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.578033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.578034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.578036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.578037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.578043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.578054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.578059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.578062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.578066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.578069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.578073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.578076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.578080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.578084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.578088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.578092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.578096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.578099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.578103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.578110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.578119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.578126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.578132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.578137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.578142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.578147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.578152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.578157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.578163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.578172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.578178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.578183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.578193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.578197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.578208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.578214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.578223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.578227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.578239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.578243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.578253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.578257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.578262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.578271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.578276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.578281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.578290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.578295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.578300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.578346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:53.584032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:53.584980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:53.585003Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:53.585007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:53.585011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:53.585019Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3052 [2:7555896877835938563:6446]
2025-09-30T14:58:53.585038Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:53.585058Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:53.585061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:53.585065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:53.585067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:53.585083Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:53.585090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:53.585104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:53.585170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.585180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.585182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.585186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:53.585189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:53.585459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3052
2025-09-30T14:58:53.585480Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3052
2025-09-30T14:58:53.585514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:53.585526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.585541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.585554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.585573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:53.585602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925739966:2454], now have 1 active actors on pipe
2025-09-30T14:58:53.585606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925740109:9260], now have 1 active actors on pipe
2025-09-30T14:58:53.585613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896877835938558:6446]
2025-09-30T14:58:53.585617Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896877835938558:6446]
2025-09-30T14:58:53.585620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896877835938558:6446]
2025-09-30T14:58:53.585633Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:53.585648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:53.585663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:53.585666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:53.585686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:53.585693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:53.585694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:53.585706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896877835938558:6446]
2025-09-30T14:58:53.585710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:53.585712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:53.585731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.585736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.585782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:53.585790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:53.585794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:53.585796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:53.585805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:53.585815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:53.585832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:53.586299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.586313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.586335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:53.586467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3053 partition: 0 MaxSeqNo: 42 sessionId: src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0
2025-09-30T14:58:53.586862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e09aadaa-4cd47c62-69de3da8-58884428_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:53.589717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0] Write session: try to update token
2025-09-30T14:58:53.589736Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:53.598835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:53.598856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:53.598859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:53.598861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:53.598871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896877835938558:6446]
2025-09-30T14:58:53.598876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896877835938558:6446]
2025-09-30T14:58:53.598881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896877835938558:6446]
2025-09-30T14:58:53.598922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:53.598923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:53.598927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:53.598931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.598933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:53.598934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:53.599077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:53.614758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3053 sessionId: src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:53.617882Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:53.658848Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896877925740130:9657]
2025-09-30T14:58:53.659269Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3052, pipe: [1:7555896877925740130:9657]
2025-09-30T14:58:53.715012Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:53.715364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.715378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.715399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925740130:9657], now have 1 active actors on pipe
2025-09-30T14:58:53.715637Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:53.715662Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:53.715719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:53.715803Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3053 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0
2025-09-30T14:58:53.715991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3053 sessionId: src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0 is DEAD
2025-09-30T14:58:53.716170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896877925740130:9657]
2025-09-30T14:58:53.716392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:53.716403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0] Write session will restart in 0.006162s
2025-09-30T14:58:53.716429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0] Write session: Do CDS request
2025-09-30T14:58:53.716435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:53.724154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:53.724272Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:53.724303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3054
2025-09-30T14:58:53.724513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3054 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:53.724565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3054 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:53.724575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3054 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:53.724581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:53.725058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3054 sessionId:  describe result for acl check
2025-09-30T14:58:53.725093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:53.725095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:53.725098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:53.725104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896877925740192:9252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:53.725655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896877925740192:9252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:53.728239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:53.727945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896877925740192:9252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:53.730363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:53.730746Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:53.730758Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:53.730773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:53.730734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896877925740192:9252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:53.730755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896877925740192:9252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:53.730758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896877925740192:9252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:53.730767Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3054 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:53.730840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:53.730883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896877835938710:6458]
2025-09-30T14:58:53.731558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:53.731958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:53.732005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:53.732309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:53.732380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.732389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.732390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.732392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.732393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.732394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.732396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.732397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.732398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.732399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.732400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.732402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.732404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.732405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.732407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.732412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.732423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.732427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.732432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.732436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.732441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.732446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.732450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.732454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.732459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.732463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.732468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.732472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.732476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.732480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.732489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.732497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.732503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.732509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.732516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.732522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.732526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.732531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.732536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.732542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.732547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.732555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.732560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.732566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.732570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.732576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.732582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.732593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.732598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.732603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.732608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.732613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.732618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.732623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.732628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.732639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.732644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.732655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.732665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.732688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.732735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:53.738385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:53.739302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:53.739317Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:53.739321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:53.739324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:53.739331Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3053 [2:7555896877835938710:6458]
2025-09-30T14:58:53.739349Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:53.739364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:53.739372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:53.739375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:53.739378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:53.739394Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:53.739406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:53.739413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:53.739473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.739485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.739487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.739491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:53.739494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:53.739656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:53.739665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.739678Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.739696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.739679Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3053
2025-09-30T14:58:53.739687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3053
2025-09-30T14:58:53.739720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:53.739743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925740132:2454], now have 1 active actors on pipe
2025-09-30T14:58:53.739753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925740274:9252], now have 1 active actors on pipe
2025-09-30T14:58:53.739773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.739782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.739798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896877835938705:6458]
2025-09-30T14:58:53.739805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896877835938705:6458]
2025-09-30T14:58:53.739807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896877835938705:6458]
2025-09-30T14:58:53.739819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:53.739831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:53.739834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:53.739835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:53.739838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:53.739854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:53.739862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:53.739879Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b828287-8bb7d23b-a8870691-9ca73762_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:53.739891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:53.739897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:53.739903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:53.739914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:53.739927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:53.739969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896877835938705:6458]
2025-09-30T14:58:53.739982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:53.739998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:53.740013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:53.740193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.740201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.740216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:53.740308Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3054 partition: 0 MaxSeqNo: 42 sessionId: src_id|4b828287-8bb7d23b-a8870691-9ca73762_0
2025-09-30T14:58:53.740622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c341aa59-7f1cc8a4-60d67b61-1924cd4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4b828287-8bb7d23b-a8870691-9ca73762_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:53.743473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b828287-8bb7d23b-a8870691-9ca73762_0] Write session: try to update token
2025-09-30T14:58:53.743499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b828287-8bb7d23b-a8870691-9ca73762_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:53.758475Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:53.758500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:53.758512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896877835938705:6458]
2025-09-30T14:58:53.758567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:53.758583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:53.758759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:53.758936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:53.759101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:53.759283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:53.759509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:53.759560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:53.759802Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3054 sessionId: src_id|4b828287-8bb7d23b-a8870691-9ca73762_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:53.762688Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:53.763630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.763654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.763672Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:53.763675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:53.763680Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:53.763682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:53.763690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896877835938705:6458]
2025-09-30T14:58:53.763694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896877835938705:6458]
2025-09-30T14:58:53.763699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896877835938705:6458]
2025-09-30T14:58:53.763743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:53.763749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:53.763755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:53.763758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.763759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:53.763760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:53.763899Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:53.812430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896877925740287:9657]
2025-09-30T14:58:53.812727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3053, pipe: [1:7555896877925740287:9657]
2025-09-30T14:58:53.879969Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:53.880390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:58:53.880429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925740287:9657], now have 1 active actors on pipe
2025-09-30T14:58:53.880619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896877925740287:9657]
2025-09-30T14:58:53.880638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:53.880659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:53.880755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:53.880767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:53.880854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3054 reason: error at write: Disconnected sessionId: src_id|4b828287-8bb7d23b-a8870691-9ca73762_0
2025-09-30T14:58:53.881030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3054 sessionId: src_id|4b828287-8bb7d23b-a8870691-9ca73762_0 is DEAD
2025-09-30T14:58:53.881311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b828287-8bb7d23b-a8870691-9ca73762_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:53.881326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b828287-8bb7d23b-a8870691-9ca73762_0] Write session will restart in 0.005476s
2025-09-30T14:58:53.881354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b828287-8bb7d23b-a8870691-9ca73762_0] Write session: Do CDS request
2025-09-30T14:58:53.881373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b828287-8bb7d23b-a8870691-9ca73762_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:53.887767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b828287-8bb7d23b-a8870691-9ca73762_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:53.888123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:53.888141Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3055
2025-09-30T14:58:53.888279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3055 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:53.888312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3055 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:53.888318Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3055 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:53.888322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:53.888754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3055 sessionId:  describe result for acl check
2025-09-30T14:58:53.888784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:53.888787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:53.888789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:53.888795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896877925740323:9244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:53.889278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896877925740323:9244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:53.893598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:53.894846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896877925740323:9244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:53.901333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:53.901602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896877925740323:9244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:53.901640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896877925740323:9244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:53.901643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896877925740323:9244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:53.901652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3055 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:53.901684Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:53.901698Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:53.901711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:53.901779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:53.901826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896877835938870:6455]
2025-09-30T14:58:53.902475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:53.902812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:53.902874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:53.903221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:53.903320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.903330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.903332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.903333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.903335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.903336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.903338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.903339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.903340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.903341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.903343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.903344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.903345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.903347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.903348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.903354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.903363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.903368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.903372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.903376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.903380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.903384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.903388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.903392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.903396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.903401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.903405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.903409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.903413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.903416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.903425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.903433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:53.903439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.903446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:53.903452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.903457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:53.903462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.903468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:53.903473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.903478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:53.903482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.903488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:53.903493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.903498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:53.903503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.903510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:53.903516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.903522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:53.903532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.903538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:53.903542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.903554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.903559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.903571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.903575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.903581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.903590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.903595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:53.903600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.903609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:53.903657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:53.909401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:53.910431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:53.910461Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:53.910464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:53.910468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:53.910475Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3054 [2:7555896877835938870:6455]
2025-09-30T14:58:53.910492Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:53.910508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:53.910512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:53.910516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:53.910518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:53.910533Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:53.910540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:53.910547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:53.910617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.910624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.910627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.910630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:53.910633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:53.910889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3054
2025-09-30T14:58:53.910941Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3054
2025-09-30T14:58:53.910700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:53.910713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.910728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:53.910740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:53.910760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:53.910778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925740289:2454], now have 1 active actors on pipe
2025-09-30T14:58:53.910783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925740444:9244], now have 1 active actors on pipe
2025-09-30T14:58:53.910789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896877835938865:6455]
2025-09-30T14:58:53.910792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896877835938865:6455]
2025-09-30T14:58:53.910794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896877835938865:6455]
2025-09-30T14:58:53.910810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:53.910822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:53.910825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:53.910826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:53.910827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:53.910842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:53.910845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:53.910879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896877835938865:6455]
2025-09-30T14:58:53.910887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:53.910909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:53.910986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.910990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.911016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:53.911023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:53.911029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:53.911031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:53.911041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:53.911050Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:53.911067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:53.911222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:53.911231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:53.911271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:53.911486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3055 partition: 0 MaxSeqNo: 42 sessionId: src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0
2025-09-30T14:58:53.911969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b828287-8bb7d23b-a8870691-9ca73762_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:53.916009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0] Write session: try to update token
2025-09-30T14:58:53.916038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:53.923608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:53.923629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:53.923632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:53.923634Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:53.923642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896877835938865:6455]
2025-09-30T14:58:53.923646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896877835938865:6455]
2025-09-30T14:58:53.923650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896877835938865:6455]
2025-09-30T14:58:53.923690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:53.923697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:53.923699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:53.923841Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:53.924763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:53.924770Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:53.924775Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:53.941911Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3055 sessionId: src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:53.949794Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:53.981845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896877925740465:9657]
2025-09-30T14:58:53.982931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3054, pipe: [1:7555896877925740465:9657]
2025-09-30T14:58:54.046906Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:54.047421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.047435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.047455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896877925740465:9657], now have 1 active actors on pipe
2025-09-30T14:58:54.047740Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:54.048632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:54.048649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0] Write session will restart in 0.007153s
2025-09-30T14:58:54.048706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0] Write session: Do CDS request
2025-09-30T14:58:54.048714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:54.047986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896877925740465:9657]
2025-09-30T14:58:54.048041Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:54.048142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3055 reason: status is not ok: tablet will be restarted right now sessionId: src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0
2025-09-30T14:58:54.048232Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:54.048377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3055 sessionId: src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0 is DEAD
2025-09-30T14:58:54.056786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:54.064067Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:54.064096Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3056
2025-09-30T14:58:54.064376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3056 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:54.064432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3056 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:54.064444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3056 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:54.064450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:54.065106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3056 sessionId:  describe result for acl check
2025-09-30T14:58:54.065153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:54.065160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:54.065163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:54.065170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896882220707817:9228] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:54.065887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896882220707817:9228] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:54.071523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896882220707817:9228] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:54.074637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:54.079451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:54.079749Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:54.079762Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:54.079775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:54.079831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:54.079886Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896882130906336:6431]
2025-09-30T14:58:54.080640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:54.081878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896882220707817:9228] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:54.081911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896882220707817:9228] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:54.081916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896882220707817:9228] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:54.081927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3056 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:54.083380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:54.083477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:54.084626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:54.084763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.084771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.084773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.084774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.084777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.084779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.084781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.084783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.084785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.084786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.084788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.084789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.084791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.084792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.084793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.084801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.084813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.084818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.084823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.084826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.084831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.084843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.084848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.084852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.084857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.084860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.084864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.084868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.084872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.084876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.084887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.084896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.084903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.084909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.084914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.084920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.084925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.084931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.084937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.084942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.084947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.084952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.084958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.084964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.084969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.084974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.084980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.084986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.084991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.084996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.085002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.085010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.085015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.085021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.085027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.085033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.085038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.085044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.085049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.085055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.085100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:54.097871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:54.099084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:54.099093Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:54.099097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:54.099102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:54.099112Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3055 [2:7555896882130906336:6431]
2025-09-30T14:58:54.099135Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:54.099155Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:54.099159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:54.099163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:54.099166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:54.099190Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:54.099198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:54.099207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:54.099349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.099352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.099356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.099361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:54.099364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:54.099825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:54.099830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.099848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.099859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.099878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:54.100344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220707909:9228], now have 1 active actors on pipe
2025-09-30T14:58:54.100358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220707763:2454], now have 1 active actors on pipe
2025-09-30T14:58:54.100367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896882130906331:6431]
2025-09-30T14:58:54.100369Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896882130906331:6431]
2025-09-30T14:58:54.100372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896882130906331:6431]
2025-09-30T14:58:54.100386Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:54.100408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:54.100426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:54.100429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:54.100448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.100454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.100514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896882130906331:6431]
2025-09-30T14:58:54.100517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:54.100536Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:54.100545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:54.100550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:54.100553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:54.100567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:54.100581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:54.100633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:54.100637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:54.100643Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:54.100645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:54.100652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:54.101013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.101021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.101037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:54.100002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3055
2025-09-30T14:58:54.100053Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3055
2025-09-30T14:58:54.101183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3056 partition: 0 MaxSeqNo: 42 sessionId: src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0
2025-09-30T14:58:54.101945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|899e65d6-22e5c6b-c93b2b2-fcd7bfb8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:54.105470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0] Write session: try to update token
2025-09-30T14:58:54.105493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:54.119837Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:54.119862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:54.119864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:54.119867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:54.119877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896882130906331:6431]
2025-09-30T14:58:54.119882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896882130906331:6431]
2025-09-30T14:58:54.119887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896882130906331:6431]
2025-09-30T14:58:54.119937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:54.119944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.119947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:54.119953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:54.119961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:54.119966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:54.120098Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:54.130091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3056 sessionId: src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:54.133562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:54.147814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896882220707919:9657]
2025-09-30T14:58:54.148233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3055, pipe: [1:7555896882220707919:9657]
2025-09-30T14:58:54.237059Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:54.237378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.237396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.237436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220707919:9657], now have 1 active actors on pipe
2025-09-30T14:58:54.238212Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:54.238009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:54.238039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:54.238078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896882220707919:9657]
2025-09-30T14:58:54.238112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:54.238116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3056 reason: error at write: Disconnected sessionId: src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0
2025-09-30T14:58:54.238534Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:54.238548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0] Write session will restart in 0.006268s
2025-09-30T14:58:54.238581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0] Write session: Do CDS request
2025-09-30T14:58:54.238588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:54.238331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3056 sessionId: src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0 is DEAD
2025-09-30T14:58:54.245757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:54.247485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:54.247514Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3057
2025-09-30T14:58:54.247739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3057 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:54.247769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3057 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:54.247774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3057 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:54.247778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:54.250616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3057 sessionId:  describe result for acl check
2025-09-30T14:58:54.250682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:54.250685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:54.250687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:54.250695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896882220707935:9222] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:54.251476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896882220707935:9222] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:54.255262Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896882220707935:9222] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:54.269444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896882220707935:9222] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:54.269470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896882220707935:9222] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:54.269474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896882220707935:9222] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:54.269484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3057 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:54.272027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:54.275143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:54.275627Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:54.275641Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:54.275656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:54.275727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:54.275785Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896882130906487:6429]
2025-09-30T14:58:54.276532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:54.277009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:54.277068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:54.277452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:54.277529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.277535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.277536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.277537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.277539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.277541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.277542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.277544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.277545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.277546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.277548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.277549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.277551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.277552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.277553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.277560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.277571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.277576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.277579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.277583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.277587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.277591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.277595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.277598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.277603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.277606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.277611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.277614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.277618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.277622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.277633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.277641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.277648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.277654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.277659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.277664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.277669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.277676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.277689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.277694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.277702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.277719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.277726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.277732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.277737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.277751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.277757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.277764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.277770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.277783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.277788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.277798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.277803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.277813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.277820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.277831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.277836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.277846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.277852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.277862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.277912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:54.289442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:54.290790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:54.290809Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:54.290811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:54.290815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:54.290822Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3056 [2:7555896882130906487:6429]
2025-09-30T14:58:54.290839Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:54.290858Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:54.290861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:54.290864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:54.290866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:54.290884Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:54.290895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:54.290902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:54.290968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.290976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.290979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.290984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:54.290986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:54.291065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:54.291072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.291085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.291096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.291107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:54.291127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896882130906482:6429]
2025-09-30T14:58:54.291133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896882130906482:6429]
2025-09-30T14:58:54.291135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896882130906482:6429]
2025-09-30T14:58:54.291148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:54.291166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:54.291181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:54.291184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:54.291230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896882130906482:6429]
2025-09-30T14:58:54.291238Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:54.291377Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:54.291392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:54.291395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:54.291403Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:54.291589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220707922:2454], now have 1 active actors on pipe
2025-09-30T14:58:54.291599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220708063:9222], now have 1 active actors on pipe
2025-09-30T14:58:54.291921Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3056
2025-09-30T14:58:54.291986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3056
2025-09-30T14:58:54.292168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.292179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.292205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:54.292213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:54.292222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:54.292224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:54.292235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:54.292249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:54.292274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:54.297294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.297315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.297352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:54.297691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3057 partition: 0 MaxSeqNo: 42 sessionId: src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0
2025-09-30T14:58:54.298147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|776bbdeb-2d846fc7-92fe86ea-7c90430_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:54.301498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0] Write session: try to update token
2025-09-30T14:58:54.301533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:54.305157Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:54.305184Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:54.305187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:54.305189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:54.305203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896882130906482:6429]
2025-09-30T14:58:54.305210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896882130906482:6429]
2025-09-30T14:58:54.305217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896882130906482:6429]
2025-09-30T14:58:54.305274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:54.305284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.305287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:54.305354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:54.305372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:54.305378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:54.305479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:54.327548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3057 sessionId: src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:54.330926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:54.338239Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896882220708083:9657]
2025-09-30T14:58:54.338605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3056, pipe: [1:7555896882220708083:9657]
2025-09-30T14:58:54.426436Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:54.426868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.426888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.426910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220708083:9657], now have 1 active actors on pipe
2025-09-30T14:58:54.427322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:54.427351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:54.427359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:54.427410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896882220708083:9657]
2025-09-30T14:58:54.427465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3057 reason: error at write: Disconnected sessionId: src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0
2025-09-30T14:58:54.427647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:54.427829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3057 sessionId: src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0 is DEAD
2025-09-30T14:58:54.428017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:54.428031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0] Write session will restart in 0.009062s
2025-09-30T14:58:54.428065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0] Write session: Do CDS request
2025-09-30T14:58:54.428076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:54.438825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:54.439116Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:54.439137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3058
2025-09-30T14:58:54.439319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3058 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:54.439357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3058 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:54.439375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3058 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:54.439380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:54.442103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3058 sessionId:  describe result for acl check
2025-09-30T14:58:54.442164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:54.442168Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:54.442170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:54.442179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896882220708198:9218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:54.442853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896882220708198:9218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:54.444582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:54.445397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896882220708198:9218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:54.449354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896882220708198:9218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:54.449377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896882220708198:9218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:54.449381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896882220708198:9218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:54.449391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3058 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:54.448865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:54.449156Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:54.449162Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:54.449176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:54.449243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:54.449297Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896882130906647:6426]
2025-09-30T14:58:54.450061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:54.450473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:54.450535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:54.450850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:54.450909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.450914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.450915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.450916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.450917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.450918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.450919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.450920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.450921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.450922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.450923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.450924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.450925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.450926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.450927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.450931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.450938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.450941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.450944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.450947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.450951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.450955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.450959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.450964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.450979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.450981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.450984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.450989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.450993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.450996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.451005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.451013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.451019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.451025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.451032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.451038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.451043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.451047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.451050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.451054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.451057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.451061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.451064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.451067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.451070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.451074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.451077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.451082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.451084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.451088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.451090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.451094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.451097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.451100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.451104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.451107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.451110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.451114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.451117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.451120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.451150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:54.457356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:54.458560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:54.458585Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:54.458588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:54.458593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:54.458602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3057 [2:7555896882130906647:6426]
2025-09-30T14:58:54.458626Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:54.458647Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:54.458651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:54.458655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:54.458659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:54.458683Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:54.458699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:54.458713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:54.458805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.458814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.458817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.458822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:54.458826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:54.458925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:54.458933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.458949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.458965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.458990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:54.459018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896882130906642:6426]
2025-09-30T14:58:54.459027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896882130906642:6426]
2025-09-30T14:58:54.459030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896882130906642:6426]
2025-09-30T14:58:54.459048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:54.459069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:54.459092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:54.459101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:54.459144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:54.459153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896882130906642:6426]
2025-09-30T14:58:54.459157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:54.459158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:54.459161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:54.459170Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:54.459495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220708234:9218], now have 1 active actors on pipe
2025-09-30T14:58:54.459507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220708089:2454], now have 1 active actors on pipe
2025-09-30T14:58:54.459740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3057
2025-09-30T14:58:54.459784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3057
2025-09-30T14:58:54.460041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.460056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.460099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:54.460115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:54.460125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:54.460128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:54.460143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:54.460160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:54.460202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:54.460402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.460412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.460436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:54.460564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3058 partition: 0 MaxSeqNo: 42 sessionId: src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0
2025-09-30T14:58:54.461058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|38fcfc42-cd2cdd71-a308cb6e-ce1fa705_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:54.464609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0] Write session: try to update token
2025-09-30T14:58:54.464633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:54.474882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:54.474909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:54.474913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:54.474923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:54.474936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896882130906642:6426]
2025-09-30T14:58:54.474942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896882130906642:6426]
2025-09-30T14:58:54.474948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896882130906642:6426]
2025-09-30T14:58:54.475003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:54.475003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:54.475010Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:54.475015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:54.475017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.475021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:54.475219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:54.488888Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3058 sessionId: src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:54.492413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:54.527189Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896882220708247:9657]
2025-09-30T14:58:54.527715Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3057, pipe: [1:7555896882220708247:9657]
2025-09-30T14:58:54.599117Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:54.599684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.599703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.599727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220708247:9657], now have 1 active actors on pipe
2025-09-30T14:58:54.599964Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:54.600001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896882220708247:9657]
2025-09-30T14:58:54.600036Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:54.600038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:54.600284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3058 reason: status is not ok: tablet will be restarted right now sessionId: src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0
2025-09-30T14:58:54.600475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3058 sessionId: src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0 is DEAD
2025-09-30T14:58:54.600695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:54.600709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0] Write session will restart in 0.007599s
2025-09-30T14:58:54.600745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0] Write session: Do CDS request
2025-09-30T14:58:54.600750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:54.609877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:54.610014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:54.610045Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3059
2025-09-30T14:58:54.610262Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3059 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:54.610309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3059 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:54.610325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3059 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:54.610330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:54.611070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3059 sessionId:  describe result for acl check
2025-09-30T14:58:54.611117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:54.611127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:54.611132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:54.611140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896882220708300:9214] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:54.611821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896882220708300:9214] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:54.615562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896882220708300:9214] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:54.618857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:54.621628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896882220708300:9214] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:54.621654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896882220708300:9214] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:54.621659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896882220708300:9214] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:54.621670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3059 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:54.621837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:54.622079Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:54.622092Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:54.622103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:54.622158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:54.622207Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896882130906800:6424]
2025-09-30T14:58:54.622938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:54.623297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:54.623375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:54.623769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:54.623843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.623845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.623847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.623848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.623850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.623851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.623853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.623854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.623856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.623857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.623859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.623863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.623865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.623866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.623868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.623873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.623885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.623890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.623894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.623899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.623903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.623908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.623912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.623917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.623921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.623926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.623930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.623934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.623938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.623943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.623951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.623959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.623965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.623971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.623976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.623982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.623987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.623993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.623999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.624004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.624009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.624015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.624020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.624024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.624029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.624035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.624040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.624046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.624051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.624058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.624063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.624070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.624074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.624079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.624084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.624090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.624096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.624101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.624107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.624113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.624162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:54.630800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:54.632015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:54.632031Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:54.632034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:54.632038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:54.632045Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3058 [2:7555896882130906800:6424]
2025-09-30T14:58:54.632062Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:54.632078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:54.632081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:54.632084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:54.632087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:54.632103Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:54.632110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:54.632124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:54.632188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.632194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.632197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.632201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:54.632204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:54.632274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:54.632281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.632295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.632313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.632335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:54.632355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896882130906794:6424]
2025-09-30T14:58:54.632361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896882130906794:6424]
2025-09-30T14:58:54.632363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896882130906794:6424]
2025-09-30T14:58:54.632378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:54.632393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:54.632408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:54.632415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:54.632440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:54.632449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896882130906794:6424]
2025-09-30T14:58:54.632451Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:54.632453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:54.632456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:54.632463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:54.632766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3058
2025-09-30T14:58:54.632845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3058
2025-09-30T14:58:54.632620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220708396:9214], now have 1 active actors on pipe
2025-09-30T14:58:54.632637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220708248:2454], now have 1 active actors on pipe
2025-09-30T14:58:54.632934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.632942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.632988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:54.632997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:54.633001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:54.633003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:54.633015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:54.633026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:54.633042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:54.633520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.633532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.633550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:54.634191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|639f1dbc-8b4270ca-741db48c-cfb19d82_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:54.633698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3059 partition: 0 MaxSeqNo: 42 sessionId: src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0
2025-09-30T14:58:54.637311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0] Write session: try to update token
2025-09-30T14:58:54.637331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:54.658383Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:54.658416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:54.658429Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896882130906794:6424]
2025-09-30T14:58:54.658504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:54.658516Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:54.658713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:54.658880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:54.659028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:54.659172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:54.659405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:54.659703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:54.662835Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:54.662863Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:54.662867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:54.662870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:54.662887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896882130906794:6424]
2025-09-30T14:58:54.662893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896882130906794:6424]
2025-09-30T14:58:54.662898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896882130906794:6424]
2025-09-30T14:58:54.662948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:54.662956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.662968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:54.663132Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:54.659560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3059 sessionId: src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:54.663109Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:54.666659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:54.666685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:54.666691Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:54.700197Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896882220708420:9657]
2025-09-30T14:58:54.700582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3058, pipe: [1:7555896882220708420:9657]
2025-09-30T14:58:54.774369Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:54.774730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.774751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.774771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220708420:9657], now have 1 active actors on pipe
2025-09-30T14:58:54.775036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:54.775055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:54.775131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3059 reason: error at write: Disconnected sessionId: src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0
2025-09-30T14:58:54.775548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:54.775559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0] Write session will restart in 0.009335s
2025-09-30T14:58:54.775585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0] Write session: Do CDS request
2025-09-30T14:58:54.775590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:54.775224Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:54.775334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3059 sessionId: src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0 is DEAD
2025-09-30T14:58:54.775369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:54.775455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896882220708420:9657]
2025-09-30T14:58:54.785786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:54.786151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:54.786177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3060
2025-09-30T14:58:54.786389Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3060 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:54.786438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3060 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:54.786448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3060 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:54.786453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:54.786980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3060 sessionId:  describe result for acl check
2025-09-30T14:58:54.787017Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:54.787020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:54.787021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:54.787028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896882220708437:9202] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:54.787691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896882220708437:9202] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:54.794096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896882220708437:9202] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:54.800279Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896882220708437:9202] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:54.800307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896882220708437:9202] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:54.800312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896882220708437:9202] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:54.800322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3060 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:54.810042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:54.811026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:54.811338Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:54.811343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:54.811357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:54.811423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:54.811686Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896882130906951:6423]
2025-09-30T14:58:54.812387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:54.812899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:54.812971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:54.813318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:54.813414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.813422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.813424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.813425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.813427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.813429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.813431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.813433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.813434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.813436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.813437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.813438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.813440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.813441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.813442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.813449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.813460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.813465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.813470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.813474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.813479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.813483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.813488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.813492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.813499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.813503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.813507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.813511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.813516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.813520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.813528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.813537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.813546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.813552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.813557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.813563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.813568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.813573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.813578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.813587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.813591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.813596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.813601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.813604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.813607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.813612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.813617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.813622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.813626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.813631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.813635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.813640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.813644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.813649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.813653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.813657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.813661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.813666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.813670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.813675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.813735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:54.820106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:54.821252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:54.821279Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:54.821283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:54.821288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:54.821296Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3059 [2:7555896882130906951:6423]
2025-09-30T14:58:54.821327Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:54.821351Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:54.821362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:54.821366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:54.821369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:54.821391Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:54.821404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:54.821412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:54.821502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.821509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.821512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.821516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:54.821519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:54.821598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:54.821609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.821627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.821641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.821660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:54.821686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896882130906946:6423]
2025-09-30T14:58:54.821694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896882130906946:6423]
2025-09-30T14:58:54.821696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896882130906946:6423]
2025-09-30T14:58:54.821706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:54.821727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:54.821743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:54.821748Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:54.821752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:54.821764Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:54.821768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:54.821801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220708421:2454], now have 1 active actors on pipe
2025-09-30T14:58:54.821811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896882130906946:6423]
2025-09-30T14:58:54.821914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3059
2025-09-30T14:58:54.821929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3059
2025-09-30T14:58:54.821822Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:54.821833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220708532:9202], now have 1 active actors on pipe
2025-09-30T14:58:54.821835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:54.825658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.825686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.825725Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5ece8089-169df3e7-253eefac-c0b987a4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:54.825740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:54.825745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:54.825749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:54.825769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:54.825787Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:54.825808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:54.826836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.826859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.826888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:54.827055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3060 partition: 0 MaxSeqNo: 42 sessionId: src_id|5ece8089-169df3e7-253eefac-c0b987a4_0
2025-09-30T14:58:54.828183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f265431f-ceac05d8-2cc044df-b8c98e25_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5ece8089-169df3e7-253eefac-c0b987a4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:54.831202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ece8089-169df3e7-253eefac-c0b987a4_0] Write session: try to update token
2025-09-30T14:58:54.831226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ece8089-169df3e7-253eefac-c0b987a4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:54.837071Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:54.837098Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:54.837102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:54.837109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:54.837121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896882130906946:6423]
2025-09-30T14:58:54.837130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896882130906946:6423]
2025-09-30T14:58:54.837134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896882130906946:6423]
2025-09-30T14:58:54.837180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:54.837187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.837190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:54.837355Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:54.839357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:54.839376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:54.839386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:54.858687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3060 sessionId: src_id|5ece8089-169df3e7-253eefac-c0b987a4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:54.861826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:54.878114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896882220708584:9657]
2025-09-30T14:58:54.878778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3059, pipe: [1:7555896882220708584:9657]
2025-09-30T14:58:54.966538Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:54.966862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:54.966877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:54.966898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220708584:9657], now have 1 active actors on pipe
2025-09-30T14:58:54.967303Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:54.968048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ece8089-169df3e7-253eefac-c0b987a4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:54.968056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ece8089-169df3e7-253eefac-c0b987a4_0] Write session will restart in 0.005561s
2025-09-30T14:58:54.968087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ece8089-169df3e7-253eefac-c0b987a4_0] Write session: Do CDS request
2025-09-30T14:58:54.968093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ece8089-169df3e7-253eefac-c0b987a4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:54.967544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:54.967591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:54.967661Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3060 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5ece8089-169df3e7-253eefac-c0b987a4_0
2025-09-30T14:58:54.967839Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3060 sessionId: src_id|5ece8089-169df3e7-253eefac-c0b987a4_0 is DEAD
2025-09-30T14:58:54.968055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896882220708584:9657]
2025-09-30T14:58:54.974826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5ece8089-169df3e7-253eefac-c0b987a4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:54.975128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:54.975151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3061
2025-09-30T14:58:54.975787Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3061 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:54.975829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3061 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:54.975834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3061 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:54.975838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:54.976521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3061 sessionId:  describe result for acl check
2025-09-30T14:58:54.976592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:54.976605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:54.976614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:54.976623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896882220708614:9193] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:54.977305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896882220708614:9193] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:54.979578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896882220708614:9193] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:54.985607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896882220708614:9193] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:54.985627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896882220708614:9193] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:54.985630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896882220708614:9193] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:54.985639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3061 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:54.993421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:54.994543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:54.994807Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:54.994819Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:54.994830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:54.994884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:54.994923Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896882130907140:6404]
2025-09-30T14:58:54.995641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:54.996055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:54.996116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:54.996484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:54.996542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.996549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.996551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.996552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.996554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.996555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.996556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.996557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.996559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.996560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.996562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.996563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.996565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.996566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.996568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.996574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.996586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.996591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.996597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.996601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.996606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.996611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.996616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.996620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.996626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.996630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.996635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.996639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.996644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.996649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.996657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.996666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:54.996685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.996692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:54.996698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.996709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:54.996713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.996720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:54.996725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.996733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:54.996739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.996745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:54.996752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.996758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:54.996763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.996769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:54.996774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.996780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:54.996785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.996792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:54.996797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.996804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:54.996809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.996815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:54.996820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.996826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:54.996832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.996839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:54.996845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.996850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:54.996899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:55.004013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:55.005043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:55.005049Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:55.005054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:55.005059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:55.005066Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3060 [2:7555896882130907140:6404]
2025-09-30T14:58:55.005085Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:55.005101Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:55.005104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:55.005107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:55.005109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:55.005127Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:55.005134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:55.005142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:55.005218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.005220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.005223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.005226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:55.005230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:55.005307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:55.005310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.005326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.005338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.005355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:55.005374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220708712:9193], now have 1 active actors on pipe
2025-09-30T14:58:55.005378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896882220708601:2454], now have 1 active actors on pipe
2025-09-30T14:58:55.005384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896882130907128:6404]
2025-09-30T14:58:55.005387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896882130907128:6404]
2025-09-30T14:58:55.005389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896882130907128:6404]
2025-09-30T14:58:55.005406Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:55.005419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:55.005419Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:55.005423Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:55.005426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:55.005435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:55.005438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:55.005474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896882130907128:6404]
2025-09-30T14:58:55.005480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:55.005485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:55.005863Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3060
2025-09-30T14:58:55.005916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3060
2025-09-30T14:58:55.006183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.006199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.006237Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8c031d8-49673fd2-5c102696-a3a18007_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:55.006247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:55.006251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:55.006253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:55.006264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:55.006276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:55.006294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:55.006551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.006559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.006578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:55.006809Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3061 partition: 0 MaxSeqNo: 42 sessionId: src_id|b8c031d8-49673fd2-5c102696-a3a18007_0
2025-09-30T14:58:55.007258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5ece8089-169df3e7-253eefac-c0b987a4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b8c031d8-49673fd2-5c102696-a3a18007_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:55.010445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c031d8-49673fd2-5c102696-a3a18007_0] Write session: try to update token
2025-09-30T14:58:55.010465Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c031d8-49673fd2-5c102696-a3a18007_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:55.019178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:55.019196Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:55.019207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896882130907128:6404]
2025-09-30T14:58:55.019273Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:55.019284Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:55.019453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:55.019611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:55.019752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:55.019896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:55.020110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:55.020156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:55.032478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:55.032500Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:55.032503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:55.032506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:55.032516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896882130907128:6404]
2025-09-30T14:58:55.032521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896882130907128:6404]
2025-09-30T14:58:55.032525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896882130907128:6404]
2025-09-30T14:58:55.032565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:55.032572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.032572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:55.032575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:55.032579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:55.032583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:55.032732Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:55.032965Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3061 sessionId: src_id|b8c031d8-49673fd2-5c102696-a3a18007_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:55.035890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:55.070813Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896886515676064:9657]
2025-09-30T14:58:55.071175Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3060, pipe: [1:7555896886515676064:9657]
2025-09-30T14:58:55.160085Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:55.160558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.160583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.160605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676064:9657], now have 1 active actors on pipe
2025-09-30T14:58:55.160920Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:55.160907Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:55.160981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:55.160992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:55.160994Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896886515676064:9657]
2025-09-30T14:58:55.161071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3061 reason: error at write: Disconnected sessionId: src_id|b8c031d8-49673fd2-5c102696-a3a18007_0
2025-09-30T14:58:55.161283Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3061 sessionId: src_id|b8c031d8-49673fd2-5c102696-a3a18007_0 is DEAD
2025-09-30T14:58:55.161463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c031d8-49673fd2-5c102696-a3a18007_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:55.161473Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c031d8-49673fd2-5c102696-a3a18007_0] Write session will restart in 0.005087s
2025-09-30T14:58:55.161498Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c031d8-49673fd2-5c102696-a3a18007_0] Write session: Do CDS request
2025-09-30T14:58:55.161509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c031d8-49673fd2-5c102696-a3a18007_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:55.171757Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c031d8-49673fd2-5c102696-a3a18007_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:55.171888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:55.171907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3062
2025-09-30T14:58:55.172062Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3062 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:55.172103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3062 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:55.172108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3062 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:55.172112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:55.172587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3062 sessionId:  describe result for acl check
2025-09-30T14:58:55.172626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:55.172628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:55.172630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:55.172636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896886515676130:9181] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:55.173187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896886515676130:9181] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:55.176133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:55.176471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896886515676130:9181] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:55.178549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:55.178927Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:55.178939Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:55.178954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:55.179030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:55.179073Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896886425874590:6396]
2025-09-30T14:58:55.179259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896886515676130:9181] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:55.179278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896886515676130:9181] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:55.179281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896886515676130:9181] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:55.179290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3062 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:55.179757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:55.183355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:55.183449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:55.183840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:55.183919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.183926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.183927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.183928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.183930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.183931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.183932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.183934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.183935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.183937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.183938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.183939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.183940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.183941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.183943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.183949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.183960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.183964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.183969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.183973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.183978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.183982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.183987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.183991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.183996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.184001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.184005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.184009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.184013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.184017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.184028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.184038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.184044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.184050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.184055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.184061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.184066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.184072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.184077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.184082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.184087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.184093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.184098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.184104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.184109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.184114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.184119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.184124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.184128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.184134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.184138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.184144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.184149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.184154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.184159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.184164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.184168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.184173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.184177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.184183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.184228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:55.190955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:55.192305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:55.192330Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:55.192333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:55.192337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:55.192346Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3061 [2:7555896886425874590:6396]
2025-09-30T14:58:55.192366Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:55.192386Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:55.192390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:55.192393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:55.192396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:55.192416Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:55.192426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:55.192435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:55.192892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3061
2025-09-30T14:58:55.192899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3061
2025-09-30T14:58:55.192522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.192535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.192537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.192541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:55.192544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:55.192625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:55.192629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.192644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.192657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.192695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:55.192713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896886425874585:6396]
2025-09-30T14:58:55.192716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896886425874585:6396]
2025-09-30T14:58:55.192719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896886425874585:6396]
2025-09-30T14:58:55.192736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:55.192751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676066:2454], now have 1 active actors on pipe
2025-09-30T14:58:55.192756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676216:9181], now have 1 active actors on pipe
2025-09-30T14:58:55.192766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:55.192781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:55.192784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:55.192831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896886425874585:6396]
2025-09-30T14:58:55.192834Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:55.193180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:55.193194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:55.193198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:55.193206Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:55.193343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.193357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.193388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75556141-13ce9435-11b06ecb-542979a9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:55.193399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:55.193405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:55.193407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:55.193422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:55.193455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:55.193476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:55.193872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.193887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.193918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:55.194026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3062 partition: 0 MaxSeqNo: 42 sessionId: src_id|75556141-13ce9435-11b06ecb-542979a9_0
2025-09-30T14:58:55.194454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8c031d8-49673fd2-5c102696-a3a18007_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|75556141-13ce9435-11b06ecb-542979a9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:55.197477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75556141-13ce9435-11b06ecb-542979a9_0] Write session: try to update token
2025-09-30T14:58:55.197501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75556141-13ce9435-11b06ecb-542979a9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:55.207802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:55.207827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:55.207830Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:55.207833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:55.207847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896886425874585:6396]
2025-09-30T14:58:55.207853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896886425874585:6396]
2025-09-30T14:58:55.207858Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896886425874585:6396]
2025-09-30T14:58:55.207900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:55.207909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.207911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:55.207980Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:55.207995Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:55.207999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:55.208063Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:55.218832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3062 sessionId: src_id|75556141-13ce9435-11b06ecb-542979a9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:55.221683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:55.263315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896886515676228:9657]
2025-09-30T14:58:55.264948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3061, pipe: [1:7555896886515676228:9657]
2025-09-30T14:58:55.342713Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:55.343161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.343172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.343212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676228:9657], now have 1 active actors on pipe
2025-09-30T14:58:55.343515Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:55.344009Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:55.344093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3062 reason: status is not ok: tablet will be restarted right now sessionId: src_id|75556141-13ce9435-11b06ecb-542979a9_0
2025-09-30T14:58:55.344262Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3062 sessionId: src_id|75556141-13ce9435-11b06ecb-542979a9_0 is DEAD
2025-09-30T14:58:55.344401Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:55.344434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896886515676228:9657]
2025-09-30T14:58:55.344738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75556141-13ce9435-11b06ecb-542979a9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:55.344750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75556141-13ce9435-11b06ecb-542979a9_0] Write session will restart in 0.005894s
2025-09-30T14:58:55.344787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75556141-13ce9435-11b06ecb-542979a9_0] Write session: Do CDS request
2025-09-30T14:58:55.344793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75556141-13ce9435-11b06ecb-542979a9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:55.351911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75556141-13ce9435-11b06ecb-542979a9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:55.352209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:55.352232Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3063
2025-09-30T14:58:55.352364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3063 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:55.352397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3063 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:55.352408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3063 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:55.352413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:55.353156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3063 sessionId:  describe result for acl check
2025-09-30T14:58:55.353199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:55.353206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:55.353207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:55.353214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896886515676252:9178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:55.353766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896886515676252:9178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:55.361438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896886515676252:9178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:55.362983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:55.365809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:55.366064Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:55.366079Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:55.366092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:55.366128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896886515676252:9178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:55.366153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896886515676252:9178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:55.366157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896886515676252:9178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:55.366165Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3063 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:55.366159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:55.366214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896886425874744:6390]
2025-09-30T14:58:55.366892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:55.367234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:55.367311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:55.367678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:55.367790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.367797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.367799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.367800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.367802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.367803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.367805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.367806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.367808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.367809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.367811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.367812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.367813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.367815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.367816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.367823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.367835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.367840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.367844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.367849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.367853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.367858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.367863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.367868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.367873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.367878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.367882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.367887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.367898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.367903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.367911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.367928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.367934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.367941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.367956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.367962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.367970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.367976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.367982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.367989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.367994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.368001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.368006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.368013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.368018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.368025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.368031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.368037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.368043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.368051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.368056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.368062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.368068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.368074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.368078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.368084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.368090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.368096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.368102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.368107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.368152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:55.375871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:55.377037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:55.377055Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:55.377058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:55.377062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:55.377070Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3062 [2:7555896886425874744:6390]
2025-09-30T14:58:55.377089Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:55.377106Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:55.377117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:55.377119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:55.377122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:55.377139Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:55.377146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:55.377157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:55.377230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.377238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.377240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.377244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:55.377246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:55.377318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:55.377326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.377341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.377354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.377371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:55.377391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676389:9178], now have 1 active actors on pipe
2025-09-30T14:58:55.377395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676237:2454], now have 1 active actors on pipe
2025-09-30T14:58:55.377401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896886425874739:6390]
2025-09-30T14:58:55.377404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896886425874739:6390]
2025-09-30T14:58:55.377407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896886425874739:6390]
2025-09-30T14:58:55.377415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:55.377426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:55.377429Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:55.377429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:55.377432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:55.377444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:55.377446Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:55.377488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896886425874739:6390]
2025-09-30T14:58:55.377495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:55.377519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:55.377551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.377555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.377483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3062
2025-09-30T14:58:55.377527Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3062
2025-09-30T14:58:55.377577Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:55.377590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:55.377594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:55.377597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:55.377607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:55.377616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:55.377630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:55.377969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.377979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.377995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:55.378102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3063 partition: 0 MaxSeqNo: 42 sessionId: src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0
2025-09-30T14:58:55.378508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75556141-13ce9435-11b06ecb-542979a9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:55.381328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0] Write session: try to update token
2025-09-30T14:58:55.381349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:55.390457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:55.390480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:55.390482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:55.390484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:55.390495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896886425874739:6390]
2025-09-30T14:58:55.390500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896886425874739:6390]
2025-09-30T14:58:55.390504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896886425874739:6390]
2025-09-30T14:58:55.390545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:55.390552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.390554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:55.390576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:55.390584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:55.390589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:55.390707Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:55.404703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3063 sessionId: src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:55.407758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:55.443663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896886515676403:9657]
2025-09-30T14:58:55.444291Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3062, pipe: [1:7555896886515676403:9657]
2025-09-30T14:58:55.508993Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:55.509394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.509411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.509450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676403:9657], now have 1 active actors on pipe
2025-09-30T14:58:55.509810Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:55.509810Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:55.509838Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:55.509854Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896886515676403:9657]
2025-09-30T14:58:55.509915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3063 reason: error at write: Disconnected sessionId: src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0
2025-09-30T14:58:55.510119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3063 sessionId: src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0 is DEAD
2025-09-30T14:58:55.510182Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:55.511067Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:55.511078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0] Write session will restart in 0.007124s
2025-09-30T14:58:55.511100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0] Write session: Do CDS request
2025-09-30T14:58:55.511109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:55.519808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:55.519858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:55.519880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3064
2025-09-30T14:58:55.520144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3064 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:55.520180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3064 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:55.520190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3064 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:55.520194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:55.520698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3064 sessionId:  describe result for acl check
2025-09-30T14:58:55.520737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:55.520754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:55.520763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:55.520769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896886515676419:8563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:55.521327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896886515676419:8563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:55.523289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896886515676419:8563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:55.528302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896886515676419:8563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:55.528323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896886515676419:8563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:55.528327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896886515676419:8563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:55.528335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3064 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:55.533932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:55.536607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:55.536828Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:55.536831Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:55.536838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:55.536878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:55.536905Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896886425874912:6391]
2025-09-30T14:58:55.537411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:55.537774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:55.537807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:55.538071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:55.538122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.538124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.538125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.538127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.538128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.538129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.538130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.538131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.538133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.538134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.538135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.538136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.538138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.538139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.538140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.538146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.538155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.538159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.538163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.538167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.538171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.538174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.538178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.538182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.538186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.538189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.538193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.538196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.538199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.538202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.538210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.538218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.538226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.538231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.538235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.538240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.538244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.538249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.538254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.538259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.538263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.538267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.538272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.538277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.538283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.538288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.538293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.538299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.538303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.538309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.538314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.538318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.538321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.538326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.538331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.538335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.538340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.538345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.538349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.538353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.538396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:55.545105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:55.546079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:55.546092Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:55.546094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:55.546097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:55.546104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3063 [2:7555896886425874912:6391]
2025-09-30T14:58:55.546116Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:55.546129Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:55.546135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:55.546138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:55.546140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:55.546154Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:55.546160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:55.546167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:55.546218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.546224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.546225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.546228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:55.546230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:55.546286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:55.546292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.546301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.546307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.546321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:55.546338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896886425874907:6391]
2025-09-30T14:58:55.546343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896886425874907:6391]
2025-09-30T14:58:55.546345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896886425874907:6391]
2025-09-30T14:58:55.546356Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:55.546369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:55.546378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:55.546384Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:55.546405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:55.546413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896886425874907:6391]
2025-09-30T14:58:55.546415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:55.546415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:55.546417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:55.546422Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:55.546736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676503:8563], now have 1 active actors on pipe
2025-09-30T14:58:55.546750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676404:2454], now have 1 active actors on pipe
2025-09-30T14:58:55.546765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.546775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.546813Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e40ec050-d2aa31cc-94488795-4eb09035_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:55.546824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:55.546832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:55.546834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:55.546845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:55.546861Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:55.546883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:55.547155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.547165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.547181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:55.546626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3063
2025-09-30T14:58:55.546660Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3063
2025-09-30T14:58:55.547330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3064 partition: 0 MaxSeqNo: 42 sessionId: src_id|e40ec050-d2aa31cc-94488795-4eb09035_0
2025-09-30T14:58:55.547702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4bdd5261-ad8b2a88-56cfcba6-8d84855e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e40ec050-d2aa31cc-94488795-4eb09035_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:55.550487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ec050-d2aa31cc-94488795-4eb09035_0] Write session: try to update token
2025-09-30T14:58:55.550506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ec050-d2aa31cc-94488795-4eb09035_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:55.559861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:55.559884Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:55.559887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:55.559889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:55.559898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896886425874907:6391]
2025-09-30T14:58:55.559903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896886425874907:6391]
2025-09-30T14:58:55.559907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896886425874907:6391]
2025-09-30T14:58:55.559948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:55.559952Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:55.559955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.559958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:55.559958Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:55.559963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:55.560121Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:55.566279Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3064 sessionId: src_id|e40ec050-d2aa31cc-94488795-4eb09035_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:55.569124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:55.610063Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896886515676569:9657]
2025-09-30T14:58:55.610475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3063, pipe: [1:7555896886515676569:9657]
2025-09-30T14:58:55.684347Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:55.684697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.684707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.684750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676569:9657], now have 1 active actors on pipe
2025-09-30T14:58:55.685086Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:55.685106Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:55.685110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896886515676569:9657]
2025-09-30T14:58:55.685143Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:55.685175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3064 reason: error at write: Disconnected sessionId: src_id|e40ec050-d2aa31cc-94488795-4eb09035_0
2025-09-30T14:58:55.685388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3064 sessionId: src_id|e40ec050-d2aa31cc-94488795-4eb09035_0 is DEAD
2025-09-30T14:58:55.685029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:55.685551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ec050-d2aa31cc-94488795-4eb09035_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:55.685562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ec050-d2aa31cc-94488795-4eb09035_0] Write session will restart in 0.009039s
2025-09-30T14:58:55.685588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ec050-d2aa31cc-94488795-4eb09035_0] Write session: Do CDS request
2025-09-30T14:58:55.685598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ec050-d2aa31cc-94488795-4eb09035_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:55.695698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ec050-d2aa31cc-94488795-4eb09035_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:55.696723Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:55.696742Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3065
2025-09-30T14:58:55.696904Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3065 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:55.696953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3065 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:55.696964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3065 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:55.696969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:55.697503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3065 sessionId:  describe result for acl check
2025-09-30T14:58:55.697540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:55.697542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:55.697544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:55.697550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896886515676700:9164] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:55.698070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896886515676700:9164] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:55.700272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896886515676700:9164] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:55.700231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:55.702932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896886515676700:9164] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:55.702949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896886515676700:9164] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:55.702953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896886515676700:9164] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:55.702961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3065 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:55.702797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:55.703006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:55.703010Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:55.703020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:55.703071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:55.703108Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896886425875069:6386]
2025-09-30T14:58:55.703813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:55.704155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:55.704204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:55.704548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:55.704600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.704601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.704602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.704603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.704605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.704606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.704607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.704608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.704609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.704611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.704612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.704613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.704615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.704616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.704617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.704623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.704635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.704640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.704645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.704649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.704654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.704658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.704663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.704682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.704687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.704691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.704695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.704699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.704704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.704708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.704717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.704726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.704732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.704738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.704744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.704749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.704756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.704761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.704767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.704773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.704778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.704784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.704789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.704794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.704799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.704804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.704809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.704815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.704819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.704825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.704831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.704837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.704842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.704848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.704854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.704859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.704864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.704870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.704879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.704884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.704931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:55.710665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:55.711575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:55.711591Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:55.711595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:55.711599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:55.711606Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3064 [2:7555896886425875069:6386]
2025-09-30T14:58:55.711624Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:55.711640Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:55.711648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:55.711652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:55.711654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:55.711671Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:55.711682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:55.711689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:55.711746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.711753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.711755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.711759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:55.711761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:55.711825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:55.711833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.711844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.711855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.711873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:55.711894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896886425875064:6386]
2025-09-30T14:58:55.711901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896886425875064:6386]
2025-09-30T14:58:55.711903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896886425875064:6386]
2025-09-30T14:58:55.711912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:55.711922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:55.711925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:55.711928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:55.711929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:55.711943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:55.711952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:55.711963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676737:9164], now have 1 active actors on pipe
2025-09-30T14:58:55.711971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676582:2454], now have 1 active actors on pipe
2025-09-30T14:58:55.712003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896886425875064:6386]
2025-09-30T14:58:55.712014Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:55.712028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:55.712051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3064
2025-09-30T14:58:55.712082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3064
2025-09-30T14:58:55.712128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.712138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.712166Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bea15a55-d20b1693-17b93472-3c48790b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:55.712369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:55.712375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:55.712377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:55.712388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:55.712397Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:55.712411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:55.712726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.712738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.712756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:55.713019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3065 partition: 0 MaxSeqNo: 42 sessionId: src_id|bea15a55-d20b1693-17b93472-3c48790b_0
2025-09-30T14:58:55.713380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e40ec050-d2aa31cc-94488795-4eb09035_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bea15a55-d20b1693-17b93472-3c48790b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:55.716086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bea15a55-d20b1693-17b93472-3c48790b_0] Write session: try to update token
2025-09-30T14:58:55.716104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bea15a55-d20b1693-17b93472-3c48790b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:55.725224Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:55.725252Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:55.725255Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:55.725258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:55.725268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896886425875064:6386]
2025-09-30T14:58:55.725273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896886425875064:6386]
2025-09-30T14:58:55.725277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896886425875064:6386]
2025-09-30T14:58:55.725315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:55.725319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:55.725322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.725324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:55.725325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:55.725329Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:55.725467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:55.735013Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3065 sessionId: src_id|bea15a55-d20b1693-17b93472-3c48790b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:55.737915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:55.785160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896886515676748:9657]
2025-09-30T14:58:55.791526Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3064, pipe: [1:7555896886515676748:9657]
2025-09-30T14:58:55.844431Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:55.844792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.844809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.844830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676748:9657], now have 1 active actors on pipe
2025-09-30T14:58:55.845126Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:55.845413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:55.845440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:55.845507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3065 reason: error at write: Disconnected sessionId: src_id|bea15a55-d20b1693-17b93472-3c48790b_0
2025-09-30T14:58:55.845867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bea15a55-d20b1693-17b93472-3c48790b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:55.845879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bea15a55-d20b1693-17b93472-3c48790b_0] Write session will restart in 0.009633s
2025-09-30T14:58:55.845903Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bea15a55-d20b1693-17b93472-3c48790b_0] Write session: Do CDS request
2025-09-30T14:58:55.845911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bea15a55-d20b1693-17b93472-3c48790b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:55.845698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3065 sessionId: src_id|bea15a55-d20b1693-17b93472-3c48790b_0 is DEAD
2025-09-30T14:58:55.845845Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:55.845879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896886515676748:9657]
2025-09-30T14:58:55.856872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bea15a55-d20b1693-17b93472-3c48790b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:55.860091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:55.860115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3066
2025-09-30T14:58:55.860332Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3066 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:55.860377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3066 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:55.860389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3066 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:55.860394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:55.861596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:55.862194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3066 sessionId:  describe result for acl check
2025-09-30T14:58:55.862237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:55.862240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:55.862243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:55.862250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896886515676869:9152] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:55.862756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896886515676869:9152] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:55.864407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:55.864658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:55.864688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:55.864709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:55.864781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:55.864828Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896886425875226:6377]
2025-09-30T14:58:55.865480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:55.866415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:55.866506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:55.866870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:55.866962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.866973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.866974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.866976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.866978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.866979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.866981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.866982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.866984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.866985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.866987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.866988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.866989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.866990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.866992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.866998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.867010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.867015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.867020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.867024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.867028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.867032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.867037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.867041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.867046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.867050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.867054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.867058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.867062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.867067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.867076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.867085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:55.867092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.867099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:55.867104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.867110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:55.867115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.867122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:55.867127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.867133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:55.867140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.867147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:55.867152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.867159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:55.867166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.867172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:55.867178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.867185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:55.867190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.867182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896886515676869:9152] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:55.867196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:55.867209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.867215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.867220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.867226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.867232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.867239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.867266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.867272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:55.867277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.867283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:55.867331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:55.870775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896886515676869:9152] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:55.870794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896886515676869:9152] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:55.870799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896886515676869:9152] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:55.870809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3066 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:55.875003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:55.877008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3065
2025-09-30T14:58:55.877049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3065
2025-09-30T14:58:55.876273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:55.876292Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:55.876295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:55.876299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:55.876307Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3065 [2:7555896886425875226:6377]
2025-09-30T14:58:55.876324Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:55.876341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:55.876345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:55.876348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:55.876351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:55.876367Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:55.876375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:55.876381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:55.876446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.876448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.876450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.876453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:55.876456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:55.876527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:55.876530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.876543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:55.876555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:55.876571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:55.876587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896886425875221:6377]
2025-09-30T14:58:55.876590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896886425875221:6377]
2025-09-30T14:58:55.876592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896886425875221:6377]
2025-09-30T14:58:55.876612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:55.876625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:55.876641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:55.876644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:55.876694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896886425875221:6377]
2025-09-30T14:58:55.876697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:55.876821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:55.876825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:55.876828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:55.876834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:55.876948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676908:9152], now have 1 active actors on pipe
2025-09-30T14:58:55.876952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676753:2454], now have 1 active actors on pipe
2025-09-30T14:58:55.877436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.877452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.877485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:55.877504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:55.877508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:55.877511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:55.877524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:55.877536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:55.877554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:55.877937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:55.877946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:55.877963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:55.878076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3066 partition: 0 MaxSeqNo: 42 sessionId: src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0
2025-09-30T14:58:55.883469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bea15a55-d20b1693-17b93472-3c48790b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:55.886433Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0] Write session: try to update token
2025-09-30T14:58:55.886461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:55.891755Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:55.891788Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:55.891792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:55.891794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:55.891805Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896886425875221:6377]
2025-09-30T14:58:55.891812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896886425875221:6377]
2025-09-30T14:58:55.891818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896886425875221:6377]
2025-09-30T14:58:55.891867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:55.891868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:55.891874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:55.891876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:55.891877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:55.891879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:55.892036Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:55.938992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3066 sessionId: src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:55.941884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:55.945938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896886515676916:9657]
2025-09-30T14:58:55.946286Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3065, pipe: [1:7555896886515676916:9657]
2025-09-30T14:58:56.008781Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:56.009134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.009150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.009170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896886515676916:9657], now have 1 active actors on pipe
2025-09-30T14:58:56.009565Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:56.009831Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896886515676916:9657]
2025-09-30T14:58:56.009871Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:56.009873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:56.009931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3066 reason: error at write: Disconnected sessionId: src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0
2025-09-30T14:58:56.010089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3066 sessionId: src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0 is DEAD
2025-09-30T14:58:56.010207Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:56.011463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:56.011475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0] Write session will restart in 0.005041s
2025-09-30T14:58:56.011497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0] Write session: Do CDS request
2025-09-30T14:58:56.011506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:56.017835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:56.019876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:56.019898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3067
2025-09-30T14:58:56.023418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3067 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:56.023481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3067 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:56.023486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3067 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:56.023491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:56.024032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3067 sessionId:  describe result for acl check
2025-09-30T14:58:56.024061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:56.024063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:56.024065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:56.024071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896890810644280:9143] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:56.024593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896890810644280:9143] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:56.027945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896890810644280:9143] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:56.029547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:56.032441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896890810644280:9143] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:56.032460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896890810644280:9143] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:56.032463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896890810644280:9143] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:56.032471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3067 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:56.032319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:56.032547Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:56.032551Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:56.032562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:56.032618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:56.032657Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896890720842696:6363]
2025-09-30T14:58:56.033332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:56.033786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:56.033854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:56.034221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:56.034298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.034299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.034300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.034302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.034303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.034304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.034305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.034306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.034307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.034308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.034310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.034311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.034312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.034313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.034314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.034320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.034330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.034334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.034338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.034341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.034346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.034350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.034354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.034357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.034362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.034367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.034370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.034374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.034378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.034383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.034390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.034399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.034406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.034412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.034418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.034423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.034427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.034432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.034437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.034442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.034447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.034454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.034459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.034465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.034469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.034475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.034479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.034484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.034489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.034497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.034503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.034509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.034513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.034519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.034525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.034529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.034534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.034539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.034543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.034548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.034595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:56.044079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:56.045193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:56.045218Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:56.045221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:56.045224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:56.045232Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3066 [2:7555896890720842696:6363]
2025-09-30T14:58:56.045250Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:56.045266Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:56.045270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:56.045275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:56.045278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:56.045295Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:56.045302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:56.045309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:56.045376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.045386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.045388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.045391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:56.045393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:56.045475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:56.045487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.045503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.045520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.045543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:56.045567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896890720842688:6363]
2025-09-30T14:58:56.045575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896890720842688:6363]
2025-09-30T14:58:56.045577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896890720842688:6363]
2025-09-30T14:58:56.045590Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:56.045616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:56.045639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:56.045652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:56.045699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896890720842688:6363]
2025-09-30T14:58:56.045713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:56.046289Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:56.046310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:56.046314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:56.046322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:56.047063Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3066
2025-09-30T14:58:56.047124Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3066
2025-09-30T14:58:56.048845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5a0be034-f26b3fe8-eba5fc15-2b5ef955_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:56.047415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810644226:2454], now have 1 active actors on pipe
2025-09-30T14:58:56.047430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810644381:9143], now have 1 active actors on pipe
2025-09-30T14:58:56.047450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.047455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.047482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:56.047492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:56.047496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:56.047499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:56.047512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:56.047527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:56.047547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:56.047821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.047830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.047856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:56.048374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3067 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0
2025-09-30T14:58:56.051831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0] Write session: try to update token
2025-09-30T14:58:56.051847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:56.070938Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:56.070959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:56.070962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:56.070964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:56.070973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896890720842688:6363]
2025-09-30T14:58:56.070978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896890720842688:6363]
2025-09-30T14:58:56.070982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896890720842688:6363]
2025-09-30T14:58:56.071022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:56.071030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.071033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:56.071178Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:56.071584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:56.071595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:56.071599Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:56.081475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3067 sessionId: src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:56.084481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:56.111328Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896890810644404:9657]
2025-09-30T14:58:56.115348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3066, pipe: [1:7555896890810644404:9657]
2025-09-30T14:58:56.204462Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:56.204886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.204907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.204927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810644404:9657], now have 1 active actors on pipe
2025-09-30T14:58:56.205939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896890810644404:9657]
2025-09-30T14:58:56.205973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:56.206044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3067 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0
2025-09-30T14:58:56.206395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:56.206408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0] Write session will restart in 0.007552s
2025-09-30T14:58:56.206433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0] Write session: Do CDS request
2025-09-30T14:58:56.206439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:56.205208Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:56.206233Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3067 sessionId: src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0 is DEAD
2025-09-30T14:58:56.206432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:56.215710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:56.216626Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:56.216649Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3068
2025-09-30T14:58:56.216867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3068 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:56.216924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3068 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:56.216935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3068 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:56.216940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:56.217475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3068 sessionId:  describe result for acl check
2025-09-30T14:58:56.217509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:56.217513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:56.217515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:56.217520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896890810644416:9132] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:56.218085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896890810644416:9132] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:56.220425Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896890810644416:9132] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:56.225762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896890810644416:9132] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:56.225783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896890810644416:9132] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:56.225787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896890810644416:9132] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:56.225796Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3068 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:56.232300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:56.234435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:56.234638Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:56.234648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:56.234659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:56.234715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:56.234757Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896890720842879:6338]
2025-09-30T14:58:56.235460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:56.236147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:56.236211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:56.236809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:56.236896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.236903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.236925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.236926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.236927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.236928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.236930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.236932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.236933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.236934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.236935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.236937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.236938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.236940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.236941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.236948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.236960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.236964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.236969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.236973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.236977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.236982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.236986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.236990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.236997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.237001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.237005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.237009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.237013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.237017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.237027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.237035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.237042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.237050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.237055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.237060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.237068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.237074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.237082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.237088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.237092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.237097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.237102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.237108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.237113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.237118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.237124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.237130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.237134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.237139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.237144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.237149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.237153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.237159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.237164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.237169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.237173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.237178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.237183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.237187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.237234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:56.243407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:56.244512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:56.244528Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:56.244532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:56.244537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:56.244545Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3067 [2:7555896890720842879:6338]
2025-09-30T14:58:56.244565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:56.244584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:56.244587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:56.244591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:56.244602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:56.244622Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:56.244630Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:56.244638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:56.244719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.244722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.244724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.244727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:56.244730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:56.244806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:56.244809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.244822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.244834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.244849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:56.244868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810644473:9132], now have 1 active actors on pipe
2025-09-30T14:58:56.244875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896890720842874:6338]
2025-09-30T14:58:56.244877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896890720842874:6338]
2025-09-30T14:58:56.244879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896890720842874:6338]
2025-09-30T14:58:56.244889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:56.244904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:56.244906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:56.244911Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:56.244913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:56.244918Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:56.244922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:56.244927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810644407:2454], now have 1 active actors on pipe
2025-09-30T14:58:56.244961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896890720842874:6338]
2025-09-30T14:58:56.244964Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:56.244969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:56.245327Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3067
2025-09-30T14:58:56.245346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3067
2025-09-30T14:58:56.245635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.245647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.245679Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:56.245687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:56.245691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:56.245694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:56.245706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:56.245718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:56.245735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:56.246080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.246087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.246103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:56.246284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3068 partition: 0 MaxSeqNo: 42 sessionId: src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0
2025-09-30T14:58:56.246690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d27b1c9-f1321e2c-64f4c010-dcb33314_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:56.250217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0] Write session: try to update token
2025-09-30T14:58:56.250244Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:56.259922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:56.259945Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:56.259947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:56.259958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:56.259966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896890720842874:6338]
2025-09-30T14:58:56.259969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896890720842874:6338]
2025-09-30T14:58:56.259973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896890720842874:6338]
2025-09-30T14:58:56.260004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:56.260012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.260013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:56.260161Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:56.263320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:56.263345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:56.263350Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:56.270875Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3068 sessionId: src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:56.273797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:56.306381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896890810644575:9657]
2025-09-30T14:58:56.306675Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3067, pipe: [1:7555896890810644575:9657]
2025-09-30T14:58:56.374660Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:56.374943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.374951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.374969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810644575:9657], now have 1 active actors on pipe
2025-09-30T14:58:56.375189Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:56.375547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896890810644575:9657]
2025-09-30T14:58:56.375584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:56.375626Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:56.375672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3068 reason: status is not ok: tablet will be restarted right now sessionId: src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0
2025-09-30T14:58:56.375844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3068 sessionId: src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0 is DEAD
2025-09-30T14:58:56.377404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:56.377416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0] Write session will restart in 0.007472s
2025-09-30T14:58:56.377451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0] Write session: Do CDS request
2025-09-30T14:58:56.377457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:56.385780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:56.386106Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:56.386127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3069
2025-09-30T14:58:56.386257Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3069 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:56.386285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3069 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:56.386290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3069 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:56.386294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:56.386691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3069 sessionId:  describe result for acl check
2025-09-30T14:58:56.386719Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:56.386721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:56.386722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:56.386726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896890810644600:9130] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:56.387234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896890810644600:9130] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:56.395990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:56.396292Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896890810644600:9130] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:56.399394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:56.399659Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:56.399671Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:56.399683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:56.399743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:56.399795Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896890720843038:6331]
2025-09-30T14:58:56.400488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:56.401101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:56.401171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:56.401518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:56.401642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896890810644600:9130] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:56.401666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896890810644600:9130] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:56.401670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896890810644600:9130] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:56.401680Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3069 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:56.401816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.401824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.401826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.401828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.401830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.401831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.401832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.401834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.401835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.401837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.401839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.401840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.401841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.401843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.401844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.401851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.401863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.401868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.401872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.401877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.401882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.401887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.401891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.401896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.401900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.401903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.401907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.401911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.401916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.401920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.401929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.401939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.401948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.401955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.401959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.401966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.401979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.401985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.401992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.401998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.402003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.402009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.402015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.402021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.402026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.402032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.402037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.402043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.402047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.402053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.402058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.402065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.402070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.402076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.402083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.402095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.402100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.402111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.402116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.402122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.402170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:56.410355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:56.411429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:56.411444Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:56.411447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:56.411451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:56.411460Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3068 [2:7555896890720843038:6331]
2025-09-30T14:58:56.411477Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:56.411494Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:56.411498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:56.411501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:56.411504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:56.411531Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:56.411545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:56.411552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:56.411620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.411631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.411634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.411638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:56.411640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:56.411713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:56.411722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.411738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.411751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.411768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:56.411788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810644583:2454], now have 1 active actors on pipe
2025-09-30T14:58:56.411791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810644743:9130], now have 1 active actors on pipe
2025-09-30T14:58:56.411798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896890720843033:6331]
2025-09-30T14:58:56.411800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896890720843033:6331]
2025-09-30T14:58:56.411802Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896890720843033:6331]
2025-09-30T14:58:56.411817Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:56.411839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:56.411843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:56.411847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:56.411849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:56.411859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:56.411862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:56.411902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896890720843033:6331]
2025-09-30T14:58:56.411987Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3068
2025-09-30T14:58:56.411989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3068
2025-09-30T14:58:56.411910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:56.411928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:56.412166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.412182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.412210Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:56.412227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:56.412230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:56.412233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:56.412243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:56.412258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:56.412282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:56.412653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.412680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.412700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:56.412827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3069 partition: 0 MaxSeqNo: 42 sessionId: src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0
2025-09-30T14:58:56.415504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da73c31e-d60c0c87-e75506f7-ab11e0c9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:56.418343Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0] Write session: try to update token
2025-09-30T14:58:56.418365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:56.426878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:56.426901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:56.426904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:56.426906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:56.426916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896890720843033:6331]
2025-09-30T14:58:56.426923Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896890720843033:6331]
2025-09-30T14:58:56.426930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896890720843033:6331]
2025-09-30T14:58:56.426970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:56.426981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.426998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:56.427016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:56.427023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:56.427028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:56.427134Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:56.453104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3069 sessionId: src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:56.455960Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:56.474313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896890810644753:9657]
2025-09-30T14:58:56.474654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3068, pipe: [1:7555896890810644753:9657]
2025-09-30T14:58:56.542941Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:56.543199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.543213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.543233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810644753:9657], now have 1 active actors on pipe
2025-09-30T14:58:56.547534Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:56.547618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:56.547702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896890810644753:9657]
2025-09-30T14:58:56.547705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:56.547819Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3069 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0
2025-09-30T14:58:56.548054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3069 sessionId: src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0 is DEAD
2025-09-30T14:58:56.548246Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:56.548258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0] Write session will restart in 0.007600s
2025-09-30T14:58:56.548284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0] Write session: Do CDS request
2025-09-30T14:58:56.548291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:56.559777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:56.560059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:56.560083Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3070
2025-09-30T14:58:56.560274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3070 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:56.560311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3070 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:56.560319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3070 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:56.560323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:56.560799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3070 sessionId:  describe result for acl check
2025-09-30T14:58:56.560841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:56.560850Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:56.560853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:56.560864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896890810644766:9116] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:56.561432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896890810644766:9116] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:56.563043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896890810644766:9116] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:56.568079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896890810644766:9116] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:56.568105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896890810644766:9116] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:56.568108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896890810644766:9116] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:56.568117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3070 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:56.571865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:56.577347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:56.577611Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:56.577616Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:56.577627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:56.577697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:56.577737Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896890720843213:6332]
2025-09-30T14:58:56.578451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:56.578890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:56.578959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:56.579359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:56.579441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.579448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.579450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.579451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.579453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.579454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.579456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.579458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.579459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.579461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.579462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.579464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.579465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.579467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.579468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.579474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.579487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.579492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.579496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.579501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.579506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.579511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.579515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.579518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.579522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.579525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.579528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.579532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.579536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.579541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.579553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.579563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.579569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.579576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.579582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.579587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.579592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.579598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.579605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.579611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.579617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.579623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.579628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.579641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.579646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.579652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.579657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.579669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.579676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.579681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.579686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.579692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.579697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.579703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.579709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.579715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.579720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.579726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.579731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.579737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.579788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:56.587323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:56.588452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:56.588474Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:56.588478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:56.588482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:56.588489Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3069 [2:7555896890720843213:6332]
2025-09-30T14:58:56.588506Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:56.588523Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:56.588527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:56.588531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:56.588534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:56.588551Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:56.588566Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:56.588579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:56.588645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.588653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.588657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.588661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:56.588676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:56.588753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:56.588763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.588777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.588796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.588819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:56.588839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896890720843207:6332]
2025-09-30T14:58:56.588842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896890720843207:6332]
2025-09-30T14:58:56.588845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896890720843207:6332]
2025-09-30T14:58:56.588861Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:56.588875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:56.588891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:56.588894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:56.588931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896890720843207:6332]
2025-09-30T14:58:56.588940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:56.589094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:56.589104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:56.589107Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:56.589112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:56.589264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810644755:2454], now have 1 active actors on pipe
2025-09-30T14:58:56.589279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810644867:9116], now have 1 active actors on pipe
2025-09-30T14:58:56.589373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3069
2025-09-30T14:58:56.589419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3069
2025-09-30T14:58:56.589536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.589544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.589567Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|107e61b5-64249524-838663a-c592f63b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:56.589580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:56.589584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:56.589587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:56.589598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:56.589613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:56.589633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:56.589800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.589809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.589822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:56.590035Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3070 partition: 0 MaxSeqNo: 42 sessionId: src_id|107e61b5-64249524-838663a-c592f63b_0
2025-09-30T14:58:56.590526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4c27ff9-f6dd9c27-d8a4ce5-6a1852b4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|107e61b5-64249524-838663a-c592f63b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:56.594176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|107e61b5-64249524-838663a-c592f63b_0] Write session: try to update token
2025-09-30T14:58:56.594204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|107e61b5-64249524-838663a-c592f63b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:56.601470Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:56.601492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:56.601501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:56.601503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:56.601512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896890720843207:6332]
2025-09-30T14:58:56.601516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896890720843207:6332]
2025-09-30T14:58:56.601519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896890720843207:6332]
2025-09-30T14:58:56.601560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:56.601567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.601571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:56.601572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:56.601580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:56.601584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:56.601708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:56.621335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3070 sessionId: src_id|107e61b5-64249524-838663a-c592f63b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:56.624803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:56.647858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896890810644936:9657]
2025-09-30T14:58:56.648264Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3069, pipe: [1:7555896890810644936:9657]
2025-09-30T14:58:56.725012Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:56.725335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.725350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.725370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810644936:9657], now have 1 active actors on pipe
2025-09-30T14:58:56.725613Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:56.725680Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896890810644936:9657]
2025-09-30T14:58:56.725704Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:56.725711Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:56.725775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3070 reason: error at write: Disconnected sessionId: src_id|107e61b5-64249524-838663a-c592f63b_0
2025-09-30T14:58:56.725578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:56.725971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3070 sessionId: src_id|107e61b5-64249524-838663a-c592f63b_0 is DEAD
2025-09-30T14:58:56.726110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|107e61b5-64249524-838663a-c592f63b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:56.726120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|107e61b5-64249524-838663a-c592f63b_0] Write session will restart in 0.006270s
2025-09-30T14:58:56.726143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|107e61b5-64249524-838663a-c592f63b_0] Write session: Do CDS request
2025-09-30T14:58:56.726152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|107e61b5-64249524-838663a-c592f63b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:56.733728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|107e61b5-64249524-838663a-c592f63b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:56.733835Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:56.733855Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3071
2025-09-30T14:58:56.734004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3071 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:56.734038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3071 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:56.734046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3071 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:56.734050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:56.734519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3071 sessionId:  describe result for acl check
2025-09-30T14:58:56.734555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:56.734562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:56.734564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:56.734570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896890810644953:9111] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:56.735102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896890810644953:9111] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:56.737560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896890810644953:9111] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:56.740649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896890810644953:9111] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:56.740689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896890810644953:9111] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:56.740693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896890810644953:9111] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:56.740702Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3071 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:56.747932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:56.750370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:56.750560Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:56.750571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:56.750580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:56.750631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:56.750673Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896890720843377:6333]
2025-09-30T14:58:56.751390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:56.751884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:56.751932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:56.752274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:56.752326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.752328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.752329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.752331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.752332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.752333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.752335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.752336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.752337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.752339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.752341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.752342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.752344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.752345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.752346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.752352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.752364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.752369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.752374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.752378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.752383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.752387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.752391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.752396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.752401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.752405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.752410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.752414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.752419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.752423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.752431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.752439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.752446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.752453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.752458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.752464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.752471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.752477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.752482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.752488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.752495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.752501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.752506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.752511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.752517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.752522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.752528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.752533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.752538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.752544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.752549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.752554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.752559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.752565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.752570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.752576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.752582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.752588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.752592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.752598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.752648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:56.758857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:56.759770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:56.759775Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:56.759778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:56.759783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:56.759790Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3070 [2:7555896890720843377:6333]
2025-09-30T14:58:56.759806Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:56.759822Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:56.759826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:56.759829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:56.759832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:56.759846Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:56.759854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:56.759861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:56.759922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.759924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.759927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.759933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:56.759937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:56.760007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:56.760010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.760023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.760036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.760055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:56.760070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896890720843371:6333]
2025-09-30T14:58:56.760073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896890720843371:6333]
2025-09-30T14:58:56.760076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896890720843371:6333]
2025-09-30T14:58:56.760088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:56.760101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:56.760116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:56.760119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:56.760149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896890720843371:6333]
2025-09-30T14:58:56.760152Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:56.760552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3070
2025-09-30T14:58:56.760554Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3070
2025-09-30T14:58:56.760444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:56.760452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:56.760454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:56.760460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:56.760756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810645045:9111], now have 1 active actors on pipe
2025-09-30T14:58:56.760764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810644939:2454], now have 1 active actors on pipe
2025-09-30T14:58:56.761073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.761081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.761110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:56.761118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:56.761122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:56.761124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:56.761137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:56.761149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:56.761164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:56.761464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.761469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.761482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:56.762110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|107e61b5-64249524-838663a-c592f63b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:56.761710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3071 partition: 0 MaxSeqNo: 42 sessionId: src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0
2025-09-30T14:58:56.765266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0] Write session: try to update token
2025-09-30T14:58:56.765286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:56.780096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:56.780117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:56.780120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:56.780122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:56.780133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896890720843371:6333]
2025-09-30T14:58:56.780137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896890720843371:6333]
2025-09-30T14:58:56.780142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896890720843371:6333]
2025-09-30T14:58:56.780179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:56.780187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.780190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:56.780328Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:56.783687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:56.783703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:56.783707Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:56.788784Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3071 sessionId: src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:56.791564Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:56.826043Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896890810645112:9657]
2025-09-30T14:58:56.828343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3070, pipe: [1:7555896890810645112:9657]
2025-09-30T14:58:56.901469Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:56.901811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.901827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.901867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810645112:9657], now have 1 active actors on pipe
2025-09-30T14:58:56.902107Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:56.902145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:56.902164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:56.902222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:56.902226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3071 reason: error at write: Disconnected sessionId: src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0
2025-09-30T14:58:56.902276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896890810645112:9657]
2025-09-30T14:58:56.902409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3071 sessionId: src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0 is DEAD
2025-09-30T14:58:56.903348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:56.903359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0] Write session will restart in 0.006786s
2025-09-30T14:58:56.903382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0] Write session: Do CDS request
2025-09-30T14:58:56.903388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:56.911858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:56.911945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:56.911964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3072
2025-09-30T14:58:56.912135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3072 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:56.912168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3072 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:56.912173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3072 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:56.912177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:56.912558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3072 sessionId:  describe result for acl check
2025-09-30T14:58:56.912580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:56.912584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:56.912586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:56.912592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896890810645130:9108] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:56.913136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896890810645130:9108] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:56.915898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896890810645130:9108] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:56.920255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896890810645130:9108] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:56.920272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896890810645130:9108] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:56.920276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896890810645130:9108] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:56.920284Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3072 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:56.921986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:56.923953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:56.924204Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:56.924216Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:56.924227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:56.924280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:56.924326Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896890720843540:6330]
2025-09-30T14:58:56.925012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:56.925337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:56.925386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:56.925722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:56.925782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.925784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.925785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.925786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.925788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.925789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.925791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.925792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.925794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.925795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.925796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.925798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.925799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.925801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.925802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.925808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.925818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.925822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.925827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.925832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.925836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.925841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.925845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.925849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.925854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.925859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.925863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.925867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.925871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.925874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.925883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.925891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:56.925898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.925904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:56.925909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.925915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:56.925920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.925926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:56.925931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.925937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:56.925941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.925947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:56.925952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.925958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:56.925963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.925969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:56.925976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.925982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:56.925987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.925992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:56.925997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.926003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.926007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.926013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.926019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.926025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.926030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.926035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:56.926040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.926046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:56.926096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:56.931650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:56.932806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:56.932827Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:56.932829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:56.932833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:56.932840Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3071 [2:7555896890720843540:6330]
2025-09-30T14:58:56.932855Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:56.932870Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:56.932875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:56.932878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:56.932880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:56.932897Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:56.932912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:56.932919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:56.932976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.932985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.932987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.932990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:56.932993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:56.933063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:56.933071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.933083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:56.933098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:56.933117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:56.933137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896890720843535:6330]
2025-09-30T14:58:56.933143Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896890720843535:6330]
2025-09-30T14:58:56.933145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896890720843535:6330]
2025-09-30T14:58:56.933159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:56.933177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:56.933196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:56.933204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:56.933207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:56.933211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:56.933213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:56.933238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896890720843535:6330]
2025-09-30T14:58:56.933247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:56.933304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:56.933420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810645114:2454], now have 1 active actors on pipe
2025-09-30T14:58:56.933435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896890810645272:9108], now have 1 active actors on pipe
2025-09-30T14:58:56.933515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3071
2025-09-30T14:58:56.933586Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3071
2025-09-30T14:58:56.933628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.933641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.933665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:56.933673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:56.933679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:56.933682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:56.933692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:56.933702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:56.933714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:56.933890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:56.933898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:56.933912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:56.933996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3072 partition: 0 MaxSeqNo: 42 sessionId: src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0
2025-09-30T14:58:56.934409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90ba28a9-54fdf942-24427d66-7cddf58f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:56.937125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0] Write session: try to update token
2025-09-30T14:58:56.937142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:56.946563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:56.946599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:56.946604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:56.946608Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:56.946619Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896890720843535:6330]
2025-09-30T14:58:56.946626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896890720843535:6330]
2025-09-30T14:58:56.946633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896890720843535:6330]
2025-09-30T14:58:56.946688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:56.946687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:56.946695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:56.946702Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:56.946705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:56.946708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:56.946888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:56.956406Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3072 sessionId: src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:56.959238Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:57.002642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896895105612582:9657]
2025-09-30T14:58:57.002931Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3071, pipe: [1:7555896895105612582:9657]
2025-09-30T14:58:57.062338Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:57.062670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.062686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.062706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105612582:9657], now have 1 active actors on pipe
2025-09-30T14:58:57.063444Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:57.067505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:57.067593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3072 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0
2025-09-30T14:58:57.067948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:57.067959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0] Write session will restart in 0.009979s
2025-09-30T14:58:57.067983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0] Write session: Do CDS request
2025-09-30T14:58:57.067989Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:57.067794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3072 sessionId: src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0 is DEAD
2025-09-30T14:58:57.067985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:57.068018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896895105612582:9657]
2025-09-30T14:58:57.078747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:57.079821Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:57.079841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3073
2025-09-30T14:58:57.080073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3073 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:57.080148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3073 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:57.080155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3073 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:57.080168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:57.080918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3073 sessionId:  describe result for acl check
2025-09-30T14:58:57.080973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:57.080975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:57.080977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:57.080982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896895105612721:9093] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:57.081541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896895105612721:9093] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:57.085303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:57.090407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:57.087788Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896895105612721:9093] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:57.090631Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:57.090642Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:57.090652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:57.090702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:57.090734Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896895015811012:6304]
2025-09-30T14:58:57.091574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:57.091915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:57.091993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:57.092369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:57.092429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.092430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.092432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.092433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.092434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.092436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.092437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.092438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.092439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.092440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.092441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.092442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.092443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.092445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.092446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.092452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.092462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.092467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.092471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.092476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.092481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.092485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.092490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.092494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.092499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.092504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.092509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.092513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.092518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.092522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.092530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.092539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.092545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.092552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.092558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.092564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.092568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.092574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.092579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.092585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.092591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.092596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.092601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.092607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.092612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.092619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.092624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.092629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.092634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.092640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.092645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.092651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.092656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.092675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.092680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.092685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.092690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.092696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.092702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.092707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.092759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:57.095718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896895105612721:9093] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:57.095741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896895105612721:9093] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:57.095744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896895105612721:9093] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:57.095751Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3073 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:57.106255Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3072
2025-09-30T14:58:57.106334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3072
2025-09-30T14:58:57.104790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:57.105827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:57.105833Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:57.105836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:57.105840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:57.105846Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3072 [2:7555896895015811012:6304]
2025-09-30T14:58:57.105862Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:57.105876Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:57.105880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:57.105883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:57.105885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:57.105901Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:57.105912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:57.105919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:57.106004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.106007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.106009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.106012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:57.106014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:57.106083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:57.106086Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.106099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.106110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.106128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:57.106147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896895015811005:6304]
2025-09-30T14:58:57.106150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896895015811005:6304]
2025-09-30T14:58:57.106151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896895015811005:6304]
2025-09-30T14:58:57.106160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:57.106171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:57.106177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105612605:2454], now have 1 active actors on pipe
2025-09-30T14:58:57.106178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:57.106181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:57.106182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:57.106198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:57.106200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:57.106206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105612760:9093], now have 1 active actors on pipe
2025-09-30T14:58:57.106237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896895015811005:6304]
2025-09-30T14:58:57.106247Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:57.106258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:57.106524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.106530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.106556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6457a55-6ab778d4-56189e72-55c947d9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:57.106567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:57.106571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:57.106573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:57.106583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:57.106594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:57.106609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:57.106821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.106827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.106844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:57.107555Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cc8f375-cccfb22-751ac369-ed23ab85_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b6457a55-6ab778d4-56189e72-55c947d9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:57.111212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6457a55-6ab778d4-56189e72-55c947d9_0] Write session: try to update token
2025-09-30T14:58:57.111266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6457a55-6ab778d4-56189e72-55c947d9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:57.106945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3073 partition: 0 MaxSeqNo: 42 sessionId: src_id|b6457a55-6ab778d4-56189e72-55c947d9_0
2025-09-30T14:58:57.127563Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:57.127587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:57.127599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896895015811005:6304]
2025-09-30T14:58:57.127649Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:57.127903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:57.128088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:57.128227Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:57.128370Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:57.128578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:57.128620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:57.128867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:57.135812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3073 sessionId: src_id|b6457a55-6ab778d4-56189e72-55c947d9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:57.133840Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:57.133862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:57.133864Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:57.133869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:57.133879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896895015811005:6304]
2025-09-30T14:58:57.133883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896895015811005:6304]
2025-09-30T14:58:57.133887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896895015811005:6304]
2025-09-30T14:58:57.133924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:57.133930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.133933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:57.134076Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:57.137104Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:57.137120Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:57.137125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:57.138309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:57.168065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896895105612777:9657]
2025-09-30T14:58:57.168350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3072, pipe: [1:7555896895105612777:9657]
2025-09-30T14:58:57.257093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:57.257494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.257511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.257532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105612777:9657], now have 1 active actors on pipe
2025-09-30T14:58:57.257782Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896895105612777:9657]
2025-09-30T14:58:57.257822Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:57.257825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:57.257897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3073 reason: error at write: Disconnected sessionId: src_id|b6457a55-6ab778d4-56189e72-55c947d9_0
2025-09-30T14:58:57.258068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3073 sessionId: src_id|b6457a55-6ab778d4-56189e72-55c947d9_0 is DEAD
2025-09-30T14:58:57.258504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:57.257797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:57.259610Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6457a55-6ab778d4-56189e72-55c947d9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:57.259627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6457a55-6ab778d4-56189e72-55c947d9_0] Write session will restart in 0.005275s
2025-09-30T14:58:57.259659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6457a55-6ab778d4-56189e72-55c947d9_0] Write session: Do CDS request
2025-09-30T14:58:57.259670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6457a55-6ab778d4-56189e72-55c947d9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:57.265726Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6457a55-6ab778d4-56189e72-55c947d9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:57.271433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:57.271455Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3074
2025-09-30T14:58:57.271704Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3074 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:57.271764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3074 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:57.271779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3074 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:57.271784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:57.271880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:57.272306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3074 sessionId:  describe result for acl check
2025-09-30T14:58:57.272350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:57.272352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:57.272354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:57.272360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896895105612907:9085] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:57.272937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896895105612907:9085] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:57.273980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:57.274226Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:57.274237Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:57.274247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:57.274305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:57.274345Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896895015811200:6309]
2025-09-30T14:58:57.274884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896895105612907:9085] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:57.275008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:57.276366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:57.276432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:57.276747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:57.276800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.276805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.276805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.276806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.276807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.276808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.276809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.276809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.276810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.276811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.276813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.276814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.276816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.276817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.276818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.276824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.276834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.276839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.276844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.276848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.276852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.276857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.276861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.276865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.276868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.276870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.276872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.276875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.276878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.276880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.276888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.276893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.276897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.276900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.276906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.276909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.276912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.276915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.276918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.276921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.276924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.276927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.276930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.276934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.276936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.276939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.276942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.276945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.276948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.276951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.276954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.276957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.276961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.276963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.276966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.276969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.276971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.276974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.276976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.276980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.277003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:57.278595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896895105612907:9085] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:57.278616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896895105612907:9085] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:57.278620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896895105612907:9085] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:57.278628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3074 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:57.282552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:57.283771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:57.283792Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:57.283795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:57.283799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:57.283806Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3073 [2:7555896895015811200:6309]
2025-09-30T14:58:57.283823Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:57.283841Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:57.283851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:57.283854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:57.283856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:57.283875Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:57.283887Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:57.283894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:57.283957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.283966Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.283968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.283971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:57.283974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:57.284041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:57.284048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.284063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.284080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.284105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:57.284211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3073
2025-09-30T14:58:57.284248Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3073
2025-09-30T14:58:57.284129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105612946:9085], now have 1 active actors on pipe
2025-09-30T14:58:57.284139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105612780:2454], now have 1 active actors on pipe
2025-09-30T14:58:57.284144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896895015811195:6309]
2025-09-30T14:58:57.284147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896895015811195:6309]
2025-09-30T14:58:57.284149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896895015811195:6309]
2025-09-30T14:58:57.284161Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:57.284175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:57.284174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:57.284177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:57.284179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:57.284190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:57.284193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:57.284229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896895015811195:6309]
2025-09-30T14:58:57.284235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:57.284266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:57.284442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.284451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.284478Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:57.284485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:57.284490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:57.284492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:57.284502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:57.284512Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:57.284526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:57.284750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.284757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.284773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:57.284888Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3074 partition: 0 MaxSeqNo: 42 sessionId: src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0
2025-09-30T14:58:57.285353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6457a55-6ab778d4-56189e72-55c947d9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:57.288706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0] Write session: try to update token
2025-09-30T14:58:57.288733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:57.298894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:57.298916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:57.298919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:57.298920Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:57.298929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896895015811195:6309]
2025-09-30T14:58:57.298941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896895015811195:6309]
2025-09-30T14:58:57.298944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896895015811195:6309]
2025-09-30T14:58:57.298987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:57.298993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.298996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:57.299004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:57.299011Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:57.299015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:57.299132Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:57.326577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3074 sessionId: src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:57.329187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:57.358029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896895105612960:9657]
2025-09-30T14:58:57.358391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3073, pipe: [1:7555896895105612960:9657]
2025-09-30T14:58:57.412964Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:57.413479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.413489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.413513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105612960:9657], now have 1 active actors on pipe
2025-09-30T14:58:57.413958Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896895105612960:9657]
2025-09-30T14:58:57.414000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:57.414003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:57.414072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3074 reason: error at write: Disconnected sessionId: src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0
2025-09-30T14:58:57.414256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:57.414269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3074 sessionId: src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0 is DEAD
2025-09-30T14:58:57.414551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:57.414568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0] Write session will restart in 0.008217s
2025-09-30T14:58:57.414601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0] Write session: Do CDS request
2025-09-30T14:58:57.414609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:57.413951Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:57.424248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:57.424270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:57.424289Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3075
2025-09-30T14:58:57.424546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3075 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:57.424582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3075 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:57.424588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3075 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:57.424593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:57.425681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3075 sessionId:  describe result for acl check
2025-09-30T14:58:57.425735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:57.425739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:57.425741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:57.425747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896895105612981:9073] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:57.426311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896895105612981:9073] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:57.429007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896895105612981:9073] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:57.438094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896895105612981:9073] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:57.438113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896895105612981:9073] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:57.438117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896895105612981:9073] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:57.438126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3075 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:57.442276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:57.449830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:57.450329Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:57.450344Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:57.450360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:57.450446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:57.450496Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896895015811378:6299]
2025-09-30T14:58:57.451207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:57.451699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:57.451754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:57.452115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:57.452174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.452176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.452177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.452179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.452180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.452181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.452183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.452184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.452186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.452187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.452189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.452190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.452192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.452193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.452195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.452201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.452213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.452218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.452222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.452227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.452231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.452235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.452240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.452243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.452248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.452252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.452256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.452260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.452264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.452269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.452278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.452288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.452295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.452301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.452306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.452312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.452316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.452323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.452329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.452335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.452341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.452346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.452351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.452357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.452364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.452372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.452377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.452383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.452388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.452394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.452400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.452406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.452414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.452420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.452427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.452433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.452438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.452444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.452450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.452456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.452505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:57.460912Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3074
2025-09-30T14:58:57.460913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3074
2025-09-30T14:58:57.459445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:57.460462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:57.460470Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:57.460473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:57.460478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:57.460485Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3074 [2:7555896895015811378:6299]
2025-09-30T14:58:57.460502Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:57.460521Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:57.460524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:57.460528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:57.460533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:57.460549Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:57.460556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:57.460563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:57.460626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.460628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.460631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.460634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:57.460637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:57.460722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:57.460726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.460739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.460753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.460773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:57.460790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896895015811373:6299]
2025-09-30T14:58:57.460792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896895015811373:6299]
2025-09-30T14:58:57.460795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896895015811373:6299]
2025-09-30T14:58:57.460805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:57.460817Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:57.460818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105613096:9073], now have 1 active actors on pipe
2025-09-30T14:58:57.460821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:57.460826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:57.460827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:57.460844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:57.460847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:57.460853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105612965:2454], now have 1 active actors on pipe
2025-09-30T14:58:57.460885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896895015811373:6299]
2025-09-30T14:58:57.460897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:57.460989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:57.461153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.461163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.461205Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|479068c9-90eae237-10d21bee-3fdce519_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:57.461222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:57.461227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:57.461229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:57.461240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:57.461252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:57.461274Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:57.461548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.461559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.461576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:57.462928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3075 partition: 0 MaxSeqNo: 42 sessionId: src_id|479068c9-90eae237-10d21bee-3fdce519_0
2025-09-30T14:58:57.463632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a665d9b1-adc3961e-473cd2c5-cf0b2d89_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|479068c9-90eae237-10d21bee-3fdce519_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:57.467084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|479068c9-90eae237-10d21bee-3fdce519_0] Write session: try to update token
2025-09-30T14:58:57.467109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|479068c9-90eae237-10d21bee-3fdce519_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:57.476333Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:57.476355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:57.476358Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:57.476360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:57.476370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896895015811373:6299]
2025-09-30T14:58:57.476374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896895015811373:6299]
2025-09-30T14:58:57.476378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896895015811373:6299]
2025-09-30T14:58:57.476417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:57.476424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.476426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:57.476437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:57.476443Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:57.476448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:57.476561Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:57.507475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3075 sessionId: src_id|479068c9-90eae237-10d21bee-3fdce519_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:57.510283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:57.513163Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896895105613139:9657]
2025-09-30T14:58:57.513503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3074, pipe: [1:7555896895105613139:9657]
2025-09-30T14:58:57.601793Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:57.602148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.602167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.602187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105613139:9657], now have 1 active actors on pipe
2025-09-30T14:58:57.602464Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:57.602484Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896895105613139:9657]
2025-09-30T14:58:57.602508Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:57.602511Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:57.602585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3075 reason: error at write: Disconnected sessionId: src_id|479068c9-90eae237-10d21bee-3fdce519_0
2025-09-30T14:58:57.602646Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:57.602932Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479068c9-90eae237-10d21bee-3fdce519_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:57.602944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479068c9-90eae237-10d21bee-3fdce519_0] Write session will restart in 0.006895s
2025-09-30T14:58:57.602967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479068c9-90eae237-10d21bee-3fdce519_0] Write session: Do CDS request
2025-09-30T14:58:57.602972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479068c9-90eae237-10d21bee-3fdce519_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:57.602771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3075 sessionId: src_id|479068c9-90eae237-10d21bee-3fdce519_0 is DEAD
2025-09-30T14:58:57.610860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|479068c9-90eae237-10d21bee-3fdce519_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:57.610923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:57.610941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3076
2025-09-30T14:58:57.611335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3076 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:57.611382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3076 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:57.611394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3076 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:57.611398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:57.612754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3076 sessionId:  describe result for acl check
2025-09-30T14:58:57.612808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:57.612810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:57.612815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:57.612822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896895105613169:9068] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:57.613420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896895105613169:9068] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:57.620817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896895105613169:9068] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:57.624372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896895105613169:9068] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:57.624396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:57.624397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896895105613169:9068] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:57.624400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896895105613169:9068] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:57.624410Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3076 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:57.626014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:57.626297Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:57.626311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:57.626324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:57.626415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:57.626457Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896895015811546:6300]
2025-09-30T14:58:57.627145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:57.627516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:57.627570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:57.627913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:57.627986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.627996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.627998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.627999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.628000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.628001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.628003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.628004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.628005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.628006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.628007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.628009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.628010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.628011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.628013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.628019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.628030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.628034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.628039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.628043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.628047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.628051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.628055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.628059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.628063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.628067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.628070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.628075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.628079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.628083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.628093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.628101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.628108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.628114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.628119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.628125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.628130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.628136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.628141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.628146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.628151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.628156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.628178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.628184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.628189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.628196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.628201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.628207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.628212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.628218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.628223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.628229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.628232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.628236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.628241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.628246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.628263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.628270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.628275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.628281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.628342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:57.640602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:57.642898Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3075
2025-09-30T14:58:57.642932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3075
2025-09-30T14:58:57.641780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:57.641797Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:57.641799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:57.641804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:57.641811Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3075 [2:7555896895015811546:6300]
2025-09-30T14:58:57.641829Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:57.641848Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:57.641851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:57.641854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:57.641857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:57.641872Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:57.641880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:57.641886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:57.641947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.641949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.641951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.644050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3076 partition: 0 MaxSeqNo: 42 sessionId: src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0
2025-09-30T14:58:57.641955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:57.641957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:57.642027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:57.642031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.642045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.642059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.642079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:57.642094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896895015811540:6300]
2025-09-30T14:58:57.642097Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896895015811540:6300]
2025-09-30T14:58:57.642099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896895015811540:6300]
2025-09-30T14:58:57.642116Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:57.642130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:57.642148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:57.642153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:57.642188Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896895015811540:6300]
2025-09-30T14:58:57.642191Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:57.642362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:57.642366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:57.642368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:57.642375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:57.642560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105613304:9068], now have 1 active actors on pipe
2025-09-30T14:58:57.642565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105613142:2454], now have 1 active actors on pipe
2025-09-30T14:58:57.643118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.643124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.643164Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:57.643172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:57.643177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:57.643179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:57.643191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:57.643202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:57.643218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:57.643636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.643641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.643656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:57.644469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|479068c9-90eae237-10d21bee-3fdce519_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:57.647564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0] Write session: try to update token
2025-09-30T14:58:57.647586Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:57.656035Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:57.656060Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:57.656063Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:57.656065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:57.656076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896895015811540:6300]
2025-09-30T14:58:57.656081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896895015811540:6300]
2025-09-30T14:58:57.656086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896895015811540:6300]
2025-09-30T14:58:57.656130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:57.656137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.656140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:57.656144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:57.656151Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:57.656156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:57.656291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:57.673145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3076 sessionId: src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:57.676019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:57.703201Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896895105613330:9657]
2025-09-30T14:58:57.703616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3075, pipe: [1:7555896895105613330:9657]
2025-09-30T14:58:57.780406Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:57.780827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.780845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.780865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105613330:9657], now have 1 active actors on pipe
2025-09-30T14:58:57.781173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:57.781194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:57.781263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3076 reason: error at write: Disconnected sessionId: src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0
2025-09-30T14:58:57.781444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3076 sessionId: src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0 is DEAD
2025-09-30T14:58:57.781141Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:57.781583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:57.781626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896895105613330:9657]
2025-09-30T14:58:57.783351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:57.783363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0] Write session will restart in 0.006538s
2025-09-30T14:58:57.783390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0] Write session: Do CDS request
2025-09-30T14:58:57.783401Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:57.791112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:57.792020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:57.792041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3077
2025-09-30T14:58:57.795391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3077 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:57.795446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3077 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:57.795450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3077 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:57.795455Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:57.796030Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3077 sessionId:  describe result for acl check
2025-09-30T14:58:57.796078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:57.796080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:57.796083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:57.796089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896895105613348:9066] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:57.796737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896895105613348:9066] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:57.802749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896895105613348:9066] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:57.808018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896895105613348:9066] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:57.808036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896895105613348:9066] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:57.808043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896895105613348:9066] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:57.808051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3077 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:57.816081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:57.818123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:57.818360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:57.818374Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:57.818385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:57.818453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:57.818496Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896895015811713:6292]
2025-09-30T14:58:57.819160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:57.819591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:57.819642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:57.820194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:57.820275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.820281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.820283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.820284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.820285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.820287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.820288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.820290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.820291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.820292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.820294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.820295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.820296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.820298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.820299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.820305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.820316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.820321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.820326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.820330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.820334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.820339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.820343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.820347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.820352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.820355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.820359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.820363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.820367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.820372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.820380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.820389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:57.820395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.820402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:57.820407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.820412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:57.820417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.820423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:57.820428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.820435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:57.820439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.820444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:57.820449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.820455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:57.820459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.820465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:57.820469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.820475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:57.820480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.820485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:57.820493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.820499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.820503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.820510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.820514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.820519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.820523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.820529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:57.820534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.820540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:57.820590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:57.826338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:57.827483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:57.827500Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:57.827503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:57.827511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:57.827519Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3076 [2:7555896895015811713:6292]
2025-09-30T14:58:57.827537Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:57.827552Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:57.827556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:57.827559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:57.827562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:57.827578Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:57.827596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:57.827603Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:57.827675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.827685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.827686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.827690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:57.827692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:57.827769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:57.827778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.827792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:57.827808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:57.827828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:57.827850Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896895015811708:6292]
2025-09-30T14:58:57.827857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896895015811708:6292]
2025-09-30T14:58:57.827859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896895015811708:6292]
2025-09-30T14:58:57.827877Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:57.827897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:57.827917Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:57.827924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:57.827925Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:57.827928Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:57.827939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:57.827964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896895015811708:6292]
2025-09-30T14:58:57.827971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:57.828036Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:57.828266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3076
2025-09-30T14:58:57.828337Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3076
2025-09-30T14:58:57.828415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105613331:2454], now have 1 active actors on pipe
2025-09-30T14:58:57.828425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105613436:9066], now have 1 active actors on pipe
2025-09-30T14:58:57.828448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.828453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.828482Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6b14b729-3f7f767-dbbf566b-7132f384_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:57.828492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:57.828499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:57.828502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:57.828513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:57.828525Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:57.828543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:57.828791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.828809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.828841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:57.828950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3077 partition: 0 MaxSeqNo: 42 sessionId: src_id|6b14b729-3f7f767-dbbf566b-7132f384_0
2025-09-30T14:58:57.829331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0a73397-6acc91ba-f1f10eac-1ee179b7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6b14b729-3f7f767-dbbf566b-7132f384_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:57.832228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14b729-3f7f767-dbbf566b-7132f384_0] Write session: try to update token
2025-09-30T14:58:57.832252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14b729-3f7f767-dbbf566b-7132f384_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:57.847493Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:57.847521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:57.847524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:57.847528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:57.847543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896895015811708:6292]
2025-09-30T14:58:57.847548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896895015811708:6292]
2025-09-30T14:58:57.847552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896895015811708:6292]
2025-09-30T14:58:57.847599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:57.847613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:57.847616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:57.847620Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:57.847636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:57.847641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:57.847762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:57.851269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3077 sessionId: src_id|6b14b729-3f7f767-dbbf566b-7132f384_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:57.854132Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:57.879778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896895105613519:9657]
2025-09-30T14:58:57.880113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3076, pipe: [1:7555896895105613519:9657]
2025-09-30T14:58:57.966773Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:57.967163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:57.967180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:57.967224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105613519:9657], now have 1 active actors on pipe
2025-09-30T14:58:57.967564Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:57.967656Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:57.967667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:57.968171Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:57.967760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3077 reason: error at write: Disconnected sessionId: src_id|6b14b729-3f7f767-dbbf566b-7132f384_0
2025-09-30T14:58:57.967995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3077 sessionId: src_id|6b14b729-3f7f767-dbbf566b-7132f384_0 is DEAD
2025-09-30T14:58:57.968219Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896895105613519:9657]
2025-09-30T14:58:57.974077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14b729-3f7f767-dbbf566b-7132f384_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:57.974091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14b729-3f7f767-dbbf566b-7132f384_0] Write session will restart in 0.007458s
2025-09-30T14:58:57.974117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14b729-3f7f767-dbbf566b-7132f384_0] Write session: Do CDS request
2025-09-30T14:58:57.974126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14b729-3f7f767-dbbf566b-7132f384_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:57.982886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14b729-3f7f767-dbbf566b-7132f384_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:57.982987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:57.983010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3078
2025-09-30T14:58:57.983168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3078 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:57.983200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3078 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:57.983205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3078 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:57.983209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:57.984571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3078 sessionId:  describe result for acl check
2025-09-30T14:58:57.984612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:57.984616Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:57.984617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:57.984623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896895105613575:9048] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:57.985089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896895105613575:9048] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:57.991792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896895105613575:9048] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:57.999621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896895105613575:9048] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:57.999644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896895105613575:9048] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:57.999647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896895105613575:9048] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:57.999657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3078 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:58.000785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:58.002947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:58.003107Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:58.003109Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:58.003118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:58.003166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:58.003209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896899310779178:6290]
2025-09-30T14:58:58.003874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:58.004280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:58.004315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:58.004548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:58.004587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.004588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.004589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.004590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.004590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.004592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.004592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.004593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.004594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.004595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.004595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.004596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.004597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.004598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.004598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.004602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.004609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.004612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.004614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.004617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.004619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.004622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.004624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.004627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.004630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.004632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.004634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.004637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.004639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.004642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.004648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.004653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.004672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.004676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.004679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.004682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.004685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.004691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.004696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.004701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.004705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.004710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.004715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.004719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.004723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.004728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.004732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.004737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.004741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.004746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.004751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.004757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.004761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.004769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.004774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.004778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.004781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.004784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.004787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.004790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.004816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:58.011155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:58.012395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:58.012414Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:58.012417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:58.012421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:58.012427Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3077 [2:7555896899310779178:6290]
2025-09-30T14:58:58.012443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:58.012460Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:58.012464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:58.012469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:58.012478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:58.012496Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:58.012506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:58.012514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:58.012582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.012590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.012594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.012597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:58.012600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:58.012682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:58.012688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.012702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.012712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.012726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:58.012743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896899310779173:6290]
2025-09-30T14:58:58.012746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896899310779173:6290]
2025-09-30T14:58:58.012748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896899310779173:6290]
2025-09-30T14:58:58.012758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:58.012772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:58.012774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:58.012776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:58.012779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:58.012786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:58.012789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:58.012798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105613685:9048], now have 1 active actors on pipe
2025-09-30T14:58:58.012801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896895105613523:2454], now have 1 active actors on pipe
2025-09-30T14:58:58.012832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896899310779173:6290]
2025-09-30T14:58:58.012839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:58.012860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:58.013061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3077
2025-09-30T14:58:58.013087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3077
2025-09-30T14:58:58.013253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.013264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.013291Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87720766-1e789d8d-16cf4659-b78e166_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:58.013299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:58.013304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:58.013307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:58.013321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:58.013332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:58.013350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:58.013659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.013668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.013683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:58.013820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3078 partition: 0 MaxSeqNo: 42 sessionId: src_id|87720766-1e789d8d-16cf4659-b78e166_0
2025-09-30T14:58:58.014263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6b14b729-3f7f767-dbbf566b-7132f384_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|87720766-1e789d8d-16cf4659-b78e166_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:58.017188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87720766-1e789d8d-16cf4659-b78e166_0] Write session: try to update token
2025-09-30T14:58:58.017209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87720766-1e789d8d-16cf4659-b78e166_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:58.027603Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:58.027628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:58.027631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:58.027632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:58.027643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896899310779173:6290]
2025-09-30T14:58:58.027647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896899310779173:6290]
2025-09-30T14:58:58.027651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896899310779173:6290]
2025-09-30T14:58:58.027694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:58.027701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.027703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:58.027849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:58.031877Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:58.031897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:58.031901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:58.039923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3078 sessionId: src_id|87720766-1e789d8d-16cf4659-b78e166_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:58.042836Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:58.067648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896899400580994:9657]
2025-09-30T14:58:58.067985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3077, pipe: [1:7555896899400580994:9657]
2025-09-30T14:58:58.148523Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:58.148810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.148825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.148859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400580994:9657], now have 1 active actors on pipe
2025-09-30T14:58:58.149152Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:58.149359Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:58.149418Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896899400580994:9657]
2025-09-30T14:58:58.149440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:58.149447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:58.149510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3078 reason: error at write: Disconnected sessionId: src_id|87720766-1e789d8d-16cf4659-b78e166_0
2025-09-30T14:58:58.149679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3078 sessionId: src_id|87720766-1e789d8d-16cf4659-b78e166_0 is DEAD
2025-09-30T14:58:58.150008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87720766-1e789d8d-16cf4659-b78e166_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:58.150021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87720766-1e789d8d-16cf4659-b78e166_0] Write session will restart in 0.008166s
2025-09-30T14:58:58.150042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87720766-1e789d8d-16cf4659-b78e166_0] Write session: Do CDS request
2025-09-30T14:58:58.150050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87720766-1e789d8d-16cf4659-b78e166_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:58.159784Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87720766-1e789d8d-16cf4659-b78e166_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:58.159864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:58.159894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3079
2025-09-30T14:58:58.160080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3079 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:58.160113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3079 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:58.160123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3079 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:58.160136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:58.160650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3079 sessionId:  describe result for acl check
2025-09-30T14:58:58.160702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:58.160705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:58.160707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:58.160713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896899400581031:9035] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:58.161287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896899400581031:9035] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:58.167934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896899400581031:9035] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:58.176569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896899400581031:9035] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:58.176593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896899400581031:9035] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:58.176597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896899400581031:9035] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:58.176605Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3079 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:58.184852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:58.188099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:58.188528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:58.188541Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:58.188554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:58.188620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:58.188683Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896899310779386:6270]
2025-09-30T14:58:58.189426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:58.189871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:58.189922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:58.190263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:58.190329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.190330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.190332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.190333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.190335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.190336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.190338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.190339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.190341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.190342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.190344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.190345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.190347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.190348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.190350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.190356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.190369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.190374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.190379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.190384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.190389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.190394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.190399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.190403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.190409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.190413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.190418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.190422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.190427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.190432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.190440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.190449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.190457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.190464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.190469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.190476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.190480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.190486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.190492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.190500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.190505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.190511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.190517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.190523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.190531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.190538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.190543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.190549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.190554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.190560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.190566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.190573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.190578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.190585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.190590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.190597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.190601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.190608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.190613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.190619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.190674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:58.198951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:58.199929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:58.199937Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:58.199941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:58.199945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:58.199954Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3078 [2:7555896899310779386:6270]
2025-09-30T14:58:58.199972Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:58.199991Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:58.199996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:58.200000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:58.200002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:58.200019Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:58.200027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:58.200034Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:58.200103Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.200105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.200108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.200112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:58.200115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:58.200204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:58.200207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.200224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.200236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.200255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:58.200272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896899310779380:6270]
2025-09-30T14:58:58.200275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896899310779380:6270]
2025-09-30T14:58:58.200278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896899310779380:6270]
2025-09-30T14:58:58.200288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:58.200304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:58.200312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:58.200316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:58.200319Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:58.200320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:58.200323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:58.200334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581164:9035], now have 1 active actors on pipe
2025-09-30T14:58:58.200371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581016:2454], now have 1 active actors on pipe
2025-09-30T14:58:58.200375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896899310779380:6270]
2025-09-30T14:58:58.200388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:58.200529Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3078
2025-09-30T14:58:58.200576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3078
2025-09-30T14:58:58.200866Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:58.201113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.201122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.201154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6df24229-58002311-8128c3f3-f9c38b8d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:58.201164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:58.201169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:58.201172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:58.201184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:58.201196Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:58.201235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:58.201623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.201633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.201864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3079 partition: 0 MaxSeqNo: 42 sessionId: src_id|6df24229-58002311-8128c3f3-f9c38b8d_0
2025-09-30T14:58:58.201650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:58.202319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87720766-1e789d8d-16cf4659-b78e166_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6df24229-58002311-8128c3f3-f9c38b8d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:58.205547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6df24229-58002311-8128c3f3-f9c38b8d_0] Write session: try to update token
2025-09-30T14:58:58.205569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6df24229-58002311-8128c3f3-f9c38b8d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:58.214619Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:58.214645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:58.214648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:58.214650Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:58.214666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896899310779380:6270]
2025-09-30T14:58:58.214672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896899310779380:6270]
2025-09-30T14:58:58.214675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896899310779380:6270]
2025-09-30T14:58:58.214723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:58.214730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.214733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:58.214914Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:58.215356Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:58.215372Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:58.215378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:58.224158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3079 sessionId: src_id|6df24229-58002311-8128c3f3-f9c38b8d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:58.227156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:58.249423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896899400581200:9657]
2025-09-30T14:58:58.249776Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3078, pipe: [1:7555896899400581200:9657]
2025-09-30T14:58:58.333594Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:58.333957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.333974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.334015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581200:9657], now have 1 active actors on pipe
2025-09-30T14:58:58.334303Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:58.335116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df24229-58002311-8128c3f3-f9c38b8d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:58.335128Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df24229-58002311-8128c3f3-f9c38b8d_0] Write session will restart in 0.007952s
2025-09-30T14:58:58.335162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df24229-58002311-8128c3f3-f9c38b8d_0] Write session: Do CDS request
2025-09-30T14:58:58.335168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df24229-58002311-8128c3f3-f9c38b8d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:58.334686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:58.334783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3079 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6df24229-58002311-8128c3f3-f9c38b8d_0
2025-09-30T14:58:58.334958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3079 sessionId: src_id|6df24229-58002311-8128c3f3-f9c38b8d_0 is DEAD
2025-09-30T14:58:58.335106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:58.335139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896899400581200:9657]
2025-09-30T14:58:58.344797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6df24229-58002311-8128c3f3-f9c38b8d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:58.345305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:58.345328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3080
2025-09-30T14:58:58.345486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3080 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:58.345520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3080 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:58.345527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3080 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:58.345532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:58.346039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3080 sessionId:  describe result for acl check
2025-09-30T14:58:58.346065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:58.346067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:58.346069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:58.346075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896899400581223:9027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:58.346618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896899400581223:9027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:58.348803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896899400581223:9027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:58.353969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896899400581223:9027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:58.353998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896899400581223:9027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:58.354002Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896899400581223:9027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:58.354012Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3080 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:58.364690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:58.367304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:58.367540Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:58.367546Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:58.367559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:58.367627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:58.367669Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896899310779557:6263]
2025-09-30T14:58:58.368346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:58.368775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:58.368823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:58.369178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:58.369266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.369288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.369289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.369291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.369293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.369294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.369297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.369298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.369300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.369301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.369302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.369304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.369305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.369307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.369308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.369316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.369327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.369332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.369336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.369341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.369346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.369350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.369354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.369358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.369363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.369366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.369371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.369375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.369379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.369383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.369395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.369403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.369410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.369417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.369422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.369427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.369433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.369439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.369445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.369450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.369455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.369461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.369468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.369474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.369480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.369485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.369490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.369496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.369501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.369506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.369512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.369518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.369523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.369530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.369535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.369541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.369546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.369552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.369558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.369564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.369629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:58.387131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:58.388273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:58.388297Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:58.388300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:58.388304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:58.388311Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3079 [2:7555896899310779557:6263]
2025-09-30T14:58:58.388329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:58.388359Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:58.388362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:58.388366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:58.388368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:58.388383Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:58.388390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:58.388396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:58.388467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.388469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.388471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.388475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:58.388477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:58.388552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:58.388555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.388571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.388584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.388603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:58.388635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581208:2454], now have 1 active actors on pipe
2025-09-30T14:58:58.388639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581312:9027], now have 1 active actors on pipe
2025-09-30T14:58:58.388646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896899310779552:6263]
2025-09-30T14:58:58.388648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896899310779552:6263]
2025-09-30T14:58:58.388650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896899310779552:6263]
2025-09-30T14:58:58.388679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:58.388694Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:58.388710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:58.388714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:58.388751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896899310779552:6263]
2025-09-30T14:58:58.388754Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:58.388793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:58.388797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:58.388800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:58.388807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:58.388962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3079
2025-09-30T14:58:58.389008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3079
2025-09-30T14:58:58.389178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.389193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.389223Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:58.389237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:58.389244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:58.389247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:58.389257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:58.389268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:58.389291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:58.389675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.389686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.389704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:58.389970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3080 partition: 0 MaxSeqNo: 42 sessionId: src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0
2025-09-30T14:58:58.390284Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6df24229-58002311-8128c3f3-f9c38b8d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:58.393016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0] Write session: try to update token
2025-09-30T14:58:58.393034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:58.412684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:58.412712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:58.412715Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:58.412717Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:58.412728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896899310779552:6263]
2025-09-30T14:58:58.412733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896899310779552:6263]
2025-09-30T14:58:58.412738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896899310779552:6263]
2025-09-30T14:58:58.412785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:58.412791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:58.412794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.412797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:58.412798Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:58.412803Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:58.412943Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:58.418608Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3080 sessionId: src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:58.422370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:58.439360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896899400581390:9657]
2025-09-30T14:58:58.439867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3079, pipe: [1:7555896899400581390:9657]
2025-09-30T14:58:58.537648Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:58.537972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.537995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.538050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581390:9657], now have 1 active actors on pipe
2025-09-30T14:58:58.538875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:58.543002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:58.543096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3080 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0
2025-09-30T14:58:58.543280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3080 sessionId: src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0 is DEAD
2025-09-30T14:58:58.543434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:58.543466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896899400581390:9657]
2025-09-30T14:58:58.550682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:58.550703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0] Write session will restart in 0.009259s
2025-09-30T14:58:58.550731Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0] Write session: Do CDS request
2025-09-30T14:58:58.550737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:58.563712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:58.567678Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:58.567709Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3081
2025-09-30T14:58:58.567886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3081 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:58.567924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3081 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:58.567930Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3081 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:58.567935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:58.568382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3081 sessionId:  describe result for acl check
2025-09-30T14:58:58.568416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:58.568418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:58.568421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:58.568428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896899400581409:9017] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:58.569076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896899400581409:9017] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:58.571584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896899400581409:9017] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:58.574640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896899400581409:9017] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:58.574657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896899400581409:9017] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:58.574660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896899400581409:9017] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:58.574668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3081 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:58.579743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:58.581732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:58.581959Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:58.581972Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:58.581984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:58.582037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:58.582096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896899310779741:6259]
2025-09-30T14:58:58.582827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:58.583200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:58.583271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:58.583646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:58.583715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.583716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.583717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.583718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.583719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.583721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.583722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.583723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.583725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.583726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.583727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.583728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.583729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.583731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.583732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.583739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.583749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.583754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.583758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.583763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.583767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.583770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.583774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.583777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.583781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.583786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.583790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.583795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.583799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.583803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.583812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.583820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.583826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.583831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.583836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.583843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.583848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.583854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.583859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.583864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.583870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.583876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.583881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.583887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.583891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.583897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.583902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.583910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.583915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.583922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.583928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.583934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.583938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.583943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.583947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.583953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.583958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.583977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.583983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.583991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.584038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:58.594375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3080
2025-09-30T14:58:58.594416Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3080
2025-09-30T14:58:58.592529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:58.593535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:58.593542Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:58.593545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:58.593549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:58.593557Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3080 [2:7555896899310779741:6259]
2025-09-30T14:58:58.593576Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:58.593592Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:58.593596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:58.593599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:58.593601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:58.593619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:58.593627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:58.593635Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:58.593704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.593706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.593708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.593712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:58.593714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:58.593790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:58.593793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.593808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.593819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.593837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:58.593870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896899310779736:6259]
2025-09-30T14:58:58.593873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896899310779736:6259]
2025-09-30T14:58:58.593876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896899310779736:6259]
2025-09-30T14:58:58.593889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:58.593898Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:58.593904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:58.593902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:58.593913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:58.593919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:58.593923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:58.593933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581490:9017], now have 1 active actors on pipe
2025-09-30T14:58:58.593937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581393:2454], now have 1 active actors on pipe
2025-09-30T14:58:58.593972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896899310779736:6259]
2025-09-30T14:58:58.593983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:58.594004Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:58.594841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.594849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.594882Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82e10e0f-7f156e7-5de21810-4688421_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:58.594893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:58.594898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:58.594901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:58.594923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:58.594937Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:58.594954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:58.595449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.595457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.595475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:58.595630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3081 partition: 0 MaxSeqNo: 42 sessionId: src_id|82e10e0f-7f156e7-5de21810-4688421_0
2025-09-30T14:58:58.599418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0602101-22e3f0c4-d4cc88c9-e3fc3a16_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|82e10e0f-7f156e7-5de21810-4688421_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:58.602336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e10e0f-7f156e7-5de21810-4688421_0] Write session: try to update token
2025-09-30T14:58:58.602366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e10e0f-7f156e7-5de21810-4688421_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:58.609144Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:58.609170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:58.609173Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:58.609174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:58.609185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896899310779736:6259]
2025-09-30T14:58:58.609191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896899310779736:6259]
2025-09-30T14:58:58.609196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896899310779736:6259]
2025-09-30T14:58:58.609244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:58.609252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.609250Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:58.609255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:58.609257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:58.609261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:58.609400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:58.643663Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896899400581573:9657]
2025-09-30T14:58:58.644020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3080, pipe: [1:7555896899400581573:9657]
2025-09-30T14:58:58.649611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3081 sessionId: src_id|82e10e0f-7f156e7-5de21810-4688421_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:58.652446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:58.747278Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:58.747642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581573:9657], now have 1 active actors on pipe
2025-09-30T14:58:58.747670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.747677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.748075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:58.748095Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:58.748161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3081 reason: error at write: Disconnected sessionId: src_id|82e10e0f-7f156e7-5de21810-4688421_0
2025-09-30T14:58:58.748204Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:58.748260Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896899400581573:9657]
2025-09-30T14:58:58.747955Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:58.748338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3081 sessionId: src_id|82e10e0f-7f156e7-5de21810-4688421_0 is DEAD
2025-09-30T14:58:58.748501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e10e0f-7f156e7-5de21810-4688421_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:58.748513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e10e0f-7f156e7-5de21810-4688421_0] Write session will restart in 0.006317s
2025-09-30T14:58:58.748551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e10e0f-7f156e7-5de21810-4688421_0] Write session: Do CDS request
2025-09-30T14:58:58.748560Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e10e0f-7f156e7-5de21810-4688421_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:58.755792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82e10e0f-7f156e7-5de21810-4688421_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:58.756167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:58.756203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3082
2025-09-30T14:58:58.756387Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3082 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:58.756436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3082 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:58.756442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3082 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:58.756446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:58.757023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3082 sessionId:  describe result for acl check
2025-09-30T14:58:58.757064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:58.757073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:58.757075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:58.757080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896899400581595:9016] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:58.757655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896899400581595:9016] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:58.760424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896899400581595:9016] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:58.763876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896899400581595:9016] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:58.763894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896899400581595:9016] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:58.763898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896899400581595:9016] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:58.763906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3082 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:58.788345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:58.793267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:58.793523Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:58.793536Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:58.793548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:58.793606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:58.793660Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896899310779916:6256]
2025-09-30T14:58:58.794332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:58.794728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:58.794786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:58.795124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:58.795192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.795198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.795200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.795201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.795202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.795203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.795205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.795206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.795207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.795208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.795210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.795211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.795212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.795214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.795215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.795221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.795232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.795236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.795241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.795257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.795260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.795264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.795269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.795273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.795278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.795282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.795287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.795291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.795295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.795299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.795307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.795316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.795324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.795330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.795335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.795342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.795347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.795352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.795358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.795364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.795369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.795374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.795379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.795385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.795389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.795404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.795417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.795421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.795426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.795432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.795437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.795442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.795447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.795452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.795465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.795470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.795476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.795480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.795486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.795490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.795530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:58.801353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:58.802371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:58.802392Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:58.802395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:58.802400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:58.802408Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3081 [2:7555896899310779916:6256]
2025-09-30T14:58:58.802428Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:58.802804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3081
2025-09-30T14:58:58.802831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3081
2025-09-30T14:58:58.802445Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:58.802458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:58.802462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:58.802468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:58.802485Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:58.802492Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:58.802498Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:58.802566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.802569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.802571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.802575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:58.802578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:58.802652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:58.802656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.802668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.802680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.802698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:58.802716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581588:2454], now have 1 active actors on pipe
2025-09-30T14:58:58.802720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581630:9016], now have 1 active actors on pipe
2025-09-30T14:58:58.802726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896899310779911:6256]
2025-09-30T14:58:58.802728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896899310779911:6256]
2025-09-30T14:58:58.802730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896899310779911:6256]
2025-09-30T14:58:58.802746Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:58.802761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:58.802761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:58.802765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:58.802767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:58.802779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:58.802782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:58.802818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896899310779911:6256]
2025-09-30T14:58:58.802826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:58.802839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:58.802884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.802888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.802917Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:58.802923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:58.802928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:58.802930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:58.802941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:58.802951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:58.802968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:58.807048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.807072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.807106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:58.807263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3082 partition: 0 MaxSeqNo: 42 sessionId: src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0
2025-09-30T14:58:58.811096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82e10e0f-7f156e7-5de21810-4688421_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:58.814150Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0] Write session: try to update token
2025-09-30T14:58:58.814175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:58.819527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:58:58.819553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:58.819567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896899310779911:6256]
2025-09-30T14:58:58.819616Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:58:58.819621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:58:58.819816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:58:58.819974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:58.820124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:58.820301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:58:58.820879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:58:58.820944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:58:58.830384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3082 sessionId: src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:58.831152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:58.831175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:58.831178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:58.831180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:58.831191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896899310779911:6256]
2025-09-30T14:58:58.831196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896899310779911:6256]
2025-09-30T14:58:58.831200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896899310779911:6256]
2025-09-30T14:58:58.831258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:58.831267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.831270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:58.831412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:58.831418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:58.831426Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:58.831431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:58.833223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:58.849895Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896899400581772:9657]
2025-09-30T14:58:58.850400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3081, pipe: [1:7555896899400581772:9657]
2025-09-30T14:58:58.949537Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:58.950095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.950117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.950139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581772:9657], now have 1 active actors on pipe
2025-09-30T14:58:58.950936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:58.950992Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896899400581772:9657]
2025-09-30T14:58:58.951010Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:58.951013Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:58.950751Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:58.951766Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:58.951778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0] Write session will restart in 0.008176s
2025-09-30T14:58:58.951807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0] Write session: Do CDS request
2025-09-30T14:58:58.951812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:58.951408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3082 reason: error at write: Disconnected sessionId: src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0
2025-09-30T14:58:58.951583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3082 sessionId: src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0 is DEAD
2025-09-30T14:58:58.960809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:58.962889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:58.962909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3083
2025-09-30T14:58:58.963077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3083 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:58.963138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3083 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:58.963148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3083 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:58.963153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:58.963700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3083 sessionId:  describe result for acl check
2025-09-30T14:58:58.963743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:58.963750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:58.963752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:58.963759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896899400581818:8996] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:58.964336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896899400581818:8996] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:58.970999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:58.972782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896899400581818:8996] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:58.975805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896899400581818:8996] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:58.975826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896899400581818:8996] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:58.975830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896899400581818:8996] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:58.975839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3083 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:58.975462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:58.975744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:58.975748Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:58.975759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:58.975817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:58.975853Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896899310780089:6254]
2025-09-30T14:58:58.976450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:58.976841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:58.976882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:58.977194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:58.977247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.977248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.977249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.977250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.977252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.977253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.977254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.977255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.977257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.977258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.977259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.977261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.977262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.977263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.977264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.977270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.977279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.977283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.977286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.977290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.977294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.977297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.977301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.977304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.977308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.977312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.977315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.977319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.977322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.977326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.977334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.977343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:58.977348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.977353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:58.977358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.977364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:58.977368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.977373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:58.977377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.977381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:58.977385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.977390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:58.977394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.977399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:58.977403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.977407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:58.977412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.977416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:58.977420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.977424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:58.977429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.977433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.977437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.977441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.977445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.977449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.977453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.977458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:58.977461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.977466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:58.977506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:58.983262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:58.984788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:58.984813Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:58.984816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:58.984821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:58.984829Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3082 [2:7555896899310780089:6254]
2025-09-30T14:58:58.984847Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:58.984866Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:58.984877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:58.984880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:58.984882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:58.984901Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:58.984915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:58.984930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:58.985025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.985035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.985041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.985045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:58.985049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:58.985140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:58.985150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.985164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:58.985181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:58.985204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:58.985328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3082
2025-09-30T14:58:58.985329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3082
2025-09-30T14:58:58.985233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581943:8996], now have 1 active actors on pipe
2025-09-30T14:58:58.985248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896899400581774:2454], now have 1 active actors on pipe
2025-09-30T14:58:58.985255Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896899310780084:6254]
2025-09-30T14:58:58.985257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896899310780084:6254]
2025-09-30T14:58:58.985259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896899310780084:6254]
2025-09-30T14:58:58.985281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:58.985298Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:58.985301Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:58.985302Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:58.985304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:58.985317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:58.985322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:58.985371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896899310780084:6254]
2025-09-30T14:58:58.985381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:58.985396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:58.985422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.985429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.985475Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:58.985484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:58.985489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:58.985490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:58.985502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:58.985516Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:58.985534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:58.985888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:58.985901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:58.985922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:58.986097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3083 partition: 0 MaxSeqNo: 42 sessionId: src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0
2025-09-30T14:58:58.987443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|602237a-a4f7e3cb-1bae51e-e7dffd34_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:58.990373Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0] Write session: try to update token
2025-09-30T14:58:58.990395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:58.998994Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:58.999017Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:58.999019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:58.999021Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:58.999030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896899310780084:6254]
2025-09-30T14:58:58.999035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896899310780084:6254]
2025-09-30T14:58:58.999039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896899310780084:6254]
2025-09-30T14:58:58.999078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:58.999084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:58.999087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:58.999224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:59.000572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:59.000579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:59.000584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:59.014267Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3083 sessionId: src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:59.016931Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:59.050866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896903695549252:9657]
2025-09-30T14:58:59.051316Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3082, pipe: [1:7555896903695549252:9657]
2025-09-30T14:58:59.118338Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:59.118359Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:59.118443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3083 reason: error at write: Disconnected sessionId: src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0
2025-09-30T14:58:59.118642Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3083 sessionId: src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0 is DEAD
2025-09-30T14:58:59.118701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896903695549252:9657]
2025-09-30T14:58:59.118728Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:59.118813Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:59.118826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0] Write session will restart in 0.008220s
2025-09-30T14:58:59.118850Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0] Write session: Do CDS request
2025-09-30T14:58:59.118856Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:59.117508Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:59.117907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.117916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.117938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695549252:9657], now have 1 active actors on pipe
2025-09-30T14:58:59.118447Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:59.127804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:59.127840Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:59.127859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3084
2025-09-30T14:58:59.128056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3084 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:59.128092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3084 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:59.128104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3084 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:59.128110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:59.128538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3084 sessionId:  describe result for acl check
2025-09-30T14:58:59.128575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:59.128577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:59.128579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:59.128584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896903695549287:9001] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:59.129140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896903695549287:9001] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:59.132231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896903695549287:9001] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:59.136029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:59.137182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896903695549287:9001] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:59.137199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896903695549287:9001] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:59.137203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896903695549287:9001] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:59.137212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3084 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:59.138578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:59.138957Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:59.138967Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:59.138979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:59.139038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:59.139080Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896903605747561:6244]
2025-09-30T14:58:59.139724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:59.140149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:59.140195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:59.140494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:59.140555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.140557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.140558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.140559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.140560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.140561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.140563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.140564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.140565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.140581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.140583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.140584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.140585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.140586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.140587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.140593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.140603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.140607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.140610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.140614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.140618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.140622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.140626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.140631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.140636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.140640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.140645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.140648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.140665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.140670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.140677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.140685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.140692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.140698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.140704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.140709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.140715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.140721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.140727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.140733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.140738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.140746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.140751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.140757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.140761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.140767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.140772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.140776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.140781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.140786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.140797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.140803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.140812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.140819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.140830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.140836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.140841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.140847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.140856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.140862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.140920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:59.146628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:59.147671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:59.147686Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:59.147689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:59.147693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:59.147700Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3083 [2:7555896903605747561:6244]
2025-09-30T14:58:59.147717Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:59.147732Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:59.147736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:59.147739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:59.147741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:59.147756Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:59.147764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:59.147781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:59.147842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.147851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.147853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.147857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:59.147860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:59.147949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:59.147960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.147973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.147991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.148013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:59.148036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896903605747555:6244]
2025-09-30T14:58:59.148049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896903605747555:6244]
2025-09-30T14:58:59.148052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896903605747555:6244]
2025-09-30T14:58:59.148069Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:59.148094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:59.148116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:59.148127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:59.148169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896903605747555:6244]
2025-09-30T14:58:59.148179Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:59.151483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:59.151491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695549253:2454], now have 1 active actors on pipe
2025-09-30T14:58:59.151497Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:59.151498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695549426:9001], now have 1 active actors on pipe
2025-09-30T14:58:59.151499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:59.151506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:59.151618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3083
2025-09-30T14:58:59.151652Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3083
2025-09-30T14:58:59.151724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.151741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.151775Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7d047f9c-392b7894-df790641-6eeee146_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:59.151797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:59.151815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:59.151818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:59.151829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:59.151843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:59.151877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:59.152069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.152077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.152113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:59.152220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3084 partition: 0 MaxSeqNo: 42 sessionId: src_id|7d047f9c-392b7894-df790641-6eeee146_0
2025-09-30T14:58:59.152591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b1c00fdb-4b2b1c3a-3cbe6676-5a353429_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7d047f9c-392b7894-df790641-6eeee146_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:59.155570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d047f9c-392b7894-df790641-6eeee146_0] Write session: try to update token
2025-09-30T14:58:59.155591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d047f9c-392b7894-df790641-6eeee146_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:59.164831Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:59.164856Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:59.164859Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:59.164862Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:59.164872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896903605747555:6244]
2025-09-30T14:58:59.164876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896903605747555:6244]
2025-09-30T14:58:59.164883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896903605747555:6244]
2025-09-30T14:58:59.164924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:59.164931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.164934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:59.164943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:59.164951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:59.164955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:59.165073Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:59.172737Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3084 sessionId: src_id|7d047f9c-392b7894-df790641-6eeee146_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:59.175518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:59.219318Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896903695549451:9657]
2025-09-30T14:58:59.229543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3083, pipe: [1:7555896903695549451:9657]
2025-09-30T14:58:59.288161Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:59.288600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.288617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.288670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695549451:9657], now have 1 active actors on pipe
2025-09-30T14:58:59.288902Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:59.289582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d047f9c-392b7894-df790641-6eeee146_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:59.289593Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d047f9c-392b7894-df790641-6eeee146_0] Write session will restart in 0.006930s
2025-09-30T14:58:59.289623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d047f9c-392b7894-df790641-6eeee146_0] Write session: Do CDS request
2025-09-30T14:58:59.289630Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d047f9c-392b7894-df790641-6eeee146_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:59.289106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896903695549451:9657]
2025-09-30T14:58:59.289142Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:59.289174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:59.289255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3084 reason: status is not ok: tablet will be restarted right now sessionId: src_id|7d047f9c-392b7894-df790641-6eeee146_0
2025-09-30T14:58:59.289417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3084 sessionId: src_id|7d047f9c-392b7894-df790641-6eeee146_0 is DEAD
2025-09-30T14:58:59.297843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7d047f9c-392b7894-df790641-6eeee146_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:59.298010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:59.298036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3085
2025-09-30T14:58:59.298191Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3085 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:59.298226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3085 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:59.298232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3085 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:59.298241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:59.298875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3085 sessionId:  describe result for acl check
2025-09-30T14:58:59.298915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:59.298922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:59.298924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:59.298944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896903695549518:8981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:59.299523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896903695549518:8981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:59.302058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896903695549518:8981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:59.305101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:59.305327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896903695549518:8981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:59.305345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896903695549518:8981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:59.305348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896903695549518:8981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:59.305358Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3085 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:59.305764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:59.305970Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:59.305980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:59.305991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:59.306046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:59.306180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896903605747775:6226]
2025-09-30T14:58:59.306796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:59.307753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:59.307815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:59.308150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:59.308216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.308223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.308224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.308226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.308227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.308228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.308229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.308230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.308232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.308233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.308234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.308235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.308236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.308238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.308239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.308245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.308257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.308261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.308266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.308270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.308274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.308278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.308282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.308287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.308291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.308294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.308297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.308301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.308304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.308308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.308316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.308324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.308330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.308336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.308340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.308345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.308349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.308355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.308359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.308366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.308370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.308376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.308380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.308385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.308390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.308395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.308399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.308406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.308410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.308415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.308419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.308424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.308438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.308442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.308447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.308452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.308456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.308462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.308466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.308471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.308519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:59.315112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:59.316230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:59.316254Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:59.316257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:59.316262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:59.316269Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3084 [2:7555896903605747775:6226]
2025-09-30T14:58:59.316287Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:59.316303Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:59.316313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:59.316317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:59.316319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:59.316337Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:59.316345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:59.316363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:59.316433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.316442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.316444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.316447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:59.316450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:59.316522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:59.316531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.316548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.316564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.316585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:59.316609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695549461:2454], now have 1 active actors on pipe
2025-09-30T14:58:59.316617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695549636:8981], now have 1 active actors on pipe
2025-09-30T14:58:59.316624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896903605747768:6226]
2025-09-30T14:58:59.316626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896903605747768:6226]
2025-09-30T14:58:59.316628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896903605747768:6226]
2025-09-30T14:58:59.316645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:59.316670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:59.316675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:59.316682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:59.316685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:59.316689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:59.316692Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:59.316729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896903605747768:6226]
2025-09-30T14:58:59.316739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:59.316742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:59.316699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3084
2025-09-30T14:58:59.316720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3084
2025-09-30T14:58:59.316769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.316779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.316821Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:59.316834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:59.316838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:59.316841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:59.316855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:59.316870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:59.316901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:59.317096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.317114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.317148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:59.317278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3085 partition: 0 MaxSeqNo: 42 sessionId: src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0
2025-09-30T14:58:59.317710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7d047f9c-392b7894-df790641-6eeee146_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:59.320867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0] Write session: try to update token
2025-09-30T14:58:59.320895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:59.332798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:59.332822Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:59.332826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:59.332828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:59.332838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896903605747768:6226]
2025-09-30T14:58:59.332843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896903605747768:6226]
2025-09-30T14:58:59.332847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896903605747768:6226]
2025-09-30T14:58:59.332888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:59.332895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.332895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:59.332898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:59.332902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:59.332906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:59.333043Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:59.342051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3085 sessionId: src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:59.345173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:59.389125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896903695549655:9657]
2025-09-30T14:58:59.389448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3084, pipe: [1:7555896903695549655:9657]
2025-09-30T14:58:59.449192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:59.449689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.449712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.449734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695549655:9657], now have 1 active actors on pipe
2025-09-30T14:58:59.449975Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:59.450077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:59.450105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896903695549655:9657]
2025-09-30T14:58:59.450128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:58:59.450131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:58:59.450188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3085 reason: error at write: Disconnected sessionId: src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0
2025-09-30T14:58:59.450536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:58:59.450546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0] Write session will restart in 0.009590s
2025-09-30T14:58:59.450586Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0] Write session: Do CDS request
2025-09-30T14:58:59.450592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:59.450378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3085 sessionId: src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0 is DEAD
2025-09-30T14:58:59.461851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:59.461923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:59.461946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3086
2025-09-30T14:58:59.462110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3086 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:59.462140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3086 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:59.462152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3086 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:59.462157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:59.462637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3086 sessionId:  describe result for acl check
2025-09-30T14:58:59.462674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:59.462682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:59.462685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:59.462691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896903695549789:8976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:59.463202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896903695549789:8976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:59.465089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:59.465403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896903695549789:8976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:59.467533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:59.467907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:59.467922Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:59.467935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:59.468004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:59.468051Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896903605747963:6224]
2025-09-30T14:58:59.468730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:59.469132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:59.469197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:59.469584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:59.469657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.469659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.469660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.469661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.469663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.469664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.469665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.469667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.469668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.469669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.469671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.469672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.469673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.469675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.469676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.469683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.469695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.469699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.469704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.469709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.469714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.469719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.469723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.469728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.469733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.469737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.469742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.469746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.469751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.469756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.469764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.469774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.469793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.469800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.469805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.469811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.469817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.469823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.469829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.469835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.469840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.469847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.469852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.469859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.469864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.469870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.469875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.469882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.469887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.469893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.469898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.469907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.469912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.469918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.469923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.469928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.469932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.469937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.469942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.469947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.469995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:59.470551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896903695549789:8976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:59.470569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896903695549789:8976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:59.470573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896903695549789:8976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:59.470581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3086 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:59.476293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:59.477402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:59.477424Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:59.477427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:59.477432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:59.477439Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3085 [2:7555896903605747963:6224]
2025-09-30T14:58:59.477456Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:59.477474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:59.477477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:59.477481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:59.477484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:59.477499Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:59.477512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:59.477519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:59.477595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.477602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.477605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.477608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:59.477611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:59.477680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:59.477688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.477700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.477715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.477735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:59.477758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695549656:2454], now have 1 active actors on pipe
2025-09-30T14:58:59.477767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695549833:8976], now have 1 active actors on pipe
2025-09-30T14:58:59.477773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896903605747958:6224]
2025-09-30T14:58:59.477775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896903605747958:6224]
2025-09-30T14:58:59.477777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896903605747958:6224]
2025-09-30T14:58:59.477792Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:59.477810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:59.477821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:59.477825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:59.477829Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:59.477829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:59.477832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:59.477914Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3085
2025-09-30T14:58:59.477871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896903605747958:6224]
2025-09-30T14:58:59.477965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3085
2025-09-30T14:58:59.477884Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:59.477902Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:59.478093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.478106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.478142Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4104c083-1055d39d-a2025812-a5092fb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:59.478151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:59.478155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:59.478157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:59.478168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:59.478180Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:59.478195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:59.478668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.478683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.478709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:59.478827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3086 partition: 0 MaxSeqNo: 42 sessionId: src_id|4104c083-1055d39d-a2025812-a5092fb1_0
2025-09-30T14:58:59.479209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8316b6b-8081e66e-a265c6b2-86153c64_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4104c083-1055d39d-a2025812-a5092fb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:59.482101Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4104c083-1055d39d-a2025812-a5092fb1_0] Write session: try to update token
2025-09-30T14:58:59.482122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4104c083-1055d39d-a2025812-a5092fb1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:59.490635Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:59.490662Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:59.490665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:59.490667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:59.490677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896903605747958:6224]
2025-09-30T14:58:59.490682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896903605747958:6224]
2025-09-30T14:58:59.490686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896903605747958:6224]
2025-09-30T14:58:59.490725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:59.490732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.490735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:59.490737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:59.490744Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:59.490748Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:59.490873Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:59.502322Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3086 sessionId: src_id|4104c083-1055d39d-a2025812-a5092fb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:59.505157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:59.550410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896903695549842:9657]
2025-09-30T14:58:59.550719Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3085, pipe: [1:7555896903695549842:9657]
2025-09-30T14:58:59.614381Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:59.614797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.614807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.614827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695549842:9657], now have 1 active actors on pipe
2025-09-30T14:58:59.615691Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:59.619399Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896903695549842:9657]
2025-09-30T14:58:59.619419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:59.619447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:59.620010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4104c083-1055d39d-a2025812-a5092fb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:59.620023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4104c083-1055d39d-a2025812-a5092fb1_0] Write session will restart in 0.008801s
2025-09-30T14:58:59.620052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4104c083-1055d39d-a2025812-a5092fb1_0] Write session: Do CDS request
2025-09-30T14:58:59.620058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4104c083-1055d39d-a2025812-a5092fb1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:59.619529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3086 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4104c083-1055d39d-a2025812-a5092fb1_0
2025-09-30T14:58:59.619709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3086 sessionId: src_id|4104c083-1055d39d-a2025812-a5092fb1_0 is DEAD
2025-09-30T14:58:59.629766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4104c083-1055d39d-a2025812-a5092fb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:59.629931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:59.629952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3087
2025-09-30T14:58:59.631495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3087 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:59.631564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3087 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:59.631579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3087 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:59.631588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:59.632063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3087 sessionId:  describe result for acl check
2025-09-30T14:58:59.632101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:59.632104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:59.632106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:59.632113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896903695549860:8977] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:59.632779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896903695549860:8977] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:59.639036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896903695549860:8977] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:59.648165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896903695549860:8977] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:59.648186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896903695549860:8977] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:59.648189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896903695549860:8977] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:59.648198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3087 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:59.648429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:59.653315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:59.653574Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:59.653586Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:59.653597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:59.653662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:59.653713Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896903605748145:6217]
2025-09-30T14:58:59.654391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:59.654746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:59.654793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:59.655144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:59.655209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.655216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.655217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.655218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.655220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.655221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.655222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.655224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.655225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.655227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.655228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.655229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.655231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.655232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.655233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.655239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.655273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.655278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.655283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.655287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.655292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.655297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.655301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.655305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.655310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.655314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.655319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.655323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.655327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.655332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.655340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.655354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.655361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.655372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.655376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.655382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.655387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.655393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.655399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.655410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.655414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.655426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.655431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.655441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.655445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.655453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.655462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.655467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.655476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.655482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.655489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.655499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.655504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.655510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.655518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.655524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.655532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.655537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.655544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.655555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.655606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:59.661792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:59.662868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:59.662890Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:59.662893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:59.662897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:59.662904Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3086 [2:7555896903605748145:6217]
2025-09-30T14:58:59.662922Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:59.662938Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:59.662941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:59.662944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:59.662946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:59.662963Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:59.662970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:59.662985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:59.663052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.663060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.663063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.663067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:59.663069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:59.663137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:59.663146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.663160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.663174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.663191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:59.663211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695550017:8977], now have 1 active actors on pipe
2025-09-30T14:58:59.663215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695549843:2454], now have 1 active actors on pipe
2025-09-30T14:58:59.663221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896903605748137:6217]
2025-09-30T14:58:59.663223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896903605748137:6217]
2025-09-30T14:58:59.663226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896903605748137:6217]
2025-09-30T14:58:59.663234Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:59.663264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:59.663269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:59.663292Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3086
2025-09-30T14:58:59.663304Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3086
2025-09-30T14:58:59.663276Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:59.663276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:59.663280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:59.663286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:59.663315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896903605748137:6217]
2025-09-30T14:58:59.663318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:59.663328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:59.663471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.663478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.663508Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:59.663524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:59.663527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:59.663529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:59.663540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:59.663559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:59.663577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:59.663762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.663771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.663784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:59.663944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3087 partition: 0 MaxSeqNo: 42 sessionId: src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0
2025-09-30T14:58:59.664328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4104c083-1055d39d-a2025812-a5092fb1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:59.666994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0] Write session: try to update token
2025-09-30T14:58:59.667014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:59.675742Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:59.675769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:59.675771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:59.675773Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:59.675782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896903605748137:6217]
2025-09-30T14:58:59.675787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896903605748137:6217]
2025-09-30T14:58:59.675791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896903605748137:6217]
2025-09-30T14:58:59.675834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:59.675842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.675841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:59.675844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:59.675847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:59.675851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:59.675986Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:59.685612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3087 sessionId: src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:59.688349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:59.717346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896903695550043:9657]
2025-09-30T14:58:59.717619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3086, pipe: [1:7555896903695550043:9657]
2025-09-30T14:58:59.787006Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:59.787416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.787437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.787458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695550043:9657], now have 1 active actors on pipe
2025-09-30T14:58:59.787688Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:59.788327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:59.788413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3087 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0
2025-09-30T14:58:59.788606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3087 sessionId: src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0 is DEAD
2025-09-30T14:58:59.788764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:59.788777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0] Write session will restart in 0.007294s
2025-09-30T14:58:59.788804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0] Write session: Do CDS request
2025-09-30T14:58:59.788810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:59.788834Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:59.788883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896903695550043:9657]
2025-09-30T14:58:59.798931Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:59.799290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:59.799317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3088
2025-09-30T14:58:59.800407Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3088 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:59.800459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3088 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:59.800472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3088 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:59.800477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:59.801008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3088 sessionId:  describe result for acl check
2025-09-30T14:58:59.801050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:59.801057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:59.801059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:59.801066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896903695550177:8967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:59.801676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896903695550177:8967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:59.803612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:59.804507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896903695550177:8967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:59.807106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:59.807489Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:59.807503Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:59.807517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:59.807588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:59.807636Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896903605748322:6221]
2025-09-30T14:58:59.807749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896903695550177:8967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:59.807767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896903695550177:8967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:59.807772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896903695550177:8967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:59.807780Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3088 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:59.808298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:59.808661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:59.808712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:59.809058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:59.809126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.809132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.809134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.809135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.809136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.809138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.809139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.809141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.809143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.809144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.809145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.809147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.809148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.809151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.809152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.809158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.809169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.809173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.809178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.809182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.809187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.809191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.809196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.809200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.809205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.809209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.809213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.809218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.809222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.809226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.809234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.809244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.809256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.809262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.809271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.809276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.809286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.809293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.809303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.809308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.809318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.809323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.809332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.809338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.809347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.809353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.809362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.809368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.809373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.809379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.809403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.809413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.809418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.809429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.809434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.809443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.809448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.809453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.809463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.809468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.809513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:59.815349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:59.816381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:59.816399Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:59.816401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:59.816406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:59.816413Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3087 [2:7555896903605748322:6221]
2025-09-30T14:58:59.816430Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:59.816446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:59.816450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:59.816453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:59.816456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:59.816472Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:59.816479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:59.816486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:59.816550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.816561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.816563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.816567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:59.816569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:59.816832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3087
2025-09-30T14:58:59.816832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3087
2025-09-30T14:58:59.816641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:59.816745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.816760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.816776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.816798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:59.816819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695550044:2454], now have 1 active actors on pipe
2025-09-30T14:58:59.816823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695550222:8967], now have 1 active actors on pipe
2025-09-30T14:58:59.816829Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896903605748317:6221]
2025-09-30T14:58:59.816831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896903605748317:6221]
2025-09-30T14:58:59.816834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896903605748317:6221]
2025-09-30T14:58:59.816848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:59.816863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:59.816878Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:59.816881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:59.816903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:59.816907Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:59.816909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:59.816914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896903605748317:6221]
2025-09-30T14:58:59.816917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:59.816927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:59.816938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.816942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.816990Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:59.816997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:59.817000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:59.817003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:59.817015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:59.817024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:59.817045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:59.817277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.817287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.817302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:59.817407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3088 partition: 0 MaxSeqNo: 42 sessionId: src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0
2025-09-30T14:58:59.817849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d6f6e2-3887fb99-cb0c691b-cd5f2eb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:59.820630Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0] Write session: try to update token
2025-09-30T14:58:59.820667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:59.830598Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:59.830625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:59.830628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:59.830631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:59.830641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896903605748317:6221]
2025-09-30T14:58:59.830649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896903605748317:6221]
2025-09-30T14:58:59.830653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896903605748317:6221]
2025-09-30T14:58:59.830698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:59.830706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.830709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:59.830852Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:58:59.835083Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:59.835130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:59.835135Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:59.837580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3088 sessionId: src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:58:59.840611Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:58:59.888871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896903695550234:9657]
2025-09-30T14:58:59.889330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3087, pipe: [1:7555896903695550234:9657]
2025-09-30T14:58:59.952592Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:58:59.952949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.952957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.952996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695550234:9657], now have 1 active actors on pipe
2025-09-30T14:58:59.955490Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:58:59.956936Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:58:59.956949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0] Write session will restart in 0.005711s
2025-09-30T14:58:59.956973Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0] Write session: Do CDS request
2025-09-30T14:58:59.956978Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:58:59.956480Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:58:59.956483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896903695550234:9657]
2025-09-30T14:58:59.956516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:58:59.956598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3088 reason: status is not ok: tablet will be restarted right now sessionId: src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0
2025-09-30T14:58:59.956774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3088 sessionId: src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0 is DEAD
2025-09-30T14:58:59.963747Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:59.971123Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:58:59.971145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3089
2025-09-30T14:58:59.971851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:58:59.974111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:58:59.974363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:58:59.974373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:58:59.974384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:58:59.974440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:58:59.974493Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896903605748502:6219]
2025-09-30T14:58:59.975054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:58:59.975316Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3089 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:58:59.975368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3089 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:58:59.975383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3089 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:58:59.975389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:58:59.975417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:58:59.975480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:58:59.975791Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3089 sessionId:  describe result for acl check
2025-09-30T14:58:59.975824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:58:59.975830Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:58:59.975832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:58:59.975838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896903695550382:8963] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:58:59.975843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:58:59.975920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.975929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.975931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.975932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.975933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.975935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.975936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.975937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.975939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.975940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.975942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.975943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.975944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.975946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.975947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.975953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.975964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.975969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.975973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.975978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.975982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.975986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.975990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.975994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.975999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.976003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.976007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.976011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.976015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.976019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.976028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.976037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:58:59.976043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.976049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:58:59.976054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.976060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:58:59.976065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.976071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:58:59.976075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.976090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:58:59.976095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.976101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:58:59.976106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.976111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:58:59.976115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.976122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:58:59.976132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.976137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:58:59.976142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.976146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:58:59.976151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.976156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.976160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.976166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.976172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.976178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.976187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.976192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:58:59.976197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.976202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:58:59.976248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:58:59.976375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896903695550382:8963] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:58:59.978389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896903695550382:8963] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:58:59.981754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:58:59.981364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896903695550382:8963] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:58:59.981385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896903695550382:8963] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:58:59.981389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896903695550382:8963] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:58:59.981397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3089 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:58:59.983437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:58:59.983457Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:58:59.983460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:58:59.983464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:58:59.983470Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3088 [2:7555896903605748502:6219]
2025-09-30T14:58:59.983489Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:58:59.983503Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:58:59.983506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:59.983509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:59.983511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:59.983526Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:58:59.983532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:58:59.983539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:58:59.983595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.983607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.983609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.983612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:58:59.983615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:58:59.983681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:58:59.983689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.983704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:58:59.983716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:58:59.983737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:58:59.983762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695550238:2454], now have 1 active actors on pipe
2025-09-30T14:58:59.983769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896903605748497:6219]
2025-09-30T14:58:59.983771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896903605748497:6219]
2025-09-30T14:58:59.983773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896903605748497:6219]
2025-09-30T14:58:59.983782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:58:59.983792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896903695550414:8963], now have 1 active actors on pipe
2025-09-30T14:58:59.983800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:58:59.983815Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:58:59.983824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:58:59.983825Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:58:59.983831Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:58:59.983835Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:58:59.983859Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896903605748497:6219]
2025-09-30T14:58:59.983841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3088
2025-09-30T14:58:59.983873Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3088
2025-09-30T14:58:59.983876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:58:59.983894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:58:59.984091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.984102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.984130Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e12332f8-5eff1dd-655adb3a-f7368814_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:58:59.984143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:58:59.984146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:58:59.984148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:58:59.984157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:58:59.984171Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:58:59.984188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:59.984482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:58:59.984491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:58:59.984506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:58:59.984672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3089 partition: 0 MaxSeqNo: 42 sessionId: src_id|e12332f8-5eff1dd-655adb3a-f7368814_0
2025-09-30T14:58:59.985261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc45e58-4dd5738e-85682be6-4d4aefc6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e12332f8-5eff1dd-655adb3a-f7368814_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:58:59.988254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e12332f8-5eff1dd-655adb3a-f7368814_0] Write session: try to update token
2025-09-30T14:58:59.988273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e12332f8-5eff1dd-655adb3a-f7368814_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:58:59.999335Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:58:59.999361Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:58:59.999364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:58:59.999366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:58:59.999378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896903605748497:6219]
2025-09-30T14:58:59.999383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896903605748497:6219]
2025-09-30T14:58:59.999387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896903605748497:6219]
2025-09-30T14:58:59.999442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:58:59.999450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:58:59.999457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:58:59.999523Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:58:59.999541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:58:59.999545Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:58:59.999602Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:00.007924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3089 sessionId: src_id|e12332f8-5eff1dd-655adb3a-f7368814_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:00.011098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:00.056811Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896907990517719:9657]
2025-09-30T14:59:00.057342Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3088, pipe: [1:7555896907990517719:9657]
2025-09-30T14:59:00.124325Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:00.124696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.124719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.124775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990517719:9657], now have 1 active actors on pipe
2025-09-30T14:59:00.125103Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:00.125646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12332f8-5eff1dd-655adb3a-f7368814_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:00.125658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12332f8-5eff1dd-655adb3a-f7368814_0] Write session will restart in 0.005030s
2025-09-30T14:59:00.125169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:00.125188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:00.125681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12332f8-5eff1dd-655adb3a-f7368814_0] Write session: Do CDS request
2025-09-30T14:59:00.125259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3089 reason: error at write: Disconnected sessionId: src_id|e12332f8-5eff1dd-655adb3a-f7368814_0
2025-09-30T14:59:00.125447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3089 sessionId: src_id|e12332f8-5eff1dd-655adb3a-f7368814_0 is DEAD
2025-09-30T14:59:00.125687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12332f8-5eff1dd-655adb3a-f7368814_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:00.125486Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:00.125535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896907990517719:9657]
2025-09-30T14:59:00.131837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e12332f8-5eff1dd-655adb3a-f7368814_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:00.131891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:00.131910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3090
2025-09-30T14:59:00.132103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3090 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:00.132136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3090 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:00.132141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3090 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:00.132145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:00.132602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3090 sessionId:  describe result for acl check
2025-09-30T14:59:00.132637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:00.132640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:00.132641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:00.132664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896907990517736:8954] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:00.133227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896907990517736:8954] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:00.136954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896907990517736:8954] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:00.141108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896907990517736:8954] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:00.141129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896907990517736:8954] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:00.141135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896907990517736:8954] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:00.141144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3090 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:00.147971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:00.150884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:00.151125Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:00.151129Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:00.151142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:00.151206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:00.151268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896907900715982:6210]
2025-09-30T14:59:00.151926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:00.152328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:00.152392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:00.152771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:00.152848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.152856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.152857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.152858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.152860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.152861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.152863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.152864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.152866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.152868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.152869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.152871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.152872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.152873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.152875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.152881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.152892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.152897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.152902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.152906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.152911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.152915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.152919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.152923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.152927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.152931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.152935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.152939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.152944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.152948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.152957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.152966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.152972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.152978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.152983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.152992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.152996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.153002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.153007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.153013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.153019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.153025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.153031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.153036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.153040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.153045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.153050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.153056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.153060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.153065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.153082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.153094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.153099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.153104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.153110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.153115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.153120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.153125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.153130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.153136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.153182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:00.160076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:00.161259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:00.161280Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:00.161284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:00.161288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:00.161296Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3089 [2:7555896907900715982:6210]
2025-09-30T14:59:00.161317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:00.161334Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:00.161338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:00.161342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:00.161347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:00.161364Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:00.161376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:00.161389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:00.161464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.161475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.161480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.161484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:00.161487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:00.161562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:00.161570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.161584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.161615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.161636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:00.161660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990517807:8954], now have 1 active actors on pipe
2025-09-30T14:59:00.161668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990517721:2454], now have 1 active actors on pipe
2025-09-30T14:59:00.161675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896907900715977:6210]
2025-09-30T14:59:00.161682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896907900715977:6210]
2025-09-30T14:59:00.161685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896907900715977:6210]
2025-09-30T14:59:00.161703Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:00.161722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:00.161744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:00.161752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:00.161792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896907900715977:6210]
2025-09-30T14:59:00.161800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:00.161803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:00.161808Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:00.161811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:00.161818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:00.161805Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3089
2025-09-30T14:59:00.161842Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3089
2025-09-30T14:59:00.162093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.162107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.162138Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:00.162147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:00.162150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:00.162153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:00.162163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:00.162175Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:00.162205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:00.162397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.162405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.162418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:00.162539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3090 partition: 0 MaxSeqNo: 42 sessionId: src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0
2025-09-30T14:59:00.162946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e12332f8-5eff1dd-655adb3a-f7368814_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:00.166005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0] Write session: try to update token
2025-09-30T14:59:00.166030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:00.176592Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:00.176617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:00.176620Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:00.176622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:00.176632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896907900715977:6210]
2025-09-30T14:59:00.176637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896907900715977:6210]
2025-09-30T14:59:00.176641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896907900715977:6210]
2025-09-30T14:59:00.176713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:00.176720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.176723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:00.176733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:00.176740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:00.176745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:00.176888Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:00.197027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3090 sessionId: src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:00.199978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:00.228326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896907990517911:9657]
2025-09-30T14:59:00.228725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3089, pipe: [1:7555896907990517911:9657]
2025-09-30T14:59:00.306377Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:00.306786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.306879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.306906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990517911:9657], now have 1 active actors on pipe
2025-09-30T14:59:00.307130Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:00.307170Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:00.307190Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:00.307284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3090 reason: error at write: Disconnected sessionId: src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0
2025-09-30T14:59:00.307682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:00.307693Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0] Write session will restart in 0.005585s
2025-09-30T14:59:00.307719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0] Write session: Do CDS request
2025-09-30T14:59:00.307729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:00.307478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3090 sessionId: src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0 is DEAD
2025-09-30T14:59:00.307551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:00.307590Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896907990517911:9657]
2025-09-30T14:59:00.314872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:00.315417Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:00.315441Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3091
2025-09-30T14:59:00.315598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3091 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:00.315634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3091 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:00.315640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3091 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:00.315645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:00.316068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3091 sessionId:  describe result for acl check
2025-09-30T14:59:00.316106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:00.316113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:00.316115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:00.316122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896907990517952:8938] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:00.316738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896907990517952:8938] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:00.319343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896907990517952:8938] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:00.324889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896907990517952:8938] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:00.324913Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896907990517952:8938] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:00.324917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896907990517952:8938] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:00.324927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3091 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:00.330690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:00.334952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:00.335378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:00.335392Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:00.335405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:00.335477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:00.335522Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896907900716201:6183]
2025-09-30T14:59:00.336151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:00.336999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:00.337073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:00.337475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:00.337588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.337596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.337598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.337599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.337600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.337602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.337604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.337605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.337606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.337608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.337610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.337611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.337613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.337614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.337616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.337623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.337635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.337639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.337644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.337648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.337652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.337657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.337662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.337666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.337671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.337675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.337680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.337684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.337689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.337692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.337702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.337711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.337718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.337727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.337733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.337738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.337743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.337749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.337757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.337763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.337767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.337773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.337778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.337783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.337788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.337793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.337807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.337813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.337817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.337822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.337827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.337838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.337843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.337849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.337858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.337864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.337875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.337880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.337885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.337891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.337941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:00.343903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:00.344998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:00.345020Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:00.345024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:00.345029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:00.345036Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3090 [2:7555896907900716201:6183]
2025-09-30T14:59:00.345056Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:00.345075Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:00.345085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:00.345089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:00.345092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:00.345110Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:00.345122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:00.345130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:00.345203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.345210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.345212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.345216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:00.345218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:00.345291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:00.345300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.345314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.345325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.345346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:00.345372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990517939:2454], now have 1 active actors on pipe
2025-09-30T14:59:00.345381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990518055:8938], now have 1 active actors on pipe
2025-09-30T14:59:00.345388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896907900716196:6183]
2025-09-30T14:59:00.345391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896907900716196:6183]
2025-09-30T14:59:00.345393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896907900716196:6183]
2025-09-30T14:59:00.345476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3090
2025-09-30T14:59:00.345481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3090
2025-09-30T14:59:00.345407Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:00.345423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:00.345439Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:00.345442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:00.345479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896907900716196:6183]
2025-09-30T14:59:00.345482Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:00.345526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:00.345531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:00.345533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:00.345540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:00.345816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.345830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.345869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:00.345883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:00.345887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:00.345889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:00.345900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:00.345912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:00.345935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:00.346206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.346217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.346233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:00.346349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3091 partition: 0 MaxSeqNo: 42 sessionId: src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0
2025-09-30T14:59:00.346779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fc3251cb-d4df6a2a-bb87b778-92426e6e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:00.349854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0] Write session: try to update token
2025-09-30T14:59:00.349878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:00.365806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:00.365829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:00.365840Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896907900716196:6183]
2025-09-30T14:59:00.365894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:00.365906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:00.366089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:00.366265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:00.366434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:00.366609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:00.366835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:00.366897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:00.370120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3091 sessionId: src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:00.372409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:00.372437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:00.372440Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:00.372443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:00.372454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896907900716196:6183]
2025-09-30T14:59:00.372460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896907900716196:6183]
2025-09-30T14:59:00.372464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896907900716196:6183]
2025-09-30T14:59:00.372501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:00.372513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.372515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:00.372622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:00.372638Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:00.372643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:00.372680Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:00.373085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:00.408874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896907990518133:9657]
2025-09-30T14:59:00.415847Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3090, pipe: [1:7555896907990518133:9657]
2025-09-30T14:59:00.493305Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:00.493685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.493703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.493725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990518133:9657], now have 1 active actors on pipe
2025-09-30T14:59:00.494927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:00.494940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0] Write session will restart in 0.006796s
2025-09-30T14:59:00.494974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0] Write session: Do CDS request
2025-09-30T14:59:00.494979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:00.493997Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:00.493965Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:00.494008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896907990518133:9657]
2025-09-30T14:59:00.494053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:00.494056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:00.494128Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3091 reason: error at write: Disconnected sessionId: src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0
2025-09-30T14:59:00.494313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3091 sessionId: src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0 is DEAD
2025-09-30T14:59:00.502867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:00.502981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:00.503020Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3092
2025-09-30T14:59:00.503177Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3092 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:00.503228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3092 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:00.503256Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3092 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:00.503264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:00.503800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3092 sessionId:  describe result for acl check
2025-09-30T14:59:00.503844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:00.503853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:00.503854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:00.503860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896907990518143:8931] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:00.504386Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896907990518143:8931] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:00.509334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896907990518143:8931] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:00.517474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896907990518143:8931] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:00.517515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896907990518143:8931] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:00.517519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896907990518143:8931] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:00.517530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3092 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:00.530109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:00.533020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:00.533522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:00.533539Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:00.533554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:00.533641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:00.533704Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896907900716396:6176]
2025-09-30T14:59:00.534494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:00.534977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:00.535056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:00.535495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:00.535600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.535609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.535610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.535612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.535613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.535615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.535617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.535619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.535620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.535622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.535624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.535625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.535627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.535629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.535631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.535638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.535651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.535656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.535661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.535664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.535668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.535682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.535686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.535691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.535696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.535701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.535705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.535710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.535714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.535718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.535730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.535744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.535757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.535764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.535774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.535781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.535791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.535797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.535807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.535813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.535824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.535830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.535843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.535854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.535859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.535870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.535875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.535883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.535889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.535895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.535901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.535907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.535918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.535925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.535931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.535937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.535941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.535946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.535953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.535959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.536015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:00.543021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:00.544213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:00.544240Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:00.544243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:00.544248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:00.544428Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3091 [2:7555896907900716396:6176]
2025-09-30T14:59:00.544454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:00.544472Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:00.544482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:00.544485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:00.544489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:00.544508Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:00.544515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:00.544522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:00.544596Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.544605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.544607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.544610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:00.544613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:00.544700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:00.544709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.544724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.544738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.544756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:00.544776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990518230:8931], now have 1 active actors on pipe
2025-09-30T14:59:00.544784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896907900716391:6176]
2025-09-30T14:59:00.544787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896907900716391:6176]
2025-09-30T14:59:00.544789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896907900716391:6176]
2025-09-30T14:59:00.544799Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:00.544813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:00.544829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:00.544832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:00.544841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:00.544846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:00.544850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:00.544872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896907900716391:6176]
2025-09-30T14:59:00.544876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:00.544881Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:00.544898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990518136:2454], now have 1 active actors on pipe
2025-09-30T14:59:00.545093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3091
2025-09-30T14:59:00.545270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3091
2025-09-30T14:59:00.545929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.545945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.545974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b41e39e-dba0163d-86faa-e47f635a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:00.545982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:00.545986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:00.545989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:00.546000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:00.546012Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:00.546028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:00.546298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.546308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.546323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:00.546489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3092 partition: 0 MaxSeqNo: 42 sessionId: src_id|9b41e39e-dba0163d-86faa-e47f635a_0
2025-09-30T14:59:00.546968Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4836dce3-1ef14417-d0fb4aed-a70d4f83_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9b41e39e-dba0163d-86faa-e47f635a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:00.550035Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b41e39e-dba0163d-86faa-e47f635a_0] Write session: try to update token
2025-09-30T14:59:00.550063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b41e39e-dba0163d-86faa-e47f635a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:00.560666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:00.560694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:00.560697Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:00.560700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:00.560713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896907900716391:6176]
2025-09-30T14:59:00.560719Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896907900716391:6176]
2025-09-30T14:59:00.560724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896907900716391:6176]
2025-09-30T14:59:00.560777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:00.560786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.560790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:00.560930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:00.560955Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:00.560960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:00.560963Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:00.566800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3092 sessionId: src_id|9b41e39e-dba0163d-86faa-e47f635a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:00.570579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:00.592327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896907990518327:9657]
2025-09-30T14:59:00.592781Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3091, pipe: [1:7555896907990518327:9657]
2025-09-30T14:59:00.695440Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:00.695862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.695882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.695932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990518327:9657], now have 1 active actors on pipe
2025-09-30T14:59:00.696389Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:00.696356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:00.696433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:00.696437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:00.696540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3092 reason: error at write: Disconnected sessionId: src_id|9b41e39e-dba0163d-86faa-e47f635a_0
2025-09-30T14:59:00.696761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3092 sessionId: src_id|9b41e39e-dba0163d-86faa-e47f635a_0 is DEAD
2025-09-30T14:59:00.696989Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896907990518327:9657]
2025-09-30T14:59:00.699526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b41e39e-dba0163d-86faa-e47f635a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:00.699543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b41e39e-dba0163d-86faa-e47f635a_0] Write session will restart in 0.005489s
2025-09-30T14:59:00.699572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b41e39e-dba0163d-86faa-e47f635a_0] Write session: Do CDS request
2025-09-30T14:59:00.699598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b41e39e-dba0163d-86faa-e47f635a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:00.706809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b41e39e-dba0163d-86faa-e47f635a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:00.707137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:00.707164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3093
2025-09-30T14:59:00.707364Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3093 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:00.707405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3093 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:00.707411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3093 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:00.707416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:00.708891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3093 sessionId:  describe result for acl check
2025-09-30T14:59:00.708942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:00.708944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:00.708947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:00.708953Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896907990518351:8917] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:00.709611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896907990518351:8917] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:00.714113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896907990518351:8917] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:00.719728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896907990518351:8917] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:00.719753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896907990518351:8917] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:00.719758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896907990518351:8917] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:00.719768Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3093 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:00.738252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:00.744394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:00.744672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:00.744676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:00.744685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:00.744739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:00.744776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896907900716583:6171]
2025-09-30T14:59:00.745335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:00.745763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:00.745823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:00.746221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:00.746297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.746303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.746305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.746306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.746308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.746310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.746312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.746313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.746315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.746317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.746318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.746320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.746321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.746322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.746323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.746330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.746344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.746349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.746353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.746358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.746363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.746367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.746373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.746377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.746383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.746388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.746392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.746396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.746400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.746405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.746417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.746431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.746443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.746451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.746465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.746477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.746488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.746495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.746502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.746513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.746523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.746534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.746544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.746550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.746560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.746566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.746576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.746587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.746594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.746603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.746610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.746617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.746622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.746632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.746643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.746652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.746658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.746668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.746677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.746683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.746737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:00.763332Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3092
2025-09-30T14:59:00.763399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3092
2025-09-30T14:59:00.761548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:00.762841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:00.762848Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:00.762852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:00.762856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:00.762865Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3092 [2:7555896907900716583:6171]
2025-09-30T14:59:00.762884Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:00.762903Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:00.762908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:00.762911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:00.762914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:00.762932Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:00.762941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:00.762949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:00.763021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.763025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.763027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.763032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:00.763034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:00.763118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:00.763121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.763138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.763151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.763169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:00.763191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990518342:2454], now have 1 active actors on pipe
2025-09-30T14:59:00.763194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990518401:8917], now have 1 active actors on pipe
2025-09-30T14:59:00.763202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896907900716577:6171]
2025-09-30T14:59:00.763205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896907900716577:6171]
2025-09-30T14:59:00.763208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896907900716577:6171]
2025-09-30T14:59:00.763224Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:00.763239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:00.763239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:00.763263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:00.763266Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:00.763276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:00.763279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:00.763331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896907900716577:6171]
2025-09-30T14:59:00.763341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:00.763359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:00.763525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.763533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.763573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:00.763583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:00.763589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:00.763591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:00.763605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:00.763619Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:00.763638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:00.763987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3093 partition: 0 MaxSeqNo: 42 sessionId: src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0
2025-09-30T14:59:00.764417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b41e39e-dba0163d-86faa-e47f635a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:00.763840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.763859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.763877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:00.768830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0] Write session: try to update token
2025-09-30T14:59:00.768858Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:00.781538Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:00.781569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:00.781573Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:00.781576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:00.781590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896907900716577:6171]
2025-09-30T14:59:00.781595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896907900716577:6171]
2025-09-30T14:59:00.781601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896907900716577:6171]
2025-09-30T14:59:00.781656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:00.781673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.781681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:00.781857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:00.783894Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:00.783917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:00.783922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:00.797142Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896907990518534:9657]
2025-09-30T14:59:00.797470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3093 sessionId: src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:00.798497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3092, pipe: [1:7555896907990518534:9657]
2025-09-30T14:59:00.800430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:00.907936Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:00.908406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990518534:9657], now have 1 active actors on pipe
2025-09-30T14:59:00.908441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.908454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.908886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:00.908953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896907990518534:9657]
2025-09-30T14:59:00.908983Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:00.908986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:00.909050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3093 reason: error at write: Disconnected sessionId: src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0
2025-09-30T14:59:00.909417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:00.909437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0] Write session will restart in 0.009406s
2025-09-30T14:59:00.909420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3093 sessionId: src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0 is DEAD
2025-09-30T14:59:00.909464Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0] Write session: Do CDS request
2025-09-30T14:59:00.909471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:00.913127Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:00.919744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:00.919985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:00.920005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3094
2025-09-30T14:59:00.923492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3094 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:00.923549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3094 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:00.923556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3094 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:00.923561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:00.927697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3094 sessionId:  describe result for acl check
2025-09-30T14:59:00.927746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:00.927748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:00.927751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:00.927758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896907990518623:8911] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:00.928334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896907990518623:8911] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:00.936024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896907990518623:8911] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:00.939679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:00.940457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896907990518623:8911] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:00.940481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896907990518623:8911] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:00.940485Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896907990518623:8911] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:00.940495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3094 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:00.942877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:00.943130Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:00.943134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:00.943145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:00.943198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:00.943238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896907900716768:6162]
2025-09-30T14:59:00.943954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:00.944405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:00.944456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:00.944839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:00.944903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.944909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.944910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.944912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.944913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.944915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.944916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.944917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.944918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.944919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.944921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.944922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.944923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.944924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.944926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.944932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.944942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.944946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.944950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.944955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.944958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.944962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.944966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.944970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.944974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.944978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.944981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.944985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.944988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.944992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.945000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.945009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:00.945015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.945021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:00.945026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.945030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:00.945035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.945041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:00.945046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.945051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:00.945055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.945059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:00.945064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.945069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:00.945075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.945080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:00.945084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.945088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:00.945093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.945097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:00.945104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.945109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.945113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.945118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.945122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.945142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.945153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.945158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:00.945163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.945167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:00.945206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:00.953319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:00.954534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:00.954555Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:00.954557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:00.954562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:00.954569Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3093 [2:7555896907900716768:6162]
2025-09-30T14:59:00.954587Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:00.954604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:00.954607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:00.954611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:00.954613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:00.954632Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:00.954639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:00.954647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:00.954711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.954721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.954723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.954727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:00.954729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:00.954803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:00.954813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.954827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:00.954838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:00.954854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:00.954873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990518539:2454], now have 1 active actors on pipe
2025-09-30T14:59:00.954886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896907900716762:6162]
2025-09-30T14:59:00.954889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896907900716762:6162]
2025-09-30T14:59:00.954891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896907900716762:6162]
2025-09-30T14:59:00.954904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:00.954918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896907990518720:8911], now have 1 active actors on pipe
2025-09-30T14:59:00.954919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:00.954921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:00.954923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:00.954933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:00.954947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:00.954951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:00.954994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3093
2025-09-30T14:59:00.954998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3093
2025-09-30T14:59:00.955000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896907900716762:6162]
2025-09-30T14:59:00.955015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:00.955040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:00.955057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.955066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.955095Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa507151-e7675712-856963e2-b297abcd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:00.955107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:00.955111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:00.955116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:00.955126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:00.955140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:00.955163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:00.955380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:00.955391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:00.955406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:00.955519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3094 partition: 0 MaxSeqNo: 42 sessionId: src_id|aa507151-e7675712-856963e2-b297abcd_0
2025-09-30T14:59:00.959580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d35f19c5-99a24db2-daf9ec09-48de5d3c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aa507151-e7675712-856963e2-b297abcd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:00.962782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa507151-e7675712-856963e2-b297abcd_0] Write session: try to update token
2025-09-30T14:59:00.962808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa507151-e7675712-856963e2-b297abcd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:00.973476Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:00.973493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:00.973496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:00.973499Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:00.973510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896907900716762:6162]
2025-09-30T14:59:00.973516Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896907900716762:6162]
2025-09-30T14:59:00.973521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896907900716762:6162]
2025-09-30T14:59:00.973579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:00.973587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:00.973590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:00.973758Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:00.975743Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:00.975760Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:00.975765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:00.981960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3094 sessionId: src_id|aa507151-e7675712-856963e2-b297abcd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:00.985035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:01.009110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896912285486031:9657]
2025-09-30T14:59:01.009410Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3093, pipe: [1:7555896912285486031:9657]
2025-09-30T14:59:01.099042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896912285486031:9657]
2025-09-30T14:59:01.099048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:01.099087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:01.099090Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:01.099166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3094 reason: error at write: Disconnected sessionId: src_id|aa507151-e7675712-856963e2-b297abcd_0
2025-09-30T14:59:01.098111Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:01.098744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.098755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.098776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486031:9657], now have 1 active actors on pipe
2025-09-30T14:59:01.099081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:01.099351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3094 sessionId: src_id|aa507151-e7675712-856963e2-b297abcd_0 is DEAD
2025-09-30T14:59:01.099525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa507151-e7675712-856963e2-b297abcd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:01.099537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa507151-e7675712-856963e2-b297abcd_0] Write session will restart in 0.008829s
2025-09-30T14:59:01.099562Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa507151-e7675712-856963e2-b297abcd_0] Write session: Do CDS request
2025-09-30T14:59:01.099570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa507151-e7675712-856963e2-b297abcd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:01.109802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa507151-e7675712-856963e2-b297abcd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:01.109922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:01.109954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3095
2025-09-30T14:59:01.110103Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3095 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:01.110148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3095 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:01.110155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3095 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:01.110160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:01.110699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3095 sessionId:  describe result for acl check
2025-09-30T14:59:01.110744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:01.110752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:01.110754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:01.110761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896912285486110:8901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:01.111351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896912285486110:8901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:01.113538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896912285486110:8901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:01.115201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:01.117808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:01.118017Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:01.118027Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:01.118037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:01.118089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:01.118128Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896912195684250:6159]
2025-09-30T14:59:01.118847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:01.118301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896912285486110:8901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:01.118320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896912285486110:8901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:01.118323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896912285486110:8901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:01.118329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3095 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:01.119208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:01.119269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:01.119633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:01.119706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.119713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.119715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.119716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.119718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.119719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.119721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.119722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.119723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.119724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.119726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.119727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.119728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.119729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.119731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.119737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.119748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.119752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.119756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.119759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.119763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.119767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.119772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.119775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.119780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.119784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.119788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.119792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.119796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.119801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.119809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.119818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.119824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.119830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.119835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.119841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.119845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.119851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.119859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.119865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.119870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.119876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.119881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.119886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.119891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.119896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.119901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.119906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.119910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.119916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.119920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.119926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.119930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.119941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.119946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.119952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.119957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.119967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.119972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.119977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.120027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:01.125844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:01.127223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:01.127241Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:01.127362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:01.127376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:01.127383Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3094 [2:7555896912195684250:6159]
2025-09-30T14:59:01.127405Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:01.127425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:01.127428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:01.127431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:01.127433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:01.127451Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:01.127458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:01.127466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:01.127535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.127542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.127546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.127550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:01.127553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:01.127635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:01.127644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.127657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.127668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.127684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:01.127701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896912195684245:6159]
2025-09-30T14:59:01.127704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896912195684245:6159]
2025-09-30T14:59:01.127707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896912195684245:6159]
2025-09-30T14:59:01.127718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:01.127729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:01.127733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:01.127734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:01.127737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:01.127750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:01.127754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:01.127764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486035:2454], now have 1 active actors on pipe
2025-09-30T14:59:01.127772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486217:8901], now have 1 active actors on pipe
2025-09-30T14:59:01.127810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896912195684245:6159]
2025-09-30T14:59:01.127821Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:01.127839Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3094
2025-09-30T14:59:01.127839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3094
2025-09-30T14:59:01.127959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.127969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.127994Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:01.128002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:01.128010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:01.128012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:01.128019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:01.128023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:01.128033Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:01.128047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:01.128244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.128257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.128278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:01.128399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3095 partition: 0 MaxSeqNo: 42 sessionId: src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0
2025-09-30T14:59:01.128787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa507151-e7675712-856963e2-b297abcd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:01.132034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0] Write session: try to update token
2025-09-30T14:59:01.132058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:01.141041Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:01.141059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:01.141062Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:01.141064Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:01.141074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896912195684245:6159]
2025-09-30T14:59:01.141083Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896912195684245:6159]
2025-09-30T14:59:01.141087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896912195684245:6159]
2025-09-30T14:59:01.141133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:01.141139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.141141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:01.141141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:01.141149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:01.141154Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:01.141291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:01.149663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3095 sessionId: src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:01.153057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:01.199070Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896912285486230:9657]
2025-09-30T14:59:01.199454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3094, pipe: [1:7555896912285486230:9657]
2025-09-30T14:59:01.258393Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:01.258930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.258951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.258985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486230:9657], now have 1 active actors on pipe
2025-09-30T14:59:01.259277Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:01.259295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896912285486230:9657]
2025-09-30T14:59:01.259336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:01.259339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:01.259405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3095 reason: error at write: Disconnected sessionId: src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0
2025-09-30T14:59:01.259420Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:01.259601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3095 sessionId: src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0 is DEAD
2025-09-30T14:59:01.263528Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:01.263540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0] Write session will restart in 0.006467s
2025-09-30T14:59:01.263564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0] Write session: Do CDS request
2025-09-30T14:59:01.263574Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:01.270776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:01.270876Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:01.270895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3096
2025-09-30T14:59:01.271091Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3096 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:01.271116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3096 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:01.271123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3096 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:01.271127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:01.271510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3096 sessionId:  describe result for acl check
2025-09-30T14:59:01.271541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:01.271546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:01.271549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:01.271554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896912285486248:8902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:01.272040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896912285486248:8902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:01.274727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896912285486248:8902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:01.280906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896912285486248:8902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:01.280928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896912285486248:8902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:01.280932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896912285486248:8902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:01.280941Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3096 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:01.289270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:01.292117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:01.292333Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:01.292343Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:01.292353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:01.292415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:01.292463Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896912195684441:6147]
2025-09-30T14:59:01.293045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:01.293418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:01.293492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:01.293883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:01.294039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.294046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.294048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.294049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.294050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.294052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.294054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.294055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.294057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.294058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.294060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.294062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.294063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.294064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.294065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.294072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.294084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.294088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.294093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.294097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.294101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.294106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.294110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.294114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.294119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.294123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.294127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.294132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.294136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.294141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.294151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.294160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.294166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.294172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.294177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.294183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.294188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.294194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.294200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.294205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.294210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.294215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.294221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.294227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.294231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.294237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.294242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.294249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.294261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.294267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.294272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.294277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.294281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.294287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.294292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.294297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.294301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.294306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.294311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.294317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.294365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:01.300215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:01.301452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:01.301463Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:01.301465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:01.301468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:01.301473Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3095 [2:7555896912195684441:6147]
2025-09-30T14:59:01.301486Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:01.301498Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:01.301501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:01.301504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:01.301505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:01.301519Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:01.301524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:01.301530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:01.301580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.301588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.301590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.301592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:01.301594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:01.301667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:01.301675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.301688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.301703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.301721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:01.301740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486346:8902], now have 1 active actors on pipe
2025-09-30T14:59:01.301747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486232:2454], now have 1 active actors on pipe
2025-09-30T14:59:01.301752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896912195684436:6147]
2025-09-30T14:59:01.301754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896912195684436:6147]
2025-09-30T14:59:01.301756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896912195684436:6147]
2025-09-30T14:59:01.301763Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:01.301776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:01.301776Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:01.301780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:01.301782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:01.301786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:01.301788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:01.301817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896912195684436:6147]
2025-09-30T14:59:01.301825Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:01.301834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:01.301848Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3095
2025-09-30T14:59:01.301895Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3095
2025-09-30T14:59:01.301989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.302004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.302038Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:01.302054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:01.302059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:01.302061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:01.302084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:01.302095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:01.302115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:01.302292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.302300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.302318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:01.302430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3096 partition: 0 MaxSeqNo: 42 sessionId: src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0
2025-09-30T14:59:01.302770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a128f2c-6d81cc66-c731fcb4-748a0cea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:01.305982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0] Write session: try to update token
2025-09-30T14:59:01.306000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:01.317170Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:01.317192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:01.317195Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:01.317197Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:01.317212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896912195684436:6147]
2025-09-30T14:59:01.317217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896912195684436:6147]
2025-09-30T14:59:01.317221Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896912195684436:6147]
2025-09-30T14:59:01.317269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:01.317278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.317281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:01.317294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:01.317302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:01.317306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:01.317453Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:01.329566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3096 sessionId: src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:01.332693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:01.363569Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896912285486452:9657]
2025-09-30T14:59:01.364039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3095, pipe: [1:7555896912285486452:9657]
2025-09-30T14:59:01.459771Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:01.460404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.460421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.460444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486452:9657], now have 1 active actors on pipe
2025-09-30T14:59:01.460740Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:01.460752Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:01.460774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:01.460846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3096 reason: error at write: Disconnected sessionId: src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0
2025-09-30T14:59:01.461078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3096 sessionId: src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0 is DEAD
2025-09-30T14:59:01.461269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:01.461281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0] Write session will restart in 0.008732s
2025-09-30T14:59:01.461295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896912285486452:9657]
2025-09-30T14:59:01.461317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0] Write session: Do CDS request
2025-09-30T14:59:01.461323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:01.461325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:01.471816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:01.471937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:01.471958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3097
2025-09-30T14:59:01.472118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3097 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:01.472162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3097 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:01.472173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3097 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:01.472178Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:01.472775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3097 sessionId:  describe result for acl check
2025-09-30T14:59:01.472816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:01.472825Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:01.472828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:01.472834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896912285486563:10587] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:01.473430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896912285486563:10587] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:01.475610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896912285486563:10587] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:01.476443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:01.478988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:01.479239Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:01.479265Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:01.479278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:01.479342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:01.479399Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896912195684675:6116]
2025-09-30T14:59:01.479464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896912285486563:10587] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:01.479483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896912285486563:10587] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:01.479490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896912285486563:10587] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:01.479500Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3097 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:01.480015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:01.480359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:01.480413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:01.480729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:01.480799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.480804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.480805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.480806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.480807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.480808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.480809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.480809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.480810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.480811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.480812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.480813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.480814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.480815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.480816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.480821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.480829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.480832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.480834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.480837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.480840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.480843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.480845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.480847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.480850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.480852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.480854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.480857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.480859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.480862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.480869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.480875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.480880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.480884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.480887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.480890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.480893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.480897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.480900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.480904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.480907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.480910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.480914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.480917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.480920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.480923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.480925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.480928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.480931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.480934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.480937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.480950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.480957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.480960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.480963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.480967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.480974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.480977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.480980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.480983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.481013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:01.486982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:01.488114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:01.488132Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:01.488135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:01.488139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:01.488146Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3096 [2:7555896912195684675:6116]
2025-09-30T14:59:01.488165Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:01.488185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:01.488189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:01.488192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:01.488196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:01.488214Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:01.488235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:01.488242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:01.488313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.488320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.488323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.488326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:01.488329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:01.488400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:01.488407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.488421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.488435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.488454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:01.488471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896912195684670:6116]
2025-09-30T14:59:01.488478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896912195684670:6116]
2025-09-30T14:59:01.488481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896912195684670:6116]
2025-09-30T14:59:01.488492Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:01.488502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:01.488508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:01.488513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:01.488515Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:01.488524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:01.488527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:01.488539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486462:2454], now have 1 active actors on pipe
2025-09-30T14:59:01.488547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486645:10587], now have 1 active actors on pipe
2025-09-30T14:59:01.488584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896912195684670:6116]
2025-09-30T14:59:01.488598Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:01.488623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:01.488609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3096
2025-09-30T14:59:01.488617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3096
2025-09-30T14:59:01.488736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.488746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.488773Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:01.488785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:01.488788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:01.488790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:01.488800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:01.488815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:01.488835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:01.489037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.489045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.489059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:01.489140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3097 partition: 0 MaxSeqNo: 42 sessionId: src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0
2025-09-30T14:59:01.489572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bd3dcc12-c347461a-8d2ef11c-de9044b6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:01.492669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0] Write session: try to update token
2025-09-30T14:59:01.492694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:01.506758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:01.506781Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:01.506783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:01.506786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:01.506796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896912195684670:6116]
2025-09-30T14:59:01.506801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896912195684670:6116]
2025-09-30T14:59:01.506806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896912195684670:6116]
2025-09-30T14:59:01.506850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:01.506856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:01.506858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.506861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:01.506863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:01.506868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:01.507003Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:01.512111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3097 sessionId: src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:01.515233Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:01.561567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896912285486658:9657]
2025-09-30T14:59:01.561905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3096, pipe: [1:7555896912285486658:9657]
2025-09-30T14:59:01.639987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:01.640626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.640652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.640710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486658:9657], now have 1 active actors on pipe
2025-09-30T14:59:01.641000Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:01.641491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:01.641500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:01.641560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896912285486658:9657]
2025-09-30T14:59:01.641586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3097 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0
2025-09-30T14:59:01.641799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3097 sessionId: src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0 is DEAD
2025-09-30T14:59:01.643350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:01.643367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0] Write session will restart in 0.007350s
2025-09-30T14:59:01.643393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0] Write session: Do CDS request
2025-09-30T14:59:01.643399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:01.651806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:01.655639Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:01.655665Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3098
2025-09-30T14:59:01.659425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3098 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:01.659640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3098 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:01.659654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3098 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:01.659659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:01.660207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3098 sessionId:  describe result for acl check
2025-09-30T14:59:01.660250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:01.660257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:01.660259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:01.660265Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896912285486783:10579] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:01.660834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896912285486783:10579] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:01.664279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:01.665411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896912285486783:10579] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:01.667026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:01.667351Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:01.667363Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:01.667376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:01.667460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:01.667508Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896912195684866:6107]
2025-09-30T14:59:01.668103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:01.668566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:01.668360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896912285486783:10579] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:01.668385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896912285486783:10579] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:01.668389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896912285486783:10579] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:01.668398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3098 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:01.668639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:01.669049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:01.669135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.669147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.669149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.669151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.669152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.669154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.669155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.669157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.669158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.669160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.669161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.669162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.669164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.669166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.669167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.669174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.669186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.669191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.669195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.669199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.669204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.669209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.669214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.669218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.669223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.669228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.669232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.669237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.669241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.669245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.669254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.669263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.669270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.669276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.669281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.669287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.669293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.669299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.669305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.669311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.669316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.669321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.669327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.669333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.669338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.669343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.669349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.669355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.669360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.669367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.669378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.669384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.669389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.669395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.669400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.669413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.669418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.669431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.669436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.669441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.669496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:01.675503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:01.676801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:01.676820Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:01.676822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:01.676826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:01.676833Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3097 [2:7555896912195684866:6107]
2025-09-30T14:59:01.676852Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:01.676867Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:01.676871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:01.676874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:01.676876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:01.676894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:01.676902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:01.676908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:01.676970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.676972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.676974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.676977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:01.676980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:01.677055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:01.677058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.677071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.677080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.677094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:01.677110Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896912195684861:6107]
2025-09-30T14:59:01.677113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896912195684861:6107]
2025-09-30T14:59:01.677115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896912195684861:6107]
2025-09-30T14:59:01.677124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:01.677134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:01.677138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:01.677141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486848:10579], now have 1 active actors on pipe
2025-09-30T14:59:01.677141Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:01.677144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486660:2454], now have 1 active actors on pipe
2025-09-30T14:59:01.677148Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:01.677160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:01.677163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:01.677197Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896912195684861:6107]
2025-09-30T14:59:01.677206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:01.677219Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:01.677802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3097
2025-09-30T14:59:01.677837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3097
2025-09-30T14:59:01.678013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.678026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.678054Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:01.678063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:01.678067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:01.678070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:01.678081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:01.678093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:01.678117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:01.678798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.678810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.678830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:01.678945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3098 partition: 0 MaxSeqNo: 42 sessionId: src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0
2025-09-30T14:59:01.679417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c19e17f-c1bea1e3-6d462d1b-e2990864_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:01.682614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0] Write session: try to update token
2025-09-30T14:59:01.682642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:01.690234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:01.690256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:01.690268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896912195684861:6107]
2025-09-30T14:59:01.690315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:01.690320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:01.690517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:01.690682Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:01.690825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:01.690956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:01.691133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:01.691182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:01.701519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:01.701537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:01.701540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:01.701541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:01.701553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896912195684861:6107]
2025-09-30T14:59:01.701557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896912195684861:6107]
2025-09-30T14:59:01.701562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896912195684861:6107]
2025-09-30T14:59:01.701606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:01.701613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.701615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:01.701619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:01.701627Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:01.701632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:01.701785Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:01.706627Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3098 sessionId: src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:01.709883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:01.741787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896912285486869:9657]
2025-09-30T14:59:01.742091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3097, pipe: [1:7555896912285486869:9657]
2025-09-30T14:59:01.810974Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:01.811463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.811479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.811501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486869:9657], now have 1 active actors on pipe
2025-09-30T14:59:01.811775Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:01.811797Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:01.811825Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:01.811830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:01.811889Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896912285486869:9657]
2025-09-30T14:59:01.811891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3098 reason: error at write: Disconnected sessionId: src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0
2025-09-30T14:59:01.812119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3098 sessionId: src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0 is DEAD
2025-09-30T14:59:01.815439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:01.815456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0] Write session will restart in 0.008117s
2025-09-30T14:59:01.815503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0] Write session: Do CDS request
2025-09-30T14:59:01.815514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:01.824876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:01.825136Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:01.825159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3099
2025-09-30T14:59:01.825319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3099 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:01.825358Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3099 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:01.825364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3099 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:01.825370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:01.825969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3099 sessionId:  describe result for acl check
2025-09-30T14:59:01.826007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:01.826010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:01.826012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:01.826018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896912285486900:10577] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:01.826856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896912285486900:10577] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:01.830490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896912285486900:10577] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:01.833522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896912285486900:10577] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:01.833547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896912285486900:10577] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:01.833551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896912285486900:10577] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:01.833570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3099 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:01.838591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:01.841602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:01.841831Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:01.841852Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:01.841863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:01.841915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:01.841977Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896912195685056:6102]
2025-09-30T14:59:01.842584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:01.842983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:01.843048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:01.843450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:01.843524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.843530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.843531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.843533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.843534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.843535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.843537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.843538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.843540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.843541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.843542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.843544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.843545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.843547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.843548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.843554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.843565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.843569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.843574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.843578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.843583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.843587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.843592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.843596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.843601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.843605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.843609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.843614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.843618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.843623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.843633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.843641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:01.843648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.843666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:01.843671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.843677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:01.843681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.843686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:01.843692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.843698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:01.843703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.843709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:01.843714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.843721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:01.843727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.843733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:01.843739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.843745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:01.843751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.843757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:01.843763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.843769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.843779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.843784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.843789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.843800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.843805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.843811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:01.843818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.843829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:01.843878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:01.849660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:01.850562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:01.850577Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:01.850581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:01.850585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:01.850592Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3098 [2:7555896912195685056:6102]
2025-09-30T14:59:01.850609Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:01.850625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:01.850628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:01.850631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:01.850633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:01.850649Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:01.850656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:01.850663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:01.850725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.850734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.850736Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.850740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:01.850743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:01.850824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:01.850833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.850845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:01.850856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:01.850872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:01.850890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285487035:10577], now have 1 active actors on pipe
2025-09-30T14:59:01.850898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285486872:2454], now have 1 active actors on pipe
2025-09-30T14:59:01.850905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896912195685051:6102]
2025-09-30T14:59:01.850907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896912195685051:6102]
2025-09-30T14:59:01.850909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896912195685051:6102]
2025-09-30T14:59:01.850922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:01.850939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:01.850947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:01.850950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:01.850953Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:01.850957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:01.850961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:01.850995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896912195685051:6102]
2025-09-30T14:59:01.851002Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:01.850967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3098
2025-09-30T14:59:01.850990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3098
2025-09-30T14:59:01.851011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:01.851041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.851052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.851080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49359f5f-4ff6889d-24e46649-89c10013_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:01.851092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:01.851096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:01.851099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:01.851109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:01.851121Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:01.851140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:01.851392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.851407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.851436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:01.851535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3099 partition: 0 MaxSeqNo: 42 sessionId: src_id|49359f5f-4ff6889d-24e46649-89c10013_0
2025-09-30T14:59:01.851929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f34130eb-9401a120-30d3f4ef-aff7ead3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|49359f5f-4ff6889d-24e46649-89c10013_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:01.854843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49359f5f-4ff6889d-24e46649-89c10013_0] Write session: try to update token
2025-09-30T14:59:01.854865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49359f5f-4ff6889d-24e46649-89c10013_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:01.863754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:01.863776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:01.863779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:01.863782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:01.863791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896912195685051:6102]
2025-09-30T14:59:01.863796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896912195685051:6102]
2025-09-30T14:59:01.863800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896912195685051:6102]
2025-09-30T14:59:01.863848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:01.863856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:01.863860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:01.863867Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:01.863875Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:01.863880Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:01.864022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:01.873689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3099 sessionId: src_id|49359f5f-4ff6889d-24e46649-89c10013_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:01.876789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:01.912280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896912285487074:9657]
2025-09-30T14:59:01.913401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3098, pipe: [1:7555896912285487074:9657]
2025-09-30T14:59:01.977065Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:01.977793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:01.977803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:01.977823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285487074:9657], now have 1 active actors on pipe
2025-09-30T14:59:01.978045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:01.978610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896912285487074:9657]
2025-09-30T14:59:01.978658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:01.978742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3099 reason: status is not ok: tablet will be restarted right now sessionId: src_id|49359f5f-4ff6889d-24e46649-89c10013_0
2025-09-30T14:59:01.978762Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:01.978921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3099 sessionId: src_id|49359f5f-4ff6889d-24e46649-89c10013_0 is DEAD
2025-09-30T14:59:01.983389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49359f5f-4ff6889d-24e46649-89c10013_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:01.983408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49359f5f-4ff6889d-24e46649-89c10013_0] Write session will restart in 0.009207s
2025-09-30T14:59:01.983444Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49359f5f-4ff6889d-24e46649-89c10013_0] Write session: Do CDS request
2025-09-30T14:59:01.983450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49359f5f-4ff6889d-24e46649-89c10013_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:01.993851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49359f5f-4ff6889d-24e46649-89c10013_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:01.993934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:01.993963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3100
2025-09-30T14:59:01.999516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3100 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:01.999581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3100 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:01.999586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3100 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:01.999591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:02.000346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3100 sessionId:  describe result for acl check
2025-09-30T14:59:02.000389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:02.000398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:02.000400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:02.000407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896916580454501:10572] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:02.000975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896916580454501:10572] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:02.002741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:02.003221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896916580454501:10572] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:02.005332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:02.005567Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:02.005577Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:02.005588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:02.005646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:02.005687Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896916490652541:6093]
2025-09-30T14:59:02.006209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896916580454501:10572] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:02.006227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896916580454501:10572] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:02.006231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896916580454501:10572] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:02.006240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3100 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:02.006349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:02.006661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:02.006716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:02.007032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:02.007118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.007124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.007126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.007127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.007129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.007130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.007132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.007133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.007134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.007135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.007136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.007137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.007138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.007139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.007140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.007146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.007156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.007159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.007163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.007166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.007170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.007173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.007177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.007180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.007183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.007187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.007190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.007194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.007197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.007201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.007208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.007215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.007221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.007226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.007231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.007235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.007239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.007262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.007267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.007271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.007278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.007283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.007288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.007293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.007297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.007301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.007305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.007310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.007314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.007319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.007324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.007328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.007337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.007342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.007346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.007350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.007354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.007358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.007362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.007366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.007409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:02.014677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3099
2025-09-30T14:59:02.014698Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3099
2025-09-30T14:59:02.013169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:02.014141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:02.014149Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:02.014152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:02.014156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:02.014165Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3099 [2:7555896916490652541:6093]
2025-09-30T14:59:02.014184Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:02.014204Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:02.014208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.014211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.014213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.014231Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:02.014238Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:02.014246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:02.014313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.014316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.014318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.014322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:02.014325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:02.014406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:02.014408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.014420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.014430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.014445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:02.014461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896916490652536:6093]
2025-09-30T14:59:02.014464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896916490652536:6093]
2025-09-30T14:59:02.014467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896916490652536:6093]
2025-09-30T14:59:02.014476Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:02.014491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:02.014496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:02.014501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:02.014503Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:02.014506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:02.014509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:02.014521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580454560:10572], now have 1 active actors on pipe
2025-09-30T14:59:02.014525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896912285487075:2454], now have 1 active actors on pipe
2025-09-30T14:59:02.014559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896916490652536:6093]
2025-09-30T14:59:02.014570Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:02.014587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:02.014947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.014956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.014986Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:02.014993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.015000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.015002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:02.015017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.015027Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:02.015047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:02.015764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.015779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.015802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:02.015939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3100 partition: 0 MaxSeqNo: 42 sessionId: src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0
2025-09-30T14:59:02.016376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49359f5f-4ff6889d-24e46649-89c10013_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:02.019482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0] Write session: try to update token
2025-09-30T14:59:02.019509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:02.028942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:02.028964Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:02.028967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:02.028969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:02.028980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896916490652536:6093]
2025-09-30T14:59:02.028986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896916490652536:6093]
2025-09-30T14:59:02.028991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896916490652536:6093]
2025-09-30T14:59:02.029040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:02.029048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.029051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:02.029057Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:02.029066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:02.029079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:02.029210Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:02.047926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3100 sessionId: src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:02.050818Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:02.078678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896916580454572:9657]
2025-09-30T14:59:02.079125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3099, pipe: [1:7555896916580454572:9657]
2025-09-30T14:59:02.149800Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:02.150136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.150166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.150187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580454572:9657], now have 1 active actors on pipe
2025-09-30T14:59:02.150458Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896916580454572:9657]
2025-09-30T14:59:02.150460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:02.150463Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:02.150488Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:02.150550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3100 reason: error at write: Disconnected sessionId: src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0
2025-09-30T14:59:02.150733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3100 sessionId: src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0 is DEAD
2025-09-30T14:59:02.150870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:02.150881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0] Write session will restart in 0.005754s
2025-09-30T14:59:02.150904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0] Write session: Do CDS request
2025-09-30T14:59:02.150910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:02.150981Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:02.157830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:02.157972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:02.157992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3101
2025-09-30T14:59:02.158129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3101 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:02.158163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3101 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:02.158173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3101 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:02.158177Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:02.158963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3101 sessionId:  describe result for acl check
2025-09-30T14:59:02.159012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:02.159020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:02.159022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:02.159029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896916580454599:10563] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:02.159633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896916580454599:10563] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:02.163751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896916580454599:10563] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:02.166573Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896916580454599:10563] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:02.166591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896916580454599:10563] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:02.166595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896916580454599:10563] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:02.166604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3101 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:02.166733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:02.171199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:02.171454Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:02.171464Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:02.171475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:02.171529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:02.171579Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896916490652735:6087]
2025-09-30T14:59:02.172284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:02.172724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:02.172773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:02.173131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:02.173189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.173194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.173195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.173196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.173197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.173198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.173200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.173201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.173203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.173205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.173206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.173208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.173209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.173210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.173212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.173217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.173228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.173231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.173234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.173237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.173239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.173242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.173244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.173247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.173251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.173255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.173259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.173263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.173267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.173272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.173280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.173287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.173293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.173299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.173304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.173309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.173313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.173318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.173323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.173329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.173333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.173339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.173344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.173349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.173354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.173362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.173369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.173375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.173379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.173383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.173386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.173390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.173393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.173395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.173398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.173401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.173404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.173407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.173409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.173412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.173451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:02.180077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:02.181493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:02.181519Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:02.181523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:02.181527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:02.181537Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3100 [2:7555896916490652735:6087]
2025-09-30T14:59:02.181559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:02.181577Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:02.181582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.181585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.181588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.181610Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:02.181618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:02.181627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:02.181712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.181728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.181732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.181737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:02.181741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:02.181829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:02.181841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.181859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.181871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.181889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:02.181913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580454574:2454], now have 1 active actors on pipe
2025-09-30T14:59:02.181923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580454762:10563], now have 1 active actors on pipe
2025-09-30T14:59:02.181931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896916490652729:6087]
2025-09-30T14:59:02.181940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896916490652729:6087]
2025-09-30T14:59:02.181943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896916490652729:6087]
2025-09-30T14:59:02.181957Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:02.181975Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:02.181978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:02.181984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:02.181986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:02.181995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:02.181999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:02.182024Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3100
2025-09-30T14:59:02.182037Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3100
2025-09-30T14:59:02.182048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896916490652729:6087]
2025-09-30T14:59:02.182517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3101 partition: 0 MaxSeqNo: 42 sessionId: src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0
2025-09-30T14:59:02.182076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:02.182096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:02.182127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.182133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.182163Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:02.182171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.182175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.182178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:02.182189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.182201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:02.182216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:02.182394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.182410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.182431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:02.182916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b588a694-3aceef26-6e58ab3b-d96a0639_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:02.186048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0] Write session: try to update token
2025-09-30T14:59:02.186069Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:02.195023Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:02.195042Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:02.195045Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:02.195047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:02.195057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896916490652729:6087]
2025-09-30T14:59:02.195062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896916490652729:6087]
2025-09-30T14:59:02.195066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896916490652729:6087]
2025-09-30T14:59:02.195105Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:02.195108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:02.195111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:02.195115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.195116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:02.195117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:02.195304Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:02.201908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3101 sessionId: src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:02.204900Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:02.250707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896916580454774:9657]
2025-09-30T14:59:02.251057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3100, pipe: [1:7555896916580454774:9657]
2025-09-30T14:59:02.255833Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:59:02.318054Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:02.318414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.318434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.318455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580454774:9657], now have 1 active actors on pipe
2025-09-30T14:59:02.318709Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:02.318748Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896916580454774:9657]
2025-09-30T14:59:02.318766Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:59:02.318779Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:02.318782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:02.318916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3101 reason: error at write: Disconnected sessionId: src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0
2025-09-30T14:59:02.318960Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3101 sessionId: src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0 is DEAD
2025-09-30T14:59:02.319061Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 31 consumer shared/user session shared/user_1_31_7051171975186204941_v1 is DEAD
2025-09-30T14:59:02.319188Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:59:02.319306Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896839271027405:9660] disconnected; active server actors: 1
2025-09-30T14:59:02.319316Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896839271027405:9660] client user disconnected session shared/user_1_31_7051171975186204941_v1
2025-09-30T14:59:02.319341Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:59:02.319348Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:59:02.319359Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.009321s
2025-09-30T14:59:02.319002Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:02.323512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:02.323526Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0] Write session will restart in 0.008719s
2025-09-30T14:59:02.323551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0] Write session: Do CDS request
2025-09-30T14:59:02.323557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:02.329726Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:59:02.330091Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:59:02.330108Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 32
2025-09-30T14:59:02.330275Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 32 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:59:02.330343Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:59:02.330432Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 auth for : user
2025-09-30T14:59:02.330633Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 Handle describe topics response
2025-09-30T14:59:02.330667Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 auth is DEAD
2025-09-30T14:59:02.330673Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:59:02.330939Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:59:02.331096Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_32_8809750126570015226_v1
2025-09-30T14:59:02.331161Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896916580454858:10555] connected; active server actors: 1
2025-09-30T14:59:02.331178Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896916580454858:10555] session shared/user_1_32_8809750126570015226_v1
2025-09-30T14:59:02.331188Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:59:02.331200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:59:02.331211Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_32_8809750126570015226_v1" (Sender=[1:7555896916580454842:10555], Pipe=[1:7555896916580454858:10555], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:59:02.331215Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:59:02.331226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:59:02.331239Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_32_8809750126570015226_v1" (Sender=[1:7555896916580454842:10555], Pipe=[1:7555896916580454858:10555], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:59:02.331268Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_32_8809750126570015226_v1" sender [1:7555896916580454842:10555] lock partition 0 for ReadingSession "shared/user_1_32_8809750126570015226_v1" (Sender=[1:7555896916580454842:10555], Pipe=[1:7555896916580454858:10555], Partitions=[], ActiveFamilyCount=1) generation 1 step 32
2025-09-30T14:59:02.331282Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:59:02.331287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000054s
2025-09-30T14:59:02.331544Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 32 Session: "shared/user_1_32_8809750126570015226_v1" ClientId: "user" PipeClient { RawX1: 7555896916580454858 RawX2: 4503603922348347 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:59:02.331578Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:59:02.333797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:02.333849Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:02.333864Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3102
2025-09-30T14:59:02.334004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3102 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:02.334044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3102 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:02.334053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3102 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:02.334059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:02.334517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3102 sessionId:  describe result for acl check
2025-09-30T14:59:02.334563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:02.334574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:02.334576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:02.334582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896916580454943:10550] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:02.335187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896916580454943:10550] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:02.335540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:02.337500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896916580454943:10550] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:02.338094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:02.338348Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:02.338358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:02.338370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:02.338428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:02.338478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896916490652927:6071]
2025-09-30T14:59:02.339172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:02.339568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:02.339620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:02.340188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:02.340274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.340283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.340284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.340286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.340287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.340289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.340290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.340292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.340293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.340294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.340296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.340298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.340299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.340300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.340301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.340307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.340318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.340322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.340327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.340331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.340335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.340340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.340344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.340348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.340353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.340357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.340361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.340365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.340369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.340373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.340381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.340390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.340397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.340402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.340407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.340413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.340418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.340425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.340430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.340436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.340442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.340447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.340453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.340459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.340464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.340470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.340479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.340486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.340491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.340496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.340501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.340505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.340508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.340513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.340518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.340523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.340528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.340533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.340538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.340544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.340610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:02.343907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896916580454943:10550] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:02.343934Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896916580454943:10550] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:02.343938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896916580454943:10550] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:02.343947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3102 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:02.348531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:02.349657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:02.349667Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:02.349669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:02.349672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:02.349678Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3101 [2:7555896916490652927:6071]
2025-09-30T14:59:02.349693Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:02.349706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:02.349709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.349711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.349713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.349727Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:02.349732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:02.349739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:02.349786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.349794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.349795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.349798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:02.349800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:02.349853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:02.349855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.349865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.349875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.349885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:02.349903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896916490652922:6071]
2025-09-30T14:59:02.349908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896916490652922:6071]
2025-09-30T14:59:02.349910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896916490652922:6071]
2025-09-30T14:59:02.349917Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:02.349927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:02.349941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:02.349946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:02.349932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:02.349960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:02.349962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:02.349983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580454778:2454], now have 1 active actors on pipe
2025-09-30T14:59:02.349989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580454983:10550], now have 1 active actors on pipe
2025-09-30T14:59:02.349991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896916490652922:6071]
2025-09-30T14:59:02.350000Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:02.350003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580454873:10551], now have 1 active actors on pipe
2025-09-30T14:59:02.350030Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:02.350086Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3101
2025-09-30T14:59:02.350116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3101
2025-09-30T14:59:02.350144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3101, pipe: [1:7555896916580454873:10551]
2025-09-30T14:59:02.350165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.350173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.350187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.350193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.350197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_32_8809750126570015226_v1 on pipe: [1:7555896916580454873:10551]
2025-09-30T14:59:02.350221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:02.350230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.350231Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_32_8809750126570015226_v1:1 with generation 3101
2025-09-30T14:59:02.350232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.350234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:02.350242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.350249Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:02.350258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.350264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.350265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:02.350275Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_32_8809750126570015226_v1
2025-09-30T14:59:02.350281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.350300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:02.350316Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:59:02.350433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.350446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.350457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:02.350536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3102 partition: 0 MaxSeqNo: 42 sessionId: src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0
2025-09-30T14:59:02.350943Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|33981f11-6cfeb1c2-f935e326-28cb6887_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:02.353898Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0] Write session: try to update token
2025-09-30T14:59:02.353922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:02.354792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:59:02.354831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:59:02.354843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.354846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.354849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.354859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:59:02.354874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:59:02.355025Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244342349 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:59:02.355054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:59:02.355108Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 sending to client partition status
2025-09-30T14:59:02.362345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:02.362364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:02.362376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896916490652922:6071]
2025-09-30T14:59:02.362423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:02.362423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:02.362613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:02.362788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:02.362956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:02.363119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:02.363364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:02.363409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:02.370664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3102 sessionId: src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:02.373639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:02.373660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:02.373682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:02.373685Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:02.373688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:02.373700Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896916490652922:6071]
2025-09-30T14:59:02.373704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896916490652922:6071]
2025-09-30T14:59:02.373709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896916490652922:6071]
2025-09-30T14:59:02.373750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:02.373754Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:02.373759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:02.373763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:02.373768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.373771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:02.373935Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:02.488668Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:02.489012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.489027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.489279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_32_8809750126570015226_v1
2025-09-30T14:59:02.489268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:02.489274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:02.489287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:02.489353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3102 reason: error at write: Disconnected sessionId: src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0
2025-09-30T14:59:02.489368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896916580454873:10551]
2025-09-30T14:59:02.489299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:02.489335Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_32_8809750126570015226_v1
2025-09-30T14:59:02.489535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3102 sessionId: src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0 is DEAD
2025-09-30T14:59:02.489687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:02.489698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0] Write session will restart in 0.007920s
2025-09-30T14:59:02.489727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0] Write session: Do CDS request
2025-09-30T14:59:02.489733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:02.498799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:02.498930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:02.498967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3103
2025-09-30T14:59:02.499240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3103 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:02.499296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3103 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:02.499301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3103 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:02.499306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:02.499877Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3103 sessionId:  describe result for acl check
2025-09-30T14:59:02.499916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:02.499919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:02.499921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:02.499927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896916580455044:10533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:02.500888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896916580455044:10533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:02.503777Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896916580455044:10533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:02.507584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896916580455044:10533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:02.507619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896916580455044:10533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:02.507623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896916580455044:10533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:02.507632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3103 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:02.507932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:02.510157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:02.510483Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:02.510496Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:02.510508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:02.510564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:02.510608Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896916490653172:6033]
2025-09-30T14:59:02.511337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:02.511782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:02.511833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:02.512181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:02.512251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.512253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.512254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.512256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.512257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.512258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.512259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.512260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.512262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.512263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.512264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.512266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.512267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.512268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.512269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.512276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.512288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.512293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.512298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.512302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.512306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.512310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.512313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.512317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.512322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.512326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.512329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.512333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.512337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.512342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.512351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.512360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.512365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.512372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.512377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.512382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.512389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.512395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.512400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.512407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.512412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.512418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.512424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.512430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.512434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.512439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.512447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.512452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.512457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.512462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.512468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.512474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.512479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.512484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.512489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.512494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.512499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.512505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.512510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.512516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.512564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:02.518404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:02.519660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:02.519679Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:02.519683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:02.519688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:02.519696Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3102 [2:7555896916490653172:6033]
2025-09-30T14:59:02.519714Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:02.519730Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:02.519740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.519743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.519746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.519763Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:02.519776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:02.519785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:02.519856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.519865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.519867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.519871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:02.519874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:02.519951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:02.519959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.519974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.519992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.520132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3102
2025-09-30T14:59:02.520150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3102
2025-09-30T14:59:02.520015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:02.520041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580455017:2454], now have 1 active actors on pipe
2025-09-30T14:59:02.520045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580455206:10533], now have 1 active actors on pipe
2025-09-30T14:59:02.520051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896916490653166:6033]
2025-09-30T14:59:02.520055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896916490653166:6033]
2025-09-30T14:59:02.520057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896916490653166:6033]
2025-09-30T14:59:02.520072Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:02.520086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:02.520092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:02.520096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:02.520099Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:02.520106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:02.520110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:02.520149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896916490653166:6033]
2025-09-30T14:59:02.520153Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:02.520158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:02.520182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.520187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.520383Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:02.520405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.520414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.520416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:02.520427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.520442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:02.520470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:02.520701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.520713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.520747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:02.520903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3103 partition: 0 MaxSeqNo: 42 sessionId: src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0
2025-09-30T14:59:02.521363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|105e36b1-558bc6de-2da5db7a-f05c5b48_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:02.524388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0] Write session: try to update token
2025-09-30T14:59:02.524408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:02.533931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:02.533962Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:02.533965Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:02.533967Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:02.533978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896916490653166:6033]
2025-09-30T14:59:02.533983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896916490653166:6033]
2025-09-30T14:59:02.533987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896916490653166:6033]
2025-09-30T14:59:02.534029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:02.534037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.534039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:02.534045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:02.534052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:02.534060Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:02.534185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:02.540529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3103 sessionId: src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:02.543424Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:02.589668Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896916580455219:10551]
2025-09-30T14:59:02.590044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3102, pipe: [1:7555896916580455219:10551]
2025-09-30T14:59:02.649710Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:02.650094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.650108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.650151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580455219:10551], now have 1 active actors on pipe
2025-09-30T14:59:02.650403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:02.650417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896916580455219:10551]
2025-09-30T14:59:02.650458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:02.650461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:02.650547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3103 reason: error at write: Disconnected sessionId: src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0
2025-09-30T14:59:02.650742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3103 sessionId: src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0 is DEAD
2025-09-30T14:59:02.650905Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:02.650916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0] Write session will restart in 0.005546s
2025-09-30T14:59:02.650944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0] Write session: Do CDS request
2025-09-30T14:59:02.650950Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:02.651257Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:02.657803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:02.657868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:02.657891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3104
2025-09-30T14:59:02.658037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3104 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:02.658071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3104 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:02.658077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3104 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:02.658081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:02.658666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3104 sessionId:  describe result for acl check
2025-09-30T14:59:02.658730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:02.658737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:02.658739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:02.658746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896916580455245:10523] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:02.659346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896916580455245:10523] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:02.661826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896916580455245:10523] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:02.667476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:02.667510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896916580455245:10523] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:02.667543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896916580455245:10523] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:02.667547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896916580455245:10523] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:02.667556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3104 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:02.670199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:02.670579Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:02.670590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:02.670604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:02.670672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:02.670717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896916490653369:6027]
2025-09-30T14:59:02.671440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:02.671785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:02.671839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:02.672185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:02.672254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.672261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.672262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.672264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.672265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.672266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.672268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.672269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.672270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.672272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.672273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.672274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.672276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.672277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.672279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.672286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.672298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.672302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.672307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.672312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.672317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.672322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.672327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.672331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.672337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.672341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.672344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.672349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.672353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.672357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.672364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.672374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.672381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.672387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.672395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.672402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.672408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.672414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.672421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.672427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.672432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.672438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.672443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.672449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.672454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.672459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.672466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.672480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.672485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.672491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.672501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.672506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.672512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.672523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.672528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.672538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.672543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.672548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.672557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.672563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.672614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:02.678173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:02.679194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:02.679208Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:02.679211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:02.679215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:02.679221Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3103 [2:7555896916490653369:6027]
2025-09-30T14:59:02.679237Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:02.679270Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:02.679277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.679280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.679282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.679298Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:02.679305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:02.679312Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:02.679377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.679384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.679386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.679389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:02.679392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:02.679456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:02.679464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.679477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.679496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.679519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:02.679542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580455220:2454], now have 1 active actors on pipe
2025-09-30T14:59:02.679551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580455412:10523], now have 1 active actors on pipe
2025-09-30T14:59:02.679557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896916490653363:6027]
2025-09-30T14:59:02.679559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896916490653363:6027]
2025-09-30T14:59:02.679561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896916490653363:6027]
2025-09-30T14:59:02.679574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:02.679593Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:02.679593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:02.679603Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:02.679606Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:02.679617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:02.679621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:02.679597Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3103
2025-09-30T14:59:02.679597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3103
2025-09-30T14:59:02.679652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896916490653363:6027]
2025-09-30T14:59:02.679662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:02.679669Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:02.679681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.679690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.679739Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6024a41c-50efc33e-39ca97f0-304fd035_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:02.679750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.679753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.679755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:02.679764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.679778Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:02.679799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:02.679969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.679982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.680007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:02.680091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3104 partition: 0 MaxSeqNo: 42 sessionId: src_id|6024a41c-50efc33e-39ca97f0-304fd035_0
2025-09-30T14:59:02.680479Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|455314f7-17f73f84-ee8bee6c-df9bd1e9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6024a41c-50efc33e-39ca97f0-304fd035_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:02.683425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6024a41c-50efc33e-39ca97f0-304fd035_0] Write session: try to update token
2025-09-30T14:59:02.683445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6024a41c-50efc33e-39ca97f0-304fd035_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:02.697413Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:02.697438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:02.697441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:02.697443Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:02.697454Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896916490653363:6027]
2025-09-30T14:59:02.697460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896916490653363:6027]
2025-09-30T14:59:02.697464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896916490653363:6027]
2025-09-30T14:59:02.697509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:02.697517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.697527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:02.697529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:02.697536Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:02.697540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:02.698157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:02.703933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3104 sessionId: src_id|6024a41c-50efc33e-39ca97f0-304fd035_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:02.707396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:02.750371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896916580455436:10551]
2025-09-30T14:59:02.750702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3103, pipe: [1:7555896916580455436:10551]
2025-09-30T14:59:02.817198Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:02.817207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896916580455436:10551]
2025-09-30T14:59:02.817231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:02.817320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3104 reason: status is not ok: tablet will be restarted right now sessionId: src_id|6024a41c-50efc33e-39ca97f0-304fd035_0
2025-09-30T14:59:02.817510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3104 sessionId: src_id|6024a41c-50efc33e-39ca97f0-304fd035_0 is DEAD
2025-09-30T14:59:02.815864Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:02.816238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.816249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.816293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580455436:10551], now have 1 active actors on pipe
2025-09-30T14:59:02.816542Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:02.831451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6024a41c-50efc33e-39ca97f0-304fd035_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:02.831472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6024a41c-50efc33e-39ca97f0-304fd035_0] Write session will restart in 0.009605s
2025-09-30T14:59:02.831513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6024a41c-50efc33e-39ca97f0-304fd035_0] Write session: Do CDS request
2025-09-30T14:59:02.831519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6024a41c-50efc33e-39ca97f0-304fd035_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:02.837361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:02.840070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:02.840462Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:02.840475Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:02.840489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:02.840560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:02.840614Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896916490653564:6024]
2025-09-30T14:59:02.841332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:02.841732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:02.841786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:02.842150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:02.842218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.842224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.842226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.842228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.842229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.842231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.842233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.842235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.842237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.842238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.842240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.842241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.842243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.842244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.842246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.842252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.842264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.842268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.842273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.842277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.842281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.842286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.842290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.842295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.842299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.842303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.842307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.842313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.842317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.842322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.842332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.842340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:02.842346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.842352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:02.842357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.842363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:02.842368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.842373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:02.842378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.842383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:02.842387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.842394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:02.842400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.842406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:02.842410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.842421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:02.842426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.842433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:02.842438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.842444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:02.842448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.842454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.842466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.842471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.842476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.842487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.842492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.842498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:02.842512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.842522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:02.842572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:02.842818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6024a41c-50efc33e-39ca97f0-304fd035_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:02.842939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:02.842959Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3105
2025-09-30T14:59:02.843207Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3105 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:02.843259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3105 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:02.843266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3105 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:02.843270Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:02.843765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3105 sessionId:  describe result for acl check
2025-09-30T14:59:02.843804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:02.844004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:02.844013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:02.844020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896916580455604:10521] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:02.844583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896916580455604:10521] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:02.848123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896916580455604:10521] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:02.849252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:02.850986Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3104
2025-09-30T14:59:02.850537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:02.850545Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:02.850548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:02.850552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:02.850559Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3104 [2:7555896916490653564:6024]
2025-09-30T14:59:02.850574Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:02.850590Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:02.850593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.850596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.850598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.850616Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:02.850623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:02.850632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:02.850698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.850701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.850705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.850708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:02.850710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:02.850792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:02.850795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.850808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:02.850822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:02.850841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:02.850863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580455439:2454], now have 1 active actors on pipe
2025-09-30T14:59:02.850869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896916490653559:6024]
2025-09-30T14:59:02.850872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896916490653559:6024]
2025-09-30T14:59:02.850874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896916490653559:6024]
2025-09-30T14:59:02.850891Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:02.850906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:02.850919Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:02.850923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:02.850924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:02.850926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:02.850927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:02.850961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896916490653559:6024]
2025-09-30T14:59:02.850969Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:02.850976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:02.851304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896916580455604:10521] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:02.851331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896916580455604:10521] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:02.851336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896916580455604:10521] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:02.851344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3105 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:02.851610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580455640:10521], now have 1 active actors on pipe
2025-09-30T14:59:02.851677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3104
2025-09-30T14:59:02.851769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.851783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.851807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:02.851823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:02.851833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:02.851837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:02.851848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:02.851865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:02.851882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:02.852061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.852072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.852089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:02.852161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3105 partition: 0 MaxSeqNo: 42 sessionId: src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0
2025-09-30T14:59:02.855539Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6024a41c-50efc33e-39ca97f0-304fd035_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:02.858695Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0] Write session: try to update token
2025-09-30T14:59:02.858719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:02.863966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:02.863986Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:02.863989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:02.863992Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:02.864002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896916490653559:6024]
2025-09-30T14:59:02.864007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896916490653559:6024]
2025-09-30T14:59:02.864011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896916490653559:6024]
2025-09-30T14:59:02.864060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:02.864066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:02.864070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:02.864073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:02.864074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:02.864079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:02.864224Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:02.878930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3105 sessionId: src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:02.882081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:02.917706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896916580455645:10551]
2025-09-30T14:59:02.918113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3104, pipe: [1:7555896916580455645:10551]
2025-09-30T14:59:02.985268Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:02.985695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:02.985715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:02.985736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580455645:10551], now have 1 active actors on pipe
2025-09-30T14:59:02.985957Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:02.986438Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:02.986449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0] Write session will restart in 0.006417s
2025-09-30T14:59:02.986475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0] Write session: Do CDS request
2025-09-30T14:59:02.986481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:02.985971Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896916580455645:10551]
2025-09-30T14:59:02.985978Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:02.985982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:02.986014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:02.986063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3105 reason: error at write: Disconnected sessionId: src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0
2025-09-30T14:59:02.986243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3105 sessionId: src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0 is DEAD
2025-09-30T14:59:02.993827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:02.993940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:02.993963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3106
2025-09-30T14:59:02.994118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3106 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:02.994154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3106 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:02.994159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3106 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:02.994164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:02.994663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3106 sessionId:  describe result for acl check
2025-09-30T14:59:02.994706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:02.994715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:02.994717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:02.994722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896916580455675:10516] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:02.995324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896916580455675:10516] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:02.997974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896916580455675:10516] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:03.001048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896916580455675:10516] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:03.001071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896916580455675:10516] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:03.001074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896916580455675:10516] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:03.001084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3106 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:03.002519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:03.004853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:03.005071Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:03.005080Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:03.005091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:03.005143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:03.005187Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896920785621058:6015]
2025-09-30T14:59:03.005889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:03.006268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:03.006337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:03.006727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:03.006941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.006950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.006951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.006953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.006954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.006956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.006957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.006958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.006962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.006963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.006964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.006965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.006966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.006967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.006969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.006976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.006987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.006992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.006997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.007001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.007005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.007010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.007013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.007017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.007022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.007026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.007031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.007035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.007040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.007044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.007054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.007063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.007074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.007080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.007089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.007095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.007104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.007110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.007115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.007127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.007137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.007143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.007152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.007157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.007166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.007170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.007176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.007185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.007190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.007196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.007205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.007211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.007221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.007227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.007235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.007285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.007295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.007301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.007305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.007310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.007359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:03.013261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:03.014358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:03.014376Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:03.014379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:03.014383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:03.014391Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3105 [2:7555896920785621058:6015]
2025-09-30T14:59:03.014410Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:03.014428Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:03.014438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:03.014441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:03.014444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:03.014465Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:03.014478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:03.014490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:03.014555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.014563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.014565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.014569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:03.014572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:03.014641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:03.014649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.014665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.014690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.014709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:03.014729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896916580455647:2454], now have 1 active actors on pipe
2025-09-30T14:59:03.014733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875423134:10516], now have 1 active actors on pipe
2025-09-30T14:59:03.014740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896920785621053:6015]
2025-09-30T14:59:03.014743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896920785621053:6015]
2025-09-30T14:59:03.014745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896920785621053:6015]
2025-09-30T14:59:03.014758Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:03.014778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:03.014779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:03.014783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:03.014786Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:03.014802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:03.014806Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:03.014790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3105
2025-09-30T14:59:03.014787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3105
2025-09-30T14:59:03.014843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896920785621053:6015]
2025-09-30T14:59:03.014858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:03.014881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.014888Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:03.014892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.014943Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:03.014957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:03.014961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:03.014963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:03.014972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:03.014981Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:03.015010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:03.015171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.015179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.015193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:03.015481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3106 partition: 0 MaxSeqNo: 42 sessionId: src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0
2025-09-30T14:59:03.015884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|afe17ae-d50e8fe0-6505fc8c-d9a62ec3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:03.018948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0] Write session: try to update token
2025-09-30T14:59:03.018978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:03.027947Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:03.027972Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:03.027974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:03.027977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:03.027988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896920785621053:6015]
2025-09-30T14:59:03.027993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896920785621053:6015]
2025-09-30T14:59:03.027997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896920785621053:6015]
2025-09-30T14:59:03.028042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:03.028047Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:03.028051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.028054Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:03.028053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:03.028061Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:03.028355Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:03.035900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3106 sessionId: src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:03.039176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:03.086302Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896920875423148:10551]
2025-09-30T14:59:03.086695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3105, pipe: [1:7555896920875423148:10551]
2025-09-30T14:59:03.151697Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:03.152078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.152095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.152118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875423148:10551], now have 1 active actors on pipe
2025-09-30T14:59:03.152363Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:03.152381Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896920875423148:10551]
2025-09-30T14:59:03.152400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:03.152405Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:03.152426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:03.152473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3106 reason: error at write: Disconnected sessionId: src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0
2025-09-30T14:59:03.152693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3106 sessionId: src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0 is DEAD
2025-09-30T14:59:03.155480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:03.155495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0] Write session will restart in 0.005722s
2025-09-30T14:59:03.155520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0] Write session: Do CDS request
2025-09-30T14:59:03.155530Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:03.164056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:03.164299Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:03.164317Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3107
2025-09-30T14:59:03.164652Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3107 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:03.164700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3107 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:03.164706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3107 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:03.164711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:03.165340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3107 sessionId:  describe result for acl check
2025-09-30T14:59:03.165388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:03.165396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:03.165398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:03.165405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896920875423230:10505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:03.165990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896920875423230:10505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:03.172329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896920875423230:10505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:03.173341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:03.177018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896920875423230:10505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:03.177038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896920875423230:10505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:03.177042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896920875423230:10505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:03.177052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3107 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:03.177954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:03.178201Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:03.178215Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:03.178227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:03.178304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:03.178349Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896920785621258:6016]
2025-09-30T14:59:03.179031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:03.179503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:03.179564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:03.179926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:03.180010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.180018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.180019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.180021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.180023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.180025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.180027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.180028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.180029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.180031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.180033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.180034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.180036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.180037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.180039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.180046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.180057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.180061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.180066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.180070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.180075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.180080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.180084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.180088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.180093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.180097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.180102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.180107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.180111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.180115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.180124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.180133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.180139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.180144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.180151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.180157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.180163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.180169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.180182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.180188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.180193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.180198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.180205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.180215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.180220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.180231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.180237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.180248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.180252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.180258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.180264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.180270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.180280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.180287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.180295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.180300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.180305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.180310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.180314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.180320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.180364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:03.186514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:03.187806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:03.187824Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:03.187827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:03.187831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:03.187839Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3106 [2:7555896920785621258:6016]
2025-09-30T14:59:03.187858Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:03.187876Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:03.187880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:03.187884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:03.187886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:03.187904Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:03.187912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:03.187920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:03.187996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.188006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.188008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.188012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:03.188015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:03.188101Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:03.188109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.188126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.188150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.188172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:03.188193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875423348:10505], now have 1 active actors on pipe
2025-09-30T14:59:03.188197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875423153:2454], now have 1 active actors on pipe
2025-09-30T14:59:03.188205Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896920785621252:6016]
2025-09-30T14:59:03.188210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896920785621252:6016]
2025-09-30T14:59:03.188213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896920785621252:6016]
2025-09-30T14:59:03.188227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:03.188249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:03.188251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:03.188259Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:03.188262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:03.188267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:03.188270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:03.188251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3106
2025-09-30T14:59:03.188253Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3106
2025-09-30T14:59:03.188310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896920785621252:6016]
2025-09-30T14:59:03.188319Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:03.188322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:03.188337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.188348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.188405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:03.188418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:03.188422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:03.188425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:03.188437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:03.188453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:03.188483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:03.188681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.188693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.188717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:03.188816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3107 partition: 0 MaxSeqNo: 42 sessionId: src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0
2025-09-30T14:59:03.189262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b38e3cbf-ad107a-ed56b61c-f89e477d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:03.192100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0] Write session: try to update token
2025-09-30T14:59:03.192119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:03.201655Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:03.201673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:03.201676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:03.201678Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:03.201688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896920785621252:6016]
2025-09-30T14:59:03.201694Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896920785621252:6016]
2025-09-30T14:59:03.201702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896920785621252:6016]
2025-09-30T14:59:03.201744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:03.201749Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:03.201750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.201754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:03.201755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:03.201759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:03.201906Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:03.208098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3107 sessionId: src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:03.211017Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:03.252741Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896920875423360:10551]
2025-09-30T14:59:03.253252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3106, pipe: [1:7555896920875423360:10551]
2025-09-30T14:59:03.316021Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:03.316498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.316515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.316555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875423360:10551], now have 1 active actors on pipe
2025-09-30T14:59:03.317050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:03.317531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:03.317544Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0] Write session will restart in 0.007212s
2025-09-30T14:59:03.317569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0] Write session: Do CDS request
2025-09-30T14:59:03.317575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:03.316947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:03.316971Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:03.317043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3107 reason: error at write: Disconnected sessionId: src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0
2025-09-30T14:59:03.317275Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:03.317286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3107 sessionId: src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0 is DEAD
2025-09-30T14:59:03.317315Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896920875423360:10551]
2025-09-30T14:59:03.325895Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:03.326038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:03.326059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3108
2025-09-30T14:59:03.326206Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3108 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:03.326247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3108 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:03.326261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3108 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:03.326266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:03.326679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3108 sessionId:  describe result for acl check
2025-09-30T14:59:03.326714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:03.326716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:03.326721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:03.326727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896920875423404:10499] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:03.327308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896920875423404:10499] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:03.331297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896920875423404:10499] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:03.334170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896920875423404:10499] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:03.334189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896920875423404:10499] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:03.334193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896920875423404:10499] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:03.334201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3108 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:03.334496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:03.336950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:03.337199Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:03.337210Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:03.337223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:03.337287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:03.337333Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896920785621457:6010]
2025-09-30T14:59:03.338036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:03.338505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:03.338568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:03.338929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:03.339013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.339021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.339022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.339023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.339025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.339027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.339028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.339030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.339031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.339033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.339034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.339035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.339036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.339037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.339039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.339045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.339057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.339061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.339065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.339070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.339074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.339079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.339083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.339087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.339092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.339097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.339101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.339105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.339109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.339113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.339123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.339131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.339137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.339142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.339147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.339152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.339156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.339162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.339167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.339172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.339177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.339184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.339206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.339213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.339218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.339223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.339231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.339237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.339259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.339265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.339272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.339277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.339283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.339289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.339294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.339299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.339304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.339310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.339315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.339321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.339370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:03.348544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:03.349934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:03.349948Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:03.349951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:03.349956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:03.349964Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3107 [2:7555896920785621457:6010]
2025-09-30T14:59:03.349982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:03.349998Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:03.350006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:03.350009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:03.350012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:03.350029Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:03.350041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:03.350047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:03.350120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.350127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.350129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.350133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:03.350135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:03.350202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:03.350211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.350227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.350248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.350263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:03.350280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875423564:10499], now have 1 active actors on pipe
2025-09-30T14:59:03.350290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875423365:2454], now have 1 active actors on pipe
2025-09-30T14:59:03.350296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896920785621451:6010]
2025-09-30T14:59:03.350298Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896920785621451:6010]
2025-09-30T14:59:03.350300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896920785621451:6010]
2025-09-30T14:59:03.350312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:03.350329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:03.350339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:03.350343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:03.350345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:03.350349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:03.350352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:03.350391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896920785621451:6010]
2025-09-30T14:59:03.350404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:03.350411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:03.350380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3107
2025-09-30T14:59:03.350387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3107
2025-09-30T14:59:03.350461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.350470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.350495Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9c8843d0-22f66204-b075a49-f91173a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:03.350507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:03.350510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:03.350512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:03.350523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:03.350536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:03.350550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:03.350764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.350779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.350816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:03.350917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3108 partition: 0 MaxSeqNo: 42 sessionId: src_id|9c8843d0-22f66204-b075a49-f91173a0_0
2025-09-30T14:59:03.351316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|24a2f031-ac9e856-aa8fdddf-1b923932_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9c8843d0-22f66204-b075a49-f91173a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:03.354348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8843d0-22f66204-b075a49-f91173a0_0] Write session: try to update token
2025-09-30T14:59:03.354370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8843d0-22f66204-b075a49-f91173a0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:03.363235Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:03.363277Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:03.363287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896920785621451:6010]
2025-09-30T14:59:03.363335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:03.363344Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:03.363524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:03.363677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:03.363838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:03.363995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:03.364209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:03.364260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:03.371537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3108 sessionId: src_id|9c8843d0-22f66204-b075a49-f91173a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:03.374607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:03.374720Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:03.374742Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:03.374745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:03.374747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:03.374757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896920785621451:6010]
2025-09-30T14:59:03.374761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896920785621451:6010]
2025-09-30T14:59:03.374766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896920785621451:6010]
2025-09-30T14:59:03.374791Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:03.374800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:03.374810Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:03.374812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.374824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.374847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:03.374859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.374866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:03.375012Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:03.416532Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896920875423579:10551]
2025-09-30T14:59:03.416880Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3107, pipe: [1:7555896920875423579:10551]
2025-09-30T14:59:03.496618Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:03.496876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875423579:10551], now have 1 active actors on pipe
2025-09-30T14:59:03.497063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:03.497073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896920875423579:10551]
2025-09-30T14:59:03.497081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:03.497090Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:03.497144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3108 reason: error at write: Disconnected sessionId: src_id|9c8843d0-22f66204-b075a49-f91173a0_0
2025-09-30T14:59:03.497143Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:03.497334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3108 sessionId: src_id|9c8843d0-22f66204-b075a49-f91173a0_0 is DEAD
2025-09-30T14:59:03.499380Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8843d0-22f66204-b075a49-f91173a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:03.499394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8843d0-22f66204-b075a49-f91173a0_0] Write session will restart in 0.006492s
2025-09-30T14:59:03.499419Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8843d0-22f66204-b075a49-f91173a0_0] Write session: Do CDS request
2025-09-30T14:59:03.499424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8843d0-22f66204-b075a49-f91173a0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:03.506843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8843d0-22f66204-b075a49-f91173a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:03.507820Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:03.507841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3109
2025-09-30T14:59:03.507983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3109 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:03.508020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3109 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:03.508042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3109 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:03.508051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:03.509016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3109 sessionId:  describe result for acl check
2025-09-30T14:59:03.509066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:03.509075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:03.509077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:03.509084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896920875423660:10479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:03.509694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896920875423660:10479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:03.513256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896920875423660:10479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:03.518396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896920875423660:10479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:03.518424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896920875423660:10479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:03.518442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896920875423660:10479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:03.518452Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3109 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:03.525041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:03.527674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:03.527906Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:03.527910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:03.527922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:03.527982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:03.528021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896920785621705:5989]
2025-09-30T14:59:03.528708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:03.529078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:03.529128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:03.529471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:03.529544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.529545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.529547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.529548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.529549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.529551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.529552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.529553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.529555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.529556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.529557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.529559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.529560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.529561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.529562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.529568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.529579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.529583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.529587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.529591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.529595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.529600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.529604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.529608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.529613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.529618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.529622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.529627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.529631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.529635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.529645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.529654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.529661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.529667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.529673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.529679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.529685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.529690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.529696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.529703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.529708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.529713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.529718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.529724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.529730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.529735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.529741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.529750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.529755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.529761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.529767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.529772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.529777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.529783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.529788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.529794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.529799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.529805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.529810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.529816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.529866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:03.536997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:03.538143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:03.538159Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:03.538162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:03.538166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:03.538174Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3108 [2:7555896920785621705:5989]
2025-09-30T14:59:03.538192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:03.538209Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:03.538213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:03.538217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:03.538219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:03.538236Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:03.538243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:03.538250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:03.538324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.538327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.538329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.538333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:03.538335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:03.538402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:03.538412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.538428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.538440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.538464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:03.538483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896920785621699:5989]
2025-09-30T14:59:03.538490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896920785621699:5989]
2025-09-30T14:59:03.538494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896920785621699:5989]
2025-09-30T14:59:03.538503Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:03.538522Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:03.538543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:03.538551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:03.538588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896920785621699:5989]
2025-09-30T14:59:03.538595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:03.539031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:03.539039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:03.539042Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:03.539048Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:03.539330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875423779:10479], now have 1 active actors on pipe
2025-09-30T14:59:03.539339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875423606:2454], now have 1 active actors on pipe
2025-09-30T14:59:03.543549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3108
2025-09-30T14:59:03.543549Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3108
2025-09-30T14:59:03.544001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.544023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.544066Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:03.544088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:03.544093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:03.544097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:03.544111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:03.544128Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:03.544152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:03.551333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.551363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.551408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:03.553796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3109 partition: 0 MaxSeqNo: 42 sessionId: src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0
2025-09-30T14:59:03.559715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9c8843d0-22f66204-b075a49-f91173a0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:03.560234Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:03.560256Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:03.560267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896920785621699:5989]
2025-09-30T14:59:03.560317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:03.560519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:03.560708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:03.560873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:03.561044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:03.561762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:03.561816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:03.561936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:03.563014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0] Write session: try to update token
2025-09-30T14:59:03.563036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:03.576237Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:03.576260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:03.576262Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:03.576265Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:03.576281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896920785621699:5989]
2025-09-30T14:59:03.576285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896920785621699:5989]
2025-09-30T14:59:03.576291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896920785621699:5989]
2025-09-30T14:59:03.576338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:03.576348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.576351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:03.576353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:03.576361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:03.576365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:03.576513Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:03.599171Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896920875423811:10551]
2025-09-30T14:59:03.599579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3109 sessionId: src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:03.599747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3108, pipe: [1:7555896920875423811:10551]
2025-09-30T14:59:03.602373Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:03.698060Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:03.698495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875423811:10551], now have 1 active actors on pipe
2025-09-30T14:59:03.698527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.698535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.698806Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:03.699129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896920875423811:10551]
2025-09-30T14:59:03.703012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:03.703029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0] Write session will restart in 0.005463s
2025-09-30T14:59:03.703058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0] Write session: Do CDS request
2025-09-30T14:59:03.703065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:03.699346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:03.699385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:03.699387Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:03.699441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3109 reason: error at write: Disconnected sessionId: src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0
2025-09-30T14:59:03.699630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3109 sessionId: src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0 is DEAD
2025-09-30T14:59:03.711763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:03.715808Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:03.715830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3110
2025-09-30T14:59:03.716272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3110 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:03.716305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3110 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:03.716311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3110 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:03.716316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:03.716950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3110 sessionId:  describe result for acl check
2025-09-30T14:59:03.716978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:03.716980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:03.716982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:03.716989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896920875423913:10468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:03.717580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896920875423913:10468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:03.719468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896920875423913:10468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:03.722539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896920875423913:10468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:03.722561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896920875423913:10468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:03.722565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896920875423913:10468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:03.722576Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3110 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:03.724140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:03.727759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:03.728113Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:03.728130Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:03.728146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:03.728227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:03.728279Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896920785621909:5987]
2025-09-30T14:59:03.729000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:03.729437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:03.729510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:03.729894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:03.729994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.730002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.730003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.730004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.730006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.730007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.730008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.730010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.730011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.730013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.730014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.730016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.730017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.730018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.730020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.730027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.730037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.730042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.730046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.730051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.730055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.730059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.730062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.730067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.730071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.730075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.730079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.730083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.730088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.730093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.730104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.730112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.730119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.730125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.730131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.730137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.730141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.730148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.730153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.730159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.730164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.730171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.730196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.730203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.730209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.730215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.730221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.730226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.730231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.730236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.730241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.730246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.730252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.730257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.730263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.730268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.730280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.730286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.730292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.730298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.730346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:03.736323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:03.737528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:03.737549Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:03.737552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:03.737556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:03.737563Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3109 [2:7555896920785621909:5987]
2025-09-30T14:59:03.737582Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:03.737600Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:03.737604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:03.737607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:03.737610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:03.737628Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:03.737636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:03.737643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:03.737713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.737723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.737725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.737729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:03.737731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:03.737803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:03.737815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.737830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.737842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.737857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:03.737875Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896920785621903:5987]
2025-09-30T14:59:03.737883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896920785621903:5987]
2025-09-30T14:59:03.737886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896920785621903:5987]
2025-09-30T14:59:03.737900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:03.737913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:03.737919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875423826:2454], now have 1 active actors on pipe
2025-09-30T14:59:03.737924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:03.737926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875424021:10468], now have 1 active actors on pipe
2025-09-30T14:59:03.737932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:03.737938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:03.737947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:03.737951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:03.737988Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896920785621903:5987]
2025-09-30T14:59:03.738004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:03.738047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:03.738032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3109
2025-09-30T14:59:03.738087Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3109
2025-09-30T14:59:03.738314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.738370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.738400Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:03.738414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:03.738419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:03.738427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:03.738437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:03.738453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:03.738476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:03.738722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.738732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.738749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:03.738901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3110 partition: 0 MaxSeqNo: 42 sessionId: src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0
2025-09-30T14:59:03.743384Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13c80694-83d50e36-c657fd81-bf5d8c0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:03.746364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0] Write session: try to update token
2025-09-30T14:59:03.746394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:03.751074Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:03.751094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:03.751097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:03.751099Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:03.751109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896920785621903:5987]
2025-09-30T14:59:03.751114Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896920785621903:5987]
2025-09-30T14:59:03.751118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896920785621903:5987]
2025-09-30T14:59:03.751160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:03.751166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.751168Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:03.751170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:03.751185Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:03.751191Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:03.751415Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:03.775357Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3110 sessionId: src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:03.778245Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:03.799491Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896920875424035:10551]
2025-09-30T14:59:03.799841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3109, pipe: [1:7555896920875424035:10551]
2025-09-30T14:59:03.869998Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:03.870405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.870424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.870444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875424035:10551], now have 1 active actors on pipe
2025-09-30T14:59:03.870907Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:03.870858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:03.870872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896920875424035:10551]
2025-09-30T14:59:03.870901Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:03.870904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:03.870967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3110 reason: error at write: Disconnected sessionId: src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0
2025-09-30T14:59:03.871158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3110 sessionId: src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0 is DEAD
2025-09-30T14:59:03.871354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:03.871366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0] Write session will restart in 0.005192s
2025-09-30T14:59:03.871406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0] Write session: Do CDS request
2025-09-30T14:59:03.871416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:03.877836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:03.877947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:03.877981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3111
2025-09-30T14:59:03.878140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3111 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:03.878175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3111 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:03.878186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3111 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:03.878192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:03.878706Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3111 sessionId:  describe result for acl check
2025-09-30T14:59:03.878745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:03.878754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:03.878756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:03.878762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896920875424054:10470] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:03.879367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896920875424054:10470] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:03.881380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896920875424054:10470] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:03.885394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896920875424054:10470] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:03.885417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896920875424054:10470] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:03.885421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896920875424054:10470] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:03.885430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3111 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:03.889795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:03.892855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:03.893131Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:03.893142Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:03.893155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:03.893213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:03.893266Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896920785622111:5981]
2025-09-30T14:59:03.893950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:03.894533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:03.894602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:03.895003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:03.895079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.895086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.895088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.895104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.895105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.895106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.895108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.895109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.895110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.895112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.895113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.895114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.895116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.895117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.895118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.895125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.895136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.895141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.895146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.895150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.895154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.895159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.895163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.895167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.895174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.895178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.895181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.895185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.895188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.895193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.895202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.895213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:03.895227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.895233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:03.895241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.895264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:03.895274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.895279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:03.895290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.895296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:03.895301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.895311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:03.895317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.895323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:03.895328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.895339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:03.895345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.895355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:03.895360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.895365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:03.895375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.895381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.895390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.895396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.895401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.895407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.895412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.895421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:03.895427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.895433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:03.895497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:03.901659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:03.903018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:03.903033Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:03.903035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:03.903039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:03.903045Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3110 [2:7555896920785622111:5981]
2025-09-30T14:59:03.903057Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:03.903073Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:03.903075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:03.903078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:03.903080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:03.903094Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:03.903103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:03.903108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:03.903167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.903176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.903177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.903181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:03.903183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:03.903263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:03.903272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.903285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:03.903300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:03.903320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:03.903344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875424039:2454], now have 1 active actors on pipe
2025-09-30T14:59:03.903348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875424165:10470], now have 1 active actors on pipe
2025-09-30T14:59:03.903355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896920785622106:5981]
2025-09-30T14:59:03.903357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896920785622106:5981]
2025-09-30T14:59:03.903359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896920785622106:5981]
2025-09-30T14:59:03.903374Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:03.903440Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3110
2025-09-30T14:59:03.903390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:03.903392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:03.903395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:03.903397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:03.903412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:03.903415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:03.903468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896920785622106:5981]
2025-09-30T14:59:03.903478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:03.903496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:03.903442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3110
2025-09-30T14:59:03.903528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.903540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.903570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:03.903577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:03.903583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:03.903586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:03.903596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:03.903612Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:03.903629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:03.904163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:03.904175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:03.904191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:03.904286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3111 partition: 0 MaxSeqNo: 42 sessionId: src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0
2025-09-30T14:59:03.904673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eabf52b3-d6cf5b36-21b26f01-acf4ab65_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:03.907814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0] Write session: try to update token
2025-09-30T14:59:03.907835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:03.917452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:03.917476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:03.917480Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:03.917482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:03.917495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896920785622106:5981]
2025-09-30T14:59:03.917500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896920785622106:5981]
2025-09-30T14:59:03.917505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896920785622106:5981]
2025-09-30T14:59:03.917558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:03.917567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:03.917570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:03.917808Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:03.919574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:03.919605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:03.919610Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:03.928564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3111 sessionId: src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:03.932019Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:03.971034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896920875424249:10551]
2025-09-30T14:59:03.971476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3110, pipe: [1:7555896920875424249:10551]
2025-09-30T14:59:04.042236Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:04.042881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.042891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.042914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896920875424249:10551], now have 1 active actors on pipe
2025-09-30T14:59:04.043400Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:04.044174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:04.044187Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0] Write session will restart in 0.005671s
2025-09-30T14:59:04.044213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0] Write session: Do CDS request
2025-09-30T14:59:04.044219Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:04.043431Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:04.043491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:04.043494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:04.043561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3111 reason: error at write: Disconnected sessionId: src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0
2025-09-30T14:59:04.043743Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3111 sessionId: src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0 is DEAD
2025-09-30T14:59:04.043894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896920875424249:10551]
2025-09-30T14:59:04.051925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:04.055600Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:04.055622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3112
2025-09-30T14:59:04.055809Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3112 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:04.055841Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3112 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:04.055847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3112 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:04.055851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:04.056505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3112 sessionId:  describe result for acl check
2025-09-30T14:59:04.056540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:04.056542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:04.056544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:04.056550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896925170391557:10467] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:04.057123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896925170391557:10467] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:04.061686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896925170391557:10467] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:04.068548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896925170391557:10467] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:04.068574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896925170391557:10467] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:04.068578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896925170391557:10467] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:04.068587Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3112 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:04.080291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:04.082811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:04.083036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:04.083045Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:04.083065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:04.083117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:04.083160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896925080589610:5976]
2025-09-30T14:59:04.083890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:04.084218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:04.084263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:04.084613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:04.084743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.084753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.084754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.084755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.084756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.084758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.084759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.084760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.084762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.084763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.084765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.084766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.084767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.084768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.084770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.084776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.084786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.084791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.084795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.084800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.084804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.084807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.084812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.084816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.084820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.084824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.084828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.084832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.084836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.084840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.084849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.084857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.084864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.084869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.084874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.084879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.084884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.084889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.084898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.084903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.084908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.084913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.084918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.084923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.084930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.084935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.084942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.084947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.084953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.084959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.084969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.084977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.084986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.084992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.084996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.085006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.085010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.085028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.085036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.085042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.085085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:04.092420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:04.093688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:04.093703Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:04.093706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:04.093709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:04.093714Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3111 [2:7555896925080589610:5976]
2025-09-30T14:59:04.093729Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:04.093743Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:04.093745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:04.093747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:04.093749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:04.093763Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:04.093769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:04.093774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:04.093837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.093845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.093846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.093850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:04.093852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:04.093910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:04.093916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.093926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.093932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.093942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:04.093957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896925080589605:5976]
2025-09-30T14:59:04.093958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896925080589605:5976]
2025-09-30T14:59:04.093960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896925080589605:5976]
2025-09-30T14:59:04.093971Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:04.093982Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:04.093991Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:04.093992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:04.094023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896925080589605:5976]
2025-09-30T14:59:04.094025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:04.094101Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:04.094104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:04.094108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:04.094114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:04.094719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170391615:10467], now have 1 active actors on pipe
2025-09-30T14:59:04.094730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170391547:2454], now have 1 active actors on pipe
2025-09-30T14:59:04.095240Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3111
2025-09-30T14:59:04.095303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3111
2025-09-30T14:59:04.095493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.095510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.095545Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ede76d66-33209a68-34653410-71d54764_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:04.095560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:04.095565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:04.095568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:04.095580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:04.095598Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:04.095628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:04.096094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.096105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.096122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:04.096251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3112 partition: 0 MaxSeqNo: 42 sessionId: src_id|ede76d66-33209a68-34653410-71d54764_0
2025-09-30T14:59:04.096715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7063673c-3fc9a7c8-b00c3fb7-686e2320_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ede76d66-33209a68-34653410-71d54764_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:04.099687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ede76d66-33209a68-34653410-71d54764_0] Write session: try to update token
2025-09-30T14:59:04.099710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ede76d66-33209a68-34653410-71d54764_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:04.109618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:04.109643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:04.109646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:04.109649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:04.109664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896925080589605:5976]
2025-09-30T14:59:04.109669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896925080589605:5976]
2025-09-30T14:59:04.109674Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896925080589605:5976]
2025-09-30T14:59:04.109722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:04.109729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.109732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:04.109875Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:04.112574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:04.112595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:04.112600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:04.119917Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3112 sessionId: src_id|ede76d66-33209a68-34653410-71d54764_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:04.123025Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:04.144099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896925170391759:10551]
2025-09-30T14:59:04.144446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3111, pipe: [1:7555896925170391759:10551]
2025-09-30T14:59:04.233750Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:04.234220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.234233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.234254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170391759:10551], now have 1 active actors on pipe
2025-09-30T14:59:04.234548Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:04.234620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896925170391759:10551]
2025-09-30T14:59:04.234645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:04.234652Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:04.234709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3112 reason: error at write: Disconnected sessionId: src_id|ede76d66-33209a68-34653410-71d54764_0
2025-09-30T14:59:04.234911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3112 sessionId: src_id|ede76d66-33209a68-34653410-71d54764_0 is DEAD
2025-09-30T14:59:04.235109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede76d66-33209a68-34653410-71d54764_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:04.235117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede76d66-33209a68-34653410-71d54764_0] Write session will restart in 0.009178s
2025-09-30T14:59:04.235144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede76d66-33209a68-34653410-71d54764_0] Write session: Do CDS request
2025-09-30T14:59:04.235151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede76d66-33209a68-34653410-71d54764_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:04.235000Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:04.245836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ede76d66-33209a68-34653410-71d54764_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:04.245939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:04.245963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3113
2025-09-30T14:59:04.246263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3113 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:04.246316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3113 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:04.246322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3113 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:04.246326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:04.246938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3113 sessionId:  describe result for acl check
2025-09-30T14:59:04.246974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:04.246980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:04.246982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:04.246988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896925170391777:10459] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:04.247598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896925170391777:10459] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:04.253525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896925170391777:10459] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:04.260747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896925170391777:10459] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:04.260783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896925170391777:10459] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:04.260787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896925170391777:10459] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:04.260800Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3113 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:04.270281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:04.271515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:04.271759Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:04.271764Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:04.271775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:04.271833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:04.271884Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896925080589816:5974]
2025-09-30T14:59:04.272666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:04.273049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:04.273102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:04.273505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:04.273599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.273609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.273610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.273611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.273613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.273614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.273616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.273618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.273619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.273620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.273622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.273623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.273624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.273626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.273627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.273633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.273643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.273647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.273651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.273655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.273659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.273662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.273666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.273669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.273674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.273677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.273680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.273684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.273687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.273691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.273700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.273708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.273715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.273720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.273725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.273731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.273734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.273740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.273744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.273749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.273753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.273758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.273762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.273768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.273773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.273778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.273782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.273790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.273793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.273798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.273804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.273809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.273814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.273819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.273824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.273837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.273842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.273849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.273855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.273861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.273912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:04.281235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:04.282848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:04.282870Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:04.282873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:04.282878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:04.282886Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3112 [2:7555896925080589816:5974]
2025-09-30T14:59:04.282904Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:04.282924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:04.282927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:04.282930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:04.282933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:04.282954Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:04.282963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:04.282970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:04.283041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.283043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.283046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.283049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:04.283052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:04.283136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:04.283138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.283156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.283170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.283190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:04.283208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896925080589811:5974]
2025-09-30T14:59:04.283211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896925080589811:5974]
2025-09-30T14:59:04.283213Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896925080589811:5974]
2025-09-30T14:59:04.283222Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:04.283237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170391951:10459], now have 1 active actors on pipe
2025-09-30T14:59:04.283256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:04.283260Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:04.283262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:04.283265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170391762:2454], now have 1 active actors on pipe
2025-09-30T14:59:04.283270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:04.283286Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:04.283289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:04.283330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896925080589811:5974]
2025-09-30T14:59:04.283339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:04.283655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:04.283887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3112
2025-09-30T14:59:04.283924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3112
2025-09-30T14:59:04.284467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.284491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.284524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:04.284543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:04.284548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:04.284551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:04.284562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:04.284581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:04.284604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:04.284917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.284925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.284953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:04.289652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3113 partition: 0 MaxSeqNo: 42 sessionId: src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0
2025-09-30T14:59:04.291581Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede76d66-33209a68-34653410-71d54764_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:04.294859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0] Write session: try to update token
2025-09-30T14:59:04.294890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:04.302552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:04.302582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:04.302584Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:04.302587Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:04.302604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896925080589811:5974]
2025-09-30T14:59:04.302608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896925080589811:5974]
2025-09-30T14:59:04.302611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896925080589811:5974]
2025-09-30T14:59:04.302670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:04.302687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.302690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:04.302869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:04.304362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:04.304378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:04.304387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:04.326534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3113 sessionId: src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:04.330125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:04.335011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896925170391980:10551]
2025-09-30T14:59:04.335348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3112, pipe: [1:7555896925170391980:10551]
2025-09-30T14:59:04.424947Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:04.425319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.425336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.425376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170391980:10551], now have 1 active actors on pipe
2025-09-30T14:59:04.425901Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896925170391980:10551]
2025-09-30T14:59:04.425943Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:04.425985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:04.425995Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:04.426067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3113 reason: error at write: Disconnected sessionId: src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0
2025-09-30T14:59:04.426266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3113 sessionId: src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0 is DEAD
2025-09-30T14:59:04.426119Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:04.427559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:04.427572Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0] Write session will restart in 0.009283s
2025-09-30T14:59:04.427599Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0] Write session: Do CDS request
2025-09-30T14:59:04.427605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:04.437828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:04.439442Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:04.439465Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3114
2025-09-30T14:59:04.439700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3114 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:04.439736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3114 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:04.439742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3114 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:04.439747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:04.440305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3114 sessionId:  describe result for acl check
2025-09-30T14:59:04.440350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:04.440352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:04.440354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:04.440360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896925170392010:10457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:04.440992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896925170392010:10457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:04.451387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896925170392010:10457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:04.458952Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896925170392010:10457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:04.458977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896925170392010:10457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:04.458982Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896925170392010:10457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:04.458991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3114 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:04.459722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:04.462270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:04.462524Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:04.462529Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:04.462541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:04.462593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:04.462643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896925080590034:5957]
2025-09-30T14:59:04.463356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:04.463695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:04.463741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:04.464342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:04.464445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.464446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.464448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.464449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.464450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.464452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.464453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.464455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.464456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.464458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.464459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.464461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.464462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.464463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.464464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.464470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.464482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.464486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.464491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.464495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.464500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.464504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.464508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.464512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.464517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.464521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.464525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.464529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.464533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.464537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.464552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.464563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.464569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.464575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.464582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.464587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.464593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.464597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.464603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.464608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.464612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.464618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.464623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.464640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.464645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.464656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.464662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.464668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.464673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.464678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.464683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.464689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.464693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.464698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.464703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.464708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.464713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.464719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.464724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.464729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.464775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:04.476067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:04.478859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3113
2025-09-30T14:59:04.477235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:04.478905Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3113
2025-09-30T14:59:04.477242Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:04.477245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:04.477249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:04.477259Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3113 [2:7555896925080590034:5957]
2025-09-30T14:59:04.477279Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:04.477296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:04.477300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:04.477304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:04.477307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:04.477325Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:04.477333Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:04.477340Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:04.477418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.477420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.477423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.477427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:04.477430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:04.477507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:04.477510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.477525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.477537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.477556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:04.477575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896925080590029:5957]
2025-09-30T14:59:04.477578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896925080590029:5957]
2025-09-30T14:59:04.477581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896925080590029:5957]
2025-09-30T14:59:04.477595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:04.477610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:04.477629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:04.477632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:04.477673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896925080590029:5957]
2025-09-30T14:59:04.477675Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:04.478444Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:04.478448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:04.478449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:04.478455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:04.479145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170392185:10457], now have 1 active actors on pipe
2025-09-30T14:59:04.479152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170391985:2454], now have 1 active actors on pipe
2025-09-30T14:59:04.479329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.479339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.479382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:04.479393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:04.479397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:04.479400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:04.479413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:04.479429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:04.479452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:04.479671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.479688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.479706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:04.479825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3114 partition: 0 MaxSeqNo: 42 sessionId: src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0
2025-09-30T14:59:04.480373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b16d19da-7902edc-75ec3dd-1cd1ce4f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:04.483600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0] Write session: try to update token
2025-09-30T14:59:04.483628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:04.499848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:04.499877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:04.499880Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:04.499882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:04.499894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896925080590029:5957]
2025-09-30T14:59:04.499901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896925080590029:5957]
2025-09-30T14:59:04.499906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896925080590029:5957]
2025-09-30T14:59:04.499955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:04.499965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.499969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:04.500201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:04.500210Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:04.500229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:04.500239Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:04.510750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3114 sessionId: src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:04.514085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:04.526014Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896925170392212:10551]
2025-09-30T14:59:04.526333Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3113, pipe: [1:7555896925170392212:10551]
2025-09-30T14:59:04.627094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:04.627857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.627871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.627892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170392212:10551], now have 1 active actors on pipe
2025-09-30T14:59:04.628917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:04.628934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:04.628991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3114 reason: error at write: Disconnected sessionId: src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0
2025-09-30T14:59:04.629206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3114 sessionId: src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0 is DEAD
2025-09-30T14:59:04.629359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:04.629372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0] Write session will restart in 0.008663s
2025-09-30T14:59:04.629397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0] Write session: Do CDS request
2025-09-30T14:59:04.629403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:04.629661Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:04.629386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896925170392212:10551]
2025-09-30T14:59:04.629412Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:04.638850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:04.638958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:04.638983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3115
2025-09-30T14:59:04.639286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3115 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:04.639326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3115 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:04.639331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3115 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:04.639335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:04.639771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3115 sessionId:  describe result for acl check
2025-09-30T14:59:04.639805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:04.639808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:04.639810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:04.639816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896925170392230:10441] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:04.640409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896925170392230:10441] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:04.643483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896925170392230:10441] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:04.647959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896925170392230:10441] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:04.647980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896925170392230:10441] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:04.647983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896925170392230:10441] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:04.647990Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3115 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:04.670044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:04.673034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:04.673423Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:04.673439Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:04.673455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:04.673531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:04.673574Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896925080590278:5936]
2025-09-30T14:59:04.674236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:04.674673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:04.674737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:04.675129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:04.675201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.675208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.675209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.675211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.675213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.675214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.675215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.675217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.675218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.675220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.675221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.675222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.675224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.675225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.675226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.675233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.675256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.675261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.675265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.675270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.675274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.675278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.675283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.675287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.675291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.675294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.675298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.675302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.675305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.675309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.675319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.675327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.675334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.675341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.675350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.675356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.675369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.675374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.675379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.675394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.675404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.675410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.675421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.675432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.675437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.675448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.675458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.675464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.675474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.675480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.675490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.675495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.675505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.675511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.675521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.675527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.675537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.675542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.675548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.675554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.675605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:04.682846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:04.683860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:04.683880Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:04.683883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:04.683888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:04.683896Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3114 [2:7555896925080590278:5936]
2025-09-30T14:59:04.683915Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:04.683932Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:04.683937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:04.683942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:04.683950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:04.683966Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:04.683980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:04.683992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:04.684066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.684076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.684078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.684082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:04.684084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:04.684167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:04.684177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.684192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.684215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.684235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:04.684255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170392223:2454], now have 1 active actors on pipe
2025-09-30T14:59:04.684259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170392265:10441], now have 1 active actors on pipe
2025-09-30T14:59:04.684266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896925080590273:5936]
2025-09-30T14:59:04.684268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896925080590273:5936]
2025-09-30T14:59:04.684271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896925080590273:5936]
2025-09-30T14:59:04.684344Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3114
2025-09-30T14:59:04.684392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3114
2025-09-30T14:59:04.684285Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:04.684302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:04.684307Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:04.684309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:04.684312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:04.684318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:04.684321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:04.684357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896925080590273:5936]
2025-09-30T14:59:04.684364Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:04.684369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:04.684929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.684943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.684966Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:04.684976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:04.684980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:04.684981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:04.684991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:04.685005Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:04.685020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:04.686625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3115 partition: 0 MaxSeqNo: 42 sessionId: src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0
2025-09-30T14:59:04.686038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.686049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.686070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:04.687749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47730e2f-5d689d0e-b9ca7480-d96acc04_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:04.690631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0] Write session: try to update token
2025-09-30T14:59:04.690650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:04.699935Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:04.699955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:04.699958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:04.699960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:04.699971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896925080590273:5936]
2025-09-30T14:59:04.699975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896925080590273:5936]
2025-09-30T14:59:04.699985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896925080590273:5936]
2025-09-30T14:59:04.700033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:04.700041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.700044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:04.700116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:04.700131Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:04.700136Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:04.700220Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:04.709506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3115 sessionId: src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:04.712516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:04.729794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896925170392450:10551]
2025-09-30T14:59:04.730082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3114, pipe: [1:7555896925170392450:10551]
2025-09-30T14:59:04.818973Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:04.819552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.819574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.819597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170392450:10551], now have 1 active actors on pipe
2025-09-30T14:59:04.820368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:04.820381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0] Write session will restart in 0.005161s
2025-09-30T14:59:04.819804Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:04.819875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:04.819879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:04.819916Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896925170392450:10551]
2025-09-30T14:59:04.820408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0] Write session: Do CDS request
2025-09-30T14:59:04.820415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:04.819945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3115 reason: error at write: Disconnected sessionId: src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0
2025-09-30T14:59:04.820171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3115 sessionId: src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0 is DEAD
2025-09-30T14:59:04.819863Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:04.826793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:04.826866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:04.826886Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3116
2025-09-30T14:59:04.827034Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3116 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:04.827070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3116 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:04.827079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3116 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:04.827084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:04.827546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3116 sessionId:  describe result for acl check
2025-09-30T14:59:04.827581Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:04.827588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:04.827591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:04.827597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896925170392470:10431] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:04.828197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896925170392470:10431] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:04.830842Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896925170392470:10431] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:04.836439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896925170392470:10431] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:04.836468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896925170392470:10431] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:04.836473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896925170392470:10431] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:04.836483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3116 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:04.848224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:04.851526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:04.851780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:04.851793Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:04.851807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:04.851897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:04.851950Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896925080590485:5930]
2025-09-30T14:59:04.852686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:04.853080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:04.853145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:04.853549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:04.853631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.853638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.853639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.853640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.853642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.853643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.853645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.853646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.853647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.853648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.853650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.853651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.853653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.853654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.853656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.853662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.853675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.853679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.853684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.853688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.853693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.853697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.853714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.853718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.853723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.853727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.853731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.853734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.853737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.853741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.853750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.853759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:04.853766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.853773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:04.853778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.853783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:04.853788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.853794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:04.853800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.853806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:04.853810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.853815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:04.853821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.853826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:04.853830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.853836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:04.853842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.853857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:04.853862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.853867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:04.853873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.853879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.853884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.853889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.853895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.853901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.853905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.853911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:04.853916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.853922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:04.853967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:04.860171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:04.861490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:04.861514Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:04.861518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:04.861522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:04.861531Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3115 [2:7555896925080590485:5930]
2025-09-30T14:59:04.861551Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:04.861571Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:04.861580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:04.861584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:04.861587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:04.861605Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:04.861618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:04.861625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:04.861701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.861709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.861712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.861715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:04.861718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:04.861795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:04.861808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.861823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:04.861839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:04.861860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:04.861881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170392537:10431], now have 1 active actors on pipe
2025-09-30T14:59:04.861891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170392454:2454], now have 1 active actors on pipe
2025-09-30T14:59:04.861898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896925080590480:5930]
2025-09-30T14:59:04.861901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896925080590480:5930]
2025-09-30T14:59:04.861904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896925080590480:5930]
2025-09-30T14:59:04.861919Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:04.861944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:04.861966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:04.861976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:04.862016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896925080590480:5930]
2025-09-30T14:59:04.862025Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:04.862027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3115
2025-09-30T14:59:04.862082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3115
2025-09-30T14:59:04.862080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:04.862091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:04.862094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:04.862102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:04.862191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.862205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.862250Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:04.862279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:04.862285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:04.862287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:04.862302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:04.862318Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:04.862342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:04.862510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.862518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.862531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:04.862658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3116 partition: 0 MaxSeqNo: 42 sessionId: src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0
2025-09-30T14:59:04.863085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|144dc373-3fb0445c-7845b825-76d1a2c2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:04.866185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0] Write session: try to update token
2025-09-30T14:59:04.866215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:04.883731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3116 sessionId: src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:04.884368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:04.884386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:04.884396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896925080590480:5930]
2025-09-30T14:59:04.884456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:04.884478Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:04.884673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:04.884833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:04.885015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:04.885203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:04.885455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:04.885510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:04.886661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:04.887266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:04.887097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:04.887116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:04.887151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:04.889162Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:04.889168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:04.889171Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:04.889174Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:04.889182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896925080590480:5930]
2025-09-30T14:59:04.889187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896925080590480:5930]
2025-09-30T14:59:04.889191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896925080590480:5930]
2025-09-30T14:59:04.889237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:04.889245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:04.889247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:04.889254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:04.889261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:04.889269Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:04.889400Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:04.920267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896925170392670:10551]
2025-09-30T14:59:04.920780Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3115, pipe: [1:7555896925170392670:10551]
2025-09-30T14:59:05.030798Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:05.041587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.041613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.041788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:05.041853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:05.041922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:05.041989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:05.042381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:05.042391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:05.042474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:05.042548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:05.042617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:05.042692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:05.042746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:05.042759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:05.042829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:05.042891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:05.042956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:05.043023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:05.043070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:05.043076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:05.043146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:05.043217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:05.043315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:05.043413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:05.043474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:05.043480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:05.043557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:05.043633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:05.043702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:05.043777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:05.043827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:05.043834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:05.043910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:05.043982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:05.044052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:05.044127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:05.044183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:05.044191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:05.044268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:05.044337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:05.044409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:05.044485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:05.044535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:05.044542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:05.044636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:05.044718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:05.044795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:05.044867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:05.044942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:05.044951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:05.045026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:05.046487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:05.046501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0] Write session will restart in 0.006387s
2025-09-30T14:59:05.046527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0] Write session: Do CDS request
2025-09-30T14:59:05.046533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:05.045091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:05.045166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:05.045228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:05.045287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:05.045289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:05.045366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:05.045430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:05.045492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:05.045570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:05.045625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:05.045631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:05.045700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896925170392670:10551], now have 1 active actors on pipe
2025-09-30T14:59:05.046582Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:05.046049Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:05.046054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896925170392670:10551]
2025-09-30T14:59:05.046085Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:05.046088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:05.046118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3116 reason: error at write: Disconnected sessionId: src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0
2025-09-30T14:59:05.046315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3116 sessionId: src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0 is DEAD
2025-09-30T14:59:05.055739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:05.055921Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:05.055944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3117
2025-09-30T14:59:05.056118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3117 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:05.056176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3117 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:05.056182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3117 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:05.056187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:05.061968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3117 sessionId:  describe result for acl check
2025-09-30T14:59:05.062022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:05.062024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:05.062026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:05.062033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896929465359977:10425] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:05.062676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896929465359977:10425] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:05.070289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896929465359977:10425] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:05.076572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896929465359977:10425] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:05.076597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896929465359977:10425] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:05.076604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896929465359977:10425] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:05.076612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3117 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:05.083862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:05.086714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:05.086954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:05.086965Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:05.086976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:05.087031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:05.087072Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896929375557990:5934]
2025-09-30T14:59:05.087822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:05.088208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:05.088261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:05.088667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:05.088731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.088736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.088738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.088739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.088740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.088742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.088743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.088744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.088746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.088747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.088748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.088750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.088751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.088753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.088754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.088760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.088770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.088775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.088779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.088783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.088787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.088791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.088795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.088799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.088804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.088808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.088812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.088816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.088820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.088825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.088834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.088843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.088849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.088861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.088868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.088878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.088882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.088888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.088893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.088899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.088904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.088917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.088921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.088927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.088936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.088941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.088951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.088956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.088965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.088971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.088982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.088988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.088996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.089002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.089008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.089014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.089018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.089027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.089032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.089037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.089084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:05.095022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:05.096333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:05.096350Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:05.096354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:05.096358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:05.096365Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3116 [2:7555896929375557990:5934]
2025-09-30T14:59:05.096381Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:05.096396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:05.096398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:05.096414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:05.096416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:05.096436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:05.096448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:05.096455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:05.096524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.096530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.096533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.096536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:05.096539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:05.096610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:05.096623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.097272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3116
2025-09-30T14:59:05.097331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3116
2025-09-30T14:59:05.096653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.096670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.096685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:05.096709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896929375557985:5934]
2025-09-30T14:59:05.096711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896929375557985:5934]
2025-09-30T14:59:05.096713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896929375557985:5934]
2025-09-30T14:59:05.096729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:05.096745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465359969:2454], now have 1 active actors on pipe
2025-09-30T14:59:05.096748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:05.096750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465360067:10425], now have 1 active actors on pipe
2025-09-30T14:59:05.096751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:05.096754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:05.096758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:05.096773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:05.096777Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:05.096818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896929375557985:5934]
2025-09-30T14:59:05.096827Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:05.096855Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:05.097519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.097527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.097570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:05.097580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:05.097585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:05.097588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:05.097598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:05.097611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:05.097630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:05.097910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.097921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.097935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:05.098060Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3117 partition: 0 MaxSeqNo: 42 sessionId: src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0
2025-09-30T14:59:05.098648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dab9f2d4-c0db5238-4aae1c9b-a806f09b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:05.101662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0] Write session: try to update token
2025-09-30T14:59:05.101686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:05.109653Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:05.109673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:05.109684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896929375557985:5934]
2025-09-30T14:59:05.109740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:05.109935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:05.110094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:05.110251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:05.110402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:05.110619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:05.110670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:05.112233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:05.129771Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:05.129794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:05.129797Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:05.129799Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:05.129812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896929375557985:5934]
2025-09-30T14:59:05.129817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896929375557985:5934]
2025-09-30T14:59:05.129822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896929375557985:5934]
2025-09-30T14:59:05.129864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:05.129872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.129874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:05.130044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:05.130260Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:05.130279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:05.130283Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:05.133201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3117 sessionId: src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:05.136499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:05.151319Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896929465360185:10551]
2025-09-30T14:59:05.157136Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3116, pipe: [1:7555896929465360185:10551]
2025-09-30T14:59:05.247501Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:05.247895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.247908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.247932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465360185:10551], now have 1 active actors on pipe
2025-09-30T14:59:05.248295Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:05.248752Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:05.248744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896929465360185:10551]
2025-09-30T14:59:05.248780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:05.248782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:05.248897Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3117 reason: error at write: Disconnected sessionId: src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0
2025-09-30T14:59:05.249079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3117 sessionId: src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0 is DEAD
2025-09-30T14:59:05.249440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:05.249452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0] Write session will restart in 0.007719s
2025-09-30T14:59:05.249477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0] Write session: Do CDS request
2025-09-30T14:59:05.249487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:05.258823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:05.259582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:05.259604Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3118
2025-09-30T14:59:05.263391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3118 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:05.263466Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3118 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:05.263477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3118 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:05.263482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:05.264039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3118 sessionId:  describe result for acl check
2025-09-30T14:59:05.264081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:05.264096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:05.264097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:05.264103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896929465360246:10422] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:05.264724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896929465360246:10422] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:05.268470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896929465360246:10422] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:05.271858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896929465360246:10422] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:05.271879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896929465360246:10422] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:05.271882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896929465360246:10422] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:05.271891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3118 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:05.272656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:05.275459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:05.275875Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:05.275888Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:05.275902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:05.275989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:05.276038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896929375558202:5928]
2025-09-30T14:59:05.276791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:05.277279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:05.277343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:05.277731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:05.277830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.277839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.277840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.277842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.277843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.277845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.277846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.277847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.277849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.277850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.277852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.277853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.277854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.277856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.277858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.277864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.277882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.277888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.277893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.277898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.277903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.277907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.277911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.277916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.277921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.277925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.277929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.277933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.277938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.277942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.277954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.277964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.277971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.277978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.277983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.277990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.277995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.278001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.278009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.278015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.278020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.278025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.278029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.278035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.278040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.278045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.278051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.278057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.278061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.278066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.278071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.278077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.278085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.278099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.278103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.278109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.278119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.278124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.278129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.278135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.278185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:05.284114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:05.285373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:05.285391Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:05.285394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:05.285398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:05.285405Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3117 [2:7555896929375558202:5928]
2025-09-30T14:59:05.285423Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:05.285440Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:05.285444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:05.285447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:05.285449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:05.285466Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:05.285473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:05.285479Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:05.285541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.285552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.285554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.285558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:05.285561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:05.285630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:05.285633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.285647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.285659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.285675Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:05.285692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896929375558196:5928]
2025-09-30T14:59:05.285695Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896929375558196:5928]
2025-09-30T14:59:05.285697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896929375558196:5928]
2025-09-30T14:59:05.285706Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:05.285726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:05.285742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:05.285744Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:05.285746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:05.285751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:05.285754Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:05.285778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896929375558196:5928]
2025-09-30T14:59:05.285782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:05.285792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:05.285822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465360391:10422], now have 1 active actors on pipe
2025-09-30T14:59:05.285831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465360188:2454], now have 1 active actors on pipe
2025-09-30T14:59:05.286240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.286254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.286286Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:05.286299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:05.286303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:05.286306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:05.286317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:05.286337Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:05.286354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:05.286563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.286570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.286582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:05.287053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a0b5cb75-a62953cc-61414d61-84e7992c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:05.285948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3117
2025-09-30T14:59:05.285956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3117
2025-09-30T14:59:05.286684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3118 partition: 0 MaxSeqNo: 42 sessionId: src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0
2025-09-30T14:59:05.290201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0] Write session: try to update token
2025-09-30T14:59:05.290224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:05.298754Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:05.298777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:05.298790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896929375558196:5928]
2025-09-30T14:59:05.298839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:05.298839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:05.299045Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:05.299221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:05.299413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:05.299590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:05.299814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:05.299863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:05.310478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:05.310502Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:05.310505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:05.310507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:05.310518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896929375558196:5928]
2025-09-30T14:59:05.310524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896929375558196:5928]
2025-09-30T14:59:05.310529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896929375558196:5928]
2025-09-30T14:59:05.310578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:05.310585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.310587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:05.310594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:05.310601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:05.310606Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:05.310744Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:05.318081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3118 sessionId: src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:05.321423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:05.348305Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896929465360411:10551]
2025-09-30T14:59:05.351600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3117, pipe: [1:7555896929465360411:10551]
2025-09-30T14:59:05.444203Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:05.444578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.444597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.444617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465360411:10551], now have 1 active actors on pipe
2025-09-30T14:59:05.444866Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:05.444860Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896929465360411:10551]
2025-09-30T14:59:05.444884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:05.444890Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:05.444896Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:05.444956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3118 reason: error at write: Disconnected sessionId: src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0
2025-09-30T14:59:05.445153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3118 sessionId: src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0 is DEAD
2025-09-30T14:59:05.445462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:05.445472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0] Write session will restart in 0.005067s
2025-09-30T14:59:05.445495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0] Write session: Do CDS request
2025-09-30T14:59:05.445504Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:05.451809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:05.451875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:05.451899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3119
2025-09-30T14:59:05.452149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3119 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:05.452235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3119 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:05.452271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3119 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:05.452285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:05.452811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3119 sessionId:  describe result for acl check
2025-09-30T14:59:05.452872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:05.452874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:05.452877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:05.452883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896929465360431:10416] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:05.453443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896929465360431:10416] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:05.456907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896929465360431:10416] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:05.461455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896929465360431:10416] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:05.461478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896929465360431:10416] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:05.461482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896929465360431:10416] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:05.461493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3119 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:05.464618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:05.467390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:05.467902Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:05.467907Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:05.467922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:05.468014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:05.468058Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896929375558424:5921]
2025-09-30T14:59:05.468782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:05.469210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:05.469269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:05.469632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:05.469692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.469697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.469698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.469700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.469701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.469702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.469704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.469706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.469708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.469709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.469710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.469711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.469712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.469713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.469714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.469721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.469733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.469737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.469741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.469745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.469758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.469762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.469765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.469769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.469774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.469778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.469782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.469787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.469791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.469796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.469806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.469822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.469830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.469836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.469844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.469850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.469855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.469862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.469868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.469874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.469879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.469885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.469892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.469899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.469904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.469923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.469929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.469942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.469948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.469956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.469962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.469972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.469979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.469989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.469995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.470004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.470011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.470018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.470032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.470046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.470105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:05.476538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:05.477570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:05.477586Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:05.477589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:05.477593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:05.477602Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3118 [2:7555896929375558424:5921]
2025-09-30T14:59:05.477620Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:05.477638Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:05.477641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:05.477645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:05.477648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:05.477664Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:05.477673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:05.477680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:05.477744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.477755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.477758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.477761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:05.477764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:05.477840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:05.477849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.477861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.477872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.477888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:05.477907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896929375558419:5921]
2025-09-30T14:59:05.477915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896929375558419:5921]
2025-09-30T14:59:05.477918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896929375558419:5921]
2025-09-30T14:59:05.477928Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:05.477938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:05.477942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:05.477944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:05.477949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465360416:2454], now have 1 active actors on pipe
2025-09-30T14:59:05.477958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:05.477974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:05.477984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:05.477990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465360596:10416], now have 1 active actors on pipe
2025-09-30T14:59:05.478028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896929375558419:5921]
2025-09-30T14:59:05.478042Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:05.478057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:05.481112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3118
2025-09-30T14:59:05.481113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3118
2025-09-30T14:59:05.481244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.481262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.481294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:05.481310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:05.481315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:05.481319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:05.481350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:05.481370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:05.481393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:05.481580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.481591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.481609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:05.481715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3119 partition: 0 MaxSeqNo: 42 sessionId: src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0
2025-09-30T14:59:05.482151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f92afdd3-c5c41102-d45ffe18-48a28915_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:05.485431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0] Write session: try to update token
2025-09-30T14:59:05.485453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:05.493849Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:05.493865Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:05.493867Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:05.493870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:05.493881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896929375558419:5921]
2025-09-30T14:59:05.493886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896929375558419:5921]
2025-09-30T14:59:05.493890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896929375558419:5921]
2025-09-30T14:59:05.493929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:05.493932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:05.493934Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:05.493938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:05.493940Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.493943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:05.494092Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:05.501881Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3119 sessionId: src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:05.504958Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:05.546005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896929465360635:10551]
2025-09-30T14:59:05.546373Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3118, pipe: [1:7555896929465360635:10551]
2025-09-30T14:59:05.613242Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:05.614828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.614852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.614872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465360635:10551], now have 1 active actors on pipe
2025-09-30T14:59:05.615156Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:05.616084Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:05.616134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:05.616216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3119 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0
2025-09-30T14:59:05.616422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3119 sessionId: src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0 is DEAD
2025-09-30T14:59:05.617170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896929465360635:10551]
2025-09-30T14:59:05.619513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:05.619533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0] Write session will restart in 0.009643s
2025-09-30T14:59:05.619561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0] Write session: Do CDS request
2025-09-30T14:59:05.619568Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:05.635703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:05.636051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:05.636073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3120
2025-09-30T14:59:05.636463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3120 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:05.636521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3120 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:05.636533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3120 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:05.636539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:05.637543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3120 sessionId:  describe result for acl check
2025-09-30T14:59:05.637592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:05.637599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:05.637602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:05.637609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896929465360748:10399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:05.638223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896929465360748:10399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:05.641671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896929465360748:10399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:05.646693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896929465360748:10399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:05.646717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896929465360748:10399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:05.646721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896929465360748:10399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:05.646730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3120 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:05.649491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:05.652537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:05.652827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:05.652839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:05.652851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:05.652911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:05.653093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896929375558672:5903]
2025-09-30T14:59:05.653798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:05.654206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:05.654277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:05.654652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:05.654720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.654722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.654723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.654724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.654726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.654727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.654728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.654730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.654731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.654732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.654734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.654735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.654736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.654737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.654739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.654753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.654765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.654770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.654775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.654779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.654784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.654788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.654792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.654797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.654802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.654806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.654810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.654814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.654818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.654822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.654832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.654841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.654847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.654852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.654862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.654867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.654871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.654877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.654883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.654888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.654893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.654899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.654906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.654912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.654916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.654922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.654927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.654933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.654938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.654946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.654951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.654957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.654961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.654966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.654971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.654977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.654982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.654987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.654992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.654997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.655043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:05.662225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:05.663626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:05.663649Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:05.663652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:05.663656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:05.663664Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3119 [2:7555896929375558672:5903]
2025-09-30T14:59:05.663689Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:05.663709Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:05.663713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:05.663717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:05.663720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:05.663737Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:05.663757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:05.663766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:05.663839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.663848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.663850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.663854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:05.663856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:05.663934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:05.663944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.663960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.663972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.663992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:05.664014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465360660:2454], now have 1 active actors on pipe
2025-09-30T14:59:05.664022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896929375558667:5903]
2025-09-30T14:59:05.664025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896929375558667:5903]
2025-09-30T14:59:05.664028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896929375558667:5903]
2025-09-30T14:59:05.664044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:05.664055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465360861:10399], now have 1 active actors on pipe
2025-09-30T14:59:05.664060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:05.664063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:05.664064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:05.664066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:05.664080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:05.664084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:05.664202Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3119
2025-09-30T14:59:05.664282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3119
2025-09-30T14:59:05.664128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896929375558667:5903]
2025-09-30T14:59:05.664142Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:05.664213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:05.664448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.664467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.664497Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:05.664509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:05.664518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:05.664521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:05.664534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:05.664548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:05.664567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:05.664962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.664975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.665000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:05.666227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3120 partition: 0 MaxSeqNo: 42 sessionId: src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0
2025-09-30T14:59:05.666663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad7c60ed-1d57c1b0-fd47c115-56a5c87c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:05.670091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0] Write session: try to update token
2025-09-30T14:59:05.670116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:05.680953Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:05.680976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:05.680979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:05.680982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:05.680993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896929375558667:5903]
2025-09-30T14:59:05.680997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896929375558667:5903]
2025-09-30T14:59:05.681006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896929375558667:5903]
2025-09-30T14:59:05.681053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:05.681061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.681064Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:05.681066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:05.681074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:05.681088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:05.681219Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:05.691497Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3120 sessionId: src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:05.694643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:05.719468Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896929465360889:10551]
2025-09-30T14:59:05.719785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3119, pipe: [1:7555896929465360889:10551]
2025-09-30T14:59:05.815982Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:05.816510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.816528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.816549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465360889:10551], now have 1 active actors on pipe
2025-09-30T14:59:05.816800Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:05.816967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:05.817068Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3120 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0
2025-09-30T14:59:05.817286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3120 sessionId: src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0 is DEAD
2025-09-30T14:59:05.817422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896929465360889:10551]
2025-09-30T14:59:05.817470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:05.817469Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:05.817495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0] Write session will restart in 0.008269s
2025-09-30T14:59:05.817521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0] Write session: Do CDS request
2025-09-30T14:59:05.817527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:05.826873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:05.827001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:05.827023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3121
2025-09-30T14:59:05.827152Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3121 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:05.827188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3121 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:05.827199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3121 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:05.827212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:05.827736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3121 sessionId:  describe result for acl check
2025-09-30T14:59:05.827787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:05.827795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:05.827797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:05.827806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896929465360908:10394] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:05.828445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896929465360908:10394] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:05.833200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896929465360908:10394] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:05.836984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896929465360908:10394] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:05.837008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896929465360908:10394] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:05.837012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896929465360908:10394] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:05.837021Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3121 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:05.841109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:05.841765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:05.841947Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:05.841956Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:05.841967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:05.842019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:05.842062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896929375558883:5902]
2025-09-30T14:59:05.842712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:05.844054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:05.844109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:05.844466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:05.844542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.844549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.844550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.844551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.844553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.844554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.844555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.844556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.844557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.844558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.844559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.844560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.844562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.844563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.844564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.844570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.844581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.844585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.844589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.844593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.844596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.844600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.844604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.844615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.844633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.844637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.844641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.844645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.844648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.844652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.844663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.844672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:05.844678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.844684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:05.844689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.844695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:05.844699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.844705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:05.844710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.844716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:05.844721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.844726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:05.844734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.844739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:05.844749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.844756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:05.844763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.844776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:05.844781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.844787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:05.844796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.844803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.844812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.844817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.844827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.844832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.844836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.844847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:05.844851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.844856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:05.844898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:05.850644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:05.852063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:05.852082Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:05.852085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:05.852090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:05.852097Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3120 [2:7555896929375558883:5902]
2025-09-30T14:59:05.852117Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:05.852133Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:05.852137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:05.852141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:05.852144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:05.852162Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:05.852170Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:05.852177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:05.852250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.852263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.852266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.852270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:05.852273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:05.852345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:05.852352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.852367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:05.852385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:05.852402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:05.852425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465361063:10394], now have 1 active actors on pipe
2025-09-30T14:59:05.852436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465360893:2454], now have 1 active actors on pipe
2025-09-30T14:59:05.852443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896929375558878:5902]
2025-09-30T14:59:05.852445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896929375558878:5902]
2025-09-30T14:59:05.852447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896929375558878:5902]
2025-09-30T14:59:05.852461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:05.852472Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:05.852476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:05.852476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:05.852478Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:05.852491Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:05.852494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:05.852507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3120
2025-09-30T14:59:05.852538Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3120
2025-09-30T14:59:05.852531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896929375558878:5902]
2025-09-30T14:59:05.852541Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:05.852543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:05.852559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.852565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.852636Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:05.852644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:05.852654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:05.852656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:05.852667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:05.852677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:05.852704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:05.852938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.852947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.852961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:05.853078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3121 partition: 0 MaxSeqNo: 42 sessionId: src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0
2025-09-30T14:59:05.853467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ef0ecaf3-6abae4c1-65e5f7e2-f736b94f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:05.856429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0] Write session: try to update token
2025-09-30T14:59:05.856447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:05.865552Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:05.865571Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:05.865574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:05.865576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:05.865589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896929375558878:5902]
2025-09-30T14:59:05.865594Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896929375558878:5902]
2025-09-30T14:59:05.865598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896929375558878:5902]
2025-09-30T14:59:05.865642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:05.865643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:05.865649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:05.865650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:05.865653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:05.865653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:05.865816Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:05.872242Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3121 sessionId: src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:05.875199Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:05.917118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896929465361114:10551]
2025-09-30T14:59:05.917434Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3120, pipe: [1:7555896929465361114:10551]
2025-09-30T14:59:05.983501Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:05.984083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:05.984103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:05.984128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465361114:10551], now have 1 active actors on pipe
2025-09-30T14:59:05.984397Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:05.984440Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896929465361114:10551]
2025-09-30T14:59:05.984454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:05.984543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3121 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0
2025-09-30T14:59:05.984723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3121 sessionId: src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0 is DEAD
2025-09-30T14:59:05.984392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:05.984873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:05.984884Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0] Write session will restart in 0.009122s
2025-09-30T14:59:05.984908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0] Write session: Do CDS request
2025-09-30T14:59:05.984915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:05.994832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:05.994952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:05.994975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3122
2025-09-30T14:59:05.995106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3122 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:05.995143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3122 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:05.995150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3122 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:05.995160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:05.996171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3122 sessionId:  describe result for acl check
2025-09-30T14:59:05.996208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:05.996224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:05.996226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:05.996232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896929465361178:10385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:05.996801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896929465361178:10385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:05.999564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896929465361178:10385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:06.002482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896929465361178:10385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:06.002504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896929465361178:10385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:06.002508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896929465361178:10385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:06.002523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3122 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:06.002927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:06.005391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:06.005632Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:06.005643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:06.005653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:06.005713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:06.005770Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896933670526391:5896]
2025-09-30T14:59:06.006476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:06.006866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:06.006935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:06.007215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:06.007292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.007297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.007298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.007299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.007300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.007301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.007301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.007302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.007303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.007304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.007305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.007306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.007307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.007307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.007309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.007315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.007325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.007330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.007335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.007345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.007355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.007358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.007361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.007367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.007371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.007373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.007376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.007378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.007381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.007383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.007391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.007396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.007401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.007405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.007408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.007411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.007414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.007417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.007420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.007423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.007428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.007434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.007439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.007445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.007449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.007454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.007458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.007463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.007467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.007472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.007477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.007482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.007487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.007493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.007498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.007504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.007509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.007515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.007522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.007527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.007574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:06.013554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:06.014530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:06.014549Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:06.014551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:06.014556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:06.014564Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3121 [2:7555896933670526391:5896]
2025-09-30T14:59:06.014585Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:06.014604Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:06.014608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:06.014612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:06.014615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:06.014635Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:06.014648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:06.014662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:06.014731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.014738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.014741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.014745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:06.014748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:06.014820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:06.014828Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.014842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.014857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.014880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:06.014912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760328621:10385], now have 1 active actors on pipe
2025-09-30T14:59:06.014922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896929465361115:2454], now have 1 active actors on pipe
2025-09-30T14:59:06.014930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896933670526386:5896]
2025-09-30T14:59:06.014932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896933670526386:5896]
2025-09-30T14:59:06.014935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896933670526386:5896]
2025-09-30T14:59:06.014949Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:06.014966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:06.014970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:06.014976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:06.014979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:06.014988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:06.014992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:06.015031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896933670526386:5896]
2025-09-30T14:59:06.015040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:06.015043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:06.015011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3121
2025-09-30T14:59:06.015058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3121
2025-09-30T14:59:06.015080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.015089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.015118Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:06.015130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:06.015138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:06.015141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:06.015152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:06.015167Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:06.015186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:06.015383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.015395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.015410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:06.015494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3122 partition: 0 MaxSeqNo: 42 sessionId: src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0
2025-09-30T14:59:06.015929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c11a373-f8ce94a-d77dc268-2fac9813_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:06.019071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0] Write session: try to update token
2025-09-30T14:59:06.019098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:06.027554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:06.027572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:06.027583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896933670526386:5896]
2025-09-30T14:59:06.027633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:06.027642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:06.027840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:06.028008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:06.028165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:06.028319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:06.028549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:06.028596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:06.035578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3122 sessionId: src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:06.038560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:06.038806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.038832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.038872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:06.038992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:06.041912Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:06.041929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:06.041931Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:06.041933Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:06.041943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896933670526386:5896]
2025-09-30T14:59:06.041947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896933670526386:5896]
2025-09-30T14:59:06.041950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896933670526386:5896]
2025-09-30T14:59:06.041990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:06.041998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.042001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:06.042015Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:06.042023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:06.042028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:06.042167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:06.084571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896933760328633:10551]
2025-09-30T14:59:06.084898Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3121, pipe: [1:7555896933760328633:10551]
2025-09-30T14:59:06.155385Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:06.164245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.164276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.164472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.164560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.164646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.164727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.164777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.164783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.164863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.164930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.164998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.165067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.165119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.165122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.165198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.165259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.165331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.165401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.165445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.165448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.165522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.165591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.165660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.165727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.165771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.165774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.165848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.165913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.165991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.166058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.166100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.166104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.166181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.166252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.166318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.166396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.166443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.166447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.166524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.166586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.166655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.166721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.166841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.166844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.166918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.166987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.167051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.167117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.167158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.167161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.167236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.167552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.167634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.167708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.167784Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.167794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.167870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.167939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.168016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.168086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.168136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.168145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.168214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760328633:10551], now have 1 active actors on pipe
2025-09-30T14:59:06.169822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896933760328633:10551]
2025-09-30T14:59:06.169835Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:06.169840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:06.169867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:06.169870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3122 reason: error at write: Disconnected sessionId: src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0
2025-09-30T14:59:06.170078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3122 sessionId: src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0 is DEAD
2025-09-30T14:59:06.170182Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:06.170192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0] Write session will restart in 0.008672s
2025-09-30T14:59:06.170178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:06.170222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0] Write session: Do CDS request
2025-09-30T14:59:06.170229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:06.179797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:06.179843Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:06.179865Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3123
2025-09-30T14:59:06.180037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3123 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:06.180072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3123 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:06.180082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3123 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:06.180086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:06.180709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3123 sessionId:  describe result for acl check
2025-09-30T14:59:06.180755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:06.180762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:06.180765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:06.180772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896933760328697:10381] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:06.181341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896933760328697:10381] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:06.185621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896933760328697:10381] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:06.188699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:06.189493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896933760328697:10381] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:06.189515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896933760328697:10381] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:06.189518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896933760328697:10381] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:06.189527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3123 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:06.191413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:06.191649Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:06.191659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:06.191670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:06.191727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:06.191767Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896933670526606:5892]
2025-09-30T14:59:06.192440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:06.192764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:06.192821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:06.193156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:06.193227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.193234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.193235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.193237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.193239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.193240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.193241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.193243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.193244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.193245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.193247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.193248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.193250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.193251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.193252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.193258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.193268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.193273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.193277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.193281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.193285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.193289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.193294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.193298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.193302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.193307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.193311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.193315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.193319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.193324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.193331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.193339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.193345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.193352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.193360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.193369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.193374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.193380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.193385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.193392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.193398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.193404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.193410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.193415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.193419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.193425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.193431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.193437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.193441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.193448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.193462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.193468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.193477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.193488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.193499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.193505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.193510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.193520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.193524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.193530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.193575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:06.199284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:06.200348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:06.200365Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:06.200368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:06.200372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:06.200379Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3122 [2:7555896933670526606:5892]
2025-09-30T14:59:06.200397Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:06.200413Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:06.200416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:06.200419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:06.200422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:06.200439Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:06.200452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:06.200460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:06.200532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.200541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.200543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.200547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:06.200550Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:06.200635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:06.200645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.200659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.200672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.200690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:06.200714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760328636:2454], now have 1 active actors on pipe
2025-09-30T14:59:06.200723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760328847:10381], now have 1 active actors on pipe
2025-09-30T14:59:06.200731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896933670526600:5892]
2025-09-30T14:59:06.200733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896933670526600:5892]
2025-09-30T14:59:06.200736Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896933670526600:5892]
2025-09-30T14:59:06.200750Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:06.200765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:06.200768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:06.200775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:06.200778Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:06.200785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:06.200788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:06.200779Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3122
2025-09-30T14:59:06.200775Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3122
2025-09-30T14:59:06.200825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896933670526600:5892]
2025-09-30T14:59:06.200839Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:06.200845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:06.200860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.200864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.200913Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:06.200925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:06.200929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:06.200931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:06.200942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:06.200951Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:06.200977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:06.201147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.201156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.201169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:06.201259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3123 partition: 0 MaxSeqNo: 42 sessionId: src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0
2025-09-30T14:59:06.201639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fafcbb54-8651b643-8d3a5c11-1a190bc3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:06.204557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0] Write session: try to update token
2025-09-30T14:59:06.204577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:06.213926Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:06.213949Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:06.213952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:06.213954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:06.213966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896933670526600:5892]
2025-09-30T14:59:06.213971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896933670526600:5892]
2025-09-30T14:59:06.213975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896933670526600:5892]
2025-09-30T14:59:06.214022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:06.214029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.214033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:06.214078Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:06.214092Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:06.214096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:06.214185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:06.221859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3123 sessionId: src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:06.224917Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:06.269915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896933760328858:10551]
2025-09-30T14:59:06.270241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3122, pipe: [1:7555896933760328858:10551]
2025-09-30T14:59:06.331346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:06.332010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.332029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.332055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760328858:10551], now have 1 active actors on pipe
2025-09-30T14:59:06.332317Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:06.332317Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896933760328858:10551]
2025-09-30T14:59:06.332348Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:06.332383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:06.332390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:06.332454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3123 reason: error at write: Disconnected sessionId: src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0
2025-09-30T14:59:06.332699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3123 sessionId: src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0 is DEAD
2025-09-30T14:59:06.335533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:06.335549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0] Write session will restart in 0.008418s
2025-09-30T14:59:06.335576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0] Write session: Do CDS request
2025-09-30T14:59:06.335587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:06.344897Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:06.345011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:06.345034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3124
2025-09-30T14:59:06.348248Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3124 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:06.348311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3124 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:06.348320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3124 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:06.348326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:06.348792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3124 sessionId:  describe result for acl check
2025-09-30T14:59:06.348835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:06.348838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:06.348840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:06.348847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896933760328974:10374] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:06.349413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896933760328974:10374] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:06.354152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896933760328974:10374] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:06.356233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:06.358988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:06.359266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:06.359279Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:06.359294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:06.359302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896933760328974:10374] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:06.359325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896933760328974:10374] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:06.359329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896933760328974:10374] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:06.359339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3124 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:06.359366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:06.359417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896933670526819:5886]
2025-09-30T14:59:06.360092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:06.360477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:06.360533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:06.360906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:06.360995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.361002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.361003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.361004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.361006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.361008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.361009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.361011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.361013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.361014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.361015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.361017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.361018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.361020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.361021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.361028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.361040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.361044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.361049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.361054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.361058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.361063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.361067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.361072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.361077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.361082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.361086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.361091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.361095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.361099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.361110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.361119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.361128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.361139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.361146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.361156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.361161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.361172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.361178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.361184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.361194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.361200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.361219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.361232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.361238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.361248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.361254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.361264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.361270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.361276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.361288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.361294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.361304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.361309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.361320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.361330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.361335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.361347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.361352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.361361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.361413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:06.367997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:06.369063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:06.369082Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:06.369086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:06.369091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:06.369097Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3123 [2:7555896933670526819:5886]
2025-09-30T14:59:06.369117Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:06.369135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:06.369145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:06.369149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:06.369151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:06.369171Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:06.369183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:06.369191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:06.369263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.369271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.369274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.369278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:06.369281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:06.369352Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:06.369361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.369376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.369390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.369408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:06.369427Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896933670526814:5886]
2025-09-30T14:59:06.369430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896933670526814:5886]
2025-09-30T14:59:06.369433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896933670526814:5886]
2025-09-30T14:59:06.369442Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:06.369453Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:06.369457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:06.369459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:06.369464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760329077:10374], now have 1 active actors on pipe
2025-09-30T14:59:06.369470Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:06.369486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:06.369489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:06.369496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760328865:2454], now have 1 active actors on pipe
2025-09-30T14:59:06.369531Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896933670526814:5886]
2025-09-30T14:59:06.369538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:06.369556Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:06.369560Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3123
2025-09-30T14:59:06.369594Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3123
2025-09-30T14:59:06.369623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.369636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.369665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:06.369677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:06.369681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:06.369684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:06.369695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:06.369709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:06.369734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:06.369915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.369923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.369935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:06.370024Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3124 partition: 0 MaxSeqNo: 42 sessionId: src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0
2025-09-30T14:59:06.370484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b18d8d-382122c-d19acb2f-f31f34bd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:06.373675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0] Write session: try to update token
2025-09-30T14:59:06.373700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:06.382416Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:06.382437Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:06.382446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896933670526814:5886]
2025-09-30T14:59:06.382491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:06.382494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:06.382693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:06.382864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:06.383030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:06.383214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:06.383538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:06.383610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:06.390483Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3124 sessionId: src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:06.393576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:06.393833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.393861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.393901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:06.394008Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:06.400103Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:06.400130Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:06.400134Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:06.400136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:06.400151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896933670526814:5886]
2025-09-30T14:59:06.400157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896933670526814:5886]
2025-09-30T14:59:06.400162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896933670526814:5886]
2025-09-30T14:59:06.400207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:06.400222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.400231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:06.400254Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:06.400292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:06.400297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:06.400444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:06.432689Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896933760329092:10551]
2025-09-30T14:59:06.433027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3123, pipe: [1:7555896933760329092:10551]
2025-09-30T14:59:06.524776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:06.534847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.534883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.535096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.535164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.535237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.535435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.535508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.535525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.535610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.535684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.535761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.535840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.535901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.535911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.535993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.536069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.536160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.536250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.536616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.536639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.536720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.536795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.536867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.536944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.537004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.537013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.537098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.537177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.537262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.537345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.537398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.537412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.537505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.537585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.537666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.537739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.537787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.537806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.537894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.537967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.538041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.538118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.538167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.538179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.538253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.538325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.538396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.538467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.538518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.538526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.538599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.538668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.538741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.538817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.538877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.538885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.538964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:06.539035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:06.539124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:06.539206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:06.539276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:06.539285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:06.539365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760329092:10551], now have 1 active actors on pipe
2025-09-30T14:59:06.539638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896933760329092:10551]
2025-09-30T14:59:06.539642Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:06.539648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:06.539684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3124 reason: error at write: Disconnected sessionId: src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0
2025-09-30T14:59:06.539689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:06.539911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3124 sessionId: src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0 is DEAD
2025-09-30T14:59:06.540106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:06.540117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0] Write session will restart in 0.005158s
2025-09-30T14:59:06.540160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0] Write session: Do CDS request
2025-09-30T14:59:06.540167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:06.540568Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:06.546894Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:06.547062Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:06.547085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3125
2025-09-30T14:59:06.547288Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3125 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:06.547330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3125 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:06.547349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3125 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:06.547360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:06.547789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3125 sessionId:  describe result for acl check
2025-09-30T14:59:06.547826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:06.547828Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:06.547831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:06.547837Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896933760329110:10363] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:06.548395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896933760329110:10363] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:06.554594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896933760329110:10363] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:06.559231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896933760329110:10363] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:06.559272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896933760329110:10363] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:06.559276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896933760329110:10363] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:06.559286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3125 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:06.565557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:06.568395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:06.568646Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:06.568656Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:06.568667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:06.568724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:06.568771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896933670527048:5869]
2025-09-30T14:59:06.569435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:06.569798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:06.569845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:06.570169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:06.570244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.570250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.570251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.570252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.570253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.570254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.570255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.570257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.570258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.570259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.570260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.570262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.570264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.570265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.570265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.570271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.570281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.570285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.570288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.570291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.570295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.570299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.570302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.570306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.570310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.570313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.570316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.570320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.570323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.570327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.570334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.570341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.570351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.570357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.570361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.570366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.570370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.570375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.570380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.570384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.570388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.570392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.570397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.570402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.570406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.570411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.570416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.570421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.570425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.570430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.570434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.570438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.570444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.570449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.570454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.570459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.570464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.570483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.570489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.570506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.570549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:06.576491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:06.577755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:06.577774Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:06.577777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:06.577781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:06.577789Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3124 [2:7555896933670527048:5869]
2025-09-30T14:59:06.577807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:06.577824Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:06.577827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:06.577830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:06.577832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:06.577851Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:06.577857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:06.577865Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:06.577926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.577936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.577938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.577943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:06.577945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:06.578023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:06.578033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.578047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.578059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.578074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:06.578092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896933670527043:5869]
2025-09-30T14:59:06.578094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896933670527043:5869]
2025-09-30T14:59:06.578096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896933670527043:5869]
2025-09-30T14:59:06.578114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:06.578134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:06.578151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:06.578159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:06.578189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:06.578198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896933670527043:5869]
2025-09-30T14:59:06.578200Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:06.578201Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:06.578204Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:06.578212Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:06.578468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760329095:2454], now have 1 active actors on pipe
2025-09-30T14:59:06.578481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760329235:10363], now have 1 active actors on pipe
2025-09-30T14:59:06.578611Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3124
2025-09-30T14:59:06.578728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3124
2025-09-30T14:59:06.578829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.578842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.578883Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:06.578894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:06.578898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:06.578901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:06.578913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:06.578926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:06.578944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:06.579160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.579166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.579182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:06.579301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3125 partition: 0 MaxSeqNo: 42 sessionId: src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0
2025-09-30T14:59:06.579706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf764767-c421981e-7d9a7eca-4a7fa43d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:06.582766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0] Write session: try to update token
2025-09-30T14:59:06.582786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:06.592279Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:06.592299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:06.592303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:06.592305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:06.592315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896933670527043:5869]
2025-09-30T14:59:06.592323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896933670527043:5869]
2025-09-30T14:59:06.592327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896933670527043:5869]
2025-09-30T14:59:06.592370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:06.592378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.592381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:06.592398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:06.592413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:06.592418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:06.592533Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:06.602514Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3125 sessionId: src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:06.605494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:06.639568Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896933760329333:10551]
2025-09-30T14:59:06.640145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3124, pipe: [1:7555896933760329333:10551]
2025-09-30T14:59:06.713267Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:06.713867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.713876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.713896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760329333:10551], now have 1 active actors on pipe
2025-09-30T14:59:06.714205Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:06.714214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896933760329333:10551]
2025-09-30T14:59:06.714895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:06.714906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0] Write session will restart in 0.008673s
2025-09-30T14:59:06.714928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0] Write session: Do CDS request
2025-09-30T14:59:06.714933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:06.714297Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:06.714351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:06.714424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3125 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0
2025-09-30T14:59:06.714606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3125 sessionId: src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0 is DEAD
2025-09-30T14:59:06.724797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:06.724912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:06.724935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3126
2025-09-30T14:59:06.725087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3126 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:06.725122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3126 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:06.725132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3126 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:06.725136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:06.725570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3126 sessionId:  describe result for acl check
2025-09-30T14:59:06.725611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:06.725619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:06.725621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:06.725627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896933760329421:10350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:06.726231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896933760329421:10350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:06.729968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896933760329421:10350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:06.732094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896933760329421:10350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:06.732114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896933760329421:10350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:06.732118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896933760329421:10350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:06.732126Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3126 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:06.732355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:06.735021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:06.735269Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:06.735280Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:06.735293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:06.735351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:06.735404Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896933670527304:5850]
2025-09-30T14:59:06.736099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:06.736438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:06.736487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:06.736845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:06.736913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.736919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.736920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.736921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.736923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.736924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.736925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.736926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.736927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.736929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.736930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.736931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.736932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.736934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.736935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.736941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.736952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.736956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.736961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.736965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.736968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.736972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.736977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.736981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.736986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.736990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.736994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.736998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.737002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.737009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.737019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.737028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.737034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.737040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.737045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.737051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.737056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.737061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.737067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.737073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.737077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.737082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.737088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.737093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.737098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.737104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.737109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.737114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.737119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.737123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.737137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.737142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.737147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.737152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.737157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.737162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.737167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.737172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.737180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.737185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.737225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:06.743269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:06.744652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:06.744660Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:06.744663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:06.744668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:06.744675Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3125 [2:7555896933670527304:5850]
2025-09-30T14:59:06.744692Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:06.744708Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:06.744712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:06.744715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:06.744718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:06.744736Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:06.744742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:06.744750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:06.744822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.744824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.744827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.744830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:06.744833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:06.744909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:06.744912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.744925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.744936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.744952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:06.744969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896933670527296:5850]
2025-09-30T14:59:06.744972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896933670527296:5850]
2025-09-30T14:59:06.744975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896933670527296:5850]
2025-09-30T14:59:06.744993Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:06.745008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:06.745025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:06.745029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:06.745047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:06.745050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:06.745052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:06.745063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896933670527296:5850]
2025-09-30T14:59:06.745066Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:06.745123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:06.745326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760329569:10350], now have 1 active actors on pipe
2025-09-30T14:59:06.745338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760329359:2454], now have 1 active actors on pipe
2025-09-30T14:59:06.745362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3125
2025-09-30T14:59:06.745373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3125
2025-09-30T14:59:06.745672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.745683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.745713Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:06.745723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:06.745727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:06.745729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:06.745742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:06.745754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:06.745771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:06.746043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.746051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.746068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:06.746210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3126 partition: 0 MaxSeqNo: 42 sessionId: src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0
2025-09-30T14:59:06.746616Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1c1088c-d851205a-b4d30d22-68bf3cbd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:06.749631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0] Write session: try to update token
2025-09-30T14:59:06.749657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:06.758155Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:06.758178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:06.758181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:06.758183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:06.758207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896933670527296:5850]
2025-09-30T14:59:06.758212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896933670527296:5850]
2025-09-30T14:59:06.758217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896933670527296:5850]
2025-09-30T14:59:06.758264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:06.758273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.758276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:06.758279Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:06.758287Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:06.758292Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:06.758427Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:06.765706Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3126 sessionId: src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:06.768828Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:06.814123Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896933760329582:10551]
2025-09-30T14:59:06.814508Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3125, pipe: [1:7555896933760329582:10551]
2025-09-30T14:59:06.874373Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:06.874895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.874909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.874928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760329582:10551], now have 1 active actors on pipe
2025-09-30T14:59:06.875240Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:06.875231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896933760329582:10551]
2025-09-30T14:59:06.875267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:06.875272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:06.875287Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:06.875349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3126 reason: error at write: Disconnected sessionId: src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0
2025-09-30T14:59:06.875549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3126 sessionId: src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0 is DEAD
2025-09-30T14:59:06.875708Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:06.875718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0] Write session will restart in 0.005574s
2025-09-30T14:59:06.875743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0] Write session: Do CDS request
2025-09-30T14:59:06.875749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:06.882792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:06.882885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:06.882908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3127
2025-09-30T14:59:06.883065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3127 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:06.883102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3127 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:06.883113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3127 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:06.883118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:06.883632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3127 sessionId:  describe result for acl check
2025-09-30T14:59:06.883684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:06.883692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:06.883694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:06.883700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896933760329609:10344] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:06.884245Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896933760329609:10344] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:06.886909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896933760329609:10344] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:06.890412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896933760329609:10344] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:06.890432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896933760329609:10344] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:06.890436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896933760329609:10344] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:06.890444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3127 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:06.892264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:06.892845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:06.893021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:06.893031Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:06.893041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:06.893081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:06.893120Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896933670527522:5844]
2025-09-30T14:59:06.893602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:06.895019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:06.895082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:06.895458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:06.895530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.895535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.895536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.895536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.895537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.895538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.895539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.895539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.895540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.895541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.895542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.895542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.895543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.895544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.895545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.895550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.895562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.895566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.895571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.895575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.895579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.895583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.895585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.895587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.895590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.895593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.895595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.895598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.895600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.895603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.895609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.895615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:06.895619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.895622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:06.895627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.895630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:06.895633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.895636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:06.895639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.895642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:06.895644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.895647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:06.895663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.895669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:06.895673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.895680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:06.895685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.895690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:06.895695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.895700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:06.895705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.895708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.895711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.895713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.895717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.895720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.895723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.895725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:06.895729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.895732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:06.895765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:06.901424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:06.902837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:06.902853Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:06.902855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:06.902858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:06.902863Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3126 [2:7555896933670527522:5844]
2025-09-30T14:59:06.902875Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:06.902888Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:06.902890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:06.902893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:06.902894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:06.902908Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:06.902915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:06.902922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:06.902988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.902996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.902999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.903002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:06.903005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:06.903059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:06.903065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.903078Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:06.903093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:06.903114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:06.903135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896933670527517:5844]
2025-09-30T14:59:06.903142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896933670527517:5844]
2025-09-30T14:59:06.903146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896933670527517:5844]
2025-09-30T14:59:06.903158Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:06.903171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760329792:10344], now have 1 active actors on pipe
2025-09-30T14:59:06.903178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760329585:2454], now have 1 active actors on pipe
2025-09-30T14:59:06.903177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:06.903181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:06.903184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:06.903184Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:06.903198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:06.903201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:06.903238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896933670527517:5844]
2025-09-30T14:59:06.903270Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:06.903277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:06.903383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.903393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.903271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3126
2025-09-30T14:59:06.903279Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3126
2025-09-30T14:59:06.903424Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:06.903435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:06.903439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:06.903442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:06.903451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:06.903460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:06.903472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:06.903638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:06.903647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:06.903656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:06.903730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3127 partition: 0 MaxSeqNo: 42 sessionId: src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0
2025-09-30T14:59:06.904073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6bacb963-cb90d4a9-79c8aa7e-b372704f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:06.906921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0] Write session: try to update token
2025-09-30T14:59:06.906944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:06.915580Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:06.915602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:06.915613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896933670527517:5844]
2025-09-30T14:59:06.915659Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:06.915664Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:06.915844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:06.916008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:06.916168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:06.916335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:06.916551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:06.916596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:06.925181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3127 sessionId: src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:06.927184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:06.927211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:06.927214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:06.927216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:06.927228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896933670527517:5844]
2025-09-30T14:59:06.927233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896933670527517:5844]
2025-09-30T14:59:06.927237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896933670527517:5844]
2025-09-30T14:59:06.927303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:06.927310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:06.927310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:06.927313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:06.927317Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:06.927322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:06.927467Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:06.928194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:06.975426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896933760329811:10551]
2025-09-30T14:59:06.975767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3126, pipe: [1:7555896933760329811:10551]
2025-09-30T14:59:07.044323Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:07.044686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.044702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.044726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896933760329811:10551], now have 1 active actors on pipe
2025-09-30T14:59:07.045050Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:07.045061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:07.045065Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896933760329811:10551]
2025-09-30T14:59:07.045083Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:07.045089Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:07.045168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3127 reason: error at write: Disconnected sessionId: src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0
2025-09-30T14:59:07.045364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3127 sessionId: src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0 is DEAD
2025-09-30T14:59:07.047403Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:07.047415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0] Write session will restart in 0.006786s
2025-09-30T14:59:07.047442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0] Write session: Do CDS request
2025-09-30T14:59:07.047450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:07.055782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:07.056151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:07.056176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3128
2025-09-30T14:59:07.056408Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3128 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:07.056469Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3128 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:07.056480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3128 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:07.056485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:07.057652Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3128 sessionId:  describe result for acl check
2025-09-30T14:59:07.057695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:07.057701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:07.057702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:07.057712Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896938055297135:10336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:07.058307Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896938055297135:10336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:07.066191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896938055297135:10336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:07.067683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:07.070414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:07.070712Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:07.070724Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:07.070737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:07.070817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:07.070879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896937965495037:5848]
2025-09-30T14:59:07.070778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896938055297135:10336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:07.070796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896938055297135:10336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:07.070800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896938055297135:10336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:07.070810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3128 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:07.071608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:07.072059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:07.072132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:07.072501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:07.072706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.072722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.072724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.072725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.072727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.072728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.072729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.072731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.072732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.072734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.072735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.072736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.072737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.072738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.072740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.072748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.072760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.072764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.072769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.072772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.072776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.072780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.072783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.072786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.072792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.072796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.072800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.072804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.072808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.072812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.072822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.072833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.072840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.072846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.072851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.072857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.072863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.072869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.072875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.072880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.072885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.072890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.072896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.072901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.072905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.072910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.072916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.072921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.072926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.072932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.072937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.072942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.072947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.072952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.072958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.072963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.072967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.072973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.072978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.072982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.073034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:07.079054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:07.080466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:07.080484Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:07.080487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:07.080491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:07.080499Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3127 [2:7555896937965495037:5848]
2025-09-30T14:59:07.080517Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:07.080536Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:07.080545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:07.080548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:07.080551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:07.080568Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:07.080576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:07.080583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:07.080682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.080694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.080696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.080982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3127
2025-09-30T14:59:07.080703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:07.080998Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3127
2025-09-30T14:59:07.080706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:07.080778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:07.080780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.080794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.080806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.080822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:07.080841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896937965495032:5848]
2025-09-30T14:59:07.080844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896937965495032:5848]
2025-09-30T14:59:07.080846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896937965495032:5848]
2025-09-30T14:59:07.080863Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:07.080878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055297109:2454], now have 1 active actors on pipe
2025-09-30T14:59:07.080882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055297326:10336], now have 1 active actors on pipe
2025-09-30T14:59:07.080887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:07.080891Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:07.080891Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:07.080894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:07.080905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:07.080908Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:07.080949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896937965495032:5848]
2025-09-30T14:59:07.080962Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:07.080983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:07.081431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.081449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.081481Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:07.081495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:07.081499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:07.081502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:07.081515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:07.081528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:07.081546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:07.083462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.083481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.083514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:07.083783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3128 partition: 0 MaxSeqNo: 42 sessionId: src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0
2025-09-30T14:59:07.084225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87b4939-b7258fa0-db7a9f30-bb915e4a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:07.088214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0] Write session: try to update token
2025-09-30T14:59:07.088243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:07.095210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:07.095233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:07.095263Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896937965495032:5848]
2025-09-30T14:59:07.095310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:07.095502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:07.095654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:07.095816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:07.095974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:07.096201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:07.096245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:07.096598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:07.106708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3128 sessionId: src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:07.108309Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:07.108332Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:07.108334Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:07.108337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:07.108348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896937965495032:5848]
2025-09-30T14:59:07.108354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896937965495032:5848]
2025-09-30T14:59:07.108359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896937965495032:5848]
2025-09-30T14:59:07.108405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:07.108412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.108415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:07.109707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:07.108569Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:07.111307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:07.111315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:07.111321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:07.145435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896938055297337:10551]
2025-09-30T14:59:07.145722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3127, pipe: [1:7555896938055297337:10551]
2025-09-30T14:59:07.225903Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:07.226580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.226598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.226624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055297337:10551], now have 1 active actors on pipe
2025-09-30T14:59:07.226895Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:07.226892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:07.226947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:07.226951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:07.227027Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3128 reason: error at write: Disconnected sessionId: src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0
2025-09-30T14:59:07.227141Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896938055297337:10551]
2025-09-30T14:59:07.227209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3128 sessionId: src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0 is DEAD
2025-09-30T14:59:07.227475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:07.227494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0] Write session will restart in 0.009646s
2025-09-30T14:59:07.227521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0] Write session: Do CDS request
2025-09-30T14:59:07.227531Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:07.238859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:07.239087Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:07.239102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3129
2025-09-30T14:59:07.239369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3129 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:07.239404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3129 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:07.239410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3129 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:07.239414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:07.239901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3129 sessionId:  describe result for acl check
2025-09-30T14:59:07.239931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:07.239933Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:07.239936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:07.239942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896938055297402:10330] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:07.240536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896938055297402:10330] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:07.244774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896938055297402:10330] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:07.248669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:07.248519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896938055297402:10330] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:07.248533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896938055297402:10330] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:07.248538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896938055297402:10330] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:07.248548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3129 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:07.252041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:07.252287Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:07.252299Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:07.252311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:07.252372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:07.252442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896937965495260:5840]
2025-09-30T14:59:07.253107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:07.253503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:07.253585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:07.254000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:07.254075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.254082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.254083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.254085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.254086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.254087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.254089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.254090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.254092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.254093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.254095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.254096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.254097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.254098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.254100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.254106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.254117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.254122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.254127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.254131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.254135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.254140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.254144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.254148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.254152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.254156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.254160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.254164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.254169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.254173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.254181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.254190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.254196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.254202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.254207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.254213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.254218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.254224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.254230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.254235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.254240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.254245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.254251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.254256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.254263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.254268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.254273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.254279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.254283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.254289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.254294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.254299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.254303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.254308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.254314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.254319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.254339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.254350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.254356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.254362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.254409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:07.260776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:07.262258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:07.262278Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:07.262282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:07.262286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:07.262294Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3128 [2:7555896937965495260:5840]
2025-09-30T14:59:07.262312Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:07.262333Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:07.262336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:07.262339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:07.262342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:07.262363Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:07.262381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:07.262389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:07.262467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.262475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.262477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.262481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:07.262483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:07.262561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:07.262569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.262582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.262593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.262609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:07.262628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896937965495254:5840]
2025-09-30T14:59:07.262635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896937965495254:5840]
2025-09-30T14:59:07.262637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896937965495254:5840]
2025-09-30T14:59:07.262646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:07.262662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055297339:2454], now have 1 active actors on pipe
2025-09-30T14:59:07.262666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:07.262670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:07.262670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055297555:10330], now have 1 active actors on pipe
2025-09-30T14:59:07.262672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:07.262679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:07.262693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:07.262697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:07.262738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896937965495254:5840]
2025-09-30T14:59:07.262751Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:07.262761Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:07.262761Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3128
2025-09-30T14:59:07.262769Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3128
2025-09-30T14:59:07.262906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.262916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.262942Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:07.262954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:07.262958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:07.262965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:07.262976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:07.262986Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:07.263003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:07.263155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.263165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.263178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:07.263299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3129 partition: 0 MaxSeqNo: 42 sessionId: src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0
2025-09-30T14:59:07.263780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3f96b122-f7c0e180-851a0fde-7f4f985d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:07.266841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0] Write session: try to update token
2025-09-30T14:59:07.266859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:07.276502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:07.276524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:07.276534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896937965495254:5840]
2025-09-30T14:59:07.276584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:07.276595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:07.276793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:07.276954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:07.277121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:07.277290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:07.277510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:07.277562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:07.284540Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3129 sessionId: src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:07.288320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.288350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.288369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:07.288372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:07.288375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:07.288378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:07.288387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896937965495254:5840]
2025-09-30T14:59:07.288392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896937965495254:5840]
2025-09-30T14:59:07.288397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896937965495254:5840]
2025-09-30T14:59:07.288439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:07.288444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:07.288448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:07.288452Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:07.288455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.288458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:07.288605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:07.287635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:07.327184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896938055297575:10551]
2025-09-30T14:59:07.327788Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3128, pipe: [1:7555896938055297575:10551]
2025-09-30T14:59:07.405642Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:07.406125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:07.406166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055297575:10551], now have 1 active actors on pipe
2025-09-30T14:59:07.406315Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:07.406371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:07.406419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896938055297575:10551]
2025-09-30T14:59:07.406449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:07.406457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:07.406538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3129 reason: error at write: Disconnected sessionId: src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0
2025-09-30T14:59:07.406735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3129 sessionId: src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0 is DEAD
2025-09-30T14:59:07.406889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:07.406902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0] Write session will restart in 0.006196s
2025-09-30T14:59:07.406928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0] Write session: Do CDS request
2025-09-30T14:59:07.406934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:07.414850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:07.415264Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:07.415281Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3130
2025-09-30T14:59:07.415461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3130 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:07.415495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3130 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:07.415504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3130 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:07.415508Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:07.416074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3130 sessionId:  describe result for acl check
2025-09-30T14:59:07.416114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:07.416123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:07.416126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:07.416134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896938055297596:10323] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:07.416741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896938055297596:10323] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:07.420073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896938055297596:10323] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:07.423627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896938055297596:10323] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:07.423644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896938055297596:10323] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:07.423647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896938055297596:10323] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:07.423655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3130 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:07.427697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:07.430827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:07.431102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:07.431114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:07.431126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:07.431186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:07.431234Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896937965495481:5836]
2025-09-30T14:59:07.431972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:07.432353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:07.432408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:07.432811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:07.432885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.432892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.432894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.432895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.432897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.432899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.432901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.432902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.432904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.432905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.432907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.432908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.432910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.432911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.432912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.432919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.432931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.432935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.432940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.432944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.432947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.432952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.432957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.432961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.432966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.432971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.432975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.432979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.432983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.432988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.432998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.433008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.433014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.433021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.433026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.433031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.433036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.433044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.433050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.433060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.433065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.433071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.433077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.433088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.433093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.433099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.433107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.433113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.433123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.433128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.433134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.433143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.433149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.433154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.433162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.433168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.433178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.433184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.433189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.433195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.433263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:07.439158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:07.440548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:07.440566Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:07.440568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:07.440574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:07.440582Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3129 [2:7555896937965495481:5836]
2025-09-30T14:59:07.440601Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:07.440630Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:07.440634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:07.440637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:07.440639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:07.440659Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:07.440666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:07.440679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:07.440760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.440769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.440771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.440774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:07.440777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:07.440851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:07.440861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.440876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.440889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.440905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:07.440934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055297744:10323], now have 1 active actors on pipe
2025-09-30T14:59:07.440941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896937965495476:5836]
2025-09-30T14:59:07.440944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896937965495476:5836]
2025-09-30T14:59:07.440946Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896937965495476:5836]
2025-09-30T14:59:07.440961Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:07.440970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055297580:2454], now have 1 active actors on pipe
2025-09-30T14:59:07.440978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:07.441022Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3129
2025-09-30T14:59:07.440983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:07.441043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3129
2025-09-30T14:59:07.440987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:07.440990Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:07.440993Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:07.440996Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:07.441035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896937965495476:5836]
2025-09-30T14:59:07.441038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:07.441054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:07.441065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.441070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.441114Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|21c989b-20f13a36-1ce6fd68-45d72515_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:07.441120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:07.441124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:07.441127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:07.441137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:07.441147Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:07.441167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:07.441327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.441335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.441349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:07.441430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3130 partition: 0 MaxSeqNo: 42 sessionId: src_id|21c989b-20f13a36-1ce6fd68-45d72515_0
2025-09-30T14:59:07.441820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f32aa1ab-515790b1-418b8e34-fd0e21b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|21c989b-20f13a36-1ce6fd68-45d72515_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:07.444946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21c989b-20f13a36-1ce6fd68-45d72515_0] Write session: try to update token
2025-09-30T14:59:07.444973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21c989b-20f13a36-1ce6fd68-45d72515_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:07.454614Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:07.454640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:07.454643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:07.454645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:07.454655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896937965495476:5836]
2025-09-30T14:59:07.454660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896937965495476:5836]
2025-09-30T14:59:07.454665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896937965495476:5836]
2025-09-30T14:59:07.454707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:07.454716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.454719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:07.454726Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:07.454734Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:07.454739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:07.454880Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:07.462146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3130 sessionId: src_id|21c989b-20f13a36-1ce6fd68-45d72515_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:07.465076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:07.506392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896938055297811:10551]
2025-09-30T14:59:07.506758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3129, pipe: [1:7555896938055297811:10551]
2025-09-30T14:59:07.573229Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:07.573766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.573776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.573821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055297811:10551], now have 1 active actors on pipe
2025-09-30T14:59:07.574093Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:07.574657Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:07.574658Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896938055297811:10551]
2025-09-30T14:59:07.574687Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:07.574776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3130 reason: status is not ok: tablet will be restarted right now sessionId: src_id|21c989b-20f13a36-1ce6fd68-45d72515_0
2025-09-30T14:59:07.574979Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3130 sessionId: src_id|21c989b-20f13a36-1ce6fd68-45d72515_0 is DEAD
2025-09-30T14:59:07.575456Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21c989b-20f13a36-1ce6fd68-45d72515_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:07.575469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21c989b-20f13a36-1ce6fd68-45d72515_0] Write session will restart in 0.005415s
2025-09-30T14:59:07.575492Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21c989b-20f13a36-1ce6fd68-45d72515_0] Write session: Do CDS request
2025-09-30T14:59:07.575497Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21c989b-20f13a36-1ce6fd68-45d72515_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:07.581847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|21c989b-20f13a36-1ce6fd68-45d72515_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:07.583610Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:07.583628Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3131
2025-09-30T14:59:07.587436Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3131 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:07.587495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3131 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:07.587502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3131 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:07.587509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:07.588089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3131 sessionId:  describe result for acl check
2025-09-30T14:59:07.588129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:07.588132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:07.588137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:07.588144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896938055297829:10317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:07.588745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896938055297829:10317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:07.591965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896938055297829:10317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:07.598156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896938055297829:10317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:07.598169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896938055297829:10317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:07.598172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896938055297829:10317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:07.598179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3131 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:07.613426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:07.616296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:07.616552Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:07.616565Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:07.616577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:07.616650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:07.616699Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896937965495715:5827]
2025-09-30T14:59:07.617392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:07.617750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:07.617806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:07.618169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:07.618247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.618257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.618258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.618260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.618261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.618263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.618265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.618266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.618267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.618269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.618270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.618271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.618273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.618274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.618275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.618282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.618293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.618296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.618301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.618305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.618309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.618312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.618316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.618320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.618325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.618328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.618332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.618335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.618339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.618342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.618352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.618361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.618368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.618374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.618380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.618385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.618389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.618395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.618401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.618407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.618412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.618418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.618424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.618432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.618437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.618443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.618449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.618454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.618460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.618467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.618472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.618478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.618483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.618489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.618503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.618509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.618519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.618524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.618534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.618540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.618595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:07.625854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:07.626794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:07.626813Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:07.626815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:07.626819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:07.626825Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3130 [2:7555896937965495715:5827]
2025-09-30T14:59:07.626840Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:07.626854Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:07.626857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:07.626859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:07.626862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:07.626876Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:07.626882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:07.626894Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:07.626947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.626953Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.626955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.626958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:07.626960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:07.627036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:07.627046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.627057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.627069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.627090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:07.627116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055297893:10317], now have 1 active actors on pipe
2025-09-30T14:59:07.627126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055297812:2454], now have 1 active actors on pipe
2025-09-30T14:59:07.627132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896937965495710:5827]
2025-09-30T14:59:07.627138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896937965495710:5827]
2025-09-30T14:59:07.627141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896937965495710:5827]
2025-09-30T14:59:07.627154Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:07.627169Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:07.627173Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:07.627179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:07.627181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:07.627187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:07.627191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:07.627234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896937965495710:5827]
2025-09-30T14:59:07.627259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:07.627277Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:07.627226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3130
2025-09-30T14:59:07.627234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3130
2025-09-30T14:59:07.627303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.627315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.627344Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:07.627352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:07.627355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:07.627357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:07.627370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:07.627379Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:07.627394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:07.628063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.628076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.628098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:07.629709Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3131 partition: 0 MaxSeqNo: 42 sessionId: src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0
2025-09-30T14:59:07.631436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|21c989b-20f13a36-1ce6fd68-45d72515_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:07.634540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0] Write session: try to update token
2025-09-30T14:59:07.634568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:07.641966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:07.641991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:07.641994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:07.641996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:07.642005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896937965495710:5827]
2025-09-30T14:59:07.642011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896937965495710:5827]
2025-09-30T14:59:07.642017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896937965495710:5827]
2025-09-30T14:59:07.642065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:07.642072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.642075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:07.642237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:07.647373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:07.647398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:07.647405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:07.658039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3131 sessionId: src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:07.661121Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:07.676241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896938055298044:10551]
2025-09-30T14:59:07.676802Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3130, pipe: [1:7555896938055298044:10551]
2025-09-30T14:59:07.761254Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:07.761606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.761625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.761644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055298044:10551], now have 1 active actors on pipe
2025-09-30T14:59:07.761886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:07.761881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:07.761899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:07.761938Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896938055298044:10551]
2025-09-30T14:59:07.761981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3131 reason: error at write: Disconnected sessionId: src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0
2025-09-30T14:59:07.762152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3131 sessionId: src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0 is DEAD
2025-09-30T14:59:07.762525Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:07.763472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:07.763484Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0] Write session will restart in 0.006142s
2025-09-30T14:59:07.763510Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0] Write session: Do CDS request
2025-09-30T14:59:07.763521Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:07.770905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:07.771018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:07.771033Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3132
2025-09-30T14:59:07.771176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3132 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:07.771208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3132 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:07.771218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3132 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:07.771237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:07.772250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3132 sessionId:  describe result for acl check
2025-09-30T14:59:07.772304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:07.772311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:07.772313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:07.772320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896938055298097:10295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:07.772885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896938055298097:10295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:07.775215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896938055298097:10295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:07.778909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896938055298097:10295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:07.778919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896938055298097:10295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:07.778923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896938055298097:10295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:07.778930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3132 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:07.782943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:07.785626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:07.785853Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:07.785864Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:07.785875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:07.785925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:07.785967Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896937965495976:5805]
2025-09-30T14:59:07.786668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:07.787054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:07.787136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:07.787487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:07.787555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.787560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.787561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.787562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.787564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.787565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.787567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.787568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.787569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.787571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.787572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.787573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.787574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.787575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.787576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.787582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.787593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.787597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.787601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.787604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.787609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.787613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.787618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.787622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.787626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.787630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.787635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.787639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.787643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.787647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.787656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.787681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.787689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.787695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.787703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.787714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.787719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.787725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.787736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.787742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.787747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.787752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.787758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.787764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.787768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.787775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.787780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.787788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.787793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.787798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.787807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.787812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.787818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.787829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.787835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.787840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.787849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.787855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.787859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.787862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.787888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:07.793591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:07.794580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:07.794597Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:07.794600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:07.794605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:07.794613Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3131 [2:7555896937965495976:5805]
2025-09-30T14:59:07.794631Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:07.794650Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:07.794659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:07.794663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:07.794665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:07.794684Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:07.794696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:07.794703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:07.794763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.794769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.794771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.794774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:07.794776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:07.794832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:07.794838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.794848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.794859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.794880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:07.794896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896937965495971:5805]
2025-09-30T14:59:07.794901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896937965495971:5805]
2025-09-30T14:59:07.794903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896937965495971:5805]
2025-09-30T14:59:07.794910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:07.794921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:07.794922Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:07.794926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:07.794929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:07.794935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:07.794937Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:07.794948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055298082:2454], now have 1 active actors on pipe
2025-09-30T14:59:07.794951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055298240:10295], now have 1 active actors on pipe
2025-09-30T14:59:07.794982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896937965495971:5805]
2025-09-30T14:59:07.794999Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:07.795001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:07.795066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3131
2025-09-30T14:59:07.795159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3131
2025-09-30T14:59:07.795419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.795431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.795455Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:07.795461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:07.795464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:07.795465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:07.795474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:07.795482Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:07.795493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:07.795677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.795684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.795696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:07.795783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3132 partition: 0 MaxSeqNo: 42 sessionId: src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0
2025-09-30T14:59:07.796161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31d7cac-d640b5ef-68f979e3-bbc15a6d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:07.799164Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0] Write session: try to update token
2025-09-30T14:59:07.799183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:07.807998Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:07.808024Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:07.808027Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:07.808029Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:07.808039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896937965495971:5805]
2025-09-30T14:59:07.808044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896937965495971:5805]
2025-09-30T14:59:07.808048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896937965495971:5805]
2025-09-30T14:59:07.808099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:07.808107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.808110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:07.808110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:07.808116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:07.808119Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:07.808263Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:07.815896Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3132 sessionId: src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:07.819030Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:07.862231Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896938055298313:10551]
2025-09-30T14:59:07.862554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3131, pipe: [1:7555896938055298313:10551]
2025-09-30T14:59:07.921459Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:07.922007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.922024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.922068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055298313:10551], now have 1 active actors on pipe
2025-09-30T14:59:07.922312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:07.922362Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:07.922368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:07.922380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896938055298313:10551]
2025-09-30T14:59:07.922437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3132 reason: error at write: Disconnected sessionId: src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0
2025-09-30T14:59:07.922641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3132 sessionId: src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0 is DEAD
2025-09-30T14:59:07.922308Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:07.922798Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:07.922810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0] Write session will restart in 0.006851s
2025-09-30T14:59:07.922843Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0] Write session: Do CDS request
2025-09-30T14:59:07.922851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:07.930882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:07.930953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:07.930967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3133
2025-09-30T14:59:07.931174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3133 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:07.931208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3133 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:07.931218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3133 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:07.931223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:07.931864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3133 sessionId:  describe result for acl check
2025-09-30T14:59:07.931905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:07.931914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:07.931916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:07.931923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896938055298352:10293] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:07.932508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896938055298352:10293] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:07.935647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896938055298352:10293] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:07.939481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896938055298352:10293] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:07.939497Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896938055298352:10293] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:07.939501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896938055298352:10293] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:07.939511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3133 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:07.940560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:07.943131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:07.943381Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:07.943396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:07.943411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:07.943477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:07.943524Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896937965496200:5803]
2025-09-30T14:59:07.944243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:07.944625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:07.944687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:07.945062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:07.945138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.945147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.945149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.945151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.945152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.945154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.945155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.945157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.945158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.945160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.945161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.945162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.945164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.945165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.945167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.945173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.945184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.945189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.945194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.945198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.945203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.945208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.945212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.945217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.945222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.945226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.945231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.945235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.945239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.945244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.945252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.945261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:07.945268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.945274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:07.945280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.945286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:07.945296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.945302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:07.945308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.945314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:07.945319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.945325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:07.945336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.945342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:07.945348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.945355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:07.945365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.945371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:07.945379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.945387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:07.945392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.945398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.945403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.945409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.945423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.945429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.945436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.945442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:07.945448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.945453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:07.945517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:07.952828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:07.953835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:07.953858Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:07.953862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:07.953867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:07.953875Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3132 [2:7555896937965496200:5803]
2025-09-30T14:59:07.953894Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:07.953914Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:07.953917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:07.953921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:07.953944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:07.953962Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:07.953970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:07.953984Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:07.954056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.954066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.954068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.954073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:07.954075Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:07.954154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:07.954163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.954177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:07.954193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:07.954214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:07.954242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055298534:10293], now have 1 active actors on pipe
2025-09-30T14:59:07.954251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896938055298315:2454], now have 1 active actors on pipe
2025-09-30T14:59:07.954257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896937965496195:5803]
2025-09-30T14:59:07.954266Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896937965496195:5803]
2025-09-30T14:59:07.954268Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896937965496195:5803]
2025-09-30T14:59:07.954284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:07.954303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:07.954313Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:07.954317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:07.954320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:07.954323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:07.954327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:07.954372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896937965496195:5803]
2025-09-30T14:59:07.954379Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:07.954382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:07.954409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.954419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.954454Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:07.954468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:07.954473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:07.954475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:07.954486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:07.954497Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:07.954524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:07.954341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3132
2025-09-30T14:59:07.954523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3132
2025-09-30T14:59:07.954966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:07.954979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:07.955000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:07.955754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77d7938f-663fa3ad-87b28934-6d4d1e30_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:07.955349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3133 partition: 0 MaxSeqNo: 42 sessionId: src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0
2025-09-30T14:59:07.958777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0] Write session: try to update token
2025-09-30T14:59:07.958794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:07.967936Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:07.967956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:07.967958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:07.967959Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:07.967966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896937965496195:5803]
2025-09-30T14:59:07.967970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896937965496195:5803]
2025-09-30T14:59:07.967973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896937965496195:5803]
2025-09-30T14:59:07.968014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:07.968022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:07.968023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:07.968026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:07.968028Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:07.968032Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:07.968185Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:07.976916Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3133 sessionId: src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:07.980886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:08.022478Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896942350265844:10551]
2025-09-30T14:59:08.022870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3132, pipe: [1:7555896942350265844:10551]
2025-09-30T14:59:08.085186Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:08.085562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.085575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.085596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350265844:10551], now have 1 active actors on pipe
2025-09-30T14:59:08.085900Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:08.085906Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:08.085919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:08.085993Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3133 reason: error at write: Disconnected sessionId: src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0
2025-09-30T14:59:08.086171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3133 sessionId: src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0 is DEAD
2025-09-30T14:59:08.086256Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896942350265844:10551]
2025-09-30T14:59:08.086283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:08.086332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:08.086341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0] Write session will restart in 0.006170s
2025-09-30T14:59:08.086366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0] Write session: Do CDS request
2025-09-30T14:59:08.086372Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:08.094030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:08.094292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:08.094320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3134
2025-09-30T14:59:08.094504Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3134 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:08.094550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3134 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:08.094562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3134 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:08.094566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:08.095076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3134 sessionId:  describe result for acl check
2025-09-30T14:59:08.095115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:08.095117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:08.095120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:08.095126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896942350265878:10279] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:08.095751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896942350265878:10279] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:08.098348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896942350265878:10279] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:08.101804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896942350265878:10279] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:08.101819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896942350265878:10279] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:08.101823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896942350265878:10279] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:08.101832Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3134 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:08.104717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:08.107285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:08.107507Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:08.107525Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:08.107537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:08.107614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:08.107664Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896942260463721:5798]
2025-09-30T14:59:08.108393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:08.108733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:08.108794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:08.109155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:08.109224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.109230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.109231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.109233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.109235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.109236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.109237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.109239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.109240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.109241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.109242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.109243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.109244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.109245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.109246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.109252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.109263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.109268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.109273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.109278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.109283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.109288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.109292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.109298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.109303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.109307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.109312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.109315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.109319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.109324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.109332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.109341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.109348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.109354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.109362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.109369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.109374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.109380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.109386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.109392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.109397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.109409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.109414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.109421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.109430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.109436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.109446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.109451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.109457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.109467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.109474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.109480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.109486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.109491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.109496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.109505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.109509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.109515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.109526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.109531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.109591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:08.115525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:08.117042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:08.117062Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:08.117065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:08.117069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:08.117077Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3133 [2:7555896942260463721:5798]
2025-09-30T14:59:08.117096Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:08.117115Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:08.117118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:08.117121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:08.117123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:08.117140Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:08.117147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:08.117159Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:08.117227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.117236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.117239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.117243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:08.117245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:08.117316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:08.117324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.117340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.117358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.117381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:08.117404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350265845:2454], now have 1 active actors on pipe
2025-09-30T14:59:08.117413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350266042:10279], now have 1 active actors on pipe
2025-09-30T14:59:08.117419Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896942260463716:5798]
2025-09-30T14:59:08.117422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896942260463716:5798]
2025-09-30T14:59:08.117424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896942260463716:5798]
2025-09-30T14:59:08.117437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:08.117452Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:08.117456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:08.117463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:08.117465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:08.117471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:08.117474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:08.117474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3133
2025-09-30T14:59:08.117503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3133
2025-09-30T14:59:08.117512Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896942260463716:5798]
2025-09-30T14:59:08.117525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:08.117527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:08.117557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.117563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.117594Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|855b646a-e50b158c-31a07d09-b3bdab37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:08.117601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:08.117605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:08.117607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:08.117617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:08.117625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:08.117651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:08.117864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.117877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.117922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:08.118052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3134 partition: 0 MaxSeqNo: 42 sessionId: src_id|855b646a-e50b158c-31a07d09-b3bdab37_0
2025-09-30T14:59:08.118538Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e66bffe-f67d41ac-d373ee89-3613f69e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|855b646a-e50b158c-31a07d09-b3bdab37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:08.122279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|855b646a-e50b158c-31a07d09-b3bdab37_0] Write session: try to update token
2025-09-30T14:59:08.122309Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|855b646a-e50b158c-31a07d09-b3bdab37_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:08.130788Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:08.130809Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:08.130811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:08.130813Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:08.130824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896942260463716:5798]
2025-09-30T14:59:08.130830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896942260463716:5798]
2025-09-30T14:59:08.130835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896942260463716:5798]
2025-09-30T14:59:08.130877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:08.130881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:08.130884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.130887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:08.130892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:08.130896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:08.131037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:08.145810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3134 sessionId: src_id|855b646a-e50b158c-31a07d09-b3bdab37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:08.148947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:08.185822Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896942350266082:10551]
2025-09-30T14:59:08.186094Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3133, pipe: [1:7555896942350266082:10551]
2025-09-30T14:59:08.247973Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:08.248298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.248311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.248330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350266082:10551], now have 1 active actors on pipe
2025-09-30T14:59:08.248698Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:08.249076Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|855b646a-e50b158c-31a07d09-b3bdab37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:08.249088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|855b646a-e50b158c-31a07d09-b3bdab37_0] Write session will restart in 0.005814s
2025-09-30T14:59:08.249112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|855b646a-e50b158c-31a07d09-b3bdab37_0] Write session: Do CDS request
2025-09-30T14:59:08.249118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|855b646a-e50b158c-31a07d09-b3bdab37_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:08.248566Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:08.248570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896942350266082:10551]
2025-09-30T14:59:08.248629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:08.248632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:08.248714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3134 reason: error at write: Disconnected sessionId: src_id|855b646a-e50b158c-31a07d09-b3bdab37_0
2025-09-30T14:59:08.248903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3134 sessionId: src_id|855b646a-e50b158c-31a07d09-b3bdab37_0 is DEAD
2025-09-30T14:59:08.255716Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|855b646a-e50b158c-31a07d09-b3bdab37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:08.255893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:08.255907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3135
2025-09-30T14:59:08.256089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3135 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:08.256125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3135 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:08.256136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3135 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:08.256139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:08.256584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3135 sessionId:  describe result for acl check
2025-09-30T14:59:08.256627Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:08.256629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:08.256631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:08.256638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896942350266098:10277] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:08.257297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896942350266098:10277] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:08.263164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896942350266098:10277] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:08.266925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896942350266098:10277] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:08.266941Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896942350266098:10277] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:08.266945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896942350266098:10277] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:08.266954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3135 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:08.269693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:08.272320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:08.272559Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:08.272570Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:08.272582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:08.272647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:08.272688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896942260463949:5779]
2025-09-30T14:59:08.273359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:08.273714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:08.273780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:08.274203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:08.274266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.274272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.274274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.274275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.274276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.274277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.274279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.274280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.274282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.274283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.274285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.274286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.274287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.274289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.274290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.274296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.274307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.274312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.274316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.274332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.274336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.274340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.274343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.274347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.274352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.274357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.274361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.274365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.274369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.274373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.274383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.274392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.274403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.274410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.274420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.274426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.274430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.274436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.274442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.274447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.274458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.274464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.274474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.274480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.274489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.274495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.274499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.274510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.274515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.274525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.274530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.274539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.274545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.274555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.274560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.274569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.274582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.274591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.274596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.274601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.274651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:08.280559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:08.282247Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3134
2025-09-30T14:59:08.282247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3134
2025-09-30T14:59:08.281783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:08.281789Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:08.281792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:08.281796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:08.281804Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3134 [2:7555896942260463949:5779]
2025-09-30T14:59:08.281821Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:08.281837Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:08.281841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:08.281844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:08.281846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:08.281862Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:08.281869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:08.281876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:08.281939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.281941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.281944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.281947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:08.281950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:08.282027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:08.282029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.282044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.282054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.282072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:08.282088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896942260463944:5779]
2025-09-30T14:59:08.282091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896942260463944:5779]
2025-09-30T14:59:08.282093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896942260463944:5779]
2025-09-30T14:59:08.282103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:08.282113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:08.282117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:08.282119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:08.282120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350266083:2454], now have 1 active actors on pipe
2025-09-30T14:59:08.282126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:08.282142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:08.282146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:08.282151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350266275:10277], now have 1 active actors on pipe
2025-09-30T14:59:08.282185Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896942260463944:5779]
2025-09-30T14:59:08.282194Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:08.282217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:08.282572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.282599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.282624Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:08.282631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:08.282641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:08.282643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:08.282653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:08.282669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:08.282689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:08.282872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.282880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.282894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:08.282990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3135 partition: 0 MaxSeqNo: 42 sessionId: src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0
2025-09-30T14:59:08.283439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|855b646a-e50b158c-31a07d09-b3bdab37_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:08.286600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0] Write session: try to update token
2025-09-30T14:59:08.286621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:08.297517Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:08.297541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:08.297544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:08.297547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:08.297558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896942260463944:5779]
2025-09-30T14:59:08.297567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896942260463944:5779]
2025-09-30T14:59:08.297572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896942260463944:5779]
2025-09-30T14:59:08.297621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:08.297629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.297632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:08.297636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:08.297645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:08.297653Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:08.297775Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:08.302932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3135 sessionId: src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:08.306287Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:08.348626Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896942350266323:10551]
2025-09-30T14:59:08.348953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3134, pipe: [1:7555896942350266323:10551]
2025-09-30T14:59:08.416717Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:08.417101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.417118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.417140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350266323:10551], now have 1 active actors on pipe
2025-09-30T14:59:08.417364Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:08.417415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:08.417487Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896942350266323:10551]
2025-09-30T14:59:08.417515Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:08.417605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3135 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0
2025-09-30T14:59:08.417799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3135 sessionId: src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0 is DEAD
2025-09-30T14:59:08.419383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:08.419399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0] Write session will restart in 0.009279s
2025-09-30T14:59:08.419425Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0] Write session: Do CDS request
2025-09-30T14:59:08.419432Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:08.429905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:08.429889Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:08.429906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3136
2025-09-30T14:59:08.430146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3136 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:08.430195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3136 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:08.430206Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3136 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:08.430210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:08.430676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3136 sessionId:  describe result for acl check
2025-09-30T14:59:08.430718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:08.430727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:08.430729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:08.430738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896942350266347:10274] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:08.431345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896942350266347:10274] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:08.434152Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896942350266347:10274] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:08.438365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896942350266347:10274] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:08.438385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896942350266347:10274] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:08.438389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896942350266347:10274] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:08.438397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3136 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:08.448010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:08.452114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:08.452362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:08.452375Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:08.452387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:08.452448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:08.452492Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896942260464180:5776]
2025-09-30T14:59:08.453195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:08.453820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:08.453883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:08.454255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:08.454331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.454333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.454334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.454336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.454337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.454339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.454341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.454343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.454344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.454345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.454347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.454348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.454349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.454351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.454352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.454359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.454370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.454375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.454380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.454386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.454391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.454395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.454400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.454404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.454409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.454414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.454418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.454423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.454427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.454431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.454442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.454451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.454457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.454464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.454469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.454474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.454479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.454485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.454491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.454497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.454502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.454508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.454513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.454520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.454525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.454532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.454537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.454543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.454548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.454554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.454563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.454569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.454574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.454580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.454585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.454590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.454594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.454600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.454605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.454611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.454655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:08.460572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:08.461686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:08.461704Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:08.461706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:08.461710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:08.461717Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3135 [2:7555896942260464180:5776]
2025-09-30T14:59:08.461735Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:08.461752Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:08.461755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:08.461758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:08.461761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:08.461778Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:08.461786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:08.461798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:08.461860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.461868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.461870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.461874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:08.461877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:08.461945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:08.461954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.461968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.461979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.461996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:08.462015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350266462:10274], now have 1 active actors on pipe
2025-09-30T14:59:08.462025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350266327:2454], now have 1 active actors on pipe
2025-09-30T14:59:08.462032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896942260464171:5776]
2025-09-30T14:59:08.462034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896942260464171:5776]
2025-09-30T14:59:08.462036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896942260464171:5776]
2025-09-30T14:59:08.462045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:08.462056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:08.462058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:08.462067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:08.462070Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:08.462071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:08.462075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:08.462108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896942260464171:5776]
2025-09-30T14:59:08.462118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:08.462121Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:08.462101Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3135
2025-09-30T14:59:08.462145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.462104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3135
2025-09-30T14:59:08.462155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.462192Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|81825831-da4505b7-cb02664f-94c0e71b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:08.462203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:08.462211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:08.462213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:08.462223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:08.462237Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:08.462262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:08.462496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.462504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.462522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:08.462620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3136 partition: 0 MaxSeqNo: 42 sessionId: src_id|81825831-da4505b7-cb02664f-94c0e71b_0
2025-09-30T14:59:08.463066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2a96d00-cc9ce5ee-15559659-7494cee_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|81825831-da4505b7-cb02664f-94c0e71b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:08.466193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81825831-da4505b7-cb02664f-94c0e71b_0] Write session: try to update token
2025-09-30T14:59:08.466220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81825831-da4505b7-cb02664f-94c0e71b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:08.477193Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:08.477214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:08.477217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:08.477220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:08.477230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896942260464171:5776]
2025-09-30T14:59:08.477236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896942260464171:5776]
2025-09-30T14:59:08.477241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896942260464171:5776]
2025-09-30T14:59:08.477298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:08.477298Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:08.477306Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:08.477309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.477311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:08.477312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:08.477574Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:08.487475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3136 sessionId: src_id|81825831-da4505b7-cb02664f-94c0e71b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:08.490138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:08.517530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896942350266564:10551]
2025-09-30T14:59:08.517726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3135, pipe: [1:7555896942350266564:10551]
2025-09-30T14:59:08.597287Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:08.597792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.597807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.597850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350266564:10551], now have 1 active actors on pipe
2025-09-30T14:59:08.598091Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:08.598164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:08.598177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:08.598245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3136 reason: error at write: Disconnected sessionId: src_id|81825831-da4505b7-cb02664f-94c0e71b_0
2025-09-30T14:59:08.598447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3136 sessionId: src_id|81825831-da4505b7-cb02664f-94c0e71b_0 is DEAD
2025-09-30T14:59:08.598618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81825831-da4505b7-cb02664f-94c0e71b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:08.598627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81825831-da4505b7-cb02664f-94c0e71b_0] Write session will restart in 0.008488s
2025-09-30T14:59:08.598652Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81825831-da4505b7-cb02664f-94c0e71b_0] Write session: Do CDS request
2025-09-30T14:59:08.598640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:08.598659Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81825831-da4505b7-cb02664f-94c0e71b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:08.598684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896942350266564:10551]
2025-09-30T14:59:08.608814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|81825831-da4505b7-cb02664f-94c0e71b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:08.608901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:08.608917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3137
2025-09-30T14:59:08.609067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3137 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:08.609099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3137 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:08.609104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3137 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:08.609108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:08.609502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3137 sessionId:  describe result for acl check
2025-09-30T14:59:08.609544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:08.609552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:08.609554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:08.609560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896942350266633:10268] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:08.610100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896942350266633:10268] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:08.612976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896942350266633:10268] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:08.615694Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896942350266633:10268] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:08.615722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896942350266633:10268] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:08.615726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896942350266633:10268] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:08.615738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3137 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:08.616887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:08.620126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:08.620518Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:08.620540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:08.620561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:08.620687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:08.621089Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896942260464416:12288]
2025-09-30T14:59:08.621951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:08.622467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:08.622541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:08.622922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:08.623018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.623024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.623026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.623027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.623029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.623031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.623032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.623034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.623035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.623036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.623038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.623039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.623041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.623042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.623043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.623050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.623060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.623064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.623069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.623072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.623076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.623080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.623084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.623088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.623092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.623096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.623101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.623105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.623108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.623112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.623120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.623128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.623134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.623140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.623145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.623150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.623155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.623160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.623166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.623172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.623177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.623183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.623189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.623195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.623199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.623205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.623210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.623216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.623221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.623227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.623236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.623256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.623262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.623268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.623272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.623278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.623284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.623289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.623294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.623300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.623345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:08.631353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:08.632392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:08.632415Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:08.632418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:08.632423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:08.632431Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3136 [2:7555896942260464416:12288]
2025-09-30T14:59:08.632450Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:08.632469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:08.632478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:08.632482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:08.632484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:08.632505Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:08.632513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:08.632521Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:08.632599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.632607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.632622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.632625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:08.632628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:08.632984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:08.632996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.633011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.633024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.633045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:08.633063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896942260464411:12288]
2025-09-30T14:59:08.633070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896942260464411:12288]
2025-09-30T14:59:08.633073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896942260464411:12288]
2025-09-30T14:59:08.633090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:08.633110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:08.633130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:08.633137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:08.633176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896942260464411:12288]
2025-09-30T14:59:08.633180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:08.633183Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:08.633184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:08.633185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:08.633192Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:08.633196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350266565:2454], now have 1 active actors on pipe
2025-09-30T14:59:08.633285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3136
2025-09-30T14:59:08.633425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350266788:10268], now have 1 active actors on pipe
2025-09-30T14:59:08.633481Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3136
2025-09-30T14:59:08.633533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.633542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.633570Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:08.633583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:08.633587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:08.633589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:08.633604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:08.633621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:08.633639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:08.633859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.633867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.633881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:08.633970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3137 partition: 0 MaxSeqNo: 42 sessionId: src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0
2025-09-30T14:59:08.634307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|81825831-da4505b7-cb02664f-94c0e71b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:08.637349Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0] Write session: try to update token
2025-09-30T14:59:08.637370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:08.648215Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:08.648239Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:08.648241Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:08.648244Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:08.648254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896942260464411:12288]
2025-09-30T14:59:08.648259Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896942260464411:12288]
2025-09-30T14:59:08.648264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896942260464411:12288]
2025-09-30T14:59:08.648305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:08.648313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.648315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:08.648324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:08.648332Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:08.648336Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:08.648456Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:08.667640Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3137 sessionId: src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:08.670633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:08.698837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896942350266803:10551]
2025-09-30T14:59:08.701164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3136, pipe: [1:7555896942350266803:10551]
2025-09-30T14:59:08.778776Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:08.779364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.779381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.779400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350266803:10551], now have 1 active actors on pipe
2025-09-30T14:59:08.779558Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:08.779651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:08.779664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:08.779724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3137 reason: error at write: Disconnected sessionId: src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0
2025-09-30T14:59:08.779940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3137 sessionId: src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0 is DEAD
2025-09-30T14:59:08.780115Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:08.780122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0] Write session will restart in 0.009003s
2025-09-30T14:59:08.780147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0] Write session: Do CDS request
2025-09-30T14:59:08.780153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:08.780119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:08.780168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896942350266803:10551]
2025-09-30T14:59:08.790767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:08.790798Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:08.790814Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3138
2025-09-30T14:59:08.791029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3138 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:08.791074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3138 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:08.791083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3138 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:08.791088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:08.791634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3138 sessionId:  describe result for acl check
2025-09-30T14:59:08.791669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:08.791671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:08.791672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:08.791678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896942350266909:10245] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:08.792224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896942350266909:10245] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:08.794650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896942350266909:10245] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:08.797505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:08.797596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896942350266909:10245] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:08.797611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896942350266909:10245] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:08.797615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896942350266909:10245] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:08.797623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3138 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:08.800027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:08.800261Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:08.800274Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:08.800286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:08.800346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:08.800388Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896942260464676:12297]
2025-09-30T14:59:08.801020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:08.801389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:08.801441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:08.801789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:08.801864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.801870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.801871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.801872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.801873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.801875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.801876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.801877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.801879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.801880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.801881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.801882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.801884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.801885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.801886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.801891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.801901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.801905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.801909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.801913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.801918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.801922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.801926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.801930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.801934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.801938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.801942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.801946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.801949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.801953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.801960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.801969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.801975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.801980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.801984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.801988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.801992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.801999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.802007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.802011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.802015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.802020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.802024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.802030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.802034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.802039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.802043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.802049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.802053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.802058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.802064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.802069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.802073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.802078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.802089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.802093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.802098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.802103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.802108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.802112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.802152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:08.807717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:08.808908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:08.808924Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:08.808927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:08.808931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:08.808937Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3137 [2:7555896942260464676:12297]
2025-09-30T14:59:08.808954Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:08.808974Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:08.808977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:08.808980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:08.808981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:08.808996Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:08.809003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:08.809017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:08.809076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.809082Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.809084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.809087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:08.809090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:08.809155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:08.809163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.809178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.809194Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.809219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:08.809235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350266830:2454], now have 1 active actors on pipe
2025-09-30T14:59:08.809239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350267054:10245], now have 1 active actors on pipe
2025-09-30T14:59:08.809245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896942260464670:12297]
2025-09-30T14:59:08.809247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896942260464670:12297]
2025-09-30T14:59:08.809252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896942260464670:12297]
2025-09-30T14:59:08.809265Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:08.809277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:08.809281Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:08.809285Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:08.809288Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:08.809294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:08.809297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:08.809330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896942260464670:12297]
2025-09-30T14:59:08.809338Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:08.809295Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3137
2025-09-30T14:59:08.809341Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:08.809351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3137
2025-09-30T14:59:08.809395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.809405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.809428Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|27800453-645b82e-7a934705-59880e22_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:08.809438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:08.809441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:08.809444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:08.809452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:08.809464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:08.809478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:08.809634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.809640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.809650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:08.809719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3138 partition: 0 MaxSeqNo: 42 sessionId: src_id|27800453-645b82e-7a934705-59880e22_0
2025-09-30T14:59:08.810085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ede4a694-f88fc6-7288dc41-e9c016b6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|27800453-645b82e-7a934705-59880e22_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:08.812934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27800453-645b82e-7a934705-59880e22_0] Write session: try to update token
2025-09-30T14:59:08.812962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27800453-645b82e-7a934705-59880e22_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:08.827533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:08.827558Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:08.827568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896942260464670:12297]
2025-09-30T14:59:08.827613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:08.827618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:08.827798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:08.827962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:08.828107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:08.828246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:08.828441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:08.828416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3138 sessionId: src_id|27800453-645b82e-7a934705-59880e22_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:08.828481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:08.831068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:08.832380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.832405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.832424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:08.832426Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:08.832429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:08.832431Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:08.832440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896942260464670:12297]
2025-09-30T14:59:08.832443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896942260464670:12297]
2025-09-30T14:59:08.832447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896942260464670:12297]
2025-09-30T14:59:08.832484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:08.832489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:08.832495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.832497Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:08.832497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:08.832510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:08.832650Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:08.883489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896942350267079:10551]
2025-09-30T14:59:08.883969Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3137, pipe: [1:7555896942350267079:10551]
2025-09-30T14:59:08.949537Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:08.949890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:08.949932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350267079:10551], now have 1 active actors on pipe
2025-09-30T14:59:08.950070Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:08.950823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27800453-645b82e-7a934705-59880e22_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:08.950835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27800453-645b82e-7a934705-59880e22_0] Write session will restart in 0.006876s
2025-09-30T14:59:08.950860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27800453-645b82e-7a934705-59880e22_0] Write session: Do CDS request
2025-09-30T14:59:08.950865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27800453-645b82e-7a934705-59880e22_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:08.950135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:08.950172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:08.950175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:08.950193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896942350267079:10551]
2025-09-30T14:59:08.950249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3138 reason: error at write: Disconnected sessionId: src_id|27800453-645b82e-7a934705-59880e22_0
2025-09-30T14:59:08.950396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3138 sessionId: src_id|27800453-645b82e-7a934705-59880e22_0 is DEAD
2025-09-30T14:59:08.958791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|27800453-645b82e-7a934705-59880e22_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:08.958935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:08.958960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3139
2025-09-30T14:59:08.963519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3139 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:08.963571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3139 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:08.963577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3139 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:08.963582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:08.964044Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3139 sessionId:  describe result for acl check
2025-09-30T14:59:08.964076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:08.964078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:08.964080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:08.964086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896942350267136:10244] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:08.964639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896942350267136:10244] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:08.968730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896942350267136:10244] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:08.973660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896942350267136:10244] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:08.973675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896942350267136:10244] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:08.973681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896942350267136:10244] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:08.973689Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3139 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:08.978723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:08.981408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:08.981662Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:08.981676Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:08.981689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:08.981761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:08.981815Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896942260464913:12305]
2025-09-30T14:59:08.982501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:08.982853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:08.982902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:08.983269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:08.983358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.983366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.983367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.983368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.983370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.983371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.983373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.983374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.983376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.983377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.983379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.983380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.983381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.983382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.983384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.983391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.983402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.983406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.983410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.983414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.983419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.983422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.983426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.983430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.983435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.983438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.983442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.983446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.983450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.983455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.983463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.983472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:08.983478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.983483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:08.983488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.983492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:08.983496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.983500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:08.983506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.983511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:08.983516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.983521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:08.983526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.983532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:08.983536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.983541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:08.983547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.983552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:08.983557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.983585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:08.983592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.983597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.983604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.983609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.983613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.983618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.983625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.983630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:08.983635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.983641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:08.983686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:08.989151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:08.990236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:08.990256Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:08.990259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:08.990263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:08.990270Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3138 [2:7555896942260464913:12305]
2025-09-30T14:59:08.990289Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:08.990305Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:08.990309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:08.990314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:08.990320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:08.990338Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:08.990349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:08.990356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:08.990414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.990421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.990423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.990429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:08.990431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:08.990499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:08.990505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:08.990519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:08.990537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:08.990559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:08.990706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3138
2025-09-30T14:59:08.990706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3138
2025-09-30T14:59:08.990580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896942260464908:12305]
2025-09-30T14:59:08.990587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896942260464908:12305]
2025-09-30T14:59:08.990590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896942260464908:12305]
2025-09-30T14:59:08.990600Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:08.990610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:08.990615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:08.990616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:08.990618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:08.990631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:08.990634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:08.990644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350267265:10244], now have 1 active actors on pipe
2025-09-30T14:59:08.990647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896942350267080:2454], now have 1 active actors on pipe
2025-09-30T14:59:08.990684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896942260464908:12305]
2025-09-30T14:59:08.990692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:08.990728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:08.991116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.991134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.991170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:08.991180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:08.991184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:08.991187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:08.991199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:08.991212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:08.991229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:08.991544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:08.991556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:08.991575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:08.991708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3139 partition: 0 MaxSeqNo: 42 sessionId: src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0
2025-09-30T14:59:08.995363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|27800453-645b82e-7a934705-59880e22_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:08.998190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0] Write session: try to update token
2025-09-30T14:59:08.998209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:09.009826Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:09.009847Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:09.009850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:09.009853Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:09.009863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896942260464908:12305]
2025-09-30T14:59:09.009872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896942260464908:12305]
2025-09-30T14:59:09.009876Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896942260464908:12305]
2025-09-30T14:59:09.009919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:09.009921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:09.009926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.009928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:09.009929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:09.009933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:09.010066Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:09.036051Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3139 sessionId: src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:09.038867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:09.050591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896946645234615:10551]
2025-09-30T14:59:09.050961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3138, pipe: [1:7555896946645234615:10551]
2025-09-30T14:59:09.125297Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:09.125623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.125636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.125652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645234615:10551], now have 1 active actors on pipe
2025-09-30T14:59:09.125888Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:09.125934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:09.125937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:09.126011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3139 reason: error at write: Disconnected sessionId: src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0
2025-09-30T14:59:09.126118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896946645234615:10551]
2025-09-30T14:59:09.126191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3139 sessionId: src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0 is DEAD
2025-09-30T14:59:09.126352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:09.126359Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0] Write session will restart in 0.007835s
2025-09-30T14:59:09.126381Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0] Write session: Do CDS request
2025-09-30T14:59:09.126387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:09.125925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:09.135786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:09.135933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:09.135952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3140
2025-09-30T14:59:09.136362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3140 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:09.136405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3140 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:09.136412Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3140 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:09.136418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:09.137008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3140 sessionId:  describe result for acl check
2025-09-30T14:59:09.137053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:09.137058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:09.137060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:09.137067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896946645234632:8123] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:09.137744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896946645234632:8123] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:09.140394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896946645234632:8123] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:09.145929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896946645234632:8123] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:09.145947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896946645234632:8123] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:09.145951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896946645234632:8123] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:09.145960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3140 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:09.156420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:09.158481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:09.158703Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:09.158717Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:09.158728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:09.158788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:09.158826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896946555432442:12307]
2025-09-30T14:59:09.159567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:09.160006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:09.160069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:09.160440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:09.160516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.160523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.160524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.160525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.160527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.160528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.160530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.160531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.160532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.160534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.160535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.160536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.160538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.160539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.160540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.160546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.160557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.160560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.160564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.160568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.160573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.160577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.160582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.160586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.160591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.160596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.160600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.160603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.160619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.160623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.160631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.160641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.160647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.160653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.160658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.160664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.160668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.160673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.160677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.160682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.160687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.160702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.160707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.160712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.160718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.160723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.160728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.160733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.160738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.160745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.160755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.160759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.160764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.160770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.160781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.160786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.160797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.160802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.160807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.160813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.160865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:09.166768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:09.168158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:09.168174Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:09.168177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:09.168181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:09.168187Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3139 [2:7555896946555432442:12307]
2025-09-30T14:59:09.168205Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:09.168220Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:09.168225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:09.168229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:09.168231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:09.168248Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:09.168258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:09.168265Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:09.168326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.168329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.168331Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.168334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:09.168337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:09.168410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:09.168419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.168433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.168446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.168463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:09.168481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645234748:8123], now have 1 active actors on pipe
2025-09-30T14:59:09.168484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645234617:2454], now have 1 active actors on pipe
2025-09-30T14:59:09.168491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896946555432437:12307]
2025-09-30T14:59:09.168498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896946555432437:12307]
2025-09-30T14:59:09.168500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896946555432437:12307]
2025-09-30T14:59:09.168515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:09.168503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3139
2025-09-30T14:59:09.168528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:09.168541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:09.168544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:09.168504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3139
2025-09-30T14:59:09.168546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:09.168548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:09.168551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:09.168601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.168621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.168638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896946555432437:12307]
2025-09-30T14:59:09.168646Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:09.168653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:09.168677Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:09.168688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:09.168691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:09.168693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:09.168703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:09.168719Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:09.168739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:09.168904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.168918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.168942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:09.169032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3140 partition: 0 MaxSeqNo: 42 sessionId: src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0
2025-09-30T14:59:09.169391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|adcc271-e48e639f-bcc66a4d-eed9b079_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:09.172283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0] Write session: try to update token
2025-09-30T14:59:09.172303Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:09.181366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:09.181388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:09.181391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:09.181393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:09.181402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896946555432437:12307]
2025-09-30T14:59:09.181409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896946555432437:12307]
2025-09-30T14:59:09.181413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896946555432437:12307]
2025-09-30T14:59:09.181453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:09.181460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.181463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:09.181472Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:09.181488Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:09.181492Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:09.181603Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:09.188556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3140 sessionId: src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:09.191324Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:09.226202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896946645234857:10551]
2025-09-30T14:59:09.226467Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3139, pipe: [1:7555896946645234857:10551]
2025-09-30T14:59:09.296543Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:09.297141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.297158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.297181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645234857:10551], now have 1 active actors on pipe
2025-09-30T14:59:09.297445Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:09.297533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896946645234857:10551]
2025-09-30T14:59:09.297550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:09.297563Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:09.297634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3140 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0
2025-09-30T14:59:09.297823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3140 sessionId: src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0 is DEAD
2025-09-30T14:59:09.298200Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:09.298213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0] Write session will restart in 0.007839s
2025-09-30T14:59:09.298238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0] Write session: Do CDS request
2025-09-30T14:59:09.298245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:09.307868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:09.308027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:09.308043Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3141
2025-09-30T14:59:09.308179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3141 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:09.308225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3141 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:09.308235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3141 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:09.308240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:09.308678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3141 sessionId:  describe result for acl check
2025-09-30T14:59:09.308713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:09.308720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:09.308722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:09.308729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896946645234928:8127] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:09.309290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896946645234928:8127] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:09.312546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896946645234928:8127] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:09.315593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896946645234928:8127] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:09.315610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896946645234928:8127] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:09.315614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896946645234928:8127] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:09.315623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3141 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:09.316548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:09.319548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:09.319939Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:09.319957Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:09.319973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:09.320049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:09.320095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896946555432674:12310]
2025-09-30T14:59:09.320802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:09.321215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:09.321299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:09.321715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:09.321805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.321812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.321814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.321815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.321817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.321818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.321820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.321822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.321823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.321825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.321827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.321828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.321829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.321831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.321832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.321840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.321851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.321854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.321858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.321863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.321867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.321870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.321874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.321877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.321881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.321884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.321888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.321892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.321897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.321901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.321911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.321933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.321940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.321947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.321952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.321958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.321963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.321969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.321975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.321981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.321987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.321992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.321998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.322004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.322009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.322015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.322021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.322029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.322034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.322040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.322045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.322051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.322056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.322061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.322066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.322072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.322077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.322082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.322091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.322104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.322152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:09.328075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:09.329337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:09.329359Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:09.329361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:09.329366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:09.329374Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3140 [2:7555896946555432674:12310]
2025-09-30T14:59:09.329392Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:09.329409Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:09.329417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:09.329421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:09.329424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:09.329442Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:09.329449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:09.329457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:09.329530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.329542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.329545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.329549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:09.329551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:09.329625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:09.329628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.329641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.329652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.329670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:09.329687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896946555432669:12310]
2025-09-30T14:59:09.329690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896946555432669:12310]
2025-09-30T14:59:09.329692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896946555432669:12310]
2025-09-30T14:59:09.329701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:09.329716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:09.329720Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:09.329723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:09.329725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:09.329731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:09.329734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:09.329748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645235090:8127], now have 1 active actors on pipe
2025-09-30T14:59:09.329752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645234860:2454], now have 1 active actors on pipe
2025-09-30T14:59:09.329789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896946555432669:12310]
2025-09-30T14:59:09.329797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:09.329812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:09.330072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3140
2025-09-30T14:59:09.330128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3140
2025-09-30T14:59:09.330150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.330159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.330183Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:09.330191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:09.330195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:09.330197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:09.330208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:09.330218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:09.330232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:09.330429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.330436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.330448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:09.331047Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e4379b2c-9966dfff-7c717824-35ba83c9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:09.333944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0] Write session: try to update token
2025-09-30T14:59:09.333962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:09.330646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3141 partition: 0 MaxSeqNo: 42 sessionId: src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0
2025-09-30T14:59:09.342731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:09.342754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:09.342757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:09.342759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:09.342769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896946555432669:12310]
2025-09-30T14:59:09.342774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896946555432669:12310]
2025-09-30T14:59:09.342778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896946555432669:12310]
2025-09-30T14:59:09.342826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:09.342834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.342837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:09.342839Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:09.342847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:09.342851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:09.342994Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:09.351972Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3141 sessionId: src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:09.355155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:09.397731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896946645235110:10551]
2025-09-30T14:59:09.398069Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3140, pipe: [1:7555896946645235110:10551]
2025-09-30T14:59:09.463009Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:09.463613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.463631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.463653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645235110:10551], now have 1 active actors on pipe
2025-09-30T14:59:09.464112Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:09.464005Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896946645235110:10551]
2025-09-30T14:59:09.464043Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:09.464078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:09.464082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:09.464144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3141 reason: error at write: Disconnected sessionId: src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0
2025-09-30T14:59:09.464330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3141 sessionId: src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0 is DEAD
2025-09-30T14:59:09.464862Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:09.464873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0] Write session will restart in 0.006853s
2025-09-30T14:59:09.464898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0] Write session: Do CDS request
2025-09-30T14:59:09.464910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:09.474966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:09.475188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:09.475207Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3142
2025-09-30T14:59:09.475812Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3142 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:09.475857Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3142 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:09.475863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3142 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:09.475868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:09.476470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3142 sessionId:  describe result for acl check
2025-09-30T14:59:09.476513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:09.476516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:09.476518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:09.476524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896946645235156:8131] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:09.477169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896946645235156:8131] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:09.480160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896946645235156:8131] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:09.488259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896946645235156:8131] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:09.488275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896946645235156:8131] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:09.488283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896946645235156:8131] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:09.488329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3142 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:09.492114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:09.496820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:09.497160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:09.497173Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:09.497185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:09.497247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:09.497291Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896946555432919:12313]
2025-09-30T14:59:09.497986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:09.498361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:09.498411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:09.498775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:09.498843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.498849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.498851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.498852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.498853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.498855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.498856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.498857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.498858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.498860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.498861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.498862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.498864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.498865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.498866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.498872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.498883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.498887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.498892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.498895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.498899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.498904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.498908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.498912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.498916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.498920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.498924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.498928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.498932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.498936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.498944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.498951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.498958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.498964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.498969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.498975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.498979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.498984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.498989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.498994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.498999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.499004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.499009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.499016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.499021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.499026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.499032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.499037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.499043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.499047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.499053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.499057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.499063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.499068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.499073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.499078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.499082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.499087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.499092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.499098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.499142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:09.512800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:09.514212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:09.514230Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:09.514232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:09.514236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:09.514243Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3141 [2:7555896946555432919:12313]
2025-09-30T14:59:09.514258Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:09.514272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:09.514275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:09.514279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:09.514281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:09.514296Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:09.514303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:09.514309Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:09.514375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.514383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.514385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.514388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:09.514391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:09.514462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:09.514469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.514483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.514499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.514532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:09.514555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645235338:8131], now have 1 active actors on pipe
2025-09-30T14:59:09.514562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645235111:2454], now have 1 active actors on pipe
2025-09-30T14:59:09.514568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896946555432914:12313]
2025-09-30T14:59:09.514570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896946555432914:12313]
2025-09-30T14:59:09.514573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896946555432914:12313]
2025-09-30T14:59:09.514585Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:09.514602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:09.514615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:09.514620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:09.514623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:09.514627Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:09.514630Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:09.514661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896946555432914:12313]
2025-09-30T14:59:09.514667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:09.514673Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:09.514686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3141
2025-09-30T14:59:09.514686Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3141
2025-09-30T14:59:09.514848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.514864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.514897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:09.514912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:09.514918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:09.514922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:09.514935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:09.514947Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:09.514965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:09.515441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.515453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.515472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:09.515853Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3142 partition: 0 MaxSeqNo: 42 sessionId: src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0
2025-09-30T14:59:09.516252Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e54a1a62-c130c829-8b6ada44-e72a33f8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:09.519777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0] Write session: try to update token
2025-09-30T14:59:09.519802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:09.527808Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:09.527833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:09.527835Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:09.527837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:09.527847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896946555432914:12313]
2025-09-30T14:59:09.527852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896946555432914:12313]
2025-09-30T14:59:09.527855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896946555432914:12313]
2025-09-30T14:59:09.527896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:09.527904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.527906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:09.527929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:09.527947Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:09.527951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:09.528055Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:09.536914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3142 sessionId: src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:09.539894Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:09.564630Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896946645235354:10551]
2025-09-30T14:59:09.565035Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3141, pipe: [1:7555896946645235354:10551]
2025-09-30T14:59:09.652468Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:09.652923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.652939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.652960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645235354:10551], now have 1 active actors on pipe
2025-09-30T14:59:09.653481Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:09.653376Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:09.653438Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896946645235354:10551]
2025-09-30T14:59:09.653465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:09.653468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:09.653534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3142 reason: error at write: Disconnected sessionId: src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0
2025-09-30T14:59:09.653739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3142 sessionId: src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0 is DEAD
2025-09-30T14:59:09.653980Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:09.653990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0] Write session will restart in 0.005823s
2025-09-30T14:59:09.654014Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0] Write session: Do CDS request
2025-09-30T14:59:09.654019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:09.661454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:09.661614Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:09.661638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3143
2025-09-30T14:59:09.663479Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3143 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:09.663543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3143 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:09.663553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3143 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:09.663559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:09.664066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3143 sessionId:  describe result for acl check
2025-09-30T14:59:09.664102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:09.664108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:09.664110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:09.664126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896946645235385:8142] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:09.664785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896946645235385:8142] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:09.668119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896946645235385:8142] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:09.672718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896946645235385:8142] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:09.672736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896946645235385:8142] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:09.672740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896946645235385:8142] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:09.672750Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3143 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:09.676451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:09.678847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:09.679073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:09.679086Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:09.679097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:09.679154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:09.679194Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896946555433155:12316]
2025-09-30T14:59:09.679864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:09.680224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:09.680274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:09.680831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:09.680910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.680915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.680917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.680918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.680919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.680920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.680921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.680922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.680923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.680924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.680926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.680926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.680928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.680928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.680929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.680935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.680944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.680948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.680951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.680955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.680958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.680962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.680965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.680969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.680972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.680975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.680978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.680982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.680985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.680988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.680997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.681004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.681009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.681014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.681018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.681023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.681026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.681031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.681035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.681041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.681044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.681049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.681053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.681057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.681061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.681065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.681070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.681074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.681077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.681082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.681086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.681091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.681094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.681099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.681103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.681107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.681111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.681115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.681119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.681123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.681161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:09.686734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:09.687695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:09.687716Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:09.687719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:09.687723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:09.687731Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3142 [2:7555896946555433155:12316]
2025-09-30T14:59:09.687749Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:09.687776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:09.687779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:09.687783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:09.687785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:09.687801Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:09.687814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:09.687821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:09.687882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.687891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.687892Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.687895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:09.687896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:09.688115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:09.688124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.688139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.688157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.688139Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3142
2025-09-30T14:59:09.688187Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3142
2025-09-30T14:59:09.688179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:09.688203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645235356:2454], now have 1 active actors on pipe
2025-09-30T14:59:09.688212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645235550:8142], now have 1 active actors on pipe
2025-09-30T14:59:09.688223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896946555433150:12316]
2025-09-30T14:59:09.688228Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896946555433150:12316]
2025-09-30T14:59:09.688230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896946555433150:12316]
2025-09-30T14:59:09.688239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:09.688252Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:09.688257Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:09.688262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:09.688264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:09.688264Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:09.688267Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:09.688278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.688282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.688316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896946555433150:12316]
2025-09-30T14:59:09.688324Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:09.688334Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:09.688337Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:09.688343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:09.688345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:09.688347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:09.688354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:09.688362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:09.688399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:09.688582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.688595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.688643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:09.688760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3143 partition: 0 MaxSeqNo: 42 sessionId: src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0
2025-09-30T14:59:09.689170Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9f78fc6c-a401b463-9614fb9c-c24df41c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:09.692125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0] Write session: try to update token
2025-09-30T14:59:09.692149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:09.701345Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:09.701369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:09.701371Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:09.701373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:09.701383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896946555433150:12316]
2025-09-30T14:59:09.701388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896946555433150:12316]
2025-09-30T14:59:09.701393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896946555433150:12316]
2025-09-30T14:59:09.701439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:09.701446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.701449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:09.701605Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:09.707353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:09.707376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:09.707382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:09.709149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3143 sessionId: src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:09.712005Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:09.753543Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896946645235611:10551]
2025-09-30T14:59:09.753934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3142, pipe: [1:7555896946645235611:10551]
2025-09-30T14:59:09.822816Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:09.823817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.823841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.823862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645235611:10551], now have 1 active actors on pipe
2025-09-30T14:59:09.824167Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:09.824192Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896946645235611:10551]
2025-09-30T14:59:09.824235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:09.824311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3143 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0
2025-09-30T14:59:09.824486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3143 sessionId: src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0 is DEAD
2025-09-30T14:59:09.824686Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:09.824959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:09.824971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0] Write session will restart in 0.007540s
2025-09-30T14:59:09.824994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0] Write session: Do CDS request
2025-09-30T14:59:09.825000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:09.833927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:09.833907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:09.833935Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3144
2025-09-30T14:59:09.834179Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3144 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:09.834219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3144 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:09.834231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3144 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:09.834235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:09.834939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3144 sessionId:  describe result for acl check
2025-09-30T14:59:09.834974Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:09.834977Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:09.834978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:09.834984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896946645235652:8154] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:09.835541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896946645235652:8154] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:09.840237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896946645235652:8154] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:09.846860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896946645235652:8154] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:09.846879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896946645235652:8154] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:09.846882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896946645235652:8154] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:09.846891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3144 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:09.850331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:09.853696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:09.853916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:09.853940Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:09.853952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:09.854007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:09.854052Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896946555433419:12324]
2025-09-30T14:59:09.854724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:09.855069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:09.855116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:09.855490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:09.855567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.855575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.855576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.855578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.855579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.855580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.855582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.855583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.855584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.855585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.855587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.855588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.855589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.855590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.855592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.855597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.855607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.855612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.855616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.855620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.855625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.855629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.855633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.855636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.855640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.855644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.855648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.855653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.855657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.855660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.855668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.855677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:09.855683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.855689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:09.855696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.855701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:09.855706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.855712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:09.855716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.855722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:09.855727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.855732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:09.855737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.855742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:09.855746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.855752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:09.855756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.855761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:09.855765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.855770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:09.855775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.855780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.855784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.855789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.855793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.855798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.855803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.855808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:09.855813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.855818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:09.855862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:09.863853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:09.864956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:09.864975Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:09.864978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:09.864982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:09.864989Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3143 [2:7555896946555433419:12324]
2025-09-30T14:59:09.865006Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:09.865020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:09.865031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:09.865035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:09.865037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:09.865053Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:09.865061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:09.865068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:09.865128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.865137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.865139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.865143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:09.865147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:09.865216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:09.865223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.865236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:09.865253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:09.865274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:09.865299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896946555433413:12324]
2025-09-30T14:59:09.865301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896946555433413:12324]
2025-09-30T14:59:09.865303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896946555433413:12324]
2025-09-30T14:59:09.865312Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:09.865322Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:09.865325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:09.865326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645235818:8154], now have 1 active actors on pipe
2025-09-30T14:59:09.865328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:09.865333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645235627:2454], now have 1 active actors on pipe
2025-09-30T14:59:09.865338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:09.865353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:09.865356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:09.865391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896946555433413:12324]
2025-09-30T14:59:09.865402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:09.865620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3143
2025-09-30T14:59:09.865664Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3143
2025-09-30T14:59:09.866064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:09.866277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.866285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.866313Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:09.866323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:09.866328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:09.866330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:09.866346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:09.866370Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:09.866401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:09.866595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.866604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.866619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:09.866703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3144 partition: 0 MaxSeqNo: 42 sessionId: src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0
2025-09-30T14:59:09.867801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a240a132-972a9a4d-97d64fb-cb5cb6e6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:09.871226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0] Write session: try to update token
2025-09-30T14:59:09.871548Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:09.881596Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:09.881618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:09.881619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:09.881621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:09.881628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896946555433413:12324]
2025-09-30T14:59:09.881631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896946555433413:12324]
2025-09-30T14:59:09.881634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896946555433413:12324]
2025-09-30T14:59:09.881668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:09.881674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:09.881676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:09.881806Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:09.883665Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:09.883684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:09.883689Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:09.890858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3144 sessionId: src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:09.893842Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:09.924580Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896946645235881:10551]
2025-09-30T14:59:09.924871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3143, pipe: [1:7555896946645235881:10551]
2025-09-30T14:59:09.998841Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:09.999168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:09.999177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:09.999216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645235881:10551], now have 1 active actors on pipe
2025-09-30T14:59:09.999506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:09.999514Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896946645235881:10551]
2025-09-30T14:59:09.999541Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:09.999611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3144 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0
2025-09-30T14:59:09.999462Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:09.999805Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3144 sessionId: src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0 is DEAD
2025-09-30T14:59:09.999967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:09.999979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0] Write session will restart in 0.005745s
2025-09-30T14:59:10.000004Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0] Write session: Do CDS request
2025-09-30T14:59:10.000010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:10.006770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:10.006863Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:10.006879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3145
2025-09-30T14:59:10.007004Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3145 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:10.007032Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3145 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:10.007037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3145 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:10.007041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:10.007498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3145 sessionId:  describe result for acl check
2025-09-30T14:59:10.007529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:10.007531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:10.007532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:10.007538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896950940203195:8163] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:10.008077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896950940203195:8163] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:10.010959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896950940203195:8163] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:10.015203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896950940203195:8163] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:10.015219Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896950940203195:8163] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:10.015223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896950940203195:8163] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:10.015233Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3145 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:10.022622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:10.027771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:10.028008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:10.028011Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:10.028020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:10.028065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:10.028410Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896950850400959:12332]
2025-09-30T14:59:10.028900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:10.030118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:10.030187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:10.030564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:10.030620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.030622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.030623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.030625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.030626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.030627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.030629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.030630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.030631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.030633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.030634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.030635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.030637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.030638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.030639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.030646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.030657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.030662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.030666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.030670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.030675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.030679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.030683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.030687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.030693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.030697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.030701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.030705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.030709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.030713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.030722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.030730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.030737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.030743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.030748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.030754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.030759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.030764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.030770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.030776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.030780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.030787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.030792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.030797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.030802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.030807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.030812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.030817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.030822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.030827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.030832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.030837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.030843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.030849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.030857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.030862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.030866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.030872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.030876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.030880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.030920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:10.039024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3144
2025-09-30T14:59:10.039073Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3144
2025-09-30T14:59:10.037151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:10.038369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:10.038376Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:10.038379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:10.038383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:10.038391Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3144 [2:7555896950850400959:12332]
2025-09-30T14:59:10.038409Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:10.038426Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:10.038430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:10.038433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:10.038436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:10.038452Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:10.038459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:10.038466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:10.038533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.038535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.038537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.038542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:10.038544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:10.038622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:10.038625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.038636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.038646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.038662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:10.038677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896950850400953:12332]
2025-09-30T14:59:10.038682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896950850400953:12332]
2025-09-30T14:59:10.038684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896950850400953:12332]
2025-09-30T14:59:10.038702Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:10.038716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:10.038729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:10.038729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:10.038732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:10.038734Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:10.038736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:10.038765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896950850400953:12332]
2025-09-30T14:59:10.038768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:10.038824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:10.039085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940203286:8163], now have 1 active actors on pipe
2025-09-30T14:59:10.039089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896946645235882:2454], now have 1 active actors on pipe
2025-09-30T14:59:10.039104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.039110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.039134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60c84087-24d86202-346bb452-3c8f1f11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:10.039142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:10.039146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:10.039148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:10.039158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:10.039169Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:10.039183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:10.039701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.039719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.039749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:10.039934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3145 partition: 0 MaxSeqNo: 42 sessionId: src_id|60c84087-24d86202-346bb452-3c8f1f11_0
2025-09-30T14:59:10.040319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4d5b4ab1-621c8aea-57882679-7af620eb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|60c84087-24d86202-346bb452-3c8f1f11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:10.043502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60c84087-24d86202-346bb452-3c8f1f11_0] Write session: try to update token
2025-09-30T14:59:10.043520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60c84087-24d86202-346bb452-3c8f1f11_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:10.056449Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:10.056477Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:10.056489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896950850400953:12332]
2025-09-30T14:59:10.056537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:10.056753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:10.056912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:10.057058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:10.057203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:10.057518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:10.057562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:10.058014Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:10.064650Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3145 sessionId: src_id|60c84087-24d86202-346bb452-3c8f1f11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:10.067905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:10.068248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.068276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.068297Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:10.068300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:10.068303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:10.068305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:10.068315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896950850400953:12332]
2025-09-30T14:59:10.068320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896950850400953:12332]
2025-09-30T14:59:10.068327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896950850400953:12332]
2025-09-30T14:59:10.068374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:10.068381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:10.068388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.068390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:10.068391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:10.068398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:10.068539Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:10.099714Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896950940203424:10551]
2025-09-30T14:59:10.100227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3144, pipe: [1:7555896950940203424:10551]
2025-09-30T14:59:10.181231Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:10.181715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:10.181749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940203424:10551], now have 1 active actors on pipe
2025-09-30T14:59:10.182200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:10.182310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:10.182318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:10.182387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3145 reason: error at write: Disconnected sessionId: src_id|60c84087-24d86202-346bb452-3c8f1f11_0
2025-09-30T14:59:10.182543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3145 sessionId: src_id|60c84087-24d86202-346bb452-3c8f1f11_0 is DEAD
2025-09-30T14:59:10.182721Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896950940203424:10551]
2025-09-30T14:59:10.182741Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:10.182960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c84087-24d86202-346bb452-3c8f1f11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:10.182971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c84087-24d86202-346bb452-3c8f1f11_0] Write session will restart in 0.008376s
2025-09-30T14:59:10.182994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c84087-24d86202-346bb452-3c8f1f11_0] Write session: Do CDS request
2025-09-30T14:59:10.183000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c84087-24d86202-346bb452-3c8f1f11_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:10.192807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60c84087-24d86202-346bb452-3c8f1f11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:10.192914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:10.192931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3146
2025-09-30T14:59:10.199539Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3146 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:10.199601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3146 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:10.199606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3146 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:10.199612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:10.200094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3146 sessionId:  describe result for acl check
2025-09-30T14:59:10.200130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:10.200132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:10.200134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:10.200140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896950940203530:8183] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:10.200728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896950940203530:8183] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:10.204203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896950940203530:8183] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:10.205308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:10.208039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:10.208247Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:10.208260Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:10.208270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:10.208323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:10.208370Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896950850401197:12335]
2025-09-30T14:59:10.208666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896950940203530:8183] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:10.208682Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896950940203530:8183] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:10.208685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896950940203530:8183] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:10.208694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3146 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:10.209098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:10.209425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:10.209472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:10.209813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:10.209873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.209879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.209881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.209882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.209884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.209885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.209887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.209888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.209890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.209891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.209892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.209894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.209896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.209897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.209898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.209904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.209916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.209921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.209925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.209930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.209934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.209939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.209944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.209948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.209954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.209958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.209963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.209967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.209971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.209976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.209984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.209991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.209998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.210004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.210013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.210019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.210024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.210030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.210036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.210042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.210047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.210053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.210064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.210070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.210075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.210081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.210086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.210091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.210103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.210109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.210118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.210125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.210138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.210145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.210150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.210155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.210160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.210165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.210169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.210174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.210216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:10.215693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:10.216843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:10.216881Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:10.216884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:10.216888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:10.216895Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3145 [2:7555896950850401197:12335]
2025-09-30T14:59:10.216912Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:10.216926Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:10.216935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:10.216938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:10.216940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:10.216956Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:10.216967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:10.216975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:10.217040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.217048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.217051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.217054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:10.217057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:10.217121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:10.217131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.217145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.217160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.217178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:10.217195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940203661:8183], now have 1 active actors on pipe
2025-09-30T14:59:10.217204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940203427:2454], now have 1 active actors on pipe
2025-09-30T14:59:10.217210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896950850401192:12335]
2025-09-30T14:59:10.217212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896950850401192:12335]
2025-09-30T14:59:10.217215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896950850401192:12335]
2025-09-30T14:59:10.217228Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:10.217298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3145
2025-09-30T14:59:10.217247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:10.217298Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3145
2025-09-30T14:59:10.217262Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:10.217267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:10.217268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:10.217269Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:10.217271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:10.217301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896950850401192:12335]
2025-09-30T14:59:10.217310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:10.217323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:10.217539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.217549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.217576Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:10.217588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:10.217592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:10.217600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:10.217608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:10.217621Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:10.217634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:10.217816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.217825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.217838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:10.217918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3146 partition: 0 MaxSeqNo: 42 sessionId: src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0
2025-09-30T14:59:10.218288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60c84087-24d86202-346bb452-3c8f1f11_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:10.221135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0] Write session: try to update token
2025-09-30T14:59:10.221156Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:10.229721Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:10.229744Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:10.229747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:10.229749Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:10.229763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896950850401192:12335]
2025-09-30T14:59:10.229768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896950850401192:12335]
2025-09-30T14:59:10.229771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896950850401192:12335]
2025-09-30T14:59:10.229813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:10.229819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.229820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:10.229822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:10.229826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:10.229830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:10.229962Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:10.236493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3146 sessionId: src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:10.239174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:10.282393Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896950940203672:10551]
2025-09-30T14:59:10.282871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3145, pipe: [1:7555896950940203672:10551]
2025-09-30T14:59:10.347867Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:10.348299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.348309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.348330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940203672:10551], now have 1 active actors on pipe
2025-09-30T14:59:10.348693Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896950940203672:10551]
2025-09-30T14:59:10.348694Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:10.348698Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:10.348769Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3146 reason: error at write: Disconnected sessionId: src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0
2025-09-30T14:59:10.348830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:10.348964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3146 sessionId: src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0 is DEAD
2025-09-30T14:59:10.348609Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:10.349656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:10.349671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0] Write session will restart in 0.007349s
2025-09-30T14:59:10.349695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0] Write session: Do CDS request
2025-09-30T14:59:10.349701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:10.357811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:10.357960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:10.357975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3147
2025-09-30T14:59:10.358178Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3147 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:10.358214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3147 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:10.358227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3147 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:10.358232Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:10.358848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3147 sessionId:  describe result for acl check
2025-09-30T14:59:10.358881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:10.358883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:10.358885Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:10.358892Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896950940203712:8187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:10.359488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896950940203712:8187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:10.364010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896950940203712:8187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:10.368205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896950940203712:8187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:10.368222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896950940203712:8187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:10.368226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896950940203712:8187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:10.368244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3147 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:10.372076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:10.375171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:10.375419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:10.375432Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:10.375444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:10.375508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:10.375555Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896950850401436:12337]
2025-09-30T14:59:10.376236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:10.376786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:10.376842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:10.377230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:10.377308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.377316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.377317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.377319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.377320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.377321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.377323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.377324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.377325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.377327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.377328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.377330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.377331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.377332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.377333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.377340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.377352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.377356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.377360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.377364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.377369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.377372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.377377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.377381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.377385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.377389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.377394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.377398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.377402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.377406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.377427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.377435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.377442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.377448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.377460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.377470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.377474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.377480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.377486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.377492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.377501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.377506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.377515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.377521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.377525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.377530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.377541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.377547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.377556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.377561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.377568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.377574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.377579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.377589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.377594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.377599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.377604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.377610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.377623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.377632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.377676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:10.387061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:10.388185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:10.388200Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:10.388202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:10.388205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:10.388211Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3146 [2:7555896950850401436:12337]
2025-09-30T14:59:10.388224Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:10.388240Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:10.388243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:10.388245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:10.388246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:10.388260Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:10.388266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:10.388271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:10.388324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.388334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.388336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.388340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:10.388343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:10.388414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:10.388422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.388437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.388454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.388473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:10.388493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940203869:8187], now have 1 active actors on pipe
2025-09-30T14:59:10.388502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896950850401430:12337]
2025-09-30T14:59:10.388504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896950850401430:12337]
2025-09-30T14:59:10.388507Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896950850401430:12337]
2025-09-30T14:59:10.388513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:10.388528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:10.388527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:10.388530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:10.388533Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:10.388543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:10.388546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:10.388584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3146
2025-09-30T14:59:10.388630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3146
2025-09-30T14:59:10.388579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940203679:2454], now have 1 active actors on pipe
2025-09-30T14:59:10.388585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896950850401430:12337]
2025-09-30T14:59:10.388587Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:10.388618Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:10.388764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.388775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.388794Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:10.388804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:10.388807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:10.388808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:10.388816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:10.388824Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:10.388839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:10.389141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.389161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.389186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:10.389359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3147 partition: 0 MaxSeqNo: 42 sessionId: src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0
2025-09-30T14:59:10.389711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|71b8299a-5e55d4ce-c946f689-5b3971ff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:10.392552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0] Write session: try to update token
2025-09-30T14:59:10.392572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:10.402643Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:10.402668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:10.402671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:10.402673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:10.402683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896950850401430:12337]
2025-09-30T14:59:10.402688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896950850401430:12337]
2025-09-30T14:59:10.402692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896950850401430:12337]
2025-09-30T14:59:10.402737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:10.402744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.402748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:10.402907Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:10.405121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:10.405142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:10.405150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:10.413687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3147 sessionId: src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:10.416734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:10.448846Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896950940203928:10551]
2025-09-30T14:59:10.449222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3146, pipe: [1:7555896950940203928:10551]
2025-09-30T14:59:10.516735Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:10.517302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.517319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.517341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940203928:10551], now have 1 active actors on pipe
2025-09-30T14:59:10.517681Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:10.517690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896950940203928:10551]
2025-09-30T14:59:10.517721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:10.517723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:10.517728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:10.517810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3147 reason: error at write: Disconnected sessionId: src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0
2025-09-30T14:59:10.517995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3147 sessionId: src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0 is DEAD
2025-09-30T14:59:10.518165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:10.518177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0] Write session will restart in 0.008567s
2025-09-30T14:59:10.518209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0] Write session: Do CDS request
2025-09-30T14:59:10.518218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:10.527744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:10.527861Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:10.527885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3148
2025-09-30T14:59:10.528008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3148 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:10.528041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3148 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:10.528051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3148 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:10.528056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:10.528472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3148 sessionId:  describe result for acl check
2025-09-30T14:59:10.528511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:10.528516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:10.528520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:10.528527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896950940203946:8191] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:10.529110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896950940203946:8191] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:10.533980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896950940203946:8191] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:10.542333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:10.540468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896950940203946:8191] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:10.540487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896950940203946:8191] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:10.540491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896950940203946:8191] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:10.540501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3148 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:10.545171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:10.545406Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:10.545423Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:10.545436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:10.545513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:10.545561Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896950850401687:12340]
2025-09-30T14:59:10.546245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:10.546722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:10.546777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:10.547132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:10.547209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.547218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.547219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.547221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.547222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.547224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.547226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.547227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.547229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.547230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.547232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.547234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.547235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.547237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.547238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.547265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.547275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.547279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.547283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.547286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.547291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.547295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.547300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.547303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.547307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.547311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.547315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.547320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.547324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.547329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.547340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.547353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.547364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.547370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.547375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.547381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.547386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.547391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.547396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.547402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.547407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.547413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.547418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.547423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.547430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.547435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.547441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.547446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.547451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.547457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.547462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.547468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.547473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.547478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.547488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.547493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.547497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.547507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.547512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.547518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.547567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:10.559309Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3147
2025-09-30T14:59:10.559356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3147
2025-09-30T14:59:10.557461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:10.558710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:10.558718Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:10.558721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:10.558726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:10.558733Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3147 [2:7555896950850401687:12340]
2025-09-30T14:59:10.558751Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:10.558769Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:10.558773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:10.558776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:10.558778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:10.558795Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:10.558802Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:10.558810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:10.558879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.558882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.558884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.558889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:10.558891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:10.558975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:10.558978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.558993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.559008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.559027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:10.559045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896950850401682:12340]
2025-09-30T14:59:10.559048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896950850401682:12340]
2025-09-30T14:59:10.559050Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896950850401682:12340]
2025-09-30T14:59:10.559059Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:10.559071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:10.559075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:10.559077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940204163:8191], now have 1 active actors on pipe
2025-09-30T14:59:10.559078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:10.559088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940203930:2454], now have 1 active actors on pipe
2025-09-30T14:59:10.559093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:10.559107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:10.559110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:10.559151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896950850401682:12340]
2025-09-30T14:59:10.559163Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:10.559171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:10.559424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.559430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.559460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:10.559467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:10.559470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:10.559473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:10.559483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:10.559493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:10.559509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:10.559766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.559781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.559794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:10.559890Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3148 partition: 0 MaxSeqNo: 42 sessionId: src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0
2025-09-30T14:59:10.560293Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bf7a1c24-5d3d60e2-af285959-e9a2f7f8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:10.563201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0] Write session: try to update token
2025-09-30T14:59:10.563222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:10.573299Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:10.573321Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:10.573328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:10.573330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:10.573340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896950850401682:12340]
2025-09-30T14:59:10.573345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896950850401682:12340]
2025-09-30T14:59:10.573350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896950850401682:12340]
2025-09-30T14:59:10.573394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:10.573406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.573413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:10.573413Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:10.573420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:10.573424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:10.573557Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:10.589271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3148 sessionId: src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:10.592047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:10.617805Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896950940204178:10551]
2025-09-30T14:59:10.618178Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3147, pipe: [1:7555896950940204178:10551]
2025-09-30T14:59:10.694565Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:10.694928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.694945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.694965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940204178:10551], now have 1 active actors on pipe
2025-09-30T14:59:10.695211Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896950940204178:10551]
2025-09-30T14:59:10.695227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:10.695266Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:10.695269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:10.695336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3148 reason: error at write: Disconnected sessionId: src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0
2025-09-30T14:59:10.695331Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:10.695519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3148 sessionId: src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0 is DEAD
2025-09-30T14:59:10.695698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:10.695709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0] Write session will restart in 0.007168s
2025-09-30T14:59:10.695735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0] Write session: Do CDS request
2025-09-30T14:59:10.695744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:10.707759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:10.707916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:10.707943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3149
2025-09-30T14:59:10.708859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3149 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:10.708907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3149 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:10.708912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3149 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:10.708917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:10.709307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3149 sessionId:  describe result for acl check
2025-09-30T14:59:10.709342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:10.709344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:10.709348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:10.709354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896950940204198:5175] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:10.709914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896950940204198:5175] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:10.712489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896950940204198:5175] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:10.716908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896950940204198:5175] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:10.716923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896950940204198:5175] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:10.716927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896950940204198:5175] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:10.716936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3149 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:10.721984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:10.724792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:10.724989Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:10.725001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:10.725012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:10.725066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:10.725109Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896950850401929:12343]
2025-09-30T14:59:10.725778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:10.726125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:10.726172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:10.726526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:10.726588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.726594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.726595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.726596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.726598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.726599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.726601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.726602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.726603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.726604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.726606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.726607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.726608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.726610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.726611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.726617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.726629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.726634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.726638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.726642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.726646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.726651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.726655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.726659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.726664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.726668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.726672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.726676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.726694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.726703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.726710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.726718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.726724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.726734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.726740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.726750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.726754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.726765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.726770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.726780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.726785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.726795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.726799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.726809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.726813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.726823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.726828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.726838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.726842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.726852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.726857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.726868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.726877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.726883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.726892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.726898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.726906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.726912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.726919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.726924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.726975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:10.733441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:10.734819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:10.734840Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:10.734843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:10.734847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:10.734854Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3148 [2:7555896950850401929:12343]
2025-09-30T14:59:10.734873Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:10.734895Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:10.734903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:10.734906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:10.734908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:10.734927Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:10.734939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:10.734946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:10.735021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.735029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.735031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.735034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:10.735037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:10.735109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:10.735117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.735132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.735146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.735166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:10.735189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940204180:2454], now have 1 active actors on pipe
2025-09-30T14:59:10.735192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940204349:5175], now have 1 active actors on pipe
2025-09-30T14:59:10.735198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896950850401924:12343]
2025-09-30T14:59:10.735200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896950850401924:12343]
2025-09-30T14:59:10.735202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896950850401924:12343]
2025-09-30T14:59:10.735215Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:10.735229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:10.735236Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:10.735260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:10.735261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:10.735263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:10.735264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:10.735302Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896950850401924:12343]
2025-09-30T14:59:10.735314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:10.735323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:10.735647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.735668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.735700Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|50a2a27a-13919a3e-5cae365d-75efb369_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:10.735715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:10.735724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:10.735727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:10.735737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:10.735754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:10.735790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:10.735326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3148
2025-09-30T14:59:10.735326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3148
2025-09-30T14:59:10.738446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.738464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.738493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:10.739387Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3149 partition: 0 MaxSeqNo: 42 sessionId: src_id|50a2a27a-13919a3e-5cae365d-75efb369_0
2025-09-30T14:59:10.743368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d75fc2e-5860383a-166b60e4-7ff8980a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|50a2a27a-13919a3e-5cae365d-75efb369_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:10.746202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a2a27a-13919a3e-5cae365d-75efb369_0] Write session: try to update token
2025-09-30T14:59:10.746226Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a2a27a-13919a3e-5cae365d-75efb369_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:10.747782Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:10.747804Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:10.747813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896950850401924:12343]
2025-09-30T14:59:10.747855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:10.747857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:10.748047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:10.748213Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:10.748372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:10.748526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:10.748758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:10.748796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:10.759661Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:10.759689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:10.759692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:10.759695Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:10.759706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896950850401924:12343]
2025-09-30T14:59:10.759711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896950850401924:12343]
2025-09-30T14:59:10.759716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896950850401924:12343]
2025-09-30T14:59:10.759764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:10.759766Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:10.759772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:10.759772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.759775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:10.759776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:10.759926Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:10.763606Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3149 sessionId: src_id|50a2a27a-13919a3e-5cae365d-75efb369_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:10.767644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:10.795497Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896950940204441:10551]
2025-09-30T14:59:10.796020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3148, pipe: [1:7555896950940204441:10551]
2025-09-30T14:59:10.882306Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:10.882673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.882689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.882711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940204441:10551], now have 1 active actors on pipe
2025-09-30T14:59:10.882934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:10.882985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:10.883033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896950940204441:10551]
2025-09-30T14:59:10.883051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:10.883053Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:10.883121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3149 reason: error at write: Disconnected sessionId: src_id|50a2a27a-13919a3e-5cae365d-75efb369_0
2025-09-30T14:59:10.883320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3149 sessionId: src_id|50a2a27a-13919a3e-5cae365d-75efb369_0 is DEAD
2025-09-30T14:59:10.887551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a2a27a-13919a3e-5cae365d-75efb369_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:10.887565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a2a27a-13919a3e-5cae365d-75efb369_0] Write session will restart in 0.008698s
2025-09-30T14:59:10.887589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a2a27a-13919a3e-5cae365d-75efb369_0] Write session: Do CDS request
2025-09-30T14:59:10.887596Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a2a27a-13919a3e-5cae365d-75efb369_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:10.897805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|50a2a27a-13919a3e-5cae365d-75efb369_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:10.898306Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:10.898320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3150
2025-09-30T14:59:10.898453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3150 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:10.898486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3150 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:10.898491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3150 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:10.898495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:10.899595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3150 sessionId:  describe result for acl check
2025-09-30T14:59:10.899625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:10.899628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:10.899629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:10.899634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896950940204504:5129] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:10.900123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896950940204504:5129] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:10.907273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896950940204504:5129] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:10.912302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896950940204504:5129] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:10.912323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896950940204504:5129] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:10.912325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896950940204504:5129] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:10.912334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3150 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:10.923883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:10.927699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:10.927936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:10.927948Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:10.927959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:10.928023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:10.928062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896950850402206:12351]
2025-09-30T14:59:10.928636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:10.928949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:10.928995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:10.929265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:10.929324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.929329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.929330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.929331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.929332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.929334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.929335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.929336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.929337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.929338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.929340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.929341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.929342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.929343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.929344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.929349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.929361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.929365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.929369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.929373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.929377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.929381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.929385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.929389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.929394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.929398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.929402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.929406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.929411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.929415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.929422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.929430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:10.929436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.929442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:10.929453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.929458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:10.929467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.929472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:10.929477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.929488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:10.929492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.929502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:10.929507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.929517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:10.929522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.929532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:10.929536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.929542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:10.929552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.929557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:10.929569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.929578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.929583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.929592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.929597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.929604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.929609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.929614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:10.929623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.929632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:10.929680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:10.935078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:10.936303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:10.936324Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:10.936326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:10.936331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:10.936338Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3149 [2:7555896950850402206:12351]
2025-09-30T14:59:10.936354Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:10.936375Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:10.936383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:10.936386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:10.936388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:10.936404Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:10.936415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:10.936421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:10.936485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.936493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.936496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.936499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:10.936502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:10.936574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:10.936584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.936612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:10.936624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:10.936641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:10.936666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940204643:5129], now have 1 active actors on pipe
2025-09-30T14:59:10.936675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940204459:2454], now have 1 active actors on pipe
2025-09-30T14:59:10.936682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896950850402201:12351]
2025-09-30T14:59:10.936685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896950850402201:12351]
2025-09-30T14:59:10.936687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896950850402201:12351]
2025-09-30T14:59:10.936700Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:10.936716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:10.936724Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:10.936727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:10.936730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:10.936740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:10.936743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:10.936780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896950850402201:12351]
2025-09-30T14:59:10.936789Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:10.936792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:10.936730Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3149
2025-09-30T14:59:10.936744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3149
2025-09-30T14:59:10.936813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.936823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.936869Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:10.936887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:10.936890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:10.936892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:10.936902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:10.936912Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:10.936938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:10.937125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:10.937137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:10.937155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:10.937255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3150 partition: 0 MaxSeqNo: 42 sessionId: src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0
2025-09-30T14:59:10.937663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|50a2a27a-13919a3e-5cae365d-75efb369_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:10.940461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0] Write session: try to update token
2025-09-30T14:59:10.940484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:10.949882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:10.949907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:10.949909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:10.949911Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:10.949921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896950850402201:12351]
2025-09-30T14:59:10.949926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896950850402201:12351]
2025-09-30T14:59:10.949929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896950850402201:12351]
2025-09-30T14:59:10.949973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:10.949980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:10.949978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:10.949983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:10.949985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:10.949988Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:10.950136Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:10.957421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3150 sessionId: src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:10.960433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:10.983310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896950940204718:10551]
2025-09-30T14:59:10.984147Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3149, pipe: [1:7555896950940204718:10551]
2025-09-30T14:59:11.076968Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:11.077501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.077522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.077567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896950940204718:10551], now have 1 active actors on pipe
2025-09-30T14:59:11.078169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:11.078212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:11.078214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:11.078276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3150 reason: error at write: Disconnected sessionId: src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0
2025-09-30T14:59:11.078449Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3150 sessionId: src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0 is DEAD
2025-09-30T14:59:11.078577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896950940204718:10551]
2025-09-30T14:59:11.078897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:11.078911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0] Write session will restart in 0.008417s
2025-09-30T14:59:11.078937Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0] Write session: Do CDS request
2025-09-30T14:59:11.078942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:11.077943Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:11.088703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:11.089007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:11.089023Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3151
2025-09-30T14:59:11.089249Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3151 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:11.089296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3151 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:11.089307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3151 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:11.089323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:11.089825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3151 sessionId:  describe result for acl check
2025-09-30T14:59:11.089859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:11.089861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:11.089863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:11.089869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896955235172029:5124] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:11.090394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896955235172029:5124] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:11.092528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896955235172029:5124] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:11.096280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896955235172029:5124] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:11.096296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896955235172029:5124] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:11.096300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896955235172029:5124] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:11.096309Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3151 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:11.110589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:11.112946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:11.113425Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:11.113443Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:11.113460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:11.113535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:11.113571Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896955145369746:12359]
2025-09-30T14:59:11.114239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:11.114614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:11.114674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:11.115035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:11.115120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.115132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.115133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.115135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.115136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.115137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.115138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.115139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.115140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.115141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.115143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.115144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.115145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.115147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.115148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.115154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.115165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.115169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.115173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.115177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.115181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.115185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.115189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.115194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.115199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.115203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.115207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.115211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.115215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.115220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.115259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.115270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.115276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.115282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.115286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.115292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.115296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.115301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.115306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.115313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.115318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.115324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.115329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.115335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.115339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.115345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.115350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.115356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.115360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.115365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.115370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.115376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.115380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.115385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.115390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.115395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.115399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.115404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.115409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.115423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.115469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:11.122814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:11.123756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:11.123777Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:11.123781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:11.123785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:11.123792Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3150 [2:7555896955145369746:12359]
2025-09-30T14:59:11.123810Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:11.123829Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:11.123833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:11.123836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:11.123839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:11.123855Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:11.123862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:11.123869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:11.123934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.123943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.123946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.123950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:11.123952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:11.124023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:11.124033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.124047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.124058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.124077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:11.124099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896955145369741:12359]
2025-09-30T14:59:11.124106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896955145369741:12359]
2025-09-30T14:59:11.124108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896955145369741:12359]
2025-09-30T14:59:11.124118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:11.124131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:11.124137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:11.124144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:11.124149Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:11.124150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:11.124152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:11.124162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235172020:2454], now have 1 active actors on pipe
2025-09-30T14:59:11.124166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235172083:5124], now have 1 active actors on pipe
2025-09-30T14:59:11.124202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896955145369741:12359]
2025-09-30T14:59:11.124217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:11.124243Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3150
2025-09-30T14:59:11.124424Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3150
2025-09-30T14:59:11.124535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:11.124727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.124744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.124774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:11.124791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:11.124800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:11.124802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:11.124814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:11.124829Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:11.124862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:11.125179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.125191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.125219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:11.125351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3151 partition: 0 MaxSeqNo: 42 sessionId: src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0
2025-09-30T14:59:11.125754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ee6d26ab-bb1e4bfa-8dd94819-3a57686c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:11.128555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0] Write session: try to update token
2025-09-30T14:59:11.128577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:11.138458Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:11.138483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:11.138485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:11.138487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:11.138496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896955145369741:12359]
2025-09-30T14:59:11.138501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896955145369741:12359]
2025-09-30T14:59:11.138506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896955145369741:12359]
2025-09-30T14:59:11.138559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:11.138561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:11.138565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.138568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:11.138568Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:11.138572Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:11.138704Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:11.152380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3151 sessionId: src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:11.155313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:11.178953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896955235172274:10551]
2025-09-30T14:59:11.179457Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3150, pipe: [1:7555896955235172274:10551]
2025-09-30T14:59:11.291396Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:11.292112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.292128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.292169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235172274:10551], now have 1 active actors on pipe
2025-09-30T14:59:11.293659Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896955235172274:10551]
2025-09-30T14:59:11.293697Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:11.293731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:11.293734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:11.293792Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3151 reason: error at write: Disconnected sessionId: src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0
2025-09-30T14:59:11.293981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3151 sessionId: src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0 is DEAD
2025-09-30T14:59:11.294699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:11.294712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0] Write session will restart in 0.007324s
2025-09-30T14:59:11.294737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0] Write session: Do CDS request
2025-09-30T14:59:11.294743Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:11.293344Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:11.303932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:11.308779Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:11.308796Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3152
2025-09-30T14:59:11.311368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3152 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:11.311418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3152 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:11.311428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3152 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:11.311432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:11.312008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3152 sessionId:  describe result for acl check
2025-09-30T14:59:11.312044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:11.312047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:11.312048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:11.312055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896955235172338:5115] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:11.312580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896955235172338:5115] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:11.319201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896955235172338:5115] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:11.324891Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896955235172338:5115] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:11.324906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896955235172338:5115] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:11.324910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896955235172338:5115] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:11.324919Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3152 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:11.342519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:11.351298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:11.351541Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:11.351545Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:11.351556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:11.351605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:11.351643Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896955145369992:12362]
2025-09-30T14:59:11.352413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:11.359556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:11.359641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:11.360065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:11.360116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.360118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.360119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.360121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.360122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.360123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.360125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.360126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.360128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.360129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.360131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.360132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.360134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.360136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.360137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.360143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.360153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.360158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.360162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.360167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.360171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.360175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.360180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.360183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.360188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.360192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.360196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.360200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.360205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.360209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.360217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.360226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.360232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.360238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.360244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.360249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.360254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.360260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.360264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.360271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.360276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.360282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.360287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.360293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.360298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.360304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.360310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.360316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.360320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.360325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.360333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.360338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.360344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.360349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.360354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.360360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.360365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.360371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.360378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.360384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.360429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:11.366870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:11.367842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:11.367849Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:11.367852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:11.367856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:11.367863Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3151 [2:7555896955145369992:12362]
2025-09-30T14:59:11.367882Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:11.367899Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:11.367902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:11.367906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:11.367909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:11.367925Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:11.367932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:11.367939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:11.368007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.368009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.368011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.368015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:11.368018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:11.368092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:11.368095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.368108Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.368120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.368137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:11.368154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896955145369986:12362]
2025-09-30T14:59:11.368157Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896955145369986:12362]
2025-09-30T14:59:11.368159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896955145369986:12362]
2025-09-30T14:59:11.368167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:11.368181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:11.368196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:11.368199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:11.368232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896955145369986:12362]
2025-09-30T14:59:11.368235Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:11.368394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:11.368396Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:11.368398Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:11.368404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:11.368696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235172477:5115], now have 1 active actors on pipe
2025-09-30T14:59:11.368700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235172276:2454], now have 1 active actors on pipe
2025-09-30T14:59:11.369392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3151
2025-09-30T14:59:11.369444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3151
2025-09-30T14:59:11.375453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.375478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.375516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16dd218-641a4283-f9738229-2461a200_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:11.375528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:11.375533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:11.375536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:11.375548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:11.375564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:11.375582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:11.375914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.375920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.375931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:11.376468Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67910b3-d7e3492f-7037607c-874cfa5c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|16dd218-641a4283-f9738229-2461a200_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:11.379239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16dd218-641a4283-f9738229-2461a200_0] Write session: try to update token
2025-09-30T14:59:11.379282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16dd218-641a4283-f9738229-2461a200_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:11.376058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3152 partition: 0 MaxSeqNo: 42 sessionId: src_id|16dd218-641a4283-f9738229-2461a200_0
2025-09-30T14:59:11.384618Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:11.384643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:11.384646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:11.384648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:11.384662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896955145369986:12362]
2025-09-30T14:59:11.384667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896955145369986:12362]
2025-09-30T14:59:11.384671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896955145369986:12362]
2025-09-30T14:59:11.384713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:11.384719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.384722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:11.384725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:11.384733Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:11.384738Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:11.384853Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:11.394020Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896955235172536:10551]
2025-09-30T14:59:11.394425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3151, pipe: [1:7555896955235172536:10551]
2025-09-30T14:59:11.409285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3152 sessionId: src_id|16dd218-641a4283-f9738229-2461a200_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:11.412157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:11.515544Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:11.516046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235172536:10551], now have 1 active actors on pipe
2025-09-30T14:59:11.516074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.516080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.516354Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:11.517247Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896955235172536:10551]
2025-09-30T14:59:11.517271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:11.517326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3152 reason: status is not ok: tablet will be restarted right now sessionId: src_id|16dd218-641a4283-f9738229-2461a200_0
2025-09-30T14:59:11.517476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3152 sessionId: src_id|16dd218-641a4283-f9738229-2461a200_0 is DEAD
2025-09-30T14:59:11.517624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:11.518642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16dd218-641a4283-f9738229-2461a200_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:11.518656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16dd218-641a4283-f9738229-2461a200_0] Write session will restart in 0.006639s
2025-09-30T14:59:11.518680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16dd218-641a4283-f9738229-2461a200_0] Write session: Do CDS request
2025-09-30T14:59:11.518687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16dd218-641a4283-f9738229-2461a200_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:11.526783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16dd218-641a4283-f9738229-2461a200_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:11.526898Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:11.526914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3153
2025-09-30T14:59:11.527075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3153 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:11.527119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3153 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:11.527129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3153 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:11.527133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:11.527602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3153 sessionId:  describe result for acl check
2025-09-30T14:59:11.527634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:11.527640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:11.527641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:11.527647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896955235172567:5089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:11.528164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896955235172567:5089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:11.533899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896955235172567:5089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:11.539158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896955235172567:5089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:11.539173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896955235172567:5089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:11.539176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896955235172567:5089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:11.539185Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3153 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:11.543632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:11.546781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:11.547167Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:11.547183Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:11.547197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:11.547285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:11.547330Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896955145370248:12365]
2025-09-30T14:59:11.548110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:11.548462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:11.548527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:11.549223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:11.549333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.549341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.549343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.549344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.549345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.549347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.549348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.549349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.549350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.549351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.549353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.549354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.549355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.549356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.549357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.549364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.549384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.549388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.549393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.549396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.549400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.549405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.549409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.549412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.549416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.549420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.549424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.549428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.549432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.549435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.549445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.549454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.549460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.549466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.549476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.549482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.549487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.549493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.549499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.549504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.549535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.549541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.549547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.549553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.549567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.549574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.549579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.549589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.549600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.549605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.549616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.549622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.549632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.549638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.549647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.549654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.549663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.549669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.549679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.549684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.549733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:11.555322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:11.556522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:11.556542Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:11.556545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:11.556549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:11.556555Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3152 [2:7555896955145370248:12365]
2025-09-30T14:59:11.556573Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:11.556587Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:11.556608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:11.556617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:11.556620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:11.556637Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:11.556647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:11.556654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:11.556715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.556717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.556719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.556723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:11.556726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:11.556796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:11.556798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.556810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.556823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.556840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:11.556859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235172744:5089], now have 1 active actors on pipe
2025-09-30T14:59:11.556863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235172551:2454], now have 1 active actors on pipe
2025-09-30T14:59:11.556868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896955145370243:12365]
2025-09-30T14:59:11.556871Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896955145370243:12365]
2025-09-30T14:59:11.556873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896955145370243:12365]
2025-09-30T14:59:11.556888Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:11.556904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:11.556909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:11.556913Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:11.556917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:11.556920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:11.556923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:11.556955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896955145370243:12365]
2025-09-30T14:59:11.557063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3152
2025-09-30T14:59:11.557098Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3152
2025-09-30T14:59:11.556963Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:11.556968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:11.557135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.557144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.557175Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b612ca03-ffbbb573-72019396-dace0982_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:11.557183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:11.557187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:11.557190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:11.557210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:11.557221Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:11.557237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:11.557425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.557436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.557450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:11.557571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3153 partition: 0 MaxSeqNo: 42 sessionId: src_id|b612ca03-ffbbb573-72019396-dace0982_0
2025-09-30T14:59:11.558027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16dd218-641a4283-f9738229-2461a200_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b612ca03-ffbbb573-72019396-dace0982_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:11.560880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b612ca03-ffbbb573-72019396-dace0982_0] Write session: try to update token
2025-09-30T14:59:11.560900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b612ca03-ffbbb573-72019396-dace0982_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:11.568898Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:11.568921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:11.568931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896955145370243:12365]
2025-09-30T14:59:11.568965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:11.568972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:11.569143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:11.569290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:11.569431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:11.569570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:11.569756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:11.569795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:11.583615Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:11.583635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:11.583636Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:11.583638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:11.583646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896955145370243:12365]
2025-09-30T14:59:11.583651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896955145370243:12365]
2025-09-30T14:59:11.583654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896955145370243:12365]
2025-09-30T14:59:11.583693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:11.583700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.583700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:11.583703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:11.583705Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:11.583709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:11.583839Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:11.588490Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3153 sessionId: src_id|b612ca03-ffbbb573-72019396-dace0982_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:11.591218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:11.616690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896955235172804:10551]
2025-09-30T14:59:11.617118Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3152, pipe: [1:7555896955235172804:10551]
2025-09-30T14:59:11.701887Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:11.702381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.702389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.702405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235172804:10551], now have 1 active actors on pipe
2025-09-30T14:59:11.702631Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:11.703115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:11.703183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3153 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b612ca03-ffbbb573-72019396-dace0982_0
2025-09-30T14:59:11.703313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:11.703364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896955235172804:10551]
2025-09-30T14:59:11.703381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3153 sessionId: src_id|b612ca03-ffbbb573-72019396-dace0982_0 is DEAD
2025-09-30T14:59:11.707368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b612ca03-ffbbb573-72019396-dace0982_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:11.707391Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b612ca03-ffbbb573-72019396-dace0982_0] Write session will restart in 0.009826s
2025-09-30T14:59:11.707420Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b612ca03-ffbbb573-72019396-dace0982_0] Write session: Do CDS request
2025-09-30T14:59:11.707427Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b612ca03-ffbbb573-72019396-dace0982_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:11.720243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b612ca03-ffbbb573-72019396-dace0982_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:11.720891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:11.720908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3154
2025-09-30T14:59:11.721098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3154 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:11.721132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3154 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:11.721137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3154 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:11.721142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:11.721628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3154 sessionId:  describe result for acl check
2025-09-30T14:59:11.721668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:11.721670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:11.721672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:11.721678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896955235172841:5077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:11.722244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896955235172841:5077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:11.726438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896955235172841:5077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:11.731344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896955235172841:5077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:11.731361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896955235172841:5077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:11.731365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896955235172841:5077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:11.731374Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3154 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:11.741982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:11.744899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:11.745142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:11.745153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:11.745164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:11.745213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:11.745259Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896955145370496:12368]
2025-09-30T14:59:11.745927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:11.746337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:11.746388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:11.746751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:11.746843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.746851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.746853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.746854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.746855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.746856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.746858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.746859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.746860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.746861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.746863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.746864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.746865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.746867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.746868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.746875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.746886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.746890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.746894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.746899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.746903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.746907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.746911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.746915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.746920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.746924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.746929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.746933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.746937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.746941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.746949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.746958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.746966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.746972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.746977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.746983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.746988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.746994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.746999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.747003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.747009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.747014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.747019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.747024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.747029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.747035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.747040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.747045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.747050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.747055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.747060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.747065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.747070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.747076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.747081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.747086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.747091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.747097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.747102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.747107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.747154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:11.755448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:11.756967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:11.756986Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:11.756989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:11.756993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:11.757000Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3153 [2:7555896955145370496:12368]
2025-09-30T14:59:11.757024Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:11.757041Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:11.757044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:11.757047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:11.757049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:11.757067Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:11.757082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:11.757088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:11.757160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.757162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.757166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.757169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:11.757172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:11.757247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:11.757250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.757265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.757278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.757295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:11.757317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235172964:5077], now have 1 active actors on pipe
2025-09-30T14:59:11.757321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235172807:2454], now have 1 active actors on pipe
2025-09-30T14:59:11.757328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896955145370491:12368]
2025-09-30T14:59:11.757331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896955145370491:12368]
2025-09-30T14:59:11.757332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896955145370491:12368]
2025-09-30T14:59:11.757348Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:11.757363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:11.757369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:11.757373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:11.757375Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:11.757378Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:11.757381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:11.757418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896955145370491:12368]
2025-09-30T14:59:11.757429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:11.757438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:11.757483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.757489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.757513Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:11.757521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:11.757526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:11.757528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:11.757540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:11.757549Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:11.757568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:11.757432Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3153
2025-09-30T14:59:11.757438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3153
2025-09-30T14:59:11.761279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.761301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.761349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:11.761484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3154 partition: 0 MaxSeqNo: 42 sessionId: src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0
2025-09-30T14:59:11.761921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b612ca03-ffbbb573-72019396-dace0982_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:11.764851Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0] Write session: try to update token
2025-09-30T14:59:11.764871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:11.772354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:11.772386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:11.772389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:11.772390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:11.772402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896955145370491:12368]
2025-09-30T14:59:11.772409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896955145370491:12368]
2025-09-30T14:59:11.772414Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896955145370491:12368]
2025-09-30T14:59:11.772470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:11.772481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.772480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:11.772485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:11.772486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:11.772491Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:11.772655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:11.785983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3154 sessionId: src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:11.788952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:11.803595Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896955235173072:10551]
2025-09-30T14:59:11.804052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3153, pipe: [1:7555896955235173072:10551]
2025-09-30T14:59:11.896204Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:11.896550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.896572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.896616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235173072:10551], now have 1 active actors on pipe
2025-09-30T14:59:11.896889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:11.896952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:11.897015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896955235173072:10551]
2025-09-30T14:59:11.897035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:11.897112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3154 reason: status is not ok: tablet will be restarted right now sessionId: src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0
2025-09-30T14:59:11.897285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3154 sessionId: src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0 is DEAD
2025-09-30T14:59:11.899347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:11.899362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0] Write session will restart in 0.007939s
2025-09-30T14:59:11.899388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0] Write session: Do CDS request
2025-09-30T14:59:11.899395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:11.911686Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:11.915378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:11.915394Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3155
2025-09-30T14:59:11.915653Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3155 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:11.915684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3155 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:11.915689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3155 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:11.915693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:11.916079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3155 sessionId:  describe result for acl check
2025-09-30T14:59:11.916113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:11.916119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:11.916121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:11.916128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896955235173145:5060] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:11.916686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896955235173145:5060] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:11.920756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896955235173145:5060] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:11.928027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896955235173145:5060] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:11.928042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896955235173145:5060] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:11.928046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896955235173145:5060] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:11.928053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3155 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:11.928244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:11.931846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:11.932244Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:11.932259Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:11.932273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:11.932340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:11.932383Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896955145370755:12370]
2025-09-30T14:59:11.932879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:11.933214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:11.933259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:11.933571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:11.933643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.933649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.933650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.933652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.933653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.933654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.933655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.933656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.933658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.933660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.933661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.933662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.933663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.933664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.933665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.933671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.933681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.933685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.933689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.933694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.933698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.933702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.933705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.933709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.933713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.933717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.933721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.933724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.933728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.933731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.933738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.933746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:11.933753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.933757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:11.933762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.933766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:11.933770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.933774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:11.933779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.933784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:11.933788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.933792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:11.933797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.933804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:11.933808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.933813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:11.933817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.933822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:11.933825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.933839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:11.933843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.933848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.933851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.933856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.933861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.933866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.933870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.933874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:11.933878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.933882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:11.933926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:11.941056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:11.942224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:11.942242Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:11.942245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:11.942249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:11.942256Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3154 [2:7555896955145370755:12370]
2025-09-30T14:59:11.942270Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:11.942285Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:11.942293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:11.942297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:11.942299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:11.942314Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:11.942326Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:11.942332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:11.942392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.942399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.942401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.942407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:11.942410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:11.942473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:11.942482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.942494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:11.942505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:11.942522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:11.942541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235173331:5060], now have 1 active actors on pipe
2025-09-30T14:59:11.942545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235173077:2454], now have 1 active actors on pipe
2025-09-30T14:59:11.942551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896955145370748:12370]
2025-09-30T14:59:11.942553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896955145370748:12370]
2025-09-30T14:59:11.942555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896955145370748:12370]
2025-09-30T14:59:11.942567Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:11.942577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:11.942580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:11.942586Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:11.942589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:11.942593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:11.942596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:11.942628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896955145370748:12370]
2025-09-30T14:59:11.942638Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:11.942678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3154
2025-09-30T14:59:11.942710Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3154
2025-09-30T14:59:11.942670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:11.942804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.942809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.942839Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:11.942846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:11.942850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:11.942851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:11.942861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:11.942871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:11.942896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:11.943269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3155 partition: 0 MaxSeqNo: 42 sessionId: src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0
2025-09-30T14:59:11.943067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:11.943076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:11.943090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:11.947356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83ffb883-4ebe832f-a31b2765-81adbf37_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:11.950331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0] Write session: try to update token
2025-09-30T14:59:11.950356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:11.956751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:11.956774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:11.956777Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:11.956779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:11.956787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896955145370748:12370]
2025-09-30T14:59:11.956791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896955145370748:12370]
2025-09-30T14:59:11.956795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896955145370748:12370]
2025-09-30T14:59:11.956830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:11.956838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:11.956841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:11.956989Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:11.959385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:11.959405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:11.959410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:11.968604Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3155 sessionId: src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:11.972131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:11.999554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896955235173353:10551]
2025-09-30T14:59:11.999988Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3154, pipe: [1:7555896955235173353:10551]
2025-09-30T14:59:12.095290Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:12.095640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.095650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.095670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896955235173353:10551], now have 1 active actors on pipe
2025-09-30T14:59:12.096562Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:12.096623Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:12.096639Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896955235173353:10551]
2025-09-30T14:59:12.095924Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:12.096700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3155 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0
2025-09-30T14:59:12.096996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:12.097003Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0] Write session will restart in 0.008158s
2025-09-30T14:59:12.097026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0] Write session: Do CDS request
2025-09-30T14:59:12.097030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:12.096872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3155 sessionId: src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0 is DEAD
2025-09-30T14:59:12.107365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:12.108756Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:12.108775Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3156
2025-09-30T14:59:12.108952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3156 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:12.109005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3156 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:12.109015Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3156 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:12.109020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:12.109498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3156 sessionId:  describe result for acl check
2025-09-30T14:59:12.109538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:12.109546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:12.109548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:12.109554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896959530140696:5037] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:12.110162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896959530140696:5037] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:12.114838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896959530140696:5037] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:12.118806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896959530140696:5037] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:12.118824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896959530140696:5037] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:12.118827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896959530140696:5037] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:12.118837Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3156 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:12.121467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:12.124081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:12.124385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:12.124396Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:12.124407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:12.124467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:12.124511Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896959440338321:12384]
2025-09-30T14:59:12.125228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:12.125551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:12.125617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:12.125987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:12.126048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.126056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.126057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.126058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.126060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.126061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.126062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.126063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.126065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.126066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.126067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.126069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.126070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.126071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.126073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.126080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.126090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.126095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.126100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.126104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.126108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.126112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.126117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.126121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.126126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.126130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.126134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.126138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.126142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.126146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.126154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.126162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.126169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.126174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.126179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.126185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.126189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.126195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.126201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.126206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.126211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.126216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.126222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.126227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.126232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.126236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.126246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.126251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.126255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.126268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.126277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.126282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.126291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.126296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.126301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.126311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.126316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.126326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.126330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.126336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.126383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:12.131734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:12.133060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:12.133076Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:12.133079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:12.133082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:12.133089Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3155 [2:7555896959440338321:12384]
2025-09-30T14:59:12.133104Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:12.133121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:12.133130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:12.133133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:12.133135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:12.133151Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:12.133163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:12.133175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:12.133236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.133243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.133246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.133249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:12.133252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:12.133320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:12.133330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.133344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.133356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.133374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:12.133393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530140652:2454], now have 1 active actors on pipe
2025-09-30T14:59:12.133396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530140880:5037], now have 1 active actors on pipe
2025-09-30T14:59:12.133401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896959440338316:12384]
2025-09-30T14:59:12.133404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896959440338316:12384]
2025-09-30T14:59:12.133406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896959440338316:12384]
2025-09-30T14:59:12.133445Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3155
2025-09-30T14:59:12.133419Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:12.133431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:12.133433Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:12.133436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:12.133438Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:12.133444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:12.133447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:12.133478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896959440338316:12384]
2025-09-30T14:59:12.133481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:12.133484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:12.133527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.133531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.133506Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3155
2025-09-30T14:59:12.133555Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:12.133570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:12.133574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:12.133576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:12.133588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:12.133597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:12.133611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:12.133876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.133886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.133900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:12.134005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3156 partition: 0 MaxSeqNo: 42 sessionId: src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0
2025-09-30T14:59:12.134314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b8d861c7-ba7c27f7-c6cee2b-7c629947_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:12.137209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0] Write session: try to update token
2025-09-30T14:59:12.137228Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:12.145778Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:12.145798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:12.145806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896959440338316:12384]
2025-09-30T14:59:12.145850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:12.145865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:12.146022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:12.146174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:12.146315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:12.146462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:12.146652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:12.146690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:12.157158Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:12.157178Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:12.157180Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:12.157181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:12.157189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896959440338316:12384]
2025-09-30T14:59:12.157193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896959440338316:12384]
2025-09-30T14:59:12.157196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896959440338316:12384]
2025-09-30T14:59:12.157226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:12.157232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.157233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:12.157236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:12.157241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:12.157246Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:12.157375Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:12.160172Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3156 sessionId: src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:12.162957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:12.196819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896959530140908:10551]
2025-09-30T14:59:12.197108Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3155, pipe: [1:7555896959530140908:10551]
2025-09-30T14:59:12.275771Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:12.276233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.276250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.276272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530140908:10551], now have 1 active actors on pipe
2025-09-30T14:59:12.276638Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896959530140908:10551]
2025-09-30T14:59:12.276638Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:12.276647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:12.276687Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:12.276714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3156 reason: error at write: Disconnected sessionId: src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0
2025-09-30T14:59:12.276638Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:12.276916Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3156 sessionId: src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0 is DEAD
2025-09-30T14:59:12.277592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:12.277604Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0] Write session will restart in 0.006412s
2025-09-30T14:59:12.277628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0] Write session: Do CDS request
2025-09-30T14:59:12.277638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:12.284833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:12.284938Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:12.284953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3157
2025-09-30T14:59:12.285074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3157 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:12.285108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3157 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:12.285129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3157 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:12.285138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:12.285694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3157 sessionId:  describe result for acl check
2025-09-30T14:59:12.285730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:12.285733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:12.285735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:12.285740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896959530140923:5015] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:12.286315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896959530140923:5015] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:12.288647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896959530140923:5015] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:12.291355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896959530140923:5015] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:12.291372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896959530140923:5015] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:12.291376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896959530140923:5015] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:12.291385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3157 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:12.310504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:12.315552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:12.315814Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:12.315828Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:12.315841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:12.315914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:12.316255Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896959440338572:12387]
2025-09-30T14:59:12.316952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:12.317379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:12.317439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:12.317821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:12.317891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.317893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.317894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.317895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.317897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.317898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.317900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.317901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.317902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.317904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.317905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.317906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.317908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.317909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.317911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.317917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.317929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.317933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.317938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.317942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.317947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.317952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.317957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.317961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.317966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.317970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.317975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.317980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.317984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.317989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.317999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.318007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.318014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.318020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.318026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.318032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.318037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.318043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.318049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.318055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.318060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.318066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.318072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.318078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.318083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.318089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.318094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.318099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.318104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.318110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.318116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.318122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.318127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.318132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.318137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.318142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.318147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.318153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.318157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.318162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.318208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:12.324083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:12.325008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:12.325016Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:12.325019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:12.325023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:12.325031Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3156 [2:7555896959440338572:12387]
2025-09-30T14:59:12.325049Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:12.325066Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:12.325070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:12.325074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:12.325076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:12.325092Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:12.325100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:12.325108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:12.325176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.325179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.325181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.325184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:12.325187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:12.325267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:12.325280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.325294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.325307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.325324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:12.325341Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896959440338567:12387]
2025-09-30T14:59:12.325345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896959440338567:12387]
2025-09-30T14:59:12.325350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896959440338567:12387]
2025-09-30T14:59:12.325360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:12.325375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:12.325391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:12.325395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:12.325434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896959440338567:12387]
2025-09-30T14:59:12.325437Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:12.325649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:12.325653Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:12.325656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:12.325661Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:12.325992Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3156
2025-09-30T14:59:12.326036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3156
2025-09-30T14:59:12.327324Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3157 partition: 0 MaxSeqNo: 42 sessionId: src_id|d87d0632-bf878de3-83078e7d-9908a238_0
2025-09-30T14:59:12.327741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2020bcfe-fcc88ea7-4e390a8b-2703ff9f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d87d0632-bf878de3-83078e7d-9908a238_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:12.326086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530140909:2454], now have 1 active actors on pipe
2025-09-30T14:59:12.326100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530140960:5015], now have 1 active actors on pipe
2025-09-30T14:59:12.326643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.326650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.326678Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d87d0632-bf878de3-83078e7d-9908a238_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:12.326688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:12.326692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:12.326694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:12.326710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:12.326724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:12.326739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:12.327189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.327196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.327216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:12.330467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87d0632-bf878de3-83078e7d-9908a238_0] Write session: try to update token
2025-09-30T14:59:12.330485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87d0632-bf878de3-83078e7d-9908a238_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:12.339409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:12.339434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:12.339436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:12.339438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:12.339449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896959440338567:12387]
2025-09-30T14:59:12.339455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896959440338567:12387]
2025-09-30T14:59:12.339459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896959440338567:12387]
2025-09-30T14:59:12.339501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:12.339514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.339514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:12.339520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:12.339524Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:12.339528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:12.339679Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:12.349786Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3157 sessionId: src_id|d87d0632-bf878de3-83078e7d-9908a238_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:12.352629Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:12.377033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896959530141172:10551]
2025-09-30T14:59:12.377566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3156, pipe: [1:7555896959530141172:10551]
2025-09-30T14:59:12.455196Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:12.455765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.455789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.455811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530141172:10551], now have 1 active actors on pipe
2025-09-30T14:59:12.456254Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:12.456510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:12.456565Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896959530141172:10551]
2025-09-30T14:59:12.456583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:12.456585Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:12.456653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3157 reason: error at write: Disconnected sessionId: src_id|d87d0632-bf878de3-83078e7d-9908a238_0
2025-09-30T14:59:12.456817Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3157 sessionId: src_id|d87d0632-bf878de3-83078e7d-9908a238_0 is DEAD
2025-09-30T14:59:12.457015Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87d0632-bf878de3-83078e7d-9908a238_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:12.457026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87d0632-bf878de3-83078e7d-9908a238_0] Write session will restart in 0.007144s
2025-09-30T14:59:12.457050Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87d0632-bf878de3-83078e7d-9908a238_0] Write session: Do CDS request
2025-09-30T14:59:12.457060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87d0632-bf878de3-83078e7d-9908a238_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:12.467306Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d87d0632-bf878de3-83078e7d-9908a238_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:12.467621Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:12.467643Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3158
2025-09-30T14:59:12.467913Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3158 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:12.467956Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3158 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:12.467963Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3158 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:12.467970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:12.468623Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3158 sessionId:  describe result for acl check
2025-09-30T14:59:12.468671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:12.468679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:12.468681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:12.468689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896959530141192:5003] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:12.469434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896959530141192:5003] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:12.473775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896959530141192:5003] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:12.480959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896959530141192:5003] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:12.480981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896959530141192:5003] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:12.480986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896959530141192:5003] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:12.480997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3158 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:12.483763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:12.486328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:12.486672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:12.486685Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:12.486697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:12.486757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:12.486804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896959440338833:12389]
2025-09-30T14:59:12.487514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:12.487889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:12.487933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:12.488264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:12.488328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.488338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.488339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.488340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.488341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.488343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.488344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.488346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.488347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.488349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.488350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.488351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.488352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.488353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.488354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.488360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.488372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.488377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.488381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.488386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.488390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.488395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.488400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.488404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.488408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.488412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.488417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.488421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.488425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.488430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.488440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.488448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.488454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.488461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.488467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.488472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.488477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.488483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.488489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.488494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.488501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.488506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.488512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.488517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.488523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.488528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.488534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.488540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.488544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.488549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.488553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.488558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.488563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.488568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.488572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.488578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.488582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.488588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.488607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.488619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.488670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:12.494781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:12.495806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:12.495825Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:12.495829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:12.495833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:12.495841Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3157 [2:7555896959440338833:12389]
2025-09-30T14:59:12.495859Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:12.495875Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:12.495878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:12.495882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:12.495885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:12.496264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3157
2025-09-30T14:59:12.496303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3157
2025-09-30T14:59:12.495901Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:12.495916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:12.495924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:12.495984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.495986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.495989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.495993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:12.495995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:12.496068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:12.496071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.496087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.496100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.496118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:12.496138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530141415:5003], now have 1 active actors on pipe
2025-09-30T14:59:12.496145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896959440338828:12389]
2025-09-30T14:59:12.496148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896959440338828:12389]
2025-09-30T14:59:12.496150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896959440338828:12389]
2025-09-30T14:59:12.496164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:12.496173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530141177:2454], now have 1 active actors on pipe
2025-09-30T14:59:12.496178Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:12.496181Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:12.496181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:12.496184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:12.496196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:12.496199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:12.496233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896959440338828:12389]
2025-09-30T14:59:12.496241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:12.496249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:12.496583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.496587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.496633Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:12.496640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:12.496645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:12.496647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:12.496658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:12.496667Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:12.496700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:12.497010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.497025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.497044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:12.497152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3158 partition: 0 MaxSeqNo: 42 sessionId: src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0
2025-09-30T14:59:12.497590Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d87d0632-bf878de3-83078e7d-9908a238_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:12.500449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0] Write session: try to update token
2025-09-30T14:59:12.500477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:12.510690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:12.510720Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:12.510723Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:12.510726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:12.510737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896959440338828:12389]
2025-09-30T14:59:12.510750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896959440338828:12389]
2025-09-30T14:59:12.510756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896959440338828:12389]
2025-09-30T14:59:12.510804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:12.510808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:12.510812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.510815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:12.510815Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:12.510821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:12.510968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:12.518872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3158 sessionId: src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:12.521661Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:12.556688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896959530141434:10551]
2025-09-30T14:59:12.556905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3157, pipe: [1:7555896959530141434:10551]
2025-09-30T14:59:12.626029Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:12.626619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.626630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.626649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530141434:10551], now have 1 active actors on pipe
2025-09-30T14:59:12.627135Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896959530141434:10551]
2025-09-30T14:59:12.627169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:12.626868Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:12.627263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3158 reason: status is not ok: tablet will be restarted right now sessionId: src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0
2025-09-30T14:59:12.627447Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:12.627458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3158 sessionId: src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0 is DEAD
2025-09-30T14:59:12.627791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:12.627804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0] Write session will restart in 0.007027s
2025-09-30T14:59:12.627829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0] Write session: Do CDS request
2025-09-30T14:59:12.627835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:12.635819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:12.635894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:12.635911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3159
2025-09-30T14:59:12.636046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3159 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:12.636104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3159 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:12.636115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3159 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:12.636120Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:12.636633Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3159 sessionId:  describe result for acl check
2025-09-30T14:59:12.636677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:12.636685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:12.636687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:12.636693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896959530141447:4999] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:12.637251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896959530141447:4999] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:12.639092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896959530141447:4999] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:12.641907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896959530141447:4999] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:12.641923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896959530141447:4999] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:12.641926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896959530141447:4999] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:12.641934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3159 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:12.660946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:12.663735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:12.663925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:12.663934Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:12.663942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:12.663989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:12.664026Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896959440339085:12393]
2025-09-30T14:59:12.664547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:12.664922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:12.664999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:12.665381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:12.665447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.665454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.665455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.665456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.665458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.665459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.665460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.665461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.665462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.665464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.665465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.665466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.665468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.665469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.665471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.665478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.665489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.665494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.665498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.665503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.665507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.665511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.665514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.665518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.665523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.665528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.665532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.665537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.665541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.665546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.665554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.665563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.665570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.665576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.665581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.665586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.665591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.665597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.665603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.665609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.665613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.665619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.665625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.665632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.665639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.665644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.665649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.665655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.665666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.665672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.665681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.665687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.665692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.665698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.665703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.665709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.665714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.665719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.665724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.665729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.665776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:12.672242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:12.673269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:12.673287Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:12.673290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:12.673294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:12.673300Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3158 [2:7555896959440339085:12393]
2025-09-30T14:59:12.673318Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:12.673341Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:12.673350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:12.673354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:12.673356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:12.673373Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:12.673385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:12.673392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:12.673454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.673462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.673465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.673469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:12.673472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:12.673538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:12.673546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.673560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.673579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.673601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:12.673624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530141485:4999], now have 1 active actors on pipe
2025-09-30T14:59:12.673628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530141435:2454], now have 1 active actors on pipe
2025-09-30T14:59:12.673634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896959440339080:12393]
2025-09-30T14:59:12.673637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896959440339080:12393]
2025-09-30T14:59:12.673639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896959440339080:12393]
2025-09-30T14:59:12.673655Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:12.673673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:12.673684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:12.673693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:12.673697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:12.673697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:12.673700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:12.673730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896959440339080:12393]
2025-09-30T14:59:12.673743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:12.673744Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:12.673777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.673787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.673731Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3158
2025-09-30T14:59:12.673787Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3158
2025-09-30T14:59:12.673817Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b998d0ef-444d04e8-125480cc-48ad73e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:12.673827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:12.673831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:12.673834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:12.673844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:12.673854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:12.673871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:12.674161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.674172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.674196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:12.674524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3159 partition: 0 MaxSeqNo: 42 sessionId: src_id|b998d0ef-444d04e8-125480cc-48ad73e_0
2025-09-30T14:59:12.674911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581655c3-4b31d208-6a0f063c-ef3d3189_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b998d0ef-444d04e8-125480cc-48ad73e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:12.678608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b998d0ef-444d04e8-125480cc-48ad73e_0] Write session: try to update token
2025-09-30T14:59:12.678633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b998d0ef-444d04e8-125480cc-48ad73e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:12.690441Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:12.690469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:12.690483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896959440339080:12393]
2025-09-30T14:59:12.690539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:12.690552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:12.690727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:12.690924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:12.691145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:12.691374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:12.691704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:12.691771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:12.699595Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3159 sessionId: src_id|b998d0ef-444d04e8-125480cc-48ad73e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:12.702147Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:12.702404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.702428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.702462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:12.702569Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:12.704127Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:12.704153Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:12.704156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:12.704158Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:12.704168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896959440339080:12393]
2025-09-30T14:59:12.704172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896959440339080:12393]
2025-09-30T14:59:12.704179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896959440339080:12393]
2025-09-30T14:59:12.704216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:12.704226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:12.704229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.704232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:12.704233Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:12.704238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:12.704379Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:12.727233Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896959530141694:10551]
2025-09-30T14:59:12.727471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3158, pipe: [1:7555896959530141694:10551]
2025-09-30T14:59:12.825554Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:12.834823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.834858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.835042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:12.835117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:12.835208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:12.835316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:12.835371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:12.835381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:12.835458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:12.838816Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:12.838833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:12.838866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3159 reason: error at write: Disconnected sessionId: src_id|b998d0ef-444d04e8-125480cc-48ad73e_0
2025-09-30T14:59:12.839052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:12.839058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3159 sessionId: src_id|b998d0ef-444d04e8-125480cc-48ad73e_0 is DEAD
2025-09-30T14:59:12.839122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896959530141694:10551]
2025-09-30T14:59:12.835538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:12.839285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b998d0ef-444d04e8-125480cc-48ad73e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:12.839298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b998d0ef-444d04e8-125480cc-48ad73e_0] Write session will restart in 0.006866s
2025-09-30T14:59:12.835618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:12.835691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:12.835734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:12.835738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:12.835816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:12.835879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:12.835946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:12.836009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:12.839323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b998d0ef-444d04e8-125480cc-48ad73e_0] Write session: Do CDS request
2025-09-30T14:59:12.836055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:12.836058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:12.839341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b998d0ef-444d04e8-125480cc-48ad73e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:12.836133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:12.836202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:12.836270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:12.836344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:12.836396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:12.836400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:12.836473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:12.836541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:12.836629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:12.836699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:12.836740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:12.836744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:12.836820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:12.836884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:12.836950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:12.837016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:12.837066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:12.837070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:12.837145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:12.837211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:12.837278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:12.837348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:12.837398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:12.837405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:12.837481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:12.837548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:12.837617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:12.837685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:12.837736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:12.837740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:12.837812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:12.837881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:12.837949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:12.838021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:12.838073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:12.838080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:12.838157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:12.838220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:12.838283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:12.838351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:12.838402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:12.838405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:12.838481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530141694:10551], now have 1 active actors on pipe
2025-09-30T14:59:12.839889Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:12.847728Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b998d0ef-444d04e8-125480cc-48ad73e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:12.847859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:12.847878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3160
2025-09-30T14:59:12.848018Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3160 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:12.848077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3160 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:12.848086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3160 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:12.848091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:12.848565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3160 sessionId:  describe result for acl check
2025-09-30T14:59:12.848622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:12.848630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:12.848632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:12.848638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896959530141744:4967] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:12.849206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896959530141744:4967] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:12.851000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896959530141744:4967] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:12.854172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896959530141744:4967] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:12.854188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896959530141744:4967] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:12.854200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896959530141744:4967] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:12.854210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3160 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:12.859419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:12.862250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:12.862479Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:12.862495Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:12.862506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:12.862558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:12.862602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896959440339336:12395]
2025-09-30T14:59:12.863357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:12.863695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:12.863742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:12.864096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:12.864154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.864161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.864163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.864164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.864165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.864167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.864168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.864170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.864172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.864173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.864174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.864175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.864177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.864178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.864179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.864185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.864197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.864202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.864207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.864212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.864217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.864222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.864226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.864231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.864236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.864241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.864246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.864251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.864256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.864261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.864269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.864277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:12.864284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.864291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:12.864296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.864303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:12.864308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.864320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:12.864325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.864336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:12.864341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.864347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:12.864358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.864364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:12.864371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.864378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:12.864383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.864389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:12.864394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.864402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:12.864407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.864413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.864417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.864423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.864429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.864435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.864439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.864446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:12.864451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.864460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:12.864510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:12.872103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:12.873174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:12.873192Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:12.873195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:12.873199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:12.873206Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3159 [2:7555896959440339336:12395]
2025-09-30T14:59:12.873223Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:12.873239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:12.873243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:12.873246Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:12.873248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:12.873265Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:12.873276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:12.873283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:12.873347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.873355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.873357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.873361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:12.873364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:12.873435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:12.873443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.873456Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:12.873469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:12.873494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:12.873516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530141710:2454], now have 1 active actors on pipe
2025-09-30T14:59:12.873528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530141868:4967], now have 1 active actors on pipe
2025-09-30T14:59:12.873534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896959440339331:12395]
2025-09-30T14:59:12.873536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896959440339331:12395]
2025-09-30T14:59:12.873538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896959440339331:12395]
2025-09-30T14:59:12.873554Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:12.873573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:12.873573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:12.873577Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:12.873579Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:12.873594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:12.873599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:12.873636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896959440339331:12395]
2025-09-30T14:59:12.873650Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:12.873675Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:12.874881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3159
2025-09-30T14:59:12.874899Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3159
2025-09-30T14:59:12.875003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.875021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.875053Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:12.875062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:12.875067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:12.875069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:12.875081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:12.875093Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:12.875110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:12.875312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:12.875322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:12.875336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:12.875475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3160 partition: 0 MaxSeqNo: 42 sessionId: src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0
2025-09-30T14:59:12.875841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b998d0ef-444d04e8-125480cc-48ad73e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:12.878613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0] Write session: try to update token
2025-09-30T14:59:12.878631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:12.887775Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:12.887802Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:12.887805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:12.887807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:12.887817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896959440339331:12395]
2025-09-30T14:59:12.887821Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896959440339331:12395]
2025-09-30T14:59:12.887826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896959440339331:12395]
2025-09-30T14:59:12.887868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:12.887876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:12.887879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:12.887878Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:12.887884Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:12.887889Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:12.888022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:12.896883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3160 sessionId: src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:12.899733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:12.939220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896959530141970:10551]
2025-09-30T14:59:12.939555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3159, pipe: [1:7555896959530141970:10551]
2025-09-30T14:59:13.007928Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:13.008705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.008726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.008747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896959530141970:10551], now have 1 active actors on pipe
2025-09-30T14:59:13.008931Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:13.011322Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:13.011388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896959530141970:10551]
2025-09-30T14:59:13.011425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:13.011539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3160 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0
2025-09-30T14:59:13.011742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3160 sessionId: src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0 is DEAD
2025-09-30T14:59:13.012108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:13.012121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0] Write session will restart in 0.006474s
2025-09-30T14:59:13.012145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0] Write session: Do CDS request
2025-09-30T14:59:13.012151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:13.019793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:13.019907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:13.019923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3161
2025-09-30T14:59:13.020151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3161 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:13.020182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3161 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:13.020186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3161 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:13.020190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:13.021155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3161 sessionId:  describe result for acl check
2025-09-30T14:59:13.021193Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:13.021196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:13.021197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:13.021202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896963825109325:4950] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:13.021677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896963825109325:4950] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:13.024918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896963825109325:4950] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:13.030660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896963825109325:4950] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:13.030675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896963825109325:4950] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:13.030679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896963825109325:4950] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:13.030688Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3161 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:13.031713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:13.034071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:13.034307Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:13.034320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:13.034332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:13.034402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:13.034446Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896963735306920:12407]
2025-09-30T14:59:13.035125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:13.036332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:13.036411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:13.036837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:13.036928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.036936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.036938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.036939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.036941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.036942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.036944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.036945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.036947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.036949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.036950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.036952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.036953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.036955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.036956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.036963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.036975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.036981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.036986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.036990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.036995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.037000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.037005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.037009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.037015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.037020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.037024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.037029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.037034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.037039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.037050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.037059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.037066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.037072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.037078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.037085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.037090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.037098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.037104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.037111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.037122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.037128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.037133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.037142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.037147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.037153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.037159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.037170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.037175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.037181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.037187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.037197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.037203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.037214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.037219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.037231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.037236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.037247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.037252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.037263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.037320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:13.043348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:13.044607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:13.044628Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:13.044632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:13.044636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:13.044644Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3160 [2:7555896963735306920:12407]
2025-09-30T14:59:13.044662Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:13.044680Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:13.044683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:13.044687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:13.044689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:13.044706Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:13.044714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:13.044721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:13.044794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.044805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.044809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.044812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:13.044814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:13.044888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:13.044898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.044914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.044932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.044954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:13.044978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896963735306915:12407]
2025-09-30T14:59:13.044981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896963735306915:12407]
2025-09-30T14:59:13.044984Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896963735306915:12407]
2025-09-30T14:59:13.044995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:13.045012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825109536:4950], now have 1 active actors on pipe
2025-09-30T14:59:13.045016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825109285:2454], now have 1 active actors on pipe
2025-09-30T14:59:13.045018Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:13.045021Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:13.045024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:13.045024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:13.045040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:13.045044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:13.045086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896963735306915:12407]
2025-09-30T14:59:13.045094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:13.045102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:13.045134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3160
2025-09-30T14:59:13.045181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3160
2025-09-30T14:59:13.045344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.045358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.045388Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:13.045403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:13.045409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:13.045412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:13.045424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:13.045435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:13.045451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:13.045744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.045755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.045771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:13.045920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3161 partition: 0 MaxSeqNo: 42 sessionId: src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0
2025-09-30T14:59:13.046350Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5d8f7110-d2b331c4-fb6dc525-423974d4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:13.049299Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0] Write session: try to update token
2025-09-30T14:59:13.049325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:13.059130Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:13.059157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:13.059160Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:13.059162Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:13.059173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896963735306915:12407]
2025-09-30T14:59:13.059178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896963735306915:12407]
2025-09-30T14:59:13.059182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896963735306915:12407]
2025-09-30T14:59:13.059228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:13.059236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.059239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:13.059240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:13.059261Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:13.059265Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:13.059444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:13.075549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3161 sessionId: src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:13.078467Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:13.111769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896963825109548:10551]
2025-09-30T14:59:13.112113Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3160, pipe: [1:7555896963825109548:10551]
2025-09-30T14:59:13.188093Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:13.188445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.188460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.188480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825109548:10551], now have 1 active actors on pipe
2025-09-30T14:59:13.188730Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:13.188725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896963825109548:10551]
2025-09-30T14:59:13.188736Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:13.188762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:13.188765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:13.188827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3161 reason: error at write: Disconnected sessionId: src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0
2025-09-30T14:59:13.189014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3161 sessionId: src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0 is DEAD
2025-09-30T14:59:13.189239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:13.189274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0] Write session will restart in 0.007279s
2025-09-30T14:59:13.189306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0] Write session: Do CDS request
2025-09-30T14:59:13.189318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:13.197791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:13.197873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:13.197905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3162
2025-09-30T14:59:13.198037Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3162 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:13.198072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3162 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:13.198080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3162 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:13.198089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:13.198572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3162 sessionId:  describe result for acl check
2025-09-30T14:59:13.198615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:13.198622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:13.198625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:13.198632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896963825109581:4913] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:13.199196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896963825109581:4913] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:13.203482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896963825109581:4913] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:13.206904Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896963825109581:4913] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:13.206919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896963825109581:4913] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:13.206923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896963825109581:4913] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:13.206932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3162 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:13.210898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:13.213381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:13.213603Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:13.213618Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:13.213643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:13.213722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:13.213766Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896963735307175:12412]
2025-09-30T14:59:13.214454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:13.214814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:13.214885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:13.215271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:13.215337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.215343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.215344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.215345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.215346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.215348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.215350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.215351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.215352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.215353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.215354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.215355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.215356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.215357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.215359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.215364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.215374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.215378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.215382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.215386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.215390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.215394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.215398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.215402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.215406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.215410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.215414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.215417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.215422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.215426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.215432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.215441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.215447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.215452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.215459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.215464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.215469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.215474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.215478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.215483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.215488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.215493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.215499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.215504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.215509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.215517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.215522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.215532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.215538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.215548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.215552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.215557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.215561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.215566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.215571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.215576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.215580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.215585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.215590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.215595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.215637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:13.221170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:13.222193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:13.222210Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:13.222213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:13.222217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:13.222224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3161 [2:7555896963735307175:12412]
2025-09-30T14:59:13.222240Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:13.222255Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:13.222264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:13.222267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:13.222269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:13.222285Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:13.222296Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:13.222304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:13.222364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.222371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.222373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.222377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:13.222379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:13.222444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:13.222451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.222463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.222481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.222497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:13.222576Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3161
2025-09-30T14:59:13.222599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3161
2025-09-30T14:59:13.222515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825109554:2454], now have 1 active actors on pipe
2025-09-30T14:59:13.222525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825109745:4913], now have 1 active actors on pipe
2025-09-30T14:59:13.222532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896963735307170:12412]
2025-09-30T14:59:13.222534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896963735307170:12412]
2025-09-30T14:59:13.222536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896963735307170:12412]
2025-09-30T14:59:13.222550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:13.222563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:13.222569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:13.222573Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:13.222576Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:13.222580Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:13.222583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:13.222612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896963735307170:12412]
2025-09-30T14:59:13.222615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:13.222631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:13.222656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.222661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.222684Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:13.222691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:13.222694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:13.222696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:13.222708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:13.222717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:13.222729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:13.222889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.222897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.222910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:13.222989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3162 partition: 0 MaxSeqNo: 42 sessionId: src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0
2025-09-30T14:59:13.223400Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|26ae011d-6b982971-4c9b7963-d7cbbe66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:13.226290Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0] Write session: try to update token
2025-09-30T14:59:13.226312Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:13.236556Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:13.236569Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:13.236572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:13.236574Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:13.236584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896963735307170:12412]
2025-09-30T14:59:13.236602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896963735307170:12412]
2025-09-30T14:59:13.236606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896963735307170:12412]
2025-09-30T14:59:13.236650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:13.236657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.236659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:13.236666Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:13.236674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:13.236678Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:13.236799Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:13.243459Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3162 sessionId: src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:13.246248Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:13.288896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896963825109817:10551]
2025-09-30T14:59:13.289153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3161, pipe: [1:7555896963825109817:10551]
2025-09-30T14:59:13.353635Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:13.353982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.353999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.354019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825109817:10551], now have 1 active actors on pipe
2025-09-30T14:59:13.354262Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:13.354389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:13.354389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896963825109817:10551]
2025-09-30T14:59:13.354415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:13.354418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:13.354479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3162 reason: error at write: Disconnected sessionId: src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0
2025-09-30T14:59:13.354640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3162 sessionId: src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0 is DEAD
2025-09-30T14:59:13.354824Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:13.354836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0] Write session will restart in 0.008785s
2025-09-30T14:59:13.354873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0] Write session: Do CDS request
2025-09-30T14:59:13.354879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:13.367880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:13.368202Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:13.368219Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3163
2025-09-30T14:59:13.368381Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3163 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:13.368597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3163 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:13.368609Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3163 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:13.368614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:13.369127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3163 sessionId:  describe result for acl check
2025-09-30T14:59:13.369167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:13.369175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:13.369177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:13.369184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896963825109841:4907] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:13.369718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896963825109841:4907] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:13.383644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896963825109841:4907] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:13.388789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896963825109841:4907] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:13.388808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896963825109841:4907] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:13.388811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896963825109841:4907] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:13.388820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3163 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:13.391554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:13.394346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:13.394580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:13.394590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:13.394602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:13.394670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:13.394715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896963735307430:12414]
2025-09-30T14:59:13.395403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:13.395859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:13.395920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:13.396307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:13.396381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.396387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.396388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.396389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.396391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.396393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.396394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.396395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.396397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.396398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.396399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.396401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.396402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.396403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.396404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.396410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.396422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.396426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.396430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.396435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.396439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.396444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.396448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.396453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.396459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.396464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.396468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.396472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.396476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.396480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.396488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.396497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.396503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.396509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.396516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.396522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.396527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.396539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.396548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.396554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.396559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.396565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.396575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.396580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.396585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.396602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.396608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.396618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.396625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.396635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.396639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.396645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.396654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.396659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.396664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.396670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.396679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.396684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.396687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.396692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.396733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:13.402838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:13.404295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:13.404318Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:13.404322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:13.404326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:13.404335Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3162 [2:7555896963735307430:12414]
2025-09-30T14:59:13.404357Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:13.404380Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:13.404384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:13.404388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:13.404391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:13.404410Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:13.404418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:13.404427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:13.404511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.404524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.404527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.404531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:13.404533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:13.404630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:13.404639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.404655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.404668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.404684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:13.404703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896963735307425:12414]
2025-09-30T14:59:13.404706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896963735307425:12414]
2025-09-30T14:59:13.404708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896963735307425:12414]
2025-09-30T14:59:13.404727Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:13.404745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:13.404759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:13.404762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:13.404823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896963735307425:12414]
2025-09-30T14:59:13.404826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:13.405008Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:13.405016Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:13.405019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:13.405027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:13.405407Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3162
2025-09-30T14:59:13.405476Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3162
2025-09-30T14:59:13.405476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825110070:4907], now have 1 active actors on pipe
2025-09-30T14:59:13.405488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825109824:2454], now have 1 active actors on pipe
2025-09-30T14:59:13.405529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.405536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.405562Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:13.405574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:13.405578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:13.405580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:13.405596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:13.405611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:13.405630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:13.405881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.405895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.405918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:13.406059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3163 partition: 0 MaxSeqNo: 42 sessionId: src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0
2025-09-30T14:59:13.406503Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12bc9beb-e0444c43-75b0b81c-20770a6a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:13.409709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0] Write session: try to update token
2025-09-30T14:59:13.409737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:13.421781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:13.421798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:13.421801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:13.421803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:13.421813Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896963735307425:12414]
2025-09-30T14:59:13.421818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896963735307425:12414]
2025-09-30T14:59:13.421822Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896963735307425:12414]
2025-09-30T14:59:13.421864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:13.421871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.421874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:13.421887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:13.421895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:13.421900Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:13.422040Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:13.438186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3163 sessionId: src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:13.440951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:13.454306Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896963825110090:10551]
2025-09-30T14:59:13.454629Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3162, pipe: [1:7555896963825110090:10551]
2025-09-30T14:59:13.540605Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:13.541101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.541115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.541136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825110090:10551], now have 1 active actors on pipe
2025-09-30T14:59:13.541428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:13.541441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:13.541476Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896963825110090:10551]
2025-09-30T14:59:13.541505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:13.541511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3163 reason: error at write: Disconnected sessionId: src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0
2025-09-30T14:59:13.541352Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:13.541693Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3163 sessionId: src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0 is DEAD
2025-09-30T14:59:13.541866Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:13.541878Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0] Write session will restart in 0.006504s
2025-09-30T14:59:13.541913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0] Write session: Do CDS request
2025-09-30T14:59:13.541922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:13.549833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:13.549908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:13.549928Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3164
2025-09-30T14:59:13.550078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3164 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:13.550130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3164 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:13.550136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3164 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:13.550141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:13.550595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3164 sessionId:  describe result for acl check
2025-09-30T14:59:13.550636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:13.550639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:13.550641Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:13.550648Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896963825110100:4901] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:13.551286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896963825110100:4901] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:13.554286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896963825110100:4901] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:13.567305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896963825110100:4901] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:13.567326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896963825110100:4901] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:13.567330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896963825110100:4901] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:13.567340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3164 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:13.572788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:13.575700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:13.576052Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:13.576065Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:13.576077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:13.576135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:13.576179Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896963735307697:12417]
2025-09-30T14:59:13.576891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:13.577188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:13.577232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:13.577566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:13.577632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.577634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.577635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.577636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.577637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.577638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.577640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.577641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.577642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.577644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.577645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.577646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.577647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.577649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.577650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.577656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.577667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.577672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.577677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.577682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.577687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.577691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.577696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.577700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.577704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.577708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.577712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.577716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.577720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.577724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.577732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.577740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.577745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.577750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.577757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.577761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.577765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.577769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.577774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.577779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.577784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.577791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.577795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.577801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.577805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.577811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.577816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.577824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.577828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.577834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.577839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.577844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.577848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.577852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.577856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.577861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.577865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.577869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.577873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.577878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.577926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:13.584043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:13.585569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:13.585590Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:13.585593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:13.585597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:13.585605Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3163 [2:7555896963735307697:12417]
2025-09-30T14:59:13.585623Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:13.585642Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:13.585649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:13.585652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:13.585655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:13.585672Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:13.585689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:13.585697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:13.585768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.585776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.585778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.585782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:13.585785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:13.585856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:13.585864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.585878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.585894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.585915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:13.585933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825110283:4901], now have 1 active actors on pipe
2025-09-30T14:59:13.585942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825110093:2454], now have 1 active actors on pipe
2025-09-30T14:59:13.585949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896963735307692:12417]
2025-09-30T14:59:13.585951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896963735307692:12417]
2025-09-30T14:59:13.585953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896963735307692:12417]
2025-09-30T14:59:13.585966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:13.585980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:13.585983Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:13.585986Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:13.585987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:13.586003Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:13.586007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:13.586045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896963735307692:12417]
2025-09-30T14:59:13.586057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:13.586058Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3163
2025-09-30T14:59:13.586072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:13.586097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.586082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3163
2025-09-30T14:59:13.586102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.586133Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:13.586147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:13.586156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:13.586158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:13.586169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:13.586183Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:13.586202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:13.586361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.586370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.586386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:13.586495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3164 partition: 0 MaxSeqNo: 42 sessionId: src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0
2025-09-30T14:59:13.586891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3e5bed28-98e16dd1-73c5ad2f-29c48c59_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:13.589830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0] Write session: try to update token
2025-09-30T14:59:13.589856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:13.606519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:13.606540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:13.606552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896963735307692:12417]
2025-09-30T14:59:13.606612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:13.606838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:13.607009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:13.607172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:13.607392Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:13.607540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:13.607786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:13.607846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:13.615081Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3164 sessionId: src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:13.618027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:13.619199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.619222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.619281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:13.619487Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:13.628442Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:13.628460Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:13.628463Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:13.628465Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:13.628475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896963735307692:12417]
2025-09-30T14:59:13.628479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896963735307692:12417]
2025-09-30T14:59:13.628483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896963735307692:12417]
2025-09-30T14:59:13.628523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:13.628529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.628531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:13.628686Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:13.628795Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:13.628808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:13.628817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:13.645483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896963825110356:10551]
2025-09-30T14:59:13.647657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3163, pipe: [1:7555896963825110356:10551]
2025-09-30T14:59:13.747163Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:13.755910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.755932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.756099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:13.756175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:13.756249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:13.756338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:13.756717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:13.756733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:13.756809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:13.756873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:13.756934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:13.757003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:13.757050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:13.757058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:13.757127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:13.757200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:13.757266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:13.757331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:13.757379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:13.757387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:13.757454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:13.757526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:13.757590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:13.757657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:13.757703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:13.757712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:13.757780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:13.757843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:13.757906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:13.757974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:13.758025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:13.758032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:13.758100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:13.758168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:13.758238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:13.758307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:13.758352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:13.758361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:13.758427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:13.758489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:13.758562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:13.758636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:13.758686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:13.758700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:13.758774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:13.758833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:13.758898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:13.758958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:13.759004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:13.759011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:13.759081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:13.759148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:13.759210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:13.759295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:13.759341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:13.759349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:13.759418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:13.759484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:13.759550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:13.759621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:13.759669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:13.759679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:13.759744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825110356:10551], now have 1 active actors on pipe
2025-09-30T14:59:13.760905Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:13.760919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:13.760947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3164 reason: error at write: Disconnected sessionId: src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0
2025-09-30T14:59:13.761022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896963825110356:10551]
2025-09-30T14:59:13.761152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3164 sessionId: src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0 is DEAD
2025-09-30T14:59:13.761251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:13.760373Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:13.763477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:13.763491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0] Write session will restart in 0.009183s
2025-09-30T14:59:13.763516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0] Write session: Do CDS request
2025-09-30T14:59:13.763522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:13.773843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:13.773922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:13.773937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3165
2025-09-30T14:59:13.774129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3165 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:13.774166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3165 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:13.774194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3165 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:13.774203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:13.774822Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3165 sessionId:  describe result for acl check
2025-09-30T14:59:13.774858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:13.774862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:13.774867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:13.774872Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896963825110444:4883] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:13.775433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896963825110444:4883] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:13.779080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896963825110444:4883] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:13.782442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896963825110444:4883] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:13.782459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896963825110444:4883] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:13.782466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896963825110444:4883] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:13.782475Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3165 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:13.791649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:13.794718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:13.794937Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:13.794951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:13.794963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:13.795036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:13.795079Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896963735307955:12420]
2025-09-30T14:59:13.795756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:13.797181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:13.797249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:13.797659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:13.797743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.797752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.797753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.797755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.797757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.797759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.797760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.797762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.797772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.797774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.797776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.797777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.797779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.797780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.797781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.797787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.797797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.797801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.797805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.797810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.797814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.797818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.797822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.797826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.797831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.797836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.797840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.797844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.797849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.797858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.797868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.797884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.797897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.797903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.797908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.797914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.797924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.797929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.797935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.797943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.797948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.797953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.797959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.797971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.797976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.797983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.797991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.798001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.798005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.798014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.798020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.798025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.798030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.798036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.798042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.798050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.798055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.798064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.798069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.798075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.798121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:13.806158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3164
2025-09-30T14:59:13.806199Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3164
2025-09-30T14:59:13.804636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:13.805675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:13.805682Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:13.805685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:13.805690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:13.805697Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3164 [2:7555896963735307955:12420]
2025-09-30T14:59:13.805725Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:13.805744Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:13.805749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:13.805752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:13.805755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:13.805773Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:13.805780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:13.805786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:13.805853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.805855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.805858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.805862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:13.805864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:13.805943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:13.805947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.805963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.805977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.805996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:13.806014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825110525:4883], now have 1 active actors on pipe
2025-09-30T14:59:13.806018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825110371:2454], now have 1 active actors on pipe
2025-09-30T14:59:13.806025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896963735307950:12420]
2025-09-30T14:59:13.806028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896963735307950:12420]
2025-09-30T14:59:13.806030Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896963735307950:12420]
2025-09-30T14:59:13.806045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:13.806059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:13.806059Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:13.806064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:13.806066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:13.806075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:13.806080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:13.806119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896963735307950:12420]
2025-09-30T14:59:13.806126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:13.806132Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:13.806372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.806380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.806413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2ab01356-97d9c382-914168ad-c73732_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:13.806422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:13.806427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:13.806429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:13.806442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:13.806453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:13.806473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:13.806909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.806921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.806938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:13.807090Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3165 partition: 0 MaxSeqNo: 42 sessionId: src_id|2ab01356-97d9c382-914168ad-c73732_0
2025-09-30T14:59:13.811383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bfcaf52f-64430a54-3a21ee88-df4d886f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2ab01356-97d9c382-914168ad-c73732_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:13.814417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab01356-97d9c382-914168ad-c73732_0] Write session: try to update token
2025-09-30T14:59:13.814445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab01356-97d9c382-914168ad-c73732_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:13.828752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:13.828771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:13.828774Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:13.828776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:13.828786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896963735307950:12420]
2025-09-30T14:59:13.828794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896963735307950:12420]
2025-09-30T14:59:13.828798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896963735307950:12420]
2025-09-30T14:59:13.828843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:13.828850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.828853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:13.828995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:13.831311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:13.831318Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:13.831323Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:13.845325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3165 sessionId: src_id|2ab01356-97d9c382-914168ad-c73732_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:13.847987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:13.861327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896963825110642:10551]
2025-09-30T14:59:13.861621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3164, pipe: [1:7555896963825110642:10551]
2025-09-30T14:59:13.947935Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:13.948326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.948337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.948357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825110642:10551], now have 1 active actors on pipe
2025-09-30T14:59:13.948838Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:13.949362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896963825110642:10551]
2025-09-30T14:59:13.949401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:13.949468Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3165 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2ab01356-97d9c382-914168ad-c73732_0
2025-09-30T14:59:13.949629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3165 sessionId: src_id|2ab01356-97d9c382-914168ad-c73732_0 is DEAD
2025-09-30T14:59:13.949750Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:13.950060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab01356-97d9c382-914168ad-c73732_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:13.950071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab01356-97d9c382-914168ad-c73732_0] Write session will restart in 0.008600s
2025-09-30T14:59:13.950092Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab01356-97d9c382-914168ad-c73732_0] Write session: Do CDS request
2025-09-30T14:59:13.950099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab01356-97d9c382-914168ad-c73732_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:13.959817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab01356-97d9c382-914168ad-c73732_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:13.962588Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:13.962602Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3166
2025-09-30T14:59:13.963137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3166 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:13.963189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3166 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:13.963199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3166 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:13.963208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:13.963715Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3166 sessionId:  describe result for acl check
2025-09-30T14:59:13.963742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:13.963743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:13.963745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:13.963750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896963825110689:4854] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:13.964171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896963825110689:4854] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:13.967961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896963825110689:4854] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:13.972526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896963825110689:4854] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:13.972540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896963825110689:4854] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:13.972544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896963825110689:4854] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:13.972553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3166 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:13.976162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:13.978830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:13.979060Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:13.979069Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:13.979080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:13.979149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:13.979202Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896963735308212:12422]
2025-09-30T14:59:13.979932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:13.980290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:13.980356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:13.980752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:13.980836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.980838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.980839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.980840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.980841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.980843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.980845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.980846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.980847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.980848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.980850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.980851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.980852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.980853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.980855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.980861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.980872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.980875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.980879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.980883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.980888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.980891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.980895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.980899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.980905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.980909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.980912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.980916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.980919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.980923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.980932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.980941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:13.980948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.980954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:13.980959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.980965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:13.980969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.980975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:13.980979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.980984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:13.980988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.980993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:13.980997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.981003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:13.981007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.981012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:13.981017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.981022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:13.981026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.981032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:13.981036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.981041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.981045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.981050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.981055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.981060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.981065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.981071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:13.981078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.981083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:13.981124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:13.987257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:13.988706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:13.988713Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:13.988715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:13.988720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:13.988727Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3165 [2:7555896963735308212:12422]
2025-09-30T14:59:13.988742Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:13.988758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:13.988763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:13.988766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:13.988769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:13.988786Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:13.988793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:13.988800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:13.988869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.988871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.988874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.988878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:13.988882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:13.988949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:13.988952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:13.988967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:13.988980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:13.988995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:13.989015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825110850:4854], now have 1 active actors on pipe
2025-09-30T14:59:13.989018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896963825110644:2454], now have 1 active actors on pipe
2025-09-30T14:59:13.989023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896963735308207:12422]
2025-09-30T14:59:13.989026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896963735308207:12422]
2025-09-30T14:59:13.989028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896963735308207:12422]
2025-09-30T14:59:13.989038Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:13.989049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:13.989051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:13.989053Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:13.989055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:13.989065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:13.989068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:13.989105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896963735308207:12422]
2025-09-30T14:59:13.989117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:13.989156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:13.989394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.989405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.989434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:13.989442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:13.989446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:13.989449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:13.989461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:13.989471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:13.989487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:13.989696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:13.989703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:13.989717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:13.990165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2ab01356-97d9c382-914168ad-c73732_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:13.989094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3165
2025-09-30T14:59:13.989106Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3165
2025-09-30T14:59:13.989793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3166 partition: 0 MaxSeqNo: 42 sessionId: src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0
2025-09-30T14:59:13.993241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0] Write session: try to update token
2025-09-30T14:59:13.993262Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:14.005001Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:14.005016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:14.005018Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:14.005019Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:14.005028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896963735308207:12422]
2025-09-30T14:59:14.005032Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896963735308207:12422]
2025-09-30T14:59:14.005035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896963735308207:12422]
2025-09-30T14:59:14.005068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:14.005074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.005076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:14.005082Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:14.005089Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:14.005094Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:14.005216Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:14.010088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3166 sessionId: src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:14.012831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:14.049226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896968120078219:10551]
2025-09-30T14:59:14.049657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3165, pipe: [1:7555896968120078219:10551]
2025-09-30T14:59:14.121689Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:14.121984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.121999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.122038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120078219:10551], now have 1 active actors on pipe
2025-09-30T14:59:14.122283Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:14.122313Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:14.122328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:14.122334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896968120078219:10551]
2025-09-30T14:59:14.122404Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3166 reason: error at write: Disconnected sessionId: src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0
2025-09-30T14:59:14.122571Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:14.122617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3166 sessionId: src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0 is DEAD
2025-09-30T14:59:14.122778Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:14.122788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0] Write session will restart in 0.006340s
2025-09-30T14:59:14.122812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0] Write session: Do CDS request
2025-09-30T14:59:14.122821Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:14.133007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:14.135541Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:14.135565Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3167
2025-09-30T14:59:14.135717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3167 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:14.135756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3167 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:14.135762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3167 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:14.135768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:14.136498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3167 sessionId:  describe result for acl check
2025-09-30T14:59:14.136534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:14.136537Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:14.136539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:14.136545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896968120078349:4848] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:14.137127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896968120078349:4848] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:14.139699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896968120078349:4848] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:14.143001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:14.145534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896968120078349:4848] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:14.145551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896968120078349:4848] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:14.145554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896968120078349:4848] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:14.145532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:14.145563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3167 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:14.145897Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:14.145914Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:14.145931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:14.146012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:14.146055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896968030275801:12436]
2025-09-30T14:59:14.146719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:14.147007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:14.147064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:14.147420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:14.147502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.147509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.147511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.147512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.147513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.147514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.147516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.147517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.147518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.147519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.147520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.147522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.147523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.147525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.147526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.147532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.147543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.147548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.147552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.147556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.147560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.147564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.147569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.147574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.147579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.147583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.147587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.147592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.147596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.147601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.147611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.147620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.147626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.147632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.147638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.147644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.147648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.147654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.147660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.147665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.147670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.147675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.147679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.147684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.147689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.147694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.147698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.147703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.147707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.147712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.147717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.147722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.147726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.147731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.147736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.147740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.147745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.147759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.147767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.147777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.147826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:14.153445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:14.154663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:14.154682Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:14.154685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:14.154689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:14.154696Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3166 [2:7555896968030275801:12436]
2025-09-30T14:59:14.154712Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:14.154727Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:14.154731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:14.154734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:14.154737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:14.154752Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:14.154758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:14.154765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:14.154827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.154838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.154840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.154844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:14.154846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:14.154908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:14.154914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.154928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.154944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.154969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:14.154991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120078230:2454], now have 1 active actors on pipe
2025-09-30T14:59:14.155000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120078485:4848], now have 1 active actors on pipe
2025-09-30T14:59:14.155006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896968030275795:12436]
2025-09-30T14:59:14.155013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896968030275795:12436]
2025-09-30T14:59:14.155017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896968030275795:12436]
2025-09-30T14:59:14.155031Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:14.155050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:14.155051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:14.155054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:14.155056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:14.155066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:14.155069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:14.155079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3166
2025-09-30T14:59:14.155115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3166
2025-09-30T14:59:14.155105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896968030275795:12436]
2025-09-30T14:59:14.155117Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:14.155129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:14.155155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.155166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.155201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:14.155213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:14.155217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:14.155221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:14.155230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:14.155261Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:14.155280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:14.155568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.155579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.155595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:14.155755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3167 partition: 0 MaxSeqNo: 42 sessionId: src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0
2025-09-30T14:59:14.156110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7045fb88-6c1962f9-b4dbce7d-35c1cac5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:14.158900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0] Write session: try to update token
2025-09-30T14:59:14.158920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:14.167919Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:14.167943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:14.167946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:14.167948Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:14.167958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896968030275795:12436]
2025-09-30T14:59:14.167967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896968030275795:12436]
2025-09-30T14:59:14.167971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896968030275795:12436]
2025-09-30T14:59:14.168012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:14.168017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.168020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:14.168033Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:14.168048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:14.168052Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:14.168163Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:14.175684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3167 sessionId: src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:14.178385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:14.222270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896968120078497:10551]
2025-09-30T14:59:14.222541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3166, pipe: [1:7555896968120078497:10551]
2025-09-30T14:59:14.284025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:14.284213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896968120078497:10551]
2025-09-30T14:59:14.284239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:14.284247Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:14.284316Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3167 reason: error at write: Disconnected sessionId: src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0
2025-09-30T14:59:14.284523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3167 sessionId: src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0 is DEAD
2025-09-30T14:59:14.284889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:14.284902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0] Write session will restart in 0.008420s
2025-09-30T14:59:14.284927Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0] Write session: Do CDS request
2025-09-30T14:59:14.284934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:14.283341Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:14.283701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.283711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.283732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120078497:10551], now have 1 active actors on pipe
2025-09-30T14:59:14.284286Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:14.294786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:14.295576Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:14.295594Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3168
2025-09-30T14:59:14.299391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3168 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:14.299462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3168 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:14.299474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3168 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:14.299480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:14.300005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3168 sessionId:  describe result for acl check
2025-09-30T14:59:14.300039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:14.300042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:14.300044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:14.300050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896968120078555:4837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:14.300655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896968120078555:4837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:14.306448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896968120078555:4837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:14.315418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:14.315896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896968120078555:4837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:14.315912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896968120078555:4837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:14.315915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896968120078555:4837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:14.315925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3168 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:14.321699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:14.321993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:14.322008Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:14.322023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:14.322102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:14.322149Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896968030276061:12439]
2025-09-30T14:59:14.322872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:14.323363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:14.323424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:14.323820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:14.323917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.323918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.323919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.323921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.323922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.323923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.323925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.323926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.323928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.323930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.323931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.323932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.323933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.323934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.323936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.323942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.323954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.323959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.323963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.323967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.323971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.323975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.323979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.323984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.323989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.323993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.323997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.324002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.324006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.324010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.324033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.324041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.324048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.324054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.324059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.324065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.324070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.324076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.324081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.324087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.324091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.324097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.324103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.324109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.324116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.324122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.324128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.324134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.324139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.324145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.324149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.324155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.324159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.324165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.324174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.324180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.324184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.324189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.324194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.324199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.324245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:14.346434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:14.347635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:14.347652Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:14.347655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:14.347658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:14.347665Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3167 [2:7555896968030276061:12439]
2025-09-30T14:59:14.347681Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:14.347696Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:14.347699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:14.347706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:14.347708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:14.347723Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:14.347730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:14.347736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:14.347798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.347806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.347808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.347812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:14.347814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:14.347882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:14.347889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.347902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.347914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.347935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:14.347957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120078756:4837], now have 1 active actors on pipe
2025-09-30T14:59:14.347965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120078498:2454], now have 1 active actors on pipe
2025-09-30T14:59:14.347971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896968030276055:12439]
2025-09-30T14:59:14.347973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896968030276055:12439]
2025-09-30T14:59:14.347976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896968030276055:12439]
2025-09-30T14:59:14.347992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:14.348006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:14.348012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:14.348017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:14.348019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:14.348026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:14.348029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:14.348063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896968030276055:12439]
2025-09-30T14:59:14.348076Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:14.348085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:14.348059Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3167
2025-09-30T14:59:14.348093Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3167
2025-09-30T14:59:14.348114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.348123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.348154Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4352fd93-608b651b-afdcf46-264bb679_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:14.348165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:14.348170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:14.348176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:14.348186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:14.348194Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:14.348208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:14.348553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.348578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.348613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:14.348747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3168 partition: 0 MaxSeqNo: 42 sessionId: src_id|4352fd93-608b651b-afdcf46-264bb679_0
2025-09-30T14:59:14.349149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dced80c-b59bdc8e-405e2711-8cdd8a60_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4352fd93-608b651b-afdcf46-264bb679_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:14.352082Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4352fd93-608b651b-afdcf46-264bb679_0] Write session: try to update token
2025-09-30T14:59:14.352105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4352fd93-608b651b-afdcf46-264bb679_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:14.361668Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:14.361686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:14.361697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896968030276055:12439]
2025-09-30T14:59:14.361741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:14.361920Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:14.362060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:14.362195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:14.362336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:14.362523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:14.362555Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:14.362800Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:14.375990Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:14.376011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:14.376014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:14.376016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:14.376028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896968030276055:12439]
2025-09-30T14:59:14.376038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896968030276055:12439]
2025-09-30T14:59:14.376042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896968030276055:12439]
2025-09-30T14:59:14.376084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:14.376093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.376096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:14.376095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:14.376103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:14.376108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:14.376250Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:14.382563Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3168 sessionId: src_id|4352fd93-608b651b-afdcf46-264bb679_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:14.384592Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896968120078773:10551]
2025-09-30T14:59:14.385013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3167, pipe: [1:7555896968120078773:10551]
2025-09-30T14:59:14.385614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:14.493587Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:14.493927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120078773:10551], now have 1 active actors on pipe
2025-09-30T14:59:14.493955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.493960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.494130Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:14.494544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:14.494607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3168 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4352fd93-608b651b-afdcf46-264bb679_0
2025-09-30T14:59:14.494742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3168 sessionId: src_id|4352fd93-608b651b-afdcf46-264bb679_0 is DEAD
2025-09-30T14:59:14.494853Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896968120078773:10551]
2025-09-30T14:59:14.494868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:14.495051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4352fd93-608b651b-afdcf46-264bb679_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:14.495062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4352fd93-608b651b-afdcf46-264bb679_0] Write session will restart in 0.005202s
2025-09-30T14:59:14.495086Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4352fd93-608b651b-afdcf46-264bb679_0] Write session: Do CDS request
2025-09-30T14:59:14.495091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4352fd93-608b651b-afdcf46-264bb679_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:14.503119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4352fd93-608b651b-afdcf46-264bb679_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:14.503305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:14.503320Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3169
2025-09-30T14:59:14.503513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3169 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:14.503543Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3169 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:14.503549Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3169 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:14.503553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:14.504074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3169 sessionId:  describe result for acl check
2025-09-30T14:59:14.504104Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:14.504107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:14.504110Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:14.504116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896968120078793:4827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:14.504671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896968120078793:4827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:14.518507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896968120078793:4827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:14.536488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896968120078793:4827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:14.536508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896968120078793:4827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:14.536511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896968120078793:4827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:14.536521Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3169 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:14.537860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:14.541836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:14.542095Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:14.542105Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:14.542117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:14.542182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:14.542226Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896968030276333:12442]
2025-09-30T14:59:14.542916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:14.543404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:14.543455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:14.543795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:14.543852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.543853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.543855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.543856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.543857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.543859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.543861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.543862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.543864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.543865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.543866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.543868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.543869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.543870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.543872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.543878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.543889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.543892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.543896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.543900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.543904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.543908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.543912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.543916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.543921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.543925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.543930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.543934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.543938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.543943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.543952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.543960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.543967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.543974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.543979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.543985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.543990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.543996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.544001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.544007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.544012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.544018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.544023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.544029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.544034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.544042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.544059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.544065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.544070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.544075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.544081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.544087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.544092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.544097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.544102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.544108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.544114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.544120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.544124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.544130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.544178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:14.550271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:14.551502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:14.551508Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:14.551511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:14.551515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:14.551520Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3168 [2:7555896968030276333:12442]
2025-09-30T14:59:14.551534Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:14.551549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:14.551553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:14.551556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:14.551558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:14.551576Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:14.551583Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:14.551591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:14.551658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.551660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.551662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.551665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:14.551667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:14.551741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:14.551744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.551758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.551768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.551777Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:14.551791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896968030276328:12442]
2025-09-30T14:59:14.551795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896968030276328:12442]
2025-09-30T14:59:14.551798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896968030276328:12442]
2025-09-30T14:59:14.551806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:14.551821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:14.551821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:14.551826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:14.551828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:14.551838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:14.551841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:14.551850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120079034:4827], now have 1 active actors on pipe
2025-09-30T14:59:14.551854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120078778:2454], now have 1 active actors on pipe
2025-09-30T14:59:14.551885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896968030276328:12442]
2025-09-30T14:59:14.551895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:14.552145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:14.552645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3168
2025-09-30T14:59:14.552677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3168
2025-09-30T14:59:14.553613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.553631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.553667Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:14.553677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:14.553681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:14.553684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:14.553699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:14.553714Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:14.553731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:14.554028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.554035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.554049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:14.554553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4352fd93-608b651b-afdcf46-264bb679_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:14.554156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3169 partition: 0 MaxSeqNo: 42 sessionId: src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0
2025-09-30T14:59:14.557441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0] Write session: try to update token
2025-09-30T14:59:14.557460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:14.566738Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:14.566760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:14.566762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:14.566764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:14.566773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896968030276328:12442]
2025-09-30T14:59:14.566778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896968030276328:12442]
2025-09-30T14:59:14.566783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896968030276328:12442]
2025-09-30T14:59:14.566830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:14.566838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.566837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:14.566841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:14.566844Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:14.566847Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:14.566987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:14.587397Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3169 sessionId: src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:14.590428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:14.594068Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896968120079047:10551]
2025-09-30T14:59:14.594585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3168, pipe: [1:7555896968120079047:10551]
2025-09-30T14:59:14.685962Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:14.686577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.686594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.686615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120079047:10551], now have 1 active actors on pipe
2025-09-30T14:59:14.687007Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:14.687635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:14.687702Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896968120079047:10551]
2025-09-30T14:59:14.687723Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:14.687727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3169 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0
2025-09-30T14:59:14.687892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3169 sessionId: src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0 is DEAD
2025-09-30T14:59:14.688157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:14.688168Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0] Write session will restart in 0.009777s
2025-09-30T14:59:14.688192Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0] Write session: Do CDS request
2025-09-30T14:59:14.688198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:14.699022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:14.699140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:14.699156Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3170
2025-09-30T14:59:14.699307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3170 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:14.699348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3170 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:14.699359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3170 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:14.699368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:14.699820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3170 sessionId:  describe result for acl check
2025-09-30T14:59:14.699854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:14.699856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:14.699858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:14.699864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896968120079081:4807] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:14.700377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896968120079081:4807] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:14.707526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896968120079081:4807] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:14.713166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896968120079081:4807] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:14.713186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896968120079081:4807] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:14.713191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896968120079081:4807] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:14.713199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3170 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:14.722887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:14.726215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:14.726630Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:14.726644Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:14.726658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:14.726726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:14.726776Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896968030276595:12445]
2025-09-30T14:59:14.727509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:14.727906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:14.727971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:14.728356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:14.728422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.728429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.728430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.728431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.728433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.728434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.728435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.728436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.728438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.728439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.728441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.728442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.728443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.728444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.728446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.728459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.728470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.728474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.728479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.728483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.728488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.728493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.728497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.728501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.728506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.728510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.728514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.728518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.728522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.728527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.728535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.728545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.728551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.728557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.728564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.728570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.728574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.728591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.728597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.728603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.728607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.728612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.728619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.728625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.728631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.728637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.728642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.728647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.728653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.728659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.728663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.728668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.728673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.728679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.728687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.728693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.728698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.728703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.728709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.728714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.728759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:14.736643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:14.738018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:14.738037Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:14.738040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:14.738044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:14.738051Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3169 [2:7555896968030276595:12445]
2025-09-30T14:59:14.738071Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:14.738090Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:14.738094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:14.738100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:14.738103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:14.738119Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:14.738126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:14.738133Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:14.738208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.738215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.738218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.738222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:14.738224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:14.738290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:14.738298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.738313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.738324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.738343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:14.738365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896968030276590:12445]
2025-09-30T14:59:14.738371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896968030276590:12445]
2025-09-30T14:59:14.738372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896968030276590:12445]
2025-09-30T14:59:14.738381Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:14.738390Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:14.738392Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:14.738398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120079215:4807], now have 1 active actors on pipe
2025-09-30T14:59:14.738401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:14.738403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:14.738417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:14.738421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:14.738433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120079049:2454], now have 1 active actors on pipe
2025-09-30T14:59:14.738477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896968030276590:12445]
2025-09-30T14:59:14.738489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:14.738514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:14.740943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3169
2025-09-30T14:59:14.740989Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3169
2025-09-30T14:59:14.741108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.741127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.741168Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:14.741185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:14.741195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:14.741198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:14.741212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:14.741233Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:14.741252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:14.741547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.741560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.741578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:14.741746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3170 partition: 0 MaxSeqNo: 42 sessionId: src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0
2025-09-30T14:59:14.742169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba5675d5-7bb1e1e7-88d259ae-73284085_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:14.745207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0] Write session: try to update token
2025-09-30T14:59:14.745232Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:14.756388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:14.756411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:14.756414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:14.756416Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:14.756426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896968030276590:12445]
2025-09-30T14:59:14.756430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896968030276590:12445]
2025-09-30T14:59:14.756435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896968030276590:12445]
2025-09-30T14:59:14.756475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:14.756483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.756485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:14.756653Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:14.757674Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:14.757681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:14.757684Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:14.762180Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3170 sessionId: src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:14.765043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:14.787506Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896968120079331:10551]
2025-09-30T14:59:14.787760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3169, pipe: [1:7555896968120079331:10551]
2025-09-30T14:59:14.876625Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:14.877014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.877029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.877069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120079331:10551], now have 1 active actors on pipe
2025-09-30T14:59:14.877313Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:14.877453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:14.877468Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:14.877535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3170 reason: error at write: Disconnected sessionId: src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0
2025-09-30T14:59:14.877726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3170 sessionId: src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0 is DEAD
2025-09-30T14:59:14.877942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896968120079331:10551]
2025-09-30T14:59:14.877958Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:14.879012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:14.879025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0] Write session will restart in 0.005984s
2025-09-30T14:59:14.879049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0] Write session: Do CDS request
2025-09-30T14:59:14.879058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:14.887093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:14.887194Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:14.887209Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3171
2025-09-30T14:59:14.887499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3171 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:14.887546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3171 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:14.887557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3171 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:14.887564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:14.888059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3171 sessionId:  describe result for acl check
2025-09-30T14:59:14.888095Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:14.888097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:14.888099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:14.888105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896968120079351:4798] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:14.888690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896968120079351:4798] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:14.891332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896968120079351:4798] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:14.898414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896968120079351:4798] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:14.898441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896968120079351:4798] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:14.898447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896968120079351:4798] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:14.898456Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3171 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:14.907884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:14.910931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:14.911155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:14.911168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:14.911193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:14.911283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:14.911324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896968030276856:12447]
2025-09-30T14:59:14.912013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:14.912426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:14.912481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:14.912834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:14.912899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.912904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.912906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.912907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.912908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.912909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.912910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.912911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.912912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.912913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.912915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.912916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.912917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.912918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.912919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.912924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.912933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.912937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.912940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.912944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.912948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.912951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.912954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.912958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.912962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.912965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.912969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.912972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.912976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.912979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.912987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.912995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:14.913001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.913005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:14.913012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.913016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:14.913021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.913025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:14.913030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.913034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:14.913038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.913043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:14.913047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.913052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:14.913056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.913062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:14.913066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.913071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:14.913075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.913079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:14.913084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.913088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.913092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.913097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.913101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.913106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.913110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.913114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:14.913119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.913124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:14.913166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:14.920063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:14.921293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:14.921310Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:14.921312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:14.921317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:14.921324Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3170 [2:7555896968030276856:12447]
2025-09-30T14:59:14.921341Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:14.921360Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:14.921364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:14.921367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:14.921370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:14.921386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:14.921394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:14.921407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:14.921476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.921483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.921486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.921489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:14.921492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:14.921567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:14.921574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.921589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:14.921608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:14.921631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:14.921654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896968030276851:12447]
2025-09-30T14:59:14.921662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896968030276851:12447]
2025-09-30T14:59:14.921664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896968030276851:12447]
2025-09-30T14:59:14.921680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:14.921699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:14.921721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:14.921729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:14.921766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896968030276851:12447]
2025-09-30T14:59:14.921775Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:14.921802Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:14.921807Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:14.921810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:14.921818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:14.922058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120079488:4798], now have 1 active actors on pipe
2025-09-30T14:59:14.922068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120079336:2454], now have 1 active actors on pipe
2025-09-30T14:59:14.922637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3170
2025-09-30T14:59:14.922675Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3170
2025-09-30T14:59:14.922844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.922854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.922883Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:14.922896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:14.922905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:14.922907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:14.922918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:14.922929Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:14.922950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:14.923172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:14.923177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:14.923190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:14.923452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3171 partition: 0 MaxSeqNo: 42 sessionId: src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0
2025-09-30T14:59:14.923852Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cb7988d7-c8da594a-6cd1a436-fd2d5783_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:14.926671Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0] Write session: try to update token
2025-09-30T14:59:14.926690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:14.937474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:14.937501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:14.937504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:14.937506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:14.937517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896968030276851:12447]
2025-09-30T14:59:14.937522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896968030276851:12447]
2025-09-30T14:59:14.937527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896968030276851:12447]
2025-09-30T14:59:14.937566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:14.937573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:14.937577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:14.937727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:14.937753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:14.937759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:14.937764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:14.947443Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3171 sessionId: src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:14.950375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:14.978018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896968120079606:10551]
2025-09-30T14:59:14.978356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3170, pipe: [1:7555896968120079606:10551]
2025-09-30T14:59:15.064161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:15.064179Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0] Write session will restart in 0.008700s
2025-09-30T14:59:15.064205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0] Write session: Do CDS request
2025-09-30T14:59:15.064212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:15.062296Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:15.062875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.062886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.062906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896968120079606:10551], now have 1 active actors on pipe
2025-09-30T14:59:15.063200Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:15.063346Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:15.063416Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896968120079606:10551]
2025-09-30T14:59:15.063614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:15.063768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3171 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0
2025-09-30T14:59:15.063995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3171 sessionId: src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0 is DEAD
2025-09-30T14:59:15.073863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:15.073967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:15.073981Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3172
2025-09-30T14:59:15.074111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3172 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:15.074141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3172 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:15.074146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3172 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:15.074151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:15.075097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3172 sessionId:  describe result for acl check
2025-09-30T14:59:15.075134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:15.075137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:15.075139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:15.075145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896972415046917:4772] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:15.075736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896972415046917:4772] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:15.080450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896972415046917:4772] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:15.084085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896972415046917:4772] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:15.084101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896972415046917:4772] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:15.084105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896972415046917:4772] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:15.084114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3172 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:15.111666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:15.114928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:15.115346Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:15.115358Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:15.115373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:15.115465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:15.115513Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896972325244427:12451]
2025-09-30T14:59:15.116180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:15.116536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:15.116596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:15.116945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:15.117015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.117020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.117022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.117023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.117025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.117026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.117030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.117031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.117033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.117034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.117036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.117037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.117038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.117039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.117040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.117046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.117058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.117062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.117067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.117071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.117075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.117079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.117083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.117087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.117091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.117096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.117101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.117106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.117110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.117114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.117122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.117134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.117144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.117150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.117155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.117160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.117166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.117172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.117180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.117185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.117188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.117194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.117199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.117211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.117216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.117235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.117243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.117248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.117256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.117262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.117269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.117274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.117281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.117286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.117295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.117301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.117308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.117314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.117322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.117327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.117376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:15.123576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:15.124918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:15.124939Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:15.124941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:15.124946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:15.124954Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3171 [2:7555896972325244427:12451]
2025-09-30T14:59:15.124968Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:15.124983Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:15.124987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:15.124992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:15.124994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:15.125016Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:15.125035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:15.125043Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:15.125117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.125122Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.125124Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.125127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:15.125130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:15.125210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:15.125222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.125236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.125247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.125265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:15.125289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415046905:2454], now have 1 active actors on pipe
2025-09-30T14:59:15.125292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415046965:4772], now have 1 active actors on pipe
2025-09-30T14:59:15.125301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896972325244422:12451]
2025-09-30T14:59:15.125311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896972325244422:12451]
2025-09-30T14:59:15.125314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896972325244422:12451]
2025-09-30T14:59:15.125335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:15.125349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:15.125360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:15.125363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:15.125365Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:15.125365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:15.125368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:15.125407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896972325244422:12451]
2025-09-30T14:59:15.125375Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3171
2025-09-30T14:59:15.125394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3171
2025-09-30T14:59:15.125420Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:15.125440Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:15.125882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.125893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.125923Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:15.125938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:15.125942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:15.125945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:15.125958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:15.125976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:15.126638Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3172 partition: 0 MaxSeqNo: 42 sessionId: src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0
2025-09-30T14:59:15.127075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f80dcbb3-7d3c6a1-d2761ad9-d2398a26_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:15.130368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0] Write session: try to update token
2025-09-30T14:59:15.130394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:15.125999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:15.126481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.126488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.126507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:15.138697Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:15.138721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:15.138732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896972325244422:12451]
2025-09-30T14:59:15.138783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:15.138866Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:15.138985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:15.139154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:15.139364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:15.139539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:15.139765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:15.139818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:15.148074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3172 sessionId: src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:15.151016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:15.151569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.151591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.151610Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:15.151613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:15.151615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:15.151616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:15.151626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896972325244422:12451]
2025-09-30T14:59:15.151630Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896972325244422:12451]
2025-09-30T14:59:15.151634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896972325244422:12451]
2025-09-30T14:59:15.151685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:15.151696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.151699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:15.151845Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:15.155310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:15.155325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:15.155330Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:15.163363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896972415047198:10551]
2025-09-30T14:59:15.163704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3171, pipe: [1:7555896972415047198:10551]
2025-09-30T14:59:15.266799Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:15.267076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:15.267116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415047198:10551], now have 1 active actors on pipe
2025-09-30T14:59:15.267235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:15.267384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:15.267441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896972415047198:10551]
2025-09-30T14:59:15.281437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:15.281450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:15.281479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3172 reason: error at write: Disconnected sessionId: src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0
2025-09-30T14:59:15.281663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3172 sessionId: src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0 is DEAD
2025-09-30T14:59:15.281849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:15.281861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0] Write session will restart in 0.005351s
2025-09-30T14:59:15.281885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0] Write session: Do CDS request
2025-09-30T14:59:15.281891Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:15.288823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:15.289521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:15.289537Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3173
2025-09-30T14:59:15.289682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3173 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:15.289735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3173 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:15.289745Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3173 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:15.289749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:15.290348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3173 sessionId:  describe result for acl check
2025-09-30T14:59:15.290397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:15.290404Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:15.290406Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:15.290413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896972415047211:4743] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:15.291016Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896972415047211:4743] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:15.294133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896972415047211:4743] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:15.296718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896972415047211:4743] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:15.296732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896972415047211:4743] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:15.296736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896972415047211:4743] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:15.296744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3173 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:15.311424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:15.312103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:15.312301Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:15.312312Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:15.312322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:15.312363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:15.312398Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896972325244717:12464]
2025-09-30T14:59:15.313119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:15.315413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:15.315499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:15.315891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:15.315970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.315977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.315978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.315979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.315980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.315982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.315994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.315996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.315997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.315999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.316000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.316001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.316003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.316004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.316006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.316014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.316026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.316030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.316034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.316039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.316043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.316047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.316051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.316055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.316061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.316065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.316069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.316073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.316077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.316082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.316091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.316100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.316107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.316113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.316119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.316125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.316129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.316135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.316140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.316147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.316152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.316158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.316163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.316169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.316175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.316183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.316188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.316193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.316198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.316203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.316208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.316214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.316219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.316225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.316242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.316247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.316251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.316256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.316261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.316267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.316317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:15.322448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:15.323828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:15.323847Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:15.323850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:15.323855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:15.323864Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3172 [2:7555896972325244717:12464]
2025-09-30T14:59:15.323883Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:15.323901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:15.323906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:15.323908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:15.323911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:15.323931Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:15.323941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:15.323949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:15.324026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.324032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.324035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.324038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:15.324041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:15.324121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:15.324130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.324144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.324157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.324175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:15.324370Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3172
2025-09-30T14:59:15.324371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3172
2025-09-30T14:59:15.324195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896972325244712:12464]
2025-09-30T14:59:15.324203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896972325244712:12464]
2025-09-30T14:59:15.324206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896972325244712:12464]
2025-09-30T14:59:15.324221Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:15.324245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:15.324250Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:15.324253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:15.324254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415047254:4743], now have 1 active actors on pipe
2025-09-30T14:59:15.324258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415047201:2454], now have 1 active actors on pipe
2025-09-30T14:59:15.324268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:15.324281Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:15.324285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:15.324327Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896972325244712:12464]
2025-09-30T14:59:15.324335Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:15.324362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:15.324826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.324842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.324877Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:15.324892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:15.324902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:15.324905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:15.324918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:15.324945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:15.324972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:15.325196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.325205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.325223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:15.325325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3173 partition: 0 MaxSeqNo: 42 sessionId: src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0
2025-09-30T14:59:15.325742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bb5059ea-f55e8eab-6f4513f3-ecaabab3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:15.329033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0] Write session: try to update token
2025-09-30T14:59:15.329060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:15.338702Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:15.338724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:15.338727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:15.338729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:15.338740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896972325244712:12464]
2025-09-30T14:59:15.338745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896972325244712:12464]
2025-09-30T14:59:15.338751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896972325244712:12464]
2025-09-30T14:59:15.338793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:15.338800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.338803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:15.338805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:15.338826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:15.338831Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:15.338968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:15.351255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3173 sessionId: src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:15.354339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:15.367111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896972415047481:10551]
2025-09-30T14:59:15.367465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3172, pipe: [1:7555896972415047481:10551]
2025-09-30T14:59:15.470692Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:15.471059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.471073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.471093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415047481:10551], now have 1 active actors on pipe
2025-09-30T14:59:15.471581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896972415047481:10551]
2025-09-30T14:59:15.471593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:15.471598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:15.471630Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:15.471673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3173 reason: error at write: Disconnected sessionId: src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0
2025-09-30T14:59:15.472079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:15.472093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0] Write session will restart in 0.006334s
2025-09-30T14:59:15.472120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0] Write session: Do CDS request
2025-09-30T14:59:15.472126Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:15.471915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3173 sessionId: src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0 is DEAD
2025-09-30T14:59:15.472086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:15.479795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:15.483684Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:15.483700Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3174
2025-09-30T14:59:15.483865Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3174 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:15.483904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3174 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:15.483933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3174 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:15.483941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:15.484420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3174 sessionId:  describe result for acl check
2025-09-30T14:59:15.484458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:15.484460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:15.484462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:15.484469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896972415047502:4716] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:15.485153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896972415047502:4716] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:15.487381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896972415047502:4716] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:15.496880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896972415047502:4716] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:15.496902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896972415047502:4716] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:15.496905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896972415047502:4716] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:15.496914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3174 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:15.515725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:15.519368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:15.519834Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:15.519838Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:15.519849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:15.519908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:15.519940Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896972325244995:12466]
2025-09-30T14:59:15.520700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:15.521114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:15.521155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:15.521513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:15.521566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.521568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.521569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.521571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.521572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.521573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.521575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.521576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.521578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.521579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.521581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.521582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.521584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.521585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.521587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.521592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.521604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.521608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.521612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.521616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.521621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.521625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.521630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.521634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.521638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.521642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.521646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.521651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.521655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.521659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.521666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.521674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.521681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.521687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.521694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.521701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.521706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.521713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.521719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.521725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.521730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.521736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.521740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.521746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.521751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.521757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.521762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.521768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.521773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.521779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.521784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.521790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.521795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.521801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.521806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.521812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.521816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.521822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.521826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.521831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.521876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:15.530588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:15.531735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:15.531750Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:15.531752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:15.531756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:15.531764Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3173 [2:7555896972325244995:12466]
2025-09-30T14:59:15.531783Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:15.531802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:15.531805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:15.531808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:15.531811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:15.531829Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:15.531836Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:15.531844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:15.531919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.531921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.531924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.531928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:15.531931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:15.532005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:15.532012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.532024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.532037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.532054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:15.532071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896972325244990:12466]
2025-09-30T14:59:15.532074Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896972325244990:12466]
2025-09-30T14:59:15.532076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896972325244990:12466]
2025-09-30T14:59:15.532089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:15.532104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:15.532119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:15.532122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:15.532159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896972325244990:12466]
2025-09-30T14:59:15.532162Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:15.532429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:15.532432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:15.532434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:15.532442Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:15.533305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415047486:2454], now have 1 active actors on pipe
2025-09-30T14:59:15.533317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415047596:4716], now have 1 active actors on pipe
2025-09-30T14:59:15.533334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.533339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.533367Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:15.533380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:15.533384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:15.533387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:15.533398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:15.533411Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:15.533440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:15.533666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.533673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.533685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:15.534201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cec633dc-f39444f3-5cd738cf-3b1e6aff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:15.532875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3173
2025-09-30T14:59:15.532920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3173
2025-09-30T14:59:15.533799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3174 partition: 0 MaxSeqNo: 42 sessionId: src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0
2025-09-30T14:59:15.537268Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0] Write session: try to update token
2025-09-30T14:59:15.537289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:15.549145Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:15.549165Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:15.549168Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:15.549170Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:15.549180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896972325244990:12466]
2025-09-30T14:59:15.549184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896972325244990:12466]
2025-09-30T14:59:15.549189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896972325244990:12466]
2025-09-30T14:59:15.549229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:15.549236Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.549239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:15.549388Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:15.549941Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:15.549957Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:15.549960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:15.554556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3174 sessionId: src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:15.557412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:15.571409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896972415047760:10551]
2025-09-30T14:59:15.575815Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3173, pipe: [1:7555896972415047760:10551]
2025-09-30T14:59:15.677395Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:15.677797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.677813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.677856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415047760:10551], now have 1 active actors on pipe
2025-09-30T14:59:15.678138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896972415047760:10551]
2025-09-30T14:59:15.678179Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:15.678215Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:15.678284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3174 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0
2025-09-30T14:59:15.678450Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3174 sessionId: src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0 is DEAD
2025-09-30T14:59:15.678142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:15.678621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:15.678633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0] Write session will restart in 0.007869s
2025-09-30T14:59:15.678658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0] Write session: Do CDS request
2025-09-30T14:59:15.678664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:15.687943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:15.688059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:15.688076Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3175
2025-09-30T14:59:15.688240Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3175 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:15.688289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3175 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:15.688301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3175 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:15.688307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:15.688873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3175 sessionId:  describe result for acl check
2025-09-30T14:59:15.688911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:15.688914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:15.688915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:15.688930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896972415047793:4712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:15.689598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896972415047793:4712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:15.693187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896972415047793:4712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:15.697763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896972415047793:4712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:15.697778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896972415047793:4712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:15.697781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896972415047793:4712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:15.697795Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3175 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:15.707267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:15.710680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:15.710938Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:15.710952Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:15.710962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:15.711023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:15.711074Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896972325245263:12470]
2025-09-30T14:59:15.711772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:15.712128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:15.712200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:15.712590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:15.712674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.712679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.712681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.712682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.712684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.712685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.712687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.712688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.712689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.712691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.712692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.712694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.712695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.712696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.712698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.712705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.712715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.712721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.712726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.712731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.712736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.712740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.712745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.712749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.712754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.712759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.712771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.712776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.712780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.712799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.712807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.712824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.712831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.712838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.712848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.712854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.712860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.712865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.712870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.712876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.712881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.712887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.712892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.712897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.712902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.712910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.712915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.712920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.712925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.712930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.712934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.712938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.712942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.712947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.712952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.712956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.712960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.712964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.712969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.712973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.713013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:15.718856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:15.720174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:15.720191Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:15.720194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:15.720198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:15.720207Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3174 [2:7555896972325245263:12470]
2025-09-30T14:59:15.720224Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:15.720243Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:15.720251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:15.720256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:15.720260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:15.720277Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:15.720290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:15.720304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:15.720380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.720389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.720391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.720395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:15.720397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:15.720667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:15.720676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.720690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.720703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.720730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:15.720755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415047965:4712], now have 1 active actors on pipe
2025-09-30T14:59:15.720766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415047762:2454], now have 1 active actors on pipe
2025-09-30T14:59:15.720704Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3174
2025-09-30T14:59:15.720721Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3174
2025-09-30T14:59:15.720773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896972325245258:12470]
2025-09-30T14:59:15.720779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896972325245258:12470]
2025-09-30T14:59:15.720781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896972325245258:12470]
2025-09-30T14:59:15.720794Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:15.720826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.720835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.720843Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:15.720852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:15.720854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:15.720854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:15.720869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:15.720876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:15.720922Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:15.720933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:15.720948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:15.720950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:15.720959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:15.720968Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:15.720973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896972325245258:12470]
2025-09-30T14:59:15.720982Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:15.720989Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:15.721009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:15.721211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.721222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.721238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:15.721345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3175 partition: 0 MaxSeqNo: 42 sessionId: src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0
2025-09-30T14:59:15.722909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b47ed75-f93b4a36-ff1a481f-766587ae_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:15.729214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0] Write session: try to update token
2025-09-30T14:59:15.729239Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:15.734688Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:15.734709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:15.734712Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:15.734714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:15.734725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896972325245258:12470]
2025-09-30T14:59:15.734730Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896972325245258:12470]
2025-09-30T14:59:15.734735Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896972325245258:12470]
2025-09-30T14:59:15.734780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:15.734788Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.734791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:15.734813Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:15.734821Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:15.734825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:15.734944Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:15.747386Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3175 sessionId: src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:15.750281Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:15.778263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896972415048049:10551]
2025-09-30T14:59:15.778548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3174, pipe: [1:7555896972415048049:10551]
2025-09-30T14:59:15.848458Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:15.848980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.848991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.849013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415048049:10551], now have 1 active actors on pipe
2025-09-30T14:59:15.849221Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:15.849714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:15.849827Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3175 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0
2025-09-30T14:59:15.850013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3175 sessionId: src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0 is DEAD
2025-09-30T14:59:15.850185Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:15.850224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896972415048049:10551]
2025-09-30T14:59:15.850508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:15.850517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0] Write session will restart in 0.007049s
2025-09-30T14:59:15.850549Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0] Write session: Do CDS request
2025-09-30T14:59:15.850554Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:15.858945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:15.860768Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:15.860783Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3176
2025-09-30T14:59:15.860923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3176 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:15.860950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3176 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:15.860957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3176 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:15.860961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:15.861516Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3176 sessionId:  describe result for acl check
2025-09-30T14:59:15.861544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:15.861547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:15.861549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:15.861556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896972415048068:4692] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:15.862111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896972415048068:4692] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:15.872275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896972415048068:4692] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:15.879090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896972415048068:4692] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:15.879107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896972415048068:4692] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:15.879112Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896972415048068:4692] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:15.879121Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3176 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:15.886191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:15.888871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:15.889088Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:15.889098Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:15.889106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:15.889150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:15.889180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896972325245530:12472]
2025-09-30T14:59:15.889727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:15.890029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:15.890057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:15.890310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:15.890363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.890364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.890365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.890365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.890366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.890367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.890368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.890369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.890369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.890370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.890371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.890372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.890373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.890374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.890375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.890379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.890386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.890389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.890392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.890394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.890397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.890399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.890402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.890404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.890407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.890410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.890412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.890415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.890417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.890420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.890425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.890431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:15.890435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.890439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:15.890442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.890445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:15.890448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.890451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:15.890453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.890457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:15.890460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.890463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:15.890465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.890468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:15.890471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.890474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:15.890477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.890480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:15.890482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.890485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:15.890488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.890491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.890493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.890498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.890500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.890503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.890505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.890508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:15.890510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.890513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:15.890536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:15.896074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:15.897128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:15.897143Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:15.897145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:15.897148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:15.897155Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3175 [2:7555896972325245530:12472]
2025-09-30T14:59:15.897169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:15.897185Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:15.897191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:15.897194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:15.897195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:15.897211Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:15.897223Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:15.897234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:15.897295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.897300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.897302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.897305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:15.897307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:15.897361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:15.897367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.897376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:15.897382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:15.897396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:15.897413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896972325245525:12472]
2025-09-30T14:59:15.897418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896972325245525:12472]
2025-09-30T14:59:15.897420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896972325245525:12472]
2025-09-30T14:59:15.897429Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:15.897441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:15.897454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:15.897460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:15.897487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896972325245525:12472]
2025-09-30T14:59:15.897491Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:15.897575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:15.897581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:15.897583Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:15.897588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:15.897864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3175
2025-09-30T14:59:15.897879Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3175
2025-09-30T14:59:15.898158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415048241:4692], now have 1 active actors on pipe
2025-09-30T14:59:15.898171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415048052:2454], now have 1 active actors on pipe
2025-09-30T14:59:15.898184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.898194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.898224Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:15.898237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:15.898243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:15.898245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:15.898259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:15.898284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:15.898305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:15.898619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:15.898627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:15.898641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:15.898758Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3176 partition: 0 MaxSeqNo: 42 sessionId: src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0
2025-09-30T14:59:15.899085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2546dcc1-10c6492-bf2c45d1-f54c25f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:15.901826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0] Write session: try to update token
2025-09-30T14:59:15.901847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:15.912425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:15.912449Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:15.912453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:15.912455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:15.912466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896972325245525:12472]
2025-09-30T14:59:15.912471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896972325245525:12472]
2025-09-30T14:59:15.912481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896972325245525:12472]
2025-09-30T14:59:15.912528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:15.912537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:15.912541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:15.912725Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:15.915432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:15.915447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:15.915451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:15.930634Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3176 sessionId: src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:15.933494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:15.953386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896972415048329:10551]
2025-09-30T14:59:15.955589Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3175, pipe: [1:7555896972415048329:10551]
2025-09-30T14:59:16.029421Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:16.029833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.029848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.029870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896972415048329:10551], now have 1 active actors on pipe
2025-09-30T14:59:16.031222Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:16.030844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:16.030857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:16.030912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3176 reason: error at write: Disconnected sessionId: src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0
2025-09-30T14:59:16.031256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0] Write session will restart in 0.008554s
2025-09-30T14:59:16.031058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3176 sessionId: src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0 is DEAD
2025-09-30T14:59:16.031159Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896972415048329:10551]
2025-09-30T14:59:16.031170Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:16.031283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0] Write session: Do CDS request
2025-09-30T14:59:16.031289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:16.031697Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:16.042205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:16.043485Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:16.043503Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3177
2025-09-30T14:59:16.043654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3177 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:16.043688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3177 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:16.043698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3177 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:16.043703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:16.044331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3177 sessionId:  describe result for acl check
2025-09-30T14:59:16.044366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:16.044368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:16.044373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:16.044378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896976710015653:4683] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:16.044978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896976710015653:4683] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:16.052381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896976710015653:4683] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:16.056665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896976710015653:4683] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:16.056684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896976710015653:4683] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:16.056688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896976710015653:4683] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:16.056697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3177 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:16.059072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:16.061611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:16.061870Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:16.061881Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:16.061892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:16.062054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:16.062095Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896976620213095:12474]
2025-09-30T14:59:16.062800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:16.063145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:16.063191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:16.063529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:16.063607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.063608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.063609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.063610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.063612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.063613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.063615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.063616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.063617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.063618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.063619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.063621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.063622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.063622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.063623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.063629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.063639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.063643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.063646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.063649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.063653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.063657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.063661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.063665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.063669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.063673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.063676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.063680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.063684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.063688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.063698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.063705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.063712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.063718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.063722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.063728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.063733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.063739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.063744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.063749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.063754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.063759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.063763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.063768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.063772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.063777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.063783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.063787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.063792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.063800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.063805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.063810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.063814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.063819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.063823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.063827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.063831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.063835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.063840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.063844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.063884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:16.070348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:16.071299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:16.071314Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:16.071318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:16.071323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:16.071330Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3176 [2:7555896976620213095:12474]
2025-09-30T14:59:16.071348Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:16.071366Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:16.071369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:16.071372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:16.071374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:16.071392Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:16.071399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:16.071406Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:16.071475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.071483Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.071486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.071490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:16.071493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:16.071562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:16.071569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.071584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.071602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.071627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:16.071644Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896976620213090:12474]
2025-09-30T14:59:16.071652Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896976620213090:12474]
2025-09-30T14:59:16.071655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896976620213090:12474]
2025-09-30T14:59:16.071669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:16.071688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:16.071704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:16.071712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:16.071746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896976620213090:12474]
2025-09-30T14:59:16.071910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:16.071918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:16.071921Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:16.072132Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3176
2025-09-30T14:59:16.072139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3176
2025-09-30T14:59:16.072068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:16.072092Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:16.072102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710015627:2454], now have 1 active actors on pipe
2025-09-30T14:59:16.072107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710015890:4683], now have 1 active actors on pipe
2025-09-30T14:59:16.072429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.072435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.072460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:16.072469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:16.072472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:16.072474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:16.072485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:16.072496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:16.072509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:16.073246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.073259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.073279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:16.073442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3177 partition: 0 MaxSeqNo: 42 sessionId: src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0
2025-09-30T14:59:16.075409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f358fac1-fe371ab1-2bfedc8e-b89aa935_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:16.078062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0] Write session: try to update token
2025-09-30T14:59:16.078078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:16.087553Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:16.087572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:16.087579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:16.087580Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:16.087589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896976620213090:12474]
2025-09-30T14:59:16.087593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896976620213090:12474]
2025-09-30T14:59:16.087596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896976620213090:12474]
2025-09-30T14:59:16.087635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:16.087642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.087645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:16.087700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:16.087710Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:16.087713Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:16.087789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:16.096681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3177 sessionId: src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:16.099780Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:16.131507Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896976710015905:10551]
2025-09-30T14:59:16.131787Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3176, pipe: [1:7555896976710015905:10551]
2025-09-30T14:59:16.245223Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:16.245736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.245759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.245792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710015905:10551], now have 1 active actors on pipe
2025-09-30T14:59:16.246422Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:16.246863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:16.246919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:16.247006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3177 reason: status is not ok: tablet will be restarted right now sessionId: src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0
2025-09-30T14:59:16.247205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3177 sessionId: src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0 is DEAD
2025-09-30T14:59:16.247392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896976710015905:10551]
2025-09-30T14:59:16.250131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:16.250151Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0] Write session will restart in 0.008224s
2025-09-30T14:59:16.250178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0] Write session: Do CDS request
2025-09-30T14:59:16.250184Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:16.259887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:16.259975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:16.259992Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3178
2025-09-30T14:59:16.263546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3178 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:16.263605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3178 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:16.263611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3178 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:16.263617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:16.264162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3178 sessionId:  describe result for acl check
2025-09-30T14:59:16.264202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:16.264204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:16.264206Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:16.264213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896976710015948:4648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:16.264823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896976710015948:4648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:16.276141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896976710015948:4648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:16.282370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896976710015948:4648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:16.282389Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896976710015948:4648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:16.282393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896976710015948:4648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:16.282402Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3178 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:16.290342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:16.294554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:16.294763Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:16.294774Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:16.294783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:16.294826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:16.294862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896976620213402:12489]
2025-09-30T14:59:16.295380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:16.296269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:16.296362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:16.296800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:16.296888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.296895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.296896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.296897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.296899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.296900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.296902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.296903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.296904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.296905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.296907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.296908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.296910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.296911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.296912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.296920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.296931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.296935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.296940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.296945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.296950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.296954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.296959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.296964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.296968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.296972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.296977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.296981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.296985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.296990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.296999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.297009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.297015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.297022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.297029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.297035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.297040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.297047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.297052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.297057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.297062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.297067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.297075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.297080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.297090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.297094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.297099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.297105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.297110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.297115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.297120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.297126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.297130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.297136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.297140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.297146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.297150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.297156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.297160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.297165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.297209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:16.304819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:16.306444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:16.306468Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:16.306471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:16.306476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:16.306485Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3177 [2:7555896976620213402:12489]
2025-09-30T14:59:16.306507Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:16.306530Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:16.306535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:16.306539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:16.306542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:16.306565Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:16.306574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:16.306592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:16.306682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.306693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.306696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.306701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:16.306704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:16.306802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:16.306812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.306832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.306843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.306860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:16.306892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896976620213397:12489]
2025-09-30T14:59:16.306901Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896976620213397:12489]
2025-09-30T14:59:16.306904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896976620213397:12489]
2025-09-30T14:59:16.306918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:16.306938Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:16.306945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:16.306951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:16.306954Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:16.306964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:16.306969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:16.306982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710015932:2454], now have 1 active actors on pipe
2025-09-30T14:59:16.306996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710016144:4648], now have 1 active actors on pipe
2025-09-30T14:59:16.307049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896976620213397:12489]
2025-09-30T14:59:16.307063Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:16.307114Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:16.307337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3177
2025-09-30T14:59:16.307389Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3177
2025-09-30T14:59:16.308316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.308336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.308382Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:16.308395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:16.308401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:16.308404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:16.308421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:16.308437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:16.308458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:16.310711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.310730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.310777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:16.311445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3178 partition: 0 MaxSeqNo: 42 sessionId: src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0
2025-09-30T14:59:16.311935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37a609c3-f56cef5d-e8067f6a-bc35255c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:16.316002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0] Write session: try to update token
2025-09-30T14:59:16.316032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:16.328604Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:16.328625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:16.328640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896976620213397:12489]
2025-09-30T14:59:16.328695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:16.328698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:16.328896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:16.329083Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:16.329264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:16.329461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:16.329782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:16.329842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:16.336530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3178 sessionId: src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:16.339543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:16.339826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.339852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.339900Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:16.341602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:16.341607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:16.341610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:16.341612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:16.341623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896976620213397:12489]
2025-09-30T14:59:16.341628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896976620213397:12489]
2025-09-30T14:59:16.341632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896976620213397:12489]
2025-09-30T14:59:16.341687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:16.341694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.341697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:16.341701Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:16.341708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:16.341712Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:16.341855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:16.340014Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:16.347704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896976710016211:10551]
2025-09-30T14:59:16.350727Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3177, pipe: [1:7555896976710016211:10551]
2025-09-30T14:59:16.468298Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:16.468980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710016211:10551], now have 1 active actors on pipe
2025-09-30T14:59:16.477650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.477679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.477884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:16.477963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:16.478048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:16.478122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:16.478170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:16.478175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:16.478254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:16.478324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:16.478397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:16.478469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:16.478522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:16.478526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:16.478602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:16.478667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:16.478731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:16.478802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:16.478846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:16.478853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:16.478928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:16.478995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:16.479124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:16.479198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:16.479265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:16.479276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:16.479355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:16.479431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:16.479510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:16.479582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:16.479635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:16.479638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:16.479713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:16.479778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:16.479844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:16.479913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:16.479968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:16.479978Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:16.480051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:16.480119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:16.480209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:16.480282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:16.480329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:16.480333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:16.480412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:16.480483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:16.480553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:16.480644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:16.480762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:16.480765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:16.480845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:16.480922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:16.480999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:16.481070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:16.481138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:16.481142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:16.481222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:16.481290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:16.481360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:16.481430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:16.481475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:16.481478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:16.482897Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:16.483796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:16.483809Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0] Write session will restart in 0.005693s
2025-09-30T14:59:16.483333Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:16.483833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0] Write session: Do CDS request
2025-09-30T14:59:16.483385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896976710016211:10551]
2025-09-30T14:59:16.483838Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:16.483398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:16.483438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3178 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0
2025-09-30T14:59:16.483619Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3178 sessionId: src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0 is DEAD
2025-09-30T14:59:16.490763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:16.491318Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:16.491336Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3179
2025-09-30T14:59:16.491519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3179 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:16.491567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3179 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:16.491574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3179 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:16.491578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:16.492125Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3179 sessionId:  describe result for acl check
2025-09-30T14:59:16.492167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:16.492174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:16.492176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:16.492182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896976710016235:4636] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:16.492797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896976710016235:4636] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:16.497371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896976710016235:4636] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:16.501577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896976710016235:4636] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:16.501594Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896976710016235:4636] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:16.501607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896976710016235:4636] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:16.501617Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3179 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:16.509545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:16.512843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:16.513095Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:16.513100Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:16.513111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:16.513169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:16.513210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896976620213685:12492]
2025-09-30T14:59:16.514127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:16.514505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:16.514568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:16.514947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:16.515020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.515022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.515023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.515024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.515025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.515027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.515028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.515030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.515031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.515033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.515034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.515036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.515037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.515038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.515040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.515047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.515058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.515063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.515067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.515072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.515076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.515080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.515083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.515087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.515090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.515094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.515097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.515100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.515103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.515107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.515115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.515126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.515132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.515138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.515142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.515146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.515150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.515154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.515159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.515164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.515169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.515174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.515179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.515184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.515188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.515193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.515198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.515204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.515210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.515216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.515220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.515229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.515233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.515238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.515273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.515278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.515283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.515288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.515293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.515299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.515348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:16.521674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:16.522942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:16.522961Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:16.522964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:16.522969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:16.522977Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3178 [2:7555896976620213685:12492]
2025-09-30T14:59:16.522996Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:16.523015Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:16.523019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:16.523024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:16.523026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:16.523045Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:16.523062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:16.523070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:16.523137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.523149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.523152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.523157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:16.523160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:16.523232Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:16.523240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.523274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.523285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.523302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:16.523322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896976620213680:12492]
2025-09-30T14:59:16.523326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896976620213680:12492]
2025-09-30T14:59:16.523329Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896976620213680:12492]
2025-09-30T14:59:16.523339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:16.523358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:16.523367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:16.523371Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:16.523373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:16.523374Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:16.523377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:16.523416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896976620213680:12492]
2025-09-30T14:59:16.523428Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:16.523439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710016365:4636], now have 1 active actors on pipe
2025-09-30T14:59:16.523443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710016219:2454], now have 1 active actors on pipe
2025-09-30T14:59:16.523559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3178
2025-09-30T14:59:16.523600Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3178
2025-09-30T14:59:16.523762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:16.523948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.523970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.524002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:16.524011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:16.524015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:16.524037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:16.524050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:16.524062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:16.524083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:16.524701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.524714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.524745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:16.524861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3179 partition: 0 MaxSeqNo: 42 sessionId: src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0
2025-09-30T14:59:16.525256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce6d6664-bfe9c83-4dd24cbb-d666215a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:16.528360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0] Write session: try to update token
2025-09-30T14:59:16.528388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:16.538863Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:16.538887Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:16.538889Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:16.538891Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:16.538902Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896976620213680:12492]
2025-09-30T14:59:16.538907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896976620213680:12492]
2025-09-30T14:59:16.538911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896976620213680:12492]
2025-09-30T14:59:16.538952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:16.538959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.538962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:16.538963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:16.538969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:16.538974Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:16.539105Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:16.553414Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3179 sessionId: src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:16.556559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:16.584071Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896976710016495:10551]
2025-09-30T14:59:16.591657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3178, pipe: [1:7555896976710016495:10551]
2025-09-30T14:59:16.661242Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:16.661606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.661630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.661653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710016495:10551], now have 1 active actors on pipe
2025-09-30T14:59:16.661875Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:16.662446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:16.662455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0] Write session will restart in 0.009968s
2025-09-30T14:59:16.661973Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:16.661984Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896976710016495:10551]
2025-09-30T14:59:16.661987Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:16.662016Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:16.662056Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3179 reason: error at write: Disconnected sessionId: src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0
2025-09-30T14:59:16.662478Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0] Write session: Do CDS request
2025-09-30T14:59:16.662251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3179 sessionId: src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0 is DEAD
2025-09-30T14:59:16.662485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:16.673826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:16.673923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:16.673940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3180
2025-09-30T14:59:16.674065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3180 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:16.674095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3180 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:16.674106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3180 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:16.674112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:16.674843Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3180 sessionId:  describe result for acl check
2025-09-30T14:59:16.674878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:16.674881Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:16.674883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:16.674889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896976710016527:4637] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:16.675520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896976710016527:4637] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:16.685223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896976710016527:4637] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:16.693487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896976710016527:4637] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:16.693505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896976710016527:4637] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:16.693507Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896976710016527:4637] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:16.693515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3180 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:16.704343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:16.710108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:16.710363Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:16.710372Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:16.710382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:16.710429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:16.710474Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896976620213958:12495]
2025-09-30T14:59:16.710989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:16.711540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:16.711599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:16.711887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:16.711943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.711948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.711949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.711950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.711950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.711951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.711953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.711954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.711955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.711955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.711956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.711957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.711958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.711959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.711960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.711964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.711972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.711975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.711978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.711980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.711982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.711985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.711988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.711990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.711993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.711996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.711998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.712001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.712003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.712005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.712011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.712016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.712020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.712024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.712027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.712033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.712038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.712043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.712048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.712052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.712056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.712060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.712066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.712071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.712075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.712080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.712085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.712090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.712094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.712098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.712103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.712108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.712115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.712121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.712125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.712130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.712133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.712138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.712145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.712149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.712193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:16.720195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:16.721672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:16.721698Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:16.721702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:16.721706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:16.721714Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3179 [2:7555896976620213958:12495]
2025-09-30T14:59:16.721732Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:16.721758Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:16.721766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:16.721769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:16.721772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:16.721791Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:16.721803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:16.721811Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:16.721886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.721895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.721898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.721902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:16.721904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:16.721978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:16.721988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.722003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.722020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.722043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:16.722061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896976620213952:12495]
2025-09-30T14:59:16.722068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896976620213952:12495]
2025-09-30T14:59:16.722071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896976620213952:12495]
2025-09-30T14:59:16.722088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:16.722107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:16.722128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:16.722136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:16.722174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896976620213952:12495]
2025-09-30T14:59:16.722181Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:16.722317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:16.722325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:16.722327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:16.722333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:16.722506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710016696:4637], now have 1 active actors on pipe
2025-09-30T14:59:16.722523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710016497:2454], now have 1 active actors on pipe
2025-09-30T14:59:16.727379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3179
2025-09-30T14:59:16.727422Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3179
2025-09-30T14:59:16.732297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.732324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.732361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:16.732375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:16.732380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:16.732383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:16.732397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:16.732417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:16.732441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:16.733660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.733676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.733703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:16.733929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3180 partition: 0 MaxSeqNo: 42 sessionId: src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0
2025-09-30T14:59:16.734378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83cb4259-6dc20306-27d0bf9b-71f7e5ba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:16.737257Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0] Write session: try to update token
2025-09-30T14:59:16.737282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:16.741010Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:16.741033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:16.741036Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:16.741038Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:16.741047Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896976620213952:12495]
2025-09-30T14:59:16.741055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896976620213952:12495]
2025-09-30T14:59:16.741059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896976620213952:12495]
2025-09-30T14:59:16.741099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:16.741107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.741110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:16.741117Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:16.741124Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:16.741128Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:16.741243Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:16.762341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896976710016776:10551]
2025-09-30T14:59:16.763667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3179, pipe: [1:7555896976710016776:10551]
2025-09-30T14:59:16.773101Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3180 sessionId: src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:16.775904Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:16.823751Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:59:16.823781Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 18
2025-09-30T14:59:16.876128Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:16.876935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710016776:10551], now have 1 active actors on pipe
2025-09-30T14:59:16.876966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.876972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.877533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:16.877563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 18
2025-09-30T14:59:16.877258Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:16.877610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896976710016776:10551]
2025-09-30T14:59:16.877634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:16.878071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:16.878082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0] Write session will restart in 0.008057s
2025-09-30T14:59:16.878107Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0] Write session: Do CDS request
2025-09-30T14:59:16.878113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:16.877700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3180 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0
2025-09-30T14:59:16.877908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3180 sessionId: src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0 is DEAD
2025-09-30T14:59:16.887824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:16.888110Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:16.888128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3181
2025-09-30T14:59:16.888252Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3181 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:16.888293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3181 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:16.888299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3181 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:16.888304Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:16.889047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3181 sessionId:  describe result for acl check
2025-09-30T14:59:16.889085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:16.889090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:16.889092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:16.889099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896976710016810:4607] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:16.889644Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896976710016810:4607] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:16.895397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896976710016810:4607] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:16.902877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896976710016810:4607] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:16.902894Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896976710016810:4607] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:16.902897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896976710016810:4607] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:16.902906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3181 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:16.916076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:16.919584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:16.919839Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:16.919850Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:16.919861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:16.919918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:16.920075Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896976620214232:12498]
2025-09-30T14:59:16.920765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:16.921819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:16.921880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:16.922225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:16.922289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.922296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.922297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.922298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.922300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.922301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.922302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.922304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.922305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.922307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.922308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.922310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.922311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.922312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.922314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.922320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.922331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.922336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.922340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.922344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.922349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.922353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.922357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.922361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.922365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.922370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.922374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.922378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.922382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.922386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.922396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.922404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:16.922410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.922415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:16.922420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.922426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:16.922430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.922436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:16.922447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.922453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:16.922457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.922468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:16.922474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.922484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:16.922489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.922498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:16.922505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.922510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:16.922520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.922526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:16.922532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.922541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.922546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.922551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.922557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.922562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.922565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.922571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:16.922577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.922586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:16.922631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:16.931394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:16.932494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:16.932513Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:16.932516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:16.932520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:16.932528Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3180 [2:7555896976620214232:12498]
2025-09-30T14:59:16.932547Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:16.932564Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:16.932567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:16.932584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:16.932586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:16.932603Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:16.932616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:16.932629Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:16.932702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.932711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.932714Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.932718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:16.932720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:16.932791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:16.932795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.932810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:16.932827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:16.932845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:16.932861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896976620214227:12498]
2025-09-30T14:59:16.932863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896976620214227:12498]
2025-09-30T14:59:16.932866Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896976620214227:12498]
2025-09-30T14:59:16.932880Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:16.932895Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:16.932909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:16.932912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:16.932926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:16.932929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:16.932932Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:16.932947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896976620214227:12498]
2025-09-30T14:59:16.932950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:16.933017Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:16.933188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3180
2025-09-30T14:59:16.933296Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3180
2025-09-30T14:59:16.933367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710016795:2454], now have 1 active actors on pipe
2025-09-30T14:59:16.933383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710016967:4607], now have 1 active actors on pipe
2025-09-30T14:59:16.933405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.933416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.933468Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9189f9e0-b71bef19-f38a857d-91233392_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:16.933481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:16.933490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:16.933493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:16.933507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:16.933523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:16.933584Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:59:16.933621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:16.933985Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 24 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:59:16.933992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:16.934002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:16.934021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:16.934020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:59:16.934145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3181 partition: 0 MaxSeqNo: 42 sessionId: src_id|9189f9e0-b71bef19-f38a857d-91233392_0
2025-09-30T14:59:16.934513Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a7c5d2f9-4babf633-3e1c02ce-95478dde_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9189f9e0-b71bef19-f38a857d-91233392_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:16.937669Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9189f9e0-b71bef19-f38a857d-91233392_0] Write session: try to update token
2025-09-30T14:59:16.937691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9189f9e0-b71bef19-f38a857d-91233392_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:16.956857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:16.956878Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:16.956889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896976620214227:12498]
2025-09-30T14:59:16.956942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:16.956954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:16.957144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:16.957567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:16.957740Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:16.957896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:16.958110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:16.958163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:16.961895Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:16.961910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:16.961912Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:16.961915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:16.961927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896976620214227:12498]
2025-09-30T14:59:16.961931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896976620214227:12498]
2025-09-30T14:59:16.961936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896976620214227:12498]
2025-09-30T14:59:16.961979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:16.961985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:16.961987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:16.961990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:16.961992Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:16.961996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:16.962143Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:16.965481Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3181 sessionId: src_id|9189f9e0-b71bef19-f38a857d-91233392_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:16.968664Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:16.976309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896976710017078:10551]
2025-09-30T14:59:16.976789Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3180, pipe: [1:7555896976710017078:10551]
2025-09-30T14:59:17.089361Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:17.089719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.089736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.089762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896976710017078:10551], now have 1 active actors on pipe
2025-09-30T14:59:17.090018Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:17.091382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:17.091384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:17.091400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:17.091432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896976710017078:10551]
2025-09-30T14:59:17.091487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3181 reason: error at write: Disconnected sessionId: src_id|9189f9e0-b71bef19-f38a857d-91233392_0
2025-09-30T14:59:17.091727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3181 sessionId: src_id|9189f9e0-b71bef19-f38a857d-91233392_0 is DEAD
2025-09-30T14:59:17.095540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9189f9e0-b71bef19-f38a857d-91233392_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:17.095551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9189f9e0-b71bef19-f38a857d-91233392_0] Write session will restart in 0.005227s
2025-09-30T14:59:17.095580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9189f9e0-b71bef19-f38a857d-91233392_0] Write session: Do CDS request
2025-09-30T14:59:17.095588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9189f9e0-b71bef19-f38a857d-91233392_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:17.101793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9189f9e0-b71bef19-f38a857d-91233392_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:17.104085Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:17.104101Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3182
2025-09-30T14:59:17.104453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3182 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:17.104510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3182 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:17.104520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3182 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:17.104526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:17.105491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3182 sessionId:  describe result for acl check
2025-09-30T14:59:17.105525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:17.105527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:17.105528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:17.105534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896981004984405:4606] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:17.106060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896981004984405:4606] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:17.109915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896981004984405:4606] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:17.113846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896981004984405:4606] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:17.113859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896981004984405:4606] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:17.113864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896981004984405:4606] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:17.113870Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3182 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:17.123356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:17.126357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:17.126577Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:17.126590Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:17.126601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:17.126653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:17.126698Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896980915181802:12501]
2025-09-30T14:59:17.127444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:17.127781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:17.127846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:17.128201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:17.128264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.128265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.128267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.128268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.128270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.128271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.128273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.128274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.128275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.128277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.128278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.128279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.128281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.128282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.128284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.128290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.128302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.128308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.128312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.128317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.128322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.128326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.128331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.128336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.128341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.128346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.128351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.128355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.128360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.128364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.128372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.128381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.128387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.128394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.128400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.128406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.128412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.128417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.128422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.128429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.128434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.128441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.128446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.128452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.128456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.128463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.128470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.128477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.128483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.128489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.128494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.128500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.128505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.128510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.128516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.128523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.128528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.128534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.128539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.128545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.128621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:17.134374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:17.136025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:17.136046Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:17.136048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:17.136053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:17.136060Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3181 [2:7555896980915181802:12501]
2025-09-30T14:59:17.136079Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:17.136095Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:17.136098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:17.136101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:17.136104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:17.136120Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:17.136127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:17.136134Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:17.136519Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3181
2025-09-30T14:59:17.136584Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3181
2025-09-30T14:59:17.136200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.136213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.136215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.136219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:17.136222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:17.136296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:17.136299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.136313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.136323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.136339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:17.136356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896980915181797:12501]
2025-09-30T14:59:17.136358Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896980915181797:12501]
2025-09-30T14:59:17.136362Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896980915181797:12501]
2025-09-30T14:59:17.136377Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:17.136393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004984513:4606], now have 1 active actors on pipe
2025-09-30T14:59:17.136397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004984380:2454], now have 1 active actors on pipe
2025-09-30T14:59:17.136401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:17.136405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:17.136405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:17.136408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:17.136419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:17.136422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:17.136457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896980915181797:12501]
2025-09-30T14:59:17.136465Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:17.136483Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:17.136750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.136761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.136792Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:17.136799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:17.136804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:17.136806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:17.136817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:17.136828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:17.136844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:17.137017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.137024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.137041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:17.137360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3182 partition: 0 MaxSeqNo: 42 sessionId: src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0
2025-09-30T14:59:17.137865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9189f9e0-b71bef19-f38a857d-91233392_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:17.141352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0] Write session: try to update token
2025-09-30T14:59:17.141377Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:17.155488Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:17.155511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:17.155515Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:17.155517Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:17.155527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896980915181797:12501]
2025-09-30T14:59:17.155530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896980915181797:12501]
2025-09-30T14:59:17.155535Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896980915181797:12501]
2025-09-30T14:59:17.155575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:17.155583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.155586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:17.155734Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:17.159502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:17.159529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:17.159533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:17.161282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3182 sessionId: src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:17.164396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:17.191872Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896981004984662:10551]
2025-09-30T14:59:17.192228Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3181, pipe: [1:7555896981004984662:10551]
2025-09-30T14:59:17.272767Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:17.273271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.273288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.273326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004984662:10551], now have 1 active actors on pipe
2025-09-30T14:59:17.273513Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:17.273495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:17.273573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:17.273581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:17.273640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3182 reason: error at write: Disconnected sessionId: src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0
2025-09-30T14:59:17.273850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3182 sessionId: src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0 is DEAD
2025-09-30T14:59:17.274022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:17.274030Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0] Write session will restart in 0.009951s
2025-09-30T14:59:17.274053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0] Write session: Do CDS request
2025-09-30T14:59:17.274059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:17.274079Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896981004984662:10551]
2025-09-30T14:59:17.284948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:17.285037Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:17.285054Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3183
2025-09-30T14:59:17.285183Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3183 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:17.285215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3183 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:17.285225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3183 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:17.285229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:17.285702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3183 sessionId:  describe result for acl check
2025-09-30T14:59:17.285740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:17.285749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:17.285751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:17.285757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896981004984749:4575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:17.286300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896981004984749:4575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:17.288889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896981004984749:4575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:17.292361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896981004984749:4575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:17.292378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896981004984749:4575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:17.292381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896981004984749:4575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:17.292391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3183 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:17.294610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:17.297853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:17.298122Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:17.298134Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:17.298146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:17.298207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:17.298250Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896980915182114:12510]
2025-09-30T14:59:17.298951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:17.299369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:17.299454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:17.300066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:17.300164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.300173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.300174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.300175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.300177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.300178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.300180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.300181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.300182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.300183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.300185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.300186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.300187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.300188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.300189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.300197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.300207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.300211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.300215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.300219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.300223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.300227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.300231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.300235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.300239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.300243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.300246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.300286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.300290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.300294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.300305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.300314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.300320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.300326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.300331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.300337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.300341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.300347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.300351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.300357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.300371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.300377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.300383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.300389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.300394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.300399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.300404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.300409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.300414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.300419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.300428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.300434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.300439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.300445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.300450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.300456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.300461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.300466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.300471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.300478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.300523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:17.306246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:17.307288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:17.307307Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:17.307310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:17.307315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:17.307323Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3182 [2:7555896980915182114:12510]
2025-09-30T14:59:17.307344Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:17.307364Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:17.307367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:17.307371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:17.307374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:17.307393Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:17.307401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:17.307409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:17.307479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.307490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.307492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.307496Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:17.307499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:17.307589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:17.307599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.307615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.307628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.307644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:17.307667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004984676:2454], now have 1 active actors on pipe
2025-09-30T14:59:17.307676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896980915182109:12510]
2025-09-30T14:59:17.307678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896980915182109:12510]
2025-09-30T14:59:17.307681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896980915182109:12510]
2025-09-30T14:59:17.307696Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:17.307707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004984953:4575], now have 1 active actors on pipe
2025-09-30T14:59:17.307717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:17.307733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:17.307742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:17.307767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:17.307774Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:17.307779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:17.307786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896980915182109:12510]
2025-09-30T14:59:17.307790Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:17.307793Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:17.308104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.308118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.308148Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:17.308162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:17.308171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:17.308174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:17.308185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:17.308201Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:17.308220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:17.307809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3182
2025-09-30T14:59:17.307868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3182
2025-09-30T14:59:17.309000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.309016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.309039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:17.309184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3183 partition: 0 MaxSeqNo: 42 sessionId: src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0
2025-09-30T14:59:17.309635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ef9826b-24b61596-2e9e72b9-93d15c3f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:17.313075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0] Write session: try to update token
2025-09-30T14:59:17.313099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:17.321179Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:17.321200Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:17.321203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:17.321205Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:17.321215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896980915182109:12510]
2025-09-30T14:59:17.321219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896980915182109:12510]
2025-09-30T14:59:17.321224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896980915182109:12510]
2025-09-30T14:59:17.321264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:17.321268Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:17.321271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.321274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:17.321275Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:17.321280Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:17.321424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:17.335658Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3183 sessionId: src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:17.338720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:17.374394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896981004984974:10551]
2025-09-30T14:59:17.374695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3182, pipe: [1:7555896981004984974:10551]
2025-09-30T14:59:17.452957Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:17.453478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.453497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.453518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004984974:10551], now have 1 active actors on pipe
2025-09-30T14:59:17.453835Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:17.453871Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896981004984974:10551]
2025-09-30T14:59:17.453880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:17.453883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:17.453953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3183 reason: error at write: Disconnected sessionId: src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0
2025-09-30T14:59:17.453873Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:17.454146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3183 sessionId: src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0 is DEAD
2025-09-30T14:59:17.455580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:17.455600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0] Write session will restart in 0.007814s
2025-09-30T14:59:17.455636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0] Write session: Do CDS request
2025-09-30T14:59:17.455644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:17.464802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:17.464943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:17.464962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3184
2025-09-30T14:59:17.467488Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3184 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:17.467541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3184 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:17.467547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3184 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:17.467553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:17.468350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3184 sessionId:  describe result for acl check
2025-09-30T14:59:17.468395Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:17.468397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:17.468399Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:17.468405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896981004984998:4568] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:17.468992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896981004984998:4568] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:17.479458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896981004984998:4568] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:17.488103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896981004984998:4568] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:17.488122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896981004984998:4568] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:17.488127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896981004984998:4568] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:17.488137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3184 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:17.491628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:17.495155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:17.495594Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:17.495606Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:17.495617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:17.495680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:17.495728Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896980915182402:12518]
2025-09-30T14:59:17.496408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:17.497775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:17.497846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:17.498257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:17.498328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.498330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.498331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.498332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.498333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.498335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.498336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.498338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.498339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.498340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.498342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.498343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.498344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.498346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.498348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.498354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.498383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.498387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.498392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.498396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.498400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.498404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.498407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.498412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.498416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.498420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.498424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.498427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.498432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.498435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.498445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.498454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.498460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.498466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.498471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.498477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.498482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.498487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.498493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.498499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.498505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.498510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.498530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.498536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.498542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.498548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.498553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.498559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.498564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.498570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.498575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.498581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.498585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.498591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.498597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.498602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.498607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.498612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.498617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.498623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.498665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:17.507007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:17.508221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:17.508245Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:17.508247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:17.508251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:17.508258Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3183 [2:7555896980915182402:12518]
2025-09-30T14:59:17.508277Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:17.508295Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:17.508298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:17.508301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:17.508304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:17.508321Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:17.508329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:17.508338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:17.508421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.508433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.508435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.508439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:17.508443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:17.508520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:17.508530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.508547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.508566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.508605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:17.508630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004984979:2454], now have 1 active actors on pipe
2025-09-30T14:59:17.508640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004985228:4568], now have 1 active actors on pipe
2025-09-30T14:59:17.508648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896980915182397:12518]
2025-09-30T14:59:17.508651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896980915182397:12518]
2025-09-30T14:59:17.508654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896980915182397:12518]
2025-09-30T14:59:17.508669Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:17.508684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:17.508697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:17.508705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:17.508708Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:17.508709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:17.508711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:17.508749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896980915182397:12518]
2025-09-30T14:59:17.508757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:17.508785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:17.508801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.508805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.508833Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:17.508849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:17.508852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:17.508855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:17.508864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:17.508874Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:17.508889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:17.509079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.509097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.509113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:17.509657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2720d73b-3361d2ba-ef5d42e-2d201fa6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:17.508743Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3183
2025-09-30T14:59:17.508758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3183
2025-09-30T14:59:17.509238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3184 partition: 0 MaxSeqNo: 42 sessionId: src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0
2025-09-30T14:59:17.512719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0] Write session: try to update token
2025-09-30T14:59:17.512739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:17.528797Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:17.528821Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:17.528834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896980915182397:12518]
2025-09-30T14:59:17.528884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:17.528893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:17.529082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:17.529249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:17.529400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:17.529569Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:17.529770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:17.529817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:17.530785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3184 sessionId: src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:17.533726Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:17.533938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.533962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.534007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:17.534094Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:17.541100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:17.541123Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:17.541127Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:17.541129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:17.541141Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896980915182397:12518]
2025-09-30T14:59:17.541146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896980915182397:12518]
2025-09-30T14:59:17.541151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896980915182397:12518]
2025-09-30T14:59:17.541190Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:17.541192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:17.541196Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:17.541200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:17.541200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.541203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:17.541345Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:17.553837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896981004985263:10551]
2025-09-30T14:59:17.554132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3183, pipe: [1:7555896981004985263:10551]
2025-09-30T14:59:17.666138Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:17.666921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004985263:10551], now have 1 active actors on pipe
2025-09-30T14:59:17.676465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.676493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.676705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:17.676786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:17.676865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:17.676936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:17.677337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:17.677352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:17.677431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:17.677504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:17.677578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:17.677925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:17.677979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:17.677983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:17.678155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:17.678223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:17.678285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:17.678348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:17.678393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:17.678396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:17.678467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:17.678532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:17.678596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:17.678663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:17.678780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:17.678783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:17.678854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:17.678915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:17.678976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:17.679037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:17.679076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:17.679079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:17.679149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:17.679208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:17.679413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:17.679485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:17.679546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:17.679554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:17.679627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:17.679692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:17.679760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:17.679830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:17.681262Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:17.681320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:17.681328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:17.681365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3184 reason: error at write: Disconnected sessionId: src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0
2025-09-30T14:59:17.681540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896981004985263:10551]
2025-09-30T14:59:17.681610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3184 sessionId: src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0 is DEAD
2025-09-30T14:59:17.682111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:17.682123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0] Write session will restart in 0.008157s
2025-09-30T14:59:17.682147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0] Write session: Do CDS request
2025-09-30T14:59:17.682153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:17.679875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:17.679887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:17.679965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:17.680025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:17.680091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:17.680161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:17.680219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:17.680223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:17.680297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:17.680355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:17.680418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:17.680485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:17.680548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:17.680551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:17.680638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:17.680702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:17.680766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:17.680832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:17.680874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:17.680877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:17.681548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:17.692350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:17.694737Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:17.694753Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3185
2025-09-30T14:59:17.694973Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3185 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:17.695009Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3185 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:17.695018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3185 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:17.695022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:17.695644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3185 sessionId:  describe result for acl check
2025-09-30T14:59:17.695681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:17.695688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:17.695690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:17.695696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896981004985311:4562] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:17.696283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896981004985311:4562] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:17.701547Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896981004985311:4562] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:17.707499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896981004985311:4562] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:17.707518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896981004985311:4562] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:17.707522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896981004985311:4562] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:17.707533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3185 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:17.715333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:17.718564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:17.718900Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:17.718911Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:17.718923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:17.718983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:17.719024Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896980915182680:12522]
2025-09-30T14:59:17.719732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:17.720053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:17.720107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:17.720444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:17.720495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.720500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.720501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.720502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.720503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.720504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.720506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.720507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.720509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.720510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.720511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.720513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.720514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.720515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.720516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.720521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.720533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.720538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.720542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.720546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.720551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.720556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.720560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.720565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.720583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.720588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.720592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.720596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.720600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.720604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.720612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.720620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.720627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.720634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.720639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.720645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.720649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.720655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.720660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.720665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.720669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.720676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.720681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.720686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.720691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.720697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.720702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.720706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.720711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.720718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.720723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.720728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.720733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.720740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.720750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.720755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.720760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.720769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.720775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.720780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.720832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:17.727128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:17.728441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:17.728460Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:17.728463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:17.728467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:17.728475Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3184 [2:7555896980915182680:12522]
2025-09-30T14:59:17.728492Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:17.728510Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:17.728513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:17.728516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:17.728518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:17.728535Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:17.728542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:17.728549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:17.728640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.728648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.728650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.728653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:17.728655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:17.728727Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:17.728740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.728753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.728764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.728780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:17.728797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896980915182675:12522]
2025-09-30T14:59:17.728799Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896980915182675:12522]
2025-09-30T14:59:17.728801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896980915182675:12522]
2025-09-30T14:59:17.728816Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:17.728834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:17.728852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:17.728859Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:17.728876Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:17.728887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:17.728889Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:17.728896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896980915182675:12522]
2025-09-30T14:59:17.728899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:17.728971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:17.729217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004985445:4562], now have 1 active actors on pipe
2025-09-30T14:59:17.729230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004985266:2454], now have 1 active actors on pipe
2025-09-30T14:59:17.729133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3184
2025-09-30T14:59:17.729276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3184
2025-09-30T14:59:17.729359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.729369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.729395Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:17.729408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:17.729412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:17.729414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:17.729425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:17.729436Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:17.729450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:17.729690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.729702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.729720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:17.729901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3185 partition: 0 MaxSeqNo: 42 sessionId: src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0
2025-09-30T14:59:17.730322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2fff2ce-6f060e81-a1962335-dc73abc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:17.733222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0] Write session: try to update token
2025-09-30T14:59:17.733245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:17.752093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3185 sessionId: src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:17.752588Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:17.752613Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:17.752617Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:17.752618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:17.752629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896980915182675:12522]
2025-09-30T14:59:17.752634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896980915182675:12522]
2025-09-30T14:59:17.752637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896980915182675:12522]
2025-09-30T14:59:17.752683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:17.752691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.752694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:17.752858Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:17.754920Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:17.755193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:17.755208Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:17.755215Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:17.781729Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896981004985562:10551]
2025-09-30T14:59:17.783029Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3184, pipe: [1:7555896981004985562:10551]
2025-09-30T14:59:17.875090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:17.875670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.875685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.875727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004985562:10551], now have 1 active actors on pipe
2025-09-30T14:59:17.876139Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896981004985562:10551]
2025-09-30T14:59:17.876252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:17.876261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:17.876320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3185 reason: error at write: Disconnected sessionId: src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0
2025-09-30T14:59:17.876476Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:17.876218Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:17.876776Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:17.876787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0] Write session will restart in 0.008880s
2025-09-30T14:59:17.876810Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0] Write session: Do CDS request
2025-09-30T14:59:17.876816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:17.876581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3185 sessionId: src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0 is DEAD
2025-09-30T14:59:17.886826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:17.886929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:17.886944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3186
2025-09-30T14:59:17.887073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3186 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:17.887102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3186 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:17.887108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3186 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:17.887112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:17.887640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3186 sessionId:  describe result for acl check
2025-09-30T14:59:17.887676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:17.887684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:17.887686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:17.887692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896981004985579:4552] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:17.888298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896981004985579:4552] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:17.890942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896981004985579:4552] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:17.896119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896981004985579:4552] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:17.896134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896981004985579:4552] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:17.896139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896981004985579:4552] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:17.896148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3186 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:17.921734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:17.924938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:17.925160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:17.925169Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:17.925180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:17.925243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:17.925299Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896980915182958:12524]
2025-09-30T14:59:17.925768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:17.926239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:17.926269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:17.926543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:17.926590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.926590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.926591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.926592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.926593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.926594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.926595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.926596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.926596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.926597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.926599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.926599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.926600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.926601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.926601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.926606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.926612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.926615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.926618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.926620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.926622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.926625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.926628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.926630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.926633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.926635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.926637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.926640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.926642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.926644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.926651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.926657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:17.926660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.926664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:17.926667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.926670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:17.926673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.926676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:17.926679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.926681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:17.926684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.926687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:17.926689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.926692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:17.926695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.926698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:17.926703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.926706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:17.926710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.926715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:17.926720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.926726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.926730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.926736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.926742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.926746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.926748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.926751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:17.926754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.926758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:17.926782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:17.934215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:17.935506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:17.935511Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:17.935513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:17.935516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:17.935523Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3185 [2:7555896980915182958:12524]
2025-09-30T14:59:17.935535Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:17.935549Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:17.935551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:17.935554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:17.935555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:17.935569Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:17.935576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:17.935582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:17.935631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.935632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.935633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.935636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:17.935638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:17.935696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:17.935697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.935709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:17.935721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:17.935737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:17.935749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896980915182953:12524]
2025-09-30T14:59:17.935751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896980915182953:12524]
2025-09-30T14:59:17.935753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896980915182953:12524]
2025-09-30T14:59:17.935761Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:17.935770Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:17.935779Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:17.935781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:17.935781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:17.935785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:17.935787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:17.935789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004985567:2454], now have 1 active actors on pipe
2025-09-30T14:59:17.935817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896980915182953:12524]
2025-09-30T14:59:17.935820Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:17.935849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:17.936022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004985614:4552], now have 1 active actors on pipe
2025-09-30T14:59:17.936519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.936531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.936557Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:17.936580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:17.936586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:17.936588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:17.936599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:17.936616Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:17.936632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:17.935893Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3185
2025-09-30T14:59:17.936423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3185
2025-09-30T14:59:17.937101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.937111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.937127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:17.937237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3186 partition: 0 MaxSeqNo: 42 sessionId: src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0
2025-09-30T14:59:17.937591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19ed1d05-1e7e4bb6-dacaa6d0-4c5ad3ad_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:17.940666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0] Write session: try to update token
2025-09-30T14:59:17.940690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:17.960304Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:17.960322Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:17.960331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896980915182953:12524]
2025-09-30T14:59:17.960372Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:17.960545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:17.960730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:17.960899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:17.961065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:17.961304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:17.961356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:17.961468Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:17.959910Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3186 sessionId: src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:17.962764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:17.963009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:17.963023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:17.963049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:17.963157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:17.977690Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896981004985852:10551]
2025-09-30T14:59:17.987556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896981004985852:10551], now have 1 active actors on pipe
2025-09-30T14:59:17.989354Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:17.989373Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:17.989375Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:17.989378Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:17.989388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896980915182953:12524]
2025-09-30T14:59:17.989391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896980915182953:12524]
2025-09-30T14:59:17.989396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896980915182953:12524]
2025-09-30T14:59:17.989441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:17.989448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:17.989451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:17.987985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3185, pipe: [1:7555896981004985852:10551]
2025-09-30T14:59:17.989596Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:17.991410Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:17.991425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:17.991430Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:18.100633Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:18.109305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.109339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.109524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:18.109591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:18.109657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:18.109724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:18.109767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:18.109777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:18.109852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:18.109920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:18.109984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:18.110059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:18.110103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:18.110111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:18.110178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:18.110243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:18.110312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:18.110381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:18.110427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:18.110433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:18.110497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:18.110564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:18.110624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:18.110697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:18.110743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:18.110752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:18.110820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:18.110889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:18.110953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:18.111022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:18.111070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:18.111073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:18.111140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:18.111204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:18.111293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:18.111365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:18.111408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:18.111414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:18.111484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:18.111560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:18.111630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:18.111697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:18.111749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:18.111760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:18.113548Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:18.113559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0] Write session will restart in 0.007828s
2025-09-30T14:59:18.113582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0] Write session: Do CDS request
2025-09-30T14:59:18.113600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:18.113130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896981004985852:10551]
2025-09-30T14:59:18.113176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:18.113179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:18.113208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3186 reason: error at write: Disconnected sessionId: src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0
2025-09-30T14:59:18.113419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3186 sessionId: src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0 is DEAD
2025-09-30T14:59:18.113631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:18.111830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:18.111906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:18.111970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:18.112035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:18.112078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:18.112081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:18.112152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:18.112210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:18.112271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:18.112332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:18.112378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:18.112381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:18.112451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:18.112509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:18.112586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:18.112652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:18.112692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:18.112695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:18.114078Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:18.122798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:18.123165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:18.123180Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3187
2025-09-30T14:59:18.123375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3187 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:18.123413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3187 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:18.123419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3187 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:18.123423Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:18.124153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3187 sessionId:  describe result for acl check
2025-09-30T14:59:18.124188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:18.124189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:18.124191Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:18.124196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896985299953193:4526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:18.124723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896985299953193:4526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:18.127709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896985299953193:4526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:18.135940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896985299953193:4526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:18.135957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896985299953193:4526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:18.135960Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896985299953193:4526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:18.135970Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3187 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:18.146382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:18.150635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:18.150842Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:18.150853Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:18.150864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:18.150916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:18.150961Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896985210150533:12526]
2025-09-30T14:59:18.151500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:18.151993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:18.152048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:18.152316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:18.152379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.152385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.152386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.152387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.152389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.152391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.152392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.152393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.152395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.152396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.152398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.152399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.152400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.152402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.152403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.152409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.152421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.152425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.152430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.152435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.152440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.152445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.152450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.152454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.152460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.152466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.152471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.152478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.152482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.152486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.152495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.152503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.152510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.152516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.152524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.152531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.152542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.152547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.152552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.152557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.152563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.152579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.152584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.152590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.152595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.152601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.152607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.152614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.152621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.152630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.152640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.152650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.152656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.152665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.152671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.152680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.152684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.152688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.152693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.152698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.152740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:18.161334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:18.162235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:18.162243Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:18.162247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:18.162251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:18.162258Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3186 [2:7555896985210150533:12526]
2025-09-30T14:59:18.162789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3186
2025-09-30T14:59:18.162279Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:18.162824Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3186
2025-09-30T14:59:18.162296Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:18.162300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:18.162304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:18.162307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:18.162327Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:18.162335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:18.162342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:18.162411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.162416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.162419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.162423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:18.162426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:18.162504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:18.162507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.162518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.162528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.162544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:18.162563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896985210150527:12526]
2025-09-30T14:59:18.162566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896985210150527:12526]
2025-09-30T14:59:18.162568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896985210150527:12526]
2025-09-30T14:59:18.162576Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:18.162590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:18.162595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:18.162599Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:18.162601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:18.162605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:18.162608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:18.162649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299953364:4526], now have 1 active actors on pipe
2025-09-30T14:59:18.162652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299953160:2454], now have 1 active actors on pipe
2025-09-30T14:59:18.162654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896985210150527:12526]
2025-09-30T14:59:18.162660Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:18.162696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:18.163039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.163050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.163081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ed442f0c-f39fff56-a3c1543f-68664998_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:18.163096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:18.163101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:18.163103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:18.163114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:18.163127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:18.163145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:18.163664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.163676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.163695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:18.164201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57d89d43-2663ec8b-a3b06377-171d68ba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ed442f0c-f39fff56-a3c1543f-68664998_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:18.163804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3187 partition: 0 MaxSeqNo: 42 sessionId: src_id|ed442f0c-f39fff56-a3c1543f-68664998_0
2025-09-30T14:59:18.167486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed442f0c-f39fff56-a3c1543f-68664998_0] Write session: try to update token
2025-09-30T14:59:18.167501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed442f0c-f39fff56-a3c1543f-68664998_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:18.180134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:18.180157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:18.180159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:18.180161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:18.180171Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896985210150527:12526]
2025-09-30T14:59:18.180177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896985210150527:12526]
2025-09-30T14:59:18.180182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896985210150527:12526]
2025-09-30T14:59:18.180226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:18.180233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.180235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:18.180241Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:18.180249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:18.180253Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:18.180397Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:18.193130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3187 sessionId: src_id|ed442f0c-f39fff56-a3c1543f-68664998_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:18.196098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:18.214132Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896985299953449:10551]
2025-09-30T14:59:18.217820Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3186, pipe: [1:7555896985299953449:10551]
2025-09-30T14:59:18.297456Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:18.297999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.298010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.298048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299953449:10551], now have 1 active actors on pipe
2025-09-30T14:59:18.298903Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:18.301847Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:18.301942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3187 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ed442f0c-f39fff56-a3c1543f-68664998_0
2025-09-30T14:59:18.302123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3187 sessionId: src_id|ed442f0c-f39fff56-a3c1543f-68664998_0 is DEAD
2025-09-30T14:59:18.302266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896985299953449:10551]
2025-09-30T14:59:18.302281Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:18.303398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed442f0c-f39fff56-a3c1543f-68664998_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:18.303412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed442f0c-f39fff56-a3c1543f-68664998_0] Write session will restart in 0.006959s
2025-09-30T14:59:18.303437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed442f0c-f39fff56-a3c1543f-68664998_0] Write session: Do CDS request
2025-09-30T14:59:18.303443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed442f0c-f39fff56-a3c1543f-68664998_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:18.312591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ed442f0c-f39fff56-a3c1543f-68664998_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:18.317580Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:18.317599Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3188
2025-09-30T14:59:18.319444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3188 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:18.319488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3188 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:18.319493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3188 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:18.319500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:18.321365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3188 sessionId:  describe result for acl check
2025-09-30T14:59:18.321423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:18.321431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:18.321433Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:18.321439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896985299953499:4496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:18.322044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896985299953499:4496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:18.334396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896985299953499:4496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:18.344201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896985299953499:4496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:18.344220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896985299953499:4496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:18.344223Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896985299953499:4496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:18.344232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3188 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:18.356837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:18.358386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:18.358990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:18.358996Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:18.359013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:18.359090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:18.359131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896985210150849:12535]
2025-09-30T14:59:18.359774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:18.360228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:18.360278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:18.360688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:18.360768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.360770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.360771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.360772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.360773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.360775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.360776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.360778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.360779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.360780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.360781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.360782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.360784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.360785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.360786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.360793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.360804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.360809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.360813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.360818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.360822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.360826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.360831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.360835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.360840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.360844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.360848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.360852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.360856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.360860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.360869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.360878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.360885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.360892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.360898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.360904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.360911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.360917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.360922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.360927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.360932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.360936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.360942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.360947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.360952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.360957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.360963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.360968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.360973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.360980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.360985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.360991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.360996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.361001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.361007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.361013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.361017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.361023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.361029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.361034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.361080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:18.367791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:18.369157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:18.369178Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:18.369181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:18.369184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:18.369191Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3187 [2:7555896985210150849:12535]
2025-09-30T14:59:18.369207Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:18.369225Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:18.369228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:18.369231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:18.369234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:18.369252Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:18.369259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:18.369275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:18.369348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.369356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.369359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.369366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:18.369368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:18.369437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:18.369443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.369458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.369468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.369482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:18.369503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299953691:4496], now have 1 active actors on pipe
2025-09-30T14:59:18.369507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299953466:2454], now have 1 active actors on pipe
2025-09-30T14:59:18.369514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896985210150844:12535]
2025-09-30T14:59:18.369517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896985210150844:12535]
2025-09-30T14:59:18.369518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896985210150844:12535]
2025-09-30T14:59:18.369528Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:18.369537Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:18.369540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:18.369542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:18.369543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:18.369557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:18.369560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:18.369597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896985210150844:12535]
2025-09-30T14:59:18.369605Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:18.369615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3187
2025-09-30T14:59:18.369674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3187
2025-09-30T14:59:18.369845Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:18.369902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.369915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.369942Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|330c0e30-e99f073-e40a129d-d00b4b48_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:18.369955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:18.369963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:18.369965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:18.369978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:18.369993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:18.370013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:18.370375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.370385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.370401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:18.375589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3188 partition: 0 MaxSeqNo: 42 sessionId: src_id|330c0e30-e99f073-e40a129d-d00b4b48_0
2025-09-30T14:59:18.376910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ed442f0c-f39fff56-a3c1543f-68664998_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|330c0e30-e99f073-e40a129d-d00b4b48_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:18.379893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330c0e30-e99f073-e40a129d-d00b4b48_0] Write session: try to update token
2025-09-30T14:59:18.379915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330c0e30-e99f073-e40a129d-d00b4b48_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:18.383660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:18.383684Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:18.383687Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:18.383689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:18.383698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896985210150844:12535]
2025-09-30T14:59:18.383702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896985210150844:12535]
2025-09-30T14:59:18.383706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896985210150844:12535]
2025-09-30T14:59:18.383750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:18.383757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.383759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:18.383776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:18.383785Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:18.383790Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:18.383899Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:18.399914Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3188 sessionId: src_id|330c0e30-e99f073-e40a129d-d00b4b48_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:18.402840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:18.402936Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896985299953768:10551]
2025-09-30T14:59:18.403099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3187, pipe: [1:7555896985299953768:10551]
2025-09-30T14:59:18.500180Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:18.500802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.500829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.500852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299953768:10551], now have 1 active actors on pipe
2025-09-30T14:59:18.501630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:18.501160Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:18.501712Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3188 reason: status is not ok: tablet will be restarted right now sessionId: src_id|330c0e30-e99f073-e40a129d-d00b4b48_0
2025-09-30T14:59:18.501756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896985299953768:10551]
2025-09-30T14:59:18.501793Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:18.502045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330c0e30-e99f073-e40a129d-d00b4b48_0] Counters: { Errors: 0 CurrentSessionLifetimeMs: 125 BytesWritten: 94617674 MessagesWritten: 42 BytesWrittenCompressed: 0 BytesInflightUncompressed: 22528020 BytesInflightCompressed: 0 BytesInflightTotal: 13516812 MessagesInflight: 10 }
2025-09-30T14:59:18.502072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330c0e30-e99f073-e40a129d-d00b4b48_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:18.502077Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330c0e30-e99f073-e40a129d-d00b4b48_0] Write session will restart in 0.007709s
2025-09-30T14:59:18.502111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330c0e30-e99f073-e40a129d-d00b4b48_0] Write session: Do CDS request
2025-09-30T14:59:18.502117Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330c0e30-e99f073-e40a129d-d00b4b48_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:18.501910Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3188 sessionId: src_id|330c0e30-e99f073-e40a129d-d00b4b48_0 is DEAD
2025-09-30T14:59:18.511039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|330c0e30-e99f073-e40a129d-d00b4b48_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:18.511431Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:18.511448Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3189
2025-09-30T14:59:18.513620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3189 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:18.513666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3189 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:18.513674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3189 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:18.513678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:18.514162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3189 sessionId:  describe result for acl check
2025-09-30T14:59:18.514200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:18.514207Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:18.514209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:18.514216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896985299953783:4491] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:18.514674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896985299953783:4491] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:18.518518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896985299953783:4491] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:18.523811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896985299953783:4491] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:18.523826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896985299953783:4491] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:18.523829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896985299953783:4491] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:18.523835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3189 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:18.547518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:18.550773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:18.550993Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:18.550997Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:18.551008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:18.551059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:18.551096Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896985210151140:12544]
2025-09-30T14:59:18.551742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:18.552159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:18.552208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:18.552529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:18.552617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.552619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.552620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.552621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.552622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.552624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.552625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.552627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.552628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.552629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.552630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.552631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.552633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.552634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.552635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.552640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.552650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.552654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.552659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.552662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.552666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.552671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.552675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.552679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.552683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.552687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.552691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.552695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.552698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.552702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.552711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.552718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.552724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.552729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.552735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.552740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.552744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.552750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.552755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.552759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.552763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.552767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.552771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.552777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.552781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.552786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.552790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.552795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.552799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.552804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.552811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.552816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.552822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.552827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.552832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.552838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.552842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.552847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.552852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.552857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.552905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:18.559218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:18.560103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:18.560109Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:18.560111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:18.560115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:18.560122Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3188 [2:7555896985210151140:12544]
2025-09-30T14:59:18.560143Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:18.560161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:18.560165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:18.560168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:18.560170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:18.560187Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:18.560193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:18.560200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:18.560263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.560265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.560268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.560271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:18.560274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:18.560345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:18.560348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.560361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.560374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.560392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:18.560408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896985210151134:12544]
2025-09-30T14:59:18.560411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896985210151134:12544]
2025-09-30T14:59:18.560413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896985210151134:12544]
2025-09-30T14:59:18.560431Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:18.560445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:18.560458Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:18.560461Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:18.560499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896985210151134:12544]
2025-09-30T14:59:18.560501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:18.560502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:18.560505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:18.560507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:18.560511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299953771:2454], now have 1 active actors on pipe
2025-09-30T14:59:18.560512Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:18.560837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3188
2025-09-30T14:59:18.560886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3188
2025-09-30T14:59:18.560778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299953847:4491], now have 1 active actors on pipe
2025-09-30T14:59:18.561260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.561271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.561300Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:18.561309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:18.561313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:18.561316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:18.561327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:18.561338Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:18.561356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:18.561686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.561693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.561709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:18.561990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3189 partition: 0 MaxSeqNo: 42 sessionId: src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0
2025-09-30T14:59:18.562378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|330c0e30-e99f073-e40a129d-d00b4b48_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:18.565616Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0] Write session: try to update token
2025-09-30T14:59:18.565656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:18.573489Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:18.573507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:18.573509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:18.573511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:18.573521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896985210151134:12544]
2025-09-30T14:59:18.573525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896985210151134:12544]
2025-09-30T14:59:18.573530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896985210151134:12544]
2025-09-30T14:59:18.573570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:18.573577Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.573580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:18.573736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:18.574193Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:18.574203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:18.574207Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:18.582283Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3189 sessionId: src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:18.585133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:18.599890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896985299954059:10551]
2025-09-30T14:59:18.600358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3188, pipe: [1:7555896985299954059:10551]
2025-09-30T14:59:18.686530Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:18.687233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.687267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.687306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299954059:10551], now have 1 active actors on pipe
2025-09-30T14:59:18.687487Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:18.687942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:18.687956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:18.688005Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3189 reason: error at write: Disconnected sessionId: src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0
2025-09-30T14:59:18.688154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3189 sessionId: src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0 is DEAD
2025-09-30T14:59:18.688252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896985299954059:10551]
2025-09-30T14:59:18.688290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:18.691496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:18.691508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0] Write session will restart in 0.007565s
2025-09-30T14:59:18.691535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0] Write session: Do CDS request
2025-09-30T14:59:18.691545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:18.703682Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:18.703811Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:18.703826Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3190
2025-09-30T14:59:18.704664Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3190 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:18.704701Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3190 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:18.704707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3190 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:18.704711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:18.705138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3190 sessionId:  describe result for acl check
2025-09-30T14:59:18.705183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:18.705185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:18.705186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:18.705192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896985299954159:4478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:18.705745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896985299954159:4478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:18.709121Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896985299954159:4478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:18.712580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896985299954159:4478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:18.712607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896985299954159:4478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:18.712612Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896985299954159:4478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:18.712621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3190 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:18.718341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:18.722091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:18.722362Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:18.722373Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:18.722385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:18.722446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:18.722495Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896985210151422:12547]
2025-09-30T14:59:18.723170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:18.723547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:18.723595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:18.723939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:18.724008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.724015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.724016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.724018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.724019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.724020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.724022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.724023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.724025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.724027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.724028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.724029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.724030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.724032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.724034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.724040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.724051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.724055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.724060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.724064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.724068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.724073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.724077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.724081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.724086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.724090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.724094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.724098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.724102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.724106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.724114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.724123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.724128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.724134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.724142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.724148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.724153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.724159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.724164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.724170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.724174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.724180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.724185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.724190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.724194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.724199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.724204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.724210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.724215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.724221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.724227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.724241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.724246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.724251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.724256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.724261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.724271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.724277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.724286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.724292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.724340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:18.729939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:18.730970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:18.730989Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:18.730991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:18.730995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:18.731000Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3189 [2:7555896985210151422:12547]
2025-09-30T14:59:18.731210Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:18.731229Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:18.731234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:18.731239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:18.731240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:18.731276Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:18.731291Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:18.731302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:18.731376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.731383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.731385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.731390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:18.731393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:18.731454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:18.731461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.731470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.731480Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.731494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:18.731509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896985210151416:12547]
2025-09-30T14:59:18.731515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896985210151416:12547]
2025-09-30T14:59:18.731517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896985210151416:12547]
2025-09-30T14:59:18.731523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:18.731535Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:18.731535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:18.731539Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:18.731544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:18.731544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:18.731546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:18.731553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299954296:4478], now have 1 active actors on pipe
2025-09-30T14:59:18.731556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299954062:2454], now have 1 active actors on pipe
2025-09-30T14:59:18.731592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896985210151416:12547]
2025-09-30T14:59:18.731607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:18.731619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:18.731705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3189
2025-09-30T14:59:18.731738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3189
2025-09-30T14:59:18.731871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.731886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.731918Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:18.731932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:18.731942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:18.731945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:18.731956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:18.731974Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:18.731995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:18.732367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3190 partition: 0 MaxSeqNo: 42 sessionId: src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0
2025-09-30T14:59:18.732873Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|65bfb69c-75b3482f-55f0aaf1-a3f45642_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:18.732210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.732221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.732243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:18.735819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0] Write session: try to update token
2025-09-30T14:59:18.735838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:18.747781Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:18.747805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:18.747807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:18.747810Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:18.747820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896985210151416:12547]
2025-09-30T14:59:18.747825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896985210151416:12547]
2025-09-30T14:59:18.747830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896985210151416:12547]
2025-09-30T14:59:18.747875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:18.747881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.747884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:18.748030Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:18.750510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:18.750528Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:18.750533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:18.760307Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3190 sessionId: src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:18.763042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:18.788288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896985299954363:10551]
2025-09-30T14:59:18.788778Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3189, pipe: [1:7555896985299954363:10551]
2025-09-30T14:59:18.865778Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:18.866352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.866360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.866377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299954363:10551], now have 1 active actors on pipe
2025-09-30T14:59:18.866597Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:18.866766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:18.867352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:18.867365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0] Write session will restart in 0.005096s
2025-09-30T14:59:18.867390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0] Write session: Do CDS request
2025-09-30T14:59:18.866867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3190 reason: status is not ok: tablet will be restarted right now sessionId: src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0
2025-09-30T14:59:18.867396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:18.867058Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3190 sessionId: src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0 is DEAD
2025-09-30T14:59:18.867145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896985299954363:10551]
2025-09-30T14:59:18.867173Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:18.875694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:18.876038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:18.876055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3191
2025-09-30T14:59:18.876239Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3191 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:18.876278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3191 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:18.876285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3191 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:18.876289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:18.877137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3191 sessionId:  describe result for acl check
2025-09-30T14:59:18.877177Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:18.877180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:18.877182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:18.877188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896985299954392:4460] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:18.877759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896985299954392:4460] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:18.881579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896985299954392:4460] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:18.886011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896985299954392:4460] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:18.886030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896985299954392:4460] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:18.886034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896985299954392:4460] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:18.886043Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3191 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:18.897763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:18.901199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:18.901424Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:18.901429Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:18.901440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:18.901500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:18.901541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896985210151704:12549]
2025-09-30T14:59:18.902204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:18.902577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:18.902641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:18.903037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:18.903111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.903117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.903119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.903120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.903122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.903123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.903124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.903126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.903127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.903128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.903130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.903131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.903133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.903134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.903135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.903141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.903153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.903157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.903161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.903165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.903170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.903174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.903178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.903182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.903186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.903191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.903195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.903210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.903213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.903216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.903225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.903233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:18.903240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.903260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:18.903270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.903274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:18.903279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.903289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:18.903294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.903300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:18.903305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.903312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:18.903320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.903326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:18.903337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.903342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:18.903352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.903357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:18.903362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.903368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:18.903378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.903383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.903387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.903393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.903398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.903403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.903408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.903413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:18.903417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.903422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:18.903466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:18.909722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:18.910821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:18.910835Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:18.910837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:18.910840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:18.910848Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3190 [2:7555896985210151704:12549]
2025-09-30T14:59:18.910860Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:18.910873Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:18.910875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:18.910878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:18.910880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:18.910894Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:18.910901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:18.910909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:18.910974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.910983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.910985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.910989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:18.910992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:18.911065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:18.911073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.911085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:18.911096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:18.911114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:18.911129Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896985210151699:12549]
2025-09-30T14:59:18.911138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896985210151699:12549]
2025-09-30T14:59:18.911140Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896985210151699:12549]
2025-09-30T14:59:18.911150Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:18.911166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299954502:4460], now have 1 active actors on pipe
2025-09-30T14:59:18.911173Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:18.911177Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:18.911178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:18.911179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:18.911192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:18.911195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:18.911201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299954367:2454], now have 1 active actors on pipe
2025-09-30T14:59:18.911241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896985210151699:12549]
2025-09-30T14:59:18.911271Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:18.911280Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:18.911276Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3190
2025-09-30T14:59:18.911313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3190
2025-09-30T14:59:18.911471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.911482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.911511Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|586734ea-c3785005-694f1f0a-619914cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:18.911523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:18.911527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:18.911529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:18.911542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:18.911558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:18.911574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:18.911778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:18.911794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:18.911808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:18.911964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3191 partition: 0 MaxSeqNo: 42 sessionId: src_id|586734ea-c3785005-694f1f0a-619914cc_0
2025-09-30T14:59:18.912357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cf413e73-5cee20d2-94c8a80a-dd3e5234_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|586734ea-c3785005-694f1f0a-619914cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:18.915427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|586734ea-c3785005-694f1f0a-619914cc_0] Write session: try to update token
2025-09-30T14:59:18.915447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|586734ea-c3785005-694f1f0a-619914cc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:18.928210Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:18.928231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:18.928234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:18.928237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:18.928247Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896985210151699:12549]
2025-09-30T14:59:18.928251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896985210151699:12549]
2025-09-30T14:59:18.928256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896985210151699:12549]
2025-09-30T14:59:18.928303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:18.928310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:18.928313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:18.928465Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:18.931583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:18.931604Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:18.931609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:18.938696Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3191 sessionId: src_id|586734ea-c3785005-694f1f0a-619914cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:18.941733Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:18.967529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896985299954657:10551]
2025-09-30T14:59:18.971635Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3190, pipe: [1:7555896985299954657:10551]
2025-09-30T14:59:19.047310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:19.047875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.047894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.047915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896985299954657:10551], now have 1 active actors on pipe
2025-09-30T14:59:19.048151Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:19.048357Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:19.048372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:19.048444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3191 reason: error at write: Disconnected sessionId: src_id|586734ea-c3785005-694f1f0a-619914cc_0
2025-09-30T14:59:19.048631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:19.048655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3191 sessionId: src_id|586734ea-c3785005-694f1f0a-619914cc_0 is DEAD
2025-09-30T14:59:19.048692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896985299954657:10551]
2025-09-30T14:59:19.049025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586734ea-c3785005-694f1f0a-619914cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:19.049037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586734ea-c3785005-694f1f0a-619914cc_0] Write session will restart in 0.009186s
2025-09-30T14:59:19.049061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586734ea-c3785005-694f1f0a-619914cc_0] Write session: Do CDS request
2025-09-30T14:59:19.049070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586734ea-c3785005-694f1f0a-619914cc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:19.059813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|586734ea-c3785005-694f1f0a-619914cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:19.059913Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:19.059939Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3192
2025-09-30T14:59:19.060044Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3192 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:19.060083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3192 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:19.060089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3192 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:19.060095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:19.060511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3192 sessionId:  describe result for acl check
2025-09-30T14:59:19.060538Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:19.060541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:19.060542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:19.060548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896989594921984:4450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:19.061106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896989594921984:4450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:19.063479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896989594921984:4450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:19.067263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896989594921984:4450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:19.067281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896989594921984:4450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:19.067285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896989594921984:4450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:19.067295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3192 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:19.075527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:19.078728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:19.079011Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:19.079028Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:19.079042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:19.079114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:19.079159Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896989505119282:12551]
2025-09-30T14:59:19.079853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:19.080242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:19.080318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:19.080727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:19.080808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.080821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.080822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.080824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.080825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.080827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.080828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.080830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.080831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.080832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.080834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.080835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.080837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.080838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.080839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.080847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.080858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.080863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.080868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.080872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.080877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.080882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.080886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.080890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.080895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.080899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.080903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.080907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.080912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.080916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.080925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.080933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.080940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.080946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.080963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.080970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.080975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.080988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.080993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.081004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.081012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.081023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.081029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.081040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.081050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.081055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.081065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.081073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.081082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.081088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.081093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.081102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.081107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.081117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.081129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.081140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.081150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.081157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.081167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.081173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.081244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:19.087171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:19.088726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:19.088743Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:19.088746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:19.088750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:19.088757Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3191 [2:7555896989505119282:12551]
2025-09-30T14:59:19.088775Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:19.088791Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:19.088794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:19.088797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:19.088799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:19.088816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:19.088823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:19.088830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:19.088896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.088904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.088906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.088909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:19.088912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:19.088983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:19.088991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.089003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.089021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.089045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:19.089071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594921956:2454], now have 1 active actors on pipe
2025-09-30T14:59:19.089134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3191
2025-09-30T14:59:19.089079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594922110:4450], now have 1 active actors on pipe
2025-09-30T14:59:19.089136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3191
2025-09-30T14:59:19.089086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896989505119277:12551]
2025-09-30T14:59:19.089089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896989505119277:12551]
2025-09-30T14:59:19.089091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896989505119277:12551]
2025-09-30T14:59:19.089105Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:19.089120Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:19.089131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:19.089135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:19.089138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:19.089138Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:19.089141Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:19.089182Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896989505119277:12551]
2025-09-30T14:59:19.089185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:19.089188Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:19.089455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.089466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.089521Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:19.089534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:19.089542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:19.089544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:19.089554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:19.089568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:19.089595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:19.090020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3192 partition: 0 MaxSeqNo: 42 sessionId: src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0
2025-09-30T14:59:19.089890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.089906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.089940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:19.090496Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|586734ea-c3785005-694f1f0a-619914cc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:19.093625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0] Write session: try to update token
2025-09-30T14:59:19.093648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:19.106917Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:19.106937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:19.106939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:19.106941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:19.106951Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896989505119277:12551]
2025-09-30T14:59:19.106957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896989505119277:12551]
2025-09-30T14:59:19.106961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896989505119277:12551]
2025-09-30T14:59:19.107017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:19.107023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:19.107030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:19.107032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.107035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:19.107038Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:19.107192Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:19.111730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3192 sessionId: src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:19.114619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:19.148755Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896989594922247:10551]
2025-09-30T14:59:19.149073Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3191, pipe: [1:7555896989594922247:10551]
2025-09-30T14:59:19.234588Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:19.234907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.234915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.234954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594922247:10551], now have 1 active actors on pipe
2025-09-30T14:59:19.235395Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:19.235621Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896989594922247:10551]
2025-09-30T14:59:19.235665Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:19.235702Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:19.235707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:19.235799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3192 reason: error at write: Disconnected sessionId: src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0
2025-09-30T14:59:19.239363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:19.239390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0] Write session will restart in 0.009699s
2025-09-30T14:59:19.235969Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3192 sessionId: src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0 is DEAD
2025-09-30T14:59:19.239414Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0] Write session: Do CDS request
2025-09-30T14:59:19.239423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:19.251767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:19.255443Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:19.255460Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3193
2025-09-30T14:59:19.255636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3193 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:19.255664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3193 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:19.255670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3193 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:19.255674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:19.260310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3193 sessionId:  describe result for acl check
2025-09-30T14:59:19.260364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:19.260369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:19.260372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:19.260379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896989594922393:4447] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:19.261004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896989594922393:4447] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:19.266000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896989594922393:4447] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:19.271910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896989594922393:4447] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:19.271925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896989594922393:4447] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:19.271930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896989594922393:4447] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:19.271939Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3193 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:19.278197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:19.280547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:19.280800Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:19.280806Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:19.280815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:19.280870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:19.280906Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896989505119567:12554]
2025-09-30T14:59:19.281592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:19.282134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:19.282183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:19.282516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:19.282572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.282574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.282575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.282576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.282577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.282579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.282581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.282582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.282583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.282584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.282586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.282587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.282589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.282590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.282591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.282596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.282606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.282610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.282614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.282618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.282622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.282626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.282630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.282633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.282637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.282640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.282644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.282648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.282652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.282656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.282663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.282671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.282677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.282682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.282687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.282692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.282696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.282701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.282706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.282711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.282716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.282721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.282729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.282734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.282738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.282744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.282748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.282754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.282759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.282764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.282769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.282774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.282779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.282784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.282789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.282794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.282798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.282803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.282808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.282813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.282859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:19.289603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:19.290548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:19.290554Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:19.290557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:19.290561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:19.290568Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3192 [2:7555896989505119567:12554]
2025-09-30T14:59:19.290588Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:19.290605Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:19.290608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:19.290612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:19.290615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:19.290632Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:19.290639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:19.290647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:19.290994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.290999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.291001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.291005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:19.291007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:19.291090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:19.291093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.291107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.291121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.291143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:19.291161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896989505119562:12554]
2025-09-30T14:59:19.291163Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896989505119562:12554]
2025-09-30T14:59:19.291165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896989505119562:12554]
2025-09-30T14:59:19.291180Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:19.291196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:19.291212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:19.291216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:19.291276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896989505119562:12554]
2025-09-30T14:59:19.291279Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:19.291929Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3192
2025-09-30T14:59:19.291974Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3192
2025-09-30T14:59:19.291513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:19.291524Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:19.291526Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:19.291531Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:19.295070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594922250:2454], now have 1 active actors on pipe
2025-09-30T14:59:19.295082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594922515:4447], now have 1 active actors on pipe
2025-09-30T14:59:19.295105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.295113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.295156Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:19.295168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:19.295173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:19.295176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:19.295190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:19.295208Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:19.295229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:19.296213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.296229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.296252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:19.296413Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3193 partition: 0 MaxSeqNo: 42 sessionId: src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0
2025-09-30T14:59:19.299588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cc87b8e4-65c0c3ee-536aa5d1-bad94da9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:19.303012Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0] Write session: try to update token
2025-09-30T14:59:19.303036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:19.309399Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:19.309419Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:19.309422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:19.309424Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:19.309434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896989505119562:12554]
2025-09-30T14:59:19.309439Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896989505119562:12554]
2025-09-30T14:59:19.309444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896989505119562:12554]
2025-09-30T14:59:19.309484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:19.309491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.309494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:19.309639Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:19.311856Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:19.311870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:19.311874Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:19.338062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896989594922550:10551]
2025-09-30T14:59:19.338112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3193 sessionId: src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:19.339688Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3192, pipe: [1:7555896989594922550:10551]
2025-09-30T14:59:19.341028Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:19.477408Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:19.477769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594922550:10551], now have 1 active actors on pipe
2025-09-30T14:59:19.477804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.477818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.478099Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:19.478157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:19.478165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:19.478230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3193 reason: error at write: Disconnected sessionId: src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0
2025-09-30T14:59:19.478417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3193 sessionId: src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0 is DEAD
2025-09-30T14:59:19.478502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896989594922550:10551]
2025-09-30T14:59:19.478178Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:19.479331Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:19.479344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0] Write session will restart in 0.008652s
2025-09-30T14:59:19.479368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0] Write session: Do CDS request
2025-09-30T14:59:19.479377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:19.488855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:19.491834Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:19.491852Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3194
2025-09-30T14:59:19.497494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3194 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:19.497557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3194 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:19.497562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3194 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:19.497569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:19.498594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3194 sessionId:  describe result for acl check
2025-09-30T14:59:19.498632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:19.498634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:19.498636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:19.498642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896989594922743:4409] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:19.499175Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896989594922743:4409] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:19.502052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896989594922743:4409] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:19.505642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896989594922743:4409] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:19.505660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896989594922743:4409] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:19.505664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896989594922743:4409] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:19.505673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3194 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:19.506465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:19.508905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:19.509309Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:19.509320Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:19.509333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:19.509396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:19.509458Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896989505119900:12568]
2025-09-30T14:59:19.510139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:19.510434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:19.510476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:19.510805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:19.510874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.510881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.510882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.510883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.510885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.510886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.510887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.510889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.510890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.510891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.510893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.510894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.510895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.510896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.510897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.510903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.510925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.510930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.510933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.510936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.510940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.510943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.510947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.510950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.510954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.510957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.510960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.510964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.510967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.510970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.510978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.510985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.510991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.510997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.511001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.511008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.511014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.511019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.511024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.511028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.511032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.511037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.511042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.511047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.511052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.511057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.511062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.511067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.511071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.511077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.511081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.511086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.511104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.511116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.511122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.511128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.511137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.511142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.511147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.511152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.511204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:19.517111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:19.518447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:19.518467Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:19.518470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:19.518474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:19.518482Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3193 [2:7555896989505119900:12568]
2025-09-30T14:59:19.518500Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:19.518516Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:19.518519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:19.518523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:19.518525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:19.518541Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:19.518554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:19.518567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:19.518631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.518638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.518643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.518647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:19.518649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:19.518719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:19.518726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.518740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.518754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.518781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:19.518800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594922579:2454], now have 1 active actors on pipe
2025-09-30T14:59:19.518805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594922858:4409], now have 1 active actors on pipe
2025-09-30T14:59:19.518812Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896989505119895:12568]
2025-09-30T14:59:19.518814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896989505119895:12568]
2025-09-30T14:59:19.518817Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896989505119895:12568]
2025-09-30T14:59:19.518835Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:19.518852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:19.518852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:19.518857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:19.518860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:19.518872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:19.518875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:19.518908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896989505119895:12568]
2025-09-30T14:59:19.518920Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:19.518927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:19.518906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3193
2025-09-30T14:59:19.518934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3193
2025-09-30T14:59:19.518985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.518996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.519020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11a8bd32-5018b172-a37c9a16-84d30648_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:19.519031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:19.519040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:19.519043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:19.519053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:19.519062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:19.519075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:19.519278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.519288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.519302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:19.519485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3194 partition: 0 MaxSeqNo: 42 sessionId: src_id|11a8bd32-5018b172-a37c9a16-84d30648_0
2025-09-30T14:59:19.519887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6024a1e-219dfd9f-3839deb4-21be3e11_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|11a8bd32-5018b172-a37c9a16-84d30648_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:19.522832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a8bd32-5018b172-a37c9a16-84d30648_0] Write session: try to update token
2025-09-30T14:59:19.522852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a8bd32-5018b172-a37c9a16-84d30648_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:19.538663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3194 sessionId: src_id|11a8bd32-5018b172-a37c9a16-84d30648_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:19.537921Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:19.537939Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:19.537949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896989505119895:12568]
2025-09-30T14:59:19.538001Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:19.538034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:19.538194Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:19.538344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:19.538485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:19.538651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:19.538858Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:19.538893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:19.541596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:19.541970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.541990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.542035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:19.542129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:19.543962Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:19.543977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:19.543979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:19.543981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:19.543991Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896989505119895:12568]
2025-09-30T14:59:19.543995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896989505119895:12568]
2025-09-30T14:59:19.543998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896989505119895:12568]
2025-09-30T14:59:19.544035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:19.544048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.544048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:19.544055Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:19.544055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:19.544058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:19.544190Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:19.578841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896989594922871:10551]
2025-09-30T14:59:19.579223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3193, pipe: [1:7555896989594922871:10551]
2025-09-30T14:59:19.659200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:19.669024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.669056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.669267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:19.669348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:19.669435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:19.669510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:19.669563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:19.669568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:19.669656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:19.669728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:19.669802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:19.669881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:19.669924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:19.669928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:19.670008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:19.670073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:19.670142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:19.670214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:19.670259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:19.670267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:19.670357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:19.670428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:19.670500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:19.670573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:19.670616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:19.670619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:19.670698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:19.670762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:19.670836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:19.670907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:19.670951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:19.670955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:19.671031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:19.671094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:19.671160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:19.671224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:19.671622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:19.671638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:19.671743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:19.671819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:19.671904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:19.671989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:19.672043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:19.672047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:19.672136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:19.672242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:19.672353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:19.672436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:19.672487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:19.672491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:19.672597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:19.672682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:19.672773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:19.672896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:19.672948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:19.672951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:19.673040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:19.673122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:19.673207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:19.673283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:19.673339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:19.673342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:19.673443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594922871:10551], now have 1 active actors on pipe
2025-09-30T14:59:19.675096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896989594922871:10551]
2025-09-30T14:59:19.675137Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:19.675180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:19.675185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:19.675230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3194 reason: error at write: Disconnected sessionId: src_id|11a8bd32-5018b172-a37c9a16-84d30648_0
2025-09-30T14:59:19.675465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3194 sessionId: src_id|11a8bd32-5018b172-a37c9a16-84d30648_0 is DEAD
2025-09-30T14:59:19.675869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a8bd32-5018b172-a37c9a16-84d30648_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:19.675880Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a8bd32-5018b172-a37c9a16-84d30648_0] Write session will restart in 0.005416s
2025-09-30T14:59:19.675912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a8bd32-5018b172-a37c9a16-84d30648_0] Write session: Do CDS request
2025-09-30T14:59:19.675917Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a8bd32-5018b172-a37c9a16-84d30648_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:19.676136Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] Counters: { Errors: 31 CurrentSessionLifetimeMs: 541720 BytesRead: 38297624 MessagesRead: 17 BytesReadCompressed: 38297624 BytesInflightUncompressed: 2252802 BytesInflightCompressed: 2252802 BytesInflightTotal: 4505604 MessagesInflight: 2 }
2025-09-30T14:59:19.675443Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:19.682772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11a8bd32-5018b172-a37c9a16-84d30648_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:19.682924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:19.682943Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3195
2025-09-30T14:59:19.683092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3195 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:19.683129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3195 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:19.683143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3195 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:19.683147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:19.683628Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3195 sessionId:  describe result for acl check
2025-09-30T14:59:19.683668Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:19.683670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:19.683672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:19.683678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896989594922880:4385] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:19.684283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896989594922880:4385] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:19.689244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896989594922880:4385] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:19.703183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896989594922880:4385] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:19.703200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896989594922880:4385] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:19.703204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896989594922880:4385] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:19.703213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3195 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:19.723406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:19.727232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:19.727502Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:19.727515Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:19.727526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:19.727579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:19.727619Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896989505120188:12572]
2025-09-30T14:59:19.728268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:19.728742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:19.728792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:19.729126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:19.729191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.729195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.729196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.729198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.729199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.729201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.729202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.729203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.729205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.729206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.729207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.729208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.729209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.729211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.729212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.729217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.729227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.729231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.729234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.729238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.729241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.729245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.729249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.729252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.729256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.729259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.729262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.729266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.729270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.729273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.729280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.729288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.729294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.729299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.729303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.729308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.729312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.729319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.729324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.729329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.729333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.729337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.729342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.729346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.729351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.729356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.729360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.729365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.729369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.729373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.729379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.729383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.729387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.729392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.729397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.729401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.729406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.729410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.729415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.729420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.729462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:19.740330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:19.741188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:19.741201Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:19.741203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:19.741206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:19.741212Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3194 [2:7555896989505120188:12572]
2025-09-30T14:59:19.741225Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:19.741239Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:19.741241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:19.741243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:19.741245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:19.741259Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:19.741264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:19.741270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:19.741337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.741348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.741351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.741354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:19.741357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:19.741864Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3194
2025-09-30T14:59:19.741908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3194
2025-09-30T14:59:19.741429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:19.741442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.741453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.741463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.741478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:19.741494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896989505120183:12572]
2025-09-30T14:59:19.741496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896989505120183:12572]
2025-09-30T14:59:19.741498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896989505120183:12572]
2025-09-30T14:59:19.741523Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:19.741525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:19.741527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:19.741529Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:19.741538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:19.741552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:19.741556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:19.741566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594922966:4385], now have 1 active actors on pipe
2025-09-30T14:59:19.741569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594922873:2454], now have 1 active actors on pipe
2025-09-30T14:59:19.741599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896989505120183:12572]
2025-09-30T14:59:19.741606Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:19.741625Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:19.742329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.742345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.742384Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|581f9af6-14010614-dadf06e9-ccf44d34_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:19.742402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:19.742407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:19.742410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:19.742425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:19.742439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:19.742465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:19.743666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.743684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.743714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:19.744312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11a8bd32-5018b172-a37c9a16-84d30648_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|581f9af6-14010614-dadf06e9-ccf44d34_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:19.743896Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3195 partition: 0 MaxSeqNo: 42 sessionId: src_id|581f9af6-14010614-dadf06e9-ccf44d34_0
2025-09-30T14:59:19.747555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|581f9af6-14010614-dadf06e9-ccf44d34_0] Write session: try to update token
2025-09-30T14:59:19.747575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|581f9af6-14010614-dadf06e9-ccf44d34_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:19.759116Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:19.759139Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:19.759141Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:19.759144Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:19.759153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896989505120183:12572]
2025-09-30T14:59:19.759158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896989505120183:12572]
2025-09-30T14:59:19.759164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896989505120183:12572]
2025-09-30T14:59:19.759207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:19.759214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.759217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:19.759382Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:19.759389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:19.759398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:19.759402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:19.769592Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3195 sessionId: src_id|581f9af6-14010614-dadf06e9-ccf44d34_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:19.772811Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:19.776198Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896989594923174:10551]
2025-09-30T14:59:19.779593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3194, pipe: [1:7555896989594923174:10551]
2025-09-30T14:59:19.887927Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:19.888535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.888545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.888578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594923174:10551], now have 1 active actors on pipe
2025-09-30T14:59:19.891654Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:19.891722Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896989594923174:10551]
2025-09-30T14:59:19.891747Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:19.891750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:19.891820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3195 reason: error at write: Disconnected sessionId: src_id|581f9af6-14010614-dadf06e9-ccf44d34_0
2025-09-30T14:59:19.892014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3195 sessionId: src_id|581f9af6-14010614-dadf06e9-ccf44d34_0 is DEAD
2025-09-30T14:59:19.891537Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:19.895132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581f9af6-14010614-dadf06e9-ccf44d34_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:19.895140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581f9af6-14010614-dadf06e9-ccf44d34_0] Write session will restart in 0.005378s
2025-09-30T14:59:19.895166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581f9af6-14010614-dadf06e9-ccf44d34_0] Write session: Do CDS request
2025-09-30T14:59:19.895174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581f9af6-14010614-dadf06e9-ccf44d34_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:19.901763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|581f9af6-14010614-dadf06e9-ccf44d34_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:19.901910Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:19.901926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3196
2025-09-30T14:59:19.902095Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3196 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:19.902131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3196 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:19.902144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3196 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:19.902150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:19.902695Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3196 sessionId:  describe result for acl check
2025-09-30T14:59:19.902739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:19.902807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:19.902814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:19.902822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896989594923199:4369] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:19.903393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896989594923199:4369] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:19.908753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896989594923199:4369] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:19.914490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896989594923199:4369] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:19.914514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896989594923199:4369] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:19.914517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896989594923199:4369] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:19.914527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3196 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:19.926919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:19.932391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:19.932655Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:19.932668Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:19.932681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:19.932748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:19.932801Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896989505120477:12574]
2025-09-30T14:59:19.933521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:19.934108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:19.934171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:19.934546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:19.934613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.934614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.934616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.934617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.934619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.934621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.934622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.934624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.934625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.934627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.934629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.934630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.934632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.934633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.934635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.934642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.934654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.934659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.934663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.934667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.934672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.934677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.934681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.934686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.934691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.934695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.934699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.934704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.934709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.934713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.934721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.934730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:19.934737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.934744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:19.934755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.934760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:19.934772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.934779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:19.934784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.934795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:19.934807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.934817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:19.934823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.934834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:19.934840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.934851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:19.934859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.934869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:19.934880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.934886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:19.934895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.934902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.934911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.934917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.934927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.934937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.934942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.934953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:19.934958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.934968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:19.935017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:19.940712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:19.942187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:19.942201Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:19.942203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:19.942207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:19.942212Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3195 [2:7555896989505120477:12574]
2025-09-30T14:59:19.942225Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:19.942238Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:19.942240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:19.942243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:19.942245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:19.942257Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:19.942262Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:19.942269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:19.942319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.942321Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.942323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.942326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:19.942328Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:19.942383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:19.942385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.942395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:19.942402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:19.942417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:19.942430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896989505120471:12574]
2025-09-30T14:59:19.942432Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896989505120471:12574]
2025-09-30T14:59:19.942433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896989505120471:12574]
2025-09-30T14:59:19.942441Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:19.942451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:19.942460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:19.942462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:19.942491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896989505120471:12574]
2025-09-30T14:59:19.942493Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:19.942501Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:19.942505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:19.942507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:19.942514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:19.942529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594923184:2454], now have 1 active actors on pipe
2025-09-30T14:59:19.942532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594923324:4369], now have 1 active actors on pipe
2025-09-30T14:59:19.943508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.943515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.943542Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:19.943549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:19.943554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:19.943556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:19.943567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:19.943580Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:19.943594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:19.943827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:19.943838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:19.943855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:19.942837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3195
2025-09-30T14:59:19.942875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3195
2025-09-30T14:59:19.944025Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3196 partition: 0 MaxSeqNo: 42 sessionId: src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0
2025-09-30T14:59:19.946278Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|581f9af6-14010614-dadf06e9-ccf44d34_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:19.949329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0] Write session: try to update token
2025-09-30T14:59:19.949362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:19.956212Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:19.956231Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:19.956234Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:19.956236Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:19.956246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896989505120471:12574]
2025-09-30T14:59:19.956252Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896989505120471:12574]
2025-09-30T14:59:19.956257Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896989505120471:12574]
2025-09-30T14:59:19.956311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:19.956319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:19.956322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:19.956487Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:19.956548Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:19.956577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:19.956581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:19.971810Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3196 sessionId: src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:19.974695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:19.992251Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896989594923479:10551]
2025-09-30T14:59:19.992749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3195, pipe: [1:7555896989594923479:10551]
2025-09-30T14:59:20.079787Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:20.080143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.080153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.080193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896989594923479:10551], now have 1 active actors on pipe
2025-09-30T14:59:20.082628Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:20.083091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896989594923479:10551]
2025-09-30T14:59:20.083125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:20.083163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:20.083361Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3196 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0
2025-09-30T14:59:20.083539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3196 sessionId: src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0 is DEAD
2025-09-30T14:59:20.083739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:20.083751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0] Write session will restart in 0.009354s
2025-09-30T14:59:20.083786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0] Write session: Do CDS request
2025-09-30T14:59:20.083791Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:20.095753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:20.096193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:20.096211Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3197
2025-09-30T14:59:20.096368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3197 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:20.096409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3197 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:20.096415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3197 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:20.096419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:20.096991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3197 sessionId:  describe result for acl check
2025-09-30T14:59:20.097033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:20.097039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:20.097041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:20.097048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896993889890787:4357] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:20.097676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896993889890787:4357] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:20.101411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896993889890787:4357] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:20.108185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896993889890787:4357] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:20.108204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896993889890787:4357] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:20.108208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896993889890787:4357] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:20.108218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3197 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:20.126603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:20.130215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:20.130444Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:20.130456Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:20.130468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:20.130542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:20.130586Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896993800088061:12576]
2025-09-30T14:59:20.131348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:20.131729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:20.131779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:20.132124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:20.132186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.132192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.132193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.132195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.132196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.132197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.132199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.132200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.132201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.132203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.132204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.132205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.132207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.132208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.132209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.132215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.132226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.132230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.132235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.132239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.132243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.132247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.132251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.132255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.132259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.132263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.132267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.132271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.132276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.132280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.132291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.132299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.132305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.132311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.132316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.132321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.132327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.132333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.132339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.132345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.132349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.132355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.132359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.132364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.132369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.132374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.132391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.132397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.132401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.132407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.132412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.132417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.132421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.132426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.132431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.132436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.132441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.132446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.132451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.132456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.132502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:20.140471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3196
2025-09-30T14:59:20.140510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3196
2025-09-30T14:59:20.139165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:20.140023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:20.140029Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:20.140032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:20.140037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:20.140044Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3196 [2:7555896993800088061:12576]
2025-09-30T14:59:20.140060Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:20.140076Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:20.140079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:20.140083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:20.140086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:20.140100Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:20.140106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:20.140112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:20.140174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.140176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.140179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.140182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:20.140185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:20.140489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:20.140492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.140519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.140531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.140549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:20.140578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889890778:2454], now have 1 active actors on pipe
2025-09-30T14:59:20.140583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889890836:4357], now have 1 active actors on pipe
2025-09-30T14:59:20.140588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896993800088056:12576]
2025-09-30T14:59:20.140591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896993800088056:12576]
2025-09-30T14:59:20.140593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896993800088056:12576]
2025-09-30T14:59:20.140607Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:20.140620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:20.140634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:20.140638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:20.140670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896993800088056:12576]
2025-09-30T14:59:20.140673Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:20.140738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:20.140743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:20.140745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:20.140752Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:20.140988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.141006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.141041Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:20.141051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:20.141056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:20.141065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:20.141085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:20.141105Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:20.141124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:20.143803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.143827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.143863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:20.145784Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3197 partition: 0 MaxSeqNo: 42 sessionId: src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0
2025-09-30T14:59:20.150717Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8d31ab4c-c04cbb88-f6ca0770-e464d465_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:20.153948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0] Write session: try to update token
2025-09-30T14:59:20.153975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:20.155049Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:20.155073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:20.155076Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:20.155078Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:20.155088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896993800088056:12576]
2025-09-30T14:59:20.155093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896993800088056:12576]
2025-09-30T14:59:20.155098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896993800088056:12576]
2025-09-30T14:59:20.155141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:20.155148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.155151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:20.155159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:20.155167Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:20.155171Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:20.155313Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:20.169877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3197 sessionId: src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:20.173127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:20.183502Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896993889891075:10551]
2025-09-30T14:59:20.183863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3196, pipe: [1:7555896993889891075:10551]
2025-09-30T14:59:20.270753Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:20.271484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.271508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.271527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889891075:10551], now have 1 active actors on pipe
2025-09-30T14:59:20.271750Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:20.272066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896993889891075:10551]
2025-09-30T14:59:20.272097Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:20.272131Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:20.272198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3197 reason: status is not ok: tablet will be restarted right now sessionId: src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0
2025-09-30T14:59:20.272397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3197 sessionId: src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0 is DEAD
2025-09-30T14:59:20.272551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:20.272591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0] Write session will restart in 0.009324s
2025-09-30T14:59:20.272614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0] Write session: Do CDS request
2025-09-30T14:59:20.272619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:20.282770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:20.283837Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:20.283853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3198
2025-09-30T14:59:20.284900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3198 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:20.284940Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3198 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:20.284945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3198 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:20.284950Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:20.285672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3198 sessionId:  describe result for acl check
2025-09-30T14:59:20.285702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:20.285704Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:20.285705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:20.285711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896993889891121:4347] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:20.286229Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896993889891121:4347] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:20.291122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896993889891121:4347] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:20.296634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896993889891121:4347] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:20.296652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896993889891121:4347] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:20.296656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896993889891121:4347] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:20.296665Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3198 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:20.302361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:20.305824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:20.306075Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:20.306088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:20.306100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:20.306162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:20.306210Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896993800088352:12579]
2025-09-30T14:59:20.306869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:20.307287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:20.307354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:20.307696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:20.307784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.307794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.307795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.307796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.307797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.307798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.307800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.307801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.307802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.307803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.307805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.307806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.307807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.307808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.307810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.307818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.307829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.307833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.307837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.307841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.307845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.307848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.307852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.307856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.307860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.307864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.307868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.307871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.307875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.307878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.307887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.307896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.307903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.307908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.307914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.307919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.307924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.307930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.307935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.307940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.307945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.307951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.307956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.307962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.307967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.307972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.307978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.307983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.307987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.307992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.307999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.308005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.308010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.308016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.308021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.308025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.308029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.308035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.308040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.308045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.308089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:20.314663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:20.315713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:20.315737Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:20.315740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:20.315744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:20.315752Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3197 [2:7555896993800088352:12579]
2025-09-30T14:59:20.315771Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:20.315790Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:20.315794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:20.315797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:20.315800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:20.315816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:20.315823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:20.315830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:20.315891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.315900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.315902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.315906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:20.315909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:20.315981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:20.315990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.316003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.316015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.316038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:20.316064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889891275:4347], now have 1 active actors on pipe
2025-09-30T14:59:20.316072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896993800088347:12579]
2025-09-30T14:59:20.316075Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896993800088347:12579]
2025-09-30T14:59:20.316077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896993800088347:12579]
2025-09-30T14:59:20.316091Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:20.316101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889891077:2454], now have 1 active actors on pipe
2025-09-30T14:59:20.316110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:20.316126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:20.316143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:20.316184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896993800088347:12579]
2025-09-30T14:59:20.316187Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:20.316225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:20.316239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:20.316242Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:20.316249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:20.316222Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3197
2025-09-30T14:59:20.316257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3197
2025-09-30T14:59:20.316474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.316488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.316533Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:20.316547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:20.316552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:20.316569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:20.316583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:20.316595Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:20.316611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:20.316940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.316953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.316973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:20.317062Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3198 partition: 0 MaxSeqNo: 42 sessionId: src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0
2025-09-30T14:59:20.317506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|457e2c01-dc1c804f-b45a431f-ed4d2c62_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:20.320501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0] Write session: try to update token
2025-09-30T14:59:20.320523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:20.330608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:20.330632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:20.330635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:20.330638Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:20.330647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896993800088347:12579]
2025-09-30T14:59:20.330651Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896993800088347:12579]
2025-09-30T14:59:20.330654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896993800088347:12579]
2025-09-30T14:59:20.330696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:20.330703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.330705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:20.330719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:20.330727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:20.330732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:20.330849Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:20.343486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3198 sessionId: src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:20.346142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:20.372423Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896993889891380:10551]
2025-09-30T14:59:20.375617Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3197, pipe: [1:7555896993889891380:10551]
2025-09-30T14:59:20.452757Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:20.453425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.453435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.453459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889891380:10551], now have 1 active actors on pipe
2025-09-30T14:59:20.453919Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:20.457589Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:20.457654Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896993889891380:10551]
2025-09-30T14:59:20.457679Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:20.457760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3198 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0
2025-09-30T14:59:20.457938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3198 sessionId: src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0 is DEAD
2025-09-30T14:59:20.459470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:20.459483Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0] Write session will restart in 0.008891s
2025-09-30T14:59:20.459509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0] Write session: Do CDS request
2025-09-30T14:59:20.459514Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:20.469848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:20.471489Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:20.471506Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3199
2025-09-30T14:59:20.471701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3199 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:20.471730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3199 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:20.471735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3199 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:20.471739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:20.472191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3199 sessionId:  describe result for acl check
2025-09-30T14:59:20.472228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:20.472230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:20.472233Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:20.472239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896993889891414:4336] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:20.472814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896993889891414:4336] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:20.481553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896993889891414:4336] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:20.487064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896993889891414:4336] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:20.487074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896993889891414:4336] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:20.487078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896993889891414:4336] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:20.487086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3199 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:20.496802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:20.499797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:20.500487Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:20.500505Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:20.500524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:20.500630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:20.500688Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896993800088690:12587]
2025-09-30T14:59:20.501502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:20.501957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:20.502053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:20.502496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:20.502581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.502590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.502592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.502593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.502595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.502596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.502598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.502599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.502601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.502603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.502605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.502607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.502608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.502610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.502611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.502619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.502632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.502637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.502641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.502645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.502649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.502654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.502658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.502663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.502669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.502673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.502678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.502682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.502687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.502690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.502701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.502711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.502719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.502726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.502731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.502738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.502743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.502749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.502755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.502761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.502766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.502773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.502780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.502786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.502791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.502797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.502803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.502809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.502815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.502821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.502828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.502834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.502847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.502853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.502859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.502865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.502877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.502882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.502888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.502895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.502944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:20.510201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3198
2025-09-30T14:59:20.508577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:20.509660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:20.509668Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:20.509672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:20.511347Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1aeff4ba-934e15f8-82b20caa-922f8ed5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:20.514213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0] Write session: try to update token
2025-09-30T14:59:20.514231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:20.510209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3198
2025-09-30T14:59:20.509677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:20.510928Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3199 partition: 0 MaxSeqNo: 42 sessionId: src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0
2025-09-30T14:59:20.509686Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3198 [2:7555896993800088690:12587]
2025-09-30T14:59:20.509709Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:20.509729Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:20.509733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:20.509737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:20.509740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:20.509760Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:20.509769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:20.509778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:20.509860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.509863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.509865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.509870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:20.509873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:20.509967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:20.509971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.509986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.509999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.510017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:20.510038Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896993800088685:12587]
2025-09-30T14:59:20.510041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896993800088685:12587]
2025-09-30T14:59:20.510044Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896993800088685:12587]
2025-09-30T14:59:20.510055Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:20.510066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:20.510071Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:20.510073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:20.510074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:20.510091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:20.510095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:20.510107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889891584:4336], now have 1 active actors on pipe
2025-09-30T14:59:20.510112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889891400:2454], now have 1 active actors on pipe
2025-09-30T14:59:20.510151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896993800088685:12587]
2025-09-30T14:59:20.510159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:20.510174Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:20.510418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.510424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.510460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:20.510469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:20.510475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:20.510477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:20.510492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:20.510502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:20.510523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:20.510794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.510799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.510829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:20.523786Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:20.523807Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:20.523818Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896993800088685:12587]
2025-09-30T14:59:20.523869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:20.523885Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:20.524041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:20.524195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:20.524328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:20.524476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:20.524684Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:20.524722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:20.534816Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3199 sessionId: src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:20.537722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:20.536020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:20.536046Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:20.536050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:20.536053Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:20.536067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896993800088685:12587]
2025-09-30T14:59:20.536071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896993800088685:12587]
2025-09-30T14:59:20.536077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896993800088685:12587]
2025-09-30T14:59:20.536132Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:20.536142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.536147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:20.536332Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:20.537914Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:20.537923Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:20.537929Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:20.557770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896993889891705:10551]
2025-09-30T14:59:20.558155Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3198, pipe: [1:7555896993889891705:10551]
2025-09-30T14:59:20.662409Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:20.663209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.663227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.663272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889891705:10551], now have 1 active actors on pipe
2025-09-30T14:59:20.663578Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:20.664437Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:20.664451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0] Write session will restart in 0.008744s
2025-09-30T14:59:20.664475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0] Write session: Do CDS request
2025-09-30T14:59:20.664481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:20.663670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896993889891705:10551]
2025-09-30T14:59:20.663719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:20.663799Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:20.663828Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3199 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0
2025-09-30T14:59:20.664021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3199 sessionId: src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0 is DEAD
2025-09-30T14:59:20.676635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:20.677151Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:20.677169Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3200
2025-09-30T14:59:20.677403Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3200 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:20.677445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3200 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:20.677458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3200 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:20.677472Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:20.678937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3200 sessionId:  describe result for acl check
2025-09-30T14:59:20.678981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:20.678988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:20.678990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:20.678999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896993889891764:4311] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:20.679673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896993889891764:4311] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:20.682926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896993889891764:4311] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:20.689461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896993889891764:4311] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:20.689481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896993889891764:4311] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:20.689486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896993889891764:4311] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:20.689494Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3200 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:20.702564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:20.707282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:20.707584Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:20.707589Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:20.707603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:20.707668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:20.707717Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896993800088983:12597]
2025-09-30T14:59:20.708482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:20.709150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:20.709227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:20.709839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:20.710046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.710056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.710057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.710059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.710060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.710062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.710063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.710065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.710066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.710068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.710070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.710072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.710073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.710074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.710076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.710084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.710096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.710101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.710106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.710121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.710126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.710131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.710136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.710141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.710146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.710150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.710155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.710159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.710164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.710168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.710180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.710190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.710198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.710205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.710210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.710218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.710224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.710231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.710237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.710244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.710249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.710256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.710261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.710268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.710273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.710280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.710286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.710292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.710310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.710317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.710325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.710332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.710338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.710352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.710358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.710365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.710377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.710384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.710389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.710396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.710454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:20.719168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:20.721436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:20.721458Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:20.721461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:20.721466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:20.721473Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3199 [2:7555896993800088983:12597]
2025-09-30T14:59:20.721490Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:20.721508Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:20.721512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:20.721514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:20.721516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:20.721532Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:20.721540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:20.721547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:20.721615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.721618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.721620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.721624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:20.721627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:20.721698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:20.721708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.721726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.721743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.721763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:20.721787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896993800088978:12597]
2025-09-30T14:59:20.721794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896993800088978:12597]
2025-09-30T14:59:20.721796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896993800088978:12597]
2025-09-30T14:59:20.721808Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:20.721820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:20.721822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:20.721824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:20.721828Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:20.721837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:20.721839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:20.721850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889891866:4311], now have 1 active actors on pipe
2025-09-30T14:59:20.721855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889891707:2454], now have 1 active actors on pipe
2025-09-30T14:59:20.721892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896993800088978:12597]
2025-09-30T14:59:20.721910Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:20.721918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:20.721951Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3199
2025-09-30T14:59:20.721962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3199
2025-09-30T14:59:20.722212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.722228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.722254Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:20.722270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:20.722274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:20.722277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:20.722291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:20.722309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:20.722335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:20.722553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.722563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.722580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:20.722697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3200 partition: 0 MaxSeqNo: 42 sessionId: src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0
2025-09-30T14:59:20.723103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a1b77ee-d57c2491-199d9630-b732f2a5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:20.725989Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0] Write session: try to update token
2025-09-30T14:59:20.726016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:20.734729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:20.734746Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:20.734748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:20.734750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:20.734760Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896993800088978:12597]
2025-09-30T14:59:20.734764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896993800088978:12597]
2025-09-30T14:59:20.734768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896993800088978:12597]
2025-09-30T14:59:20.734811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:20.734818Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.734817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:20.734821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:20.734825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:20.734845Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:20.734958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:20.745556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3200 sessionId: src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:20.748157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:20.763540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896993889892007:10551]
2025-09-30T14:59:20.765062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3199, pipe: [1:7555896993889892007:10551]
2025-09-30T14:59:20.849878Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:20.850213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.850234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.850255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889892007:10551], now have 1 active actors on pipe
2025-09-30T14:59:20.851055Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:20.851068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0] Write session will restart in 0.008444s
2025-09-30T14:59:20.851091Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0] Write session: Do CDS request
2025-09-30T14:59:20.851096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:20.850547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:20.850570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896993889892007:10551]
2025-09-30T14:59:20.850597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:20.850600Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:20.850681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3200 reason: error at write: Disconnected sessionId: src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0
2025-09-30T14:59:20.850855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3200 sessionId: src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0 is DEAD
2025-09-30T14:59:20.851758Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:20.861136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:20.861218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:20.861235Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3201
2025-09-30T14:59:20.861388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3201 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:20.861415Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3201 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:20.861420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3201 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:20.861425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:20.861842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3201 sessionId:  describe result for acl check
2025-09-30T14:59:20.861869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:20.861871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:20.861873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:20.861878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896993889892040:4317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:20.862373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896993889892040:4317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:20.869326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896993889892040:4317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:20.875084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896993889892040:4317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:20.875101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896993889892040:4317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:20.875105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896993889892040:4317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:20.875113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3201 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:20.883645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:20.886672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:20.886950Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:20.886964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:20.886990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:20.887066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:20.887109Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896993800089275:12599]
2025-09-30T14:59:20.887791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:20.888117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:20.888177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:20.888577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:20.888672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.888679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.888681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.888682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.888684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.888685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.888686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.888688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.888689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.888691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.888692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.888694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.888695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.888697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.888698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.888704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.888715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.888720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.888724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.888729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.888734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.888738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.888742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.888747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.888751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.888755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.888759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.888762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.888765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.888770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.888780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.888789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:20.888795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.888802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:20.888810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.888822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:20.888827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.888832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:20.888837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.888843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:20.888849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.888854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:20.888859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.888870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:20.888874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.888879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:20.888889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.888895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:20.888904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.888910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:20.888919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.888939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.888950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.888956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.888960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.888965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.888969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.888974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:20.888978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.888983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:20.889029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:20.895623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:20.897073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:20.897092Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:20.897095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:20.897099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:20.897106Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3200 [2:7555896993800089275:12599]
2025-09-30T14:59:20.897123Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:20.897138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:20.897141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:20.897145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:20.897147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:20.897163Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:20.897174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:20.897182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:20.897245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.897252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.897255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.897259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:20.897261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:20.897334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:20.897342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.897356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:20.897373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:20.897391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:20.897416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896993800089270:12599]
2025-09-30T14:59:20.897423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896993800089270:12599]
2025-09-30T14:59:20.897426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896993800089270:12599]
2025-09-30T14:59:20.897435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:20.897445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:20.897454Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:20.897462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:20.897465Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:20.897469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:20.897472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:20.897483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889892227:4317], now have 1 active actors on pipe
2025-09-30T14:59:20.897489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889892024:2454], now have 1 active actors on pipe
2025-09-30T14:59:20.897522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896993800089270:12599]
2025-09-30T14:59:20.897537Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:20.897614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:20.897581Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3200
2025-09-30T14:59:20.897616Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3200
2025-09-30T14:59:20.897742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.897754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.897787Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:20.897796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:20.897801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:20.897803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:20.897813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:20.897825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:20.897851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:20.898151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:20.898158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:20.898181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:20.898428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3201 partition: 0 MaxSeqNo: 42 sessionId: src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0
2025-09-30T14:59:20.898863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c419cdc0-c05dc784-7ae2b9db-6a53a249_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:20.901563Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0] Write session: try to update token
2025-09-30T14:59:20.901582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:20.911068Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:20.911089Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:20.911092Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:20.911094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:20.911103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896993800089270:12599]
2025-09-30T14:59:20.911108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896993800089270:12599]
2025-09-30T14:59:20.911111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896993800089270:12599]
2025-09-30T14:59:20.911154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:20.911164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:20.911167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:20.911333Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:20.915340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:20.915361Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:20.915366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:20.918724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3201 sessionId: src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:20.921559Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:20.952474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896993889892325:10551]
2025-09-30T14:59:20.952985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3200, pipe: [1:7555896993889892325:10551]
2025-09-30T14:59:21.028586Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:21.028904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.028920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.028958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896993889892325:10551], now have 1 active actors on pipe
2025-09-30T14:59:21.029329Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:21.029249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:21.029265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:21.029336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3201 reason: error at write: Disconnected sessionId: src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0
2025-09-30T14:59:21.029360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896993889892325:10551]
2025-09-30T14:59:21.029381Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:21.029426Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:59:21.029508Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 32 consumer shared/user session shared/user_1_32_8809750126570015226_v1 is DEAD
2025-09-30T14:59:21.029514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3201 sessionId: src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0 is DEAD
2025-09-30T14:59:21.029637Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896916580454858:10555] disconnected; active server actors: 1
2025-09-30T14:59:21.029641Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896916580454858:10555] client user disconnected session shared/user_1_32_8809750126570015226_v1
2025-09-30T14:59:21.029977Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:59:21.030102Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:59:21.030108Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:59:21.030115Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.008130s
2025-09-30T14:59:21.031328Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:21.031343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0] Write session will restart in 0.005335s
2025-09-30T14:59:21.031368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0] Write session: Do CDS request
2025-09-30T14:59:21.031375Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:21.037762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:21.039629Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:59:21.039557Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:21.039571Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3202
2025-09-30T14:59:21.039701Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3202 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:21.039729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3202 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:21.039734Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3202 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:21.039739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:21.039908Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:59:21.039916Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 33
2025-09-30T14:59:21.040064Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 33 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:59:21.040105Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:59:21.040195Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 auth for : user
2025-09-30T14:59:21.040643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3202 sessionId:  describe result for acl check
2025-09-30T14:59:21.040681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:21.040683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:21.040685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:21.040690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896998184859653:4294] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:21.040913Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 Handle describe topics response
2025-09-30T14:59:21.040935Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 auth is DEAD
2025-09-30T14:59:21.040950Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:59:21.041202Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:59:21.041296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896998184859653:4294] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:21.041375Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896998184859660:4283] connected; active server actors: 1
2025-09-30T14:59:21.041484Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_33_15939603490645126362_v1
2025-09-30T14:59:21.041469Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555896998184859660:4283] session shared/user_1_33_15939603490645126362_v1
2025-09-30T14:59:21.041483Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:59:21.041493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:59:21.041500Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_33_15939603490645126362_v1" (Sender=[1:7555896998184859647:4283], Pipe=[1:7555896998184859660:4283], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:59:21.041503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:59:21.041517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:59:21.041526Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_33_15939603490645126362_v1" (Sender=[1:7555896998184859647:4283], Pipe=[1:7555896998184859660:4283], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:59:21.041536Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_33_15939603490645126362_v1" sender [1:7555896998184859647:4283] lock partition 0 for ReadingSession "shared/user_1_33_15939603490645126362_v1" (Sender=[1:7555896998184859647:4283], Pipe=[1:7555896998184859660:4283], Partitions=[], ActiveFamilyCount=1) generation 1 step 33
2025-09-30T14:59:21.041544Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:59:21.041547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000028s
2025-09-30T14:59:21.041855Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 33 Session: "shared/user_1_33_15939603490645126362_v1" ClientId: "user" PipeClient { RawX1: 7555896998184859660 RawX2: 4503603922342075 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:59:21.042010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:59:21.045510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896998184859653:4294] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:21.049270Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896998184859653:4294] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:21.049289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896998184859653:4294] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:21.049293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896998184859653:4294] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:21.049302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3202 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:21.060096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:21.064702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:21.064925Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:21.064935Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:21.064946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:21.064993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:21.065033Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896998095056866:12601]
2025-09-30T14:59:21.065798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:21.066172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:21.066238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:21.066608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:21.066691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.066700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.066701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.066703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.066705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.066706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.066707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.066709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.066710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.066711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.066712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.066713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.066714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.066715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.066716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.066722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.066733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.066738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.066743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.066747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.066751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.066756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.066760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.066764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.066769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.066773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.066777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.066782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.066785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.066790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.066799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.066808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.066815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.066821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.066827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.066833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.066838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.066843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.066850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.066855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.066860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.066866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.066871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.066877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.066890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.066896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.066901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.066906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.066912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.066921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.066926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.066935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.066939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.066944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.066952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.066957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.066967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.066972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.066980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.066985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.067037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:21.074241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:21.075104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:21.075120Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:21.075124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:21.075127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:21.075134Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3201 [2:7555896998095056866:12601]
2025-09-30T14:59:21.075151Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:21.075171Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:21.075174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:21.075177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:21.075180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:21.075195Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:21.075201Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:21.075209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:21.075289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.075298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.075300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.075304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:21.075306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:21.075583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:21.075592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.075605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.075619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.075642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:21.075662Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896998095056861:12601]
2025-09-30T14:59:21.075670Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896998095056861:12601]
2025-09-30T14:59:21.075672Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896998095056861:12601]
2025-09-30T14:59:21.075688Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:21.075705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:21.075724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:21.075731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:21.075753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:21.075764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896998095056861:12601]
2025-09-30T14:59:21.075766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:21.075767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:21.075770Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:21.075777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:21.076018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3201, pipe: [1:7555896998184859674:4275]
2025-09-30T14:59:21.076052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3201
2025-09-30T14:59:21.076071Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3201
2025-09-30T14:59:21.075918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184859674:4275], now have 1 active actors on pipe
2025-09-30T14:59:21.075931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184859822:4294], now have 1 active actors on pipe
2025-09-30T14:59:21.075937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184859626:2454], now have 1 active actors on pipe
2025-09-30T14:59:21.076117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.076125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.076136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_33_15939603490645126362_v1 on pipe: [1:7555896998184859674:4275]
2025-09-30T14:59:21.076160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.076167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.076166Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_33_15939603490645126362_v1:1 with generation 3201
2025-09-30T14:59:21.076184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:21.076194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:21.076197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:21.076217Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_33_15939603490645126362_v1
2025-09-30T14:59:21.076225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:21.076261Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:21.076272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:59:21.076278Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:59:21.082283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe1b5db-f1790f2c-d1576b53-74c87eae_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:21.081497Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244361074 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:59:21.081521Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:59:21.081557Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 sending to client partition status
2025-09-30T14:59:21.081780Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3202 partition: 0 MaxSeqNo: 42 sessionId: src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0
2025-09-30T14:59:21.081248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:59:21.081285Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:59:21.081293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:21.081298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:21.081300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:21.081309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:21.081321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:21.081327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:59:21.081338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:59:21.081351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:21.081644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.081652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.081677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:21.085154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0] Write session: try to update token
2025-09-30T14:59:21.085174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:21.088172Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:21.088192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:21.088199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896998095056861:12601]
2025-09-30T14:59:21.088239Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:21.088240Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:21.088410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:21.088571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:21.088720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:21.088868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:21.089066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:21.089105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:21.099484Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:21.099503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:21.099505Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:21.099507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:21.099517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896998095056861:12601]
2025-09-30T14:59:21.099521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896998095056861:12601]
2025-09-30T14:59:21.099525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896998095056861:12601]
2025-09-30T14:59:21.099566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:21.099570Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:21.099573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.099576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:21.099585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:21.099589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:21.099714Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:21.099938Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3202 sessionId: src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:21.103006Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:21.228115Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:21.229046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.229058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.229397Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896998184859674:4275]
2025-09-30T14:59:21.229412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:21.229419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:21.229426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:21.229481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3202 reason: error at write: Disconnected sessionId: src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0
2025-09-30T14:59:21.229670Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3202 sessionId: src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0 is DEAD
2025-09-30T14:59:21.230270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:21.230282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0] Write session will restart in 0.005518s
2025-09-30T14:59:21.230306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0] Write session: Do CDS request
2025-09-30T14:59:21.230311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:21.229848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_33_15939603490645126362_v1
2025-09-30T14:59:21.229871Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:21.229892Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_33_15939603490645126362_v1
2025-09-30T14:59:21.236805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:21.239702Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:21.239717Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3203
2025-09-30T14:59:21.239908Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3203 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:21.239936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3203 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:21.239941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3203 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:21.239948Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:21.240398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3203 sessionId:  describe result for acl check
2025-09-30T14:59:21.240428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:21.240431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:21.240432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:21.240439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896998184859954:4271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:21.240994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896998184859954:4271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:21.245042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896998184859954:4271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:21.249792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896998184859954:4271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:21.249813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896998184859954:4271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:21.249817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896998184859954:4271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:21.249827Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3203 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:21.274972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:21.278154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:21.278385Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:21.278398Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:21.278409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:21.278466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:21.278510Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896998095057166:12604]
2025-09-30T14:59:21.279217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:21.279614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:21.279667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:21.280024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:21.280091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.280100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.280102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.280103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.280104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.280106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.280108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.280109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.280110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.280112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.280114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.280115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.280116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.280118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.280119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.280125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.280137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.280142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.280147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.280151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.280157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.280161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.280165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.280169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.280174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.280179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.280183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.280187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.280191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.280195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.280204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.280213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.280219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.280225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.280231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.280237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.280242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.280248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.280253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.280259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.280264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.280270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.280276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.280282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.280287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.280293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.280299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.280307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.280312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.280318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.280324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.280329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.280335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.280341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.280346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.280352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.280369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.280374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.280382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.280389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.280444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:21.286198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:21.287856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:21.287875Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:21.287878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:21.287882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:21.287889Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3202 [2:7555896998095057166:12604]
2025-09-30T14:59:21.287910Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:21.287927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:21.287932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:21.287934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:21.287937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:21.287953Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:21.287970Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:21.287978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:21.288045Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.288053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.288055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.288059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:21.288061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:21.288134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:21.288142Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.288157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.288175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.288193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:21.288217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896998095057161:12604]
2025-09-30T14:59:21.288220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896998095057161:12604]
2025-09-30T14:59:21.288222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896998095057161:12604]
2025-09-30T14:59:21.288230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:21.288244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:21.288246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:21.288249Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:21.288254Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:21.288257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:21.288260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:21.288271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184860024:4271], now have 1 active actors on pipe
2025-09-30T14:59:21.288275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184859939:2454], now have 1 active actors on pipe
2025-09-30T14:59:21.288309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896998095057161:12604]
2025-09-30T14:59:21.288317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:21.288325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:21.291641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.291661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.291694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:21.291717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:21.291727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:21.291731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:21.291744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:21.291760Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:21.291791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:21.292043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.292057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.292082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:21.292923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f41a4a7e-5e30190d-468d75ef-ba8c0e95_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:21.291432Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3202
2025-09-30T14:59:21.291474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3202
2025-09-30T14:59:21.292310Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3203 partition: 0 MaxSeqNo: 42 sessionId: src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0
2025-09-30T14:59:21.295976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0] Write session: try to update token
2025-09-30T14:59:21.295994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:21.304358Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:21.304380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:21.304383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:21.304385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:21.304397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896998095057161:12604]
2025-09-30T14:59:21.304402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896998095057161:12604]
2025-09-30T14:59:21.304407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896998095057161:12604]
2025-09-30T14:59:21.304450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:21.304457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.304455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:21.304460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:21.304463Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:21.304467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:21.304622Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:21.317829Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3203 sessionId: src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:21.321200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:21.329352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896998184860245:4275]
2025-09-30T14:59:21.329852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3202, pipe: [1:7555896998184860245:4275]
2025-09-30T14:59:21.431676Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:21.431988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.432004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.432024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184860245:4275], now have 1 active actors on pipe
2025-09-30T14:59:21.432381Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:21.433130Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:21.433152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0] Write session will restart in 0.006424s
2025-09-30T14:59:21.433176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0] Write session: Do CDS request
2025-09-30T14:59:21.433183Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:21.432738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896998184860245:4275]
2025-09-30T14:59:21.432768Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:21.432840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3203 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0
2025-09-30T14:59:21.433011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3203 sessionId: src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0 is DEAD
2025-09-30T14:59:21.433148Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:21.441004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:21.441102Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:21.441117Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3204
2025-09-30T14:59:21.441334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3204 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:21.441365Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3204 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:21.441370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3204 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:21.441374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:21.441962Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3204 sessionId:  describe result for acl check
2025-09-30T14:59:21.441996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:21.442001Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:21.442003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:21.442008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896998184860261:4256] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:21.442565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896998184860261:4256] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:21.445476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896998184860261:4256] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:21.455026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896998184860261:4256] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:21.455064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896998184860261:4256] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:21.455069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896998184860261:4256] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:21.455079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3204 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:21.491834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:21.495543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:21.495776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:21.495790Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:21.495802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:21.495865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:21.495902Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896998095057474:12606]
2025-09-30T14:59:21.496625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:21.497520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:21.497571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:21.497909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:21.497975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.497977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.497978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.497979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.497981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.497982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.497983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.497984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.497985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.497986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.497987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.497989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.497990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.497991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.497993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.497999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.498010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.498014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.498019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.498026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.498030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.498034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.498039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.498043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.498048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.498052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.498056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.498061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.498065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.498070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.498077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.498085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.498092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.498098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.498102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.498108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.498112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.498118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.498123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.498128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.498133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.498138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.498143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.498148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.498153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.498158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.498164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.498169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.498174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.498179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.498186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.498192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.498196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.498200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.498205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.498210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.498215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.498221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.498226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.498232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.498282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:21.512367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:21.513255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:21.513262Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:21.513265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:21.513269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:21.513277Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3203 [2:7555896998095057474:12606]
2025-09-30T14:59:21.513294Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:21.513309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:21.513312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:21.513316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:21.513318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:21.513334Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:21.513343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:21.513350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:21.513411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.513413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.513415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.513418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:21.513420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:21.513494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:21.513497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.513511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.513524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.513543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:21.513559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896998095057468:12606]
2025-09-30T14:59:21.513562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896998095057468:12606]
2025-09-30T14:59:21.513564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896998095057468:12606]
2025-09-30T14:59:21.513573Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:21.513585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:21.513587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:21.513589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:21.513592Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:21.513602Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:21.513605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:21.513615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184860298:4256], now have 1 active actors on pipe
2025-09-30T14:59:21.513619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184860254:2454], now have 1 active actors on pipe
2025-09-30T14:59:21.513677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3203
2025-09-30T14:59:21.513720Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3203
2025-09-30T14:59:21.513655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896998095057468:12606]
2025-09-30T14:59:21.513665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:21.513670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:21.513939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.513947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.513981Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:21.514010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:21.514019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:21.514021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:21.514032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:21.514048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:21.514070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:21.514691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.514704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.514727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:21.514944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3204 partition: 0 MaxSeqNo: 42 sessionId: src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0
2025-09-30T14:59:21.515447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbad85-5702f9bf-a8d441b9-a3c1a8e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:21.518203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0] Write session: try to update token
2025-09-30T14:59:21.518221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:21.535417Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896998184860575:4275]
2025-09-30T14:59:21.536097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3203, pipe: [1:7555896998184860575:4275]
2025-09-30T14:59:21.536595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184860575:4275], now have 1 active actors on pipe
2025-09-30T14:59:21.536623Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:21.536627Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:21.536629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:21.536631Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:21.536639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896998095057468:12606]
2025-09-30T14:59:21.536643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896998095057468:12606]
2025-09-30T14:59:21.536647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896998095057468:12606]
2025-09-30T14:59:21.536688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:21.536687Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:21.536693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:21.536694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.536697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:21.536711Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:21.536848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:21.545858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3204 sessionId: src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:21.548857Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:21.654425Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:21.655458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.655474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.655712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:21.655762Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:21.655777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:21.655777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:21.655832Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896998184860575:4275]
2025-09-30T14:59:21.655838Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3204 reason: error at write: Disconnected sessionId: src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0
2025-09-30T14:59:21.656013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3204 sessionId: src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0 is DEAD
2025-09-30T14:59:21.656163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:21.656173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0] Write session will restart in 0.008541s
2025-09-30T14:59:21.656196Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0] Write session: Do CDS request
2025-09-30T14:59:21.656217Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:21.665831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:21.665878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:21.665894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3205
2025-09-30T14:59:21.667526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3205 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:21.667573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3205 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:21.667594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3205 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:21.667598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:21.668200Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3205 sessionId:  describe result for acl check
2025-09-30T14:59:21.668240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:21.668247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:21.668250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:21.668257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896998184860641:4218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:21.668938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896998184860641:4218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:21.673149Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896998184860641:4218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:21.677197Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896998184860641:4218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:21.677213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896998184860641:4218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:21.677217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896998184860641:4218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:21.677227Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3205 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:21.686833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:21.690425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:21.690710Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:21.690715Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:21.690728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:21.690800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:21.691093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896998095057809:12622]
2025-09-30T14:59:21.692196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:21.692656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:21.692712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:21.693226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:21.693354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.693355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.693356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.693358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.693359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.693361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.693362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.693363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.693365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.693367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.693368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.693370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.693371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.693372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.693373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.693380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.693392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.693396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.693400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.693404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.693409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.693413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.693417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.693421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.693425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.693429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.693433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.693437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.693441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.693445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.693455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.693464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.693470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.693476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.693482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.693490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.693495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.693501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.693506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.693512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.693517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.693525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.693530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.693537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.693542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.693547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.693552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.693556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.693560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.693566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.693572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.693577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.693581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.693585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.693591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.693597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.693602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.693611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.693617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.693622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.693671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:21.699956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:21.701427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:21.701445Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:21.701447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:21.701452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:21.701459Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3204 [2:7555896998095057809:12622]
2025-09-30T14:59:21.701479Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:21.701499Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:21.701502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:21.701508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:21.701510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:21.701526Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:21.701536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:21.701543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:21.701611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.701620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.701622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.701628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:21.701632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:21.701698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:21.701706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.701722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.701741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.701764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:21.701787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896998095057804:12622]
2025-09-30T14:59:21.701794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896998095057804:12622]
2025-09-30T14:59:21.701796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896998095057804:12622]
2025-09-30T14:59:21.701815Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:21.701833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184860582:2454], now have 1 active actors on pipe
2025-09-30T14:59:21.701832Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:21.701836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:21.701838Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:21.701841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184860793:4218], now have 1 active actors on pipe
2025-09-30T14:59:21.701848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:21.701861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:21.701864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:21.701899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896998095057804:12622]
2025-09-30T14:59:21.701912Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:21.701939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:21.701983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.701995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.701939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3204
2025-09-30T14:59:21.701947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3204
2025-09-30T14:59:21.702025Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7f998610-b4af55a-1da0adc4-81b05c50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:21.702037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:21.702047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:21.702052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:21.702062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:21.702077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:21.702096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:21.702264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.702272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.702287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:21.702401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3205 partition: 0 MaxSeqNo: 42 sessionId: src_id|7f998610-b4af55a-1da0adc4-81b05c50_0
2025-09-30T14:59:21.702851Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3decc1c8-6ebc874-28654be8-af7a21a1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7f998610-b4af55a-1da0adc4-81b05c50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:21.711880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f998610-b4af55a-1da0adc4-81b05c50_0] Write session: try to update token
2025-09-30T14:59:21.711917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f998610-b4af55a-1da0adc4-81b05c50_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:21.721305Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:21.721329Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:21.721343Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555896998095057804:12622]
2025-09-30T14:59:21.721394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:21.721409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:21.721597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:21.721773Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:21.721914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:21.722315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:21.722739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:21.722781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:21.726587Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:21.726609Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:21.726612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:21.726619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:21.726629Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896998095057804:12622]
2025-09-30T14:59:21.726636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896998095057804:12622]
2025-09-30T14:59:21.726643Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896998095057804:12622]
2025-09-30T14:59:21.726687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:21.726695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.726698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:21.726824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:21.726847Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:21.726852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:21.726863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:21.733009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3205 sessionId: src_id|7f998610-b4af55a-1da0adc4-81b05c50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:21.735844Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:21.755838Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896998184860886:4275]
2025-09-30T14:59:21.756401Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3204, pipe: [1:7555896998184860886:4275]
2025-09-30T14:59:21.847354Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:21.847668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.847678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.847701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184860886:4275], now have 1 active actors on pipe
2025-09-30T14:59:21.848097Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:21.848112Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:21.848189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3205 reason: error at write: Disconnected sessionId: src_id|7f998610-b4af55a-1da0adc4-81b05c50_0
2025-09-30T14:59:21.848205Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:21.848372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3205 sessionId: src_id|7f998610-b4af55a-1da0adc4-81b05c50_0 is DEAD
2025-09-30T14:59:21.848391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896998184860886:4275]
2025-09-30T14:59:21.848429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:21.848525Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f998610-b4af55a-1da0adc4-81b05c50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:21.848536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f998610-b4af55a-1da0adc4-81b05c50_0] Write session will restart in 0.009852s
2025-09-30T14:59:21.848577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f998610-b4af55a-1da0adc4-81b05c50_0] Write session: Do CDS request
2025-09-30T14:59:21.848585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f998610-b4af55a-1da0adc4-81b05c50_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:21.859654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7f998610-b4af55a-1da0adc4-81b05c50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:21.860673Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:21.860689Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3206
2025-09-30T14:59:21.860923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3206 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:21.860985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3206 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:21.860996Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3206 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:21.861001Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:21.861530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3206 sessionId:  describe result for acl check
2025-09-30T14:59:21.861561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:21.861565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:21.861567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:21.861572Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555896998184860929:4208] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:21.862105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555896998184860929:4208] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:21.868422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555896998184860929:4208] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:21.872642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555896998184860929:4208] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:21.872662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555896998184860929:4208] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:21.872666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555896998184860929:4208] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:21.872676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3206 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:21.875671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:21.879032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:21.879545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:21.879558Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:21.879574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:21.879652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:21.879696Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555896998095058106:12624]
2025-09-30T14:59:21.880317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:21.880709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:21.880781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:21.881158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:21.881236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.881240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.881241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.881242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.881244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.881245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.881246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.881248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.881249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.881250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.881251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.881253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.881254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.881255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.881256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.881263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.881273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.881278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.881282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.881285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.881289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.881308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.881312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.881316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.881321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.881326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.881330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.881334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.881338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.881342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.881352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.881360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:21.881366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.881383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:21.881387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.881392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:21.881397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.881401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:21.881405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.881410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:21.881414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.881419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:21.881424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.881429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:21.881435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.881440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:21.881445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.881450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:21.881454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.881459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:21.881464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.881469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.881473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.881479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.881484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.881490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.881495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.881501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:21.881507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.881513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:21.881560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:21.892819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:21.893732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:21.893749Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:21.893753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:21.893757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:21.893764Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3205 [2:7555896998095058106:12624]
2025-09-30T14:59:21.893782Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:21.893801Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:21.893811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:21.893815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:21.893817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:21.893834Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:21.893841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:21.893849Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:21.893917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.893925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.893927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.893931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:21.893933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:21.894341Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3205
2025-09-30T14:59:21.894399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3205
2025-09-30T14:59:21.894494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:21.894506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.894522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:21.894538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:21.894563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:21.894588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184860904:2454], now have 1 active actors on pipe
2025-09-30T14:59:21.894593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184861164:4208], now have 1 active actors on pipe
2025-09-30T14:59:21.894614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.894623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.894639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555896998095058101:12624]
2025-09-30T14:59:21.894646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555896998095058101:12624]
2025-09-30T14:59:21.894648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555896998095058101:12624]
2025-09-30T14:59:21.894662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:21.894681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:21.894682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:21.894686Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:21.894688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:21.894701Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:21.894705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:21.894722Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:21.894734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:21.894738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:21.894741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:21.894752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:21.894761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:21.894800Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555896998095058101:12624]
2025-09-30T14:59:21.894812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:21.894822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:21.894825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:21.895326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:21.895338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:21.895365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:21.895485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3206 partition: 0 MaxSeqNo: 42 sessionId: src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0
2025-09-30T14:59:21.899516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7f998610-b4af55a-1da0adc4-81b05c50_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:21.902510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0] Write session: try to update token
2025-09-30T14:59:21.902529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:21.912605Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:21.912623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:21.912625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:21.912628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:21.912637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555896998095058101:12624]
2025-09-30T14:59:21.912642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555896998095058101:12624]
2025-09-30T14:59:21.912646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555896998095058101:12624]
2025-09-30T14:59:21.912685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:21.912692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:21.912692Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:21.912694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:21.912699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:21.912704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:21.912835Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:21.923282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3206 sessionId: src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:21.926043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:21.948379Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555896998184861209:4275]
2025-09-30T14:59:21.948642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3205, pipe: [1:7555896998184861209:4275]
2025-09-30T14:59:22.029245Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:22.029599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.029618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.029637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555896998184861209:4275], now have 1 active actors on pipe
2025-09-30T14:59:22.029874Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:22.031410Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:22.031471Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555896998184861209:4275]
2025-09-30T14:59:22.031500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:22.031571Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3206 reason: status is not ok: tablet will be restarted right now sessionId: src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0
2025-09-30T14:59:22.031749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3206 sessionId: src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0 is DEAD
2025-09-30T14:59:22.039348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:22.039365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0] Write session will restart in 0.007533s
2025-09-30T14:59:22.039392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0] Write session: Do CDS request
2025-09-30T14:59:22.039398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:22.051683Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:22.055457Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:22.055479Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3207
2025-09-30T14:59:22.055681Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3207 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:22.055719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3207 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:22.055725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3207 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:22.055729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:22.056182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3207 sessionId:  describe result for acl check
2025-09-30T14:59:22.056225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:22.056228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:22.056230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:22.056236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897002479828670:4204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:22.056797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897002479828670:4204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:22.061637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897002479828670:4204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:22.068060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897002479828670:4204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:22.068077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897002479828670:4204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:22.068081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897002479828670:4204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:22.068090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3207 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:22.076930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:22.084195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:22.084647Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:22.084652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:22.084666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:22.084750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:22.084790Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897002390025700:12626]
2025-09-30T14:59:22.085458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:22.086797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:22.086879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:22.087299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:22.087393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.087401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.087402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.087403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.087405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.087406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.087407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.087409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.087410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.087411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.087412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.087413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.087414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.087415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.087416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.087442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.087452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.087456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.087460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.087463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.087467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.087471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.087474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.087478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.087482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.087486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.087490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.087494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.087497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.087501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.087510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.087518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.087524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.087530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.087535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.087541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.087545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.087550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.087557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.087562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.087566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.087571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.087576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.087589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.087594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.087599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.087604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.087609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.087614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.087618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.087625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.087629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.087633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.087638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.087643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.087647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.087651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.087656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.087661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.087665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.087704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:22.094944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:22.096493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:22.096514Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:22.096517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:22.096521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:22.096529Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3206 [2:7555897002390025700:12626]
2025-09-30T14:59:22.096559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:22.096579Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:22.096582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:22.096586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:22.096588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:22.096604Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:22.096612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:22.096620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:22.096692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.096702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.096704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.096708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:22.096710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:22.096785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:22.096793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.096808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.096820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.096843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:22.096867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897002390025694:12626]
2025-09-30T14:59:22.096874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897002390025694:12626]
2025-09-30T14:59:22.096877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897002390025694:12626]
2025-09-30T14:59:22.096887Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:22.096903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:22.096906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:22.096910Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:22.096912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:22.096924Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:22.096927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:22.096938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479828786:4204], now have 1 active actors on pipe
2025-09-30T14:59:22.096948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479828510:2454], now have 1 active actors on pipe
2025-09-30T14:59:22.096986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897002390025694:12626]
2025-09-30T14:59:22.097003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:22.097027Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:22.097223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3206
2025-09-30T14:59:22.097266Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3206
2025-09-30T14:59:22.097972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.097985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.098016Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:22.098025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:22.098029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:22.098031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:22.098043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:22.098056Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:22.098072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:22.098463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.098472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.098488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:22.098635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3207 partition: 0 MaxSeqNo: 42 sessionId: src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0
2025-09-30T14:59:22.103354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|967b673a-3a789cec-a2ba0bac-27e0ef7e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:22.106155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0] Write session: try to update token
2025-09-30T14:59:22.106178Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:22.110583Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:22.110606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:22.110610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:22.110612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:22.110622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897002390025694:12626]
2025-09-30T14:59:22.110627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897002390025694:12626]
2025-09-30T14:59:22.110632Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897002390025694:12626]
2025-09-30T14:59:22.110677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:22.110684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.110685Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:22.110687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:22.110693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:22.110698Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:22.110830Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:22.135323Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897002479828813:4275]
2025-09-30T14:59:22.135828Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3206, pipe: [1:7555897002479828813:4275]
2025-09-30T14:59:22.147820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3207 sessionId: src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:22.150723Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:22.238453Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:22.238808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479828813:4275], now have 1 active actors on pipe
2025-09-30T14:59:22.238834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.238841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.239510Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:22.239318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:22.239334Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:22.239346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897002479828813:4275]
2025-09-30T14:59:22.239369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:22.239402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3207 reason: error at write: Disconnected sessionId: src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0
2025-09-30T14:59:22.239583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3207 sessionId: src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0 is DEAD
2025-09-30T14:59:22.240366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:22.240378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0] Write session will restart in 0.007206s
2025-09-30T14:59:22.240407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0] Write session: Do CDS request
2025-09-30T14:59:22.240430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:22.255713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:22.260325Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:22.260342Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3208
2025-09-30T14:59:22.260570Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3208 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:22.260617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3208 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:22.260627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3208 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:22.260632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:22.261425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3208 sessionId:  describe result for acl check
2025-09-30T14:59:22.261462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:22.261470Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:22.261472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:22.261479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897002479828859:4199] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:22.262044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897002479828859:4199] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:22.264950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897002479828859:4199] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:22.268898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897002479828859:4199] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:22.268918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897002479828859:4199] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:22.268922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897002479828859:4199] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:22.268930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3208 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:22.281234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:22.285111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:22.285348Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:22.285360Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:22.285372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:22.285429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:22.285477Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897002390026003:12629]
2025-09-30T14:59:22.286142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:22.289632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:22.289729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:22.290141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:22.290220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.290237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.290243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.290244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.290246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.290247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.290249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.290251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.290253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.290254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.290256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.290257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.290259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.290260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.290262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.290270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.290282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.290287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.290292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.290297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.290302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.290307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.290312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.290317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.290325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.290329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.290334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.290340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.290345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.290349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.290358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.290367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.290374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.290381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.290387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.290392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.290396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.290402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.290409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.290414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.290418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.290423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.290432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.290438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.290443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.290449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.290454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.290461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.290466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.290472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.290477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.290482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.290493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.290497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.290501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.290506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.290509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.290514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.290518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.290523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.290564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:22.298933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:22.300380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:22.300410Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:22.300414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:22.300418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:22.300427Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3207 [2:7555897002390026003:12629]
2025-09-30T14:59:22.300448Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:22.300473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:22.300488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:22.300492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:22.300494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:22.300517Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:22.300526Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:22.300536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:22.300643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.300664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.300667Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.300671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:22.300674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:22.300783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:22.300800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.300819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.300842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.300859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:22.300879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897002390025997:12629]
2025-09-30T14:59:22.300882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897002390025997:12629]
2025-09-30T14:59:22.300884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897002390025997:12629]
2025-09-30T14:59:22.300899Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:22.300915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:22.300929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:22.300935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:22.300977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897002390025997:12629]
2025-09-30T14:59:22.300980Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:22.301127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:22.301131Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:22.301134Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:22.301143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:22.302031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479828973:4199], now have 1 active actors on pipe
2025-09-30T14:59:22.302046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479828816:2454], now have 1 active actors on pipe
2025-09-30T14:59:22.302062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.302067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.302099Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:22.302113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:22.302119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:22.302121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:22.302135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:22.302149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:22.302169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:22.301492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3207
2025-09-30T14:59:22.301528Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3207
2025-09-30T14:59:22.305076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.305096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.305136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:22.306114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e05388e-6451fe6d-a1128a68-6e627f1f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:22.305509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3208 partition: 0 MaxSeqNo: 42 sessionId: src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0
2025-09-30T14:59:22.308962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0] Write session: try to update token
2025-09-30T14:59:22.308982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:22.315970Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:22.315989Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:22.315991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:22.315993Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:22.316003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897002390025997:12629]
2025-09-30T14:59:22.316009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897002390025997:12629]
2025-09-30T14:59:22.316013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897002390025997:12629]
2025-09-30T14:59:22.316061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:22.316069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.316071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:22.316187Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:22.316200Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:22.316205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:22.316212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:22.336925Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3208 sessionId: src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:22.339632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897002479829128:4275]
2025-09-30T14:59:22.339877Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:22.340531Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3207, pipe: [1:7555897002479829128:4275]
2025-09-30T14:59:22.447317Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:22.447683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479829128:4275], now have 1 active actors on pipe
2025-09-30T14:59:22.447709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.447714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.448746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:22.448759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0] Write session will restart in 0.009145s
2025-09-30T14:59:22.448794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0] Write session: Do CDS request
2025-09-30T14:59:22.448801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:22.448329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:22.448343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:22.448401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3208 reason: error at write: Disconnected sessionId: src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0
2025-09-30T14:59:22.448590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3208 sessionId: src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0 is DEAD
2025-09-30T14:59:22.448734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:22.448769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897002479829128:4275]
2025-09-30T14:59:22.448029Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:22.460187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:22.460348Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:22.460366Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3209
2025-09-30T14:59:22.460536Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3209 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:22.460590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3209 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:22.460595Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3209 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:22.460600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:22.461826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3209 sessionId:  describe result for acl check
2025-09-30T14:59:22.461871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:22.461873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:22.461876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:22.461883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897002479829168:4178] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:22.462576Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897002479829168:4178] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:22.478462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897002479829168:4178] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:22.491610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897002479829168:4178] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:22.491630Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897002479829168:4178] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:22.491633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897002479829168:4178] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:22.491642Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3209 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:22.500664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:22.507088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:22.507390Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:22.507395Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:22.507407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:22.507476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:22.507529Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897002390026314:12631]
2025-09-30T14:59:22.508190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:22.508792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:22.508862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:22.509227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:22.509316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.509325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.509326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.509328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.509329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.509331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.509332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.509334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.509335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.509337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.509338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.509340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.509341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.509342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.509344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.509351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.509362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.509366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.509370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.509375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.509379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.509383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.509387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.509391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.509396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.509401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.509405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.509410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.509414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.509419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.509428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.509437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.509444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.509451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.509456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.509461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.509466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.509472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.509477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.509483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.509497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.509503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.509508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.509514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.509519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.509524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.509529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.509535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.509540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.509545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.509551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.509555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.509559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.509564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.509573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.509579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.509584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.509589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.509594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.509600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.509646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:22.517845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:22.519000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:22.519016Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:22.519019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:22.519023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:22.519031Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3208 [2:7555897002390026314:12631]
2025-09-30T14:59:22.519047Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:22.519069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:22.519077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:22.519080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:22.519083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:22.519099Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:22.519107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:22.519123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:22.519197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.519205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.519207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.519211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:22.519214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:22.519298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:22.519306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.519318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.519330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.519347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:22.519371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897002390026298:12631]
2025-09-30T14:59:22.519378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897002390026298:12631]
2025-09-30T14:59:22.519381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897002390026298:12631]
2025-09-30T14:59:22.519391Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:22.519401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:22.519405Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:22.519405Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:22.519408Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:22.519418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:22.519421Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:22.519432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479829134:2454], now have 1 active actors on pipe
2025-09-30T14:59:22.519436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479829415:4178], now have 1 active actors on pipe
2025-09-30T14:59:22.519470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897002390026298:12631]
2025-09-30T14:59:22.519484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:22.519520Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:22.520814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.520831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.520872Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|963fd289-4ce09a25-d5436232-47937034_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:22.520886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:22.520891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:22.520896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:22.520908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:22.520922Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:22.520941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:22.520194Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3208
2025-09-30T14:59:22.520252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3208
2025-09-30T14:59:22.523719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.523737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.523767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:22.524457Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad9ed7f3-86b644b3-639c645-c7901c55_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|963fd289-4ce09a25-d5436232-47937034_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:22.524046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3209 partition: 0 MaxSeqNo: 42 sessionId: src_id|963fd289-4ce09a25-d5436232-47937034_0
2025-09-30T14:59:22.527579Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963fd289-4ce09a25-d5436232-47937034_0] Write session: try to update token
2025-09-30T14:59:22.527599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963fd289-4ce09a25-d5436232-47937034_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:22.534236Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:22.534258Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:22.534261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:22.534264Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:22.534275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897002390026298:12631]
2025-09-30T14:59:22.534279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897002390026298:12631]
2025-09-30T14:59:22.534284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897002390026298:12631]
2025-09-30T14:59:22.534323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:22.534330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.534333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:22.534471Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:22.539496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:22.539525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:22.539529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:22.551295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3209 sessionId: src_id|963fd289-4ce09a25-d5436232-47937034_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:22.554327Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:22.554419Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897002479829456:4275]
2025-09-30T14:59:22.554591Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3208, pipe: [1:7555897002479829456:4275]
2025-09-30T14:59:22.666903Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:22.667357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479829456:4275], now have 1 active actors on pipe
2025-09-30T14:59:22.667385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.667391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.671577Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:22.671979Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:22.672036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:22.672123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3209 reason: status is not ok: tablet will be restarted right now sessionId: src_id|963fd289-4ce09a25-d5436232-47937034_0
2025-09-30T14:59:22.672297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3209 sessionId: src_id|963fd289-4ce09a25-d5436232-47937034_0 is DEAD
2025-09-30T14:59:22.672460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897002479829456:4275]
2025-09-30T14:59:22.676166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963fd289-4ce09a25-d5436232-47937034_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:22.676181Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963fd289-4ce09a25-d5436232-47937034_0] Write session will restart in 0.005463s
2025-09-30T14:59:22.676201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963fd289-4ce09a25-d5436232-47937034_0] Write session: Do CDS request
2025-09-30T14:59:22.676205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963fd289-4ce09a25-d5436232-47937034_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:22.682765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|963fd289-4ce09a25-d5436232-47937034_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:22.683135Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:22.683147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3210
2025-09-30T14:59:22.683319Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3210 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:22.683341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3210 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:22.683345Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3210 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:22.683349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:22.683720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3210 sessionId:  describe result for acl check
2025-09-30T14:59:22.683749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:22.683751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:22.683752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:22.683757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897002479829483:4140] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:22.684298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897002479829483:4140] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:22.686640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897002479829483:4140] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:22.695634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897002479829483:4140] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:22.695651Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897002479829483:4140] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:22.695654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897002479829483:4140] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:22.695663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3210 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:22.713777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:22.715500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:22.715722Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:22.715734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:22.715746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:22.715817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:22.715862Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897002390026653:12647]
2025-09-30T14:59:22.716538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:22.716937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:22.716994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:22.717361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:22.717435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.717442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.717443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.717445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.717446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.717447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.717448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.717450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.717451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.717453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.717454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.717455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.717457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.717458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.717459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.717466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.717477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.717481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.717485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.717490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.717494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.717498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.717503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.717507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.717511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.717515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.717520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.717524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.717528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.717532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.717542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.717551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.717557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.717563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.717567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.717572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.717586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.717593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.717598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.717610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.717615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.717620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.717625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.717631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.717635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.717640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.717650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.717656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.717660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.717665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.717669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.717675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.717678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.717684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.717688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.717692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.717696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.717700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.717704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.717709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.717750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:22.723484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:22.724369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:22.724385Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:22.724387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:22.724391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:22.724396Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3209 [2:7555897002390026653:12647]
2025-09-30T14:59:22.724410Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:22.724424Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:22.724430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:22.724432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:22.724434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:22.724447Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:22.724457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:22.724462Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:22.724511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.724516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.724518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.724521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:22.724523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:22.724891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:22.724903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.724917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.724934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.724957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:22.725025Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3209
2025-09-30T14:59:22.725061Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3209
2025-09-30T14:59:22.724983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479829469:2454], now have 1 active actors on pipe
2025-09-30T14:59:22.724994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479829598:4140], now have 1 active actors on pipe
2025-09-30T14:59:22.725003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897002390026648:12647]
2025-09-30T14:59:22.725005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897002390026648:12647]
2025-09-30T14:59:22.725008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897002390026648:12647]
2025-09-30T14:59:22.725020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:22.725037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:22.725051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:22.725055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:22.725091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897002390026648:12647]
2025-09-30T14:59:22.725094Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:22.725161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:22.725163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:22.725165Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:22.725171Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:22.725444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.725461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.725489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec5da665-947f87bf-78c3ea59-397b537d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:22.725502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:22.725506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:22.725509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:22.725521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:22.725533Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:22.725547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:22.726005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.726017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.726037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:22.726187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3210 partition: 0 MaxSeqNo: 42 sessionId: src_id|ec5da665-947f87bf-78c3ea59-397b537d_0
2025-09-30T14:59:22.726607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|963fd289-4ce09a25-d5436232-47937034_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ec5da665-947f87bf-78c3ea59-397b537d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:22.729532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5da665-947f87bf-78c3ea59-397b537d_0] Write session: try to update token
2025-09-30T14:59:22.729553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5da665-947f87bf-78c3ea59-397b537d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:22.739457Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:22.739478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:22.739481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:22.739483Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:22.739493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897002390026648:12647]
2025-09-30T14:59:22.739501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897002390026648:12647]
2025-09-30T14:59:22.739505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897002390026648:12647]
2025-09-30T14:59:22.739548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:22.739559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.739557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:22.739562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:22.739566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:22.739571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:22.739703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:22.744718Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3210 sessionId: src_id|ec5da665-947f87bf-78c3ea59-397b537d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:22.747456Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:22.774749Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897002479829777:4275]
2025-09-30T14:59:22.775022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3209, pipe: [1:7555897002479829777:4275]
2025-09-30T14:59:22.850780Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:22.851063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.851079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.851118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479829777:4275], now have 1 active actors on pipe
2025-09-30T14:59:22.851494Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:22.851500Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897002479829777:4275]
2025-09-30T14:59:22.851542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:22.851545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:22.851614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3210 reason: error at write: Disconnected sessionId: src_id|ec5da665-947f87bf-78c3ea59-397b537d_0
2025-09-30T14:59:22.851816Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3210 sessionId: src_id|ec5da665-947f87bf-78c3ea59-397b537d_0 is DEAD
2025-09-30T14:59:22.852198Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:22.854486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5da665-947f87bf-78c3ea59-397b537d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:22.854499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5da665-947f87bf-78c3ea59-397b537d_0] Write session will restart in 0.005608s
2025-09-30T14:59:22.854533Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5da665-947f87bf-78c3ea59-397b537d_0] Write session: Do CDS request
2025-09-30T14:59:22.854543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5da665-947f87bf-78c3ea59-397b537d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:22.864763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5da665-947f87bf-78c3ea59-397b537d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:22.864842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:22.864859Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3211
2025-09-30T14:59:22.867453Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3211 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:22.867501Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3211 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:22.867507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3211 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:22.867512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:22.867970Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3211 sessionId:  describe result for acl check
2025-09-30T14:59:22.868004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:22.868008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:22.868010Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:22.868015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897002479829902:4133] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:22.868534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897002479829902:4133] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:22.872418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897002479829902:4133] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:22.880688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897002479829902:4133] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:22.880707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897002479829902:4133] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:22.880710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897002479829902:4133] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:22.880720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3211 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:22.883119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:22.886119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:22.886332Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:22.886342Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:22.886354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:22.886410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:22.886456Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897002390026954:12649]
2025-09-30T14:59:22.887127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:22.887474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:22.887526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:22.887881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:22.887952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.887959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.887961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.887962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.887963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.887964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.887965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.887966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.887968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.887969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.887970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.887971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.887972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.887973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.887974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.887980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.887990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.887994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.887998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.888002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.888006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.888009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.888013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.888017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.888022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.888025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.888029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.888032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.888036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.888040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.888049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.888056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:22.888061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.888066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:22.888070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.888075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:22.888082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.888087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:22.888092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.888097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:22.888102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.888108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:22.888115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.888127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:22.888131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.888141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:22.888145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.888153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:22.888156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.888161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:22.888168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.888173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.888182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.888187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.888192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.888200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.888205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.888209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:22.888214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.888223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:22.888264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:22.893738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:22.894999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:22.895016Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:22.895019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:22.895023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:22.895030Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3210 [2:7555897002390026954:12649]
2025-09-30T14:59:22.895045Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:22.895061Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:22.895064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:22.895067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:22.895070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:22.895084Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:22.895091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:22.895097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:22.895158Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.895165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.895167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.895170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:22.895173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:22.895240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:22.895270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.895284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:22.895296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:22.895318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:22.895340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897002390026949:12649]
2025-09-30T14:59:22.895347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897002390026949:12649]
2025-09-30T14:59:22.895350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897002390026949:12649]
2025-09-30T14:59:22.895358Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:22.895369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:22.895375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479830088:4133], now have 1 active actors on pipe
2025-09-30T14:59:22.895380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:22.895381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:22.895383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:22.895398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:22.895400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:22.895405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479829793:2454], now have 1 active actors on pipe
2025-09-30T14:59:22.895436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897002390026949:12649]
2025-09-30T14:59:22.895449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:22.895460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:22.895478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3210
2025-09-30T14:59:22.895484Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3210
2025-09-30T14:59:22.895593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.895604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.895630Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:22.895642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:22.895646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:22.895648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:22.895659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:22.895668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:22.895684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:22.895921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.895950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.895982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:22.896126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3211 partition: 0 MaxSeqNo: 42 sessionId: src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0
2025-09-30T14:59:22.896519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec5da665-947f87bf-78c3ea59-397b537d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:22.899528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0] Write session: try to update token
2025-09-30T14:59:22.899550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:22.911376Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:22.911395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:22.911405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897002390026949:12649]
2025-09-30T14:59:22.911452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:22.911455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:22.911631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:22.911787Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:22.911938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:22.912094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:22.912376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:22.912423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:22.917532Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3211 sessionId: src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:22.920493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:22.920746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:22.920773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:22.920814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:22.920942Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:22.923419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:22.923436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:22.923438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:22.923441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:22.923451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897002390026949:12649]
2025-09-30T14:59:22.923456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897002390026949:12649]
2025-09-30T14:59:22.923460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897002390026949:12649]
2025-09-30T14:59:22.923500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:22.923507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:22.923507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:22.923510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:22.923514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:22.923519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:22.923649Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:22.951836Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897002479830103:4275]
2025-09-30T14:59:22.952040Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3210, pipe: [1:7555897002479830103:4275]
2025-09-30T14:59:23.057520Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:23.058190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897002479830103:4275], now have 1 active actors on pipe
2025-09-30T14:59:23.066799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.066834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.067023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.067079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.067141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.067202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.067863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.067878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.067952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.068009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.068066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.068129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.068168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.068171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.068236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.068292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.068350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.068409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.068447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.068450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.068517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.068592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.068655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.068716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.068757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.068760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.068827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.068883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.068940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.068996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.069034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.069040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.069103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.069157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.069214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.069272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.069312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.069315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.069383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.069443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.069512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.069574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.069614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.069616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.069680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.069736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.069794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.069855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.070126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.070129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.070192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.070246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.070302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.070409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.070464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.070467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.070530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.070588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.070647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.070706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.070747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.070750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.071550Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:23.073774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:23.073830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3211 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0
2025-09-30T14:59:23.074021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3211 sessionId: src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0 is DEAD
2025-09-30T14:59:23.074177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:23.074202Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0] Write session will restart in 0.009420s
2025-09-30T14:59:23.074227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0] Write session: Do CDS request
2025-09-30T14:59:23.074233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:23.074303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:23.074341Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897002479830103:4275]
2025-09-30T14:59:23.084917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:23.084896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:23.084912Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3212
2025-09-30T14:59:23.085170Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3212 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:23.085209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3212 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:23.085220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3212 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:23.085224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:23.085840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3212 sessionId:  describe result for acl check
2025-09-30T14:59:23.085875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:23.085876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:23.085877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:23.085882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897006774797417:4125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:23.086382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897006774797417:4125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:23.098969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897006774797417:4125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:23.105299Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897006774797417:4125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:23.105317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897006774797417:4125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:23.105326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897006774797417:4125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:23.105335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3212 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:23.110112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:23.113429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:23.113673Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:23.113684Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:23.113696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:23.113763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:23.113814Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897006684994553:12651]
2025-09-30T14:59:23.114360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:23.114667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:23.114719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:23.115069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:23.115129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.115135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.115137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.115138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.115140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.115141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.115143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.115144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.115145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.115147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.115148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.115150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.115151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.115152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.115153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.115159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.115171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.115175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.115180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.115184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.115188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.115193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.115197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.115202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.115206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.115210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.115214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.115218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.115222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.115226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.115239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.115272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.115278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.115283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.115289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.115294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.115299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.115305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.115313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.115319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.115323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.115329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.115334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.115340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.115344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.115350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.115355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.115359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.115364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.115370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.115375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.115381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.115385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.115391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.115395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.115401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.115405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.115417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.115422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.115428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.115473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:23.121125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:23.122735Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3211
2025-09-30T14:59:23.122759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3211
2025-09-30T14:59:23.122338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:23.122356Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:23.122359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:23.122363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:23.122371Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3211 [2:7555897006684994553:12651]
2025-09-30T14:59:23.122392Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:23.122408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:23.122411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:23.122415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:23.122417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:23.122433Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:23.122441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:23.122447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:23.122507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.122510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.122512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.122515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:23.122518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:23.122589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:23.122592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.122606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.122621Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.122641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:23.122660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774797402:2454], now have 1 active actors on pipe
2025-09-30T14:59:23.122664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774797641:4125], now have 1 active actors on pipe
2025-09-30T14:59:23.122671Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897006684994548:12651]
2025-09-30T14:59:23.122673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897006684994548:12651]
2025-09-30T14:59:23.122676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897006684994548:12651]
2025-09-30T14:59:23.122691Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:23.122705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:23.122705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:23.122709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:23.122712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:23.122721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:23.122725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:23.122758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897006684994548:12651]
2025-09-30T14:59:23.122762Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:23.122766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:23.122801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.122806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.122836Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|718d36cf-7ac4788e-19131bd2-d894abff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:23.122843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:23.122847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:23.122849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:23.122862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:23.122871Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:23.122884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:23.123152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.123168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.123182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:23.123311Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3212 partition: 0 MaxSeqNo: 42 sessionId: src_id|718d36cf-7ac4788e-19131bd2-d894abff_0
2025-09-30T14:59:23.123726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f01e563c-32ba431b-55e03f0c-8e83edfd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|718d36cf-7ac4788e-19131bd2-d894abff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:23.126599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|718d36cf-7ac4788e-19131bd2-d894abff_0] Write session: try to update token
2025-09-30T14:59:23.126618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|718d36cf-7ac4788e-19131bd2-d894abff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:23.136100Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:23.136126Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:23.136129Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:23.136131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:23.136142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897006684994548:12651]
2025-09-30T14:59:23.136147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897006684994548:12651]
2025-09-30T14:59:23.136151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897006684994548:12651]
2025-09-30T14:59:23.136195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:23.136201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.136205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:23.136220Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:23.136226Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:23.136232Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:23.136350Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:23.145296Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3212 sessionId: src_id|718d36cf-7ac4788e-19131bd2-d894abff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:23.148231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:23.174597Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897006774797715:4275]
2025-09-30T14:59:23.174890Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3211, pipe: [1:7555897006774797715:4275]
2025-09-30T14:59:23.254241Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:23.254672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.254683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.254705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774797715:4275], now have 1 active actors on pipe
2025-09-30T14:59:23.255133Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:23.255420Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897006774797715:4275]
2025-09-30T14:59:23.255456Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:23.255496Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:23.255499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:23.255560Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3212 reason: error at write: Disconnected sessionId: src_id|718d36cf-7ac4788e-19131bd2-d894abff_0
2025-09-30T14:59:23.255727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3212 sessionId: src_id|718d36cf-7ac4788e-19131bd2-d894abff_0 is DEAD
2025-09-30T14:59:23.258561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|718d36cf-7ac4788e-19131bd2-d894abff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:23.258576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|718d36cf-7ac4788e-19131bd2-d894abff_0] Write session will restart in 0.005543s
2025-09-30T14:59:23.258619Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|718d36cf-7ac4788e-19131bd2-d894abff_0] Write session: Do CDS request
2025-09-30T14:59:23.258628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|718d36cf-7ac4788e-19131bd2-d894abff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:23.266435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|718d36cf-7ac4788e-19131bd2-d894abff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:23.266691Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:23.266712Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3213
2025-09-30T14:59:23.267098Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3213 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:23.267132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3213 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:23.267143Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3213 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:23.267147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:23.267878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3213 sessionId:  describe result for acl check
2025-09-30T14:59:23.267915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:23.267917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:23.267919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:23.267924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897006774797726:4101] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:23.268450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897006774797726:4101] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:23.270699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897006774797726:4101] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:23.273606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897006774797726:4101] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:23.273632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897006774797726:4101] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:23.273636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897006774797726:4101] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:23.273643Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3213 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:23.292553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:23.296813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:23.297437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:23.297453Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:23.297463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:23.297516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:23.297561Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897006684994867:12654]
2025-09-30T14:59:23.298287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:23.298648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:23.298712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:23.299069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:23.299129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.299136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.299137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.299139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.299140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.299142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.299143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.299145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.299146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.299148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.299149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.299150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.299152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.299153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.299154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.299160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.299172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.299177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.299182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.299186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.299191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.299196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.299201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.299205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.299210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.299215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.299220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.299225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.299230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.299235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.299261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.299270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.299277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.299289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.299296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.299307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.299313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.299322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.299332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.299339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.299343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.299354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.299359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.299369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.299375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.299386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.299392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.299402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.299408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.299414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.299425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.299433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.299443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.299449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.299454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.299465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.299470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.299481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.299487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.299492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.299544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:23.305373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:23.306598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:23.306626Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:23.306629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:23.306632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:23.306640Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3212 [2:7555897006684994867:12654]
2025-09-30T14:59:23.306657Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:23.306675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:23.306678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:23.306681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:23.306684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:23.306702Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:23.306716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:23.306728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:23.306799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.306807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.306808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.306812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:23.306815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:23.306887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:23.306895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.306909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.306923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.306942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:23.306966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774797768:4101], now have 1 active actors on pipe
2025-09-30T14:59:23.306977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897006684994853:12654]
2025-09-30T14:59:23.306981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897006684994853:12654]
2025-09-30T14:59:23.306983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897006684994853:12654]
2025-09-30T14:59:23.307067Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3212
2025-09-30T14:59:23.307075Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3212
2025-09-30T14:59:23.306995Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:23.307014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774797717:2454], now have 1 active actors on pipe
2025-09-30T14:59:23.307020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:23.307022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:23.307023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:23.307025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:23.307036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:23.307039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:23.307092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897006684994853:12654]
2025-09-30T14:59:23.307095Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:23.307106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:23.307132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.307137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.307170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:23.307180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:23.307185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:23.307187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:23.307201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:23.307212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:23.307228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:23.307544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.307559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.307581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:23.307683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3213 partition: 0 MaxSeqNo: 42 sessionId: src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0
2025-09-30T14:59:23.308066Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|718d36cf-7ac4788e-19131bd2-d894abff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:23.310953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0] Write session: try to update token
2025-09-30T14:59:23.310970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:23.320717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:23.320741Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:23.320743Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:23.320745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:23.320757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897006684994853:12654]
2025-09-30T14:59:23.320761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897006684994853:12654]
2025-09-30T14:59:23.320764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897006684994853:12654]
2025-09-30T14:59:23.320807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:23.320814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.320817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:23.320959Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:23.323342Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:23.323362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:23.323366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:23.326647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3213 sessionId: src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:23.329683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:23.353814Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897006774798039:4275]
2025-09-30T14:59:23.354170Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3212, pipe: [1:7555897006774798039:4275]
2025-09-30T14:59:23.440061Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:23.440506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.440521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.440574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774798039:4275], now have 1 active actors on pipe
2025-09-30T14:59:23.440921Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:23.445881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897006774798039:4275]
2025-09-30T14:59:23.445886Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:23.445923Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:23.446008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3213 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0
2025-09-30T14:59:23.446171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3213 sessionId: src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0 is DEAD
2025-09-30T14:59:23.446333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:23.446341Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0] Write session will restart in 0.009267s
2025-09-30T14:59:23.446364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0] Write session: Do CDS request
2025-09-30T14:59:23.446370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:23.456101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:23.456850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:23.456880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:23.456895Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3214
2025-09-30T14:59:23.457108Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3214 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:23.457152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3214 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:23.457163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3214 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:23.457168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:23.457648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3214 sessionId:  describe result for acl check
2025-09-30T14:59:23.457680Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:23.457683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:23.457684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:23.457691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897006774798064:4097] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:23.458240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897006774798064:4097] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:23.457876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:23.458084Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:23.458088Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:23.458099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:23.458151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:23.458186Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897006684994923:12656]
2025-09-30T14:59:23.458886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:23.459643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:23.459712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:23.460086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:23.460168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.460177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.460178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.460180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.460181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.460183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.460184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.460185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.460187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.460188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.460189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.460191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.460192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.460193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.460194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.460201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.460213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.460217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.460222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.460228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.460233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.460237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.460242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.460247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.460252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.460256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.460261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.460265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.460270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.460275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.460285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.460292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.460297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.460303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.460309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.460313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.460317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.460333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.460339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.460344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.460347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.460351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.460357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.460361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.460367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.460379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.460384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.460388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.460392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.460397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.460402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.460407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.460410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.460415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.460420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.460425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.460430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.460435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.460441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.460446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.460485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:23.460610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897006774798064:4097] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:23.466928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:23.466640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897006774798064:4097] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:23.466660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897006774798064:4097] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:23.466664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897006774798064:4097] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:23.466675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3214 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:23.468008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:23.468029Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:23.468032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:23.468039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:23.468046Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3213 [2:7555897006684994923:12656]
2025-09-30T14:59:23.468063Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:23.468078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:23.468082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:23.468085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:23.468087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:23.468104Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:23.468117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:23.468126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:23.468198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.468206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.468208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.468211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:23.468214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:23.468644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3213
2025-09-30T14:59:23.468674Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3213
2025-09-30T14:59:23.468293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:23.468301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.468314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.468326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.468342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:23.468363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897006684994918:12656]
2025-09-30T14:59:23.468365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897006684994918:12656]
2025-09-30T14:59:23.468367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897006684994918:12656]
2025-09-30T14:59:23.468375Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:23.468392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774798102:4097], now have 1 active actors on pipe
2025-09-30T14:59:23.468395Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:23.468398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:23.468399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:23.468401Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:23.468412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:23.468416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:23.468420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774798044:2454], now have 1 active actors on pipe
2025-09-30T14:59:23.468456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897006684994918:12656]
2025-09-30T14:59:23.468463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:23.468469Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:23.469861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.469880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.469911Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5087e351-8bb09728-681407d8-376994ca_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:23.469929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:23.469958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:23.469966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:23.469982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:23.470007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:23.470057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:23.470340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.470365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.470388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:23.470572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3214 partition: 0 MaxSeqNo: 42 sessionId: src_id|5087e351-8bb09728-681407d8-376994ca_0
2025-09-30T14:59:23.471005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3eafeaf8-add08487-7935d4c3-6c7bdebb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5087e351-8bb09728-681407d8-376994ca_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:23.474030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5087e351-8bb09728-681407d8-376994ca_0] Write session: try to update token
2025-09-30T14:59:23.474050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5087e351-8bb09728-681407d8-376994ca_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:23.485423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:23.485451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:23.485457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:23.485459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:23.485472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897006684994918:12656]
2025-09-30T14:59:23.485478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897006684994918:12656]
2025-09-30T14:59:23.485482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897006684994918:12656]
2025-09-30T14:59:23.485531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:23.485539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.485540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:23.485542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:23.485546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:23.485552Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:23.485764Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:23.491138Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3214 sessionId: src_id|5087e351-8bb09728-681407d8-376994ca_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:23.493728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:23.545821Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897006774798111:4275]
2025-09-30T14:59:23.546111Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3213, pipe: [1:7555897006774798111:4275]
2025-09-30T14:59:23.603383Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:23.603697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.603713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.603752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774798111:4275], now have 1 active actors on pipe
2025-09-30T14:59:23.603967Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:23.604024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:23.604034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897006774798111:4275]
2025-09-30T14:59:23.604039Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:23.604055Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:23.604112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3214 reason: error at write: Disconnected sessionId: src_id|5087e351-8bb09728-681407d8-376994ca_0
2025-09-30T14:59:23.604292Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3214 sessionId: src_id|5087e351-8bb09728-681407d8-376994ca_0 is DEAD
2025-09-30T14:59:23.604387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5087e351-8bb09728-681407d8-376994ca_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:23.604397Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5087e351-8bb09728-681407d8-376994ca_0] Write session will restart in 0.008041s
2025-09-30T14:59:23.604430Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5087e351-8bb09728-681407d8-376994ca_0] Write session: Do CDS request
2025-09-30T14:59:23.604436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5087e351-8bb09728-681407d8-376994ca_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:23.613789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5087e351-8bb09728-681407d8-376994ca_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:23.614821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:23.615304Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:23.615322Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3215
2025-09-30T14:59:23.616530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:23.615478Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3215 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:23.615513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3215 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:23.615518Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3215 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:23.615524Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:23.615891Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3215 sessionId:  describe result for acl check
2025-09-30T14:59:23.615916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:23.615918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:23.615920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:23.615926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897006774798145:4077] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:23.616483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897006774798145:4077] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:23.616790Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:23.616803Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:23.616815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:23.616880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:23.616933Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897006684995006:12659]
2025-09-30T14:59:23.617626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:23.617949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:23.618005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:23.618364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:23.618447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.618454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.618455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.618456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.618458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.618459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.618460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.618461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.618462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.618463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.618465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.618466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.618467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.618468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.618469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.618475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.618486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.618490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.618494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.618498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.618503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.618506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.618510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.618514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.618518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.618522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.618530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.618534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.618538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.618542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.618550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.618558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.618565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.618570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.618575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.618580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.618585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.618590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.618595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.618600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.618604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.618610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.618615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.618620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.618625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.618630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.618637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.618650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.618654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.618659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.618665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.618670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.618674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.618680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.618685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.618690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.618694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.618700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.618705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.618710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.618754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:23.618263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897006774798145:4077] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:23.624681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:23.625743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:23.625765Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:23.625770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:23.625775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:23.625781Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3214 [2:7555897006684995006:12659]
2025-09-30T14:59:23.625797Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:23.625812Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:23.625816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:23.625820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:23.625822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:23.625838Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:23.625844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:23.625851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:23.625913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.625914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.625916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.625919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:23.625921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:23.625994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:23.625997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.626010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.626021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.626038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:23.626057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774798183:4077], now have 1 active actors on pipe
2025-09-30T14:59:23.626061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774798112:2454], now have 1 active actors on pipe
2025-09-30T14:59:23.626066Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897006684995000:12659]
2025-09-30T14:59:23.626068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897006684995000:12659]
2025-09-30T14:59:23.626070Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897006684995000:12659]
2025-09-30T14:59:23.626084Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:23.626096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:23.626109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:23.626112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:23.626111Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:23.626116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:23.626118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:23.626147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897006684995000:12659]
2025-09-30T14:59:23.626160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:23.626186Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:23.626437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.626444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.626480Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:23.626491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:23.626500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:23.626502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:23.626514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:23.626527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:23.626546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:23.626774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.626789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.626820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:23.624162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897006774798145:4077] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:23.624180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897006774798145:4077] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:23.624184Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897006774798145:4077] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:23.624193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3215 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:23.626160Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3214
2025-09-30T14:59:23.627322Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5087e351-8bb09728-681407d8-376994ca_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:23.626182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3214
2025-09-30T14:59:23.626908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3215 partition: 0 MaxSeqNo: 42 sessionId: src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0
2025-09-30T14:59:23.630549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0] Write session: try to update token
2025-09-30T14:59:23.630571Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:23.639527Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:23.639551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:23.639553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:23.639555Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:23.639567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897006684995000:12659]
2025-09-30T14:59:23.639571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897006684995000:12659]
2025-09-30T14:59:23.639575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897006684995000:12659]
2025-09-30T14:59:23.639620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:23.639627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.639630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:23.639632Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:23.639640Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:23.639644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:23.639776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:23.647282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3215 sessionId: src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:23.651068Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:23.704022Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897006774798201:4275]
2025-09-30T14:59:23.704492Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3214, pipe: [1:7555897006774798201:4275]
2025-09-30T14:59:23.756193Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:23.756597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.756606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.756624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774798201:4275], now have 1 active actors on pipe
2025-09-30T14:59:23.758435Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:23.758587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897006774798201:4275]
2025-09-30T14:59:23.758610Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:23.758633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:23.758635Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:23.758682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3215 reason: error at write: Disconnected sessionId: src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0
2025-09-30T14:59:23.758830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3215 sessionId: src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0 is DEAD
2025-09-30T14:59:23.759494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:23.759502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0] Write session will restart in 0.007350s
2025-09-30T14:59:23.759520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0] Write session: Do CDS request
2025-09-30T14:59:23.759540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:23.768139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:23.768891Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:23.768906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3216
2025-09-30T14:59:23.769109Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3216 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:23.769147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3216 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:23.769151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3216 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:23.769155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:23.769570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3216 sessionId:  describe result for acl check
2025-09-30T14:59:23.769608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:23.769615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:23.769617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:23.769621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897006774798211:4062] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:23.770055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897006774798211:4062] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:23.772714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897006774798211:4062] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:23.780359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:23.780147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897006774798211:4062] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:23.780163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897006774798211:4062] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:23.780166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897006774798211:4062] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:23.780176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3216 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:23.788265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:23.788500Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:23.788504Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:23.788514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:23.788574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:23.788612Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897006684995091:12674]
2025-09-30T14:59:23.789109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:23.791065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:23.791111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:23.791400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:23.791496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.791498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.791499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.791500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.791502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.791503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.791504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.791505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.791509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.791510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.791511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.791517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.791518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.791519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.791520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.791526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.791536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.791540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.791545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.791549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.791553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.791556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.791558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.791561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.791563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.791566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.791568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.791570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.791572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.791575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.791583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.791592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:23.791598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.791604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:23.791609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.791614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:23.791619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.791624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:23.791630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.791636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:23.791641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.791647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:23.791655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.791660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:23.791665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.791670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:23.791675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.791679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:23.791682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.791687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:23.791693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.791698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.791703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.791709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.791713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.791719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.791723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.791729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:23.791733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.791738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:23.791785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:23.797367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:23.798243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:23.798258Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:23.798260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:23.798262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:23.798267Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3215 [2:7555897006684995091:12674]
2025-09-30T14:59:23.798279Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:23.798293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:23.798295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:23.798297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:23.798298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:23.798311Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:23.798319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:23.798325Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:23.798385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.798393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.798394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.798397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:23.798399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:23.798458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:23.798466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.798479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:23.798495Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:23.798513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:23.798535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774798202:2454], now have 1 active actors on pipe
2025-09-30T14:59:23.798545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774798256:4062], now have 1 active actors on pipe
2025-09-30T14:59:23.798551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897006684995085:12674]
2025-09-30T14:59:23.798553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897006684995085:12674]
2025-09-30T14:59:23.798555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897006684995085:12674]
2025-09-30T14:59:23.798574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:23.798588Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:23.798610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:23.798616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:23.798646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897006684995085:12674]
2025-09-30T14:59:23.798652Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:23.798665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:23.798677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:23.798680Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:23.798688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:23.798617Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3215
2025-09-30T14:59:23.798815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3215
2025-09-30T14:59:23.798872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.798884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.798908Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:23.798920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:23.798927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:23.798932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:23.798943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:23.798971Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:23.798993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:23.799114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.799127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.799154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:23.799241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3216 partition: 0 MaxSeqNo: 42 sessionId: src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0
2025-09-30T14:59:23.799682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c3f3789f-33c937b6-24ce9fdf-ce230f3b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:23.802697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0] Write session: try to update token
2025-09-30T14:59:23.802715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:23.821690Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:23.821709Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:23.821718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897006684995085:12674]
2025-09-30T14:59:23.821756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:23.821938Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:23.822081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:23.822260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:23.822392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:23.822579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:23.822610Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:23.823321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:23.827960Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3216 sessionId: src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:23.830517Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:23.831142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.831163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.831191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:23.831310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:23.832902Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:23.832921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:23.832924Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:23.832925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:23.832934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897006684995085:12674]
2025-09-30T14:59:23.832938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897006684995085:12674]
2025-09-30T14:59:23.832942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897006684995085:12674]
2025-09-30T14:59:23.832987Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:23.832994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:23.833001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:23.833003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:23.833004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:23.833005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:23.833137Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:23.857603Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897006774798284:4275]
2025-09-30T14:59:23.858051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3215, pipe: [1:7555897006774798284:4275]
2025-09-30T14:59:23.968042Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:23.976714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:23.976749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:23.976963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.977052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.977131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.977197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.977245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.977251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.977325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.977391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.977456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.977525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.977566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.977570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.977648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.977717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.977794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.977875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.977922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.977926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.978011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.978102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.978176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.978281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.978339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.978342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.978426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.978484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.978543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.978604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.978649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.978652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.978724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.978785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.978855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.978953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.979001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.979005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.979088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.979163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.979462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.979668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.979721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.979731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.979801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.979866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.979933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.980009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.980060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.980069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.980139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.980208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.980283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.980360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.980417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.980426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.980509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:23.980601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:23.980696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:23.980770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:23.980823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:23.980833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:23.981175Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:23.981186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897006774798284:4275]
2025-09-30T14:59:23.981191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:23.981208Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:23.981221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3216 reason: error at write: Disconnected sessionId: src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0
2025-09-30T14:59:23.981386Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3216 sessionId: src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0 is DEAD
2025-09-30T14:59:23.981658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:23.981670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0] Write session will restart in 0.009275s
2025-09-30T14:59:23.981695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0] Write session: Do CDS request
2025-09-30T14:59:23.981701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:23.980907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774798284:4275], now have 1 active actors on pipe
2025-09-30T14:59:23.982093Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:23.991800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:23.991944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:23.991962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3217
2025-09-30T14:59:23.992130Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3217 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:23.992175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3217 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:23.992185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3217 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:23.992188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:23.992647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3217 sessionId:  describe result for acl check
2025-09-30T14:59:23.992674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:23.992679Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:23.992681Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:23.992685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897006774798304:4045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:23.993217Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897006774798304:4045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:23.995180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897006774798304:4045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:23.997134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:23.999927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:24.000142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:24.000156Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:24.000168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:24.000274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:24.000316Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897006684995151:12676]
2025-09-30T14:59:24.000971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:24.001331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:24.001406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:24.001772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:24.001842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.001851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.001852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.001854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.001856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.001857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.001859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.001860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.001861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.001863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.001865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.001866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.001867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.001870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.001871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.001877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.001889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.001894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.001899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.001904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.001908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.001913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.001920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.001924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.001928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.001932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.001936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.001940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.001944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.001949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.001958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.001979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.001985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.001992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.001996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.002003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.002008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.002013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.002019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.002024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.002030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.002036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.002046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.002052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.002061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.002068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.002072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.002080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.002084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.002090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.002095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.002105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.002109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.002116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.002125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.002131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.002139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.002144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.002149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.002158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.002203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:24.000417Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897006774798304:4045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:24.000434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897006774798304:4045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:24.000438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897006774798304:4045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:24.000447Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3217 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:24.008085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:24.008965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:24.008982Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:24.008985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:24.008990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:24.008997Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3216 [2:7555897006684995151:12676]
2025-09-30T14:59:24.009013Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:24.009029Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:24.009038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:24.009042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:24.009045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:24.009063Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:24.009075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:24.009086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:24.009146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.009157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.009159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.009163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:24.009166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:24.009245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:24.009254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.009269Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.009419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3216
2025-09-30T14:59:24.009459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3216
2025-09-30T14:59:24.009281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.009307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:24.009325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765638:4045], now have 1 active actors on pipe
2025-09-30T14:59:24.009328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897006774798289:2454], now have 1 active actors on pipe
2025-09-30T14:59:24.009336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897006684995146:12676]
2025-09-30T14:59:24.009338Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897006684995146:12676]
2025-09-30T14:59:24.009340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897006684995146:12676]
2025-09-30T14:59:24.009354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:24.009367Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:24.009368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:24.009370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:24.009373Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:24.009383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:24.009386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:24.009418Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897006684995146:12676]
2025-09-30T14:59:24.009425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:24.009493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:24.009716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.009726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.009759Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:24.009768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:24.009771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:24.009773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:24.009784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:24.009796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:24.009822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:24.009990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.010000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.010014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:24.010127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3217 partition: 0 MaxSeqNo: 42 sessionId: src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0
2025-09-30T14:59:24.010499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c70432a6-d0f1ad90-38a48aad-98eebf66_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:24.013350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0] Write session: try to update token
2025-09-30T14:59:24.013370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:24.022602Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:24.022623Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:24.022625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:24.022628Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:24.022637Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897006684995146:12676]
2025-09-30T14:59:24.022642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897006684995146:12676]
2025-09-30T14:59:24.022646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897006684995146:12676]
2025-09-30T14:59:24.022695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:24.022709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.022712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:24.022720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:24.022729Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:24.022747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:24.022871Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:24.032877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3217 sessionId: src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:24.035622Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:24.082482Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897011069765651:4275]
2025-09-30T14:59:24.088825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3216, pipe: [1:7555897011069765651:4275]
2025-09-30T14:59:24.143273Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:24.143683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.143693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.143734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765651:4275], now have 1 active actors on pipe
2025-09-30T14:59:24.148064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:24.148080Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0] Write session will restart in 0.006845s
2025-09-30T14:59:24.147575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:24.147592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:24.147664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3217 reason: error at write: Disconnected sessionId: src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0
2025-09-30T14:59:24.148106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0] Write session: Do CDS request
2025-09-30T14:59:24.147848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3217 sessionId: src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0 is DEAD
2025-09-30T14:59:24.148113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:24.147997Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:24.148034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897011069765651:4275]
2025-09-30T14:59:24.150545Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:24.155878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:24.156323Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:24.156339Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3218
2025-09-30T14:59:24.156560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3218 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:24.156602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3218 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:24.156607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3218 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:24.156610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:24.157410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3218 sessionId:  describe result for acl check
2025-09-30T14:59:24.157442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:24.157444Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:24.157446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:24.157453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897011069765660:4040] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:24.158599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897011069765660:4040] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:24.165163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897011069765660:4040] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:24.170295Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897011069765660:4040] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:24.170310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897011069765660:4040] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:24.170314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897011069765660:4040] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:24.170323Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3218 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:24.174193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:24.176417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:24.176666Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:24.176682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:24.176696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:24.176772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:24.176834Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897010979962511:12678]
2025-09-30T14:59:24.177587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:24.178219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:24.178298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:24.178680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:24.178757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.178758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.178759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.178761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.178762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.178766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.178768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.178769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.178770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.178771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.178773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.178774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.178775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.178776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.178777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.178785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.178795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.178799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.178803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.178807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.178810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.178814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.178818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.178822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.178826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.178830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.178834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.178839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.178844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.178848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.178858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.178867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.178874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.178880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.178889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.178895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.178901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.178908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.178914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.178920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.178925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.178931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.178935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.178941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.178945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.178951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.178958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.178964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.178968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.178974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.178980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.178986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.178991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.178997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.179004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.179010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.179014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.179021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.179026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.179031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.179078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:24.185679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:24.186656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:24.186674Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:24.186678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:24.186682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:24.186693Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3217 [2:7555897010979962511:12678]
2025-09-30T14:59:24.186717Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:24.186734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:24.186737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:24.186741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:24.186744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:24.186763Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:24.186775Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:24.186785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:24.186853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.186860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.186862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.186865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:24.186871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:24.186939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:24.186946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.186961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.186978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.187002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:24.187025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765702:4040], now have 1 active actors on pipe
2025-09-30T14:59:24.187033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765653:2454], now have 1 active actors on pipe
2025-09-30T14:59:24.187040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897010979962506:12678]
2025-09-30T14:59:24.187046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897010979962506:12678]
2025-09-30T14:59:24.187048Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897010979962506:12678]
2025-09-30T14:59:24.187062Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:24.187079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:24.187095Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:24.187101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:24.187104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:24.187108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:24.187112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:24.187146Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897010979962506:12678]
2025-09-30T14:59:24.187159Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:24.187167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:24.187290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3217
2025-09-30T14:59:24.187328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3217
2025-09-30T14:59:24.187394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.187407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.187440Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:24.187453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:24.187461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:24.187463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:24.187475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:24.187483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:24.187503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:24.187715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.187729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.187755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:24.187884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3218 partition: 0 MaxSeqNo: 42 sessionId: src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0
2025-09-30T14:59:24.188272Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e93227ab-5bf4994-7c8acdc7-200b7f55_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:24.191583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0] Write session: try to update token
2025-09-30T14:59:24.191609Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:24.199507Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:24.199529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:24.199538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897010979962506:12678]
2025-09-30T14:59:24.199582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:24.199595Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:24.199778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:24.199926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:24.200069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:24.200209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:24.200408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:24.200443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:24.211185Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:24.211207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:24.211210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:24.211216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:24.211347Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897010979962506:12678]
2025-09-30T14:59:24.211360Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897010979962506:12678]
2025-09-30T14:59:24.211365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897010979962506:12678]
2025-09-30T14:59:24.211405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:24.211416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.211419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:24.211421Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:24.211428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:24.211432Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:24.211559Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:24.211651Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3218 sessionId: src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:24.214494Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:24.247504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897011069765723:4275]
2025-09-30T14:59:24.248533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3217, pipe: [1:7555897011069765723:4275]
2025-09-30T14:59:24.346749Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:24.347145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.347163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.347186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765723:4275], now have 1 active actors on pipe
2025-09-30T14:59:24.347501Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:24.347561Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897011069765723:4275]
2025-09-30T14:59:24.347598Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:24.347601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:24.347664Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3218 reason: error at write: Disconnected sessionId: src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0
2025-09-30T14:59:24.347840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3218 sessionId: src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0 is DEAD
2025-09-30T14:59:24.347982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:24.348045Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:24.348054Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0] Write session will restart in 0.009631s
2025-09-30T14:59:24.348079Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0] Write session: Do CDS request
2025-09-30T14:59:24.348088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:24.356701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:24.358391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:24.358621Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:24.358630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:24.358641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:24.358696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:24.358744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897010979962571:12681]
2025-09-30T14:59:24.359454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:24.359805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:24.359866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:24.360222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:24.360303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.360304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.360305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.360307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.360308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.360313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.360315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.360316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.360317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.360318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.360320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.360321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.360322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.360323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.360326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.360334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.360345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.360349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.360354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.360358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.360361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.360366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.360369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.360374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.360381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.360385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.360389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.360393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.360397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.360401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.360409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.360418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.360424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.360441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.360446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.360452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.360459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.360465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.360470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.360475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.360480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.360485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.360491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.360496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.360501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.360506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.360512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.360519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.360524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.360529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.360535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.360551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.360556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.360560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.360564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.360570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.360574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.360579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.360584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.360589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.360641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:24.361161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:24.361313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:24.361328Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3219
2025-09-30T14:59:24.361510Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3219 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:24.361567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3219 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:24.361579Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3219 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:24.361584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:24.362029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3219 sessionId:  describe result for acl check
2025-09-30T14:59:24.362066Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:24.362069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:24.362071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:24.362076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897011069765760:4027] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:24.362631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897011069765760:4027] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:24.365171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897011069765760:4027] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:24.366390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:24.367340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:24.367357Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:24.367360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:24.367363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:24.367370Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3218 [2:7555897010979962571:12681]
2025-09-30T14:59:24.367386Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:24.367405Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:24.367408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:24.367411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:24.367413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:24.367431Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:24.367437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:24.367443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:24.367497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.367507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.367509Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.367513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:24.367515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:24.367586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:24.367594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.367607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.367618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.367642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897011069765760:4027] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:24.367656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897011069765760:4027] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:24.367659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897011069765760:4027] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:24.367667Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3219 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:24.367760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3218
2025-09-30T14:59:24.367636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:24.367658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765730:2454], now have 1 active actors on pipe
2025-09-30T14:59:24.367664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897010979962566:12681]
2025-09-30T14:59:24.367666Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897010979962566:12681]
2025-09-30T14:59:24.367668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897010979962566:12681]
2025-09-30T14:59:24.367680Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:24.367693Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:24.367697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:24.367700Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:24.367702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:24.367709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:24.367712Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:24.367815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897010979962566:12681]
2025-09-30T14:59:24.367826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:24.367887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:24.367932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765796:4027], now have 1 active actors on pipe
2025-09-30T14:59:24.367981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3218
2025-09-30T14:59:24.367998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.368012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.368036Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0a36b4e-290800ac-ed89a209-80365e54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:24.368052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:24.368055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:24.368057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:24.368066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:24.368077Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:24.368090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:24.368353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.368369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.368391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:24.368515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3219 partition: 0 MaxSeqNo: 42 sessionId: src_id|c0a36b4e-290800ac-ed89a209-80365e54_0
2025-09-30T14:59:24.368909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56ed2d5c-4acc9eda-390dc203-a60307ae_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c0a36b4e-290800ac-ed89a209-80365e54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:24.371771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a36b4e-290800ac-ed89a209-80365e54_0] Write session: try to update token
2025-09-30T14:59:24.371793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a36b4e-290800ac-ed89a209-80365e54_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:24.380713Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:24.380734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:24.380736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:24.380738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:24.380749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897010979962566:12681]
2025-09-30T14:59:24.380754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897010979962566:12681]
2025-09-30T14:59:24.380758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897010979962566:12681]
2025-09-30T14:59:24.380802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:24.380809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.380814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:24.380807Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:24.380825Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:24.380830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:24.380966Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:24.400760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3219 sessionId: src_id|c0a36b4e-290800ac-ed89a209-80365e54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:24.403538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:24.447661Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897011069765808:4275]
2025-09-30T14:59:24.448477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3218, pipe: [1:7555897011069765808:4275]
2025-09-30T14:59:24.503110Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:24.503468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.503482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.503501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765808:4275], now have 1 active actors on pipe
2025-09-30T14:59:24.503741Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:24.503756Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:24.503769Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:24.503767Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897011069765808:4275]
2025-09-30T14:59:24.503786Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:24.503834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3219 reason: error at write: Disconnected sessionId: src_id|c0a36b4e-290800ac-ed89a209-80365e54_0
2025-09-30T14:59:24.504010Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3219 sessionId: src_id|c0a36b4e-290800ac-ed89a209-80365e54_0 is DEAD
2025-09-30T14:59:24.507346Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a36b4e-290800ac-ed89a209-80365e54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:24.507358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a36b4e-290800ac-ed89a209-80365e54_0] Write session will restart in 0.006895s
2025-09-30T14:59:24.507383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a36b4e-290800ac-ed89a209-80365e54_0] Write session: Do CDS request
2025-09-30T14:59:24.507393Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a36b4e-290800ac-ed89a209-80365e54_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:24.513056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:24.514865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:24.515100Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:24.515114Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:24.515125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:24.515183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:24.515233Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897010979962646:12683]
2025-09-30T14:59:24.515761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a36b4e-290800ac-ed89a209-80365e54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:24.515959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:24.515830Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:24.515853Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3220
2025-09-30T14:59:24.515961Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3220 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:24.515985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3220 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:24.515991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3220 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:24.515995Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:24.516375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:24.516440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:24.516534Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3220 sessionId:  describe result for acl check
2025-09-30T14:59:24.516586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:24.516589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:24.516591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:24.516597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897011069765837:4020] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:24.516795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:24.516891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.516898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.516899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.516900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.516901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.516902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.516905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.516906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.516908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.516909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.516910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.516911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.516912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.516913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.516914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.516920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.516929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.516933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.516937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.516941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.516945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.516948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.516953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.516957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.516961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.516964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.516967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.516971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.516975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.516979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.516987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.516993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.516999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.517004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.517009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.517014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.517018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.517022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.517027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.517031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.517035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.517039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.517043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.517048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.517052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.517057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.517063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.517069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.517074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.517078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.517082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.517087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.517091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.517097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.517101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.517105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.517109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.517113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.517118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.517122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.517145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897011069765837:4020] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:24.517164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:24.519078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897011069765837:4020] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:24.524024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897011069765837:4020] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:24.524041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897011069765837:4020] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:24.524044Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897011069765837:4020] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:24.524053Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3220 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:24.524828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:24.525746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:24.525764Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:24.525767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:24.525771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:24.525778Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3219 [2:7555897010979962646:12683]
2025-09-30T14:59:24.525797Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:24.525813Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:24.525821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:24.525825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:24.525827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:24.525843Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:24.525850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:24.525857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:24.525916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.525923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.525927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.526052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:24.526063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:24.526131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:24.526139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.526152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.526164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.526185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:24.526207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765809:2454], now have 1 active actors on pipe
2025-09-30T14:59:24.526211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765874:4020], now have 1 active actors on pipe
2025-09-30T14:59:24.526217Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897010979962632:12683]
2025-09-30T14:59:24.526224Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897010979962632:12683]
2025-09-30T14:59:24.526226Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897010979962632:12683]
2025-09-30T14:59:24.526239Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:24.526259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:24.526258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:24.526261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:24.526263Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:24.526278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:24.526283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:24.526319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897010979962632:12683]
2025-09-30T14:59:24.526330Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:24.526337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:24.526325Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3219
2025-09-30T14:59:24.526392Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3219
2025-09-30T14:59:24.526486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.526497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.526522Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79e94e17-9b91e712-9b294c30-84336784_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:24.526534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:24.526541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:24.526544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:24.526554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:24.526564Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:24.526578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:24.526762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.526777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.526803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:24.526921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3220 partition: 0 MaxSeqNo: 42 sessionId: src_id|79e94e17-9b91e712-9b294c30-84336784_0
2025-09-30T14:59:24.527315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a36b4e-290800ac-ed89a209-80365e54_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|79e94e17-9b91e712-9b294c30-84336784_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:24.530036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79e94e17-9b91e712-9b294c30-84336784_0] Write session: try to update token
2025-09-30T14:59:24.530058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79e94e17-9b91e712-9b294c30-84336784_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:24.545862Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3220 sessionId: src_id|79e94e17-9b91e712-9b294c30-84336784_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:24.548474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:24.549126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.549158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.549177Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:24.549186Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:24.549196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897010979962632:12683]
2025-09-30T14:59:24.549251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:24.549258Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:24.549436Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:24.549582Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:24.549729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:24.549867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:24.550061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:24.550098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:24.550124Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:24.550216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:24.557275Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:24.557300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:24.557302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:24.557304Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:24.557315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897010979962632:12683]
2025-09-30T14:59:24.557320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897010979962632:12683]
2025-09-30T14:59:24.557325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897010979962632:12683]
2025-09-30T14:59:24.557368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:24.557375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.557378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:24.557378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:24.557385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:24.557390Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:24.557529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:24.604106Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897011069765882:4275]
2025-09-30T14:59:24.604405Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3219, pipe: [1:7555897011069765882:4275]
2025-09-30T14:59:24.675404Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:24.683990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.684022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.684201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:24.684259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:24.684333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:24.684398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:24.684444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:24.684449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:24.684525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:24.684604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:24.684677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:24.684747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:24.684791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:24.684794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:24.684870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:24.684933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:24.684997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:24.685062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:24.685106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:24.685109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:24.685183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:24.685257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:24.685366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:24.685435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:24.685482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:24.685485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:24.685556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:24.685617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:24.685685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:24.685745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:24.685788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:24.685791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:24.685862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:24.685929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:24.685995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:24.686067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:24.686119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:24.686126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:24.686204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:24.686263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:24.686338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:24.686402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:24.686446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:24.686449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:24.686518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:24.686580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:24.686644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:24.686720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:24.686761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:24.686764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:24.686835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:24.686894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:24.686957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:24.687019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:24.687060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:24.687062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:24.687132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:24.687194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:24.687506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:24.687582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:24.687648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:24.687657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:24.687782Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765882:4275], now have 1 active actors on pipe
2025-09-30T14:59:24.688240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897011069765882:4275]
2025-09-30T14:59:24.688273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:24.688320Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:24.688323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:24.688351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3220 reason: error at write: Disconnected sessionId: src_id|79e94e17-9b91e712-9b294c30-84336784_0
2025-09-30T14:59:24.688533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3220 sessionId: src_id|79e94e17-9b91e712-9b294c30-84336784_0 is DEAD
2025-09-30T14:59:24.688887Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:24.688975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79e94e17-9b91e712-9b294c30-84336784_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:24.688986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79e94e17-9b91e712-9b294c30-84336784_0] Write session will restart in 0.007874s
2025-09-30T14:59:24.689022Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79e94e17-9b91e712-9b294c30-84336784_0] Write session: Do CDS request
2025-09-30T14:59:24.689029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79e94e17-9b91e712-9b294c30-84336784_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:24.697778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79e94e17-9b91e712-9b294c30-84336784_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:24.697930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:24.697947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3221
2025-09-30T14:59:24.698174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3221 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:24.698211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3221 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:24.698231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3221 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:24.698236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:24.698777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3221 sessionId:  describe result for acl check
2025-09-30T14:59:24.698814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:24.698816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:24.698818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:24.698824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897011069765920:3973] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:24.699364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897011069765920:3973] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:24.702278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:24.704941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:24.705196Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:24.705201Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:24.705211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:24.705267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:24.705302Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897010979962727:12693]
2025-09-30T14:59:24.705894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:24.706254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:24.704084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897011069765920:3973] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:24.706330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:24.706722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:24.706798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.706804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.706806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.706807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.706808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.706809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.706811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.706812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.706813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.706816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.706817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.706819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.706820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.706821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.706822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.706827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.706837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.706840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.706844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.706849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.706854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.706859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.706863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.706868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.706874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.706879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.706884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.706889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.706893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.706896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.706903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.706911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.706917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.706924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.706928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.706935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.706940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.706945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.706950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.706956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.706961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.706967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.706975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.706988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.706993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.706999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.707004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.707009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.707014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.707020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.707025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.707035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.707040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.707046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.707051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.707057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.707068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.707073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.707083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.707089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.707138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:24.707313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897011069765920:3973] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:24.707330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897011069765920:3973] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:24.707333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897011069765920:3973] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:24.707340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3221 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:24.713118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:24.714145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:24.714163Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:24.714166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:24.714170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:24.714177Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3220 [2:7555897010979962727:12693]
2025-09-30T14:59:24.714192Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:24.714208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:24.714212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:24.714216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:24.714218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:24.714234Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:24.714241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:24.714247Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:24.714306Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.714314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.714317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.714320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:24.714322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:24.714491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3220
2025-09-30T14:59:24.714539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3220
2025-09-30T14:59:24.714401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:24.714411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.714425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.714437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.714455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:24.714475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765897:2454], now have 1 active actors on pipe
2025-09-30T14:59:24.714478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765961:3973], now have 1 active actors on pipe
2025-09-30T14:59:24.714485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897010979962722:12693]
2025-09-30T14:59:24.714487Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897010979962722:12693]
2025-09-30T14:59:24.714490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897010979962722:12693]
2025-09-30T14:59:24.714502Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:24.714514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:24.714516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:24.714518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:24.714521Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:24.714530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:24.714533Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:24.714572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897010979962722:12693]
2025-09-30T14:59:24.714582Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:24.714585Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:24.714594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.714599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.714652Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:24.714659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:24.714663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:24.714665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:24.714674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:24.714683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:24.714699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:24.714860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.714876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.714897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:24.714991Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3221 partition: 0 MaxSeqNo: 42 sessionId: src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0
2025-09-30T14:59:24.715592Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79e94e17-9b91e712-9b294c30-84336784_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:24.718347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0] Write session: try to update token
2025-09-30T14:59:24.718365Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:24.736744Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3221 sessionId: src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:24.737862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:24.737886Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:24.737888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:24.737890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:24.737899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897010979962722:12693]
2025-09-30T14:59:24.737904Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897010979962722:12693]
2025-09-30T14:59:24.737907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897010979962722:12693]
2025-09-30T14:59:24.737951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:24.737958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.737961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:24.737986Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:24.738012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:24.738016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:24.738100Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:24.739795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:24.788099Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897011069765979:4275]
2025-09-30T14:59:24.788343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3220, pipe: [1:7555897011069765979:4275]
2025-09-30T14:59:24.856252Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:24.857141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.857164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.857205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765979:4275], now have 1 active actors on pipe
2025-09-30T14:59:24.857590Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:24.857491Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:24.857505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:24.857561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3221 reason: error at write: Disconnected sessionId: src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0
2025-09-30T14:59:24.857566Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897011069765979:4275]
2025-09-30T14:59:24.857582Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:24.857721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3221 sessionId: src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0 is DEAD
2025-09-30T14:59:24.858058Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:24.858064Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0] Write session will restart in 0.007427s
2025-09-30T14:59:24.858083Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0] Write session: Do CDS request
2025-09-30T14:59:24.858087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:24.866263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:24.866874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:24.867275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:24.867290Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3222
2025-09-30T14:59:24.867430Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3222 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:24.867465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3222 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:24.867471Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3222 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:24.867475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:24.868142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3222 sessionId:  describe result for acl check
2025-09-30T14:59:24.868183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:24.868185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:24.868188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:24.868194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897011069766022:3951] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:24.868763Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897011069766022:3951] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:24.870815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897011069766022:3951] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:24.873041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:24.873292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:24.873311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:24.873325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:24.873418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:24.873469Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897010979962815:12701]
2025-09-30T14:59:24.873905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897011069766022:3951] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:24.873921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897011069766022:3951] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:24.873926Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897011069766022:3951] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:24.873935Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3222 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:24.874118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:24.874460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:24.874527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:24.874899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:24.874980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.874981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.874983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.874985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.874986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.874987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.874989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.874990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.874991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.874993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.874995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.874997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.874998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.874999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.875001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.875007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.875017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.875021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.875026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.875031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.875035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.875039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.875044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.875047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.875052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.875057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.875061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.875065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.875069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.875073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.875081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.875089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:24.875095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.875102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:24.875107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.875112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:24.875117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.875123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:24.875127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.875133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:24.875137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.875142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:24.875149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.875155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:24.875160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.875166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:24.875180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.875186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:24.875190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.875196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:24.875201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.875206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.875210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.875216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.875224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.875229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.875234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.875239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:24.875257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.875262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:24.875300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:24.880984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:24.882035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:24.882056Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:24.882059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:24.882064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:24.882072Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3221 [2:7555897010979962815:12701]
2025-09-30T14:59:24.882089Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:24.882106Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:24.882109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:24.882115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:24.882117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:24.882135Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:24.882147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:24.882156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:24.882231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.882238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.882240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.882242Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:24.882244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:24.882299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:24.882305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.882315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:24.882327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:24.882350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:24.882371Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897010979962809:12701]
2025-09-30T14:59:24.882377Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897010979962809:12701]
2025-09-30T14:59:24.882380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897010979962809:12701]
2025-09-30T14:59:24.882389Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:24.882404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:24.882424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:24.882430Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:24.882431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:24.882434Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:24.882436Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:24.882466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897010979962809:12701]
2025-09-30T14:59:24.882477Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:24.882491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069766058:3951], now have 1 active actors on pipe
2025-09-30T14:59:24.882493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:24.882500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069765994:2454], now have 1 active actors on pipe
2025-09-30T14:59:24.882543Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3221
2025-09-30T14:59:24.882541Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3221
2025-09-30T14:59:24.882666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.882681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.882719Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|452a603-41e4da4b-30580d5b-7edb8532_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:24.882731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:24.882735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:24.882737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:24.882752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:24.882768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:24.882910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:24.883134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:24.883147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:24.883178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:24.883299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3222 partition: 0 MaxSeqNo: 42 sessionId: src_id|452a603-41e4da4b-30580d5b-7edb8532_0
2025-09-30T14:59:24.883698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d5db55db-928b76d2-bc42c1fb-92fcb17_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|452a603-41e4da4b-30580d5b-7edb8532_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:24.886614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|452a603-41e4da4b-30580d5b-7edb8532_0] Write session: try to update token
2025-09-30T14:59:24.886638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|452a603-41e4da4b-30580d5b-7edb8532_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:24.895327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:24.895349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:24.895351Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:24.895354Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:24.895363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897010979962809:12701]
2025-09-30T14:59:24.895368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897010979962809:12701]
2025-09-30T14:59:24.895376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897010979962809:12701]
2025-09-30T14:59:24.895427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:24.895428Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:24.895433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:24.895437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:24.895441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:24.895444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:24.895584Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:24.906243Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3222 sessionId: src_id|452a603-41e4da4b-30580d5b-7edb8532_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:24.909209Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:24.957873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897011069766069:4275]
2025-09-30T14:59:24.958278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3221, pipe: [1:7555897011069766069:4275]
2025-09-30T14:59:25.011899Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:25.012306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.012324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.012345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897011069766069:4275], now have 1 active actors on pipe
2025-09-30T14:59:25.012594Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:25.012711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897011069766069:4275]
2025-09-30T14:59:25.012730Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:25.012736Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:25.012740Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:25.012801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3222 reason: error at write: Disconnected sessionId: src_id|452a603-41e4da4b-30580d5b-7edb8532_0
2025-09-30T14:59:25.013006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3222 sessionId: src_id|452a603-41e4da4b-30580d5b-7edb8532_0 is DEAD
2025-09-30T14:59:25.013162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452a603-41e4da4b-30580d5b-7edb8532_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:25.013173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452a603-41e4da4b-30580d5b-7edb8532_0] Write session will restart in 0.005301s
2025-09-30T14:59:25.013197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452a603-41e4da4b-30580d5b-7edb8532_0] Write session: Do CDS request
2025-09-30T14:59:25.013206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452a603-41e4da4b-30580d5b-7edb8532_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:25.021048Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|452a603-41e4da4b-30580d5b-7edb8532_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:25.021159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:25.021176Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3223
2025-09-30T14:59:25.021292Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3223 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:25.022187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:25.021329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3223 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:25.021341Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3223 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:25.021346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:25.021775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3223 sessionId:  describe result for acl check
2025-09-30T14:59:25.021803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:25.021805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:25.021807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:25.021813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897015364733393:3941] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:25.022349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897015364733393:3941] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:25.025125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897015364733393:3941] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:25.024357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:25.024622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:25.024626Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:25.024637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:25.024703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:25.024744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897015274930177:12703]
2025-09-30T14:59:25.025386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:25.025762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:25.025816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:25.026177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:25.026233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.026234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.026235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.026237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.026238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.026240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.026241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.026243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.026245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.026247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.026248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.026249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.026251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.026252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.026253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.026259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.026271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.026276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.026280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.026285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.026288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.026307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.026311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.026315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.026320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.026325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.026329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.026333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.026337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.026345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.026353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.026362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.026368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.026374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.026381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.026387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.026391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.026397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.026404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.026410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.026415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.026422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.026427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.026432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.026437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.026443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.026448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.026454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.026458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.026464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.026469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.026475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.026480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.026485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.026490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.026496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.026501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.026507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.026512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.026518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.026566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:25.031340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897015364733393:3941] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:25.031357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897015364733393:3941] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:25.031362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897015364733393:3941] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:25.031372Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3223 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:25.032600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:25.033689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:25.033700Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:25.033704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:25.033708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:25.033717Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3222 [2:7555897015274930177:12703]
2025-09-30T14:59:25.033736Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:25.033754Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:25.033761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:25.033765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:25.033767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:25.033789Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:25.033798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:25.033807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:25.033885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.033888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.033890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.033894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:25.033897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:25.034072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:25.034077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.034092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.034106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.034129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:25.034148Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897015274930171:12703]
2025-09-30T14:59:25.034153Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897015274930171:12703]
2025-09-30T14:59:25.034155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897015274930171:12703]
2025-09-30T14:59:25.034173Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:25.034190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:25.034206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:25.034209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:25.034253Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897015274930171:12703]
2025-09-30T14:59:25.034255Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:25.034417Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:25.034421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:25.034424Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:25.034431Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:25.034872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733432:3941], now have 1 active actors on pipe
2025-09-30T14:59:25.034877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733366:2454], now have 1 active actors on pipe
2025-09-30T14:59:25.035470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3222
2025-09-30T14:59:25.035503Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3222
2025-09-30T14:59:25.035616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.035642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.035676Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:25.035693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:25.035701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:25.035705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:25.035716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:25.035729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:25.035754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:25.036097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.036107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.036123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:25.036217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3223 partition: 0 MaxSeqNo: 42 sessionId: src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0
2025-09-30T14:59:25.036594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|452a603-41e4da4b-30580d5b-7edb8532_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:25.039483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0] Write session: try to update token
2025-09-30T14:59:25.039503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:25.049160Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:25.049185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:25.049187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:25.049189Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:25.049199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897015274930171:12703]
2025-09-30T14:59:25.049210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897015274930171:12703]
2025-09-30T14:59:25.049214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897015274930171:12703]
2025-09-30T14:59:25.049261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:25.049268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.049270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:25.049273Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:25.049281Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:25.049285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:25.049476Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:25.058789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3223 sessionId: src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:25.061705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:25.113003Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897015364733441:4275]
2025-09-30T14:59:25.119527Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3222, pipe: [1:7555897015364733441:4275]
2025-09-30T14:59:25.165667Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:25.166017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.166027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.166048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733441:4275], now have 1 active actors on pipe
2025-09-30T14:59:25.166325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:25.166771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:25.166793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0] Write session will restart in 0.008905s
2025-09-30T14:59:25.166816Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0] Write session: Do CDS request
2025-09-30T14:59:25.166822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:25.166377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:25.166391Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:25.166463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3223 reason: error at write: Disconnected sessionId: src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0
2025-09-30T14:59:25.166640Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3223 sessionId: src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0 is DEAD
2025-09-30T14:59:25.166771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897015364733441:4275]
2025-09-30T14:59:25.166789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:25.174860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:25.176828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:25.177081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:25.177305Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:25.177314Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:25.177325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:25.177382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:25.177424Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897015274930245:12706]
2025-09-30T14:59:25.178131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:25.178502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:25.178566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:25.178939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:25.179017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.179023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.179024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.179025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.179027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.179028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.179029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.179031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.179032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.179035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.179036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.179040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.179041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.179042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.179043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.179049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.179058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.179062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.179066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.179069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.179073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.179077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.179080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.179084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.179088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.179092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.179095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.179099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.179102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.179105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.179114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.179121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.179126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.179131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.179135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.179140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.179144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.179149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.179155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.176926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:25.176944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3224
2025-09-30T14:59:25.179159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.179166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.179172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.179177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.179181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.179185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.179189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.179193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.179197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.179201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.179206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.179210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.179214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.179220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.179225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.179229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.179234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.179238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.179256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.179261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.179266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.179309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:25.177086Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3224 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:25.177113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3224 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:25.177119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3224 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:25.177123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:25.177553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3224 sessionId:  describe result for acl check
2025-09-30T14:59:25.177580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:25.177582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:25.177584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:25.177591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897015364733471:3936] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:25.178117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897015364733471:3936] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:25.180936Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897015364733471:3936] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:25.184709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897015364733471:3936] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:25.184726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897015364733471:3936] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:25.184729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897015364733471:3936] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:25.184738Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3224 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:25.185235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:25.186135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:25.186157Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:25.186160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:25.186163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:25.186170Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3223 [2:7555897015274930245:12706]
2025-09-30T14:59:25.186185Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:25.186200Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:25.186205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:25.186208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:25.186210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:25.186227Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:25.186233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:25.186240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:25.186300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.186308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.186310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.186312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:25.186314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:25.186381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:25.186390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.186402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.186413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.186441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:25.186463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733509:3936], now have 1 active actors on pipe
2025-09-30T14:59:25.186471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733442:2454], now have 1 active actors on pipe
2025-09-30T14:59:25.186478Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897015274930240:12706]
2025-09-30T14:59:25.186480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897015274930240:12706]
2025-09-30T14:59:25.186484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897015274930240:12706]
2025-09-30T14:59:25.186495Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:25.186510Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:25.186513Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:25.186517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:25.186519Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:25.186524Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:25.186527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:25.186559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897015274930240:12706]
2025-09-30T14:59:25.186574Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:25.186556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3223
2025-09-30T14:59:25.186577Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3223
2025-09-30T14:59:25.186614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:25.186758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.186770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.186797Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:25.186808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:25.186811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:25.186813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:25.186824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:25.186845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:25.186864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:25.187110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.187119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.187132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:25.189692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3224 partition: 0 MaxSeqNo: 42 sessionId: src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0
2025-09-30T14:59:25.190169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|524e77ad-1b02cb9d-cfd8761f-55bfc630_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:25.193119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0] Write session: try to update token
2025-09-30T14:59:25.193142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:25.203427Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:25.203447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:25.203450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:25.203452Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:25.203463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897015274930240:12706]
2025-09-30T14:59:25.203470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897015274930240:12706]
2025-09-30T14:59:25.203474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897015274930240:12706]
2025-09-30T14:59:25.203519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:25.203526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.203529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:25.203529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:25.203546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:25.203551Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:25.203671Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:25.209260Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3224 sessionId: src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:25.211961Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:25.267202Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897015364733518:4275]
2025-09-30T14:59:25.267734Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3223, pipe: [1:7555897015364733518:4275]
2025-09-30T14:59:25.328672Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:25.329041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.329058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.329096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733518:4275], now have 1 active actors on pipe
2025-09-30T14:59:25.329340Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:25.330542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897015364733518:4275]
2025-09-30T14:59:25.330577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:25.330647Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3224 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0
2025-09-30T14:59:25.330813Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3224 sessionId: src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0 is DEAD
2025-09-30T14:59:25.330947Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:25.330986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:25.330998Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0] Write session will restart in 0.005992s
2025-09-30T14:59:25.331023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0] Write session: Do CDS request
2025-09-30T14:59:25.331029Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:25.337790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:25.337914Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:25.337931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3225
2025-09-30T14:59:25.338106Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3225 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:25.338149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3225 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:25.338155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3225 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:25.338159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:25.340398Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3225 sessionId:  describe result for acl check
2025-09-30T14:59:25.340443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:25.340446Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:25.340448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:25.340458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897015364733530:3929] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:25.341077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897015364733530:3929] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:25.344918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897015364733530:3929] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:25.356158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897015364733530:3929] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:25.356179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897015364733530:3929] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:25.356182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897015364733530:3929] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:25.356193Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3225 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:25.359106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:25.361135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:25.361339Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:25.361349Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:25.361359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:25.361409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:25.361453Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897015274930315:12708]
2025-09-30T14:59:25.362063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:25.362434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:25.362496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:25.362849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:25.362913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.362920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.362921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.362922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.362923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.362924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.362926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.362926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.362928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.362930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.362932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.362933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.362934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.362935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.362936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.362942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.362952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.362955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.362959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.362968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.362972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.362975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.362979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.362983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.362987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.362993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.362997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.363000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.363004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.363007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.363017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.363024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.363031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.363036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.363052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.363058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.363064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.363070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.363076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.363081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.363100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.363106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.363110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.363115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.363119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.363124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.363128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.363133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.363138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.363144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.363148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.363153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.363158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.363164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.363169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.363176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.363188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.363192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.363197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.363202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.363270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:25.371766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:25.372714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:25.372731Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:25.372736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:25.372741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:25.372752Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3224 [2:7555897015274930315:12708]
2025-09-30T14:59:25.372771Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:25.372787Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:25.372799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:25.372803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:25.372811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:25.372828Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:25.372841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:25.372853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:25.372922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.372936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.372937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.372941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:25.372944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:25.373023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:25.373030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.373046Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.373059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.373081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:25.373105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733523:2454], now have 1 active actors on pipe
2025-09-30T14:59:25.373114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733575:3929], now have 1 active actors on pipe
2025-09-30T14:59:25.373121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897015274930310:12708]
2025-09-30T14:59:25.373125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897015274930310:12708]
2025-09-30T14:59:25.373127Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897015274930310:12708]
2025-09-30T14:59:25.373140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:25.373156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:25.373160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:25.373161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:25.373162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:25.373177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:25.373179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:25.373215Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897015274930310:12708]
2025-09-30T14:59:25.373223Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:25.373229Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:25.373409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3224
2025-09-30T14:59:25.373465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3224
2025-09-30T14:59:25.373724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.373735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.373761Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:25.373772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:25.373782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:25.373784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:25.373793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:25.373804Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:25.373818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:25.374000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.374011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.374024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:25.374114Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3225 partition: 0 MaxSeqNo: 42 sessionId: src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0
2025-09-30T14:59:25.374529Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e3f975d-1fc8da30-bacf8f02-de730e0f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:25.377499Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0] Write session: try to update token
2025-09-30T14:59:25.377520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:25.387575Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:25.387599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:25.387611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897015274930310:12708]
2025-09-30T14:59:25.387662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:25.387881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:25.388064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:25.388240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:25.388374Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:25.388604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:25.388881Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:25.388928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:25.398327Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3225 sessionId: src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:25.401204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:25.402175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.402208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.402229Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:25.402233Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:25.402235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:25.402237Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:25.402246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897015274930310:12708]
2025-09-30T14:59:25.402251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897015274930310:12708]
2025-09-30T14:59:25.402256Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897015274930310:12708]
2025-09-30T14:59:25.402309Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:25.402308Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:25.402315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:25.402319Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:25.402322Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.402329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:25.402475Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:25.427943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897015364733606:4275]
2025-09-30T14:59:25.428363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3224, pipe: [1:7555897015364733606:4275]
2025-09-30T14:59:25.522168Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:25.522650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:25.522686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733606:4275], now have 1 active actors on pipe
2025-09-30T14:59:25.522856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:25.522989Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:25.522997Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:25.523092Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3225 reason: error at write: Disconnected sessionId: src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0
2025-09-30T14:59:25.523234Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:25.523287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3225 sessionId: src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0 is DEAD
2025-09-30T14:59:25.523301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897015364733606:4275]
2025-09-30T14:59:25.523662Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:25.523672Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0] Write session will restart in 0.008929s
2025-09-30T14:59:25.523697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0] Write session: Do CDS request
2025-09-30T14:59:25.523703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:25.533817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:25.533933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:25.533960Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3226
2025-09-30T14:59:25.534105Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3226 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:25.534141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3226 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:25.534146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3226 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:25.534151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:25.534659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3226 sessionId:  describe result for acl check
2025-09-30T14:59:25.534701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:25.534703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:25.534705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:25.534711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897015364733632:3902] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:25.535335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897015364733632:3902] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:25.539414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:25.540368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897015364733632:3902] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:25.541761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:25.542055Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:25.542073Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:25.542088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:25.542161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:25.542219Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897015274930395:12711]
2025-09-30T14:59:25.543070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:25.543857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897015364733632:3902] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:25.543875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897015364733632:3902] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:25.543879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897015364733632:3902] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:25.543889Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3226 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:25.544336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:25.544417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:25.544921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:25.545007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.545015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.545017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.545019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.545021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.545026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.545027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.545030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.545031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.545033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.545034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.545036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.545038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.545039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.545041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.545049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.545061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.545065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.545070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.545075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.545080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.545085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.545090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.545094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.545101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.545106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.545110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.545114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.545119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.545123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.545133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.545143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.545150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.545157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.545163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.545169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.545176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.545181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.545191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.545197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.545201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.545215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.545221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.545226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.545237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.545243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.545248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.545253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.545259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.545274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.545285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.545291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.545296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.545302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.545312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.545319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.545324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.545335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.545340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.545347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.545407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:25.552529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:25.553614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:25.553636Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:25.553639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:25.553643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:25.553651Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3225 [2:7555897015274930395:12711]
2025-09-30T14:59:25.553672Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:25.553702Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:25.553714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:25.553719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:25.553722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:25.553744Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:25.553754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:25.553774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:25.553865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.553875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.553878Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.553882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:25.553886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:25.553986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:25.554004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.554023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.554036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.554054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:25.554081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897015274930389:12711]
2025-09-30T14:59:25.554091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897015274930389:12711]
2025-09-30T14:59:25.554094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897015274930389:12711]
2025-09-30T14:59:25.554163Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3225
2025-09-30T14:59:25.554192Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3225
2025-09-30T14:59:25.554114Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:25.554142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733608:2454], now have 1 active actors on pipe
2025-09-30T14:59:25.554147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733677:3902], now have 1 active actors on pipe
2025-09-30T14:59:25.554148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:25.554152Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:25.554156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:25.554156Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:25.554183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:25.554187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:25.554239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897015274930389:12711]
2025-09-30T14:59:25.554242Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:25.554246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:25.554269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.554275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.554465Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:25.554480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:25.554484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:25.554490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:25.554505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:25.554521Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:25.554548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:25.554813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.554828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.554848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:25.554985Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3226 partition: 0 MaxSeqNo: 42 sessionId: src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0
2025-09-30T14:59:25.555436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4e5b373c-73a0f9c1-83427f14-f1567034_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:25.558310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0] Write session: try to update token
2025-09-30T14:59:25.558331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:25.568633Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:25.568659Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:25.568663Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:25.568665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:25.568677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897015274930389:12711]
2025-09-30T14:59:25.568683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897015274930389:12711]
2025-09-30T14:59:25.568689Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897015274930389:12711]
2025-09-30T14:59:25.568745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:25.568758Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.568763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:25.568765Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:25.568787Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:25.568794Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:25.568968Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:25.574757Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3226 sessionId: src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:25.577728Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:25.623474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897015364733686:4275]
2025-09-30T14:59:25.623914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3225, pipe: [1:7555897015364733686:4275]
2025-09-30T14:59:25.689719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:25.690089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.690110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.690152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733686:4275], now have 1 active actors on pipe
2025-09-30T14:59:25.690710Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:25.691472Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:25.691485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0] Write session will restart in 0.007962s
2025-09-30T14:59:25.691509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0] Write session: Do CDS request
2025-09-30T14:59:25.691516Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:25.690489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:25.690548Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897015364733686:4275]
2025-09-30T14:59:25.690568Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:25.690571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:25.690653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3226 reason: error at write: Disconnected sessionId: src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0
2025-09-30T14:59:25.690836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3226 sessionId: src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0 is DEAD
2025-09-30T14:59:25.703712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:25.704548Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:25.704570Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3227
2025-09-30T14:59:25.707530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3227 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:25.707597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3227 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:25.707603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3227 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:25.707608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:25.708091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3227 sessionId:  describe result for acl check
2025-09-30T14:59:25.708123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:25.708125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:25.708127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:25.708132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897015364733720:3899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:25.708743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897015364733720:3899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:25.709585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:25.710988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:25.711311Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:25.711334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897015364733720:3899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:25.711328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:25.711341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:25.711411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:25.711466Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897015274930467:12714]
2025-09-30T14:59:25.712181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:25.713085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:25.713182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:25.713697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:25.713811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.713822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.713824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.713826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.713827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.713829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.713831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.713832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.713835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.713837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.713839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.713840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.713842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.713844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.713845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.713854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.713868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.713874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.713879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.713884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.713889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.713895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.713899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.713904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.713911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.713916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.713921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.713925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.713932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.713937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.713947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.713959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.713968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.713974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.713980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.713987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.713993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.713999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.714005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.714014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.714019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.714024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.714030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.714035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.714040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.714046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.714052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.714058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.714062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.714069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.714075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.714080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.714084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.714089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.714094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.714102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.714107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.714111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.714116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.714121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.714169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:25.721073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:25.722183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:25.722203Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:25.722207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:25.722215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:25.722224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3226 [2:7555897015274930467:12714]
2025-09-30T14:59:25.722245Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:25.722267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:25.722272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:25.722275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:25.722284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:25.722311Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:25.722319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:25.722332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:25.722414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.722416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.722418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.722422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:25.722426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:25.722523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:25.722526Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.722543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.722556Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.722576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:25.722598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897015274930462:12714]
2025-09-30T14:59:25.722600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897015274930462:12714]
2025-09-30T14:59:25.722602Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897015274930462:12714]
2025-09-30T14:59:25.722613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:25.722626Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:25.722632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:25.722635Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:25.722637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:25.722651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:25.722654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:25.722670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733687:2454], now have 1 active actors on pipe
2025-09-30T14:59:25.722729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897015274930462:12714]
2025-09-30T14:59:25.722739Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:25.722748Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:25.731602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3226
2025-09-30T14:59:25.732126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897015364733720:3899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:25.732137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897015364733720:3899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:25.732144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897015364733720:3899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:25.732153Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3227 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:25.733134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3226
2025-09-30T14:59:25.733066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733776:3899], now have 1 active actors on pipe
2025-09-30T14:59:25.733299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.733328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.733360Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|75579d6c-c7d57584-3f806aba-59408195_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:25.733374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:25.733379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:25.733383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:25.733404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:25.733421Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:25.733440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:25.740089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.740112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.740154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:25.742463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3227 partition: 0 MaxSeqNo: 42 sessionId: src_id|75579d6c-c7d57584-3f806aba-59408195_0
2025-09-30T14:59:25.744974Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2a921ba-d663b32b-e5a4da0b-e71b6d54_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|75579d6c-c7d57584-3f806aba-59408195_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:25.747806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:25.747828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:25.747831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:25.747833Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:25.747842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897015274930462:12714]
2025-09-30T14:59:25.747846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897015274930462:12714]
2025-09-30T14:59:25.747864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897015274930462:12714]
2025-09-30T14:59:25.747905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:25.747911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.747914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:25.747917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:25.747936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:25.747940Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:25.748121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75579d6c-c7d57584-3f806aba-59408195_0] Write session: try to update token
2025-09-30T14:59:25.748144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75579d6c-c7d57584-3f806aba-59408195_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:25.748047Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:25.790396Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897015364733789:4275]
2025-09-30T14:59:25.790593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3226, pipe: [1:7555897015364733789:4275]
2025-09-30T14:59:25.792628Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3227 sessionId: src_id|75579d6c-c7d57584-3f806aba-59408195_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:25.795370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:25.867213Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:25.867633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733789:4275], now have 1 active actors on pipe
2025-09-30T14:59:25.867664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.867671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.868131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:25.868362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897015364733789:4275]
2025-09-30T14:59:25.868400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:25.868402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:25.868457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3227 reason: error at write: Disconnected sessionId: src_id|75579d6c-c7d57584-3f806aba-59408195_0
2025-09-30T14:59:25.868650Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3227 sessionId: src_id|75579d6c-c7d57584-3f806aba-59408195_0 is DEAD
2025-09-30T14:59:25.868778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:25.870311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75579d6c-c7d57584-3f806aba-59408195_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:25.870321Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75579d6c-c7d57584-3f806aba-59408195_0] Write session will restart in 0.009163s
2025-09-30T14:59:25.870344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75579d6c-c7d57584-3f806aba-59408195_0] Write session: Do CDS request
2025-09-30T14:59:25.870353Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75579d6c-c7d57584-3f806aba-59408195_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:25.883789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|75579d6c-c7d57584-3f806aba-59408195_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:25.885711Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:25.885726Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3228
2025-09-30T14:59:25.885927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3228 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:25.885959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3228 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:25.885968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3228 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:25.885973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:25.886617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3228 sessionId:  describe result for acl check
2025-09-30T14:59:25.886656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:25.886663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:25.886665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:25.886672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897015364733837:3869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:25.887210Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897015364733837:3869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:25.889958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897015364733837:3869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:25.892580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:25.895684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897015364733837:3869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:25.895703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897015364733837:3869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:25.895706Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897015364733837:3869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:25.895727Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3228 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:25.895943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:25.896177Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:25.896182Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:25.896193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:25.896254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:25.896288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897015274930574:12728]
2025-09-30T14:59:25.897179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:25.897643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:25.897723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:25.898154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:25.898263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.898275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.898276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.898277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.898279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.898280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.898282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.898284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.898285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.898286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.898288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.898289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.898290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.898291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.898293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.898300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.898311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.898316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.898320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.898324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.898328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.898332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.898336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.898344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.898350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.898354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.898358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.898361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.898366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.898370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.898381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.898389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:25.898399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.898405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:25.898418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.898424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:25.898434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.898440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:25.898450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.898456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:25.898464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.898474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:25.898479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.898484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:25.898494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.898499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:25.898505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.898519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:25.898524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.898530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:25.898536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.898542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.898547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.898553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.898566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.898574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.898580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.898591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:25.898595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.898600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:25.898652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:25.906458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:25.907540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:25.907561Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:25.907564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:25.907568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:25.907576Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3227 [2:7555897015274930574:12728]
2025-09-30T14:59:25.907595Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:25.907614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:25.907618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:25.907621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:25.907624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:25.907643Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:25.907650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:25.907656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:25.907725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.907739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.907743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.907747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:25.907749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:25.907823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:25.907832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.907847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:25.907864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:25.907888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:25.907910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897015274930569:12728]
2025-09-30T14:59:25.907917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897015274930569:12728]
2025-09-30T14:59:25.907920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897015274930569:12728]
2025-09-30T14:59:25.907934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:25.907952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:25.907972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:25.907983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:25.908031Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897015274930569:12728]
2025-09-30T14:59:25.908039Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:25.908071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733873:3869], now have 1 active actors on pipe
2025-09-30T14:59:25.908083Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733804:2454], now have 1 active actors on pipe
2025-09-30T14:59:25.908100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:25.908112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:25.908115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:25.908122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:25.908826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3227
2025-09-30T14:59:25.908863Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3227
2025-09-30T14:59:25.909130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.909154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.909181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ccac489-93a090c6-a00a4949-add1e90b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:25.909195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:25.909204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:25.909207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:25.909230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:25.909242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:25.909263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:25.909692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:25.909704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:25.909731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:25.909989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3228 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ccac489-93a090c6-a00a4949-add1e90b_0
2025-09-30T14:59:25.910422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|75579d6c-c7d57584-3f806aba-59408195_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ccac489-93a090c6-a00a4949-add1e90b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:25.913136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccac489-93a090c6-a00a4949-add1e90b_0] Write session: try to update token
2025-09-30T14:59:25.913153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccac489-93a090c6-a00a4949-add1e90b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:25.923080Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:25.923107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:25.923109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:25.923111Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:25.923121Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897015274930569:12728]
2025-09-30T14:59:25.923126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897015274930569:12728]
2025-09-30T14:59:25.923130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897015274930569:12728]
2025-09-30T14:59:25.923176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:25.923184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:25.923186Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:25.923190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:25.923194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:25.923199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:25.923359Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:25.929801Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3228 sessionId: src_id|8ccac489-93a090c6-a00a4949-add1e90b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:25.932504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:25.968611Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897015364733885:4275]
2025-09-30T14:59:25.969034Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3227, pipe: [1:7555897015364733885:4275]
2025-09-30T14:59:26.047060Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:26.047623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.047643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.047683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897015364733885:4275], now have 1 active actors on pipe
2025-09-30T14:59:26.047929Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:26.048198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:26.048214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:26.048282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3228 reason: error at write: Disconnected sessionId: src_id|8ccac489-93a090c6-a00a4949-add1e90b_0
2025-09-30T14:59:26.048452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3228 sessionId: src_id|8ccac489-93a090c6-a00a4949-add1e90b_0 is DEAD
2025-09-30T14:59:26.048648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897015364733885:4275]
2025-09-30T14:59:26.048668Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:26.048979Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccac489-93a090c6-a00a4949-add1e90b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:26.048991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccac489-93a090c6-a00a4949-add1e90b_0] Write session will restart in 0.007896s
2025-09-30T14:59:26.049026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccac489-93a090c6-a00a4949-add1e90b_0] Write session: Do CDS request
2025-09-30T14:59:26.049035Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccac489-93a090c6-a00a4949-add1e90b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:26.057817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccac489-93a090c6-a00a4949-add1e90b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:26.057880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:26.057900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3229
2025-09-30T14:59:26.058061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3229 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:26.058104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3229 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:26.058109Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3229 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:26.058113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:26.058297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:26.058537Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3229 sessionId:  describe result for acl check
2025-09-30T14:59:26.058568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:26.058575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:26.058577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:26.058582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897019659701217:3860] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:26.059108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897019659701217:3860] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:26.060179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:26.060378Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:26.060389Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:26.060400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:26.060449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:26.060484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897019569897942:12730]
2025-09-30T14:59:26.061216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:26.061391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897019659701217:3860] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:26.061524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:26.061601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:26.061953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:26.062012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.062021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.062022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.062023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.062025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.062026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.062028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.062029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.062031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.062032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.062033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.062035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.062038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.062039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.062041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.062046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.062057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.062061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.062066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.062070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.062075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.062079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.062084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.062088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.062094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.062098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.062102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.062106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.062110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.062114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.062121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.062130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.062135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.062141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.062147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.062153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.062158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.062164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.062169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.062175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.062179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.062185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.062197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.062204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.062208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.062214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.062220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.062226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.062231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.062236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.062241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.062246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.062251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.062256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.062261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.062267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.062274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.062280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.062285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.062303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.062350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:26.067860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:26.067737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897019659701217:3860] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:26.067759Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897019659701217:3860] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:26.067762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897019659701217:3860] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:26.067771Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3229 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:26.068726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:26.068746Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:26.068749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:26.068753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:26.068760Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3228 [2:7555897019569897942:12730]
2025-09-30T14:59:26.068778Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:26.068793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:26.068797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:26.068800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:26.068803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:26.068818Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:26.068833Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:26.068845Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:26.068899Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.068907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.068909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.068912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:26.068915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:26.068981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:26.068991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.069004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.069023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.069047Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:26.069069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701183:2454], now have 1 active actors on pipe
2025-09-30T14:59:26.069076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701255:3860], now have 1 active actors on pipe
2025-09-30T14:59:26.069082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897019569897937:12730]
2025-09-30T14:59:26.069084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897019569897937:12730]
2025-09-30T14:59:26.069086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897019569897937:12730]
2025-09-30T14:59:26.069097Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:26.069110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:26.069112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:26.069116Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:26.069118Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:26.069126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:26.069128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:26.069159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897019569897937:12730]
2025-09-30T14:59:26.069167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:26.069179Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:26.069140Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3228
2025-09-30T14:59:26.069155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3228
2025-09-30T14:59:26.069200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.069209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.069245Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:26.069258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:26.069262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:26.069264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:26.069273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:26.069282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:26.069295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:26.069493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.069501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.069513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:26.069634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3229 partition: 0 MaxSeqNo: 42 sessionId: src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0
2025-09-30T14:59:26.070298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ccac489-93a090c6-a00a4949-add1e90b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:26.073125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0] Write session: try to update token
2025-09-30T14:59:26.073140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:26.081976Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:26.082002Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:26.082005Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:26.082008Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:26.082017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897019569897937:12730]
2025-09-30T14:59:26.082022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897019569897937:12730]
2025-09-30T14:59:26.082027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897019569897937:12730]
2025-09-30T14:59:26.082067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:26.082074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.082072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:26.082077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:26.082080Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:26.082084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:26.082225Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:26.101589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3229 sessionId: src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:26.104641Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:26.148784Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897019659701266:4275]
2025-09-30T14:59:26.149326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3228, pipe: [1:7555897019659701266:4275]
2025-09-30T14:59:26.208048Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:26.208490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.208519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.208560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701266:4275], now have 1 active actors on pipe
2025-09-30T14:59:26.209149Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897019659701266:4275]
2025-09-30T14:59:26.209169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:26.209183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:26.209185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:26.209257Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3229 reason: error at write: Disconnected sessionId: src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0
2025-09-30T14:59:26.209092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:26.209460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3229 sessionId: src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0 is DEAD
2025-09-30T14:59:26.210650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:26.210663Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0] Write session will restart in 0.007372s
2025-09-30T14:59:26.210686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0] Write session: Do CDS request
2025-09-30T14:59:26.210692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:26.219876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:26.221590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:26.223743Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:26.223759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3230
2025-09-30T14:59:26.224017Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3230 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:26.224051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3230 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:26.224061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3230 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:26.224065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:26.223857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:26.224109Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:26.224115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:26.224126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:26.224187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:26.224224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897019569898018:12733]
2025-09-30T14:59:26.224957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:26.225359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:26.225424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:26.224580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3230 sessionId:  describe result for acl check
2025-09-30T14:59:26.224619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:26.224621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:26.224623Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:26.224629Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897019659701303:3850] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:26.225203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897019659701303:3850] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:26.225801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:26.225867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.225874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.225876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.225877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.225879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.225880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.225882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.225883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.225885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.225886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.225887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.225889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.225890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.225892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.225893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.225899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.225910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.225914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.225919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.225925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.225930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.225934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.225938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.225943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.225947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.225951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.225955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.225959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.225963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.225967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.225976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.225986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.225992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.225998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.226004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.226010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.226015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.226020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.226026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.226032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.226036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.226042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.226048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.226068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.226072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.226080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.226085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.226090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.226095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.226100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.226105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.226110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.226114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.226119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.226124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.226129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.226133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.226138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.226143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.226148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.226196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:26.228495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897019659701303:3850] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:26.232819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:26.233814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:26.233821Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:26.233824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:26.233828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:26.233836Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3229 [2:7555897019569898018:12733]
2025-09-30T14:59:26.233854Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:26.233870Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:26.233874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:26.233877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:26.233880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:26.233897Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:26.233904Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:26.233912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:26.233987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.233990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.233992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.233996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:26.233999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:26.234077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:26.234080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.234094Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.234107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.234126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:26.234145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701341:3850], now have 1 active actors on pipe
2025-09-30T14:59:26.234149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701268:2454], now have 1 active actors on pipe
2025-09-30T14:59:26.234159Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897019569898013:12733]
2025-09-30T14:59:26.234161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897019569898013:12733]
2025-09-30T14:59:26.234164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897019569898013:12733]
2025-09-30T14:59:26.234178Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:26.234193Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:26.234196Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:26.234197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:26.234199Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:26.234212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:26.234216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:26.234254Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897019569898013:12733]
2025-09-30T14:59:26.234257Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:26.234261Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:26.234275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.234279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.234329Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:26.234337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:26.234340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:26.234342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:26.234353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:26.234362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:26.234384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:26.234823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.234841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.234861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:26.232385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897019659701303:3850] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:26.232407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897019659701303:3850] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:26.232410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897019659701303:3850] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:26.232421Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3230 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:26.234211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3229
2025-09-30T14:59:26.234219Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3229
2025-09-30T14:59:26.234989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3230 partition: 0 MaxSeqNo: 42 sessionId: src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0
2025-09-30T14:59:26.235455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ee4d1f5-4eab5313-cfa871b5-fbd4af26_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:26.238448Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0] Write session: try to update token
2025-09-30T14:59:26.238471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:26.255445Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:26.255468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:26.255470Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:26.255473Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:26.255483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897019569898013:12733]
2025-09-30T14:59:26.255488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897019569898013:12733]
2025-09-30T14:59:26.255495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897019569898013:12733]
2025-09-30T14:59:26.255537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:26.255544Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.255547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:26.255566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:26.255588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:26.255597Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:26.255703Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:26.261312Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3230 sessionId: src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:26.264204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:26.309066Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897019659701348:4275]
2025-09-30T14:59:26.309503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3229, pipe: [1:7555897019659701348:4275]
2025-09-30T14:59:26.372575Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:26.373047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.373058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.373096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701348:4275], now have 1 active actors on pipe
2025-09-30T14:59:26.373353Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:26.373389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:26.373426Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897019659701348:4275]
2025-09-30T14:59:26.373448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:26.373450Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:26.373523Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3230 reason: error at write: Disconnected sessionId: src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0
2025-09-30T14:59:26.373705Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3230 sessionId: src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0 is DEAD
2025-09-30T14:59:26.374109Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:26.374121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0] Write session will restart in 0.006119s
2025-09-30T14:59:26.374145Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0] Write session: Do CDS request
2025-09-30T14:59:26.374156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:26.381837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:26.381987Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:26.382003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3231
2025-09-30T14:59:26.382167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3231 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:26.382209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3231 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:26.382216Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3231 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:26.382222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:26.382720Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3231 sessionId:  describe result for acl check
2025-09-30T14:59:26.382760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:26.382767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:26.382769Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:26.382775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897019659701390:3836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:26.383350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897019659701390:3836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:26.383851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:26.386309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897019659701390:3836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:26.388399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:26.388644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:26.388658Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:26.388670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:26.388733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:26.388777Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897019569898092:12735]
2025-09-30T14:59:26.389259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897019659701390:3836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:26.389273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897019659701390:3836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:26.389276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897019659701390:3836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:26.389285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3231 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:26.389431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:26.389765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:26.389820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:26.390133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:26.390211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.390217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.390219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.390220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.390221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.390222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.390223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.390224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.390225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.390226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.390227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.390228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.390229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.390230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.390231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.390236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.390248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.390253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.390257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.390260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.390264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.390267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.390273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.390277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.390281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.390285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.390289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.390292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.390297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.390300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.390309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.390317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.390323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.390328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.390332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.390336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.390341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.390346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.390351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.390355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.390361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.390367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.390372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.390377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.390381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.390386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.390405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.390410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.390415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.390420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.390426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.390431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.390435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.390440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.390444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.390449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.390453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.390459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.390464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.390468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.390510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:26.396671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:26.397531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:26.397571Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:26.397575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:26.397580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:26.397587Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3230 [2:7555897019569898092:12735]
2025-09-30T14:59:26.397604Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:26.397625Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:26.397633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:26.397636Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:26.397639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:26.397654Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:26.397661Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:26.397668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:26.397733Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.397745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.397747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.397751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:26.397754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:26.397824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:26.397833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.397848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.397863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.397884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:26.397908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701354:2454], now have 1 active actors on pipe
2025-09-30T14:59:26.397918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701426:3836], now have 1 active actors on pipe
2025-09-30T14:59:26.397925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897019569898085:12735]
2025-09-30T14:59:26.397927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897019569898085:12735]
2025-09-30T14:59:26.397928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897019569898085:12735]
2025-09-30T14:59:26.397941Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:26.397961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:26.397969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:26.397973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:26.397976Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:26.397983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:26.397986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:26.398020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897019569898085:12735]
2025-09-30T14:59:26.398035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:26.398069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:26.398003Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3230
2025-09-30T14:59:26.398061Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3230
2025-09-30T14:59:26.398202Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.398211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.398238Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:26.398269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:26.398277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:26.398279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:26.398299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:26.398313Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:26.398326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:26.398535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.398545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.398559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:26.398678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3231 partition: 0 MaxSeqNo: 42 sessionId: src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0
2025-09-30T14:59:26.399039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f1387679-de02ff05-2ed40dbe-d750ea06_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:26.401970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0] Write session: try to update token
2025-09-30T14:59:26.401990Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:26.412409Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:26.412442Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:26.412445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:26.412447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:26.412458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897019569898085:12735]
2025-09-30T14:59:26.412466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897019569898085:12735]
2025-09-30T14:59:26.412470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897019569898085:12735]
2025-09-30T14:59:26.412515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:26.412522Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.412525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:26.412553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:26.412571Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:26.412577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:26.412697Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:26.418369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3231 sessionId: src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:26.421306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:26.473392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897019659701440:4275]
2025-09-30T14:59:26.473947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3230, pipe: [1:7555897019659701440:4275]
2025-09-30T14:59:26.534249Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:26.534660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.534677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.534713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701440:4275], now have 1 active actors on pipe
2025-09-30T14:59:26.534980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:26.535052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897019659701440:4275]
2025-09-30T14:59:26.535096Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:26.535099Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:26.535275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3231 reason: error at write: Disconnected sessionId: src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0
2025-09-30T14:59:26.535337Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:26.535573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:26.535582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0] Write session will restart in 0.007340s
2025-09-30T14:59:26.535605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0] Write session: Do CDS request
2025-09-30T14:59:26.535611Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:26.535435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3231 sessionId: src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0 is DEAD
2025-09-30T14:59:26.547187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:26.547732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:26.547858Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:26.547875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3232
2025-09-30T14:59:26.547982Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3232 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:26.548013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3232 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:26.548022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3232 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:26.548034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:26.548866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3232 sessionId:  describe result for acl check
2025-09-30T14:59:26.548909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:26.548914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:26.548916Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:26.548923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897019659701480:3827] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:26.548935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:26.549142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:26.549153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:26.549163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:26.549219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:26.549260Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897019569898179:12738]
2025-09-30T14:59:26.549454Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897019659701480:3827] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:26.549927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:26.550211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:26.550261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:26.550607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:26.550672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.550678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.550679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.550680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.550682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.550683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.550684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.550685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.550687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.550688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.550689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.550690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.550692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.550693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.550694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.550700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.550710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.550714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.550718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.550722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.550726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.550729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.550734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.550738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.550743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.550747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.550752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.550756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.550760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.550764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.550772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.550779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.550785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.550791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.550797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.550802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.550806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.550810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.550817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.550829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.550834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.550839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.550844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.550850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.550855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.550859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.550865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.550875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.550880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.550890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.550895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.550904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.550909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.550915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.550924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.550929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.550933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.550938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.550943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.550948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.550992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:26.551600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897019659701480:3827] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:26.556188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897019659701480:3827] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:26.556205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897019659701480:3827] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:26.556209Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897019659701480:3827] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:26.556218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3232 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:26.556549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:26.557470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:26.557489Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:26.557493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:26.557496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:26.557503Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3231 [2:7555897019569898179:12738]
2025-09-30T14:59:26.557520Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:26.557535Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:26.557542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:26.557545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:26.557547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:26.557564Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:26.557570Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:26.557577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:26.557633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.557641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.557643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.557646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:26.557649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:26.557712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:26.557719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.557732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.557748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.557768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:26.557789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897019569898174:12738]
2025-09-30T14:59:26.557798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897019569898174:12738]
2025-09-30T14:59:26.557801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897019569898174:12738]
2025-09-30T14:59:26.557812Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:26.557822Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:26.557824Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:26.557827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701518:3827], now have 1 active actors on pipe
2025-09-30T14:59:26.557827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:26.557831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701441:2454], now have 1 active actors on pipe
2025-09-30T14:59:26.557837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:26.557851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:26.557854Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:26.557883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897019569898174:12738]
2025-09-30T14:59:26.557889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:26.557894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:26.557888Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3231
2025-09-30T14:59:26.557892Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3231
2025-09-30T14:59:26.558051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.558063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.558088Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:26.558101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:26.558104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:26.558111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:26.558121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:26.558130Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:26.558142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:26.558291Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.558308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.558330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:26.558417Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3232 partition: 0 MaxSeqNo: 42 sessionId: src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0
2025-09-30T14:59:26.558806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4a4c9e5e-3dd05187-d42a7d97-2a407dff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:26.561455Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0] Write session: try to update token
2025-09-30T14:59:26.561471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:26.570787Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:26.570811Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:26.570814Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:26.570816Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:26.570828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897019569898174:12738]
2025-09-30T14:59:26.570833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897019569898174:12738]
2025-09-30T14:59:26.570842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897019569898174:12738]
2025-09-30T14:59:26.570880Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:26.570887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.570888Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:26.570890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:26.570895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:26.570899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:26.571031Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:26.577228Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3232 sessionId: src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:26.579943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:26.635400Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897019659701525:4275]
2025-09-30T14:59:26.635648Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3231, pipe: [1:7555897019659701525:4275]
2025-09-30T14:59:26.707084Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:26.708892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.708919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.708975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701525:4275], now have 1 active actors on pipe
2025-09-30T14:59:26.709297Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:26.709311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:26.709336Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:26.709376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897019659701525:4275]
2025-09-30T14:59:26.709382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3232 reason: error at write: Disconnected sessionId: src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0
2025-09-30T14:59:26.709617Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:26.709774Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:26.709786Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0] Write session will restart in 0.006055s
2025-09-30T14:59:26.709815Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0] Write session: Do CDS request
2025-09-30T14:59:26.709822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:26.709589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3232 sessionId: src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0 is DEAD
2025-09-30T14:59:26.717779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:26.717839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:26.717918Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:26.717934Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3233
2025-09-30T14:59:26.718078Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3233 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:26.718119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3233 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:26.718129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3233 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:26.718133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:26.718578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3233 sessionId:  describe result for acl check
2025-09-30T14:59:26.718620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:26.718622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:26.718624Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:26.718631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897019659701565:3819] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:26.719188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897019659701565:3819] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:26.719691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:26.719923Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:26.719945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:26.719960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:26.720028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:26.720090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897019569898257:12741]
2025-09-30T14:59:26.720768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:26.721072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:26.721049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897019659701565:3819] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:26.721138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:26.721459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:26.721521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.721527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.721528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.721531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.721532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.721533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.721534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.721535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.721537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.721538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.721539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.721540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.721541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.721542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.721544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.721549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.721559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.721563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.721568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.721572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.721577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.721581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.721585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.721589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.721606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.721609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.721613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.721617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.721621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.721625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.721634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.721641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.721647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.721653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.721659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.721664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.721668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.721674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.721679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.721693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.721698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.721703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.721708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.721713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.721717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.721722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.721728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.721734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.721738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.721744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.721749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.721755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.721759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.721765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.721769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.721774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.721779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.721783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.721788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.721793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.721838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:26.726755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897019659701565:3819] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:26.726770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897019659701565:3819] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:26.726773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897019659701565:3819] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:26.726782Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3233 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:26.727081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:26.727982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:26.728000Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:26.728003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:26.728007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:26.728014Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3232 [2:7555897019569898257:12741]
2025-09-30T14:59:26.728032Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:26.728046Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:26.728055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:26.728058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:26.728060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:26.728075Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:26.728086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:26.728092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:26.728154Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.728161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.728163Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.728167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:26.728170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:26.728231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:26.728239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.728252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.728266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.728292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:26.728313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701604:3819], now have 1 active actors on pipe
2025-09-30T14:59:26.728322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701527:2454], now have 1 active actors on pipe
2025-09-30T14:59:26.728328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897019569898251:12741]
2025-09-30T14:59:26.728331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897019569898251:12741]
2025-09-30T14:59:26.728333Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897019569898251:12741]
2025-09-30T14:59:26.728344Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:26.728359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:26.728363Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:26.728365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:26.728366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:26.728383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:26.728362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3232
2025-09-30T14:59:26.728386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:26.728372Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3232
2025-09-30T14:59:26.728428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.728438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.728449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897019569898251:12741]
2025-09-30T14:59:26.728461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:26.728467Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:26.728490Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|642e200b-2a01db3-e28d9b29-5feb989b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:26.728501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:26.728505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:26.728507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:26.728516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:26.728537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:26.728562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:26.728736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.728744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.728756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:26.728866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3233 partition: 0 MaxSeqNo: 42 sessionId: src_id|642e200b-2a01db3-e28d9b29-5feb989b_0
2025-09-30T14:59:26.729260Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2fbc219f-9fdeb90c-d8ab5794-30d05158_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|642e200b-2a01db3-e28d9b29-5feb989b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:26.732038Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|642e200b-2a01db3-e28d9b29-5feb989b_0] Write session: try to update token
2025-09-30T14:59:26.732058Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|642e200b-2a01db3-e28d9b29-5feb989b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:26.740708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:26.740731Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:26.740733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:26.740735Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:26.740745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897019569898251:12741]
2025-09-30T14:59:26.740749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897019569898251:12741]
2025-09-30T14:59:26.740754Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897019569898251:12741]
2025-09-30T14:59:26.740794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:26.740797Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:26.740805Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:26.740807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.740808Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:26.740812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:26.740951Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:26.751027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3233 sessionId: src_id|642e200b-2a01db3-e28d9b29-5feb989b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:26.753875Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:26.809799Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897019659701635:4275]
2025-09-30T14:59:26.810097Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3232, pipe: [1:7555897019659701635:4275]
2025-09-30T14:59:26.859734Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:26.860086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.860102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.860122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701635:4275], now have 1 active actors on pipe
2025-09-30T14:59:26.860483Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897019659701635:4275]
2025-09-30T14:59:26.860518Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:26.860520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:26.861377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642e200b-2a01db3-e28d9b29-5feb989b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:26.861387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642e200b-2a01db3-e28d9b29-5feb989b_0] Write session will restart in 0.007837s
2025-09-30T14:59:26.861423Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642e200b-2a01db3-e28d9b29-5feb989b_0] Write session: Do CDS request
2025-09-30T14:59:26.861429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642e200b-2a01db3-e28d9b29-5feb989b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:26.861012Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:26.861087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3233 reason: status is not ok: tablet will be restarted right now sessionId: src_id|642e200b-2a01db3-e28d9b29-5feb989b_0
2025-09-30T14:59:26.861258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3233 sessionId: src_id|642e200b-2a01db3-e28d9b29-5feb989b_0 is DEAD
2025-09-30T14:59:26.870126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:26.870754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|642e200b-2a01db3-e28d9b29-5feb989b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:26.870873Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:26.870887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3234
2025-09-30T14:59:26.871045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3234 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:26.871096Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3234 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:26.871105Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3234 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:26.871110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:26.871566Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3234 sessionId:  describe result for acl check
2025-09-30T14:59:26.871602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:26.871611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:26.871613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:26.871619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897019659701687:3773] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:26.872025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:26.872169Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897019659701687:3773] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:26.872229Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:26.872239Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:26.872250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:26.872311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:26.872361Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897019569898370:12755]
2025-09-30T14:59:26.872994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:26.873644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:26.873699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:26.874077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:26.874142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.874148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.874149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.874150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.874151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.874153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.874154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.874155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.874157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.874158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.874159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.874161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.874162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.874163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.874165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.874171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.874182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.874186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.874190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.874193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.874197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.874200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.874204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.874207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.874211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.874214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.874218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.874221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.874225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.874228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.874235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.874242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:26.874248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.874254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:26.874258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.874262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:26.874266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.874271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:26.874275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.874279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:26.874283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.874288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:26.874293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.874297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:26.874309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.874314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:26.874318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.874328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:26.874332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.874336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:26.874357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.874367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.874366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897019659701687:3773] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:26.874371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.874376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.874381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.874386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.874390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.874395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:26.874399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.874404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:26.874457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:26.879886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:26.879949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897019659701687:3773] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:26.879965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897019659701687:3773] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:26.879971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897019659701687:3773] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:26.879979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3234 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:26.880747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:26.880764Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:26.880767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:26.880771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:26.880778Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3233 [2:7555897019569898370:12755]
2025-09-30T14:59:26.880794Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:26.880807Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:26.880815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:26.880818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:26.880821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:26.880836Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:26.880844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:26.880850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:26.880910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.880918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.880920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.880924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:26.880926Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:26.880989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:26.880997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.881009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:26.881026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:26.881048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:26.881070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701648:2454], now have 1 active actors on pipe
2025-09-30T14:59:26.881079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701727:3773], now have 1 active actors on pipe
2025-09-30T14:59:26.881084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897019569898365:12755]
2025-09-30T14:59:26.881087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897019569898365:12755]
2025-09-30T14:59:26.881090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897019569898365:12755]
2025-09-30T14:59:26.881100Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:26.881113Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:26.881117Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:26.881120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:26.881122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:26.881127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:26.881130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:26.881160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897019569898365:12755]
2025-09-30T14:59:26.881175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:26.881166Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3233
2025-09-30T14:59:26.881169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3233
2025-09-30T14:59:26.881232Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:26.881324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.881339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.881365Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:26.881380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:26.881384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:26.881386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:26.881397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:26.881410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:26.881430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:26.881597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.881607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.881622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:26.881700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3234 partition: 0 MaxSeqNo: 42 sessionId: src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0
2025-09-30T14:59:26.882048Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|642e200b-2a01db3-e28d9b29-5feb989b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:26.885022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0] Write session: try to update token
2025-09-30T14:59:26.885041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:26.900762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:26.900783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:26.900793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897019569898365:12755]
2025-09-30T14:59:26.900848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:26.900852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:26.900932Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3234 sessionId: src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:26.901032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:26.901192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:26.901335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:26.901486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:26.901681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:26.901724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:26.903703Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:26.903918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:26.903940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:26.903974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:26.904033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:26.905367Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:26.905386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:26.905388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:26.905393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:26.905401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897019569898365:12755]
2025-09-30T14:59:26.905406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897019569898365:12755]
2025-09-30T14:59:26.905409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897019569898365:12755]
2025-09-30T14:59:26.905444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:26.905457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:26.905460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:26.905453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:26.905467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:26.905471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:26.905597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:26.960843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897019659701734:4275]
2025-09-30T14:59:26.961087Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3233, pipe: [1:7555897019659701734:4275]
2025-09-30T14:59:27.020238Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:27.028445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.028475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.028671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.028753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.028834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.028917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.028972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.028987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.029066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.029136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.029208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.029282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.029332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.029340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.029414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.029486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.029555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.029619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.029662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.029670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.029743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.029813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.029880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.029947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.029990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.029997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.030066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.030128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.030199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.030269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.030317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.030324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.030392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.030460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.030524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.030593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.030639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.030648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.030717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.030789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.030856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.030923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.030966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.030975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.031044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.031110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.031177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.031267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.031399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.031406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.032360Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897019659701734:4275]
2025-09-30T14:59:27.032364Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:27.032399Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:27.032402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:27.032446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3234 reason: error at write: Disconnected sessionId: src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0
2025-09-30T14:59:27.032649Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3234 sessionId: src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0 is DEAD
2025-09-30T14:59:27.032789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:27.032799Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0] Write session will restart in 0.009228s
2025-09-30T14:59:27.032823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0] Write session: Do CDS request
2025-09-30T14:59:27.032829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:27.031476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.031542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.031602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.031663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.031708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.031711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.031780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.031840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.031904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.031969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.032014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.032017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.032088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897019659701734:4275], now have 1 active actors on pipe
2025-09-30T14:59:27.033086Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:27.042214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:27.042802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:27.042883Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:27.042899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3235
2025-09-30T14:59:27.043015Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3235 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:27.043040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3235 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:27.043046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3235 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:27.043050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:27.043762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3235 sessionId:  describe result for acl check
2025-09-30T14:59:27.043798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:27.043805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:27.043807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:27.043814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897023954669073:3763] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:27.044149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:27.044321Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:27.044328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:27.044337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:27.044379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:27.044416Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897023864865744:12757]
2025-09-30T14:59:27.044364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897023954669073:3763] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:27.045157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:27.045493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:27.045526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:27.045859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:27.045910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.045915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.045917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.045918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.045919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.045920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.045921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.045922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.045923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.045924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.045926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.045927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.045928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.045929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.045930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.045935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.045944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.045949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.045953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.045957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.045961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.045965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.045969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.045973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.045978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.045982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.045986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.045992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.045996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.046000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.046006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.046013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.046018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.046024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.046028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.046034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.046038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.046043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.046048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.046054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.046058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.046064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.046068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.046073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.046078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.046083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.046088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.046093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.046098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.046103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.046107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.046113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.046118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.046122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.046127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.046133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.046137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.046142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.046147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.046152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.046195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:27.046758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897023954669073:3763] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:27.051519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897023954669073:3763] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:27.051544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897023954669073:3763] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:27.051551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897023954669073:3763] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:27.051559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3235 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:27.052090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:27.053004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:27.053022Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:27.053025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:27.053029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:27.053036Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3234 [2:7555897023864865744:12757]
2025-09-30T14:59:27.053054Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:27.053069Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:27.053072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:27.053075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:27.053077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:27.053092Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:27.053098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:27.053107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:27.053164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.053173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.053175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.053178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:27.053181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:27.053249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:27.053256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.053270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.053282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.053299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:27.053319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897023864865739:12757]
2025-09-30T14:59:27.053321Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897023864865739:12757]
2025-09-30T14:59:27.053323Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897023864865739:12757]
2025-09-30T14:59:27.053331Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:27.053346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:27.053360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:27.053362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:27.053362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:27.053366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:27.053369Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:27.053393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897023864865739:12757]
2025-09-30T14:59:27.053396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:27.053399Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:27.053466Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3234
2025-09-30T14:59:27.053478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3234
2025-09-30T14:59:27.053404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669031:2454], now have 1 active actors on pipe
2025-09-30T14:59:27.053408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669112:3763], now have 1 active actors on pipe
2025-09-30T14:59:27.054081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.054108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.054138Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:27.054147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:27.054151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:27.054154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:27.054182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:27.054199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:27.054219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:27.059699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.059735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.059769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:27.059905Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3235 partition: 0 MaxSeqNo: 42 sessionId: src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0
2025-09-30T14:59:27.061675Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f580bf88-43091e24-389b3dd0-49c9aa74_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:27.064560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0] Write session: try to update token
2025-09-30T14:59:27.064581Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:27.066003Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:27.066028Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:27.066031Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:27.066033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:27.066049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897023864865739:12757]
2025-09-30T14:59:27.066057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897023864865739:12757]
2025-09-30T14:59:27.066061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897023864865739:12757]
2025-09-30T14:59:27.066102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:27.066112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.066115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:27.066133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:27.066139Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:27.066143Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:27.066252Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:27.084226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3235 sessionId: src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:27.087341Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:27.132394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897023954669119:4275]
2025-09-30T14:59:27.132790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3234, pipe: [1:7555897023954669119:4275]
2025-09-30T14:59:27.183789Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:27.184623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:27.184680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:27.184683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:27.185100Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:27.184742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3235 reason: error at write: Disconnected sessionId: src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0
2025-09-30T14:59:27.184922Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3235 sessionId: src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0 is DEAD
2025-09-30T14:59:27.185114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0] Write session will restart in 0.005885s
2025-09-30T14:59:27.185015Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897023954669119:4275]
2025-09-30T14:59:27.185152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0] Write session: Do CDS request
2025-09-30T14:59:27.185158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:27.184205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.184237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.184259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669119:4275], now have 1 active actors on pipe
2025-09-30T14:59:27.184767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:27.191754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:27.191842Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:27.191860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3236
2025-09-30T14:59:27.191991Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3236 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:27.192036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3236 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:27.192043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3236 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:27.192048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:27.192489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3236 sessionId:  describe result for acl check
2025-09-30T14:59:27.192520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:27.192540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:27.192542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:27.192549Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897023954669133:3758] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:27.193243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897023954669133:3758] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:27.195220Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897023954669133:3758] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:27.197155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:27.199107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:27.199317Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:27.199330Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:27.199341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:27.199396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:27.199296Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897023954669133:3758] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:27.199309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897023954669133:3758] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:27.199435Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897023864865826:12760]
2025-09-30T14:59:27.199311Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897023954669133:3758] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:27.199318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3236 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:27.200104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:27.200412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:27.200457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:27.200811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:27.200873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.200879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.200880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.200881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.200881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.200883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.200884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.200885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.200886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.200887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.200889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.200892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.200893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.200894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.200895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.200901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.200911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.200915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.200919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.200923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.200928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.200932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.200937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.200940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.200945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.200949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.200954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.200958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.200962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.200967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.200974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.200981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.200985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.200991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.200996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.201002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.201007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.201013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.201018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.201024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.201029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.201034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.201040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.201046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.201050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.201055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.201060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.201065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.201072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.201077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.201087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.201092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.201101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.201107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.201111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.201121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.201125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.201135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.201144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.201155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.201201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:27.206854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:27.207806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:27.207822Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:27.207826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:27.207830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:27.207839Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3235 [2:7555897023864865826:12760]
2025-09-30T14:59:27.207857Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:27.207874Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:27.207879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:27.207882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:27.207884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:27.207906Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:27.207913Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:27.207921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:27.207992Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.207999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.208001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.208004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:27.208007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:27.208079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:27.208091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.208105Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.208120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.208139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:27.208158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669120:2454], now have 1 active actors on pipe
2025-09-30T14:59:27.208162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669196:3758], now have 1 active actors on pipe
2025-09-30T14:59:27.208168Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897023864865820:12760]
2025-09-30T14:59:27.208170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897023864865820:12760]
2025-09-30T14:59:27.208173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897023864865820:12760]
2025-09-30T14:59:27.208185Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:27.208199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:27.208205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:27.208211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:27.208214Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:27.208217Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:27.208222Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:27.208248Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897023864865820:12760]
2025-09-30T14:59:27.208261Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:27.208286Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:27.208256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3235
2025-09-30T14:59:27.208254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3235
2025-09-30T14:59:27.208370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.208381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.208405Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:27.208417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:27.208421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:27.208427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:27.208436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:27.208450Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:27.208467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:27.208679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.208695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.208717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:27.208814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3236 partition: 0 MaxSeqNo: 42 sessionId: src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0
2025-09-30T14:59:27.209257Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|92d5026-6fd13c71-ccfd3b0b-c86fc45_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:27.212140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0] Write session: try to update token
2025-09-30T14:59:27.212165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:27.220869Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:27.220893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:27.220899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:27.220901Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:27.220911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897023864865820:12760]
2025-09-30T14:59:27.220916Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897023864865820:12760]
2025-09-30T14:59:27.220921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897023864865820:12760]
2025-09-30T14:59:27.220960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:27.220969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.220972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:27.220977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:27.220984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:27.220989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:27.221123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:27.229546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3236 sessionId: src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:27.232119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:27.284394Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897023954669208:4275]
2025-09-30T14:59:27.284725Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3235, pipe: [1:7555897023954669208:4275]
2025-09-30T14:59:27.334619Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:27.334976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.334997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.335038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669208:4275], now have 1 active actors on pipe
2025-09-30T14:59:27.335610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897023954669208:4275]
2025-09-30T14:59:27.335644Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:27.335678Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:27.335681Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:27.335864Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:27.336852Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3236 reason: error at write: Disconnected sessionId: src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0
2025-09-30T14:59:27.337038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3236 sessionId: src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0 is DEAD
2025-09-30T14:59:27.339363Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:27.339378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0] Write session will restart in 0.008120s
2025-09-30T14:59:27.339404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0] Write session: Do CDS request
2025-09-30T14:59:27.339411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:27.345807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:27.347918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:27.348155Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:27.348159Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:27.348170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:27.348221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:27.348258Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897023864865906:12762]
2025-09-30T14:59:27.348822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:27.348893Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:27.348908Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3237
2025-09-30T14:59:27.348898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:27.349223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:27.349273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:27.349285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3237 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:27.349320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3237 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:27.349328Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3237 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:27.349332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:27.349630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:27.349698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.349699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.349701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.349702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.349703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.349705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.349706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.349707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.349709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.349710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.349711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.349713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.349714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.349715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.349718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.349724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.349735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.349739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.349743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.349747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.349751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.349754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.349759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.349762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.349765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.349769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.349772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.349776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.349779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.349783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.349791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.349799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.349806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.349812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.349817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.349822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.349827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.349833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.349838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.349843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.349848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.349853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.349858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.349862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.349865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.349873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.349877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.349882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.349887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.349892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.349900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.349906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.349910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.349916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.349921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.349927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.349931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.349937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.349941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.349947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.349994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:27.349746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3237 sessionId:  describe result for acl check
2025-09-30T14:59:27.349787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:27.349790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:27.349792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:27.349798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897023954669261:3736] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:27.350314Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897023954669261:3736] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:27.353352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897023954669261:3736] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:27.358420Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897023954669261:3736] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:27.358436Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897023954669261:3736] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:27.358440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897023954669261:3736] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:27.358450Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3237 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:27.358670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:27.359641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:27.359666Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:27.359669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:27.359673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:27.359681Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3236 [2:7555897023864865906:12762]
2025-09-30T14:59:27.359698Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:27.359722Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:27.359730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:27.359734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:27.359736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:27.359753Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:27.359765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:27.359772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:27.359839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.359849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.359851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.359854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:27.359856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:27.359929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:27.359937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.359949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.359960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.359983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:27.360006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669213:2454], now have 1 active actors on pipe
2025-09-30T14:59:27.360017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669296:3736], now have 1 active actors on pipe
2025-09-30T14:59:27.360023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897023864865900:12762]
2025-09-30T14:59:27.360025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897023864865900:12762]
2025-09-30T14:59:27.360027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897023864865900:12762]
2025-09-30T14:59:27.360044Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:27.360058Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:27.360072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:27.360075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:27.360073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:27.360078Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:27.360081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:27.360056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3236
2025-09-30T14:59:27.360112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897023864865900:12762]
2025-09-30T14:59:27.360121Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:27.360124Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:27.360128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3236
2025-09-30T14:59:27.360182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.360194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.360221Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:27.360234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:27.360244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:27.360248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:27.360257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:27.360267Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:27.360283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:27.360465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.360479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.360503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:27.360611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3237 partition: 0 MaxSeqNo: 42 sessionId: src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0
2025-09-30T14:59:27.360985Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a88395bd-a47929ed-3ac56a49-a56bd240_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:27.363789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0] Write session: try to update token
2025-09-30T14:59:27.363810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:27.372227Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:27.372251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:27.372261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897023864865900:12762]
2025-09-30T14:59:27.372305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:27.372316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:27.372509Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:27.372672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:27.372809Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:27.372962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:27.373166Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:27.373210Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:27.378622Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3237 sessionId: src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:27.381501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:27.381723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.381748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.381781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:27.381876Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:27.383961Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:27.383980Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:27.383982Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:27.383983Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:27.383993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897023864865900:12762]
2025-09-30T14:59:27.383996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897023864865900:12762]
2025-09-30T14:59:27.383999Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897023864865900:12762]
2025-09-30T14:59:27.384034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:27.384039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.384040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:27.384041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:27.384048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:27.384053Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:27.384176Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:27.434964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897023954669308:4275]
2025-09-30T14:59:27.435268Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3236, pipe: [1:7555897023954669308:4275]
2025-09-30T14:59:27.494788Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:27.502503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.502535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.502719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.502788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.502859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.502930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.502982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.502992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.503065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.503129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.503193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.503293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.503344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.503351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.503426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.503491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.503557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.503633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.503681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.503692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.503771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.503840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.503909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.503979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.504030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.504037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.504110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.504176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.504245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.504316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.504364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.504372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.504439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.504506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.504586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.504653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.504703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.504712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.504780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.504849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.504918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.504991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.505046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.505053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.505126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.505193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.505262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.505329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.505379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.505386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.505461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.505529Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.505600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.505675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.505725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.505733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.505802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.505867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.505933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.506000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.506045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.506052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.506118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669308:4275], now have 1 active actors on pipe
2025-09-30T14:59:27.506392Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897023954669308:4275]
2025-09-30T14:59:27.506408Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:27.506436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:27.506441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:27.506480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3237 reason: error at write: Disconnected sessionId: src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0
2025-09-30T14:59:27.506737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3237 sessionId: src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0 is DEAD
2025-09-30T14:59:27.506876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:27.506889Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0] Write session will restart in 0.006801s
2025-09-30T14:59:27.506912Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0] Write session: Do CDS request
2025-09-30T14:59:27.506918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:27.507325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:27.514853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:27.514985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:27.515003Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3238
2025-09-30T14:59:27.515144Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3238 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:27.515193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3238 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:27.515205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3238 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:27.515210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:27.515676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3238 sessionId:  describe result for acl check
2025-09-30T14:59:27.515729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:27.515737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:27.515739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:27.515745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897023954669351:3733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:27.515904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:27.516310Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897023954669351:3733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:27.517938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:27.518230Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:27.518243Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:27.518255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:27.518331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:27.518380Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897023864865987:12764]
2025-09-30T14:59:27.518429Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897023954669351:3733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:27.519047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:27.519387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:27.519465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:27.519817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:27.519904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.519915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.519916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.519917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.519921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.519922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.519924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.519925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.519927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.519928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.519929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.519931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.519932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.519933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.519935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.519942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.519953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.519957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.519962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.519965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.519970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.519974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.519978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.519982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.519987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.519992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.519996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.520000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.520004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.520008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.520017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.520026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.520033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.520039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.520044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.520051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.520055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.520061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.520066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.520079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.520084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.520098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.520104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.520110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.520114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.520120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.520125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.520137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.520142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.520152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.520159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.520168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.520171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.520177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.520181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.520206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.520210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.520215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.520219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.520224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.520266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:27.521226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897023954669351:3733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:27.521242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897023954669351:3733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:27.521246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897023954669351:3733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:27.521255Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3238 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:27.525710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:27.526684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:27.526705Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:27.526708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:27.526712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:27.526718Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3237 [2:7555897023864865987:12764]
2025-09-30T14:59:27.526734Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:27.526749Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:27.526753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:27.526755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:27.526758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:27.526774Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:27.526781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:27.526794Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:27.526854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.526861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.526863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.526867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:27.526869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:27.526935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:27.527135Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3237
2025-09-30T14:59:27.526945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.527139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3237
2025-09-30T14:59:27.526958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.526971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.526988Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:27.527008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669391:3733], now have 1 active actors on pipe
2025-09-30T14:59:27.527012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669309:2454], now have 1 active actors on pipe
2025-09-30T14:59:27.527017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897023864865981:12764]
2025-09-30T14:59:27.527021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897023864865981:12764]
2025-09-30T14:59:27.527023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897023864865981:12764]
2025-09-30T14:59:27.527035Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:27.527048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:27.527050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:27.527055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:27.527057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:27.527062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:27.527064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:27.527096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897023864865981:12764]
2025-09-30T14:59:27.527103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:27.527128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:27.527188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.527192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.527216Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:27.527223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:27.527226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:27.527228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:27.527240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:27.527265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:27.527279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:27.527442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.527451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.527464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:27.527564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3238 partition: 0 MaxSeqNo: 42 sessionId: src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0
2025-09-30T14:59:27.527944Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3146694-18e4cf7b-1cf092e-50af3bd5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:27.530964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0] Write session: try to update token
2025-09-30T14:59:27.530982Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:27.540425Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:27.540447Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:27.540457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897023864865981:12764]
2025-09-30T14:59:27.540500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:27.540509Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:27.540695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:27.540846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:27.541004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:27.541165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:27.541365Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:27.541420Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:27.546351Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3238 sessionId: src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:27.549051Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:27.549248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.549282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.549318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:27.549410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:27.551548Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:27.551567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:27.551570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:27.551572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:27.551581Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897023864865981:12764]
2025-09-30T14:59:27.551586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897023864865981:12764]
2025-09-30T14:59:27.551590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897023864865981:12764]
2025-09-30T14:59:27.551626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:27.551633Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:27.551637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.551639Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:27.551640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:27.551643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:27.551776Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:27.606475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897023954669399:4275]
2025-09-30T14:59:27.606779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3237, pipe: [1:7555897023954669399:4275]
2025-09-30T14:59:27.668332Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:27.677473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.677514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.677714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.677795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.677861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.677938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.677986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.677997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.678074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.678143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.678220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.678295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.678344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.678355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.678429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.678496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.678575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.678641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.678685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.678688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.678765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.678833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.678899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.678965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.679008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.679012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.679088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.679150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.679216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.679413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.681513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897023954669399:4275]
2025-09-30T14:59:27.682108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:27.682121Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0] Write session will restart in 0.008424s
2025-09-30T14:59:27.682147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0] Write session: Do CDS request
2025-09-30T14:59:27.681675Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:27.681689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:27.681731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:27.682153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:27.681732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3238 reason: error at write: Disconnected sessionId: src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0
2025-09-30T14:59:27.681931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3238 sessionId: src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0 is DEAD
2025-09-30T14:59:27.679468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.679478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.679561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.679629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.679699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.679770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.679819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.679823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.679899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.679963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.680032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.680105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.680152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.680155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.680232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.680300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.680366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.680438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.680486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.680488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.680583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.680642Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.680705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.680770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.680810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.680817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.680886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:27.680946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:27.681011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:27.681077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:27.681119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:27.681122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:27.681204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669399:4275], now have 1 active actors on pipe
2025-09-30T14:59:27.682471Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:27.692031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:27.692127Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:27.692145Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3239
2025-09-30T14:59:27.692271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3239 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:27.692306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3239 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:27.692317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3239 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:27.692322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:27.692812Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3239 sessionId:  describe result for acl check
2025-09-30T14:59:27.692849Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:27.692854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:27.692858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:27.692864Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897023954669416:3712] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:27.693411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897023954669416:3712] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:27.697086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897023954669416:3712] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:27.697835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:27.699427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:27.699637Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:27.699649Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:27.699660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:27.699715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:27.699751Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897023864866083:12768]
2025-09-30T14:59:27.699813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897023954669416:3712] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:27.699829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897023954669416:3712] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:27.699833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897023954669416:3712] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:27.699841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3239 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:27.700421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:27.700768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:27.700835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:27.701235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:27.701318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.701325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.701326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.701327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.701328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.701330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.701331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.701332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.701333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.701334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.701335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.701336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.701337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.701338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.701339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.701345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.701356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.701364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.701368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.701373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.701377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.701382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.701386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.701390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.701395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.701400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.701405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.701409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.701414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.701419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.701427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.701436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.701447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.701454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.701463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.701474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.701479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.701489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.701495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.701504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.701510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.701519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.701525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.701534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.701539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.701548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.701553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.701563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.701568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.701574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.701583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.701592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.701597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.701607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.701616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.701621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.701631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.701637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.701645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.701651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.701701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:27.707834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:27.709043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:27.709079Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:27.709084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:27.709090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:27.709099Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3238 [2:7555897023864866083:12768]
2025-09-30T14:59:27.709120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:27.709143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:27.709147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:27.709151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:27.709162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:27.709184Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:27.709206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:27.709216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:27.709302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.709310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.709312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.709316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:27.709319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:27.709403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:27.709413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.709428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.709439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.709473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:27.709502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669400:2454], now have 1 active actors on pipe
2025-09-30T14:59:27.709508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669480:3712], now have 1 active actors on pipe
2025-09-30T14:59:27.709518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897023864866078:12768]
2025-09-30T14:59:27.709520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897023864866078:12768]
2025-09-30T14:59:27.709522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897023864866078:12768]
2025-09-30T14:59:27.709539Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:27.709560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:27.709579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:27.709594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:27.709640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897023864866078:12768]
2025-09-30T14:59:27.709651Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:27.709691Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:27.709701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:27.709704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:27.709710Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:27.709832Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3238
2025-09-30T14:59:27.709887Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3238
2025-09-30T14:59:27.710093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.710112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.710155Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:27.710171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:27.710180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:27.710182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:27.710194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:27.710226Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:27.710253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:27.710486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.710504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.710526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:27.710654Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3239 partition: 0 MaxSeqNo: 42 sessionId: src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0
2025-09-30T14:59:27.711016Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|901042d9-818bd8d7-c24643f5-8e0a8cb7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:27.714083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0] Write session: try to update token
2025-09-30T14:59:27.714111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:27.724873Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:27.724904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:27.724907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:27.724909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:27.724920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897023864866078:12768]
2025-09-30T14:59:27.724925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897023864866078:12768]
2025-09-30T14:59:27.724931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897023864866078:12768]
2025-09-30T14:59:27.724981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:27.724991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.724998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:27.725150Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:27.727328Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:27.727337Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:27.727341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:27.732611Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3239 sessionId: src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:27.735812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:27.781557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897023954669492:4275]
2025-09-30T14:59:27.781886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3238, pipe: [1:7555897023954669492:4275]
2025-09-30T14:59:27.842382Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:27.842778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.842794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.842813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669492:4275], now have 1 active actors on pipe
2025-09-30T14:59:27.843131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:27.843317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:27.843375Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:27.843383Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:27.843445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3239 reason: error at write: Disconnected sessionId: src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0
2025-09-30T14:59:27.843614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3239 sessionId: src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0 is DEAD
2025-09-30T14:59:27.843724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:27.843739Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0] Write session will restart in 0.005814s
2025-09-30T14:59:27.843760Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0] Write session: Do CDS request
2025-09-30T14:59:27.843777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:27.843758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897023954669492:4275]
2025-09-30T14:59:27.850725Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:27.850818Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:27.850836Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3240
2025-09-30T14:59:27.851090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3240 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:27.851132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3240 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:27.851137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3240 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:27.851141Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:27.851580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3240 sessionId:  describe result for acl check
2025-09-30T14:59:27.851603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:27.851606Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:27.851608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:27.851613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897023954669546:3668] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:27.852122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897023954669546:3668] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:27.854577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897023954669546:3668] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:27.855490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:27.857596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:27.857808Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:27.857818Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:27.857829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:27.858122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897023954669546:3668] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:27.858138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897023954669546:3668] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:27.858141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897023954669546:3668] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:27.858157Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3240 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:27.857887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:27.857932Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897023864866179:12776]
2025-09-30T14:59:27.858597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:27.859010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:27.859073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:27.859448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:27.859535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.859536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.859537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.859538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.859540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.859541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.859543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.859544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.859546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.859547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.859548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.859549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.859551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.859552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.859553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.859559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.859569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.859574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.859579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.859584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.859588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.859594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.859597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.859601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.859606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.859610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.859614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.859618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.859622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.859626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.859633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.859641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:27.859646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.859652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:27.859657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.859662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:27.859667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.859673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:27.859678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.859684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:27.859689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.859695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:27.859701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.859706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:27.859710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.859715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:27.859721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.859727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:27.859734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.859740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:27.859746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.859753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.859760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.859766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.859771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.859777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.859781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.859787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:27.859792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.859799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:27.859847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:27.866464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:27.867420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:27.867438Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:27.867441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:27.867445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:27.867453Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3239 [2:7555897023864866179:12776]
2025-09-30T14:59:27.867469Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:27.867485Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:27.867487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:27.867490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:27.867494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:27.867510Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:27.867519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:27.867534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:27.867600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.867602Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.867604Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.867608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:27.867610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:27.867683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:27.867685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.867699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:27.867713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:27.867730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:27.867747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897023864866174:12776]
2025-09-30T14:59:27.867750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897023864866174:12776]
2025-09-30T14:59:27.867752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897023864866174:12776]
2025-09-30T14:59:27.867765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:27.867781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:27.867796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:27.867798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:27.867834Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897023864866174:12776]
2025-09-30T14:59:27.867836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:27.867867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:27.867871Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:27.867874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:27.867880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:27.868199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669511:2454], now have 1 active actors on pipe
2025-09-30T14:59:27.868211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669599:3668], now have 1 active actors on pipe
2025-09-30T14:59:27.869672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3239
2025-09-30T14:59:27.869729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3239
2025-09-30T14:59:27.869828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.869846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.869887Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:27.869898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:27.869902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:27.869905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:27.869917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:27.869940Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:27.869957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:27.870343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:27.870356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:27.870379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:27.870507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3240 partition: 0 MaxSeqNo: 42 sessionId: src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0
2025-09-30T14:59:27.870951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6033d3c0-725f4464-8d15a8a7-e1f3587c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:27.874044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0] Write session: try to update token
2025-09-30T14:59:27.874066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:27.890689Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:27.890714Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:27.890724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897023864866174:12776]
2025-09-30T14:59:27.890771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:27.890962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:27.891114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:27.891371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:27.891399Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:27.891544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:27.891780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:27.891819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:27.898196Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:27.898217Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:27.898219Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:27.898221Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:27.898230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897023864866174:12776]
2025-09-30T14:59:27.898234Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897023864866174:12776]
2025-09-30T14:59:27.898239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897023864866174:12776]
2025-09-30T14:59:27.898284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:27.898295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:27.898298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:27.898304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:27.898311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:27.898316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:27.898440Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:27.900099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3240 sessionId: src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:27.902954Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:27.943851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897023954669621:4275]
2025-09-30T14:59:27.944148Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3239, pipe: [1:7555897023954669621:4275]
2025-09-30T14:59:28.016540Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:28.016960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.016979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.016998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897023954669621:4275], now have 1 active actors on pipe
2025-09-30T14:59:28.017243Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:28.017572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897023954669621:4275]
2025-09-30T14:59:28.017605Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:28.017640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:28.017717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3240 reason: status is not ok: tablet will be restarted right now sessionId: src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0
2025-09-30T14:59:28.018120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:28.018132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0] Write session will restart in 0.006302s
2025-09-30T14:59:28.018155Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0] Write session: Do CDS request
2025-09-30T14:59:28.018161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:28.017901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3240 sessionId: src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0 is DEAD
2025-09-30T14:59:28.025786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:28.025880Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:28.025896Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3241
2025-09-30T14:59:28.026049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3241 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:28.026081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3241 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:28.026087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3241 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:28.026091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:28.026702Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3241 sessionId:  describe result for acl check
2025-09-30T14:59:28.026746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:28.026750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:28.026752Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:28.026758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897028249636948:3667] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:28.027405Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897028249636948:3667] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:28.030743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897028249636948:3667] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:28.031768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:28.033832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:28.034065Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:28.034077Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:28.034090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:28.034153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:28.034195Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897028159833582:12784]
2025-09-30T14:59:28.034237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897028249636948:3667] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:28.034253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897028249636948:3667] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:28.034257Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897028249636948:3667] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:28.034265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3241 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:28.034852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:28.035196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:28.035278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:28.035616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:28.035691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.035700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.035701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.035702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.035703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.035704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.035705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.035706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.035708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.035709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.035710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.035711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.035712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.035713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.035714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.035720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.035731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.035738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.035742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.035746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.035750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.035754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.035759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.035762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.035767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.035771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.035774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.035778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.035782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.035786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.035795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.035803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.035808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.035814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.035818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.035822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.035826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.035831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.035835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.035841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.035845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.035850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.035854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.035859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.035864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.035869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.035873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.035878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.035883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.035888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.035893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.035898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.035902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.035907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.035912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.035917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.035922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.035927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.035931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.035935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.035979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:28.041653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:28.042606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:28.042627Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:28.042629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:28.042634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:28.042641Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3240 [2:7555897028159833582:12784]
2025-09-30T14:59:28.042658Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:28.042675Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:28.042679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:28.042681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:28.042684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:28.042701Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:28.042717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:28.042731Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:28.042937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.042952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.042956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.042960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:28.042963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:28.043051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:28.043060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.043076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.043092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.043116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:28.043137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249636918:2454], now have 1 active actors on pipe
2025-09-30T14:59:28.043141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249636998:3667], now have 1 active actors on pipe
2025-09-30T14:59:28.043149Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897028159833577:12784]
2025-09-30T14:59:28.043151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897028159833577:12784]
2025-09-30T14:59:28.043154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897028159833577:12784]
2025-09-30T14:59:28.043175Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:28.043203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:28.043217Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3240
2025-09-30T14:59:28.043237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3240
2025-09-30T14:59:28.043230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:28.043259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:28.043307Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897028159833577:12784]
2025-09-30T14:59:28.043311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:28.043404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:28.043418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:28.043421Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:28.043427Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:28.043487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.043507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.043535Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:28.043549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:28.043558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:28.043563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:28.043574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:28.043592Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:28.043613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:28.043887Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3241 partition: 0 MaxSeqNo: 42 sessionId: src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0
2025-09-30T14:59:28.043785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.043795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.043809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:28.044205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|15c96f4a-3bdca2ba-e1c1ecb0-a5b3a78f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:28.047159Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0] Write session: try to update token
2025-09-30T14:59:28.047185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:28.056126Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:28.056152Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:28.056162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897028159833577:12784]
2025-09-30T14:59:28.056209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:28.056294Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:28.056389Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:28.056556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:28.056706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:28.056863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:28.057063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:28.057109Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:28.068104Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3241 sessionId: src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:28.070945Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:28.071868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.071903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.071944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:28.072034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:28.080539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:28.080562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:28.080565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:28.080568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:28.080579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897028159833577:12784]
2025-09-30T14:59:28.080582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897028159833577:12784]
2025-09-30T14:59:28.080587Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897028159833577:12784]
2025-09-30T14:59:28.080627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:28.080633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.080640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:28.080772Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:28.083345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:28.083366Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:28.083371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:28.117976Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897028249637011:4275]
2025-09-30T14:59:28.119501Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3240, pipe: [1:7555897028249637011:4275]
2025-09-30T14:59:28.201588Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:28.210548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.210583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.210781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:28.210851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:28.210921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:28.210993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:28.211043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:28.211054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:28.211126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:28.211191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:28.211280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:28.211360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:28.211400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:28.211403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:28.211474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:28.211532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:28.211592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:28.211668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:28.211712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:28.211724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:28.211801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:28.211866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:28.211931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:28.211993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:28.212039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:28.212046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:28.212116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:28.212184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:28.212246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:28.212311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:28.212355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:28.212362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:28.212431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:28.212496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:28.212572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:28.212634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:28.212684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:28.212692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:28.212760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:28.212825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:28.212893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:28.212979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:28.213041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:28.213054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:28.213122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:28.213186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:28.213248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:28.213313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:28.213357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:28.213366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:28.213433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:28.213498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:28.213567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:28.213634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:28.213685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:28.213692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:28.213758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:28.213819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:28.213882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:28.213950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:28.213995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:28.214003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:28.214069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637011:4275], now have 1 active actors on pipe
2025-09-30T14:59:28.214313Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:28.214371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:28.214379Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:28.214411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3241 reason: error at write: Disconnected sessionId: src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0
2025-09-30T14:59:28.214632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897028249637011:4275]
2025-09-30T14:59:28.214648Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3241 sessionId: src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0 is DEAD
2025-09-30T14:59:28.214789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:28.214796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0] Write session will restart in 0.009058s
2025-09-30T14:59:28.214820Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0] Write session: Do CDS request
2025-09-30T14:59:28.214825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:28.215392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:28.224251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:28.224882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:28.224937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:28.224952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3242
2025-09-30T14:59:28.225115Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3242 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:28.225150Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3242 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:28.225158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3242 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:28.225163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:28.225771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3242 sessionId:  describe result for acl check
2025-09-30T14:59:28.225809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:28.225818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:28.225820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:28.225826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897028249637064:3648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:28.226409Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897028249637064:3648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:28.226456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:28.226701Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:28.226713Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:28.226724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:28.226786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:28.226826Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897028159833669:12787]
2025-09-30T14:59:28.227407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:28.227725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:28.227765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:28.228102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:28.228175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.228181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.228182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.228183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.228184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.228186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.228187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.228188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.228190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.228191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.228192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.228193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.228194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.228196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.228197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.228203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.228212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.228216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.228220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.228224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.228228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.228232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.228235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.228239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.228245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.228249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.228252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.228256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.228259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.228263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.228271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.228278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.228285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.228290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.228295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.228300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.228304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.228309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.228313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.228318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.228322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.228327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.228332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.228337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.228342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.228348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.228352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.228357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.228361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.228366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.228371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.228386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.228390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.228397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.228401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.228406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.228411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.228415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.228421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.228426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.228465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:28.229041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897028249637064:3648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:28.233222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897028249637064:3648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:28.233239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897028249637064:3648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:28.233242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897028249637064:3648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:28.233251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3242 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:28.234818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:28.236316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:28.236334Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:28.236337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:28.236341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:28.236348Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3241 [2:7555897028159833669:12787]
2025-09-30T14:59:28.236365Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:28.236395Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:28.236402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:28.236406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:28.236409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:28.236425Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:28.236437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:28.236445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:28.236512Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.236528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.236532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.236538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:28.236540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:28.236622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:28.236628Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.236641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.236654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.236672Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:28.236690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637017:2454], now have 1 active actors on pipe
2025-09-30T14:59:28.236701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637103:3648], now have 1 active actors on pipe
2025-09-30T14:59:28.236708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897028159833663:12787]
2025-09-30T14:59:28.236711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897028159833663:12787]
2025-09-30T14:59:28.236712Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897028159833663:12787]
2025-09-30T14:59:28.236725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:28.236739Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:28.236746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:28.236749Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:28.236751Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:28.236759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:28.236761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:28.236769Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3241
2025-09-30T14:59:28.236798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897028159833663:12787]
2025-09-30T14:59:28.236788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3241
2025-09-30T14:59:28.236813Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:28.236849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:28.236968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.236989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.237020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:28.237033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:28.237037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:28.237038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:28.237050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:28.237061Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:28.237080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:28.237301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.237309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.237324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:28.237441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3242 partition: 0 MaxSeqNo: 42 sessionId: src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0
2025-09-30T14:59:28.237840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b2ddc516-9511afbd-39d616b2-d22936cc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:28.240782Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0] Write session: try to update token
2025-09-30T14:59:28.240804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:28.249757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:28.249785Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:28.249787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:28.249794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:28.249803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897028159833663:12787]
2025-09-30T14:59:28.249807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897028159833663:12787]
2025-09-30T14:59:28.249811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897028159833663:12787]
2025-09-30T14:59:28.249855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:28.249863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.249863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:28.249865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:28.249882Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:28.249897Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:28.250010Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:28.260614Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3242 sessionId: src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:28.263453Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:28.314557Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897028249637110:4275]
2025-09-30T14:59:28.314870Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3241, pipe: [1:7555897028249637110:4275]
2025-09-30T14:59:28.366536Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:28.366903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.366917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.366938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637110:4275], now have 1 active actors on pipe
2025-09-30T14:59:28.367186Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:28.368044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:28.368057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0] Write session will restart in 0.007422s
2025-09-30T14:59:28.368084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0] Write session: Do CDS request
2025-09-30T14:59:28.368090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:28.367460Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897028249637110:4275]
2025-09-30T14:59:28.367502Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:28.367505Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:28.367576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3242 reason: error at write: Disconnected sessionId: src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0
2025-09-30T14:59:28.367801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3242 sessionId: src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0 is DEAD
2025-09-30T14:59:28.367844Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:28.376827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:28.377079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:28.377095Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3243
2025-09-30T14:59:28.377315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3243 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:28.377372Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3243 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:28.377383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3243 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:28.377388Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:28.377947Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3243 sessionId:  describe result for acl check
2025-09-30T14:59:28.377986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:28.377995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:28.377997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:28.378004Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897028249637124:3631] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:28.378587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897028249637124:3631] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:28.381768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897028249637124:3631] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:28.388359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897028249637124:3631] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:28.388377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897028249637124:3631] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:28.388381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897028249637124:3631] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:28.388391Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3243 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:28.392336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:28.397563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:28.397810Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:28.397815Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:28.397828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:28.398042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:28.398090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897028159833756:12789]
2025-09-30T14:59:28.398804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:28.399402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:28.399464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:28.399845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:28.399928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.399934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.399936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.399937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.399939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.399943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.399944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.399946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.399947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.399949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.399951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.399952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.399953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.399955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.399956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.399962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.399973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.399978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.399982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.399986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.399991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.399996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.400000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.400004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.400008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.400012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.400016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.400020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.400024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.400028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.400036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.400044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.400051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.400057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.400062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.400068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.400074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.400080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.400084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.400089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.400094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.400099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.400103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.400107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.400119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.400124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.400131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.400136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.400146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.400152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.400157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.400167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.400173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.400183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.400188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.400199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.400203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.400209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.400219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.400225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.400280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:28.406746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:28.407740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:28.407748Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:28.407752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:28.407756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:28.407765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3242 [2:7555897028159833756:12789]
2025-09-30T14:59:28.407784Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:28.407809Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:28.407812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:28.407816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:28.407818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:28.407852Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:28.407860Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:28.407867Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:28.407935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.407938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.407941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.407945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:28.407949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:28.408021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:28.408024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.408040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.408051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.408067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:28.408084Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897028159833751:12789]
2025-09-30T14:59:28.408089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897028159833751:12789]
2025-09-30T14:59:28.408091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897028159833751:12789]
2025-09-30T14:59:28.408107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:28.408121Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:28.408136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:28.408139Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:28.408178Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897028159833751:12789]
2025-09-30T14:59:28.408182Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:28.408307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637116:2454], now have 1 active actors on pipe
2025-09-30T14:59:28.408315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637197:3631], now have 1 active actors on pipe
2025-09-30T14:59:28.408355Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:28.408359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:28.408362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:28.408368Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:28.408463Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3242
2025-09-30T14:59:28.408474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3242
2025-09-30T14:59:28.408637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.408658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.408685Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:28.408694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:28.408698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:28.408700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:28.408712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:28.408726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:28.408744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:28.409008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.409019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.409038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:28.409149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3243 partition: 0 MaxSeqNo: 42 sessionId: src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0
2025-09-30T14:59:28.409553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|49a2f0d7-ae8a32b7-4adf81b1-5a3702e8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:28.412511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0] Write session: try to update token
2025-09-30T14:59:28.412558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:28.424415Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:28.424444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:28.424448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:28.424453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:28.424463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897028159833751:12789]
2025-09-30T14:59:28.424472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897028159833751:12789]
2025-09-30T14:59:28.424476Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897028159833751:12789]
2025-09-30T14:59:28.424543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:28.424551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.424554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:28.424561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:28.424569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:28.424574Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:28.424701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:28.431000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3243 sessionId: src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:28.434172Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:28.467587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897028249637214:4275]
2025-09-30T14:59:28.468038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3242, pipe: [1:7555897028249637214:4275]
2025-09-30T14:59:28.545585Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:28.546008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.546024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.546065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637214:4275], now have 1 active actors on pipe
2025-09-30T14:59:28.546366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:28.546371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897028249637214:4275]
2025-09-30T14:59:28.546396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:28.546486Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3243 reason: status is not ok: tablet will be restarted right now sessionId: src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0
2025-09-30T14:59:28.546710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3243 sessionId: src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0 is DEAD
2025-09-30T14:59:28.546883Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:28.546892Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0] Write session will restart in 0.007246s
2025-09-30T14:59:28.546916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0] Write session: Do CDS request
2025-09-30T14:59:28.546923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:28.546318Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:28.555829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:28.555937Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:28.555952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3244
2025-09-30T14:59:28.556112Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3244 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:28.556161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3244 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:28.556171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3244 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:28.556176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:28.556679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3244 sessionId:  describe result for acl check
2025-09-30T14:59:28.556726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:28.556730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:28.556732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:28.556738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897028249637265:3610] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:28.556880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:28.557329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897028249637265:3610] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:28.559049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:28.559322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:28.559337Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:28.559350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:28.559415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:28.559459Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897028159833854:12792]
2025-09-30T14:59:28.559459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897028249637265:3610] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:28.560082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:28.560471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:28.560564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:28.560967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:28.561061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.561071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.561073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.561074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.561075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.561076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.561077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.561079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.561080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.561081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.561082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.561083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.561084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.561085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.561086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.561093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.561113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.561116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.561119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.561123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.561127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.561130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.561133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.561137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.561141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.561145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.561148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.561152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.561155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.561160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.561168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.561175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.561182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.561187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.561191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.561198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.561202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.561208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.561212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.561218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.561222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.561227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.561234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.561239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.561243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.561248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.561251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.561257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.561261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.561266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.561270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.561275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.561279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.561284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.561289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.561294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.561299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.561304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.561309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.561315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.561356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:28.567014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897028249637265:3610] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:28.567033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897028249637265:3610] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:28.567036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897028249637265:3610] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:28.567046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3244 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:28.567279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:28.568197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:28.568222Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:28.568225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:28.568232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:28.568239Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3243 [2:7555897028159833854:12792]
2025-09-30T14:59:28.568255Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:28.568273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:28.568276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:28.568279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:28.568281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:28.568298Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:28.568310Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:28.568317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:28.568384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.568391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.568395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.568399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:28.568402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:28.568475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:28.568478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.568492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.568508Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.568546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:28.568569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637215:2454], now have 1 active actors on pipe
2025-09-30T14:59:28.568577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637305:3610], now have 1 active actors on pipe
2025-09-30T14:59:28.568583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897028159833848:12792]
2025-09-30T14:59:28.568589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897028159833848:12792]
2025-09-30T14:59:28.568591Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897028159833848:12792]
2025-09-30T14:59:28.568610Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:28.568628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:28.568633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:28.568648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:28.568651Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:28.568656Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:28.568659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:28.568640Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3243
2025-09-30T14:59:28.568648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3243
2025-09-30T14:59:28.568690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897028159833848:12792]
2025-09-30T14:59:28.568697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:28.568712Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:28.568741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.568750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.568783Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:28.568794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:28.568797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:28.568801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:28.568811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:28.568825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:28.568844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:28.569058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.569066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.569080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:28.569248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3244 partition: 0 MaxSeqNo: 42 sessionId: src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0
2025-09-30T14:59:28.569644Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|196eadaf-8405d9ad-2a0908d9-f28802c1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:28.572836Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0] Write session: try to update token
2025-09-30T14:59:28.572863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:28.582579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:28.582611Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:28.582615Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:28.582618Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:28.582628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897028159833848:12792]
2025-09-30T14:59:28.582633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897028159833848:12792]
2025-09-30T14:59:28.582639Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897028159833848:12792]
2025-09-30T14:59:28.582685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:28.582700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.582704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:28.582711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:28.582715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:28.582725Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:28.582853Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:28.589427Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3244 sessionId: src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:28.592451Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:28.646364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897028249637312:4275]
2025-09-30T14:59:28.646615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3243, pipe: [1:7555897028249637312:4275]
2025-09-30T14:59:28.694640Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:28.695126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.695147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.695182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637312:4275], now have 1 active actors on pipe
2025-09-30T14:59:28.695459Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:28.695495Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:28.695505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897028249637312:4275]
2025-09-30T14:59:28.695536Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:28.695539Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:28.695626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3244 reason: error at write: Disconnected sessionId: src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0
2025-09-30T14:59:28.695864Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3244 sessionId: src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0 is DEAD
2025-09-30T14:59:28.696072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:28.696084Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0] Write session will restart in 0.006587s
2025-09-30T14:59:28.696108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0] Write session: Do CDS request
2025-09-30T14:59:28.696114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:28.703834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:28.703950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:28.703972Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3245
2025-09-30T14:59:28.704134Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3245 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:28.704170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3245 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:28.704182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3245 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:28.704187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:28.704719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3245 sessionId:  describe result for acl check
2025-09-30T14:59:28.704754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:28.704756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:28.704758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:28.704764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897028249637362:3598] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:28.705065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:28.705315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897028249637362:3598] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:28.706979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:28.707182Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:28.707191Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:28.707199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:28.707240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:28.707306Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897028159833943:12795]
2025-09-30T14:59:28.707385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897028249637362:3598] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:28.708014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:28.708352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:28.708399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:28.708697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:28.708767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.708773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.708773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.708774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.708775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.708776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.708777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.708778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.708779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.708779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.708780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.708781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.708782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.708783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.708786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.708789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.708795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.708798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.708800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.708803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.708805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.708807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.708809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.708812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.708814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.708817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.708819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.708821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.708824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.708826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.708832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.708837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.708841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.708845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.708848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.708852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.708855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.708858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.708861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.708864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.708867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.708870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.708874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.708877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.708880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.708888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.708892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.708895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.708898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.708901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.708904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.708907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.708910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.708913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.708916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.708918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.708921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.708924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.708927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.708930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.708974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:28.713277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897028249637362:3598] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:28.713301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897028249637362:3598] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:28.713304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897028249637362:3598] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:28.713315Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3245 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:28.714678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:28.715648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:28.715667Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:28.715670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:28.715678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:28.715686Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3244 [2:7555897028159833943:12795]
2025-09-30T14:59:28.715705Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:28.715725Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:28.715733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:28.715737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:28.715740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:28.715757Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:28.715764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:28.715776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:28.715850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.715857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.715860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.715863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:28.715866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:28.715954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:28.715962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.715976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.715989Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.716008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:28.716031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637313:2454], now have 1 active actors on pipe
2025-09-30T14:59:28.716039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637402:3598], now have 1 active actors on pipe
2025-09-30T14:59:28.716046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897028159833938:12795]
2025-09-30T14:59:28.716049Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897028159833938:12795]
2025-09-30T14:59:28.716051Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897028159833938:12795]
2025-09-30T14:59:28.716067Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:28.716087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:28.716094Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:28.716098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:28.716100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:28.716107Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:28.716112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:28.716116Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3244
2025-09-30T14:59:28.716150Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897028159833938:12795]
2025-09-30T14:59:28.716122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3244
2025-09-30T14:59:28.716160Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:28.716167Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:28.716201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.716211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.716245Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:28.716256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:28.716260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:28.716263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:28.716274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:28.716282Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:28.716310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:28.716484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.716491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.716504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:28.716607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3245 partition: 0 MaxSeqNo: 42 sessionId: src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0
2025-09-30T14:59:28.716991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b3f02a-76d6a5cd-b48e509d-c295f9e4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:28.719820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0] Write session: try to update token
2025-09-30T14:59:28.719839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:28.728502Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:28.728532Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:28.728535Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:28.728537Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:28.728547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897028159833938:12795]
2025-09-30T14:59:28.728552Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897028159833938:12795]
2025-09-30T14:59:28.728556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897028159833938:12795]
2025-09-30T14:59:28.728595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:28.728603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.728603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:28.728608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:28.728609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:28.728614Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:28.728753Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:28.734882Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3245 sessionId: src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:28.737759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:28.795884Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897028249637410:4275]
2025-09-30T14:59:28.796244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3244, pipe: [1:7555897028249637410:4275]
2025-09-30T14:59:28.840945Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:28.841298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.841312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.841354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637410:4275], now have 1 active actors on pipe
2025-09-30T14:59:28.841608Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:28.841714Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:28.841808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897028249637410:4275]
2025-09-30T14:59:28.841833Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:28.841917Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3245 reason: status is not ok: tablet will be restarted right now sessionId: src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0
2025-09-30T14:59:28.842117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3245 sessionId: src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0 is DEAD
2025-09-30T14:59:28.842296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:28.842308Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0] Write session will restart in 0.007690s
2025-09-30T14:59:28.842332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0] Write session: Do CDS request
2025-09-30T14:59:28.842338Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:28.850880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:28.851188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:28.851216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3246
2025-09-30T14:59:28.851392Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3246 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:28.851437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3246 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:28.851447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3246 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:28.851452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:28.851965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3246 sessionId:  describe result for acl check
2025-09-30T14:59:28.852011Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:28.852013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:28.852015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:28.852022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897028249637467:3578] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:28.852655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897028249637467:3578] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:28.854576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:28.855896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897028249637467:3578] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:28.856781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:28.857036Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:28.857047Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:28.857059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:28.857126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:28.857171Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897028159834033:12797]
2025-09-30T14:59:28.857861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:28.858168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:28.858224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:28.858596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:28.858662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.858668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.858670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.858671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.858673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.858674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.858676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.858677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.858681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.858682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.858684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.858685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.858687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.858688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.858689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.858696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.858707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.858712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.858716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.858721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.858726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.858730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.858736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.858740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.858744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.858748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.858752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.858756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.858760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.858763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.858771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.858744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897028249637467:3578] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:28.858779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:28.858785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.858791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:28.858795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.858762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897028249637467:3578] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:28.858765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897028249637467:3578] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:28.858800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:28.858775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3246 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:28.858805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.858810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:28.858816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.858823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:28.858827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.858833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:28.858838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.858842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:28.858846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.858851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:28.858857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.858861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:28.858866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.858870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:28.858876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.858888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.858893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.858903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.858909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.858918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.858923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.858927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:28.858937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.858942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:28.858991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:28.864861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:28.865806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:28.865832Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:28.865835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:28.865839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:28.865846Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3245 [2:7555897028159834033:12797]
2025-09-30T14:59:28.865868Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:28.865885Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:28.865895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:28.865898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:28.865905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:28.865924Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:28.865935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:28.865947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:28.866016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.866024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.866026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.866030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:28.866033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:28.866106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:28.866114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.866130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:28.866147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:28.866175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:28.866196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637513:3578], now have 1 active actors on pipe
2025-09-30T14:59:28.866199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637425:2454], now have 1 active actors on pipe
2025-09-30T14:59:28.866206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897028159834028:12797]
2025-09-30T14:59:28.866208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897028159834028:12797]
2025-09-30T14:59:28.866210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897028159834028:12797]
2025-09-30T14:59:28.866229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:28.866245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:28.866260Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:28.866264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:28.866304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897028159834028:12797]
2025-09-30T14:59:28.866313Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:28.866326Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:28.866329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:28.866332Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:28.866338Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:28.866274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3245
2025-09-30T14:59:28.866282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3245
2025-09-30T14:59:28.866509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.866519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.866544Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|436964ee-5208524d-1845e7c4-b315c99b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:28.866558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:28.866566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:28.866568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:28.866578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:28.866589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:28.866608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:28.866816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.866830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.866852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:28.866958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3246 partition: 0 MaxSeqNo: 42 sessionId: src_id|436964ee-5208524d-1845e7c4-b315c99b_0
2025-09-30T14:59:28.867319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|94dff0f4-3730f24b-ecd2a14a-b0a9d5cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|436964ee-5208524d-1845e7c4-b315c99b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:28.870198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436964ee-5208524d-1845e7c4-b315c99b_0] Write session: try to update token
2025-09-30T14:59:28.870222Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436964ee-5208524d-1845e7c4-b315c99b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:28.885184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3246 sessionId: src_id|436964ee-5208524d-1845e7c4-b315c99b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:28.888237Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:28.894131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:28.894164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:28.894189Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:28.894193Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:28.894202Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897028159834028:12797]
2025-09-30T14:59:28.894268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:28.894270Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:28.894476Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:28.894625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:28.895158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:28.895409Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:28.895632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:28.895693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:28.895721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:28.895868Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:28.900819Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:28.900842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:28.900844Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:28.900848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:28.900857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897028159834028:12797]
2025-09-30T14:59:28.900863Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897028159834028:12797]
2025-09-30T14:59:28.900867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897028159834028:12797]
2025-09-30T14:59:28.900898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:28.900908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:28.900911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:28.900915Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:28.900931Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:28.900935Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:28.901058Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:28.945325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897028249637536:4275]
2025-09-30T14:59:28.945691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3245, pipe: [1:7555897028249637536:4275]
2025-09-30T14:59:29.020350Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:29.029205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.029236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.029432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:29.029505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:29.029577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:29.029646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:29.029695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:29.029704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:29.029785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:29.029849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:29.029918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:29.029989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:29.030035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:29.030042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:29.030113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:29.030177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:29.030256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:29.030324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:29.030766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:29.030777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:29.030849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:29.031172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:29.031286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:29.031357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:29.031402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:29.031409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:29.031484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:29.031554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:29.031624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:29.031698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:29.031745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:29.031756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:29.031830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:29.031896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:29.031966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:29.032037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:29.032088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:29.032099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:29.032174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:29.032234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:29.032299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:29.032360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:29.032400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:29.032403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:29.032480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:29.034285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436964ee-5208524d-1845e7c4-b315c99b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:29.034316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436964ee-5208524d-1845e7c4-b315c99b_0] Write session will restart in 0.006637s
2025-09-30T14:59:29.032554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:29.032619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:29.032681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:29.032725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:29.032728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:29.032798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:29.032853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:29.032909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:29.032973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:29.033020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:29.033022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:29.034348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436964ee-5208524d-1845e7c4-b315c99b_0] Write session: Do CDS request
2025-09-30T14:59:29.033090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:29.033151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:29.034356Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436964ee-5208524d-1845e7c4-b315c99b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:29.033225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:29.033292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:29.033333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:29.033337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:29.033404Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897028249637536:4275], now have 1 active actors on pipe
2025-09-30T14:59:29.033937Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:29.033753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897028249637536:4275]
2025-09-30T14:59:29.033799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:29.033814Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:29.033848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3246 reason: error at write: Disconnected sessionId: src_id|436964ee-5208524d-1845e7c4-b315c99b_0
2025-09-30T14:59:29.034041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:29.034059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3246 sessionId: src_id|436964ee-5208524d-1845e7c4-b315c99b_0 is DEAD
2025-09-30T14:59:29.041800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|436964ee-5208524d-1845e7c4-b315c99b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:29.042463Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:29.042482Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3247
2025-09-30T14:59:29.042731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3247 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:29.042771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3247 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:29.042774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3247 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:29.042778Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:29.043234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3247 sessionId:  describe result for acl check
2025-09-30T14:59:29.043357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:29.043360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:29.043362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:29.043369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897032544604858:3551] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:29.043888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897032544604858:3551] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:29.047690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897032544604858:3551] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:29.051498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:29.051638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897032544604858:3551] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:29.051657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897032544604858:3551] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:29.051661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897032544604858:3551] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:29.051670Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3247 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:29.056891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:29.057184Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:29.057195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:29.057206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:29.057271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:29.057324Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897032454801456:12811]
2025-09-30T14:59:29.057908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:29.058367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:29.058465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:29.058909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:29.059015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.059026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.059027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.059028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.059030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.059031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.059033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.059034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.059035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.059041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.059042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.059043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.059045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.059046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.059048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.059056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.059066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.059070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.059075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.059079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.059083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.059087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.059091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.059095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.059099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.059104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.059108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.059112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.059115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.059119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.059129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.059139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.059146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.059151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.059155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.059161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.059165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.059171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.059177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.059182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.059188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.059193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.059198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.059203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.059208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.059213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.059218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.059223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.059227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.059233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.059238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.059259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.059263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.059268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.059272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.059277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.059281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.059286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.059291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.059296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.059343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:29.065371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:29.066397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:29.066404Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:29.066408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:29.066413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:29.066422Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3246 [2:7555897032454801456:12811]
2025-09-30T14:59:29.066443Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:29.066462Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:29.066466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:29.066469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:29.066472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:29.066493Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:29.066500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:29.066507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:29.066581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.066584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.066586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.066590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:29.066592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:29.066679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:29.066681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.066696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.066708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.066723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:29.066742Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897032454801449:12811]
2025-09-30T14:59:29.066744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897032454801449:12811]
2025-09-30T14:59:29.066746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897032454801449:12811]
2025-09-30T14:59:29.066768Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:29.066786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:29.066801Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:29.066805Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:29.066841Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:29.066846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897032454801449:12811]
2025-09-30T14:59:29.066846Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:29.066849Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:29.066849Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:29.066857Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:29.067172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544604930:3551], now have 1 active actors on pipe
2025-09-30T14:59:29.067187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544604843:2454], now have 1 active actors on pipe
2025-09-30T14:59:29.067232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3246
2025-09-30T14:59:29.067324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.067346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.067378Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:29.067395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:29.067400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:29.067402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:29.067418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:29.067434Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:29.067462Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3246
2025-09-30T14:59:29.067457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:29.067683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.067696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.067720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:29.067818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3247 partition: 0 MaxSeqNo: 42 sessionId: src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0
2025-09-30T14:59:29.068249Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|436964ee-5208524d-1845e7c4-b315c99b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:29.071300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0] Write session: try to update token
2025-09-30T14:59:29.071324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:29.080887Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:29.080922Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:29.080926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:29.080929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:29.080940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897032454801449:12811]
2025-09-30T14:59:29.080947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897032454801449:12811]
2025-09-30T14:59:29.080952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897032454801449:12811]
2025-09-30T14:59:29.081003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:29.081011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.081012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:29.081014Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:29.081020Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:29.081024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:29.081211Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:29.089429Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3247 sessionId: src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:29.092473Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:29.133809Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897032544604942:4275]
2025-09-30T14:59:29.134144Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3246, pipe: [1:7555897032544604942:4275]
2025-09-30T14:59:29.202615Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:29.203021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.203038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.203058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544604942:4275], now have 1 active actors on pipe
2025-09-30T14:59:29.203353Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:29.203358Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897032544604942:4275]
2025-09-30T14:59:29.203380Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:29.203463Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3247 reason: status is not ok: tablet will be restarted right now sessionId: src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0
2025-09-30T14:59:29.203337Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:29.203672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3247 sessionId: src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0 is DEAD
2025-09-30T14:59:29.203806Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:29.203818Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0] Write session will restart in 0.008510s
2025-09-30T14:59:29.203842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0] Write session: Do CDS request
2025-09-30T14:59:29.203849Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:29.214806Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:29.217418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:29.217436Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3248
2025-09-30T14:59:29.218599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:29.217724Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3248 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:29.217765Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3248 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:29.217771Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3248 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:29.217776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:29.218169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3248 sessionId:  describe result for acl check
2025-09-30T14:59:29.218196Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:29.218198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:29.218199Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:29.218205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897032544604998:3526] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:29.218768Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897032544604998:3526] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:29.221297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:29.221561Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:29.221574Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:29.221586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:29.221648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:29.221692Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897032454801548:12814]
2025-09-30T14:59:29.222446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:29.222875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:29.222945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:29.223363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:29.223450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.223462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.223463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.223464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.223465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.223467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.223468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.223470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.223471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.223472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.223473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.223475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.223476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.223477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.223478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.223484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.223495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.223499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.223503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.223507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.223511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.223515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.223519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.223523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.223528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.223531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.223535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.223539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.223542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.223546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.223554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.223564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.223574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.223580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.223584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.223589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.223594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.223600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.223604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.223609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.223613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.223636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.223641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.223646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.223652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.223657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.223662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.223666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.223673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.223679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.223684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.223689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.223693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.223699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.223703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.223709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.223713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.223718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.223723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.223728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.223772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:29.225597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897032544604998:3526] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:29.230840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897032544604998:3526] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:29.230859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897032544604998:3526] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:29.230863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897032544604998:3526] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:29.230900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3248 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:29.231377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:29.232453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:29.232470Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:29.232473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:29.232481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:29.232490Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3247 [2:7555897032454801548:12814]
2025-09-30T14:59:29.232509Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:29.232544Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:29.232553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:29.232556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:29.232559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:29.232578Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:29.232591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:29.232601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:29.232686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.232696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.232699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.232702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:29.232705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:29.232789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:29.232798Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.232812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.232830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.232852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:29.232878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897032454801543:12814]
2025-09-30T14:59:29.232886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897032454801543:12814]
2025-09-30T14:59:29.232889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897032454801543:12814]
2025-09-30T14:59:29.232908Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:29.232929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:29.232950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:29.232958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:29.232968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:29.232987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:29.232995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:29.232998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897032454801543:12814]
2025-09-30T14:59:29.233001Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:29.233377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3247
2025-09-30T14:59:29.233409Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3247
2025-09-30T14:59:29.233089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:29.233161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544605037:3526], now have 1 active actors on pipe
2025-09-30T14:59:29.233206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544604943:2454], now have 1 active actors on pipe
2025-09-30T14:59:29.233599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.233607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.233642Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:29.233654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:29.233675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:29.233677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:29.233693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:29.233711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:29.233735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:29.234176Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3248 partition: 0 MaxSeqNo: 42 sessionId: src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0
2025-09-30T14:59:29.235494Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|efdcb5aa-ab840dcc-3491f293-6eb1b26a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:29.234003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.234013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.234045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:29.238551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0] Write session: try to update token
2025-09-30T14:59:29.238570Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:29.252106Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:29.252131Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:29.252147Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897032454801543:12814]
2025-09-30T14:59:29.252199Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:29.252202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:29.252438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:29.252631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:29.252829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:29.253060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:29.253303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:29.253358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:29.267052Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3248 sessionId: src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:29.270231Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:29.270257Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:29.270260Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:29.270281Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:29.270294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897032454801543:12814]
2025-09-30T14:59:29.270300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897032454801543:12814]
2025-09-30T14:59:29.270306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897032454801543:12814]
2025-09-30T14:59:29.270360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:29.270203Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:29.270371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:29.270377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.270378Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:29.270380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:29.270383Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:29.270597Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:29.303357Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897032544605044:4275]
2025-09-30T14:59:29.305652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3247, pipe: [1:7555897032544605044:4275]
2025-09-30T14:59:29.397090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:29.397564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.397583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.397606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544605044:4275], now have 1 active actors on pipe
2025-09-30T14:59:29.397927Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:29.398042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897032544605044:4275]
2025-09-30T14:59:29.398084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:29.398088Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:29.398153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3248 reason: error at write: Disconnected sessionId: src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0
2025-09-30T14:59:29.398349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3248 sessionId: src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0 is DEAD
2025-09-30T14:59:29.398508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:29.398522Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0] Write session will restart in 0.009780s
2025-09-30T14:59:29.398506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:29.398551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0] Write session: Do CDS request
2025-09-30T14:59:29.398561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:29.408464Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:29.409805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:29.409870Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:29.409885Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3249
2025-09-30T14:59:29.410028Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3249 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:29.410071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3249 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:29.410084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3249 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:29.410089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:29.410565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3249 sessionId:  describe result for acl check
2025-09-30T14:59:29.410618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:29.410620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:29.410622Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:29.410628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897032544605106:3514] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:29.410669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:29.410946Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:29.410964Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:29.410982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:29.411077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:29.411169Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897032454801640:12816]
2025-09-30T14:59:29.411198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897032544605106:3514] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:29.411925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:29.412326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:29.412392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:29.412774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:29.412835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.412837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.412838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.412839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.412841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.412846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.412848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.412849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.412850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.412851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.412852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.412853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.412854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.412854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.412855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.412861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.412870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.412874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.412878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.412881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.412885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.412889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.412892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.412895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.412899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.412902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.412905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.412909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.412912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.412915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.412923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.412930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.412936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.412942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.412947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.412952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.412959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.412963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.412967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.412972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.412977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.412983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.412988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.412993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.412997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.413002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.413007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.413011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.413015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.413020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.413024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.413028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.413032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.413037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.413041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.413046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.413052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.413056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.413060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.413065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.413104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:29.413214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897032544605106:3514] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:29.426726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897032544605106:3514] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:29.426749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897032544605106:3514] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:29.426753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897032544605106:3514] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:29.426763Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3249 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:29.429549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:29.430461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:29.430481Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:29.430484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:29.430489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:29.430496Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3248 [2:7555897032454801640:12816]
2025-09-30T14:59:29.430515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:29.430539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:29.430549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:29.430553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:29.430555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:29.430572Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:29.430585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:29.430592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:29.430674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.430682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.430685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.430689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:29.430692Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:29.430766Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:29.430774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.430786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.430802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.430819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:29.430839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897032454801635:12816]
2025-09-30T14:59:29.430847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897032454801635:12816]
2025-09-30T14:59:29.430849Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897032454801635:12816]
2025-09-30T14:59:29.430859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:29.430874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:29.430878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:29.430879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:29.430880Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:29.430898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:29.430901Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:29.430913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544605146:3514], now have 1 active actors on pipe
2025-09-30T14:59:29.430918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544605054:2454], now have 1 active actors on pipe
2025-09-30T14:59:29.430955Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897032454801635:12816]
2025-09-30T14:59:29.430966Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:29.431016Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3248
2025-09-30T14:59:29.431050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3248
2025-09-30T14:59:29.431354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:29.431635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.431646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.431687Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:29.431705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:29.431712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:29.431714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:29.431729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:29.431746Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:29.431769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:29.432450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.432467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.432496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:29.432677Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3249 partition: 0 MaxSeqNo: 42 sessionId: src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0
2025-09-30T14:59:29.435573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12b84476-8aa7e44-b4481f6d-ceb48fd0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:29.438595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0] Write session: try to update token
2025-09-30T14:59:29.438619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:29.456388Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:29.456408Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:29.456411Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:29.456414Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:29.456425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897032454801635:12816]
2025-09-30T14:59:29.456430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897032454801635:12816]
2025-09-30T14:59:29.456438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897032454801635:12816]
2025-09-30T14:59:29.456481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:29.456491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.456493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:29.456674Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:29.458188Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:29.458197Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:29.458201Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:29.465263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3249 sessionId: src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:29.468311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:29.497801Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897032544605154:4275]
2025-09-30T14:59:29.504220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3248, pipe: [1:7555897032544605154:4275]
2025-09-30T14:59:29.579094Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:29.579593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.579611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.579651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544605154:4275], now have 1 active actors on pipe
2025-09-30T14:59:29.579879Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:29.579964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897032544605154:4275]
2025-09-30T14:59:29.580001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:29.580004Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:29.580063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3249 reason: error at write: Disconnected sessionId: src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0
2025-09-30T14:59:29.580237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3249 sessionId: src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0 is DEAD
2025-09-30T14:59:29.580403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:29.580677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:29.580689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0] Write session will restart in 0.009814s
2025-09-30T14:59:29.580720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0] Write session: Do CDS request
2025-09-30T14:59:29.580730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:29.591754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:29.591868Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:29.591884Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3250
2025-09-30T14:59:29.592029Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3250 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:29.592054Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3250 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:29.592059Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3250 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:29.592064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:29.592552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3250 sessionId:  describe result for acl check
2025-09-30T14:59:29.592583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:29.592585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:29.592588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:29.592593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897032544605210:3490] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:29.593122Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897032544605210:3490] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:29.594879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897032544605210:3490] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:29.596470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:29.598461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:29.598672Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:29.598680Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:29.598691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:29.598749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:29.598789Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897032454801745:12819]
2025-09-30T14:59:29.599569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:29.599924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:29.599962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:29.600237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897032544605210:3490] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:29.600254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897032544605210:3490] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:29.600258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897032544605210:3490] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:29.600274Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3250 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:29.600319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:29.600381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.600386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.600388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.600389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.600390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.600392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.600393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.600395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.600397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.600398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.600399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.600401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.600404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.600405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.600406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.600411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.600422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.600426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.600430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.600434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.600438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.600442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.600446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.600450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.600454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.600458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.600462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.600466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.600470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.600474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.600482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.600489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.600495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.600500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.600505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.600510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.600528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.600533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.600539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.600544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.600549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.600555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.600559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.600565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.600569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.600575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.600580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.600586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.600590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.600596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.600601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.600606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.600610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.600615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.600625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.600630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.600634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.600639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.600648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.600653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.600696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:29.606403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:29.607475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:29.607489Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:29.607492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:29.607497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:29.607504Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3249 [2:7555897032454801745:12819]
2025-09-30T14:59:29.607522Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:29.607540Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:29.607543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:29.607547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:29.607551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:29.607566Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:29.607577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:29.607585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:29.607647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.607655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.607657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.607661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:29.607664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:29.607738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:29.607746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.607760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.607773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.607793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:29.607811Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897032454801740:12819]
2025-09-30T14:59:29.607814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897032454801740:12819]
2025-09-30T14:59:29.607816Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897032454801740:12819]
2025-09-30T14:59:29.607829Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:29.607848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:29.607868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:29.607875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:29.607885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:29.607895Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:29.607897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:29.607910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897032454801740:12819]
2025-09-30T14:59:29.607913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:29.607988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:29.608042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544605249:3490], now have 1 active actors on pipe
2025-09-30T14:59:29.608048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544605157:2454], now have 1 active actors on pipe
2025-09-30T14:59:29.608177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.608183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.608218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|476c25f-7e15871-ade95e9a-d82f1195_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:29.608227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:29.608230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:29.608233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:29.608243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:29.608254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:29.608273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:29.608133Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3249
2025-09-30T14:59:29.608169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3249
2025-09-30T14:59:29.608531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.608550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.608565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:29.608683Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3250 partition: 0 MaxSeqNo: 42 sessionId: src_id|476c25f-7e15871-ade95e9a-d82f1195_0
2025-09-30T14:59:29.609412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9b4291-e314ea81-51d3fac5-e4a69f1a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|476c25f-7e15871-ade95e9a-d82f1195_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:29.612441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476c25f-7e15871-ade95e9a-d82f1195_0] Write session: try to update token
2025-09-30T14:59:29.612464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476c25f-7e15871-ade95e9a-d82f1195_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:29.621055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:29.621070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:29.621080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897032454801740:12819]
2025-09-30T14:59:29.621127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:29.621323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:29.621473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:29.621623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:29.621769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:29.621978Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:29.622016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:29.622502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:29.633809Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:29.633827Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:29.633829Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:29.633831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:29.633842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897032454801740:12819]
2025-09-30T14:59:29.633847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897032454801740:12819]
2025-09-30T14:59:29.633852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897032454801740:12819]
2025-09-30T14:59:29.633893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:29.633898Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:29.633901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:29.633901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:29.633908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.633911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:29.634049Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:29.641548Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3250 sessionId: src_id|476c25f-7e15871-ade95e9a-d82f1195_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:29.644501Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:29.679089Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897032544605258:4275]
2025-09-30T14:59:29.681524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3249, pipe: [1:7555897032544605258:4275]
2025-09-30T14:59:29.758538Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:29.758989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.759003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.759029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544605258:4275], now have 1 active actors on pipe
2025-09-30T14:59:29.759343Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:29.760355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476c25f-7e15871-ade95e9a-d82f1195_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:29.760364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476c25f-7e15871-ade95e9a-d82f1195_0] Write session will restart in 0.007795s
2025-09-30T14:59:29.760390Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476c25f-7e15871-ade95e9a-d82f1195_0] Write session: Do CDS request
2025-09-30T14:59:29.760396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476c25f-7e15871-ade95e9a-d82f1195_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:29.759876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897032544605258:4275]
2025-09-30T14:59:29.759919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:29.759994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3250 reason: status is not ok: tablet will be restarted right now sessionId: src_id|476c25f-7e15871-ade95e9a-d82f1195_0
2025-09-30T14:59:29.760181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3250 sessionId: src_id|476c25f-7e15871-ade95e9a-d82f1195_0 is DEAD
2025-09-30T14:59:29.760426Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:29.769893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|476c25f-7e15871-ade95e9a-d82f1195_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:29.770301Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:29.770316Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3251
2025-09-30T14:59:29.770484Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3251 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:29.770521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3251 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:29.770527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3251 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:29.770530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:29.772003Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3251 sessionId:  describe result for acl check
2025-09-30T14:59:29.772047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:29.772054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:29.772057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:29.772063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897032544605269:3478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:29.772656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897032544605269:3478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:29.779755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897032544605269:3478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:29.784194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:29.786505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897032544605269:3478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:29.786524Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897032544605269:3478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:29.786528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897032544605269:3478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:29.786537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3251 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:29.786061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:29.786294Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:29.786298Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:29.786309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:29.786363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:29.786401Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897032454801841:12822]
2025-09-30T14:59:29.787111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:29.787419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:29.787467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:29.787845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:29.787907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.787913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.787915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.787916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.787917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.787919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.787920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.787922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.787923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.787927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.787928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.787930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.787931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.787932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.787933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.787939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.787949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.787954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.787958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.787962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.787966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.787969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.787973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.787977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.787982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.787986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.787990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.787994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.787998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.788003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.788012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.788021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.788028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.788033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.788037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.788042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.788046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.788051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.788055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.788061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.788067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.788073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.788078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.788083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.788088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.788093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.788098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.788104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.788108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.788113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.788119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.788125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.788129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.788134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.788139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.788144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.788148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.788153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.788158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.788171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.788220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:29.793964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:29.795017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:29.795024Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:29.795028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:29.795032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:29.795039Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3250 [2:7555897032454801841:12822]
2025-09-30T14:59:29.795059Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:29.795080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:29.795083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:29.795088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:29.795090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:29.795106Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:29.795115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:29.795122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:29.795185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.795187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.795190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.795193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:29.795196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:29.795294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:29.795297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.795313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.795326Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.795346Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:29.795363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897032454801836:12822]
2025-09-30T14:59:29.795367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897032454801836:12822]
2025-09-30T14:59:29.795370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897032454801836:12822]
2025-09-30T14:59:29.795388Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:29.795402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:29.795418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:29.795425Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:29.795455Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:29.795460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:29.795460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897032454801836:12822]
2025-09-30T14:59:29.795462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:29.795463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:29.795470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:29.795881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3250
2025-09-30T14:59:29.795930Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3250
2025-09-30T14:59:29.796267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544605351:3478], now have 1 active actors on pipe
2025-09-30T14:59:29.796281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544605260:2454], now have 1 active actors on pipe
2025-09-30T14:59:29.796299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.796311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.796344Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:29.796360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:29.796368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:29.796371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:29.796384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:29.796402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:29.796423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:29.796679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.796689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.796720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:29.796846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3251 partition: 0 MaxSeqNo: 42 sessionId: src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0
2025-09-30T14:59:29.797416Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|476c25f-7e15871-ade95e9a-d82f1195_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:29.800502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0] Write session: try to update token
2025-09-30T14:59:29.800543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:29.809540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:29.809562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:29.809572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897032454801836:12822]
2025-09-30T14:59:29.809620Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:29.809808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:29.809961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:29.810112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:29.810258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:29.810494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:29.810537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:29.810753Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:29.820551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3251 sessionId: src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:29.823740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:29.824855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:29.824881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:29.824903Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:29.824906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:29.824909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:29.824916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:29.824925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897032454801836:12822]
2025-09-30T14:59:29.824929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897032454801836:12822]
2025-09-30T14:59:29.824935Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897032454801836:12822]
2025-09-30T14:59:29.824971Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:29.824981Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:29.824984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:29.824985Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:29.824991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.824994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:29.825135Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:29.859278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897032544605377:4275]
2025-09-30T14:59:29.859594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3250, pipe: [1:7555897032544605377:4275]
2025-09-30T14:59:29.959332Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:29.959595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:29.959622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544605377:4275], now have 1 active actors on pipe
2025-09-30T14:59:29.960111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:29.960195Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:29.960198Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:29.960268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3251 reason: error at write: Disconnected sessionId: src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0
2025-09-30T14:59:29.960348Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897032544605377:4275]
2025-09-30T14:59:29.960362Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:29.960409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3251 sessionId: src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0 is DEAD
2025-09-30T14:59:29.960934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:29.960942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0] Write session will restart in 0.007339s
2025-09-30T14:59:29.960969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0] Write session: Do CDS request
2025-09-30T14:59:29.960975Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:29.971677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:29.971766Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:29.971789Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3252
2025-09-30T14:59:29.975527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3252 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:29.975572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3252 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:29.975577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3252 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:29.975583Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:29.975957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3252 sessionId:  describe result for acl check
2025-09-30T14:59:29.975985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:29.975988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:29.975990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:29.975995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897032544605408:3444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:29.976492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897032544605408:3444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:29.980776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897032544605408:3444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:29.986328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:29.986778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897032544605408:3444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:29.986798Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897032544605408:3444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:29.986802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897032544605408:3444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:29.986811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3252 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:29.988383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:29.988681Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:29.988686Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:29.988698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:29.988763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:29.988798Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897032454801950:12830]
2025-09-30T14:59:29.989454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:29.989918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:29.989966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:29.990301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:29.990358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.990359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.990360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.990362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.990364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.990365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.990366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.990368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.990369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.990370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.990371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.990373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.990374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.990375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.990377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.990383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.990394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.990398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.990402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.990406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.990411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.990415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.990419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.990423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.990428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.990433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.990437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.990441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.990445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.990451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.990458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.990466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:29.990472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.990477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:29.990483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.990488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:29.990493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.990499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:29.990505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.990510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:29.990514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.990520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:29.990525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.990531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:29.990535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.990540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:29.990545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.990551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:29.990556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.990561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:29.990566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.990572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:29.990576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.990581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:29.990586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.990592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:29.990600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.990606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:29.990610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.990616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:29.990666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:30.000065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:30.000976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:30.000982Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:30.000984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:30.000988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:30.000994Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3251 [2:7555897032454801950:12830]
2025-09-30T14:59:30.001009Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:30.001030Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:30.001034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.001037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.001039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.001055Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:30.001061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:30.001068Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:30.001126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.001129Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.001131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.001135Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:30.001137Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:30.001211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:30.001213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.001226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.001239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.001256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:30.001273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897032454801943:12830]
2025-09-30T14:59:30.001277Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897032454801943:12830]
2025-09-30T14:59:30.001279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897032454801943:12830]
2025-09-30T14:59:30.001290Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:30.001304Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:30.001317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:30.001320Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:30.001357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897032454801943:12830]
2025-09-30T14:59:30.001361Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:30.001598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:30.001605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:30.001607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:30.001612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:30.001874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3251
2025-09-30T14:59:30.001906Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3251
2025-09-30T14:59:30.001932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544605484:3444], now have 1 active actors on pipe
2025-09-30T14:59:30.001938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897032544605395:2454], now have 1 active actors on pipe
2025-09-30T14:59:30.002103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.002110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.002135Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66802d46-377a854-586b1035-b478ccf9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:30.002142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.002148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.002150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:30.002159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.002170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:30.002184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.007798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.007812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.007840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.008207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3252 partition: 0 MaxSeqNo: 42 sessionId: src_id|66802d46-377a854-586b1035-b478ccf9_0
2025-09-30T14:59:30.008577Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|394cbe87-40d13bae-9fe5d924-5f469da3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|66802d46-377a854-586b1035-b478ccf9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:30.011480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66802d46-377a854-586b1035-b478ccf9_0] Write session: try to update token
2025-09-30T14:59:30.011501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66802d46-377a854-586b1035-b478ccf9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:30.021183Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:30.021204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:30.021206Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:30.021209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:30.021218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897032454801943:12830]
2025-09-30T14:59:30.021222Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897032454801943:12830]
2025-09-30T14:59:30.021227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897032454801943:12830]
2025-09-30T14:59:30.021270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:30.021277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.021280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:30.021424Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:30.023312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:30.023320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:30.023324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:30.038863Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3252 sessionId: src_id|66802d46-377a854-586b1035-b478ccf9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:30.041793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:30.060477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897036839572802:4275]
2025-09-30T14:59:30.060829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3251, pipe: [1:7555897036839572802:4275]
2025-09-30T14:59:30.157867Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897036839572802:4275]
2025-09-30T14:59:30.157907Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:30.157911Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:30.157978Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3252 reason: error at write: Disconnected sessionId: src_id|66802d46-377a854-586b1035-b478ccf9_0
2025-09-30T14:59:30.158162Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:30.158167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3252 sessionId: src_id|66802d46-377a854-586b1035-b478ccf9_0 is DEAD
2025-09-30T14:59:30.158315Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66802d46-377a854-586b1035-b478ccf9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:30.158327Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66802d46-377a854-586b1035-b478ccf9_0] Write session will restart in 0.006274s
2025-09-30T14:59:30.158351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66802d46-377a854-586b1035-b478ccf9_0] Write session: Do CDS request
2025-09-30T14:59:30.158357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66802d46-377a854-586b1035-b478ccf9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:30.157084Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:30.157546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.157555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.157576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839572802:4275], now have 1 active actors on pipe
2025-09-30T14:59:30.158264Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:30.165828Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66802d46-377a854-586b1035-b478ccf9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:30.166215Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:30.166234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3253
2025-09-30T14:59:30.166359Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3253 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:30.166394Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3253 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:30.166405Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3253 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:30.166409Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:30.166858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3253 sessionId:  describe result for acl check
2025-09-30T14:59:30.166899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:30.166902Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:30.166905Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:30.166911Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897036839572859:3437] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:30.167508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897036839572859:3437] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:30.169851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897036839572859:3437] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:30.168470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:30.170484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:30.170674Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:30.170684Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:30.170694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:30.170743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:30.170793Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897036749769364:12838]
2025-09-30T14:59:30.171463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:30.171785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:30.171833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:30.172180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:30.172342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.172350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.172352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.172353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.172354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.172356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.172357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.172359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.172360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.172361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.172363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.172364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.172365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.172366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.172368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.172374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.172385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.172389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.172393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.172397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.172402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.172406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.172410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.172415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.172419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.172423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.172427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.172431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.172435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.172439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.172447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.172455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.172461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.172467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.172476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.172481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.172487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.172493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.172498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.172504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.172524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.172530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.172535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.172541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.172559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.172569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.172575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.172585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.172589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.172599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.172604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.172613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.172618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.172628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.172632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.172642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.172647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.172654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.172664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.172670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.172717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:30.173224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897036839572859:3437] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:30.173239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897036839572859:3437] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:30.173243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897036839572859:3437] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:30.173251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3253 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:30.178199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:30.179454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:30.179465Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:30.179467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:30.179470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:30.179476Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3252 [2:7555897036749769364:12838]
2025-09-30T14:59:30.179486Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:30.179499Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:30.179501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.179503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.179505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.179520Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:30.179527Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:30.179534Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:30.179594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.179600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.179603Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.179605Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:30.179607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:30.179660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:30.179665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.179674Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.179681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.179691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:30.179704Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897036749769358:12838]
2025-09-30T14:59:30.179705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897036749769358:12838]
2025-09-30T14:59:30.179706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897036749769358:12838]
2025-09-30T14:59:30.179712Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:30.179722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:30.179731Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:30.179734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:30.179735Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:30.179737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:30.179737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:30.179769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839572804:2454], now have 1 active actors on pipe
2025-09-30T14:59:30.179775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839572901:3437], now have 1 active actors on pipe
2025-09-30T14:59:30.179777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897036749769358:12838]
2025-09-30T14:59:30.179782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:30.179790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:30.179878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3252
2025-09-30T14:59:30.179885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3252
2025-09-30T14:59:30.179944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.179957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.179988Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|895fff0d-ca372a5c-594149a-549443cb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:30.180003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.180010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.180013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:30.180023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.180035Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:30.180069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.180236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.180250Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.180271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.180427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3253 partition: 0 MaxSeqNo: 42 sessionId: src_id|895fff0d-ca372a5c-594149a-549443cb_0
2025-09-30T14:59:30.180794Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66802d46-377a854-586b1035-b478ccf9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|895fff0d-ca372a5c-594149a-549443cb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:30.183560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|895fff0d-ca372a5c-594149a-549443cb_0] Write session: try to update token
2025-09-30T14:59:30.183577Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|895fff0d-ca372a5c-594149a-549443cb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:30.191844Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:30.191861Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:30.191873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897036749769358:12838]
2025-09-30T14:59:30.191919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:30.191920Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:30.192091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:30.192230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:30.192362Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:30.192507Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:30.192797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:30.192837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:30.199537Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3253 sessionId: src_id|895fff0d-ca372a5c-594149a-549443cb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:30.202322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:30.202566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.202586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.202620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:30.202724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:30.204070Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:30.204088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:30.204091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:30.204094Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:30.204104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897036749769358:12838]
2025-09-30T14:59:30.204109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897036749769358:12838]
2025-09-30T14:59:30.204112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897036749769358:12838]
2025-09-30T14:59:30.204153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:30.204160Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.204165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:30.204181Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:30.204189Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:30.204194Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:30.204307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:30.258145Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897036839572909:4275]
2025-09-30T14:59:30.258504Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3252, pipe: [1:7555897036839572909:4275]
2025-09-30T14:59:30.325566Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:30.334475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.334511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.334704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.334780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.334851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.334930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.334994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.335004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.335081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.335149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.335220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.335331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.335385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.335396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.335472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.335547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.335625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.335702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.335745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.335749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.335822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.335892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.335959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.336040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.336093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.336107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.336182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.336245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.336405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.336473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.336540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.336545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.336623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.336686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.336755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.336824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.336865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.336869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.336945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.337006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.337073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.337137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.337182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.337186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.337257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.337314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.337379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.337442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.337489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.337492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.337597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.337660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.337721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.337786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.337830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.337833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.337908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.337969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.338033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.338102Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.338678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.338683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.338759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839572909:4275], now have 1 active actors on pipe
2025-09-30T14:59:30.339145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:30.339310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:30.339310Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897036839572909:4275]
2025-09-30T14:59:30.339325Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:30.339342Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:30.339351Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3253 reason: error at write: Disconnected sessionId: src_id|895fff0d-ca372a5c-594149a-549443cb_0
2025-09-30T14:59:30.339578Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3253 sessionId: src_id|895fff0d-ca372a5c-594149a-549443cb_0 is DEAD
2025-09-30T14:59:30.339706Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895fff0d-ca372a5c-594149a-549443cb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:30.339719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895fff0d-ca372a5c-594149a-549443cb_0] Write session will restart in 0.009467s
2025-09-30T14:59:30.339742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895fff0d-ca372a5c-594149a-549443cb_0] Write session: Do CDS request
2025-09-30T14:59:30.339748Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895fff0d-ca372a5c-594149a-549443cb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:30.350843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|895fff0d-ca372a5c-594149a-549443cb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:30.350906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:30.350936Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3254
2025-09-30T14:59:30.351110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3254 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:30.351166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3254 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:30.351175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3254 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:30.351179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:30.351694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3254 sessionId:  describe result for acl check
2025-09-30T14:59:30.351728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:30.351734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:30.351736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:30.351743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897036839572971:3428] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:30.352268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897036839572971:3428] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:30.352351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:30.354856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897036839572971:3428] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:30.354280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:30.354493Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:30.354497Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:30.354506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:30.354562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:30.354599Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897036749769465:12841]
2025-09-30T14:59:30.355311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:30.355683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:30.355757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:30.356102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:30.356186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.356193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.356195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.356197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.356198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.356200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.356201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.356203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.356204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.356206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.356207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.356209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.356210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.356211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.356213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.356218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.356229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.356234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.356238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.356242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.356246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.356250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.356254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.356258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.356263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.356267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.356271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.356276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.356280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.356285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.356294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.356303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.356309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.356318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.356323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.356329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.356334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.356340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.356345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.356350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.356354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.356359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.356364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.356369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.356373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.356378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.356383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.356388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.356393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.356399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.356404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.356410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.356416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.356421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.356426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.356431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.356435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.356441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.356446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.356451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.356492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:30.361757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897036839572971:3428] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:30.361776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897036839572971:3428] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:30.361780Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897036839572971:3428] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:30.361788Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3254 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:30.362090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:30.363151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:30.363167Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:30.363171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:30.363175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:30.363183Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3253 [2:7555897036749769465:12841]
2025-09-30T14:59:30.363204Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:30.363221Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:30.363224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.363227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.363229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.363259Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:30.363268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:30.363274Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:30.363335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.363343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.363345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.363350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:30.363353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:30.363418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:30.363424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.363438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.363464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.363485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:30.363507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839573014:3428], now have 1 active actors on pipe
2025-09-30T14:59:30.363515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839572913:2454], now have 1 active actors on pipe
2025-09-30T14:59:30.363521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897036749769460:12841]
2025-09-30T14:59:30.363524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897036749769460:12841]
2025-09-30T14:59:30.363526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897036749769460:12841]
2025-09-30T14:59:30.363538Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:30.363553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:30.363558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:30.363563Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:30.363565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:30.363572Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:30.363576Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:30.363610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897036749769460:12841]
2025-09-30T14:59:30.363618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:30.363621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:30.363571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3253
2025-09-30T14:59:30.363581Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3253
2025-09-30T14:59:30.363635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.363644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.363697Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:30.363708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.363712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.363714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:30.363723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.363736Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:30.363762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.363906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.363934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.363971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.364093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3254 partition: 0 MaxSeqNo: 42 sessionId: src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0
2025-09-30T14:59:30.364558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|895fff0d-ca372a5c-594149a-549443cb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:30.367730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0] Write session: try to update token
2025-09-30T14:59:30.367754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:30.376700Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:30.376722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:30.376724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:30.376727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:30.376737Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897036749769460:12841]
2025-09-30T14:59:30.376741Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897036749769460:12841]
2025-09-30T14:59:30.376745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897036749769460:12841]
2025-09-30T14:59:30.376785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:30.376792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.376795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:30.376796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:30.376804Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:30.376809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:30.376941Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:30.384612Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3254 sessionId: src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:30.387182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:30.439362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897036839573025:4275]
2025-09-30T14:59:30.439667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3253, pipe: [1:7555897036839573025:4275]
2025-09-30T14:59:30.491586Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:30.492100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.492115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.492136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839573025:4275], now have 1 active actors on pipe
2025-09-30T14:59:30.492377Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:30.492856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:30.492949Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3254 reason: status is not ok: tablet will be restarted right now sessionId: src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0
2025-09-30T14:59:30.493154Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3254 sessionId: src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0 is DEAD
2025-09-30T14:59:30.493325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:30.493340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0] Write session will restart in 0.009183s
2025-09-30T14:59:30.493367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0] Write session: Do CDS request
2025-09-30T14:59:30.493373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:30.493334Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:30.493389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897036839573025:4275]
2025-09-30T14:59:30.503483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:30.503741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:30.503860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:30.503879Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3255
2025-09-30T14:59:30.503995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3255 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:30.504028Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3255 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:30.504042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3255 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:30.504050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:30.504485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3255 sessionId:  describe result for acl check
2025-09-30T14:59:30.504536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:30.504544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:30.504546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:30.504552Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897036839573086:3419] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:30.505117Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897036839573086:3419] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:30.505308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:30.505503Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:30.505514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:30.505524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:30.505581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:30.505623Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897036749769562:12843]
2025-09-30T14:59:30.506304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:30.506624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:30.506706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:30.507088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:30.507157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.507158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.507159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.507161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.507162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.507163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.507165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.507166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.507167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.507168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.507170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.507171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.507172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.507173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.507174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.507179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.507189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.507192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.507196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.507200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.507204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.507209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.507213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.507216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.507220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.507224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.507228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.507232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.507236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.507240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.507330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897036839573086:3419] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:30.507376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.507389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.507395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.507400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.507404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.507409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.507422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.507431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.507437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.507441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.507447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.507452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.507457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.507462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.507466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.507471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.507477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.507481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.507486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.507491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.507503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.507508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.507518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.507524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.507533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.507537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.507541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.507551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.507555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.507560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.507606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:30.513026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897036839573086:3419] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:30.513048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897036839573086:3419] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:30.513053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897036839573086:3419] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:30.513064Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3255 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:30.513389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:30.514472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:30.514491Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:30.514494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:30.514498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:30.514505Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3254 [2:7555897036749769562:12843]
2025-09-30T14:59:30.514524Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:30.514543Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:30.514556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.514561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.514564Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.514585Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:30.514599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:30.514611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:30.514690Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.514700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.514702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.514706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:30.514709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:30.514794Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:30.514805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.514820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.514839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.514863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:30.514882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897036749769555:12843]
2025-09-30T14:59:30.514889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897036749769555:12843]
2025-09-30T14:59:30.514892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897036749769555:12843]
2025-09-30T14:59:30.514901Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:30.514919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:30.514939Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:30.514944Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:30.514946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:30.514947Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:30.514949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:30.514990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897036749769555:12843]
2025-09-30T14:59:30.514999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:30.515011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839573125:3419], now have 1 active actors on pipe
2025-09-30T14:59:30.515015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839573026:2454], now have 1 active actors on pipe
2025-09-30T14:59:30.515028Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:30.515104Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3254
2025-09-30T14:59:30.515149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3254
2025-09-30T14:59:30.515209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.515219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.515269Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5188fed2-5644d5de-cb541adc-8121a47f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:30.515283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.515287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.515294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:30.515306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.515321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:30.515345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.515513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.515528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.515554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.515692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3255 partition: 0 MaxSeqNo: 42 sessionId: src_id|5188fed2-5644d5de-cb541adc-8121a47f_0
2025-09-30T14:59:30.516103Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|da1d85a4-2782f88e-b9a2b1d0-13e80829_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5188fed2-5644d5de-cb541adc-8121a47f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:30.519074Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5188fed2-5644d5de-cb541adc-8121a47f_0] Write session: try to update token
2025-09-30T14:59:30.519097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5188fed2-5644d5de-cb541adc-8121a47f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:30.529674Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:30.529696Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:30.529705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897036749769555:12843]
2025-09-30T14:59:30.529750Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:30.529774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:30.529932Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:30.530084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:30.530231Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:30.530380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:30.530577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:30.530614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:30.534774Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3255 sessionId: src_id|5188fed2-5644d5de-cb541adc-8121a47f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:30.537968Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:30.538179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.538217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.538276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:30.538353Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:30.541418Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:30.541434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:30.541436Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:30.541438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:30.541447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897036749769555:12843]
2025-09-30T14:59:30.541451Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897036749769555:12843]
2025-09-30T14:59:30.541456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897036749769555:12843]
2025-09-30T14:59:30.541493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:30.541502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.541504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:30.541510Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:30.541518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:30.541522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:30.541655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:30.593505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897036839573133:4275]
2025-09-30T14:59:30.593824Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3254, pipe: [1:7555897036839573133:4275]
2025-09-30T14:59:30.650932Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:30.658430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.658459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.658641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.658710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.658772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.658831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.658892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.658904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.658985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.659049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.659120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.659193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.659261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.659271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.659344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.659411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.659479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.659549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.659597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.659604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.659679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.659746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.659811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.659879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.659925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.659932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.660002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.660065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.660131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.660197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.660245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.660252Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.660323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.660387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.660451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.660533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.660581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.660588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.660657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.660722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.660788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.660852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.660899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.660905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.660973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.661038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.661107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.661179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.661225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.661231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.661303Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.661369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.661434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.661498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.661540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.661545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.661610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:30.661667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:30.661741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:30.661812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:30.661859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:30.661866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:30.661934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839573133:4275], now have 1 active actors on pipe
2025-09-30T14:59:30.662181Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:30.662190Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897036839573133:4275]
2025-09-30T14:59:30.662216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:30.662218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:30.662243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3255 reason: error at write: Disconnected sessionId: src_id|5188fed2-5644d5de-cb541adc-8121a47f_0
2025-09-30T14:59:30.662465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3255 sessionId: src_id|5188fed2-5644d5de-cb541adc-8121a47f_0 is DEAD
2025-09-30T14:59:30.662618Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5188fed2-5644d5de-cb541adc-8121a47f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:30.662631Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5188fed2-5644d5de-cb541adc-8121a47f_0] Write session will restart in 0.006360s
2025-09-30T14:59:30.662655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5188fed2-5644d5de-cb541adc-8121a47f_0] Write session: Do CDS request
2025-09-30T14:59:30.662661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5188fed2-5644d5de-cb541adc-8121a47f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:30.663027Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:30.669771Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5188fed2-5644d5de-cb541adc-8121a47f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:30.669945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:30.669961Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3256
2025-09-30T14:59:30.670113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3256 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:30.670153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3256 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:30.670168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3256 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:30.670172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:30.670548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3256 sessionId:  describe result for acl check
2025-09-30T14:59:30.670577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:30.670579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:30.670580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:30.670584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897036839573192:3408] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:30.671118Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897036839573192:3408] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:30.672224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:30.673676Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897036839573192:3408] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:30.674169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:30.674398Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:30.674416Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:30.674431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:30.674523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:30.674580Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897036749769675:12847]
2025-09-30T14:59:30.675365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:30.675722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:30.675775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:30.676043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:30.676092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.676098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.676099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.676100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.676101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.676102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.676103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.676104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.676104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.676105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.676106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.676107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.676107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.676108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.676109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.676113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.676120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.676123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.676125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.676128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.676130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.676133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.676135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.676138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.676140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.676143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.676145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.676147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.676150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.676155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.676160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.676167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.676172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.676175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.676178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.676182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.676184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.676188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.676190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.676193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.676196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.676199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.676201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.676205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.676209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.676212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.676215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.676218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.676220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.676224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.676226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.676229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.676232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.676236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.676238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.676241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.676244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.676247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.676250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.676252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.676278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:30.676584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897036839573192:3408] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:30.676597Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897036839573192:3408] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:30.676601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897036839573192:3408] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:30.676610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3256 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:30.681700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:30.682614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:30.682628Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:30.682636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:30.682640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:30.682647Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3255 [2:7555897036749769675:12847]
2025-09-30T14:59:30.682665Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:30.682681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:30.682684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.682687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.682691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.682706Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:30.682713Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:30.682726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:30.682789Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.682799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.682802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.682805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:30.682808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:30.682874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:30.682882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.682895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.682913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.682936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:30.682958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839573134:2454], now have 1 active actors on pipe
2025-09-30T14:59:30.682966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839573234:3408], now have 1 active actors on pipe
2025-09-30T14:59:30.682973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897036749769668:12847]
2025-09-30T14:59:30.682976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897036749769668:12847]
2025-09-30T14:59:30.682978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897036749769668:12847]
2025-09-30T14:59:30.682994Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:30.683015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:30.683033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:30.683042Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:30.683014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3255
2025-09-30T14:59:30.683036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3255
2025-09-30T14:59:30.683078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897036749769668:12847]
2025-09-30T14:59:30.683085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:30.683085Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:30.683089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:30.683091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:30.683104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:30.683108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.683112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.683152Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c3264c2-25054199-57929ead-122bbb1b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:30.683168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.683172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.683174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:30.683184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.683193Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:30.683209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.683319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.683327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.683340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.683421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3256 partition: 0 MaxSeqNo: 42 sessionId: src_id|1c3264c2-25054199-57929ead-122bbb1b_0
2025-09-30T14:59:30.683801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5188fed2-5644d5de-cb541adc-8121a47f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1c3264c2-25054199-57929ead-122bbb1b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:30.686593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3264c2-25054199-57929ead-122bbb1b_0] Write session: try to update token
2025-09-30T14:59:30.686612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3264c2-25054199-57929ead-122bbb1b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:30.695796Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:30.695824Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:30.695826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:30.695828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:30.695838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897036749769668:12847]
2025-09-30T14:59:30.695844Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897036749769668:12847]
2025-09-30T14:59:30.695851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897036749769668:12847]
2025-09-30T14:59:30.695905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:30.695910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:30.695917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:30.695922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:30.695922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.695925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:30.696116Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:30.702933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3256 sessionId: src_id|1c3264c2-25054199-57929ead-122bbb1b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:30.705764Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:30.762447Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897036839573242:4275]
2025-09-30T14:59:30.762771Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3255, pipe: [1:7555897036839573242:4275]
2025-09-30T14:59:30.810559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:30.811107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.811123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.811144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839573242:4275], now have 1 active actors on pipe
2025-09-30T14:59:30.811385Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:30.811423Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:30.811439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897036839573242:4275]
2025-09-30T14:59:30.811469Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:30.811556Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3256 reason: status is not ok: tablet will be restarted right now sessionId: src_id|1c3264c2-25054199-57929ead-122bbb1b_0
2025-09-30T14:59:30.811732Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3256 sessionId: src_id|1c3264c2-25054199-57929ead-122bbb1b_0 is DEAD
2025-09-30T14:59:30.811914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3264c2-25054199-57929ead-122bbb1b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:30.811928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3264c2-25054199-57929ead-122bbb1b_0] Write session will restart in 0.008832s
2025-09-30T14:59:30.811953Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3264c2-25054199-57929ead-122bbb1b_0] Write session: Do CDS request
2025-09-30T14:59:30.811959Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3264c2-25054199-57929ead-122bbb1b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:30.821808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3264c2-25054199-57929ead-122bbb1b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:30.821872Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:30.821890Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3257
2025-09-30T14:59:30.822055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3257 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:30.822087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3257 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:30.822094Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3257 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:30.822098Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:30.822514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3257 sessionId:  describe result for acl check
2025-09-30T14:59:30.822542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:30.822550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:30.822551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:30.822557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897036839573306:3398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:30.822561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:30.823094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897036839573306:3398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:30.824530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:30.824741Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:30.824753Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:30.824763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:30.824817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:30.824857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897036749769774:12849]
2025-09-30T14:59:30.825494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897036839573306:3398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:30.825530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:30.825860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:30.825925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:30.826338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:30.826423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.826430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.826432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.826433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.826434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.826436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.826437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.826438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.826439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.826441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.826442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.826443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.826444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.826445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.826447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.826453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.826464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.826468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.826473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.826477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.826482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.826486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.826491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.826495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.826500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.826504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.826507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.826510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.826513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.826516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.826526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.826535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.826542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.826549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.826554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.826561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.826566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.826572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.826576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.826582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.826587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.826592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.826598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.826603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.826608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.826614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.826619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.826632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.826637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.826642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.826652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.826658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.826667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.826672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.826678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.826684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.826688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.826693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.826699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.826709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.826756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:30.832032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897036839573306:3398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:30.832049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897036839573306:3398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:30.832053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897036839573306:3398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:30.832061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3257 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:30.832319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:30.833245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:30.833263Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:30.833266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:30.833270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:30.833278Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3256 [2:7555897036749769774:12849]
2025-09-30T14:59:30.833297Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:30.833316Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:30.833326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.833329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.833332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.833347Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:30.833358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:30.833369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:30.833433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.833440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.833443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.833446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:30.833449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:30.833518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:30.833529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.833542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.833553Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.833569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:30.833592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839573346:3398], now have 1 active actors on pipe
2025-09-30T14:59:30.833601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839573243:2454], now have 1 active actors on pipe
2025-09-30T14:59:30.833607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897036749769768:12849]
2025-09-30T14:59:30.833610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897036749769768:12849]
2025-09-30T14:59:30.833612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897036749769768:12849]
2025-09-30T14:59:30.833623Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:30.833633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:30.833638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:30.833642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:30.833645Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:30.833653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:30.833658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:30.833659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3256
2025-09-30T14:59:30.833659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3256
2025-09-30T14:59:30.833691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897036749769768:12849]
2025-09-30T14:59:30.833701Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:30.833704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:30.833737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.833742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.833779Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:30.833793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.833796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.833798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:30.833807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.833821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:30.833843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.833998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.834006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.834022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.834112Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3257 partition: 0 MaxSeqNo: 42 sessionId: src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0
2025-09-30T14:59:30.834543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c3264c2-25054199-57929ead-122bbb1b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:30.837665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0] Write session: try to update token
2025-09-30T14:59:30.837687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:30.846899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:30.846923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:30.846927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:30.846930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:30.846943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897036749769768:12849]
2025-09-30T14:59:30.846950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897036749769768:12849]
2025-09-30T14:59:30.846957Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897036749769768:12849]
2025-09-30T14:59:30.847006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:30.847016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.847020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:30.847023Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:30.847030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:30.847035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:30.847276Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:30.854758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3257 sessionId: src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:30.857643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:30.911430Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897036839573366:4275]
2025-09-30T14:59:30.911726Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3256, pipe: [1:7555897036839573366:4275]
2025-09-30T14:59:30.963322Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:30.963726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.963742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.963762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839573366:4275], now have 1 active actors on pipe
2025-09-30T14:59:30.964046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897036839573366:4275]
2025-09-30T14:59:30.964052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:30.964057Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:30.964080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:30.964045Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:30.964130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3257 reason: error at write: Disconnected sessionId: src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0
2025-09-30T14:59:30.964321Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3257 sessionId: src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0 is DEAD
2025-09-30T14:59:30.964690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:30.964711Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0] Write session will restart in 0.007548s
2025-09-30T14:59:30.964735Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0] Write session: Do CDS request
2025-09-30T14:59:30.964744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:30.973667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:30.973780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:30.973965Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:30.973980Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3258
2025-09-30T14:59:30.974538Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3258 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:30.974587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3258 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:30.974597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3258 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:30.974602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:30.975037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3258 sessionId:  describe result for acl check
2025-09-30T14:59:30.975072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:30.975078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:30.975080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:30.975085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897036839573434:3364] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:30.975732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897036839573434:3364] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:30.975897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:30.976094Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:30.976103Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:30.976112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:30.976160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:30.976209Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897036749769876:12851]
2025-09-30T14:59:30.976854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:30.977142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:30.977175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:30.977497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:30.977577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.977584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.977585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.977587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.977588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.977589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.977591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.977592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.977593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.977594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.977595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.977596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.977598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.977599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.977601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.977607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.977616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.977620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.977623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.977627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.977630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.977633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.977637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.977641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.977644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.977648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.977651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.977655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.977659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.977663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.977669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.977677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:30.977683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.977687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:30.977692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.977697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:30.977701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.977706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:30.977713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.977718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:30.977722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.977727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:30.977732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.977736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:30.977740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.977745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:30.977749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.977757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:30.977761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.977771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:30.977777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.977786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.977790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.977795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.977803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.977808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.977812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.977817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:30.977821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.977825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:30.977879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:30.977893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897036839573434:3364] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:30.983043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897036839573434:3364] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:30.983060Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897036839573434:3364] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:30.983065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897036839573434:3364] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:30.983074Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3258 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:30.983333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:30.984317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:30.984335Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:30.984338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:30.984343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:30.984351Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3257 [2:7555897036749769876:12851]
2025-09-30T14:59:30.984368Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:30.984384Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:30.984387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.984390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.984392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.984408Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:30.984416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:30.984422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:30.984485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.984498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.984500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.984503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:30.984519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:30.984591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:30.984599Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:30.984614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:30.984630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:30.984652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:30.984675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839573470:3364], now have 1 active actors on pipe
2025-09-30T14:59:30.984684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897036839573371:2454], now have 1 active actors on pipe
2025-09-30T14:59:30.984690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897036749769870:12851]
2025-09-30T14:59:30.984697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897036749769870:12851]
2025-09-30T14:59:30.984699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897036749769870:12851]
2025-09-30T14:59:30.984715Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:30.984736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:30.984742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:30.984747Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:30.984750Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:30.984752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:30.984755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:30.984731Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3257
2025-09-30T14:59:30.984737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3257
2025-09-30T14:59:30.984793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897036749769870:12851]
2025-09-30T14:59:30.984810Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:30.984826Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:30.984960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.984971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.985002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:30.985011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:30.985014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:30.985017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:30.985029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:30.985041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:30.985059Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.985279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:30.985293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:30.985324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:30.985445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3258 partition: 0 MaxSeqNo: 42 sessionId: src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0
2025-09-30T14:59:30.986239Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8a4181-ee4ad8bb-dc5abc31-257c419e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:30.989172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0] Write session: try to update token
2025-09-30T14:59:30.989193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:30.997265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:30.997284Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:30.997294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897036749769870:12851]
2025-09-30T14:59:30.997352Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:30.997435Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:30.997547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:30.997709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:30.997855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:30.998011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:30.998225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:30.998277Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:31.005668Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3258 sessionId: src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:31.008826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:31.009022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.009045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.009084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:31.009182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:31.011371Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:31.011388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:31.011390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:31.011392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:31.011402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897036749769870:12851]
2025-09-30T14:59:31.011406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897036749769870:12851]
2025-09-30T14:59:31.011410Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897036749769870:12851]
2025-09-30T14:59:31.011451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:31.011462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.011465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:31.011484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:31.011496Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:31.011507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:31.011612Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:31.063977Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897041134540798:4275]
2025-09-30T14:59:31.064169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3257, pipe: [1:7555897041134540798:4275]
2025-09-30T14:59:31.124098Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:31.132661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.132689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.132878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:31.132949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:31.133019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:31.133096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:31.133148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:31.133163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:31.133238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:31.133310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:31.133384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:31.133461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:31.133505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:31.133517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:31.133590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:31.133654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:31.133729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:31.133801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:31.133846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:31.133854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:31.133930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:31.134002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:31.134070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:31.134136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:31.134182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:31.134188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:31.134260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:31.134327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:31.134396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:31.134467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:31.134513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:31.134521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:31.134592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:31.134653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:31.134721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:31.134790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:31.134839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:31.134848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:31.134922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:31.134988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:31.135054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:31.135123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:31.135176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:31.135184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:31.135270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:31.135334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:31.135402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:31.135476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:31.135520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:31.135528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:31.135598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:31.135667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:31.135732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:31.135803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:31.135849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:31.135856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:31.135927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:31.135990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:31.136052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:31.136121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:31.136168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:31.136175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:31.136241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134540798:4275], now have 1 active actors on pipe
2025-09-30T14:59:31.136557Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:31.136567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:31.136571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:31.136604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3258 reason: error at write: Disconnected sessionId: src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0
2025-09-30T14:59:31.136619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897041134540798:4275]
2025-09-30T14:59:31.136825Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3258 sessionId: src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0 is DEAD
2025-09-30T14:59:31.136996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:31.137008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0] Write session will restart in 0.009682s
2025-09-30T14:59:31.137042Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0] Write session: Do CDS request
2025-09-30T14:59:31.137049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:31.137460Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:31.147713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:31.148490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:31.148521Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3259
2025-09-30T14:59:31.148649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3259 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:31.148681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3259 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:31.148692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3259 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:31.148696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:31.148808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:31.150407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3259 sessionId:  describe result for acl check
2025-09-30T14:59:31.150457Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:31.150459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:31.150461Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:31.150467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897041134540869:3339] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:31.151074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897041134540869:3339] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:31.150569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:31.150756Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:31.150760Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:31.150770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:31.150821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:31.150857Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897041044737310:12865]
2025-09-30T14:59:31.151487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:31.151870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:31.151918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:31.152265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:31.152334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.152342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.152343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.152344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.152345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.152346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.152347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.152349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.152350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.152351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.152352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.152354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.152355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.152356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.152357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.152362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.152372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.152376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.152379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.152383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.152387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.152391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.152394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.152398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.152402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.152406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.152410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.152413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.152417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.152420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.152427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.152436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.152441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.152447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.152451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.152457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.152461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.152466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.152470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.152474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.152478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.152483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.152487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.152491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.152495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.152500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.152504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.152524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.152528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.152533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.152539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.152543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.152547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.152552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.152556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.152560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.152564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.152568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.152572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.152576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.152616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:31.153469Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897041134540869:3339] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:31.158248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:31.158490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897041134540869:3339] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:31.158514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897041134540869:3339] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:31.158518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897041134540869:3339] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:31.158529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3259 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:31.159186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:31.159203Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:31.159205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:31.159209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:31.159215Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3258 [2:7555897041044737310:12865]
2025-09-30T14:59:31.159232Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:31.159272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:31.159279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:31.159282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:31.159284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:31.159300Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:31.159311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:31.159317Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:31.159378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.159385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.159386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.159390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:31.159392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:31.159453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:31.159460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.159472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.159487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.159507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:31.159526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897041044737304:12865]
2025-09-30T14:59:31.159532Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897041044737304:12865]
2025-09-30T14:59:31.159534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897041044737304:12865]
2025-09-30T14:59:31.159543Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:31.159553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:31.159557Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:31.159558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:31.159559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:31.159571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:31.159581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:31.159589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134540804:2454], now have 1 active actors on pipe
2025-09-30T14:59:31.159598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134540904:3339], now have 1 active actors on pipe
2025-09-30T14:59:31.159627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897041044737304:12865]
2025-09-30T14:59:31.159639Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:31.159672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:31.159882Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3258
2025-09-30T14:59:31.159928Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3258
2025-09-30T14:59:31.160012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.160022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.160045Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:31.160056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:31.160059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:31.160062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:31.160073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:31.160083Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:31.160103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:31.160322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.160329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.160341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:31.160453Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3259 partition: 0 MaxSeqNo: 42 sessionId: src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0
2025-09-30T14:59:31.160916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e2383a8b-86f2c74-ca2cce35-7774587f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:31.163627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0] Write session: try to update token
2025-09-30T14:59:31.163644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:31.177246Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:31.177275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:31.177278Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:31.177280Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:31.177291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897041044737304:12865]
2025-09-30T14:59:31.177296Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897041044737304:12865]
2025-09-30T14:59:31.177300Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897041044737304:12865]
2025-09-30T14:59:31.177355Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:31.177358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:31.177365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:31.177365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.177369Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:31.177375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:31.177594Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:31.180474Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3259 sessionId: src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:31.183477Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:31.236587Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897041134540912:4275]
2025-09-30T14:59:31.238773Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3258, pipe: [1:7555897041134540912:4275]
2025-09-30T14:59:31.297496Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:31.298030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.298051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.298110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134540912:4275], now have 1 active actors on pipe
2025-09-30T14:59:31.298482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:31.298500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:31.298559Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:31.298576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3259 reason: error at write: Disconnected sessionId: src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0
2025-09-30T14:59:31.298605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897041134540912:4275]
2025-09-30T14:59:31.298404Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:31.298826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3259 sessionId: src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0 is DEAD
2025-09-30T14:59:31.300720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:31.300733Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0] Write session will restart in 0.006823s
2025-09-30T14:59:31.300764Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0] Write session: Do CDS request
2025-09-30T14:59:31.300770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:31.309090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:31.309198Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:31.309227Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3260
2025-09-30T14:59:31.309489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3260 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:31.309529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3260 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:31.309539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3260 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:31.309544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:31.310011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3260 sessionId:  describe result for acl check
2025-09-30T14:59:31.310048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:31.310055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:31.310058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:31.310065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897041134540978:3331] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:31.310621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897041134540978:3331] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:31.311429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:31.313338Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897041134540978:3331] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:31.313919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:31.314187Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:31.314198Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:31.314211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:31.314273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:31.314315Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897041044737415:12868]
2025-09-30T14:59:31.315030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:31.315411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:31.315479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:31.315843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:31.315921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.315922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.315923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.315925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.315926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.315927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.315929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.315930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.315932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.315933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.315934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.315935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.315936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.315938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.315939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.315947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.315958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.315962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.315967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.315972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.315977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.315981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.315985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.315989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.315994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.315998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.316002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.316006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.316010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.316014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.316022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.316030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.316037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.316044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.316048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.316054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.316059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.316065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.316072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.316078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.316084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.316089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.316097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.316102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.316107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.316111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.316117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.316122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.316127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.316133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.316141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.316146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.316150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.316157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.316163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.316169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.316175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.316181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.316187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.316193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.316243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:31.316297Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897041134540978:3331] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:31.316316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897041134540978:3331] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:31.316319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897041134540978:3331] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:31.316329Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3260 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:31.322592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:31.323759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:31.323789Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:31.323794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:31.323803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:31.323812Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3259 [2:7555897041044737415:12868]
2025-09-30T14:59:31.323832Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:31.323855Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:31.323867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:31.323872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:31.323875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:31.323895Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:31.323910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:31.323929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:31.324010Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.324020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.324022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.324026Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:31.324030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:31.324136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:31.324146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.324162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.324179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.324206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:31.324239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134540916:2454], now have 1 active actors on pipe
2025-09-30T14:59:31.324255Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134541018:3331], now have 1 active actors on pipe
2025-09-30T14:59:31.324264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897041044737410:12868]
2025-09-30T14:59:31.324267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897041044737410:12868]
2025-09-30T14:59:31.324270Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897041044737410:12868]
2025-09-30T14:59:31.324292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:31.324356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3259
2025-09-30T14:59:31.324368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3259
2025-09-30T14:59:31.324317Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:31.324322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:31.324342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:31.324345Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:31.324347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:31.324348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:31.324399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897041044737410:12868]
2025-09-30T14:59:31.324404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:31.324406Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:31.324431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.324436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.324502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:31.324523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:31.324528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:31.324530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:31.324541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:31.324558Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:31.324584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:31.324775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.324787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.324805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:31.324886Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3260 partition: 0 MaxSeqNo: 42 sessionId: src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0
2025-09-30T14:59:31.325337Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdaa31f9-615039f2-9223af6a-b17c785a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:31.328943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0] Write session: try to update token
2025-09-30T14:59:31.328972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:31.341980Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:31.342004Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:31.342007Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:31.342009Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:31.342020Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897041044737410:12868]
2025-09-30T14:59:31.342025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897041044737410:12868]
2025-09-30T14:59:31.342029Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897041044737410:12868]
2025-09-30T14:59:31.342085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:31.342096Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:31.342103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:31.342108Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:31.342141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.342149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:31.342315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:31.348143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3260 sessionId: src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:31.351584Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:31.398866Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897041134541033:4275]
2025-09-30T14:59:31.399162Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3259, pipe: [1:7555897041134541033:4275]
2025-09-30T14:59:31.463777Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:31.464270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.464287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.464329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134541033:4275], now have 1 active actors on pipe
2025-09-30T14:59:31.464620Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897041134541033:4275]
2025-09-30T14:59:31.464631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:31.464636Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:31.464658Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:31.464707Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3260 reason: error at write: Disconnected sessionId: src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0
2025-09-30T14:59:31.464899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3260 sessionId: src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0 is DEAD
2025-09-30T14:59:31.465010Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:31.465021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0] Write session will restart in 0.008441s
2025-09-30T14:59:31.465043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0] Write session: Do CDS request
2025-09-30T14:59:31.465049Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:31.464599Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:31.474810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:31.474787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:31.474906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:31.474924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3261
2025-09-30T14:59:31.475038Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3261 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:31.475073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3261 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:31.475084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3261 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:31.475088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:31.475552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3261 sessionId:  describe result for acl check
2025-09-30T14:59:31.475589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:31.475596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:31.475598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:31.475605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897041134541103:3320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:31.476242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897041134541103:3320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:31.476709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:31.476892Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:31.476902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:31.476912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:31.476961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:31.477003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897041044737519:12870]
2025-09-30T14:59:31.477674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:31.477907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897041134541103:3320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:31.477938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:31.477986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:31.478318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:31.478376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.478383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.478384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.478385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.478387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.478388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.478390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.478391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.478392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.478393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.478395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.478396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.478397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.478398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.478399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.478405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.478416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.478420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.478425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.478429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.478434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.478439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.478465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.478470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.478475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.478479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.478483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.478487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.478491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.478496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.478504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.478514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.478526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.478537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.478543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.478549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.478554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.478560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.478565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.478571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.478581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.478587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.478596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.478602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.478607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.478617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.478623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.478629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.478633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.478639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.478650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.478656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.478665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.478670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.478675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.478685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.478689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.478699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.478707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.478712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.478765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:31.484107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897041134541103:3320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:31.484125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897041134541103:3320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:31.484129Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897041134541103:3320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:31.484139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3261 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:31.484378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:31.485304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:31.485321Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:31.485323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:31.485327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:31.485335Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3260 [2:7555897041044737519:12870]
2025-09-30T14:59:31.485352Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:31.485367Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:31.485375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:31.485378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:31.485381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:31.485396Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:31.485408Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:31.485417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:31.485491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.485498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.485500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.485504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:31.485506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:31.485572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:31.485580Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.485593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.485607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.485631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:31.485653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134541142:3320], now have 1 active actors on pipe
2025-09-30T14:59:31.485662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134541037:2454], now have 1 active actors on pipe
2025-09-30T14:59:31.485668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897041044737513:12870]
2025-09-30T14:59:31.485675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897041044737513:12870]
2025-09-30T14:59:31.485677Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897041044737513:12870]
2025-09-30T14:59:31.485690Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:31.485705Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:31.485709Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:31.485713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:31.485715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:31.485725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:31.485733Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:31.485722Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3260
2025-09-30T14:59:31.485766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897041044737513:12870]
2025-09-30T14:59:31.485778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:31.485785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:31.485794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.485798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.485791Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3260
2025-09-30T14:59:31.485842Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:31.485854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:31.485859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:31.485862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:31.485874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:31.485882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:31.485904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:31.486071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.486078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.486091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:31.486184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3261 partition: 0 MaxSeqNo: 42 sessionId: src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0
2025-09-30T14:59:31.488471Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6da18cc7-bc793c12-2a48bff6-57ee79f5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:31.491450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0] Write session: try to update token
2025-09-30T14:59:31.491474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:31.499042Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:31.499065Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:31.499067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:31.499070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:31.499081Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897041044737513:12870]
2025-09-30T14:59:31.499086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897041044737513:12870]
2025-09-30T14:59:31.499091Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897041044737513:12870]
2025-09-30T14:59:31.499134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:31.499143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.499147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:31.499147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:31.499157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:31.499161Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:31.499336Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:31.508355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3261 sessionId: src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:31.511552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:31.564753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897041134541150:4275]
2025-09-30T14:59:31.565096Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3260, pipe: [1:7555897041134541150:4275]
2025-09-30T14:59:31.614925Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:31.615300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.615321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.615359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134541150:4275], now have 1 active actors on pipe
2025-09-30T14:59:31.615689Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:31.615776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3261 reason: status is not ok: tablet will be restarted right now sessionId: src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0
2025-09-30T14:59:31.615964Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3261 sessionId: src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0 is DEAD
2025-09-30T14:59:31.615986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897041134541150:4275]
2025-09-30T14:59:31.616014Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:31.615635Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:31.616120Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:31.616132Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0] Write session will restart in 0.008516s
2025-09-30T14:59:31.616156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0] Write session: Do CDS request
2025-09-30T14:59:31.616162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:31.625870Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:31.626277Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:31.626294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3262
2025-09-30T14:59:31.626516Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3262 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:31.626568Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3262 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:31.626580Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3262 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:31.626585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:31.627278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3262 sessionId:  describe result for acl check
2025-09-30T14:59:31.627333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:31.627341Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:31.627344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:31.627371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897041134541215:3317] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:31.628020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897041134541215:3317] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:31.629254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:31.631413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:31.631634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:31.631643Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:31.631653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:31.631703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:31.631744Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897041044737636:12873]
2025-09-30T14:59:31.632422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:31.632825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:31.632870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:31.633185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897041134541215:3317] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:31.633207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:31.633276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.633277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.633278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.633280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.633281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.633282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.633284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.633285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.633287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.633288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.633289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.633290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.633292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.633293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.633294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.633300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.633309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.633314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.633317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.633322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.633327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.633330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.633333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.633337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.633342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.633345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.633348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.633352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.633355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.633359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.633366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.633374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.633379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.633385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.633390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.633395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.633400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.633405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.633411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.633416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.633421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.633427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.633431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.633436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.633441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.633446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.633451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.633456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.633461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.633465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.633472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.633478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.633482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.633487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.633492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.633497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.633504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.633510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.633514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.633519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.633572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:31.638994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897041134541215:3317] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:31.639014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897041134541215:3317] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:31.639018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897041134541215:3317] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:31.639027Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3262 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:31.639349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:31.640323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:31.640345Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:31.640348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:31.640352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:31.640361Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3261 [2:7555897041044737636:12873]
2025-09-30T14:59:31.640379Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:31.640396Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:31.640400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:31.640403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:31.640405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:31.640423Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:31.640430Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:31.640438Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:31.640524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.640535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.640538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.640541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:31.640546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:31.640620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:31.640629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.640643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.640657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.640684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:31.640708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134541258:3317], now have 1 active actors on pipe
2025-09-30T14:59:31.640718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134541151:2454], now have 1 active actors on pipe
2025-09-30T14:59:31.640724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897041044737630:12873]
2025-09-30T14:59:31.640728Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897041044737630:12873]
2025-09-30T14:59:31.640731Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897041044737630:12873]
2025-09-30T14:59:31.640748Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:31.640768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:31.640777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:31.640781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:31.640783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:31.640789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:31.640798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:31.640837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897041044737630:12873]
2025-09-30T14:59:31.640847Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:31.640854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:31.640980Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3261
2025-09-30T14:59:31.641011Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3261
2025-09-30T14:59:31.641158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.641171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.641201Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:31.641213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:31.641217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:31.641220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:31.641243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:31.641258Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:31.641277Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:31.641481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.641491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.641508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:31.641594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3262 partition: 0 MaxSeqNo: 42 sessionId: src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0
2025-09-30T14:59:31.642028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|791fa77a-bcc63bc7-706706b6-4e82bcf8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:31.645125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0] Write session: try to update token
2025-09-30T14:59:31.645154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:31.653908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:31.653927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:31.653941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897041044737630:12873]
2025-09-30T14:59:31.653986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:31.654009Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:31.654167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:31.654344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:31.654506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:31.654668Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:31.654911Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:31.654966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:31.665345Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3262 sessionId: src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:31.667983Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:31.668011Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:31.668014Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:31.668016Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:31.668042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897041044737630:12873]
2025-09-30T14:59:31.668046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897041044737630:12873]
2025-09-30T14:59:31.668054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897041044737630:12873]
2025-09-30T14:59:31.668102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:31.668111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.668115Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:31.668289Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:31.668449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:31.668609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:31.668626Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:31.668630Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:31.716327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897041134541265:4275]
2025-09-30T14:59:31.716666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3261, pipe: [1:7555897041134541265:4275]
2025-09-30T14:59:31.787198Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:31.787556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.787573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.787593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134541265:4275], now have 1 active actors on pipe
2025-09-30T14:59:31.787814Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:31.788452Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:31.788463Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0] Write session will restart in 0.009325s
2025-09-30T14:59:31.788489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0] Write session: Do CDS request
2025-09-30T14:59:31.788495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:31.787938Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:31.787967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897041134541265:4275]
2025-09-30T14:59:31.787991Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:31.788076Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3262 reason: status is not ok: tablet will be restarted right now sessionId: src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0
2025-09-30T14:59:31.788240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3262 sessionId: src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0 is DEAD
2025-09-30T14:59:31.800352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:31.800962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:31.801036Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:31.801055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3263
2025-09-30T14:59:31.801212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3263 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:31.801252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3263 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:31.801258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3263 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:31.801265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:31.801698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3263 sessionId:  describe result for acl check
2025-09-30T14:59:31.801739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:31.801741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:31.801743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:31.801750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897041134541337:3304] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:31.802318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897041134541337:3304] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:31.802452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:31.802658Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:31.802670Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:31.802681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:31.802738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:31.802781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897041044737744:12876]
2025-09-30T14:59:31.803450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:31.803788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:31.803847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:31.804135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897041134541337:3304] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:31.804214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:31.804284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.804292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.804293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.804294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.804295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.804297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.804298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.804299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.804300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.804301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.804303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.804304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.804305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.804306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.804308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.804314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.804324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.804328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.804331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.804335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.804339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.804343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.804348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.804352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.804357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.804361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.804365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.804369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.804373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.804377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.804384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.804392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.804398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.804403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.804408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.804413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.804417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.804422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.804427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.804432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.804437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.804442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.804448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.804453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.804458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.804463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.804468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.804473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.804478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.804483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.804488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.804492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.804498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.804519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.804524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.804531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.804535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.804539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.804544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.804548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.804591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:31.809789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897041134541337:3304] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:31.809810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897041134541337:3304] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:31.809815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897041134541337:3304] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:31.809824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3263 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:31.810126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:31.811212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:31.811231Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:31.811235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:31.811238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:31.811260Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3262 [2:7555897041044737744:12876]
2025-09-30T14:59:31.811279Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:31.811294Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:31.811298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:31.811301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:31.811304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:31.811321Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:31.811328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:31.811336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:31.811399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.811407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.811410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.811413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:31.811416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:31.811492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:31.811502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.811516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.811527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.811541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:31.811561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897041044737739:12876]
2025-09-30T14:59:31.811568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897041044737739:12876]
2025-09-30T14:59:31.811571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897041044737739:12876]
2025-09-30T14:59:31.811579Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:31.811600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134541267:2454], now have 1 active actors on pipe
2025-09-30T14:59:31.811607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:31.811609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134541375:3304], now have 1 active actors on pipe
2025-09-30T14:59:31.811612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:31.811615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:31.811617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:31.811631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:31.811634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:31.811669Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897041044737739:12876]
2025-09-30T14:59:31.811686Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:31.811714Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:31.811753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3262
2025-09-30T14:59:31.811766Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3262
2025-09-30T14:59:31.811824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.811835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.811864Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:31.811878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:31.811882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:31.811885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:31.811894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:31.811909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:31.811932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:31.812115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.812123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.812137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:31.812215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3263 partition: 0 MaxSeqNo: 42 sessionId: src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0
2025-09-30T14:59:31.812607Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2776c2c0-9c46b8c9-aa7e1a30-70448ecb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:31.815533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0] Write session: try to update token
2025-09-30T14:59:31.815556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:31.824450Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:31.824475Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:31.824478Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:31.824481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:31.824493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897041044737739:12876]
2025-09-30T14:59:31.824498Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897041044737739:12876]
2025-09-30T14:59:31.824521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897041044737739:12876]
2025-09-30T14:59:31.824569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:31.824584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.824586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:31.824588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:31.824594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:31.824600Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:31.824736Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:31.833186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3263 sessionId: src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:31.836173Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:31.888343Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897041134541399:4275]
2025-09-30T14:59:31.888684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3262, pipe: [1:7555897041134541399:4275]
2025-09-30T14:59:31.949504Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:31.949902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.949922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.949944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134541399:4275], now have 1 active actors on pipe
2025-09-30T14:59:31.950213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897041134541399:4275]
2025-09-30T14:59:31.950280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:31.950284Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:31.950353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3263 reason: error at write: Disconnected sessionId: src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0
2025-09-30T14:59:31.950358Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:31.950546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3263 sessionId: src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0 is DEAD
2025-09-30T14:59:31.950220Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:31.950952Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:31.950963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0] Write session will restart in 0.006573s
2025-09-30T14:59:31.950986Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0] Write session: Do CDS request
2025-09-30T14:59:31.950994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:31.958773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:31.958945Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:31.958962Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3264
2025-09-30T14:59:31.959110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3264 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:31.959146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3264 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:31.959156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3264 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:31.959163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:31.959653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3264 sessionId:  describe result for acl check
2025-09-30T14:59:31.959691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:31.959701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:31.959703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:31.959708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897041134541415:3283] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:31.960241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897041134541415:3283] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:31.962472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897041134541415:3283] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:31.965398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897041134541415:3283] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:31.965415Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897041134541415:3283] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:31.965419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897041134541415:3283] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:31.965428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3264 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:31.965462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:31.967225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:31.967437Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:31.967445Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:31.967455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:31.967502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:31.967547Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897041044737853:12878]
2025-09-30T14:59:31.968229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:31.968578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:31.968630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:31.968969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:31.969024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.969029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.969029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.969030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.969031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.969032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.969032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.969034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.969035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.969035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.969036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.969037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.969038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.969039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.969039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.969043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.969051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.969053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.969056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.969058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.969060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.969063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.969065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.969067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.969070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.969073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.969075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.969077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.969080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.969082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.969087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.969092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:31.969096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.969099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:31.969102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.969106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:31.969108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.969112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:31.969114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.969117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:31.969120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.969123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:31.969126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.969129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:31.969131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.969135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:31.969138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.969141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:31.969143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.969150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:31.969155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.969160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.969164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.969170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.969175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.969181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.969185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.969188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:31.969193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.969195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:31.969220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:31.974796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:31.976022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:31.976039Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:31.976041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:31.976044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:31.976049Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3263 [2:7555897041044737853:12878]
2025-09-30T14:59:31.976067Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:31.976084Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:31.976088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:31.976091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:31.976092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:31.976108Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:31.976114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:31.976119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:31.976170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.976179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.976181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.976184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:31.976186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:31.976254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:31.976266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:31.976278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:31.976289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:31.976305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:31.976328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897041044737847:12878]
2025-09-30T14:59:31.976335Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897041044737847:12878]
2025-09-30T14:59:31.976339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897041044737847:12878]
2025-09-30T14:59:31.976352Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:31.976369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134541503:3283], now have 1 active actors on pipe
2025-09-30T14:59:31.976375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897041134541401:2454], now have 1 active actors on pipe
2025-09-30T14:59:31.976379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:31.976382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:31.976384Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:31.976387Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:31.976390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:31.976393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:31.976430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897041044737847:12878]
2025-09-30T14:59:31.976444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:31.976459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:31.976445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3263
2025-09-30T14:59:31.976452Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3263
2025-09-30T14:59:31.976685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.976696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.976725Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:31.976739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:31.976743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:31.976746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:31.976758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:31.976767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:31.976781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:31.976955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:31.976981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:31.977006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:31.977355Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3264 partition: 0 MaxSeqNo: 42 sessionId: src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0
2025-09-30T14:59:31.977698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9d7faa70-240927d4-95dabf05-755bbbb1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:31.980656Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0] Write session: try to update token
2025-09-30T14:59:31.980679Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:31.988666Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:31.988688Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:31.988697Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897041044737847:12878]
2025-09-30T14:59:31.988752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:31.988956Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:31.989130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:31.989290Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:31.989440Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:31.989757Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:31.989814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:31.989905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:31.996308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3264 sessionId: src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:31.999159Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:32.000123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.000153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.000174Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:32.000177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:32.000179Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:32.000181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:32.000191Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897041044737847:12878]
2025-09-30T14:59:32.000200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897041044737847:12878]
2025-09-30T14:59:32.000204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897041044737847:12878]
2025-09-30T14:59:32.000243Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:32.000253Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:32.000257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:32.000259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.000261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:32.000263Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:32.000405Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:32.050615Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897045429508812:4275]
2025-09-30T14:59:32.050907Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3263, pipe: [1:7555897045429508812:4275]
2025-09-30T14:59:32.117142Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:32.117468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:32.117509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429508812:4275], now have 1 active actors on pipe
2025-09-30T14:59:32.117610Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:32.117737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:32.117746Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:32.117826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3264 reason: error at write: Disconnected sessionId: src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0
2025-09-30T14:59:32.118006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3264 sessionId: src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0 is DEAD
2025-09-30T14:59:32.118152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:32.118166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0] Write session will restart in 0.006839s
2025-09-30T14:59:32.118189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0] Write session: Do CDS request
2025-09-30T14:59:32.118198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:32.118196Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897045429508812:4275]
2025-09-30T14:59:32.118220Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:32.125833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:32.126001Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:32.126018Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3265
2025-09-30T14:59:32.126151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3265 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:32.126184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3265 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:32.126189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3265 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:32.126193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:32.126597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3265 sessionId:  describe result for acl check
2025-09-30T14:59:32.126637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:32.126639Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:32.126642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:32.126647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897045429508843:3259] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:32.127212Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897045429508843:3259] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:32.130540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897045429508843:3259] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:32.133453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:32.133557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897045429508843:3259] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:32.133577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897045429508843:3259] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:32.133580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897045429508843:3259] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:32.133598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3265 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:32.135858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:32.136085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:32.136094Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:32.136105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:32.136157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:32.136199Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897045339705270:12886]
2025-09-30T14:59:32.136926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:32.137314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:32.137369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:32.137730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:32.137790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.137797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.137799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.137800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.137801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.137803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.137804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.137806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.137807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.137808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.137810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.137811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.137813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.137814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.137815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.137822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.137832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.137836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.137840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.137845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.137850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.137854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.137858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.137862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.137866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.137870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.137874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.137878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.137881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.137885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.137892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.137902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.137908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.137913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.137918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.137923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.137928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.137933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.137938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.137944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.137948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.137954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.137959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.137965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.137969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.137974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.137980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.137985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.137990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.137996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.138001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.138006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.138010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.138016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.138021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.138026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.138031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.138036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.138041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.138046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.138090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:32.143913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:32.144941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:32.144956Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:32.144959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:32.144963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:32.144970Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3264 [2:7555897045339705270:12886]
2025-09-30T14:59:32.144988Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:32.145007Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:32.145010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:32.145014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:32.145016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:32.145036Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:32.145048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:32.145055Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:32.145120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.145128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.145130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.145133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:32.145136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:32.145208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:32.145215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.145229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.145244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.145263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:32.145283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429508827:2454], now have 1 active actors on pipe
2025-09-30T14:59:32.145292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429508930:3259], now have 1 active actors on pipe
2025-09-30T14:59:32.145299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897045339705264:12886]
2025-09-30T14:59:32.145301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897045339705264:12886]
2025-09-30T14:59:32.145303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897045339705264:12886]
2025-09-30T14:59:32.145318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:32.145339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:32.145353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:32.145356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:32.145380Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:32.145383Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:32.145386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:32.145392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897045339705264:12886]
2025-09-30T14:59:32.145399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:32.145393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3264
2025-09-30T14:59:32.145414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:32.145449Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3264
2025-09-30T14:59:32.145595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.145610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.145655Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:32.145669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:32.145673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:32.145676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:32.145687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:32.145699Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:32.145721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:32.145903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.145913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.145929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:32.146066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3265 partition: 0 MaxSeqNo: 42 sessionId: src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0
2025-09-30T14:59:32.146482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7e8173b3-19d78084-8ba7b57b-12f01f35_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:32.149602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0] Write session: try to update token
2025-09-30T14:59:32.149626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:32.163756Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:32.163780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:32.163791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897045339705264:12886]
2025-09-30T14:59:32.163842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:32.163842Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:32.164116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:32.164283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:32.164437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:32.164623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:32.164846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:32.164896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:32.171468Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3265 sessionId: src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:32.174486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:32.175423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.175459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.175479Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:32.175482Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:32.175485Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:32.175487Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:32.175496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897045339705264:12886]
2025-09-30T14:59:32.175500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897045339705264:12886]
2025-09-30T14:59:32.175505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897045339705264:12886]
2025-09-30T14:59:32.175538Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:32.175553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:32.175554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:32.175557Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:32.175561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.175566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:32.175708Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:32.218599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897045429508953:4275]
2025-09-30T14:59:32.218990Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3264, pipe: [1:7555897045429508953:4275]
2025-09-30T14:59:32.292165Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:32.292770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:32.292813Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429508953:4275], now have 1 active actors on pipe
2025-09-30T14:59:32.292939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:32.293515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:32.293567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897045429508953:4275]
2025-09-30T14:59:32.307289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:32.307311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:32.307340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3265 reason: error at write: Disconnected sessionId: src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0
2025-09-30T14:59:32.307530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3265 sessionId: src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0 is DEAD
2025-09-30T14:59:32.307658Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:32.307671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0] Write session will restart in 0.008779s
2025-09-30T14:59:32.307698Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0] Write session: Do CDS request
2025-09-30T14:59:32.307704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:32.317888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:32.318008Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:32.318029Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3266
2025-09-30T14:59:32.318212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3266 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:32.318266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3266 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:32.318272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3266 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:32.318277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:32.319555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3266 sessionId:  describe result for acl check
2025-09-30T14:59:32.319598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:32.319600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:32.319602Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:32.319611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897045429509027:3239] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:32.319819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:32.320192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897045429509027:3239] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:32.321926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:32.322220Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:32.322236Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:32.322253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:32.322347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:32.322392Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897045339705403:12895]
2025-09-30T14:59:32.322914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:32.323266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:32.323317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:32.323619Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897045429509027:3239] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:32.323671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:32.323737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.323746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.323747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.323748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.323750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.323751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.323752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.323754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.323755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.323756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.323757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.323759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.323760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.323762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.323763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.323769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.323780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.323785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.323789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.323793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.323798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.323802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.323806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.323811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.323816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.323820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.323823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.323828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.323832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.323836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.323843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.323852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.323858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.323864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.323868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.323873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.323877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.323882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.323888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.323892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.323897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.323903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.323910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.323915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.323920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.323926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.323931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.323936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.323941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.323947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.323953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.323958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.323970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.323976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.323988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.323993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.323998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.324003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.324013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.324018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.324080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:32.329734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897045429509027:3239] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:32.329756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897045429509027:3239] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:32.329760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897045429509027:3239] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:32.329770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3266 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:32.331030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:32.332376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:32.332397Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:32.332400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:32.332407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:32.332415Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3265 [2:7555897045339705403:12895]
2025-09-30T14:59:32.332436Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:32.332455Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:32.332465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:32.332467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:32.332470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:32.332489Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:32.332517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:32.332531Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:32.332608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.332615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.332618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.332622Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:32.332625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:32.332701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:32.332707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.332724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.332745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.332764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:32.332785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429508954:2454], now have 1 active actors on pipe
2025-09-30T14:59:32.332794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429509065:3239], now have 1 active actors on pipe
2025-09-30T14:59:32.332804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897045339705398:12895]
2025-09-30T14:59:32.332806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897045339705398:12895]
2025-09-30T14:59:32.332808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897045339705398:12895]
2025-09-30T14:59:32.332826Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:32.332839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:32.332847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:32.332850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:32.332852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:32.332864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:32.332868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:32.332911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897045339705398:12895]
2025-09-30T14:59:32.332921Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:32.332934Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:32.332910Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3265
2025-09-30T14:59:32.332918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3265
2025-09-30T14:59:32.332965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.332977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.333002Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:32.333019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:32.333022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:32.333024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:32.333034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:32.333044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:32.333064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:32.333237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.333246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.333261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:32.333384Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3266 partition: 0 MaxSeqNo: 42 sessionId: src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0
2025-09-30T14:59:32.333861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c0a0d93c-95ed6b42-5842c4a0-320bf0fc_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:32.337251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0] Write session: try to update token
2025-09-30T14:59:32.337281Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:32.346942Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:32.346966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:32.346978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897045339705398:12895]
2025-09-30T14:59:32.347032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:32.347039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:32.358250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:32.358455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:32.358612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:32.358762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:32.359619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3266 sessionId: src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:32.359082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:32.359168Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:32.362064Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:32.362085Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:32.362091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:32.362093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:32.362113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897045339705398:12895]
2025-09-30T14:59:32.362124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897045339705398:12895]
2025-09-30T14:59:32.362133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897045339705398:12895]
2025-09-30T14:59:32.362205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:32.362219Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:32.362223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.362226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:32.362239Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:32.362244Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:32.362417Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:32.362913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:32.393691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897045429509078:4275]
2025-09-30T14:59:32.394114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3265, pipe: [1:7555897045429509078:4275]
2025-09-30T14:59:32.485532Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:32.485913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.485929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.485950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429509078:4275], now have 1 active actors on pipe
2025-09-30T14:59:32.486216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897045429509078:4275]
2025-09-30T14:59:32.486241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:32.486222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:32.486259Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:32.486262Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:32.486343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3266 reason: error at write: Disconnected sessionId: src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0
2025-09-30T14:59:32.486575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3266 sessionId: src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0 is DEAD
2025-09-30T14:59:32.486723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:32.486737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0] Write session will restart in 0.008593s
2025-09-30T14:59:32.486775Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0] Write session: Do CDS request
2025-09-30T14:59:32.486784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:32.496835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:32.496949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:32.496967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3267
2025-09-30T14:59:32.497100Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3267 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:32.497133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3267 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:32.497146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3267 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:32.497156Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:32.497698Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3267 sessionId:  describe result for acl check
2025-09-30T14:59:32.497756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:32.497765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:32.497767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:32.497774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897045429509155:3234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:32.497972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:32.498542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897045429509155:3234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:32.500357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:32.500561Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897045429509155:3234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:32.500600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:32.500613Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:32.500625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:32.500692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:32.500877Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897045339705513:12897]
2025-09-30T14:59:32.501547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:32.501854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:32.501914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:32.502214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:32.502277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.502283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.502285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.502286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.502287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.502288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.502290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.502291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.502292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.502294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.502295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.502296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.502297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.502299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.502300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.502306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.502317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.502322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.502327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.502331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.502335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.502339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.502342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.502344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.502347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.502350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.502352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.502364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.502366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.502369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.502375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.502380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.502386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.502394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.502397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.502401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.502404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.502407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.502410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.502413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.502416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.502419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.502422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.502425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.502427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.502430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.502433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.502436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.502438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.502441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.502450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.502453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.502456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.502459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.502461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.502464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.502467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.502469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.502475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.502480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.502522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:32.503741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897045429509155:3234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:32.503757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897045429509155:3234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:32.503761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897045429509155:3234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:32.503770Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3267 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:32.510143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:32.511484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:32.511510Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:32.511514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:32.511520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:32.511529Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3266 [2:7555897045339705513:12897]
2025-09-30T14:59:32.511549Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:32.511581Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:32.511598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:32.511602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:32.511606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:32.511629Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:32.511648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:32.511657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:32.511742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.511753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.511755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.511759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:32.511762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:32.511921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:32.511938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.511955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.511973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.512004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:32.512042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429509194:3234], now have 1 active actors on pipe
2025-09-30T14:59:32.512046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429509083:2454], now have 1 active actors on pipe
2025-09-30T14:59:32.512054Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897045339705507:12897]
2025-09-30T14:59:32.512057Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897045339705507:12897]
2025-09-30T14:59:32.512059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897045339705507:12897]
2025-09-30T14:59:32.512077Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:32.512042Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3266
2025-09-30T14:59:32.512050Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3266
2025-09-30T14:59:32.512095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:32.512105Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:32.512110Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:32.512113Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:32.512122Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:32.512126Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:32.512197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.512212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.512233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897045339705507:12897]
2025-09-30T14:59:32.512251Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:32.512270Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:32.512294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f399f6d1-90260684-b588f2e4-180a83c4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:32.512307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:32.512316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:32.512318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:32.512330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:32.512348Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:32.512389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:32.512665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.512681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.512701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:32.512807Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3267 partition: 0 MaxSeqNo: 42 sessionId: src_id|f399f6d1-90260684-b588f2e4-180a83c4_0
2025-09-30T14:59:32.513371Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79d2b2b2-adcf0316-638bcf93-4752761b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f399f6d1-90260684-b588f2e4-180a83c4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:32.516538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f399f6d1-90260684-b588f2e4-180a83c4_0] Write session: try to update token
2025-09-30T14:59:32.516566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f399f6d1-90260684-b588f2e4-180a83c4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:32.528894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:32.528923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:32.528926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:32.528929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:32.528940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897045339705507:12897]
2025-09-30T14:59:32.528944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897045339705507:12897]
2025-09-30T14:59:32.528949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897045339705507:12897]
2025-09-30T14:59:32.529003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:32.529012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.529018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:32.529022Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:32.529031Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:32.529036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:32.529195Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:32.533794Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3267 sessionId: src_id|f399f6d1-90260684-b588f2e4-180a83c4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:32.536914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:32.586195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897045429509202:4275]
2025-09-30T14:59:32.586496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3266, pipe: [1:7555897045429509202:4275]
2025-09-30T14:59:32.644519Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:32.644845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.644861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.644902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429509202:4275], now have 1 active actors on pipe
2025-09-30T14:59:32.645145Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:32.645167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:32.645182Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:32.645185Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:32.645250Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3267 reason: error at write: Disconnected sessionId: src_id|f399f6d1-90260684-b588f2e4-180a83c4_0
2025-09-30T14:59:32.645389Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897045429509202:4275]
2025-09-30T14:59:32.645505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3267 sessionId: src_id|f399f6d1-90260684-b588f2e4-180a83c4_0 is DEAD
2025-09-30T14:59:32.645681Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f399f6d1-90260684-b588f2e4-180a83c4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:32.645692Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f399f6d1-90260684-b588f2e4-180a83c4_0] Write session will restart in 0.005379s
2025-09-30T14:59:32.645720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f399f6d1-90260684-b588f2e4-180a83c4_0] Write session: Do CDS request
2025-09-30T14:59:32.645726Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f399f6d1-90260684-b588f2e4-180a83c4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:32.652847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f399f6d1-90260684-b588f2e4-180a83c4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:32.652929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:32.652948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3268
2025-09-30T14:59:32.653093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3268 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:32.653129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3268 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:32.653140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3268 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:32.653146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:32.653617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3268 sessionId:  describe result for acl check
2025-09-30T14:59:32.653656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:32.653663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:32.653666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:32.653673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897045429509219:3217] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:32.654308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897045429509219:3217] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:32.657180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897045429509219:3217] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:32.657980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:32.659885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:32.660064Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897045429509219:3217] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:32.660080Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897045429509219:3217] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:32.660084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897045429509219:3217] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:32.660093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3268 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:32.660304Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:32.660322Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:32.660337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:32.660430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:32.660478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897045339705638:12901]
2025-09-30T14:59:32.661190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:32.661568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:32.661627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:32.662028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:32.662100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.662106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.662107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.662109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.662110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.662112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.662113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.662114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.662116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.662117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.662119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.662120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.662122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.662124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.662125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.662131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.662142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.662147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.662151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.662155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.662159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.662163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.662168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.662172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.662176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.662180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.662184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.662188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.662192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.662196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.662206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.662216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.662221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.662226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.662231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.662237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.662242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.662250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.662255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.662260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.662266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.662272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.662282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.662287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.662292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.662302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.662308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.662318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.662323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.662333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.662338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.662343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.662351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.662355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.662359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.662368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.662373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.662380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.662389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.662394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.662444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:32.669349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:32.670370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:32.670392Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:32.670399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:32.670403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:32.670411Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3267 [2:7555897045339705638:12901]
2025-09-30T14:59:32.670429Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:32.670447Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:32.670456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:32.670459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:32.670462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:32.670479Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:32.670487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:32.670500Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:32.670573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.670583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.670589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.670592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:32.670595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:32.670671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:32.670679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.670694Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.670711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.670734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:32.670759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429509316:3217], now have 1 active actors on pipe
2025-09-30T14:59:32.670768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429509203:2454], now have 1 active actors on pipe
2025-09-30T14:59:32.670774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897045339705633:12901]
2025-09-30T14:59:32.670782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897045339705633:12901]
2025-09-30T14:59:32.670784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897045339705633:12901]
2025-09-30T14:59:32.670800Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:32.670821Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:32.670834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:32.670842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:32.670846Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:32.670848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:32.670852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:32.670884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897045339705633:12901]
2025-09-30T14:59:32.670892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:32.670897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:32.670934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.670943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.670972Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|43557f24-13157202-bcbee15f-eaeee555_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:32.670979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:32.670982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:32.670984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:32.670994Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:32.671003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:32.671018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:32.670849Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3267
2025-09-30T14:59:32.670875Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3267
2025-09-30T14:59:32.671189Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.671198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.671212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:32.671320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3268 partition: 0 MaxSeqNo: 42 sessionId: src_id|43557f24-13157202-bcbee15f-eaeee555_0
2025-09-30T14:59:32.671750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f399f6d1-90260684-b588f2e4-180a83c4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|43557f24-13157202-bcbee15f-eaeee555_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:32.674802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43557f24-13157202-bcbee15f-eaeee555_0] Write session: try to update token
2025-09-30T14:59:32.674825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43557f24-13157202-bcbee15f-eaeee555_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:32.691693Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3268 sessionId: src_id|43557f24-13157202-bcbee15f-eaeee555_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:32.694437Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:32.694510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:32.694531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:32.694545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897045339705633:12901]
2025-09-30T14:59:32.694586Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:32.694596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:32.694766Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:32.694922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:32.695072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:32.695215Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:32.695434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:32.695487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.695500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.695520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:32.695549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:32.695648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:32.702221Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:32.702248Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:32.702251Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:32.702253Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:32.702262Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897045339705633:12901]
2025-09-30T14:59:32.702267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897045339705633:12901]
2025-09-30T14:59:32.702272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897045339705633:12901]
2025-09-30T14:59:32.702317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:32.702324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.702329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:32.702333Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:32.702341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:32.702345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:32.702477Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:32.745407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897045429509327:4275]
2025-09-30T14:59:32.745768Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3267, pipe: [1:7555897045429509327:4275]
2025-09-30T14:59:32.818793Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:32.827866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.827895Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.828084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:32.828157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:32.828239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:32.828325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:32.828376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:32.828386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:32.828463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:32.828549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:32.828621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:32.828697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:32.828745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:32.828753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:32.828826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:32.828898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:32.828966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:32.829032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:32.829076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:32.829079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:32.829156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:32.829583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:32.829704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:32.829818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:32.829867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:32.829875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:32.829950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:32.830138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:32.830213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:32.830293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:32.830342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:32.830350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:32.830423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:32.830498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:32.830575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:32.830652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:32.830708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:32.830718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:32.830795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:32.830869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:32.830947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:32.831022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:32.831068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:32.831077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:32.831148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:32.831218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:32.831312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:32.831386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:32.831436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:32.831445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:32.831520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:32.831589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:32.831661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:32.831736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:32.831792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:32.831799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:32.831877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:32.831946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:32.832019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:32.832092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:32.832229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:32.832237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:32.832322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429509327:4275], now have 1 active actors on pipe
2025-09-30T14:59:32.832706Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:32.832711Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897045429509327:4275]
2025-09-30T14:59:32.832720Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:32.832734Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:32.832748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3268 reason: error at write: Disconnected sessionId: src_id|43557f24-13157202-bcbee15f-eaeee555_0
2025-09-30T14:59:32.832822Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:32.832929Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3268 sessionId: src_id|43557f24-13157202-bcbee15f-eaeee555_0 is DEAD
2025-09-30T14:59:32.833111Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43557f24-13157202-bcbee15f-eaeee555_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:32.833137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43557f24-13157202-bcbee15f-eaeee555_0] Write session will restart in 0.005605s
2025-09-30T14:59:32.833162Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43557f24-13157202-bcbee15f-eaeee555_0] Write session: Do CDS request
2025-09-30T14:59:32.833167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43557f24-13157202-bcbee15f-eaeee555_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:32.839769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|43557f24-13157202-bcbee15f-eaeee555_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:32.839892Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:32.839909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3269
2025-09-30T14:59:32.840046Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3269 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:32.840080Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3269 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:32.840093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3269 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:32.840103Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:32.840573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3269 sessionId:  describe result for acl check
2025-09-30T14:59:32.840611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:32.840613Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:32.840615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:32.840621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897045429509348:3187] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:32.841159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897045429509348:3187] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:32.844027Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897045429509348:3187] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:32.844472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:32.846214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:32.846427Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:32.846436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:32.846446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:32.846506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:32.846545Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897045339705751:12903]
2025-09-30T14:59:32.846959Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897045429509348:3187] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:32.846971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897045429509348:3187] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:32.846973Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897045429509348:3187] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:32.846980Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3269 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:32.847221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:32.847546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:32.847587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:32.847902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:32.847962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.847969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.847970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.847972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.847973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.847974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.847975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.847977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.847978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.847979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.847980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.847981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.847982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.847984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.847985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.847990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.848000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.848004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.848009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.848013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.848017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.848021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.848025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.848029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.848034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.848037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.848041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.848046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.848049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.848053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.848061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.848068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:32.848074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.848080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:32.848085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.848091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:32.848096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.848101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:32.848106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.848111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:32.848121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.848127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:32.848131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.848137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:32.848142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.848148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:32.848159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.848164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:32.848168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.848173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:32.848181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.848186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.848192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.848197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.848207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.848212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.848218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.848223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:32.848227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.848237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:32.848281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:32.857043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:32.858178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:32.858201Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:32.858203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:32.858208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:32.858216Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3268 [2:7555897045339705751:12903]
2025-09-30T14:59:32.858233Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:32.858250Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:32.858253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:32.858257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:32.858259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:32.858281Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:32.858294Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:32.858302Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:32.858374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.858382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.858385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.858389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:32.858392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:32.858463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:32.858478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.858493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:32.858506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:32.858523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:32.858551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429509332:2454], now have 1 active actors on pipe
2025-09-30T14:59:32.858555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429509454:3187], now have 1 active actors on pipe
2025-09-30T14:59:32.858562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897045339705745:12903]
2025-09-30T14:59:32.858565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897045339705745:12903]
2025-09-30T14:59:32.858567Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897045339705745:12903]
2025-09-30T14:59:32.858581Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:32.858595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:32.858596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:32.858605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:32.858607Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:32.858615Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:32.858618Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:32.858654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897045339705745:12903]
2025-09-30T14:59:32.858612Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3268
2025-09-30T14:59:32.858665Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:32.858616Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3268
2025-09-30T14:59:32.858667Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:32.858683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.858692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.858750Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:32.858762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:32.858767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:32.858771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:32.858781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:32.858792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:32.858817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:32.858962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.858974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.858987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:32.859087Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3269 partition: 0 MaxSeqNo: 42 sessionId: src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0
2025-09-30T14:59:32.859523Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|43557f24-13157202-bcbee15f-eaeee555_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:32.862426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0] Write session: try to update token
2025-09-30T14:59:32.862449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:32.874562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:32.874589Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:32.874592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:32.874597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:32.874607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897045339705745:12903]
2025-09-30T14:59:32.874610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897045339705745:12903]
2025-09-30T14:59:32.874616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897045339705745:12903]
2025-09-30T14:59:32.874663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:32.874670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:32.874677Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:32.874680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:32.874681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:32.874684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:32.874831Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:32.879649Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3269 sessionId: src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:32.882513Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:32.932770Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897045429509465:4275]
2025-09-30T14:59:32.933091Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3268, pipe: [1:7555897045429509465:4275]
2025-09-30T14:59:32.994126Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:32.994491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:32.994510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:32.994551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429509465:4275], now have 1 active actors on pipe
2025-09-30T14:59:32.994801Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:32.994763Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:32.994799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:32.994816Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897045429509465:4275]
2025-09-30T14:59:32.994843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:32.994874Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3269 reason: error at write: Disconnected sessionId: src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0
2025-09-30T14:59:32.995085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3269 sessionId: src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0 is DEAD
2025-09-30T14:59:32.995276Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:32.995288Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0] Write session will restart in 0.007274s
2025-09-30T14:59:32.995311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0] Write session: Do CDS request
2025-09-30T14:59:32.995320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:33.003822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.003915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:33.003930Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3270
2025-09-30T14:59:33.004045Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3270 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.004073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3270 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:33.004077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3270 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:33.004081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:33.004507Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3270 sessionId:  describe result for acl check
2025-09-30T14:59:33.004541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:33.004548Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:33.004550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:33.004556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897049724476836:3182] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:33.005123Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897049724476836:3182] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:33.005257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:33.007122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:33.007310Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:33.007321Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:33.007331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:33.007334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897049724476836:3182] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:33.007376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:33.007417Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897049634673159:12905]
2025-09-30T14:59:33.007946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:33.008209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:33.008269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:33.008623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:33.008690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.008696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.008697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.008698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.008699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.008701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.008702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.008703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.008705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.008706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.008707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.008708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.008709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.008710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.008712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.008717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.008726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.008729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.008731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.008734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.008736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.008739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.008741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.008743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.008746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.008748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.008751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.008753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.008756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.008758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.008765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.008770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.008774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.008778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.008780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.008784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.008786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.008789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.008792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.008795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.008798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.008801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.008804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.008807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.008810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.008813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.008816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.008819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.008821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.008825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.008828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.008831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.008834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.008838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.008845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.008851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.008857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.008862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.008872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.008881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.008907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:33.009846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897049724476836:3182] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:33.009861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897049724476836:3182] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:33.009865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897049724476836:3182] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:33.009874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3270 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:33.015628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:33.016654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:33.016670Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:33.016673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:33.016677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:33.016684Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3269 [2:7555897049634673159:12905]
2025-09-30T14:59:33.016699Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:33.016717Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:33.016725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.016728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.016730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.016746Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:33.016756Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:33.016768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:33.016832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.016840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.016841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.016845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:33.016848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:33.016916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:33.016924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.016939Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.016950Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.016971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:33.016994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897045429509467:2454], now have 1 active actors on pipe
2025-09-30T14:59:33.017003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724476877:3182], now have 1 active actors on pipe
2025-09-30T14:59:33.017009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897049634673153:12905]
2025-09-30T14:59:33.017012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897049634673153:12905]
2025-09-30T14:59:33.017014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897049634673153:12905]
2025-09-30T14:59:33.017026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:33.017039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:33.017049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:33.017053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:33.017054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:33.017056Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:33.017056Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:33.017062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3269
2025-09-30T14:59:33.017095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897049634673153:12905]
2025-09-30T14:59:33.017103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:33.017078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3269
2025-09-30T14:59:33.017104Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:33.017122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.017132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.017177Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:33.017189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.017193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.017195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:33.017205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.017218Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:33.017239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.017386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.017394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.017407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.017491Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3270 partition: 0 MaxSeqNo: 42 sessionId: src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0
2025-09-30T14:59:33.017881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53b5a049-74837a2-8b12233b-ea2e7c0d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:33.020742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0] Write session: try to update token
2025-09-30T14:59:33.020767Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:33.032931Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:33.032955Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:33.032958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:33.032960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:33.032974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897049634673153:12905]
2025-09-30T14:59:33.032979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897049634673153:12905]
2025-09-30T14:59:33.032983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897049634673153:12905]
2025-09-30T14:59:33.033029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:33.033034Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:33.033037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.033041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:33.033041Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:33.033045Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:33.033197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:33.036486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3270 sessionId: src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:33.039268Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:33.095122Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897049724476884:4275]
2025-09-30T14:59:33.095415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3269, pipe: [1:7555897049724476884:4275]
2025-09-30T14:59:33.145909Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:33.146210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.146225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.146263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724476884:4275], now have 1 active actors on pipe
2025-09-30T14:59:33.146472Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:33.146486Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897049724476884:4275]
2025-09-30T14:59:33.146538Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:33.146615Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3270 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0
2025-09-30T14:59:33.146810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3270 sessionId: src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0 is DEAD
2025-09-30T14:59:33.146958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:33.146969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0] Write session will restart in 0.006578s
2025-09-30T14:59:33.146993Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0] Write session: Do CDS request
2025-09-30T14:59:33.146999Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:33.146991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:33.154807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.154894Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:33.154911Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3271
2025-09-30T14:59:33.155039Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3271 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.155072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3271 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:33.155082Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3271 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:33.155086Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:33.155485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3271 sessionId:  describe result for acl check
2025-09-30T14:59:33.155519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:33.155522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:33.155523Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:33.155533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897049724476972:3170] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:33.156036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897049724476972:3170] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:33.157223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:33.157781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897049724476972:3170] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:33.159213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:33.159557Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:33.159571Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:33.159584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:33.159652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:33.159695Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897049634673286:12909]
2025-09-30T14:59:33.160350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:33.160380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897049724476972:3170] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:33.160408Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897049724476972:3170] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:33.160411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897049724476972:3170] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:33.160419Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3271 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:33.160656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:33.160702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:33.161035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:33.161098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.161105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.161106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.161107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.161108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.161109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.161110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.161111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.161113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.161114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.161115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.161117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.161118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.161119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.161121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.161127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.161138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.161142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.161147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.161152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.161157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.161162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.161166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.161171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.161176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.161181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.161185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.161189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.161193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.161200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.161210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.161218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.161224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.161231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.161236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.161242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.161247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.161254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.161263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.161269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.161278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.161282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.161287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.161293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.161299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.161305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.161315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.161321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.161326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.161337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.161342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.161352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.161356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.161366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.161371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.161376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.161385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.161390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.161396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.161406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.161454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:33.167862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:33.168909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:33.168926Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:33.168929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:33.168933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:33.168939Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3270 [2:7555897049634673286:12909]
2025-09-30T14:59:33.168956Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:33.168977Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:33.168984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.168987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.168990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.169004Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:33.169016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:33.169022Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:33.169090Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.169098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.169100Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.169104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:33.169107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:33.169171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:33.169185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.169198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.169210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.169229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:33.169249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477012:3170], now have 1 active actors on pipe
2025-09-30T14:59:33.169258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724476898:2454], now have 1 active actors on pipe
2025-09-30T14:59:33.169265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897049634673281:12909]
2025-09-30T14:59:33.169267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897049634673281:12909]
2025-09-30T14:59:33.169269Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897049634673281:12909]
2025-09-30T14:59:33.169281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:33.169296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:33.169300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:33.169289Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3270
2025-09-30T14:59:33.169306Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:33.169326Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3270
2025-09-30T14:59:33.169309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:33.169316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:33.169318Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:33.169366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.169371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.169388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897049634673281:12909]
2025-09-30T14:59:33.169400Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:33.169407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:33.169434Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fdbf4-c69c285f-836db3a2-2eedc947_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:33.169446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.169452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.169458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:33.169468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.169481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:33.169508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.169624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.169631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.169644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.169724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3271 partition: 0 MaxSeqNo: 42 sessionId: src_id|fdbf4-c69c285f-836db3a2-2eedc947_0
2025-09-30T14:59:33.170087Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a7b7b4-cbcd7bbb-11d24dd9-195c33e4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fdbf4-c69c285f-836db3a2-2eedc947_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:33.173061Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbf4-c69c285f-836db3a2-2eedc947_0] Write session: try to update token
2025-09-30T14:59:33.173081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbf4-c69c285f-836db3a2-2eedc947_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:33.183414Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:33.183438Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:33.183441Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:33.183444Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:33.183453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897049634673281:12909]
2025-09-30T14:59:33.183464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897049634673281:12909]
2025-09-30T14:59:33.183472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897049634673281:12909]
2025-09-30T14:59:33.183515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:33.183518Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:33.183523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.183525Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:33.183525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:33.183529Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:33.183692Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:33.188654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3271 sessionId: src_id|fdbf4-c69c285f-836db3a2-2eedc947_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:33.191592Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:33.247186Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897049724477032:4275]
2025-09-30T14:59:33.247524Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3270, pipe: [1:7555897049724477032:4275]
2025-09-30T14:59:33.307680Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:33.308138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.308157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.308203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477032:4275], now have 1 active actors on pipe
2025-09-30T14:59:33.308436Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:33.308436Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897049724477032:4275]
2025-09-30T14:59:33.308459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:33.308465Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:33.308464Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:33.308561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3271 reason: error at write: Disconnected sessionId: src_id|fdbf4-c69c285f-836db3a2-2eedc947_0
2025-09-30T14:59:33.308767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3271 sessionId: src_id|fdbf4-c69c285f-836db3a2-2eedc947_0 is DEAD
2025-09-30T14:59:33.309026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbf4-c69c285f-836db3a2-2eedc947_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:33.309039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbf4-c69c285f-836db3a2-2eedc947_0] Write session will restart in 0.008708s
2025-09-30T14:59:33.309063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbf4-c69c285f-836db3a2-2eedc947_0] Write session: Do CDS request
2025-09-30T14:59:33.309073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbf4-c69c285f-836db3a2-2eedc947_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:33.318766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbf4-c69c285f-836db3a2-2eedc947_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.318920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:33.318948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3272
2025-09-30T14:59:33.319113Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3272 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.319148Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3272 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:33.319153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3272 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:33.319157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:33.319624Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3272 sessionId:  describe result for acl check
2025-09-30T14:59:33.319663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:33.319670Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:33.319672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:33.319678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897049724477112:3151] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:33.319862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:33.320286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897049724477112:3151] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:33.321867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:33.322081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:33.322093Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:33.322105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:33.322162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:33.322207Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897049634673425:12922]
2025-09-30T14:59:33.322593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897049724477112:3151] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:33.322891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:33.323234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:33.323315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:33.323670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:33.323757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.323765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.323766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.323768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.323769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.323771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.323772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.323774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.323776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.323777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.323778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.323779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.323780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.323781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.323783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.323790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.323801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.323806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.323811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.323815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.323819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.323824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.323829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.323833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.323838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.323842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.323847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.323851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.323854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.323859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.323867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.323875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.323883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.323889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.323894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.323900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.323904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.323911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.323916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.323922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.323927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.323932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.323937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.323943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.323947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.323953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.323958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.323964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.323968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.323974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.323978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.323984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.323989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.323994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.323999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.324004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.324008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.324021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.324026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.324032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.324082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:33.329355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897049724477112:3151] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:33.329377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897049724477112:3151] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:33.329381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897049724477112:3151] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:33.329390Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3272 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:33.329558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:33.330437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:33.330450Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:33.330452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:33.330456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:33.330461Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3271 [2:7555897049634673425:12922]
2025-09-30T14:59:33.330474Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:33.330487Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:33.330489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.330491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.330492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.330504Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:33.330508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:33.330513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:33.330557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.330563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.330565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.330568Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:33.330570Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:33.330624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:33.330632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.330641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.330648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.330658Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:33.330673Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897049634673419:12922]
2025-09-30T14:59:33.330678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897049634673419:12922]
2025-09-30T14:59:33.330680Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897049634673419:12922]
2025-09-30T14:59:33.330687Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:33.330698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477151:3151], now have 1 active actors on pipe
2025-09-30T14:59:33.330699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:33.330703Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:33.330704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477033:2454], now have 1 active actors on pipe
2025-09-30T14:59:33.330706Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:33.330711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:33.330720Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:33.330722Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:33.330750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897049634673419:12922]
2025-09-30T14:59:33.330765Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:33.330751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3271
2025-09-30T14:59:33.330753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3271
2025-09-30T14:59:33.330790Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:33.330800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.330804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.330827Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:33.330836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.330839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.330840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:33.330848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.330858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:33.330873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.331017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.331028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.331049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.331173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3272 partition: 0 MaxSeqNo: 42 sessionId: src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0
2025-09-30T14:59:33.331543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fdbf4-c69c285f-836db3a2-2eedc947_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:33.334778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0] Write session: try to update token
2025-09-30T14:59:33.334803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:33.350327Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:33.350352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:33.350363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897049634673419:12922]
2025-09-30T14:59:33.350411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:33.350433Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:33.350596Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:33.350774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:33.350936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:33.351101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:33.351335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:33.351387Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:33.352717Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3272 sessionId: src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:33.355654Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:33.356446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.356470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.356487Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:33.356490Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:33.356492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:33.356493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:33.356517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897049634673419:12922]
2025-09-30T14:59:33.356520Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897049634673419:12922]
2025-09-30T14:59:33.356522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897049634673419:12922]
2025-09-30T14:59:33.356556Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:33.356562Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:33.356565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:33.356566Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:33.356571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.356574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:33.356702Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:33.408455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897049724477164:4275]
2025-09-30T14:59:33.408785Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3271, pipe: [1:7555897049724477164:4275]
2025-09-30T14:59:33.473031Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:33.473426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:33.473463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477164:4275], now have 1 active actors on pipe
2025-09-30T14:59:33.473590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:33.473624Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:33.473678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897049724477164:4275]
2025-09-30T14:59:33.473682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:33.473685Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:33.473776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3272 reason: error at write: Disconnected sessionId: src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0
2025-09-30T14:59:33.473955Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3272 sessionId: src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0 is DEAD
2025-09-30T14:59:33.474122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:33.474135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0] Write session will restart in 0.009679s
2025-09-30T14:59:33.474158Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0] Write session: Do CDS request
2025-09-30T14:59:33.474165Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:33.484789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.484902Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:33.484917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3273
2025-09-30T14:59:33.485065Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3273 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.485107Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3273 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:33.485118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3273 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:33.485122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:33.485122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:33.485613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3273 sessionId:  describe result for acl check
2025-09-30T14:59:33.485647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:33.485654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:33.485656Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:33.485663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897049724477247:3125] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:33.486222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897049724477247:3125] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:33.487068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:33.487292Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:33.487301Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:33.487312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:33.487368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:33.487408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897049634673540:12924]
2025-09-30T14:59:33.488021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897049724477247:3125] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:33.488051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:33.488336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:33.488378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:33.488722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:33.488794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.488800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.488802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.488803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.488804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.488805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.488806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.488808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.488809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.488810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.488812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.488813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.488814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.488815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.488816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.488821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.488831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.488835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.488839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.488842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.488846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.488851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.488855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.488859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.488863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.488868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.488872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.488876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.488880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.488884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.488892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.488900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.488906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.488911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.488916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.488922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.488926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.488932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.488937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.488943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.488948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.488953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.488959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.488964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.488970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.488975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.488981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.488986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.488991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.488996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.489002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.489012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.489017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.489023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.489028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.489033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.489042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.489047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.489052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.489058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.489104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:33.494322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897049724477247:3125] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:33.494355Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897049724477247:3125] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:33.494359Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897049724477247:3125] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:33.494367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3273 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:33.494691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:33.495658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:33.495673Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:33.495676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:33.495680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:33.495688Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3272 [2:7555897049634673540:12924]
2025-09-30T14:59:33.495704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:33.495720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:33.495728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.495731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.495734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.495751Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:33.495764Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:33.495771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:33.495832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.495839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.495842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.495846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:33.495849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:33.495922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:33.495930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.495941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.495958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.495980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:33.496001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477286:3125], now have 1 active actors on pipe
2025-09-30T14:59:33.496009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477168:2454], now have 1 active actors on pipe
2025-09-30T14:59:33.496015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897049634673534:12924]
2025-09-30T14:59:33.496017Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897049634673534:12924]
2025-09-30T14:59:33.496021Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897049634673534:12924]
2025-09-30T14:59:33.496032Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:33.496044Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:33.496053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:33.496054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:33.496057Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:33.496067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:33.496070Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:33.496103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897049634673534:12924]
2025-09-30T14:59:33.496093Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3272
2025-09-30T14:59:33.496118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:33.496100Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3272
2025-09-30T14:59:33.496155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:33.496233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.496261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.496294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31a826a4-3a95376d-79a28464-c3b05909_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:33.496308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.496312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.496320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:33.496333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.496360Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:33.496380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.496582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.496598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.496621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.496777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3273 partition: 0 MaxSeqNo: 42 sessionId: src_id|31a826a4-3a95376d-79a28464-c3b05909_0
2025-09-30T14:59:33.497178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9e8909ea-5284bc00-3e5bb38a-52b4f58c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|31a826a4-3a95376d-79a28464-c3b05909_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:33.500043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a826a4-3a95376d-79a28464-c3b05909_0] Write session: try to update token
2025-09-30T14:59:33.500063Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a826a4-3a95376d-79a28464-c3b05909_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:33.508366Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:33.508389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:33.508399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897049634673534:12924]
2025-09-30T14:59:33.508447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:33.508460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:33.508654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:33.508825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:33.508980Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:33.509130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:33.509331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:33.509379Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:33.515369Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3273 sessionId: src_id|31a826a4-3a95376d-79a28464-c3b05909_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:33.518295Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:33.518519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.518546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.518587Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:33.518670Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:33.521511Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:33.521536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:33.521539Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:33.521542Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:33.521554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897049634673534:12924]
2025-09-30T14:59:33.521559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897049634673534:12924]
2025-09-30T14:59:33.521564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897049634673534:12924]
2025-09-30T14:59:33.521606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:33.521614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.521618Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:33.521624Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:33.521631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:33.521635Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:33.521762Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:33.573843Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897049724477293:4275]
2025-09-30T14:59:33.574165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3272, pipe: [1:7555897049724477293:4275]
2025-09-30T14:59:33.644297Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:33.653225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.653258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.653449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:33.653519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:33.653599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:33.653669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:33.653715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:33.653727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:33.653798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:33.653876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:33.653953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:33.654031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:33.654081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:33.654084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:33.654157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:33.654229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:33.654306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:33.654376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:33.654422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:33.654436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:33.654504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:33.654572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:33.654643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:33.654710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:33.654761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:33.654770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:33.654839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:33.654907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:33.654979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:33.655056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:33.655114Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:33.655122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:33.655198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:33.655283Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:33.655353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:33.655426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:33.655474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:33.655482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:33.655553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:33.655617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:33.655687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:33.655761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:33.655807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:33.655814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:33.655886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:33.655951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:33.656017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:33.656095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:33.656245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:33.656256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:33.656330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:33.656395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:33.656468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:33.656551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:33.656599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:33.656607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:33.656677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:33.656751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:33.656818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:33.656883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:33.656929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:33.656937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:33.657007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477293:4275], now have 1 active actors on pipe
2025-09-30T14:59:33.657271Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:33.657336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:33.657340Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:33.657340Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897049724477293:4275]
2025-09-30T14:59:33.657368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3273 reason: error at write: Disconnected sessionId: src_id|31a826a4-3a95376d-79a28464-c3b05909_0
2025-09-30T14:59:33.657603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3273 sessionId: src_id|31a826a4-3a95376d-79a28464-c3b05909_0 is DEAD
2025-09-30T14:59:33.657732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a826a4-3a95376d-79a28464-c3b05909_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:33.657744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a826a4-3a95376d-79a28464-c3b05909_0] Write session will restart in 0.007882s
2025-09-30T14:59:33.657784Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a826a4-3a95376d-79a28464-c3b05909_0] Write session: Do CDS request
2025-09-30T14:59:33.657789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a826a4-3a95376d-79a28464-c3b05909_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:33.658341Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:33.666834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31a826a4-3a95376d-79a28464-c3b05909_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.666906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:33.666925Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3274
2025-09-30T14:59:33.667079Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3274 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.667116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3274 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:33.667127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3274 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:33.667132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:33.667607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3274 sessionId:  describe result for acl check
2025-09-30T14:59:33.667650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:33.667657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:33.667659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:33.667665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897049724477365:3114] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:33.668252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897049724477365:3114] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:33.669846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:33.671190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897049724477365:3114] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:33.671933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:33.672194Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:33.672203Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:33.672215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:33.672277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:33.672320Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897049634673670:12928]
2025-09-30T14:59:33.673016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:33.673429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:33.673491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:33.673921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:33.673993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.673999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.674001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.674002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.674004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.674005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.674007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.674008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.674009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.674011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.674012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.674013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.674015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.674017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.674018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.674025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.674035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.674039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.674043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.674047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.674051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.674055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.674059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.674063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.674067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.674071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.674075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.674079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.674084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.674088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.674097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.674105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.674113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.674119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.674125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.674131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.674137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.674144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.674149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.674155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.674160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.674166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.674176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.674183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.674193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.674199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.674211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.674217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.674222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.674240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.674252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.674256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.674261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.674269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.674274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.674281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.674285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.674291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.674297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.674303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.674353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:33.674565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897049724477365:3114] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:33.674582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897049724477365:3114] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:33.674587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897049724477365:3114] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:33.674610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3274 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:33.680180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:33.681067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:33.681086Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:33.681090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:33.681095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:33.681103Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3273 [2:7555897049634673670:12928]
2025-09-30T14:59:33.681122Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:33.681140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:33.681150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.681153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.681156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.681174Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:33.681188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:33.681196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:33.681279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.681288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.681294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.681299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:33.681302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:33.681371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:33.681379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.681392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.681402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.681419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:33.681443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477414:3114], now have 1 active actors on pipe
2025-09-30T14:59:33.681452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477296:2454], now have 1 active actors on pipe
2025-09-30T14:59:33.681459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897049634673665:12928]
2025-09-30T14:59:33.681461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897049634673665:12928]
2025-09-30T14:59:33.681464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897049634673665:12928]
2025-09-30T14:59:33.681478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:33.681493Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:33.681505Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:33.681516Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:33.681518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:33.681519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:33.681522Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:33.681526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3273
2025-09-30T14:59:33.681560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897049634673665:12928]
2025-09-30T14:59:33.681547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3273
2025-09-30T14:59:33.681569Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:33.681591Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:33.681610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.681615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.681648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:33.681661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.681666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.681673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:33.681684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.681693Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:33.681714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.681898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.681910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.681925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.682020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3274 partition: 0 MaxSeqNo: 42 sessionId: src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0
2025-09-30T14:59:33.682482Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31a826a4-3a95376d-79a28464-c3b05909_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:33.685613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0] Write session: try to update token
2025-09-30T14:59:33.685637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:33.694562Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:33.694582Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:33.694588Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:33.694590Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:33.694599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897049634673665:12928]
2025-09-30T14:59:33.694604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897049634673665:12928]
2025-09-30T14:59:33.694611Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897049634673665:12928]
2025-09-30T14:59:33.694655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:33.694663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.694662Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:33.694665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:33.694669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:33.694679Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:33.694813Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:33.704398Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3274 sessionId: src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:33.707323Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:33.757652Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897049724477421:4275]
2025-09-30T14:59:33.758056Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3273, pipe: [1:7555897049724477421:4275]
2025-09-30T14:59:33.809486Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:33.809982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.810000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.810020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477421:4275], now have 1 active actors on pipe
2025-09-30T14:59:33.810318Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:33.810349Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:33.810330Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897049724477421:4275]
2025-09-30T14:59:33.810335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:33.810352Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:33.810403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3274 reason: error at write: Disconnected sessionId: src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0
2025-09-30T14:59:33.810590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3274 sessionId: src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0 is DEAD
2025-09-30T14:59:33.810789Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:33.810800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0] Write session will restart in 0.005503s
2025-09-30T14:59:33.810826Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0] Write session: Do CDS request
2025-09-30T14:59:33.810835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:33.817822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.817970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:33.817988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3275
2025-09-30T14:59:33.818133Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3275 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.818175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3275 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:33.818185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3275 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:33.818190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:33.818763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3275 sessionId:  describe result for acl check
2025-09-30T14:59:33.818806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:33.818814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:33.818816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:33.818823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897049724477446:3119] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:33.819732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897049724477446:3119] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:33.822271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897049724477446:3119] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:33.823317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:33.825415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:33.825644Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:33.825660Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:33.825672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:33.825740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:33.825787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897049634673787:12930]
2025-09-30T14:59:33.826495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:33.826833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:33.826883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:33.827068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897049724477446:3119] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:33.827086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897049724477446:3119] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:33.827090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897049724477446:3119] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:33.827099Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3275 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:33.827286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:33.827361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.827371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.827373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.827375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.827376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.827378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.827380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.827381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.827383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.827384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.827386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.827387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.827389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.827390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.827392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.827398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.827410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.827416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.827421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.827426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.827431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.827436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.827441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.827446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.827451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.827456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.827460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.827466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.827471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.827476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.827484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.827493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.827501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.827508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.827513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.827521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.827526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.827533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.827538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.827544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.827550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.827556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.827562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.827574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.827580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.827586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.827594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.827605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.827611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.827623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.827629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.827640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.827645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.827657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.827663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.827674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.827679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.827690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.827697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.827711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.827762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:33.835387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:33.836338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:33.836360Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:33.836363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:33.836368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:33.836377Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3274 [2:7555897049634673787:12930]
2025-09-30T14:59:33.836396Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:33.836421Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:33.836430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.836433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.836437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.836456Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:33.836469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:33.836486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:33.836576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.836584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.836587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.836591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:33.836594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:33.836673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:33.836681Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.836697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.836717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.836743Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:33.836768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477542:3119], now have 1 active actors on pipe
2025-09-30T14:59:33.836778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477422:2454], now have 1 active actors on pipe
2025-09-30T14:59:33.836785Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897049634673782:12930]
2025-09-30T14:59:33.836793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897049634673782:12930]
2025-09-30T14:59:33.836797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897049634673782:12930]
2025-09-30T14:59:33.836819Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:33.836838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:33.836848Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:33.836852Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:33.836854Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:33.836861Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:33.836864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:33.836852Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3274
2025-09-30T14:59:33.836866Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3274
2025-09-30T14:59:33.836905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897049634673782:12930]
2025-09-30T14:59:33.836918Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:33.836926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:33.836940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.836945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.836998Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:33.837011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.837017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.837019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:33.837029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.837044Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:33.837075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.837302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.837311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.837326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.837407Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3275 partition: 0 MaxSeqNo: 42 sessionId: src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0
2025-09-30T14:59:33.837822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9b180b2e-969c7844-6c55e6f8-5fc8e237_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:33.849265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0] Write session: try to update token
2025-09-30T14:59:33.849292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:33.852594Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:33.852616Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:33.852619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:33.852621Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:33.852631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897049634673782:12930]
2025-09-30T14:59:33.852636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897049634673782:12930]
2025-09-30T14:59:33.852641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897049634673782:12930]
2025-09-30T14:59:33.852691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:33.852700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.852702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:33.852709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:33.852717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:33.852722Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:33.852864Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:33.866007Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3275 sessionId: src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:33.875326Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:33.910737Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897049724477563:4275]
2025-09-30T14:59:33.911082Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3274, pipe: [1:7555897049724477563:4275]
2025-09-30T14:59:33.972403Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:33.972944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.972960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.972977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477563:4275], now have 1 active actors on pipe
2025-09-30T14:59:33.973215Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:33.973224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897049724477563:4275]
2025-09-30T14:59:33.973234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:33.973239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:33.973273Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:33.973322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3275 reason: error at write: Disconnected sessionId: src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0
2025-09-30T14:59:33.973529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3275 sessionId: src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0 is DEAD
2025-09-30T14:59:33.973686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:33.973696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0] Write session will restart in 0.009510s
2025-09-30T14:59:33.973719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0] Write session: Do CDS request
2025-09-30T14:59:33.973725Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:33.984205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:33.984812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.984977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:33.984993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3276
2025-09-30T14:59:33.985128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3276 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:33.985181Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3276 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:33.985191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3276 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:33.985196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:33.985630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3276 sessionId:  describe result for acl check
2025-09-30T14:59:33.985660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:33.985667Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:33.985669Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:33.985674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897049724477649:3089] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:33.986169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:33.986231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897049724477649:3089] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:33.986352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:33.986362Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:33.986369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:33.986412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:33.986467Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897049634673905:12932]
2025-09-30T14:59:33.987052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:33.987324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:33.987374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:33.987731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:33.987804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.987812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.987813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.987814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.987815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.987816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.987818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.987819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.987820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.987822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.987823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.987825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.987826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.987827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.987828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.987835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.987845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.987849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.987853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.987857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.987862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.987865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.987869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.987872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.987877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.987882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.987886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.987890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.987893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.987897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.987905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.987915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:33.987922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.987927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:33.987931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.987936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:33.987941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.987946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:33.987951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.987957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:33.987961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.987968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:33.987973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.987978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:33.987983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.987988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:33.987993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.987999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:33.988003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.988009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:33.988013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.988019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.988029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.988035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.988046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.988051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.988060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.988066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:33.988072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.988081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:33.988121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:33.988329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897049724477649:3089] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:33.993532Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897049724477649:3089] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:33.993550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897049724477649:3089] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:33.993555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897049724477649:3089] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:33.993565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3276 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:33.993891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:33.994781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:33.994800Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:33.994803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:33.994807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:33.994814Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3275 [2:7555897049634673905:12932]
2025-09-30T14:59:33.994832Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:33.994850Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:33.994858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.994862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.994864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.994881Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:33.994896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:33.994903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:33.994962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.994971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.994974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.994977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:33.994980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:33.995049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:33.995058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:33.995070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:33.995089Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:33.995112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:33.995135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477567:2454], now have 1 active actors on pipe
2025-09-30T14:59:33.995145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897049724477685:3089], now have 1 active actors on pipe
2025-09-30T14:59:33.995151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897049634673899:12932]
2025-09-30T14:59:33.995154Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897049634673899:12932]
2025-09-30T14:59:33.995156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897049634673899:12932]
2025-09-30T14:59:33.995152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3275
2025-09-30T14:59:33.995157Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3275
2025-09-30T14:59:33.995171Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:33.995180Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:33.995184Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:33.995187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:33.995189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:33.995204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:33.995207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:33.995269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.995278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.995295Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897049634673899:12932]
2025-09-30T14:59:33.995315Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:33.995328Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:33.995347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:33.995356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:33.995366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:33.995368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:33.995378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:33.995393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:33.995425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.995585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:33.995594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:33.995607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:33.995697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3276 partition: 0 MaxSeqNo: 42 sessionId: src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0
2025-09-30T14:59:33.996116Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eddbcb7e-8e84c49-2f2fe68c-429e2473_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:33.998945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0] Write session: try to update token
2025-09-30T14:59:33.998966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:34.007907Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:34.007930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:34.007932Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:34.007935Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:34.007944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897049634673899:12932]
2025-09-30T14:59:34.007948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897049634673899:12932]
2025-09-30T14:59:34.007952Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897049634673899:12932]
2025-09-30T14:59:34.007996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:34.008003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.008001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:34.008005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:34.008008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:34.008012Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:34.008139Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:34.014005Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3276 sessionId: src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:34.016765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:34.073553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897054019444988:4275]
2025-09-30T14:59:34.073900Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3275, pipe: [1:7555897054019444988:4275]
2025-09-30T14:59:34.122626Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:34.123091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.123105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.123140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019444988:4275], now have 1 active actors on pipe
2025-09-30T14:59:34.123383Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:34.123441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:34.123458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:34.123475Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897054019444988:4275]
2025-09-30T14:59:34.123500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:34.123532Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3276 reason: error at write: Disconnected sessionId: src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0
2025-09-30T14:59:34.123730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3276 sessionId: src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0 is DEAD
2025-09-30T14:59:34.123906Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:34.123915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0] Write session will restart in 0.007054s
2025-09-30T14:59:34.123940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0] Write session: Do CDS request
2025-09-30T14:59:34.123948Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:34.131814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:34.131851Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:34.131866Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3277
2025-09-30T14:59:34.132056Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3277 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:34.132100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3277 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:34.132110Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3277 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:34.132113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:34.132674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3277 sessionId:  describe result for acl check
2025-09-30T14:59:34.132713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:34.132721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:34.132724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:34.132731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897054019445038:3095] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:34.133340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897054019445038:3095] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:34.135291Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897054019445038:3095] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:34.135351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:34.137371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:34.137588Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:34.137605Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:34.137628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:34.137696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897054019445038:3095] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:34.137713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897054019445038:3095] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:34.137717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897054019445038:3095] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:34.137726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3277 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:34.137696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:34.137755Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897053929641320:12934]
2025-09-30T14:59:34.138406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:34.138716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:34.138768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:34.139103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:34.139204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.139212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.139213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.139214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.139215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.139217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.139218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.139219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.139221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.139222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.139223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.139224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.139225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.139227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.139228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.139234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.139261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.139266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.139269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.139274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.139278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.139281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.139285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.139289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.139294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.139298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.139302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.139306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.139311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.139315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.139323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.139330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.139337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.139343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.139350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.139356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.139362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.139372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.139378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.139390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.139395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.139406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.139413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.139422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.139427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.139432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.139441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.139448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.139458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.139464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.139474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.139479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.139487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.139493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.139499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.139509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.139514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.139524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.139530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.139535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.139589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:34.145265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:34.146187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:34.146202Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:34.146206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:34.146211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:34.146219Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3276 [2:7555897053929641320:12934]
2025-09-30T14:59:34.146239Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:34.146264Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:34.146272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:34.146276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:34.146278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:34.146295Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:34.146308Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:34.146316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:34.146393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.146405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.146409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.146413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:34.146415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:34.146494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:34.146505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.146519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.146532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.146554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:34.146582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019444990:2454], now have 1 active actors on pipe
2025-09-30T14:59:34.146590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445107:3095], now have 1 active actors on pipe
2025-09-30T14:59:34.146598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897053929641315:12934]
2025-09-30T14:59:34.146601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897053929641315:12934]
2025-09-30T14:59:34.146603Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897053929641315:12934]
2025-09-30T14:59:34.146619Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:34.146643Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:34.146667Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:34.146670Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:34.146708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897053929641315:12934]
2025-09-30T14:59:34.146725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:34.146715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3276
2025-09-30T14:59:34.146716Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3276
2025-09-30T14:59:34.146769Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:34.146781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.146782Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:34.146785Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:34.146786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.146794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:34.146811Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:34.146826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:34.146832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:34.146834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:34.146846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:34.146858Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:34.146883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:34.147106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.147116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.147131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:34.147382Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3277 partition: 0 MaxSeqNo: 42 sessionId: src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0
2025-09-30T14:59:34.147822Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a6a6932-8a685b43-67821bd1-3c769ee9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:34.150945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0] Write session: try to update token
2025-09-30T14:59:34.150975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:34.159501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:34.159526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:34.159537Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897053929641315:12934]
2025-09-30T14:59:34.159589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:34.159591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:34.159804Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:34.159977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:34.160146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:34.160377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:34.160614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:34.160673Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:34.167520Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3277 sessionId: src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:34.170458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:34.173800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.173838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.173862Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:34.173870Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:34.173874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:34.173876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:34.173885Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897053929641315:12934]
2025-09-30T14:59:34.173889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897053929641315:12934]
2025-09-30T14:59:34.173894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897053929641315:12934]
2025-09-30T14:59:34.173946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:34.173943Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:34.173958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.173961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:34.173962Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:34.173966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:34.174111Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:34.223553Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897054019445132:4275]
2025-09-30T14:59:34.223844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3276, pipe: [1:7555897054019445132:4275]
2025-09-30T14:59:34.294017Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:34.294336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:34.294377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445132:4275], now have 1 active actors on pipe
2025-09-30T14:59:34.294514Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:34.294547Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897054019445132:4275]
2025-09-30T14:59:34.294567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:34.294618Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:34.294631Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:34.294697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3277 reason: error at write: Disconnected sessionId: src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0
2025-09-30T14:59:34.294873Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3277 sessionId: src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0 is DEAD
2025-09-30T14:59:34.295033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:34.295043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0] Write session will restart in 0.008186s
2025-09-30T14:59:34.295068Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0] Write session: Do CDS request
2025-09-30T14:59:34.295074Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:34.304835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:34.304931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:34.304949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3278
2025-09-30T14:59:34.305073Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3278 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:34.305108Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3278 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:34.305118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3278 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:34.305122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:34.305539Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3278 sessionId:  describe result for acl check
2025-09-30T14:59:34.305580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:34.305582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:34.305584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:34.305591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897054019445224:3064] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:34.306153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897054019445224:3064] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:34.306143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:34.308261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:34.308468Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:34.308481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:34.308506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:34.308543Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897054019445224:3064] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:34.308566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:34.308612Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897053929641479:12949]
2025-09-30T14:59:34.309259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:34.309662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:34.309724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:34.310075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:34.310161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.310169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.310170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.310172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.310173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.310174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.310176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.310177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.310178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.310179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.310181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.310182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.310183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.310184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.310186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.310193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.310204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.310208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.310213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.310216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.310220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.310224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.310227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.310231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.310236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.310240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.310244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.310248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.310252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.310256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.310264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.310272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.310279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.310285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.310290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.310296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.310300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.310306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.310311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.310317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.310325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.310333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.310343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.310349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.310358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.310363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.310368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.310373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.310378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.310383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.310388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.310392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.310397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.310403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.310408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.310418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.310422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.310428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.310436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.310442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.310497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:34.311505Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897054019445224:3064] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:34.311522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897054019445224:3064] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:34.311526Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897054019445224:3064] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:34.311534Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3278 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:34.316255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:34.317436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:34.317453Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:34.317456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:34.317461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:34.317468Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3277 [2:7555897053929641479:12949]
2025-09-30T14:59:34.317486Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:34.317503Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:34.317512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:34.317516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:34.317518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:34.317536Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:34.317543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:34.317551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:34.317619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.317627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.317631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.317635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:34.317638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:34.317705Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:34.317712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.317725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.317741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.317761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:34.317784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897053929641473:12949]
2025-09-30T14:59:34.317791Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897053929641473:12949]
2025-09-30T14:59:34.317793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897053929641473:12949]
2025-09-30T14:59:34.317806Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:34.317823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:34.317825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445265:3064], now have 1 active actors on pipe
2025-09-30T14:59:34.317829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445142:2454], now have 1 active actors on pipe
2025-09-30T14:59:34.317834Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:34.317836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:34.317837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:34.317851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:34.317855Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:34.317892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897053929641473:12949]
2025-09-30T14:59:34.317904Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:34.317912Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:34.317916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3277
2025-09-30T14:59:34.317919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3277
2025-09-30T14:59:34.317990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.318001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.318027Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|370492e9-91809414-9c8edb13-6a39133d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:34.318042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:34.318049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:34.318051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:34.318061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:34.318071Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:34.318086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:34.318254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.318264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.318281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:34.318357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3278 partition: 0 MaxSeqNo: 42 sessionId: src_id|370492e9-91809414-9c8edb13-6a39133d_0
2025-09-30T14:59:34.318793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|249c9e0f-f753a981-8de31ef1-8f0dc3de_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|370492e9-91809414-9c8edb13-6a39133d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:34.321735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370492e9-91809414-9c8edb13-6a39133d_0] Write session: try to update token
2025-09-30T14:59:34.321753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370492e9-91809414-9c8edb13-6a39133d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:34.331269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:34.331293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:34.331297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:34.331299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:34.331309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897053929641473:12949]
2025-09-30T14:59:34.331314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897053929641473:12949]
2025-09-30T14:59:34.331319Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897053929641473:12949]
2025-09-30T14:59:34.331370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:34.331384Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:34.331392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.331395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:34.331401Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:34.331406Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:34.331551Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:34.336930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3278 sessionId: src_id|370492e9-91809414-9c8edb13-6a39133d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:34.339903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:34.394586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897054019445278:4275]
2025-09-30T14:59:34.394937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3277, pipe: [1:7555897054019445278:4275]
2025-09-30T14:59:34.444601Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:34.444872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.444885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.444920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445278:4275], now have 1 active actors on pipe
2025-09-30T14:59:34.445102Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:34.445193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:34.445210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:34.445216Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:34.445280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3278 reason: error at write: Disconnected sessionId: src_id|370492e9-91809414-9c8edb13-6a39133d_0
2025-09-30T14:59:34.445280Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897054019445278:4275]
2025-09-30T14:59:34.445476Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3278 sessionId: src_id|370492e9-91809414-9c8edb13-6a39133d_0 is DEAD
2025-09-30T14:59:34.445664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370492e9-91809414-9c8edb13-6a39133d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:34.445671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370492e9-91809414-9c8edb13-6a39133d_0] Write session will restart in 0.007193s
2025-09-30T14:59:34.445695Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370492e9-91809414-9c8edb13-6a39133d_0] Write session: Do CDS request
2025-09-30T14:59:34.445704Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370492e9-91809414-9c8edb13-6a39133d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:34.453903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|370492e9-91809414-9c8edb13-6a39133d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:34.453887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:34.453906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3279
2025-09-30T14:59:34.454135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3279 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:34.454166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3279 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:34.454171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3279 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:34.454175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:34.454688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3279 sessionId:  describe result for acl check
2025-09-30T14:59:34.454729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:34.454731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:34.454735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:34.454741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897054019445331:3045] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:34.455361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897054019445331:3045] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:34.457421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897054019445331:3045] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:34.457785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:34.459676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:34.459902Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:34.459915Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:34.459926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:34.459988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:34.460032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897053929641601:12951]
2025-09-30T14:59:34.460336Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897054019445331:3045] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:34.460354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897054019445331:3045] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:34.460358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897054019445331:3045] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:34.460366Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3279 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:34.460615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:34.460911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:34.460948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:34.461285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:34.461359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.461365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.461367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.461368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.461369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.461371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.461372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.461373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.461374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.461375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.461376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.461378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.461379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.461381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.461382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.461387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.461398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.461402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.461406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.461410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.461414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.461418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.461423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.461427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.461431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.461435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.461439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.461443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.461447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.461452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.461459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.461466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.461472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.461478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.461483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.461489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.461494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.461500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.461505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.461511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.461516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.461521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.461526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.461537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.461546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.461556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.461561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.461568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.461573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.461578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.461583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.461593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.461597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.461602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.461612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.461617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.461627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.461632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.461636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.461641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.461692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:34.467667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:34.468600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:34.468621Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:34.468624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:34.468629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:34.468636Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3278 [2:7555897053929641601:12951]
2025-09-30T14:59:34.468653Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:34.468668Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:34.468672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:34.468676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:34.468678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:34.468696Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:34.468703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:34.468710Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:34.468771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.468781Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.468783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.468787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:34.468790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:34.468867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:34.468877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.468891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.468901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.468918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:34.468944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445401:3045], now have 1 active actors on pipe
2025-09-30T14:59:34.468952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445282:2454], now have 1 active actors on pipe
2025-09-30T14:59:34.468960Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897053929641596:12951]
2025-09-30T14:59:34.468962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897053929641596:12951]
2025-09-30T14:59:34.468965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897053929641596:12951]
2025-09-30T14:59:34.468978Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:34.468997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:34.468997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:34.469000Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:34.469003Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:34.469021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:34.469025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:34.469024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3278
2025-09-30T14:59:34.469030Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3278
2025-09-30T14:59:34.469060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897053929641596:12951]
2025-09-30T14:59:34.469074Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:34.469081Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:34.469138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.469150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.469178Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95db232d-58e632c5-cd8da261-823bcbe5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:34.469186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:34.469190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:34.469192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:34.469203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:34.469214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:34.469229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:34.469375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.469385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.469401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:34.469473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3279 partition: 0 MaxSeqNo: 42 sessionId: src_id|95db232d-58e632c5-cd8da261-823bcbe5_0
2025-09-30T14:59:34.469874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|370492e9-91809414-9c8edb13-6a39133d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|95db232d-58e632c5-cd8da261-823bcbe5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:34.472915Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95db232d-58e632c5-cd8da261-823bcbe5_0] Write session: try to update token
2025-09-30T14:59:34.472937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95db232d-58e632c5-cd8da261-823bcbe5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:34.483448Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:34.483488Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:34.483499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897053929641596:12951]
2025-09-30T14:59:34.483549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:34.483560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:34.483747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:34.483926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:34.484087Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:34.484250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:34.484473Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:34.484543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:34.490048Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3279 sessionId: src_id|95db232d-58e632c5-cd8da261-823bcbe5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:34.493107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:34.493632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:34.493452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.493478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.493518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:34.495338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:34.495344Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:34.495346Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:34.495353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:34.495364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897053929641596:12951]
2025-09-30T14:59:34.495368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897053929641596:12951]
2025-09-30T14:59:34.495372Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897053929641596:12951]
2025-09-30T14:59:34.495415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:34.495423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.495425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:34.495440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:34.495447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:34.495464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:34.495566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:34.545567Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897054019445413:4275]
2025-09-30T14:59:34.545863Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3278, pipe: [1:7555897054019445413:4275]
2025-09-30T14:59:34.616371Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:34.625821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.625863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.626060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:34.626140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:34.626218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:34.626294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:34.626352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:34.626365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:34.626446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:34.626524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:34.626609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:34.626685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:34.626737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:34.626745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:34.626826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:34.626908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:34.626999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:34.627080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:34.627146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:34.627156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:34.627235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:34.627338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:34.627410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:34.627489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:34.627538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:34.627546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:34.627625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:34.627696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:34.627770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:34.627844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:34.627899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:34.627909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:34.627984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:34.628058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:34.628131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:34.628207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:34.628285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:34.628294Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:34.628375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:34.628446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:34.628540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:34.628614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:34.628667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:34.628675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:34.628751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:34.628822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:34.628892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:34.628974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:34.629028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:34.629037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:34.629112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:34.629180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:34.629256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:34.629331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:34.629383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:34.629390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:34.629465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:34.629541Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:34.629621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:34.629700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:34.629749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:34.629758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:34.629837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445413:4275], now have 1 active actors on pipe
2025-09-30T14:59:34.630123Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:34.630202Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:34.630211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:34.630243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3279 reason: error at write: Disconnected sessionId: src_id|95db232d-58e632c5-cd8da261-823bcbe5_0
2025-09-30T14:59:34.630436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3279 sessionId: src_id|95db232d-58e632c5-cd8da261-823bcbe5_0 is DEAD
2025-09-30T14:59:34.630699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897054019445413:4275]
2025-09-30T14:59:34.630918Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95db232d-58e632c5-cd8da261-823bcbe5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:34.630931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95db232d-58e632c5-cd8da261-823bcbe5_0] Write session will restart in 0.005388s
2025-09-30T14:59:34.630956Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95db232d-58e632c5-cd8da261-823bcbe5_0] Write session: Do CDS request
2025-09-30T14:59:34.630962Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95db232d-58e632c5-cd8da261-823bcbe5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:34.631378Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:34.637837Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95db232d-58e632c5-cd8da261-823bcbe5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:34.637997Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:34.638014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3280
2025-09-30T14:59:34.638176Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3280 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:34.638215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3280 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:34.638221Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3280 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:34.638226Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:34.638761Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3280 sessionId:  describe result for acl check
2025-09-30T14:59:34.638804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:34.638812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:34.638815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:34.638821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897054019445423:3052] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:34.639550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897054019445423:3052] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:34.642568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897054019445423:3052] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:34.647007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897054019445423:3052] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:34.647028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897054019445423:3052] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:34.647032Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897054019445423:3052] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:34.647041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3280 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:34.648535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:34.650624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:34.650867Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:34.650880Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:34.650893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:34.650962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:34.651014Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897053929641739:12954]
2025-09-30T14:59:34.651705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:34.652048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:34.652105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:34.652448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:34.652544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.652552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.652553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.652555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.652556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.652558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.652560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.652562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.652563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.652565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.652566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.652568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.652569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.652570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.652571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.652578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.652590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.652595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.652600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.652605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.652610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.652615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.652619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.652624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.652629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.652634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.652638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.652643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.652647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.652652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.652666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.652681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.652693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.652699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.652709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.652714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.652720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.652726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.652731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.652737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.652741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.652747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.652753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.652765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.652770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.652780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.652786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.652795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.652800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.652806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.652830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.652842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.652852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.652858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.652869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.652876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.652886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.652891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.652901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.652907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.652975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:34.658678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:34.659666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:34.659687Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:34.659690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:34.659694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:34.659701Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3279 [2:7555897053929641739:12954]
2025-09-30T14:59:34.659720Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:34.659737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:34.659740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:34.659744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:34.659746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:34.659762Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:34.659776Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:34.659785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:34.659856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.659865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.659867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.659871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:34.659873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:34.659944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:34.659957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.659972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.659984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.659998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:34.660025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445532:3052], now have 1 active actors on pipe
2025-09-30T14:59:34.660033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445415:2454], now have 1 active actors on pipe
2025-09-30T14:59:34.660040Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897053929641734:12954]
2025-09-30T14:59:34.660042Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897053929641734:12954]
2025-09-30T14:59:34.660045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897053929641734:12954]
2025-09-30T14:59:34.660058Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:34.660073Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:34.660077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:34.660084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:34.660087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:34.660092Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:34.660096Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:34.660132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897053929641734:12954]
2025-09-30T14:59:34.660155Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:34.660286Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3279
2025-09-30T14:59:34.660320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3279
2025-09-30T14:59:34.660181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:34.660434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.660452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.660516Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:34.660531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:34.660543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:34.660546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:34.660557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:34.660579Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:34.660602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:34.660807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.660819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.660844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:34.660986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3280 partition: 0 MaxSeqNo: 42 sessionId: src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0
2025-09-30T14:59:34.661453Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95db232d-58e632c5-cd8da261-823bcbe5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:34.664484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0] Write session: try to update token
2025-09-30T14:59:34.664526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:34.674107Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:34.674135Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:34.674138Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:34.674140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:34.674151Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897053929641734:12954]
2025-09-30T14:59:34.674156Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897053929641734:12954]
2025-09-30T14:59:34.674162Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897053929641734:12954]
2025-09-30T14:59:34.674203Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:34.674207Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:34.674209Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:34.674213Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:34.674218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.674221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:34.674376Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:34.681404Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3280 sessionId: src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:34.684532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:34.730979Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897054019445547:4275]
2025-09-30T14:59:34.731374Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3279, pipe: [1:7555897054019445547:4275]
2025-09-30T14:59:34.803146Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:34.803947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.803975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.804031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445547:4275], now have 1 active actors on pipe
2025-09-30T14:59:34.804539Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:34.804355Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:34.804371Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:34.804460Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3280 reason: error at write: Disconnected sessionId: src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0
2025-09-30T14:59:34.804550Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:34.804600Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897054019445547:4275]
2025-09-30T14:59:34.804656Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3280 sessionId: src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0 is DEAD
2025-09-30T14:59:34.805135Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:34.805149Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0] Write session will restart in 0.006159s
2025-09-30T14:59:34.805173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0] Write session: Do CDS request
2025-09-30T14:59:34.805178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:34.812826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:34.812917Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:34.812942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3281
2025-09-30T14:59:34.813212Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3281 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:34.813248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3281 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:34.813253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3281 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:34.813258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:34.813727Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3281 sessionId:  describe result for acl check
2025-09-30T14:59:34.813758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:34.813760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:34.813762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:34.813771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897054019445566:3034] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:34.814377Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897054019445566:3034] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:34.817529Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897054019445566:3034] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:34.822738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897054019445566:3034] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:34.822754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897054019445566:3034] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:34.822757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897054019445566:3034] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:34.822765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3281 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:34.828197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:34.831714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:34.832004Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:34.832016Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:34.832028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:34.832102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:34.832180Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897053929641863:12957]
2025-09-30T14:59:34.832944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:34.833257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:34.833317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:34.833720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:34.833794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.833802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.833804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.833805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.833807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.833809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.833810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.833813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.833815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.833816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.833818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.833819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.833821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.833822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.833824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.833830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.833843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.833848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.833853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.833858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.833863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.833868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.833874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.833879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.833884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.833888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.833893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.833898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.833903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.833908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.833917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.833927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:34.833934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.833941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:34.833947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.833954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:34.833968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.833975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:34.833987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.833999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:34.834008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.834015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:34.834023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.834030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:34.834042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.834052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:34.834063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.834074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:34.834083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.834090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:34.834101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.834119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.834127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.834134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.834145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.834155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.834165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.834176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:34.834187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.834193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:34.834246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:34.840935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:34.842520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:34.842543Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:34.842547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:34.842551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:34.842559Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3280 [2:7555897053929641863:12957]
2025-09-30T14:59:34.842580Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:34.842598Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:34.842604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:34.842607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:34.842609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:34.842626Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:34.842639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:34.842647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:34.842724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.842732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.842735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.842739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:34.842742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:34.842816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:34.842824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.842839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:34.842858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:34.842881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:34.842905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445671:3034], now have 1 active actors on pipe
2025-09-30T14:59:34.842914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445548:2454], now have 1 active actors on pipe
2025-09-30T14:59:34.842920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897053929641858:12957]
2025-09-30T14:59:34.842929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897053929641858:12957]
2025-09-30T14:59:34.842931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897053929641858:12957]
2025-09-30T14:59:34.842944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:34.842958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:34.842962Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:34.842966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:34.842968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:34.842979Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:34.842983Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:34.843025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897053929641858:12957]
2025-09-30T14:59:34.843037Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:34.843055Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:34.843032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3280
2025-09-30T14:59:34.843082Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3280
2025-09-30T14:59:34.843093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.843105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.843134Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:34.843141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:34.843150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:34.843153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:34.843163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:34.843173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:34.843187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:34.843348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.843354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.843368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:34.843470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3281 partition: 0 MaxSeqNo: 42 sessionId: src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0
2025-09-30T14:59:34.843876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c2f414a-9a27421-a2ed3711-85ab9539_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:34.847103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0] Write session: try to update token
2025-09-30T14:59:34.847123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:34.858466Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:34.858493Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:34.858496Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:34.858498Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:34.858509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897053929641858:12957]
2025-09-30T14:59:34.858517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897053929641858:12957]
2025-09-30T14:59:34.858522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897053929641858:12957]
2025-09-30T14:59:34.858569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:34.858582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:34.858581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:34.858589Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:34.858591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:34.858594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:34.858974Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:34.876096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3281 sessionId: src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:34.879454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:34.906352Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897054019445698:4275]
2025-09-30T14:59:34.907018Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3280, pipe: [1:7555897054019445698:4275]
2025-09-30T14:59:34.975975Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:34.976471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:34.976506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:34.976528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445698:4275], now have 1 active actors on pipe
2025-09-30T14:59:34.979548Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:34.979490Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897054019445698:4275]
2025-09-30T14:59:34.979556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:34.979558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:34.979622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3281 reason: error at write: Disconnected sessionId: src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0
2025-09-30T14:59:34.979815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3281 sessionId: src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0 is DEAD
2025-09-30T14:59:34.979935Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:34.980201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:34.980213Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0] Write session will restart in 0.009710s
2025-09-30T14:59:34.980238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0] Write session: Do CDS request
2025-09-30T14:59:34.980248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:34.990855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:34.990947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:34.990979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3282
2025-09-30T14:59:34.991107Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3282 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:34.991151Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3282 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:34.991162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3282 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:34.991167Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:34.991945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3282 sessionId:  describe result for acl check
2025-09-30T14:59:34.991989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:34.991997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:34.992000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:34.992008Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897054019445719:3023] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:34.992640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897054019445719:3023] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:34.995601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897054019445719:3023] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:35.000197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:35.001663Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897054019445719:3023] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:35.001683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897054019445719:3023] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:35.001687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897054019445719:3023] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:35.001697Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3282 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:35.002834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:35.003222Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:35.003227Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:35.003257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:35.003342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:35.003408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897058224609284:12959]
2025-09-30T14:59:35.004143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:35.004670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:35.004715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:35.005097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:35.005165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.005166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.005167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.005168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.005170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.005171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.005173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.005174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.005176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.005177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.005179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.005180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.005181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.005183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.005184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.005190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.005202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.005206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.005211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.005215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.005219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.005224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.005228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.005232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.005237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.005241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.005245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.005249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.005253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.005257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.005266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.005275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.005281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.005287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.005292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.005298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.005303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.005308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.005314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.005320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.005326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.005332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.005337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.005342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.005346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.005352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.005358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.005363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.005369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.005375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.005380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.005386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.005391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.005397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.005403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.005408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.005414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.005419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.005424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.005429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.005478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:35.013265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:35.014216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:35.014235Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:35.014237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:35.014241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:35.014248Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3281 [2:7555897058224609284:12959]
2025-09-30T14:59:35.014263Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:35.014277Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:35.014279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:35.014281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:35.014283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:35.014297Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:35.014305Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:35.014311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:35.014377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.014385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.014388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.014395Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:35.014397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:35.014462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:35.014475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.014486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.014493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.014504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:35.014522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413117:3023], now have 1 active actors on pipe
2025-09-30T14:59:35.014533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897054019445702:2454], now have 1 active actors on pipe
2025-09-30T14:59:35.014540Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897053929641982:12959]
2025-09-30T14:59:35.014543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897053929641982:12959]
2025-09-30T14:59:35.014545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897053929641982:12959]
2025-09-30T14:59:35.014560Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:35.014577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:35.014580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:35.014584Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:35.014587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:35.014591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:35.014594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:35.014631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897053929641982:12959]
2025-09-30T14:59:35.014644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:35.014668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:35.014637Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3281
2025-09-30T14:59:35.014637Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3281
2025-09-30T14:59:35.014816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.014824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.014845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:35.014854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:35.014857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:35.014859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:35.014869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:35.014884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:35.014902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:35.015075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.015090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.015117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:35.015228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3282 partition: 0 MaxSeqNo: 42 sessionId: src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0
2025-09-30T14:59:35.015657Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3ef9d9b2-2325169d-f1a7e221-d3ce9b3c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:35.018893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0] Write session: try to update token
2025-09-30T14:59:35.018921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:35.028539Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:35.028566Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:35.028570Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:35.028578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:35.028589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897053929641982:12959]
2025-09-30T14:59:35.028595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897053929641982:12959]
2025-09-30T14:59:35.028598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897053929641982:12959]
2025-09-30T14:59:35.028647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:35.028660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.028668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:35.028834Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:35.031326Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:35.031351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:35.031357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:35.038171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3282 sessionId: src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:35.041669Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:35.079605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897058314413129:4275]
2025-09-30T14:59:35.079914Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3281, pipe: [1:7555897058314413129:4275]
2025-09-30T14:59:35.151229Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:35.151792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.151814Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.151836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413129:4275], now have 1 active actors on pipe
2025-09-30T14:59:35.152083Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:35.152263Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:35.152332Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897058314413129:4275]
2025-09-30T14:59:35.152360Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:35.152459Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3282 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0
2025-09-30T14:59:35.152719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3282 sessionId: src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0 is DEAD
2025-09-30T14:59:35.152881Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:35.152894Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0] Write session will restart in 0.005563s
2025-09-30T14:59:35.152923Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0] Write session: Do CDS request
2025-09-30T14:59:35.152929Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:35.159868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:35.159940Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:35.159967Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3283
2025-09-30T14:59:35.160137Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3283 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:35.160169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3283 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:35.160180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3283 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:35.160187Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:35.160690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3283 sessionId:  describe result for acl check
2025-09-30T14:59:35.160723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:35.160725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:35.160726Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:35.160733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897058314413147:3014] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:35.161322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897058314413147:3014] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:35.164813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897058314413147:3014] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:35.168114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897058314413147:3014] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:35.168133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897058314413147:3014] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:35.168285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:35.168137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897058314413147:3014] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:35.168146Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3283 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:35.171340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:35.171636Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:35.171648Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:35.171661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:35.171738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:35.171786Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897058224609410:12961]
2025-09-30T14:59:35.172556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:35.172971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:35.173027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:35.173426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:35.173504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.173512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.173513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.173515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.173516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.173517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.173519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.173521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.173522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.173524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.173525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.173527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.173528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.173530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.173531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.173538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.173550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.173556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.173561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.173567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.173572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.173577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.173588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.173592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.173597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.173600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.173608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.173612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.173616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.173619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.173627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.173640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.173651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.173657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.173666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.173671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.173682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.173693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.173704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.173728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.173737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.173744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.173749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.173761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.173770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.173777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.173782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.173788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.173797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.173808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.173818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.173823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.173828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.173839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.173850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.173861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.173871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.173881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.173887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.173898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.173950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:35.182008Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3282
2025-09-30T14:59:35.182066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3282
2025-09-30T14:59:35.180048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:35.181470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:35.181480Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:35.181484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:35.181488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:35.181497Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3282 [2:7555897058224609410:12961]
2025-09-30T14:59:35.181514Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:35.181533Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:35.181537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:35.181541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:35.181544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:35.181563Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:35.181571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:35.181579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:35.181663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.181666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.181669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.181673Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:35.181677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:35.181754Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:35.181757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.181773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.181786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.181805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:35.181823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897058224609403:12961]
2025-09-30T14:59:35.181826Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897058224609403:12961]
2025-09-30T14:59:35.181828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897058224609403:12961]
2025-09-30T14:59:35.181837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:35.181853Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:35.181870Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:35.181869Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:35.181872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:35.181873Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:35.181875Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:35.181913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897058224609403:12961]
2025-09-30T14:59:35.181922Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:35.181932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413131:2454], now have 1 active actors on pipe
2025-09-30T14:59:35.181936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413254:3014], now have 1 active actors on pipe
2025-09-30T14:59:35.181940Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:35.182648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.182664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.182694Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|722bfb74-21615148-43a6c121-5c550cce_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:35.182703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:35.182707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:35.182710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:35.182722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:35.182734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:35.182751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:35.182953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.182970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.182984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:35.183185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3283 partition: 0 MaxSeqNo: 42 sessionId: src_id|722bfb74-21615148-43a6c121-5c550cce_0
2025-09-30T14:59:35.183635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f8a0cf61-38d4135e-ab20ce8a-1ab97348_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|722bfb74-21615148-43a6c121-5c550cce_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:35.186803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|722bfb74-21615148-43a6c121-5c550cce_0] Write session: try to update token
2025-09-30T14:59:35.186831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|722bfb74-21615148-43a6c121-5c550cce_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:35.196704Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:35.196734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:35.196737Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:35.196739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:35.196751Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897058224609403:12961]
2025-09-30T14:59:35.196757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897058224609403:12961]
2025-09-30T14:59:35.196761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897058224609403:12961]
2025-09-30T14:59:35.196811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:35.196820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.196823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:35.196826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:35.196833Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:35.196838Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:35.196987Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:35.213928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3283 sessionId: src_id|722bfb74-21615148-43a6c121-5c550cce_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:35.216967Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:35.255435Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897058314413270:4275]
2025-09-30T14:59:35.256093Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3282, pipe: [1:7555897058314413270:4275]
2025-09-30T14:59:35.338124Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:35.338178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:35.338181Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:35.338245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3283 reason: error at write: Disconnected sessionId: src_id|722bfb74-21615148-43a6c121-5c550cce_0
2025-09-30T14:59:35.337121Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:35.337649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.337663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.337687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413270:4275], now have 1 active actors on pipe
2025-09-30T14:59:35.338090Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:35.338660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|722bfb74-21615148-43a6c121-5c550cce_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:35.338670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|722bfb74-21615148-43a6c121-5c550cce_0] Write session will restart in 0.005512s
2025-09-30T14:59:35.338697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|722bfb74-21615148-43a6c121-5c550cce_0] Write session: Do CDS request
2025-09-30T14:59:35.338703Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|722bfb74-21615148-43a6c121-5c550cce_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:35.338463Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897058314413270:4275]
2025-09-30T14:59:35.338464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3283 sessionId: src_id|722bfb74-21615148-43a6c121-5c550cce_0 is DEAD
2025-09-30T14:59:35.345929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|722bfb74-21615148-43a6c121-5c550cce_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:35.346091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:35.346109Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3284
2025-09-30T14:59:35.346380Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3284 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:35.346428Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3284 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:35.346434Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3284 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:35.346439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:35.347050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3284 sessionId:  describe result for acl check
2025-09-30T14:59:35.347077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:35.347081Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:35.347084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:35.347089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897058314413304:2990] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:35.347705Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897058314413304:2990] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:35.350590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897058314413304:2990] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:35.354281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897058314413304:2990] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:35.354309Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897058314413304:2990] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:35.354313Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897058314413304:2990] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:35.354324Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3284 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:35.363775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:35.366559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:35.366780Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:35.366784Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:35.366795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:35.366843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:35.366883Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897058224609576:12976]
2025-09-30T14:59:35.367678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:35.367999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:35.368042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:35.368416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:35.368476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.368482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.368484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.368499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.368500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.368502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.368503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.368505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.368506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.368508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.368509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.368510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.368512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.368513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.368514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.368522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.368533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.368537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.368542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.368547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.368551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.368556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.368560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.368564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.368569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.368573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.368577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.368581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.368585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.368590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.368597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.368607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.368614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.368619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.368624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.368642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.368647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.368653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.368658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.368664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.368669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.368675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.368684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.368690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.368696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.368701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.368707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.368712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.368717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.368723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.368728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.368734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.368739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.368745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.368750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.368755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.368760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.368766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.368771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.368776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.368829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:35.375055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:35.376117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:35.376135Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:35.376139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:35.376144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:35.376152Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3283 [2:7555897058224609576:12976]
2025-09-30T14:59:35.376175Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:35.376992Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3283
2025-09-30T14:59:35.377052Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3283
2025-09-30T14:59:35.376198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:35.376210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:35.376214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:35.376217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:35.376235Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:35.376242Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:35.376250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:35.376325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.376327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.376330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.376333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:35.376336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:35.376414Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:35.376417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.376430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.376443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.376461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:35.376479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897058224609571:12976]
2025-09-30T14:59:35.376482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897058224609571:12976]
2025-09-30T14:59:35.376484Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897058224609571:12976]
2025-09-30T14:59:35.376517Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:35.376532Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:35.376548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:35.376551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:35.376590Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897058224609571:12976]
2025-09-30T14:59:35.376593Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:35.376727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:35.376729Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:35.376732Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:35.376738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:35.377570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413342:2990], now have 1 active actors on pipe
2025-09-30T14:59:35.377582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413294:2454], now have 1 active actors on pipe
2025-09-30T14:59:35.377600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.377605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.377634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:35.377643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:35.377648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:35.377650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:35.377664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:35.377677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:35.377694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:35.378009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.378016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.378029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:35.378134Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3284 partition: 0 MaxSeqNo: 42 sessionId: src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0
2025-09-30T14:59:35.378558Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|722bfb74-21615148-43a6c121-5c550cce_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:35.381864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0] Write session: try to update token
2025-09-30T14:59:35.381888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:35.404478Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:35.404521Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:35.404523Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:35.404526Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:35.404536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897058224609571:12976]
2025-09-30T14:59:35.404541Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897058224609571:12976]
2025-09-30T14:59:35.404545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897058224609571:12976]
2025-09-30T14:59:35.404590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:35.404597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.404600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:35.404821Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:35.407573Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:35.407596Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:35.407603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:35.414140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3284 sessionId: src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:35.417433Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:35.439335Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897058314413433:4275]
2025-09-30T14:59:35.439883Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3283, pipe: [1:7555897058314413433:4275]
2025-09-30T14:59:35.540742Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:35.541232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.541245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.541292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413433:4275], now have 1 active actors on pipe
2025-09-30T14:59:35.541592Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:35.541970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:35.542033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:35.542036Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:35.542097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3284 reason: error at write: Disconnected sessionId: src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0
2025-09-30T14:59:35.542220Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897058314413433:4275]
2025-09-30T14:59:35.542295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3284 sessionId: src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0 is DEAD
2025-09-30T14:59:35.543443Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:35.543455Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0] Write session will restart in 0.007218s
2025-09-30T14:59:35.543481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0] Write session: Do CDS request
2025-09-30T14:59:35.543488Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:35.553880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:35.554013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:35.554030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3285
2025-09-30T14:59:35.554216Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3285 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:35.554266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3285 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:35.554279Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3285 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:35.554284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:35.554835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3285 sessionId:  describe result for acl check
2025-09-30T14:59:35.554871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:35.554873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:35.554875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:35.554882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897058314413524:2976] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:35.555534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897058314413524:2976] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:35.555886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:35.558800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:35.559091Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:35.559106Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:35.559121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:35.559198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:35.559286Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897058224609715:12979]
2025-09-30T14:59:35.559992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:35.560394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:35.560452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:35.560570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897058314413524:2976] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:35.560863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:35.560947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.560954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.560956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.560957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.560959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.560960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.560962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.560963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.560965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.560966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.560968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.560970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.560971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.560973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.560974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.560982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.560994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.560999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.561004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.561009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.561014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.561019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.561024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.561029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.561034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.561039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.561044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.561048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.561052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.561057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.561065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.561075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.561083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.561090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.561096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.561102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.561108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.561138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.561147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.561154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.561165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.561170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.561180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.561186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.561191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.561197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.561203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.561208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.561218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.561223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.561233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.561239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.561245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.561251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.561255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.561261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.561268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.561274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.561280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.561286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.561338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:35.567041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897058314413524:2976] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:35.567067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897058314413524:2976] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:35.567073Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897058314413524:2976] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:35.567084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3285 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:35.567436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:35.569597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3284
2025-09-30T14:59:35.569649Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3284
2025-09-30T14:59:35.568952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:35.568976Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:35.568981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:35.568985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:35.568996Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3284 [2:7555897058224609715:12979]
2025-09-30T14:59:35.569019Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:35.569039Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:35.569043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:35.569048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:35.569051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:35.569072Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:35.569080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:35.569088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:35.569169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.569172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.569174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.569178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:35.569181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:35.569265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:35.569267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.569283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.569297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.569317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:35.569336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897058224609710:12979]
2025-09-30T14:59:35.569339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897058224609710:12979]
2025-09-30T14:59:35.569342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897058224609710:12979]
2025-09-30T14:59:35.569360Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:35.569376Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:35.569394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:35.569398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:35.569443Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897058224609710:12979]
2025-09-30T14:59:35.569445Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:35.569479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413564:2976], now have 1 active actors on pipe
2025-09-30T14:59:35.569484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413436:2454], now have 1 active actors on pipe
2025-09-30T14:59:35.569474Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:35.569489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:35.569491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:35.569498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:35.569714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.569725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.569774Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a8a24cc9-182fb762-72f530d6-66f23665_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:35.569785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:35.569790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:35.569792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:35.569806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:35.569819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:35.569841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:35.570089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.570107Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.570131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:35.570229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3285 partition: 0 MaxSeqNo: 42 sessionId: src_id|a8a24cc9-182fb762-72f530d6-66f23665_0
2025-09-30T14:59:35.570715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a8ba154-94388ede-b3a139fe-18be67ee_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a8a24cc9-182fb762-72f530d6-66f23665_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:35.574408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a24cc9-182fb762-72f530d6-66f23665_0] Write session: try to update token
2025-09-30T14:59:35.574435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a24cc9-182fb762-72f530d6-66f23665_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:35.593504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:35.593530Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:35.593544Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897058224609710:12979]
2025-09-30T14:59:35.593604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:35.593611Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:35.593834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:35.594009Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:35.594174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:35.594353Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:35.594636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:35.594708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:35.598519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:35.598541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:35.598545Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:35.598547Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:35.598562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897058224609710:12979]
2025-09-30T14:59:35.598566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897058224609710:12979]
2025-09-30T14:59:35.598571Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897058224609710:12979]
2025-09-30T14:59:35.598617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:35.598627Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.598630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:35.598636Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:35.598645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:35.598650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:35.598855Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:35.610428Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3285 sessionId: src_id|a8a24cc9-182fb762-72f530d6-66f23665_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:35.613791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:35.642277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897058314413571:4275]
2025-09-30T14:59:35.642529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3284, pipe: [1:7555897058314413571:4275]
2025-09-30T14:59:35.723908Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:35.724324Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.724335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.724358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413571:4275], now have 1 active actors on pipe
2025-09-30T14:59:35.724632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:35.724819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897058314413571:4275]
2025-09-30T14:59:35.724859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:35.724967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3285 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a8a24cc9-182fb762-72f530d6-66f23665_0
2025-09-30T14:59:35.725175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:35.725208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3285 sessionId: src_id|a8a24cc9-182fb762-72f530d6-66f23665_0 is DEAD
2025-09-30T14:59:35.731388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a24cc9-182fb762-72f530d6-66f23665_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:35.731408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a24cc9-182fb762-72f530d6-66f23665_0] Write session will restart in 0.008084s
2025-09-30T14:59:35.731442Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a24cc9-182fb762-72f530d6-66f23665_0] Write session: Do CDS request
2025-09-30T14:59:35.731450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a24cc9-182fb762-72f530d6-66f23665_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:35.740923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a24cc9-182fb762-72f530d6-66f23665_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:35.741161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:35.741184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3286
2025-09-30T14:59:35.743515Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3286 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:35.743584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3286 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:35.743590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3286 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:35.743596Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:35.744163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3286 sessionId:  describe result for acl check
2025-09-30T14:59:35.744208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:35.744215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:35.744218Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:35.744225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897058314413582:2960] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:35.744861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897058314413582:2960] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:35.747957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897058314413582:2960] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:35.758671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897058314413582:2960] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:35.758693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897058314413582:2960] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:35.758698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897058314413582:2960] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:35.758708Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3286 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:35.772112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:35.777672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:35.777917Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:35.777926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:35.777935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:35.777984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:35.778023Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897058224609848:12982]
2025-09-30T14:59:35.778540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:35.778982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:35.779059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:35.779510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:35.779598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.779607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.779609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.779610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.779612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.779614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.779616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.779617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.779619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.779621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.779622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.779624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.779626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.779628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.779630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.779637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.779649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.779654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.779659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.779664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.779668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.779673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.779678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.779682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.779687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.779691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.779695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.779699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.779702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.779706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.779715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.779725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.779734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.779740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.779746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.779752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.779760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.779771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.779777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.779783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.779787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.779793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.779803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.779816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.779821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.779828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.779833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.779844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.779850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.779861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.779866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.779878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.779884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.779895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.779901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.779908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.779917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.779923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.779929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.779941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.779991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:35.794556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:35.796386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:35.796416Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:35.796419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:35.796424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:35.796432Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3285 [2:7555897058224609848:12982]
2025-09-30T14:59:35.796451Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:35.796474Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:35.796478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:35.796482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:35.796500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:35.796530Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:35.796538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:35.796546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:35.796634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.796642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.796645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.796649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:35.796652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:35.796741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:35.796749Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.796765Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.796780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.796803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:35.796967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3285
2025-09-30T14:59:35.797020Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3285
2025-09-30T14:59:35.796828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897058224609843:12982]
2025-09-30T14:59:35.796838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897058224609843:12982]
2025-09-30T14:59:35.796841Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897058224609843:12982]
2025-09-30T14:59:35.796855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:35.796873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413573:2454], now have 1 active actors on pipe
2025-09-30T14:59:35.796877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413632:2960], now have 1 active actors on pipe
2025-09-30T14:59:35.796886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:35.796885Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:35.796890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:35.796893Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:35.796902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:35.796905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:35.796948Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897058224609843:12982]
2025-09-30T14:59:35.796956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:35.797040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:35.797278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.797285Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.797315Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|34c9f665-74edd0b2-45087370-620d935_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:35.797338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:35.797343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:35.797346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:35.797360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:35.797375Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:35.797407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:35.797780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.797793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.797828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:35.797936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3286 partition: 0 MaxSeqNo: 42 sessionId: src_id|34c9f665-74edd0b2-45087370-620d935_0
2025-09-30T14:59:35.798369Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a8a24cc9-182fb762-72f530d6-66f23665_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|34c9f665-74edd0b2-45087370-620d935_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:35.801589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34c9f665-74edd0b2-45087370-620d935_0] Write session: try to update token
2025-09-30T14:59:35.801615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34c9f665-74edd0b2-45087370-620d935_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:35.823513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897058314413714:4275]
2025-09-30T14:59:35.824150Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3285, pipe: [1:7555897058314413714:4275]
2025-09-30T14:59:35.822537Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:35.822563Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:35.822565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:35.822567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:35.822576Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897058224609843:12982]
2025-09-30T14:59:35.822583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897058224609843:12982]
2025-09-30T14:59:35.822586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897058224609843:12982]
2025-09-30T14:59:35.822629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:35.822642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.822644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:35.822645Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:35.822650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:35.822655Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:35.822804Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:35.830502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3286 sessionId: src_id|34c9f665-74edd0b2-45087370-620d935_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:35.833913Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:35.944365Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897058314413714:4275]
2025-09-30T14:59:35.944419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:35.944423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:35.943580Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:35.943973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413714:4275], now have 1 active actors on pipe
2025-09-30T14:59:35.944006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.944014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.944511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3286 reason: error at write: Disconnected sessionId: src_id|34c9f665-74edd0b2-45087370-620d935_0
2025-09-30T14:59:35.944710Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3286 sessionId: src_id|34c9f665-74edd0b2-45087370-620d935_0 is DEAD
2025-09-30T14:59:35.944797Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:35.944913Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:35.947394Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34c9f665-74edd0b2-45087370-620d935_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:35.947412Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34c9f665-74edd0b2-45087370-620d935_0] Write session will restart in 0.008958s
2025-09-30T14:59:35.947440Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34c9f665-74edd0b2-45087370-620d935_0] Write session: Do CDS request
2025-09-30T14:59:35.947449Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34c9f665-74edd0b2-45087370-620d935_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:35.957949Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|34c9f665-74edd0b2-45087370-620d935_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:35.958034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:35.958055Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3287
2025-09-30T14:59:35.959530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3287 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:35.959588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3287 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:35.959598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3287 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:35.959603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:35.960132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3287 sessionId:  describe result for acl check
2025-09-30T14:59:35.960172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:35.960179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:35.960182Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:35.960188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897058314413745:2946] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:35.960785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897058314413745:2946] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:35.963430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897058314413745:2946] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:35.969924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897058314413745:2946] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:35.969950Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897058314413745:2946] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:35.969954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897058314413745:2946] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:35.969964Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3287 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:35.978416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:35.981316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:35.981618Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:35.981624Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:35.981639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:35.981709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:35.981771Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897058224609978:12984]
2025-09-30T14:59:35.982573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:35.983079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:35.983134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:35.986096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:35.986280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.986281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.986283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.986285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.986288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.986289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.986292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.986294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.986296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.986297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.986299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.986300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.986303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.986307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.986310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.986320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.986337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.986343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.986348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.986352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.986359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.986366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.986371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.986375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.986382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.986388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.986395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.986399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.986403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.986406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.986419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.986429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:35.986436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.986442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:35.986450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.986459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:35.986468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.986478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:35.986488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.986496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:35.986504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.986511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:35.986520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.986525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:35.986534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.986541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:35.986550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.986560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:35.986568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.986574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:35.986584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.986590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.986597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.986603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.986610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.986618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.986626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.986632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:35.986642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.986647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:35.986714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:35.993718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:35.996385Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3286
2025-09-30T14:59:35.996434Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3286
2025-09-30T14:59:35.997621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3287 partition: 0 MaxSeqNo: 42 sessionId: src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0
2025-09-30T14:59:35.995501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:35.995523Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:35.995529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:35.995534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:35.995542Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3286 [2:7555897058224609978:12984]
2025-09-30T14:59:35.995562Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:35.995584Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:35.995588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:35.995592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:35.995599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:35.995617Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:35.995625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:35.995634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:35.995741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.995744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.995746Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.995750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:35.995752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:35.995851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:35.995855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:35.995873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:35.995888Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:35.995907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:35.995926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897058224609973:12984]
2025-09-30T14:59:35.995928Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897058224609973:12984]
2025-09-30T14:59:35.995930Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897058224609973:12984]
2025-09-30T14:59:35.995940Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:35.995957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:35.995959Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:35.995973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:35.995976Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:35.995977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:35.995981Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:35.995990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413805:2946], now have 1 active actors on pipe
2025-09-30T14:59:35.995995Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897058314413729:2454], now have 1 active actors on pipe
2025-09-30T14:59:35.996034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897058224609973:12984]
2025-09-30T14:59:35.996048Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:35.996051Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:35.996719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.996728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.996776Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:35.996785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:35.996791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:35.996794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:35.996806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:35.996818Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:35.996838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:35.997425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:35.997429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:35.997447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:35.999428Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|34c9f665-74edd0b2-45087370-620d935_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:36.002740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0] Write session: try to update token
2025-09-30T14:59:36.002761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:36.010570Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:36.010598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:36.010609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897058224609973:12984]
2025-09-30T14:59:36.010658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:36.010856Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:36.011016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:36.011183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:36.011410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:36.011663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:36.011711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:36.011969Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:36.026519Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:36.026548Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:36.026551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:36.026553Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:36.026566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897058224609973:12984]
2025-09-30T14:59:36.026578Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897058224609973:12984]
2025-09-30T14:59:36.026584Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897058224609973:12984]
2025-09-30T14:59:36.026636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:36.026645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.026649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:36.026659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:36.026668Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:36.026673Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:36.026829Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:36.032733Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3287 sessionId: src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:36.036054Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:36.042708Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897062609381164:4275]
2025-09-30T14:59:36.043218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3286, pipe: [1:7555897062609381164:4275]
2025-09-30T14:59:36.148257Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:36.148879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.148903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.148929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381164:4275], now have 1 active actors on pipe
2025-09-30T14:59:36.149723Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:36.149738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0] Write session will restart in 0.006179s
2025-09-30T14:59:36.149771Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0] Write session: Do CDS request
2025-09-30T14:59:36.149779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:36.149223Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:36.149204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:36.149224Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:36.149232Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897062609381164:4275]
2025-09-30T14:59:36.149257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:36.149303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3287 reason: error at write: Disconnected sessionId: src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0
2025-09-30T14:59:36.149528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3287 sessionId: src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0 is DEAD
2025-09-30T14:59:36.156873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:36.157004Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:36.157024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3288
2025-09-30T14:59:36.157156Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3288 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:36.157203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3288 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:36.157215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3288 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:36.157220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:36.157774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3288 sessionId:  describe result for acl check
2025-09-30T14:59:36.157819Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:36.157821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:36.157826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:36.157832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897062609381181:2922] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:36.158504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897062609381181:2922] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:36.161626Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897062609381181:2922] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:36.164645Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897062609381181:2922] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:36.164672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897062609381181:2922] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:36.164675Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897062609381181:2922] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:36.164684Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3288 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:36.165860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:36.168600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:36.168898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:36.168909Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:36.168921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:36.168985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:36.169034Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897062519577406:12986]
2025-09-30T14:59:36.169754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:36.173048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:36.173138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:36.173561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:36.173650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.173652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.173653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.173655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.173656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.173658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.173660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.173661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.173662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.173664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.173665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.173666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.173668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.173669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.173671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.173677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.173689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.173693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.173698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.173703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.173708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.173712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.173716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.173721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.173726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.173730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.173734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.173738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.173742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.173746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.173755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.173763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.173770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.173776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.173782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.173788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.173793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.173799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.173806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.173812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.173829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.173834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.173840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.173846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.173852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.173857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.173866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.173872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.173878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.173886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.173892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.173898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.173904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.173909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.173915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.173921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.173926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.173932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.173937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.173943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.174000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:36.184353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:36.185702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:36.185725Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:36.185729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:36.185735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:36.185743Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3287 [2:7555897062519577406:12986]
2025-09-30T14:59:36.185770Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:36.185793Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:36.185798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:36.185801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:36.185804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:36.185822Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:36.185830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:36.185838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:36.185913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.185915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.185917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.185921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:36.185924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:36.186009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:36.186021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.186038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.186051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.186068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:36.186092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381166:2454], now have 1 active actors on pipe
2025-09-30T14:59:36.186096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381292:2922], now have 1 active actors on pipe
2025-09-30T14:59:36.186103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897062519577401:12986]
2025-09-30T14:59:36.186105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897062519577401:12986]
2025-09-30T14:59:36.186108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897062519577401:12986]
2025-09-30T14:59:36.186126Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:36.186142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:36.186156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:36.186160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:36.186187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:36.186190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:36.186194Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:36.186207Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897062519577401:12986]
2025-09-30T14:59:36.186210Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:36.186215Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:36.186446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.186460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.186489Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:36.186501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:36.186506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:36.186508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:36.186520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:36.186531Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:36.186547Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:36.186992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.187005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.187037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:36.186180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3287
2025-09-30T14:59:36.186241Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3287
2025-09-30T14:59:36.187222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3288 partition: 0 MaxSeqNo: 42 sessionId: src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0
2025-09-30T14:59:36.188195Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1ea1d68f-64eb3822-7d11bcfa-b5bd14ea_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:36.192015Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0] Write session: try to update token
2025-09-30T14:59:36.192039Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:36.209263Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:36.209288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:36.209291Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:36.209293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:36.209303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897062519577401:12986]
2025-09-30T14:59:36.209310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897062519577401:12986]
2025-09-30T14:59:36.209314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897062519577401:12986]
2025-09-30T14:59:36.209364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:36.209373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.209376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:36.209566Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:36.211498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:36.211522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:36.211527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:36.215557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3288 sessionId: src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:36.218729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:36.249560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897062609381306:4275]
2025-09-30T14:59:36.249881Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3287, pipe: [1:7555897062609381306:4275]
2025-09-30T14:59:36.330870Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:36.331950Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.331988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.332051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381306:4275], now have 1 active actors on pipe
2025-09-30T14:59:36.333211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:36.333355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897062609381306:4275]
2025-09-30T14:59:36.333360Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:36.333396Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:36.333496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3288 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0
2025-09-30T14:59:36.333704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3288 sessionId: src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0 is DEAD
2025-09-30T14:59:36.333902Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:36.333910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0] Write session will restart in 0.008094s
2025-09-30T14:59:36.333935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0] Write session: Do CDS request
2025-09-30T14:59:36.333942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:36.342863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:36.343000Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:36.343021Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3289
2025-09-30T14:59:36.343149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3289 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:36.343196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3289 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:36.343210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3289 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:36.343214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:36.343678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3289 sessionId:  describe result for acl check
2025-09-30T14:59:36.343708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:36.343710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:36.343716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:36.343722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897062609381330:2912] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:36.344215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897062609381330:2912] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:36.347520Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897062609381330:2912] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:36.355475Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897062609381330:2912] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:36.355496Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897062609381330:2912] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:36.355502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897062609381330:2912] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:36.355511Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3289 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:36.356757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:36.361245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:36.361537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:36.361549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:36.361562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:36.361628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:36.361675Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897062519577554:12995]
2025-09-30T14:59:36.362388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:36.363466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:36.363543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:36.363941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:36.364023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.364024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.364026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.364027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.364029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.364030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.364031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.364033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.364035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.364036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.364038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.364039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.364041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.364042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.364044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.364050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.364061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.364065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.364070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.364074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.364078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.364083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.364087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.364091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.364096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.364100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.364104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.364108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.364113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.364117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.364126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.364134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.364143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.364149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.364154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.364160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.364166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.364171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.364176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.364182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.364186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.364191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.364196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.364201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.364208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.364213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.364218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.364223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.364227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.364233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.364238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.364244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.364248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.364254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.364260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.364265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.364271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.364276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.364282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.364288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.364332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:36.373512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:36.374885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:36.374911Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:36.374914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:36.374919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:36.374926Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3288 [2:7555897062519577554:12995]
2025-09-30T14:59:36.374943Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:36.374962Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:36.374965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:36.374968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:36.374971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:36.374989Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:36.374997Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:36.375004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:36.375079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.375081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.375083Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.375085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:36.375087Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:36.375169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:36.375174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.375189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.375199Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.375215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:36.375235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897062519577548:12995]
2025-09-30T14:59:36.375237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897062519577548:12995]
2025-09-30T14:59:36.375239Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897062519577548:12995]
2025-09-30T14:59:36.375305Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:36.375323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:36.375338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:36.375341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:36.375389Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897062519577548:12995]
2025-09-30T14:59:36.375393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:36.375743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:36.375753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:36.375755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:36.375762Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:36.376137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381451:2912], now have 1 active actors on pipe
2025-09-30T14:59:36.376146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381309:2454], now have 1 active actors on pipe
2025-09-30T14:59:36.376145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3288
2025-09-30T14:59:36.376180Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3288
2025-09-30T14:59:36.376352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.376364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.376394Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|63e3f9-2904785a-43a1a768-ed451d33_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:36.376405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:36.376410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:36.376413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:36.376426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:36.376439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:36.376459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:36.377177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.377191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.377215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:36.377431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3289 partition: 0 MaxSeqNo: 42 sessionId: src_id|63e3f9-2904785a-43a1a768-ed451d33_0
2025-09-30T14:59:36.377836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e45884a3-7fe4e70c-7ff84ac7-40a69199_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|63e3f9-2904785a-43a1a768-ed451d33_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:36.381395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e3f9-2904785a-43a1a768-ed451d33_0] Write session: try to update token
2025-09-30T14:59:36.381422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e3f9-2904785a-43a1a768-ed451d33_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:36.395184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:36.395212Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:36.395214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:36.395216Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:36.395227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897062519577548:12995]
2025-09-30T14:59:36.395230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897062519577548:12995]
2025-09-30T14:59:36.395235Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897062519577548:12995]
2025-09-30T14:59:36.395319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:36.395338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.395341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:36.395388Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:36.395405Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:36.395412Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:36.395537Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:36.401032Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3289 sessionId: src_id|63e3f9-2904785a-43a1a768-ed451d33_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:36.404272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:36.433380Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897062609381479:4275]
2025-09-30T14:59:36.433740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3288, pipe: [1:7555897062609381479:4275]
2025-09-30T14:59:36.517610Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:36.518213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.518234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.518278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381479:4275], now have 1 active actors on pipe
2025-09-30T14:59:36.518558Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:36.518574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:36.518576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897062609381479:4275]
2025-09-30T14:59:36.518602Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:36.518690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3289 reason: error at write: Disconnected sessionId: src_id|63e3f9-2904785a-43a1a768-ed451d33_0
2025-09-30T14:59:36.518894Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3289 sessionId: src_id|63e3f9-2904785a-43a1a768-ed451d33_0 is DEAD
2025-09-30T14:59:36.519339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e3f9-2904785a-43a1a768-ed451d33_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:36.519352Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e3f9-2904785a-43a1a768-ed451d33_0] Write session will restart in 0.007972s
2025-09-30T14:59:36.519378Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e3f9-2904785a-43a1a768-ed451d33_0] Write session: Do CDS request
2025-09-30T14:59:36.519383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e3f9-2904785a-43a1a768-ed451d33_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:36.519586Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:36.529245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|63e3f9-2904785a-43a1a768-ed451d33_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:36.529161Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:36.529179Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3290
2025-09-30T14:59:36.530388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3290 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:36.530440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3290 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:36.530447Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3290 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:36.530452Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:36.530981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3290 sessionId:  describe result for acl check
2025-09-30T14:59:36.531009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:36.531012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:36.531014Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:36.531020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897062609381543:2892] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:36.531628Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897062609381543:2892] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:36.538323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897062609381543:2892] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:36.541137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:36.545372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897062609381543:2892] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:36.545393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897062609381543:2892] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:36.545397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897062609381543:2892] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:36.545418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3290 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:36.547074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:36.547340Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:36.547353Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:36.547366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:36.547432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:36.547479Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897062519577713:13003]
2025-09-30T14:59:36.548224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:36.548667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:36.548739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:36.549142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:36.549203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.549205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.549206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.549208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.549210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.549213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.549214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.549216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.549217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.549218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.549220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.549224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.549225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.549226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.549227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.549234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.549245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.549250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.549255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.549259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.549264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.549268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.549273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.549278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.549283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.549287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.549292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.549296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.549301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.549305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.549314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.549322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.549329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.549335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.549341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.549347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.549353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.549360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.549381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.549388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.549394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.549400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.549408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.549414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.549419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.549425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.549431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.549437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.549442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.549448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.549454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.549460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.549467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.549473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.549478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.549485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.549490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.549496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.549501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.549507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.549556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:36.555420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:36.556508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:36.556516Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:36.556519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:36.556523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:36.556531Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3289 [2:7555897062519577713:13003]
2025-09-30T14:59:36.556549Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:36.556568Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:36.556573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:36.556578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:36.556580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:36.556598Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:36.556605Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:36.556612Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:36.556849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.556865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.556870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.556874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:36.556876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:36.556956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:36.556958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.556972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.556985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.557004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:36.557025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381611:2892], now have 1 active actors on pipe
2025-09-30T14:59:36.557032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381482:2454], now have 1 active actors on pipe
2025-09-30T14:59:36.557039Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897062519577703:13003]
2025-09-30T14:59:36.557041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897062519577703:13003]
2025-09-30T14:59:36.557043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897062519577703:13003]
2025-09-30T14:59:36.557060Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:36.557079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:36.557087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:36.557093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:36.557096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:36.557099Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:36.557103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:36.557142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897062519577703:13003]
2025-09-30T14:59:36.557157Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:36.557203Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:36.557156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3289
2025-09-30T14:59:36.557172Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3289
2025-09-30T14:59:36.557301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.557318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.557909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3290 partition: 0 MaxSeqNo: 42 sessionId: src_id|83dbe390-dd920ea-3d006985-e5880b59_0
2025-09-30T14:59:36.557347Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|83dbe390-dd920ea-3d006985-e5880b59_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:36.557359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:36.557363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:36.557365Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:36.557378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:36.557394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:36.557411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:36.557725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.557730Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.557759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:36.559345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|63e3f9-2904785a-43a1a768-ed451d33_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|83dbe390-dd920ea-3d006985-e5880b59_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:36.562384Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83dbe390-dd920ea-3d006985-e5880b59_0] Write session: try to update token
2025-09-30T14:59:36.562410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83dbe390-dd920ea-3d006985-e5880b59_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:36.571320Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:36.571347Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:36.571350Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:36.571353Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:36.571364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897062519577703:13003]
2025-09-30T14:59:36.571368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897062519577703:13003]
2025-09-30T14:59:36.571373Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897062519577703:13003]
2025-09-30T14:59:36.571425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:36.571432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.571436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:36.571437Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:36.571445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:36.571451Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:36.571668Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:36.603709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3290 sessionId: src_id|83dbe390-dd920ea-3d006985-e5880b59_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:36.606751Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:36.618738Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897062609381623:4275]
2025-09-30T14:59:36.619128Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3289, pipe: [1:7555897062609381623:4275]
2025-09-30T14:59:36.691053Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:36.691462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.691484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.691505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381623:4275], now have 1 active actors on pipe
2025-09-30T14:59:36.692076Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:36.695512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:36.695639Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3290 reason: status is not ok: tablet will be restarted right now sessionId: src_id|83dbe390-dd920ea-3d006985-e5880b59_0
2025-09-30T14:59:36.695829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3290 sessionId: src_id|83dbe390-dd920ea-3d006985-e5880b59_0 is DEAD
2025-09-30T14:59:36.695991Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897062609381623:4275]
2025-09-30T14:59:36.696003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:36.696299Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dbe390-dd920ea-3d006985-e5880b59_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:36.696314Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dbe390-dd920ea-3d006985-e5880b59_0] Write session will restart in 0.007633s
2025-09-30T14:59:36.696357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dbe390-dd920ea-3d006985-e5880b59_0] Write session: Do CDS request
2025-09-30T14:59:36.696365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dbe390-dd920ea-3d006985-e5880b59_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:36.707739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|83dbe390-dd920ea-3d006985-e5880b59_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:36.711415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:36.711433Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3291
2025-09-30T14:59:36.711630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3291 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:36.711666Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3291 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:36.711672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3291 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:36.711686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:36.712185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3291 sessionId:  describe result for acl check
2025-09-30T14:59:36.712225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:36.712228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:36.712230Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:36.712237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897062609381680:2881] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:36.712827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897062609381680:2881] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:36.715774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897062609381680:2881] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:36.716806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:36.719596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:36.719910Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:36.719926Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:36.719940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:36.720011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:36.720062Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897062519577857:13007]
2025-09-30T14:59:36.720083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897062609381680:2881] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:36.720103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897062609381680:2881] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:36.720107Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897062609381680:2881] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:36.720117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3291 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:36.721021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:36.721465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:36.721532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:36.721957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:36.722050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.722051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.722053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.722055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.722056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.722058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.722060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.722062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.722063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.722065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.722066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.722068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.722069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.722071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.722073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.722081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.722094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.722099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.722104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.722109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.722113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.722117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.722121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.722126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.722130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.722134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.722138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.722143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.722148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.722152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.722161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.722185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.722193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.722201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.722207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.722214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.722219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.722226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.722254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.722261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.722269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.722275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.722281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.722288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.722293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.722299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.722307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.722313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.722318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.722323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.722329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.722335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.722340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.722347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.722353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.722359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.722364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.722370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.722377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.722383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.722459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:36.728856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:36.730242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:36.730268Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:36.730271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:36.730276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:36.730283Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3290 [2:7555897062519577857:13007]
2025-09-30T14:59:36.730301Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:36.730320Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:36.731232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3290
2025-09-30T14:59:36.731284Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3290
2025-09-30T14:59:36.730323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:36.730326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:36.730329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:36.730346Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:36.730355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:36.730361Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:36.730439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.730442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.730444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.730448Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:36.730450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:36.730535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:36.730538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.730555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.730569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.730587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:36.730605Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897062519577852:13007]
2025-09-30T14:59:36.730607Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897062519577852:13007]
2025-09-30T14:59:36.730609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897062519577852:13007]
2025-09-30T14:59:36.730620Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:36.730635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381757:2881], now have 1 active actors on pipe
2025-09-30T14:59:36.730638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381625:2454], now have 1 active actors on pipe
2025-09-30T14:59:36.730637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:36.730642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:36.730644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:36.730648Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:36.730663Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:36.730666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:36.730726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897062519577852:13007]
2025-09-30T14:59:36.730734Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:36.730773Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:36.731728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.731743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.731778Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b05896db-333baafe-33ee9839-f5ee89a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:36.731787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:36.731792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:36.731795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:36.731810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:36.731823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:36.731846Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:36.732974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.732990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.733017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:36.733714Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3291 partition: 0 MaxSeqNo: 42 sessionId: src_id|b05896db-333baafe-33ee9839-f5ee89a0_0
2025-09-30T14:59:36.734163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|83dbe390-dd920ea-3d006985-e5880b59_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b05896db-333baafe-33ee9839-f5ee89a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:36.737425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b05896db-333baafe-33ee9839-f5ee89a0_0] Write session: try to update token
2025-09-30T14:59:36.737452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b05896db-333baafe-33ee9839-f5ee89a0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:36.752729Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:36.752755Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:36.752758Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:36.752760Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:36.752770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897062519577852:13007]
2025-09-30T14:59:36.752775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897062519577852:13007]
2025-09-30T14:59:36.752780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897062519577852:13007]
2025-09-30T14:59:36.752824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:36.752830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.752834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:36.752972Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:36.755439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:36.755457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:36.755460Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:36.775646Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3291 sessionId: src_id|b05896db-333baafe-33ee9839-f5ee89a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:36.778479Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:36.795852Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897062609381769:4275]
2025-09-30T14:59:36.796207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3290, pipe: [1:7555897062609381769:4275]
2025-09-30T14:59:36.877283Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:36.877733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.877754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.877777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381769:4275], now have 1 active actors on pipe
2025-09-30T14:59:36.879555Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:36.880060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05896db-333baafe-33ee9839-f5ee89a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:36.880072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05896db-333baafe-33ee9839-f5ee89a0_0] Write session will restart in 0.005204s
2025-09-30T14:59:36.880112Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05896db-333baafe-33ee9839-f5ee89a0_0] Write session: Do CDS request
2025-09-30T14:59:36.880118Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05896db-333baafe-33ee9839-f5ee89a0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:36.879571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:36.879589Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:36.879678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3291 reason: error at write: Disconnected sessionId: src_id|b05896db-333baafe-33ee9839-f5ee89a0_0
2025-09-30T14:59:36.879889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3291 sessionId: src_id|b05896db-333baafe-33ee9839-f5ee89a0_0 is DEAD
2025-09-30T14:59:36.880095Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897062609381769:4275]
2025-09-30T14:59:36.880120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:36.886839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b05896db-333baafe-33ee9839-f5ee89a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:36.891498Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:36.891515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3292
2025-09-30T14:59:36.891758Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3292 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:36.891790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3292 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:36.891796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3292 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:36.891802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:36.892373Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3292 sessionId:  describe result for acl check
2025-09-30T14:59:36.892411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:36.892413Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:36.892416Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:36.892422Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897062609381801:2857] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:36.893029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897062609381801:2857] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:36.906000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897062609381801:2857] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:36.913423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897062609381801:2857] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:36.913445Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897062609381801:2857] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:36.913449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897062609381801:2857] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:36.913920Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:36.913460Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3292 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:36.917061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:36.917316Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:36.917328Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:36.917340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:36.917396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:36.917450Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897062519577993:13009]
2025-09-30T14:59:36.918137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:36.918639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:36.918713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:36.919108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:36.919190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.919198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.919199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.919200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.919202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.919203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.919205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.919207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.919209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.919210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.919211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.919213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.919215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.919216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.919217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.919224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.919235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.919240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.919264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.919269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.919274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.919278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.919283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.919288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.919293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.919298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.919302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.919307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.919312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.919316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.919325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.919334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:36.919341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.919348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:36.919354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.919366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:36.919371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.919376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:36.919382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.919388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:36.919392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.919399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:36.919405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.919411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:36.919416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.919421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:36.919427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.919434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:36.919440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.919447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:36.919453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.919459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.919463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.919471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.919477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.919483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.919488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.919492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:36.919498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.919503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:36.919551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:36.925893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:36.927006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:36.927027Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:36.927032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:36.927036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:36.927044Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3291 [2:7555897062519577993:13009]
2025-09-30T14:59:36.927063Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:36.927080Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:36.927088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:36.927092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:36.927095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:36.927115Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:36.927123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:36.927132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:36.927209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.927219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.927222Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.927225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:36.927228Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:36.927333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:36.927342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.927359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:36.927379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:36.927404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:36.927424Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897062519577986:13009]
2025-09-30T14:59:36.927433Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897062519577986:13009]
2025-09-30T14:59:36.927436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897062519577986:13009]
2025-09-30T14:59:36.927447Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:36.927456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:36.927460Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:36.927462Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:36.927465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:36.927481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:36.927486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:36.927498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381916:2857], now have 1 active actors on pipe
2025-09-30T14:59:36.927502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381785:2454], now have 1 active actors on pipe
2025-09-30T14:59:36.927545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897062519577986:13009]
2025-09-30T14:59:36.927559Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:36.927568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:36.927608Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3291
2025-09-30T14:59:36.927665Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3291
2025-09-30T14:59:36.927856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.927869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.927897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:36.927911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:36.927915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:36.927920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:36.927932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:36.927950Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:36.927971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:36.928407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:36.928421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:36.928445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:36.928636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3292 partition: 0 MaxSeqNo: 42 sessionId: src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0
2025-09-30T14:59:36.931435Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b05896db-333baafe-33ee9839-f5ee89a0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:36.934663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0] Write session: try to update token
2025-09-30T14:59:36.934689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:36.942736Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:36.942761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:36.942764Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:36.942766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:36.942778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897062519577986:13009]
2025-09-30T14:59:36.942784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897062519577986:13009]
2025-09-30T14:59:36.942790Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897062519577986:13009]
2025-09-30T14:59:36.942827Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:36.942833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:36.942835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:36.942927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:36.942942Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:36.942946Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:36.942988Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:36.968878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3292 sessionId: src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:36.971856Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:36.980194Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897062609381929:4275]
2025-09-30T14:59:36.980503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3291, pipe: [1:7555897062609381929:4275]
2025-09-30T14:59:37.064708Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:37.065336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.065371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.065389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897062609381929:4275], now have 1 active actors on pipe
2025-09-30T14:59:37.065720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:37.066719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:37.066732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0] Write session will restart in 0.008662s
2025-09-30T14:59:37.066062Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:37.066130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897062609381929:4275]
2025-09-30T14:59:37.066167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:37.066261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3292 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0
2025-09-30T14:59:37.066467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3292 sessionId: src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0 is DEAD
2025-09-30T14:59:37.066765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0] Write session: Do CDS request
2025-09-30T14:59:37.066772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:37.076838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:37.076977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:37.076996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3293
2025-09-30T14:59:37.077123Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3293 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:37.077172Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3293 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:37.077183Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3293 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:37.077188Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:37.077737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3293 sessionId:  describe result for acl check
2025-09-30T14:59:37.077779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:37.077787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:37.077789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:37.077795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897066904349259:2837] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:37.078434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897066904349259:2837] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:37.083455Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897066904349259:2837] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:37.085930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:37.088225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897066904349259:2837] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:37.088246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897066904349259:2837] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:37.088250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897066904349259:2837] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:37.088258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3293 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:37.088437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:37.088715Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:37.088727Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:37.088739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:37.088798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:37.088840Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897066814545425:13011]
2025-09-30T14:59:37.089525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:37.089873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:37.089921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:37.090244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:37.090317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.090324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.090326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.090327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.090329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.090330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.090332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.090333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.090334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.090336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.090337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.090338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.090339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.090340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.090341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.090348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.090360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.090364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.090369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.090373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.090377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.090382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.090385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.090389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.090394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.090398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.090402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.090406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.090410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.090415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.090423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.090430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.090437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.090443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.090453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.090459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.090468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.090473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.090479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.090489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.090494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.090504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.090509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.090519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.090524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.090534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.090540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.090550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.090554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.090566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.090575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.090581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.090590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.090597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.090606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.090611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.090620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.090625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.090632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.090638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.090684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:37.096712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:37.098837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:37.098861Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:37.098865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:37.098869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:37.098878Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3292 [2:7555897066814545425:13011]
2025-09-30T14:59:37.098896Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:37.098916Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:37.098919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:37.098923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:37.098926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:37.098945Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:37.098961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:37.098974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:37.099044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.099053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.099056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.099059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:37.099062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:37.099139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:37.099147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.099165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.099180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.099201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:37.099220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349360:2837], now have 1 active actors on pipe
2025-09-30T14:59:37.099230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349228:2454], now have 1 active actors on pipe
2025-09-30T14:59:37.099237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897066814545419:13011]
2025-09-30T14:59:37.099271Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897066814545419:13011]
2025-09-30T14:59:37.099273Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897066814545419:13011]
2025-09-30T14:59:37.099288Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:37.099303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:37.099314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:37.099324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:37.099328Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:37.099330Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:37.099333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:37.099375Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897066814545419:13011]
2025-09-30T14:59:37.099387Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:37.099404Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:37.099425Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3292
2025-09-30T14:59:37.099428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3292
2025-09-30T14:59:37.099543Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.099559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.099592Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:37.099643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:37.099651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:37.099653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:37.099668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:37.099687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:37.099712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:37.100025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.100056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.100081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:37.100228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3293 partition: 0 MaxSeqNo: 42 sessionId: src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0
2025-09-30T14:59:37.100780Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ce229ac9-4478ff7-3992cf63-ed07bec1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:37.104209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0] Write session: try to update token
2025-09-30T14:59:37.104229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:37.114424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:37.114454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:37.114457Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:37.114459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:37.114469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897066814545419:13011]
2025-09-30T14:59:37.114474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897066814545419:13011]
2025-09-30T14:59:37.114479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897066814545419:13011]
2025-09-30T14:59:37.114524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:37.114540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.114543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:37.114555Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:37.114563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:37.114567Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:37.114737Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:37.130295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3293 sessionId: src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:37.133249Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:37.165523Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897066904349372:4275]
2025-09-30T14:59:37.165841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3292, pipe: [1:7555897066904349372:4275]
2025-09-30T14:59:37.238877Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:37.239364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.239386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.239411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349372:4275], now have 1 active actors on pipe
2025-09-30T14:59:37.239627Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:37.239644Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:37.239713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3293 reason: error at write: Disconnected sessionId: src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0
2025-09-30T14:59:37.239920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3293 sessionId: src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0 is DEAD
2025-09-30T14:59:37.239991Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:37.240038Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897066904349372:4275]
2025-09-30T14:59:37.240148Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:37.240160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0] Write session will restart in 0.009617s
2025-09-30T14:59:37.240203Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0] Write session: Do CDS request
2025-09-30T14:59:37.240209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:37.240803Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:37.250772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:37.250841Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:37.250856Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3294
2025-09-30T14:59:37.251213Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3294 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:37.251293Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3294 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:37.251319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3294 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:37.251326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:37.251939Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3294 sessionId:  describe result for acl check
2025-09-30T14:59:37.251987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:37.251989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:37.251992Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:37.251999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897066904349388:2848] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:37.252755Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897066904349388:2848] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:37.255148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897066904349388:2848] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:37.259038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897066904349388:2848] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:37.259055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897066904349388:2848] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:37.259059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897066904349388:2848] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:37.259067Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3294 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:37.263594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:37.266476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:37.266747Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:37.266759Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:37.266774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:37.266835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:37.266879Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897066814545565:13014]
2025-09-30T14:59:37.267594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:37.268348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:37.268423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:37.268847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:37.268923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.268925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.268926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.268928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.268929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.268930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.268932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.268934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.268935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.268937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.268938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.268940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.268941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.268942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.268943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.268950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.268962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.268967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.268971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.268975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.268980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.268984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.268988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.268992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.268997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.269001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.269005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.269009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.269013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.269016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.269025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.269034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.269040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.269048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.269053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.269059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.269064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.269069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.269075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.269080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.269085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.269091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.269098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.269104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.269110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.269116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.269122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.269128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.269133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.269138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.269143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.269148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.269152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.269156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.269161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.269166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.269172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.269178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.269183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.269192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.269234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:37.277063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:37.278400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:37.278410Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:37.278414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:37.278418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:37.278427Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3293 [2:7555897066814545565:13014]
2025-09-30T14:59:37.278447Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:37.278467Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:37.278472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:37.278475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:37.278478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:37.278497Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:37.278504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:37.278512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:37.278589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.278592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.278594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.278598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:37.278601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:37.278688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:37.278691Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.278707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.278721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.278740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:37.278758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897066814545560:13014]
2025-09-30T14:59:37.278761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897066814545560:13014]
2025-09-30T14:59:37.278763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897066814545560:13014]
2025-09-30T14:59:37.278780Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:37.278795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:37.278810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:37.278813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:37.278855Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897066814545560:13014]
2025-09-30T14:59:37.278859Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:37.279295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:37.279302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349467:2848], now have 1 active actors on pipe
2025-09-30T14:59:37.279308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349374:2454], now have 1 active actors on pipe
2025-09-30T14:59:37.279312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:37.279314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:37.279320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:37.279413Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3293
2025-09-30T14:59:37.279419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3293
2025-09-30T14:59:37.279552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.279565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.279596Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:37.279605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:37.279609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:37.279612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:37.279624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:37.279638Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:37.279657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:37.279838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.279848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.279864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:37.279957Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3294 partition: 0 MaxSeqNo: 42 sessionId: src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0
2025-09-30T14:59:37.280385Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f961a124-4bc9e1e2-5ada4a02-33da88d3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:37.283572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0] Write session: try to update token
2025-09-30T14:59:37.283600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:37.294115Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:37.294140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:37.294143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:37.294147Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:37.294158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897066814545560:13014]
2025-09-30T14:59:37.294165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897066814545560:13014]
2025-09-30T14:59:37.294172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897066814545560:13014]
2025-09-30T14:59:37.294221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:37.294231Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.294235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:37.294485Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:37.295730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:37.295750Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:37.295755Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:37.318061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3294 sessionId: src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:37.321204Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:37.339643Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897066904349523:4275]
2025-09-30T14:59:37.340218Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3293, pipe: [1:7555897066904349523:4275]
2025-09-30T14:59:37.414396Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:37.414788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.414797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.414819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349523:4275], now have 1 active actors on pipe
2025-09-30T14:59:37.415450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897066904349523:4275]
2025-09-30T14:59:37.415500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:37.415504Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:37.415608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3294 reason: error at write: Disconnected sessionId: src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0
2025-09-30T14:59:37.416127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:37.416137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0] Write session will restart in 0.007634s
2025-09-30T14:59:37.416172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0] Write session: Do CDS request
2025-09-30T14:59:37.416180Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:37.415750Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:37.416462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3294 sessionId: src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0 is DEAD
2025-09-30T14:59:37.416776Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:37.428542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:37.429079Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:37.429099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3295
2025-09-30T14:59:37.429334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3295 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:37.429371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3295 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:37.429376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3295 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:37.429381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:37.430022Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3295 sessionId:  describe result for acl check
2025-09-30T14:59:37.430052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:37.430054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:37.430056Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:37.430061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897066904349557:2812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:37.430620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897066904349557:2812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:37.433214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897066904349557:2812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:37.441488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897066904349557:2812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:37.441514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897066904349557:2812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:37.441518Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897066904349557:2812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:37.441527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3295 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:37.458365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:37.462620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:37.462907Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:37.462912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:37.462927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:37.463001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:37.463189Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897066814545731:13022]
2025-09-30T14:59:37.463915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:37.466463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:37.466526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:37.466935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:37.466993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.466995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.466997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.466998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.467000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.467001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.467002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.467004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.467006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.467007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.467009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.467010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.467012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.467013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.467015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.467022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.467034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.467039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.467043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.467048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.467053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.467058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.467063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.467068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.467073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.467078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.467082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.467086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.467090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.467093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.467102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.467112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.467119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.467126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.467132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.467138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.467143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.467149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.467155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.467161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.467166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.467172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.467177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.467183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.467204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.467210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.467216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.467222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.467227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.467233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.467239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.467262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.467267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.467275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.467282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.467288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.467293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.467297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.467302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.467307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.467375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:37.477087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:37.478246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:37.478255Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:37.478258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:37.478263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:37.478271Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3294 [2:7555897066814545731:13022]
2025-09-30T14:59:37.478291Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:37.478309Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:37.478313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:37.478317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:37.478323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:37.478342Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:37.478350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:37.478357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:37.478423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.478426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.478428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.478432Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:37.478434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:37.478513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:37.478516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.478533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.478546Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.478564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:37.478582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897066814545725:13022]
2025-09-30T14:59:37.478585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897066814545725:13022]
2025-09-30T14:59:37.478588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897066814545725:13022]
2025-09-30T14:59:37.478597Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:37.478608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:37.478612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:37.478613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349542:2454], now have 1 active actors on pipe
2025-09-30T14:59:37.478614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:37.478619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349629:2812], now have 1 active actors on pipe
2025-09-30T14:59:37.478625Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:37.478642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:37.478645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:37.478683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897066814545725:13022]
2025-09-30T14:59:37.478692Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:37.478900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:37.479547Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3294
2025-09-30T14:59:37.479603Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3294
2025-09-30T14:59:37.480389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3295 partition: 0 MaxSeqNo: 42 sessionId: src_id|4ff07212-f871466c-70531c7b-80eea14c_0
2025-09-30T14:59:37.480860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5dfcdd12-c716cf08-acb8984a-701a144f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4ff07212-f871466c-70531c7b-80eea14c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:37.479690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.479708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.479737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ff07212-f871466c-70531c7b-80eea14c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:37.479747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:37.479753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:37.479756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:37.479769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:37.479782Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:37.479802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:37.480223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.480230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.480265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:37.484213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff07212-f871466c-70531c7b-80eea14c_0] Write session: try to update token
2025-09-30T14:59:37.484235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff07212-f871466c-70531c7b-80eea14c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:37.497510Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:37.497536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:37.497538Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:37.497540Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:37.497550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897066814545725:13022]
2025-09-30T14:59:37.497554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897066814545725:13022]
2025-09-30T14:59:37.497558Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897066814545725:13022]
2025-09-30T14:59:37.497601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:37.497609Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.497612Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:37.497631Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:37.497644Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:37.497649Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:37.497754Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:37.508675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3295 sessionId: src_id|4ff07212-f871466c-70531c7b-80eea14c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:37.511617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:37.518855Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897066904349702:4275]
2025-09-30T14:59:37.519107Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3294, pipe: [1:7555897066904349702:4275]
2025-09-30T14:59:37.618485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:37.618818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.618835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.618879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349702:4275], now have 1 active actors on pipe
2025-09-30T14:59:37.619122Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:37.619227Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:37.619240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897066904349702:4275]
2025-09-30T14:59:37.619293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:37.619299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:37.619380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3295 reason: error at write: Disconnected sessionId: src_id|4ff07212-f871466c-70531c7b-80eea14c_0
2025-09-30T14:59:37.619584Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3295 sessionId: src_id|4ff07212-f871466c-70531c7b-80eea14c_0 is DEAD
2025-09-30T14:59:37.619749Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff07212-f871466c-70531c7b-80eea14c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:37.619758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff07212-f871466c-70531c7b-80eea14c_0] Write session will restart in 0.008943s
2025-09-30T14:59:37.619783Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff07212-f871466c-70531c7b-80eea14c_0] Write session: Do CDS request
2025-09-30T14:59:37.619793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff07212-f871466c-70531c7b-80eea14c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:37.629980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff07212-f871466c-70531c7b-80eea14c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:37.630100Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:37.630119Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3296
2025-09-30T14:59:37.630313Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3296 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:37.630362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3296 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:37.630367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3296 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:37.630374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:37.630931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3296 sessionId:  describe result for acl check
2025-09-30T14:59:37.630980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:37.630985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:37.630988Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:37.630994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897066904349716:2801] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:37.631609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897066904349716:2801] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:37.634557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897066904349716:2801] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:37.639614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897066904349716:2801] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:37.639631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897066904349716:2801] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:37.639635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897066904349716:2801] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:37.639644Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3296 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:37.642689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:37.645621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:37.645916Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:37.645921Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:37.645933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:37.646004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:37.646043Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897066814545888:13031]
2025-09-30T14:59:37.646689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:37.647733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:37.647802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:37.648177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:37.648252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.648253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.648254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.648256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.648257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.648259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.648260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.648262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.648263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.648265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.648267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.648269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.648270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.648271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.648273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.648279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.648289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.648293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.648298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.648303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.648308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.648312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.648316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.648319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.648323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.648327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.648332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.648335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.648339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.648343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.648352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.648360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.648367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.648374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.648380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.648386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.648391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.648396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.648401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.648406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.648411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.648417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.648422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.648426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.648431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.648436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.648442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.648446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.648452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.648456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.648462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.648467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.648472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.648497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.648505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.648510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.648515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.648522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.648526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.648532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.648581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:37.662346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3295
2025-09-30T14:59:37.662389Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3295
2025-09-30T14:59:37.660627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:37.661845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:37.661853Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:37.661857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:37.661861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:37.661868Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3295 [2:7555897066814545888:13031]
2025-09-30T14:59:37.661886Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:37.661908Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:37.661912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:37.661916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:37.661918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:37.661938Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:37.661945Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:37.661953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:37.662024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.662027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.662029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.662032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:37.662035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:37.662225Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:37.662229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.662246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.662260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.662280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:37.662301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349704:2454], now have 1 active actors on pipe
2025-09-30T14:59:37.662306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349837:2801], now have 1 active actors on pipe
2025-09-30T14:59:37.662312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897066814545883:13031]
2025-09-30T14:59:37.662315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897066814545883:13031]
2025-09-30T14:59:37.662317Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897066814545883:13031]
2025-09-30T14:59:37.662339Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:37.662357Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:37.662373Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:37.662380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:37.662422Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897066814545883:13031]
2025-09-30T14:59:37.662425Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:37.662486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:37.662490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:37.662496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:37.662504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:37.662603Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.662621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.662654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:37.662676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:37.662681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:37.662693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:37.662706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:37.662718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:37.662738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:37.663355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.663373Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.663399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:37.663510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3296 partition: 0 MaxSeqNo: 42 sessionId: src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0
2025-09-30T14:59:37.663922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ff07212-f871466c-70531c7b-80eea14c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:37.666912Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0] Write session: try to update token
2025-09-30T14:59:37.666934Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:37.685894Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:37.685923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:37.685927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:37.685930Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:37.685940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897066814545883:13031]
2025-09-30T14:59:37.685945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897066814545883:13031]
2025-09-30T14:59:37.685949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897066814545883:13031]
2025-09-30T14:59:37.686001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:37.686009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.686012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:37.686172Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:37.683477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3296 sessionId: src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:37.686749Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:37.691351Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:37.691386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:37.691391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:37.719535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897066904349852:4275]
2025-09-30T14:59:37.723570Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3295, pipe: [1:7555897066904349852:4275]
2025-09-30T14:59:37.818950Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:37.819489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.819504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.819545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349852:4275], now have 1 active actors on pipe
2025-09-30T14:59:37.819937Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:37.819957Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:37.819962Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:37.820000Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897066904349852:4275]
2025-09-30T14:59:37.820040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3296 reason: error at write: Disconnected sessionId: src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0
2025-09-30T14:59:37.820248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3296 sessionId: src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0 is DEAD
2025-09-30T14:59:37.820031Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:37.823475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:37.823487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0] Write session will restart in 0.007463s
2025-09-30T14:59:37.823512Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0] Write session: Do CDS request
2025-09-30T14:59:37.823519Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:37.835839Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:37.835923Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:37.835941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3297
2025-09-30T14:59:37.839508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3297 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:37.839589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3297 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:37.839601Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3297 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:37.839606Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:37.840093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3297 sessionId:  describe result for acl check
2025-09-30T14:59:37.840134Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:37.840145Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:37.840147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:37.840154Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897066904349873:2783] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:37.840817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897066904349873:2783] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:37.845115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897066904349873:2783] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:37.852201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897066904349873:2783] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:37.852221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897066904349873:2783] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:37.852225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897066904349873:2783] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:37.852234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3297 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:37.856379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:37.861886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:37.862183Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:37.862195Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:37.862208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:37.862272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:37.862333Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897066814546030:13034]
2025-09-30T14:59:37.863156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:37.863611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:37.863678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:37.864086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:37.864165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.864172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.864173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.864175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.864176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.864178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.864180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.864182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.864184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.864186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.864187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.864189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.864190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.864192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.864193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.864199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.864211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.864217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.864222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.864227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.864232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.864237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.864243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.864247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.864256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.864260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.864265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.864269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.864274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.864279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.864289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.864299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:37.864309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.864315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:37.864319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.864325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:37.864329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.864334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:37.864340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.864344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:37.864348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.864352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:37.864356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.864360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:37.864364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.864368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:37.864373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.864377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:37.864382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.864386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:37.864391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.864395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.864399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.864403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.864416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.864421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.864425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.864430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:37.864434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.864444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:37.864512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:37.870810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:37.872028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:37.872051Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:37.872053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:37.872062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:37.872070Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3296 [2:7555897066814546030:13034]
2025-09-30T14:59:37.872089Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:37.872107Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:37.872110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:37.872113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:37.872115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:37.872130Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:37.872137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:37.872143Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:37.872208Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.872219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.872221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.872224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:37.872226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:37.872300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:37.872308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.872323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:37.872335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:37.872357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:37.872378Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897066814546024:13034]
2025-09-30T14:59:37.872385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897066814546024:13034]
2025-09-30T14:59:37.872388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897066814546024:13034]
2025-09-30T14:59:37.872399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:37.872413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349854:2454], now have 1 active actors on pipe
2025-09-30T14:59:37.872427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:37.872441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:37.872443Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:37.872447Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:37.872449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:37.872449Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:37.872506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897066814546024:13034]
2025-09-30T14:59:37.872519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:37.872525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904349990:2783], now have 1 active actors on pipe
2025-09-30T14:59:37.872544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:37.872504Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3296
2025-09-30T14:59:37.873115Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3296
2025-09-30T14:59:37.873282Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.873302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.873335Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:37.873351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:37.873357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:37.873374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:37.873387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:37.873406Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:37.873435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:37.873621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:37.873631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:37.873646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:37.873790Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3297 partition: 0 MaxSeqNo: 42 sessionId: src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0
2025-09-30T14:59:37.874206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d9ffa142-8f2e7c90-bbd6e5aa-8ab2f644_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:37.877425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0] Write session: try to update token
2025-09-30T14:59:37.877450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:37.885920Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:37.885946Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:37.885956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897066814546024:13034]
2025-09-30T14:59:37.886005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:37.886024Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:37.886221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:37.886400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:37.886567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:37.886783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:37.887038Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:37.887077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:37.898673Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3297 sessionId: src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:37.899731Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:37.899754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:37.899757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:37.899765Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:37.899775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897066814546024:13034]
2025-09-30T14:59:37.899779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897066814546024:13034]
2025-09-30T14:59:37.899783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897066814546024:13034]
2025-09-30T14:59:37.899830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:37.899845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:37.899847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:37.900048Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:37.900533Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:37.900550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:37.900554Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:37.901648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:37.920180Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897066904350017:4275]
2025-09-30T14:59:37.920577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3296, pipe: [1:7555897066904350017:4275]
2025-09-30T14:59:38.019490Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:38.019953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.019963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.019986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897066904350017:4275], now have 1 active actors on pipe
2025-09-30T14:59:38.020275Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:38.020388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897066904350017:4275]
2025-09-30T14:59:38.020429Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:38.020553Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:38.020577Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:38.020644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3297 reason: error at write: Disconnected sessionId: src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0
2025-09-30T14:59:38.020833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3297 sessionId: src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0 is DEAD
2025-09-30T14:59:38.021031Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:38.021044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0] Write session will restart in 0.008038s
2025-09-30T14:59:38.021075Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0] Write session: Do CDS request
2025-09-30T14:59:38.021085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:38.030770Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:38.031603Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:38.031622Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3298
2025-09-30T14:59:38.031995Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3298 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:38.032043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3298 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:38.032053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3298 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:38.032070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:38.032697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3298 sessionId:  describe result for acl check
2025-09-30T14:59:38.032743Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:38.032745Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:38.032748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:38.032767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897071199317358:2785] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:38.033411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897071199317358:2785] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:38.035821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897071199317358:2785] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:38.044286Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:38.048036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897071199317358:2785] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:38.048058Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897071199317358:2785] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:38.048062Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897071199317358:2785] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:38.048071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3298 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:38.047368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:38.047622Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:38.047627Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:38.047638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:38.047693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:38.047739Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897071109513465:13036]
2025-09-30T14:59:38.048495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:38.049035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:38.049089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:38.049442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:38.049547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.049549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.049550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.049551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.049553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.049554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.049555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.049557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.049558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.049560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.049561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.049562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.049563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.049564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.049566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.049572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.049582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.049587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.049591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.049595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.049599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.049603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.049607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.049610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.049616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.049619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.049623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.049626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.049630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.049633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.049643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.049651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.049658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.049663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.049669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.049674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.049679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.049684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.049689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.049694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.049699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.049704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.049708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.049713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.049718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.049723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.049728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.049733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.049737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.049742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.049747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.049753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.049757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.049761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.049766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.049771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.049775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.049780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.049784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.049790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.049831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:38.057708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:38.058853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:38.058876Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:38.058879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:38.058884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:38.058891Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3297 [2:7555897071109513465:13036]
2025-09-30T14:59:38.058907Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:38.058925Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:38.059356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3297
2025-09-30T14:59:38.058928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:38.058932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:38.059402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3297
2025-09-30T14:59:38.058934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:38.058951Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:38.058959Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:38.058965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:38.059048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.059050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.059053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.059057Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:38.059059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:38.059131Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:38.059134Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.059150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.059161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.059176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:38.059193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897071109513460:13036]
2025-09-30T14:59:38.059196Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897071109513460:13036]
2025-09-30T14:59:38.059198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897071109513460:13036]
2025-09-30T14:59:38.059206Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:38.059221Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:38.059227Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:38.059231Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:38.059233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:38.059234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:38.059237Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:38.059265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317316:2454], now have 1 active actors on pipe
2025-09-30T14:59:38.059269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317452:2785], now have 1 active actors on pipe
2025-09-30T14:59:38.059308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897071109513460:13036]
2025-09-30T14:59:38.059317Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:38.059329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:38.059577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.059590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.059615Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:38.059627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:38.059631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:38.059633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:38.059643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:38.059653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:38.059673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:38.060256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.060267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.060288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:38.060406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3298 partition: 0 MaxSeqNo: 42 sessionId: src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0
2025-09-30T14:59:38.063123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4955d54a-a22e82dd-d628e944-c45c31bf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:38.066075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0] Write session: try to update token
2025-09-30T14:59:38.066102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:38.077710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:38.077733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:38.077736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:38.077739Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:38.077749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897071109513460:13036]
2025-09-30T14:59:38.077755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897071109513460:13036]
2025-09-30T14:59:38.077759Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897071109513460:13036]
2025-09-30T14:59:38.077801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:38.077807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.077810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:38.077819Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:38.077827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:38.077832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:38.078004Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:38.084089Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3298 sessionId: src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:38.086916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:38.120414Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897071199317464:4275]
2025-09-30T14:59:38.121051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3297, pipe: [1:7555897071199317464:4275]
2025-09-30T14:59:38.196310Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:38.196739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.196755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.196797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317464:4275], now have 1 active actors on pipe
2025-09-30T14:59:38.197095Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:38.197145Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:38.197215Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897071199317464:4275]
2025-09-30T14:59:38.197236Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:38.197336Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3298 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0
2025-09-30T14:59:38.197569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3298 sessionId: src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0 is DEAD
2025-09-30T14:59:38.199609Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:38.199626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0] Write session will restart in 0.007025s
2025-09-30T14:59:38.199655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0] Write session: Do CDS request
2025-09-30T14:59:38.199661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:38.207829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:38.208278Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:38.208293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3299
2025-09-30T14:59:38.208415Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3299 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:38.208441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3299 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:38.208445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3299 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:38.208448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:38.208907Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3299 sessionId:  describe result for acl check
2025-09-30T14:59:38.208935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:38.208937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:38.208940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:38.208945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897071199317518:2760] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:38.209435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897071199317518:2760] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:38.214896Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897071199317518:2760] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:38.215658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:38.216381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:38.216598Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:38.216608Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:38.216619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:38.216676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:38.216715Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897071109513608:13039]
2025-09-30T14:59:38.217336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:38.218474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:38.218545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:38.218847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897071199317518:2760] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:38.218867Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897071199317518:2760] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:38.218871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897071199317518:2760] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:38.218900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:38.218880Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3299 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:38.218983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.218990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.218991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.219005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.219012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.219013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.219014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.219016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.219017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.219018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.219020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.219021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.219022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.219023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.219025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.219031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.219041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.219045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.219049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.219053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.219057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.219061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.219065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.219070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.219075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.219091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.219095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.219099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.219103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.219107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.219116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.219124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.219130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.219136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.219141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.219146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.219151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.219156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.219161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.219167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.219171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.219177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.219183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.219195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.219199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.219205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.219211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.219216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.219232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.219238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.219261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.219269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.219273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.219277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.219282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.219286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.219291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.219296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.219300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.219305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.219352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:38.229246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:38.230484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:38.230510Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:38.230513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:38.230518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:38.230526Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3298 [2:7555897071109513608:13039]
2025-09-30T14:59:38.230544Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:38.230562Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:38.230567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:38.230570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:38.230573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:38.230590Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:38.230599Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:38.230623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:38.230698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.230701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.230703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.230707Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:38.230710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:38.230791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:38.230795Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.230809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.230822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.230844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:38.230861Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897071109513602:13039]
2025-09-30T14:59:38.230864Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897071109513602:13039]
2025-09-30T14:59:38.230867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897071109513602:13039]
2025-09-30T14:59:38.230876Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:38.230890Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:38.230905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:38.230909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:38.230914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:38.230918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:38.230920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:38.230949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897071109513602:13039]
2025-09-30T14:59:38.230953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:38.230956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:38.230965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317469:2454], now have 1 active actors on pipe
2025-09-30T14:59:38.230970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317611:2760], now have 1 active actors on pipe
2025-09-30T14:59:38.231078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3298
2025-09-30T14:59:38.231123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3298
2025-09-30T14:59:38.231260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.231273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.231301Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:38.231309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:38.231313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:38.231316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:38.231329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:38.231341Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:38.231355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:38.231584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.231599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.231620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:38.231729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3299 partition: 0 MaxSeqNo: 42 sessionId: src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0
2025-09-30T14:59:38.232114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3d6a3912-863bc66c-7693ae69-c03de2e1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:38.235151Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0] Write session: try to update token
2025-09-30T14:59:38.235171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:38.250252Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:38.250276Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:38.250290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897071109513602:13039]
2025-09-30T14:59:38.250467Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:38.250771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:38.251054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:38.251316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:38.251504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:38.251813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:38.251879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:38.252622Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:38.267526Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3299 sessionId: src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:38.271617Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:38.270452Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:38.270472Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:38.270474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:38.270476Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:38.270485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897071109513602:13039]
2025-09-30T14:59:38.270488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897071109513602:13039]
2025-09-30T14:59:38.270491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897071109513602:13039]
2025-09-30T14:59:38.270527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:38.270538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.270540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:38.270699Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:38.271752Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:38.271759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:38.271764Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:38.302296Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897071199317620:4275]
2025-09-30T14:59:38.302740Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3298, pipe: [1:7555897071199317620:4275]
2025-09-30T14:59:38.388962Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:38.389337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.389361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.389384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317620:4275], now have 1 active actors on pipe
2025-09-30T14:59:38.389694Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:38.389707Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897071199317620:4275]
2025-09-30T14:59:38.389749Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:38.389796Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:38.389800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:38.389878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3299 reason: error at write: Disconnected sessionId: src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0
2025-09-30T14:59:38.390066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3299 sessionId: src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0 is DEAD
2025-09-30T14:59:38.391508Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:38.391520Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0] Write session will restart in 0.007978s
2025-09-30T14:59:38.391545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0] Write session: Do CDS request
2025-09-30T14:59:38.391553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:38.401295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:38.401349Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:38.401378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3300
2025-09-30T14:59:38.403495Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3300 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:38.403559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3300 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:38.403565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3300 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:38.403570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:38.404390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3300 sessionId:  describe result for acl check
2025-09-30T14:59:38.404428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:38.404435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:38.404437Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:38.404443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897071199317732:2750] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:38.405036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897071199317732:2750] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:38.405214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:38.407055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897071199317732:2750] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:38.407863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:38.408087Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:38.408091Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:38.408102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:38.408162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:38.408200Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897071109513750:13041]
2025-09-30T14:59:38.408867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:38.409312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:38.409376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:38.409733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:38.409810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.409820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.409821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.409823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.409824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.409825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.409826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.409828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.409829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.409830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.409831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.409833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.409834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.409835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.409836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.409842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.409852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.409856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.409861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.409865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.409869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.409873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.409877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.409881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.409888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.409892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.409896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.409901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.409905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.409909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.409918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.409926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.409932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.409938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.409944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.409951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.409955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.409961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.409966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.409972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.409978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.409984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.409989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.409995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.410000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.410006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.410011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.410017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.410022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.410029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.410035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.410040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.410045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.410051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.410057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897071199317732:2750] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:38.410059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.410072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.410076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.410074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897071199317732:2750] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:38.410082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.410085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.410077Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897071199317732:2750] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:38.410090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.410130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:38.410087Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3300 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:38.416385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:38.417593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:38.417628Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:38.417632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:38.417636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:38.417643Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3299 [2:7555897071109513750:13041]
2025-09-30T14:59:38.417664Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:38.417681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:38.417691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:38.417694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:38.417697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:38.417714Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:38.417721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:38.417728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:38.417791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.417800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.417802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.417806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:38.417809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:38.417903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:38.417908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.417924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.417941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.417965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:38.417992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317769:2750], now have 1 active actors on pipe
2025-09-30T14:59:38.418000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317628:2454], now have 1 active actors on pipe
2025-09-30T14:59:38.418006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897071109513745:13041]
2025-09-30T14:59:38.418013Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897071109513745:13041]
2025-09-30T14:59:38.418015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897071109513745:13041]
2025-09-30T14:59:38.418030Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:38.418044Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:38.418059Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:38.418060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:38.418062Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:38.418064Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:38.418066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:38.418098Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897071109513745:13041]
2025-09-30T14:59:38.418101Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:38.418120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:38.418140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.418145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.418170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:38.418177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:38.418180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:38.418183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:38.418196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:38.418205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:38.418218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:38.418072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3299
2025-09-30T14:59:38.418080Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3299
2025-09-30T14:59:38.418506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.418520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.418537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:38.418723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3300 partition: 0 MaxSeqNo: 42 sessionId: src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0
2025-09-30T14:59:38.419220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a010c60a-2b0aa0b8-d1ae66bd-26a197e6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:38.422479Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0] Write session: try to update token
2025-09-30T14:59:38.422505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:38.431488Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:38.431511Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:38.431522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897071109513745:13041]
2025-09-30T14:59:38.431575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:38.431594Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:38.431783Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:38.431934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:38.432086Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:38.432244Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:38.432449Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:38.432508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:38.444342Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3300 sessionId: src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:38.447269Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:38.448170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.448201Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.448222Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:38.448226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:38.448228Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:38.448232Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:38.448242Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897071109513745:13041]
2025-09-30T14:59:38.448246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897071109513745:13041]
2025-09-30T14:59:38.448250Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897071109513745:13041]
2025-09-30T14:59:38.448305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:38.448312Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:38.448317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.448319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:38.448321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:38.448325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:38.448484Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:38.490133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897071199317795:4275]
2025-09-30T14:59:38.490362Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3299, pipe: [1:7555897071199317795:4275]
2025-09-30T14:59:38.564719Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:38.565069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:38.565113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317795:4275], now have 1 active actors on pipe
2025-09-30T14:59:38.565673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:38.565773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:38.565782Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:38.565855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3300 reason: error at write: Disconnected sessionId: src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0
2025-09-30T14:59:38.565948Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897071199317795:4275]
2025-09-30T14:59:38.565978Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:38.565992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3300 sessionId: src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0 is DEAD
2025-09-30T14:59:38.566142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:38.566161Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0] Write session will restart in 0.005278s
2025-09-30T14:59:38.566188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0] Write session: Do CDS request
2025-09-30T14:59:38.566193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:38.575796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:38.575887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:38.575906Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3301
2025-09-30T14:59:38.576090Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3301 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:38.576137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3301 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:38.576153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3301 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:38.576158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:38.576676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3301 sessionId:  describe result for acl check
2025-09-30T14:59:38.576713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:38.576721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:38.576723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:38.576729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897071199317833:2733] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:38.577301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897071199317833:2733] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:38.579931Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897071199317833:2733] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:38.582476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:38.584937Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:38.585320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897071199317833:2733] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:38.585342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897071199317833:2733] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:38.585345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897071199317833:2733] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:38.585354Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3301 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:38.585393Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:38.585406Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:38.585419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:38.585493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:38.585536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897071109513942:13056]
2025-09-30T14:59:38.586165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:38.586553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:38.586620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:38.587037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:38.587141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.587150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.587152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.587153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.587155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.587157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.587158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.587160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.587161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.587162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.587163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.587164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.587166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.587167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.587168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.587174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.587184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.587188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.587192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.587195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.587199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.587203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.587206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.587210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.587216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.587219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.587222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.587226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.587229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.587232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.587241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.587268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.587274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.587280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.587284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.587290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.587295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.587300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.587305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.587321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.587330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.587335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.587341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.587345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.587349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.587354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.587359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.587363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.587368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.587373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.587377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.587381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.587385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.587391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.587396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.587400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.587404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.587408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.587412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.587417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.587459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:38.594299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:38.595466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:38.595487Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:38.595490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:38.595495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:38.595502Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3300 [2:7555897071109513942:13056]
2025-09-30T14:59:38.595521Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:38.595538Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:38.595541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:38.595545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:38.595547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:38.595569Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:38.595581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:38.595589Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:38.595680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.595693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.595696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.595700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:38.595702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:38.595784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:38.595793Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.595808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.595825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.595848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:38.595875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317809:2454], now have 1 active actors on pipe
2025-09-30T14:59:38.595883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317947:2733], now have 1 active actors on pipe
2025-09-30T14:59:38.595890Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897071109513937:13056]
2025-09-30T14:59:38.595891Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897071109513937:13056]
2025-09-30T14:59:38.595894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897071109513937:13056]
2025-09-30T14:59:38.595907Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:38.595923Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:38.595927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:38.595927Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:38.595929Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:38.595941Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:38.595944Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:38.595990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897071109513937:13056]
2025-09-30T14:59:38.595999Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:38.596002Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:38.595976Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3300
2025-09-30T14:59:38.595982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3300
2025-09-30T14:59:38.596028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.596042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.596080Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:38.596089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:38.596093Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:38.596095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:38.596108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:38.596118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:38.596144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:38.596616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3301 partition: 0 MaxSeqNo: 42 sessionId: src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0
2025-09-30T14:59:38.597063Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|64ce62f1-a05cc410-b9f6e98d-601e80fa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:38.600364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0] Write session: try to update token
2025-09-30T14:59:38.600393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:38.596456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.596494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.596522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:38.609706Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:38.609732Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:38.609734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:38.609736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:38.609746Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897071109513937:13056]
2025-09-30T14:59:38.609752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897071109513937:13056]
2025-09-30T14:59:38.609757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897071109513937:13056]
2025-09-30T14:59:38.609804Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:38.609813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.609817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:38.609972Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:38.611484Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:38.611507Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:38.611512Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:38.619448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3301 sessionId: src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:38.622394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:38.663627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897071199317958:4275]
2025-09-30T14:59:38.663920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3300, pipe: [1:7555897071199317958:4275]
2025-09-30T14:59:38.729409Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:38.729837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.729851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.729872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317958:4275], now have 1 active actors on pipe
2025-09-30T14:59:38.730119Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897071199317958:4275]
2025-09-30T14:59:38.730154Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:59:38.730331Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 33 consumer shared/user session shared/user_1_33_15939603490645126362_v1 is DEAD
2025-09-30T14:59:38.730474Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:38.730520Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:59:38.730482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:38.730675Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:59:38.730681Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:59:38.730688Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.006854s
2025-09-30T14:59:38.730857Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:38.730872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0] Write session will restart in 0.007082s
2025-09-30T14:59:38.730895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0] Write session: Do CDS request
2025-09-30T14:59:38.730900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:38.730569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3301 reason: error at write: Disconnected sessionId: src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0
2025-09-30T14:59:38.730678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3301 sessionId: src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0 is DEAD
2025-09-30T14:59:38.730816Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896998184859660:4283] disconnected; active server actors: 1
2025-09-30T14:59:38.730820Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555896998184859660:4283] client user disconnected session shared/user_1_33_15939603490645126362_v1
2025-09-30T14:59:38.730841Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:38.731372Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:38.738757Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:59:38.738892Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:38.739218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:38.739217Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:59:38.739223Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 34
2025-09-30T14:59:38.739238Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3302
2025-09-30T14:59:38.739444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3302 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:38.739470Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 34 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:59:38.739482Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3302 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:38.739488Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3302 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:38.739495Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:38.739547Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:59:38.739620Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 auth for : user
2025-09-30T14:59:38.739714Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 Handle describe topics response
2025-09-30T14:59:38.739739Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 auth is DEAD
2025-09-30T14:59:38.739764Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:59:38.739938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3302 sessionId:  describe result for acl check
2025-09-30T14:59:38.739968Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:38.739983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:38.739985Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:38.739991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897071199317971:2713] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:38.740014Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:59:38.740201Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_34_9210698993788309934_v1
2025-09-30T14:59:38.740312Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555897071199317972:2716] connected; active server actors: 1
2025-09-30T14:59:38.740395Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555897071199317972:2716] session shared/user_1_34_9210698993788309934_v1
2025-09-30T14:59:38.740417Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:59:38.740427Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:59:38.740435Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_34_9210698993788309934_v1" (Sender=[1:7555897071199317966:2716], Pipe=[1:7555897071199317972:2716], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:59:38.740439Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:59:38.740449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:59:38.740458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_34_9210698993788309934_v1" (Sender=[1:7555897071199317966:2716], Pipe=[1:7555897071199317972:2716], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:59:38.740468Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_34_9210698993788309934_v1" sender [1:7555897071199317966:2716] lock partition 0 for ReadingSession "shared/user_1_34_9210698993788309934_v1" (Sender=[1:7555897071199317966:2716], Pipe=[1:7555897071199317972:2716], Partitions=[], ActiveFamilyCount=1) generation 1 step 34
2025-09-30T14:59:38.740500Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:59:38.740505Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000052s
2025-09-30T14:59:38.740580Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897071199317971:2713] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:38.740726Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 34 Session: "shared/user_1_34_9210698993788309934_v1" ClientId: "user" PipeClient { RawX1: 7555897071199317972 RawX2: 4503603922340508 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:59:38.740754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:59:38.746287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897071199317971:2713] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:38.756109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897071199317971:2713] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:38.756128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897071199317971:2713] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:38.756132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897071199317971:2713] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:38.756141Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3302 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:38.763007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:38.765365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:38.765795Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:38.765810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:38.765826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:38.765914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:38.765958Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897071109514091:13059]
2025-09-30T14:59:38.766621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:38.767034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:38.767123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:38.767500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:38.767570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.767575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.767577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.767578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.767579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.767581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.767582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.767583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.767585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.767586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.767587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.767589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.767590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.767591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.767593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.767598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.767609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.767613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.767618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.767621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.767625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.767629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.767633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.767637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.767641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.767644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.767647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.767651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.767655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.767659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.767670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.767679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.767685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.767691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.767701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.767707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.767712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.767722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.767727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.767733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.767737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.767743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.767754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.767759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.767769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.767774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.767778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.767783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.767788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.767792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.767797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.767803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.767814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.767819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.767831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.767836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.767840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.767845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.767849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.767854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.767908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:38.774592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:38.775628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:38.775650Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:38.775653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:38.775657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:38.775665Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3301 [2:7555897071109514091:13059]
2025-09-30T14:59:38.775683Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:38.775699Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:38.775703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:38.775707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:38.775709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:38.775727Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:38.775734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:38.775742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:38.775802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.775813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.775816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.775820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:38.775822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:38.775891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:38.775900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.775915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.775929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.775954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:38.775975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897071109514086:13059]
2025-09-30T14:59:38.775983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897071109514086:13059]
2025-09-30T14:59:38.775985Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897071109514086:13059]
2025-09-30T14:59:38.776003Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:38.776024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:38.776040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:38.776047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:38.776074Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:38.776086Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897071109514086:13059]
2025-09-30T14:59:38.776088Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:38.776088Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:38.776091Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:38.776097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:38.776449Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3301
2025-09-30T14:59:38.776507Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3301
2025-09-30T14:59:38.776545Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3301, pipe: [1:7555897071199317978:2695]
2025-09-30T14:59:38.776650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317961:2454], now have 1 active actors on pipe
2025-09-30T14:59:38.776662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199318017:2713], now have 1 active actors on pipe
2025-09-30T14:59:38.776666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199317978:2695], now have 1 active actors on pipe
2025-09-30T14:59:38.776705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.776711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.776723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_34_9210698993788309934_v1 on pipe: [1:7555897071199317978:2695]
2025-09-30T14:59:38.776750Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.776753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.776764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:38.776769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:38.776772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:38.776777Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_34_9210698993788309934_v1:1 with generation 3301
2025-09-30T14:59:38.776789Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_34_9210698993788309934_v1
2025-09-30T14:59:38.776792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:38.776824Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:38.776830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:59:38.776834Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:59:38.783349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:59:38.783394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:59:38.783404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:38.783416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:38.783419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:38.783432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:38.783453Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:38.783465Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:59:38.783483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:59:38.783503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:38.783673Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244378775 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:59:38.783713Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:59:38.783747Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 sending to client partition status
2025-09-30T14:59:38.783788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.783812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.783853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:38.783958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3302 partition: 0 MaxSeqNo: 42 sessionId: src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0
2025-09-30T14:59:38.787571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5260a5cb-d1890ac2-3ffba08f-2c31082b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:38.790341Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:38.790364Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:38.790374Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897071109514086:13059]
2025-09-30T14:59:38.790422Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:38.790424Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:38.790607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:38.790765Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:38.790826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0] Write session: try to update token
2025-09-30T14:59:38.790849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:38.790921Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:38.791085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:38.791349Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:38.791404Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:38.802727Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:38.802754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:38.802756Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:38.802759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:38.802771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897071109514086:13059]
2025-09-30T14:59:38.802776Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897071109514086:13059]
2025-09-30T14:59:38.802780Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897071109514086:13059]
2025-09-30T14:59:38.802825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:38.802830Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:38.802834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.802838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:38.802849Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:38.802854Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:38.802991Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:38.812655Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3302 sessionId: src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:38.815351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:38.935939Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:38.936366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.936376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.939758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897071199317978:2695]
2025-09-30T14:59:38.939809Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:38.939809Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:38.939813Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:38.939893Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3302 reason: error at write: Disconnected sessionId: src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0
2025-09-30T14:59:38.940084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3302 sessionId: src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0 is DEAD
2025-09-30T14:59:38.939988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_34_9210698993788309934_v1
2025-09-30T14:59:38.940436Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:38.940454Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0] Write session will restart in 0.007632s
2025-09-30T14:59:38.940501Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0] Write session: Do CDS request
2025-09-30T14:59:38.940507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:38.940019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:38.940386Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_34_9210698993788309934_v1
2025-09-30T14:59:38.951964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:38.952563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:38.952582Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3303
2025-09-30T14:59:38.953011Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3303 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:38.953055Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3303 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:38.953061Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3303 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:38.953065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:38.953721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3303 sessionId:  describe result for acl check
2025-09-30T14:59:38.953756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:38.953758Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:38.953760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:38.953767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897071199318177:2689] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:38.954331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897071199318177:2689] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:38.961185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897071199318177:2689] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:38.965611Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897071199318177:2689] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:38.965634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897071199318177:2689] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:38.965637Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897071199318177:2689] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:38.965647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3303 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:38.968117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:38.970319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:38.970545Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:38.970549Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:38.970560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:38.970612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:38.970651Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897071109514239:13061]
2025-09-30T14:59:38.971360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:38.972022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:38.972078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:38.972439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:38.972520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.972521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.972523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.972524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.972525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.972527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.972528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.972530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.972531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.972533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.972534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.972535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.972537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.972538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.972539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.972545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.972570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.972574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.972578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.972582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.972587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.972591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.972595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.972599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.972604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.972608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.972611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.972615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.972620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.972625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.972637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.972646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:38.972653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.972659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:38.972664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.972669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:38.972677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.972682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:38.972687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.972693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:38.972697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.972702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:38.972707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.972712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:38.972717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.972723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:38.972728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.972733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:38.972737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.972743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:38.972748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.972753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.972758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.972764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.972769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.972775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.972780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.972785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:38.972790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.972795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:38.972844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:38.979487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:38.980658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:38.980666Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:38.980670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:38.980674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:38.980683Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3302 [2:7555897071109514239:13061]
2025-09-30T14:59:38.980702Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:38.980720Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:38.980723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:38.980728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:38.980731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:38.980752Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:38.980760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:38.980768Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:38.980842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.980844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.980846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.980852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:38.980856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:38.980937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:38.980941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:38.980954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:38.980967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:38.980983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:38.981000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897071109514234:13061]
2025-09-30T14:59:38.981003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897071109514234:13061]
2025-09-30T14:59:38.981005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897071109514234:13061]
2025-09-30T14:59:38.981020Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:38.981036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:38.981050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:38.981053Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:38.981096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897071109514234:13061]
2025-09-30T14:59:38.981099Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:38.981715Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:38.981728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:38.981730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:38.981737Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:38.982014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199318279:2689], now have 1 active actors on pipe
2025-09-30T14:59:38.982024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897071199318138:2454], now have 1 active actors on pipe
2025-09-30T14:59:38.981965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3302
2025-09-30T14:59:38.982000Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3302
2025-09-30T14:59:38.982263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.982271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.982316Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:38.982327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:38.982331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:38.982334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:38.982348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:38.982363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:38.982389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:38.984375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:38.984394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:38.984433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:38.984892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3303 partition: 0 MaxSeqNo: 42 sessionId: src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0
2025-09-30T14:59:38.985348Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7b034b53-54d267c9-2dafbbf1-652af6a0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:38.988431Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0] Write session: try to update token
2025-09-30T14:59:38.988460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:39.002678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:39.002704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:39.002707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:39.002710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:39.002720Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897071109514234:13061]
2025-09-30T14:59:39.002726Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897071109514234:13061]
2025-09-30T14:59:39.002732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897071109514234:13061]
2025-09-30T14:59:39.002774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:39.002783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.002785Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:39.002851Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:39.002865Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:39.002868Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:39.002916Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:39.021486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3303 sessionId: src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:39.024919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:39.040691Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897075494285591:2695]
2025-09-30T14:59:39.041046Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3302, pipe: [1:7555897075494285591:2695]
2025-09-30T14:59:39.120279Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:39.120787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.120809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.120833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494285591:2695], now have 1 active actors on pipe
2025-09-30T14:59:39.121131Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:39.123460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:39.123562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3303 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0
2025-09-30T14:59:39.123777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3303 sessionId: src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0 is DEAD
2025-09-30T14:59:39.123882Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897075494285591:2695]
2025-09-30T14:59:39.123899Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:39.125088Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:39.125104Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0] Write session will restart in 0.007104s
2025-09-30T14:59:39.125131Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0] Write session: Do CDS request
2025-09-30T14:59:39.125138Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:39.133791Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:39.134319Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:39.134340Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3304
2025-09-30T14:59:39.134508Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3304 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:39.134547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3304 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:39.134552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3304 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:39.134557Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:39.135050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3304 sessionId:  describe result for acl check
2025-09-30T14:59:39.135103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:39.135106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:39.135108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:39.135114Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897075494285600:2687] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:39.135722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897075494285600:2687] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:39.138255Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897075494285600:2687] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:39.143770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897075494285600:2687] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:39.143803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897075494285600:2687] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:39.143809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897075494285600:2687] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:39.143820Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3304 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:39.159071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:39.161500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:39.161972Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:39.161988Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:39.162004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:39.162086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:39.162131Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897075404481683:13063]
2025-09-30T14:59:39.162814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:39.163497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:39.163560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:39.164186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:39.164253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.164254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.164255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.164256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.164257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.164258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.164259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.164260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.164261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.164262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.164263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.164264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.164264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.164265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.164266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.164270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.164278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.164281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.164283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.164286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.164288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.164291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.164293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.164296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.164301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.164303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.164306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.164308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.164311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.164313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.164340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.164348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.164353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.164357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.164361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.164364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.164367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.164370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.164374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.164377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.164379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.164382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.164386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.164389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.164392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.164395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.164398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.164402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.164406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.164412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.164417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.164422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.164427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.164434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.164439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.164446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.164449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.164452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.164454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.164458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.164503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:39.171197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:39.172342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:39.172351Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:39.172353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:39.172359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:39.172367Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3303 [2:7555897075404481683:13063]
2025-09-30T14:59:39.172386Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:39.172404Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:39.172408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:39.172411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:39.172417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:39.172437Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:39.172445Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:39.172452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:39.172538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.172543Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.172545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.172549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:39.172551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:39.172633Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:39.172635Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.172648Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.172661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.172680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:39.172698Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897075404481677:13063]
2025-09-30T14:59:39.172701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897075404481677:13063]
2025-09-30T14:59:39.172703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897075404481677:13063]
2025-09-30T14:59:39.172718Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:39.172736Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:39.172751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:39.172754Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:39.172794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897075404481677:13063]
2025-09-30T14:59:39.172797Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:39.173122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:39.173133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:39.173135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:39.173142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:39.173402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494285651:2687], now have 1 active actors on pipe
2025-09-30T14:59:39.173406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494285593:2454], now have 1 active actors on pipe
2025-09-30T14:59:39.173832Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3303
2025-09-30T14:59:39.173867Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3303
2025-09-30T14:59:39.181111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.181856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3304 partition: 0 MaxSeqNo: 42 sessionId: src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0
2025-09-30T14:59:39.181140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.181181Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:39.181194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:39.181200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:39.181203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:39.181219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:39.181239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:39.181265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:39.181709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.181714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.181731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:39.182355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6cef6c8-7b7c65a7-85820f7a-cde82291_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:39.185706Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0] Write session: try to update token
2025-09-30T14:59:39.185734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:39.208929Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:39.208960Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:39.208963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:39.208966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:39.208977Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897075404481677:13063]
2025-09-30T14:59:39.208986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897075404481677:13063]
2025-09-30T14:59:39.208992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897075404481677:13063]
2025-09-30T14:59:39.209055Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:39.209067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.209070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:39.209387Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:39.214520Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:39.214546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:39.214553Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:39.216425Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3304 sessionId: src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:39.219350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:39.223765Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897075494285749:2695]
2025-09-30T14:59:39.224686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3303, pipe: [1:7555897075494285749:2695]
2025-09-30T14:59:39.334052Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:39.334460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.334477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.334501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494285749:2695], now have 1 active actors on pipe
2025-09-30T14:59:39.334791Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897075494285749:2695]
2025-09-30T14:59:39.334829Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:39.334852Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:39.334867Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:39.334925Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:39.334933Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3304 reason: error at write: Disconnected sessionId: src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0
2025-09-30T14:59:39.335118Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3304 sessionId: src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0 is DEAD
2025-09-30T14:59:39.335564Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:39.335587Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0] Write session will restart in 0.007001s
2025-09-30T14:59:39.335614Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0] Write session: Do CDS request
2025-09-30T14:59:39.335623Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:39.343853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:39.347878Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:39.347900Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3305
2025-09-30T14:59:39.348119Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3305 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:39.348153Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3305 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:39.348159Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3305 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:39.348164Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:39.348663Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3305 sessionId:  describe result for acl check
2025-09-30T14:59:39.348697Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:39.348700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:39.348702Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:39.348709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897075494285766:2691] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:39.349382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897075494285766:2691] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:39.351654Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897075494285766:2691] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:39.359290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:39.356556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897075494285766:2691] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:39.356575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897075494285766:2691] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:39.356579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897075494285766:2691] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:39.356588Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3305 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:39.362043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:39.362776Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:39.362790Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:39.362805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:39.362893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:39.362932Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897075404481834:13066]
2025-09-30T14:59:39.364036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:39.364441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:39.364545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:39.364915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:39.364988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.364990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.364991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.364993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.364994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.364995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.364997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.364998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.364999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.365001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.365003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.365004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.365006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.365007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.365009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.365015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.365026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.365031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.365035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.365039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.365043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.365047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.365051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.365055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.365059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.365063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.365067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.365071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.365075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.365092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.365103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.365113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.365120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.365126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.365130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.365136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.365140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.365145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.365149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.365154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.365159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.365166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.365171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.365176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.365181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.365185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.365190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.365195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.365200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.365206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.365211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.365229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.365235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.365240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.365245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.365250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.365256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.365262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.365267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.365273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.365333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:39.372431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:39.373616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:39.373640Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:39.373648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:39.373653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:39.373662Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3304 [2:7555897075404481834:13066]
2025-09-30T14:59:39.373681Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:39.373702Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:39.373706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:39.373709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:39.373712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:39.373733Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:39.373745Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:39.373753Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:39.373829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.373836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.373838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.373842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:39.373844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:39.373921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:39.373929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.373944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.373961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.373984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:39.374007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897075404481828:13066]
2025-09-30T14:59:39.374011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897075404481828:13066]
2025-09-30T14:59:39.374014Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897075404481828:13066]
2025-09-30T14:59:39.374026Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:39.374039Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:39.374042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494285753:2454], now have 1 active actors on pipe
2025-09-30T14:59:39.374043Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:39.374045Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:39.374051Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:39.374065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:39.374069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:39.374075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494285884:2691], now have 1 active actors on pipe
2025-09-30T14:59:39.374124Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897075404481828:13066]
2025-09-30T14:59:39.374133Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:39.374197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:39.374287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.374300Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.374339Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:39.374352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:39.374356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:39.374360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:39.374371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:39.374141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3304
2025-09-30T14:59:39.374403Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:39.374147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3304
2025-09-30T14:59:39.374419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:39.374709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.374737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.374762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:39.374871Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3305 partition: 0 MaxSeqNo: 42 sessionId: src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0
2025-09-30T14:59:39.375343Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4b6dcf14-8ef5c13a-397ef658-57e0a9c7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:39.378449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0] Write session: try to update token
2025-09-30T14:59:39.378478Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:39.387396Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:39.387422Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:39.387434Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897075404481828:13066]
2025-09-30T14:59:39.387490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:39.387703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:39.387864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:39.388029Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:39.388245Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:39.388466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:39.388540Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:39.388683Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:39.401279Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:39.401313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:39.401316Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:39.401319Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:39.401330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897075404481828:13066]
2025-09-30T14:59:39.401334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897075404481828:13066]
2025-09-30T14:59:39.401346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897075404481828:13066]
2025-09-30T14:59:39.401409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:39.401418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.401423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:39.401424Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:39.401431Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:39.401445Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:39.401595Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:39.405879Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3305 sessionId: src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:39.409151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:39.434699Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897075494285918:2695]
2025-09-30T14:59:39.435053Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3304, pipe: [1:7555897075494285918:2695]
2025-09-30T14:59:39.522187Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:39.524484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.524517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.524545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494285918:2695], now have 1 active actors on pipe
2025-09-30T14:59:39.524810Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:39.525330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:39.525342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0] Write session will restart in 0.009182s
2025-09-30T14:59:39.525368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0] Write session: Do CDS request
2025-09-30T14:59:39.525374Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:39.524847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:39.524854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:39.524859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:39.524912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897075494285918:2695]
2025-09-30T14:59:39.524941Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3305 reason: error at write: Disconnected sessionId: src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0
2025-09-30T14:59:39.525157Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3305 sessionId: src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0 is DEAD
2025-09-30T14:59:39.535863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:39.535950Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:39.535970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3306
2025-09-30T14:59:39.536088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3306 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:39.536121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3306 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:39.536131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3306 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:39.536147Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:39.536689Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3306 sessionId:  describe result for acl check
2025-09-30T14:59:39.536739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:39.536747Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:39.536749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:39.536756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897075494286003:2635] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:39.537352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897075494286003:2635] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:39.539700Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897075494286003:2635] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:39.539988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:39.542589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:39.542936Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:39.542951Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:39.542966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:39.543040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:39.543090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897075404481995:13074]
2025-09-30T14:59:39.543767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:39.544080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:39.544162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:39.544236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897075494286003:2635] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:39.544256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897075494286003:2635] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:39.544260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897075494286003:2635] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:39.544269Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3306 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:39.544566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:39.544655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.544663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.544664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.544665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.544667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.544668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.544669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.544670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.544671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.544672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.544673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.544675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.544676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.544677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.544678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.544685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.544695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.544699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.544703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.544707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.544711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.544716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.544720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.544724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.544728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.544732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.544736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.544740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.544744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.544748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.544757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.544765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.544772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.544778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.544783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.544789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.544793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.544799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.544804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.544820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.544826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.544831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.544836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.544840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.544845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.544850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.544862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.544867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.544876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.544881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.544890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.544894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.544899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.544903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.544911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.544916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.544920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.544924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.544929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.544949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.545000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:39.550883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:39.552456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:39.552495Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:39.552498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:39.552502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:39.552508Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3305 [2:7555897075404481995:13074]
2025-09-30T14:59:39.552524Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:39.552539Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:39.552544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:39.552548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:39.552550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:39.552566Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:39.552573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:39.552579Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:39.552645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.552656Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.552659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.552662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:39.552665Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:39.552738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:39.552750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.552764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.552775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.552791Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:39.552812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494286081:2635], now have 1 active actors on pipe
2025-09-30T14:59:39.552822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494285921:2454], now have 1 active actors on pipe
2025-09-30T14:59:39.552828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897075404481990:13074]
2025-09-30T14:59:39.552830Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897075404481990:13074]
2025-09-30T14:59:39.552832Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897075404481990:13074]
2025-09-30T14:59:39.552848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:39.552863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:39.552867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:39.552870Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:39.552874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:39.552882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:39.552884Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:39.552921Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897075404481990:13074]
2025-09-30T14:59:39.552934Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:39.552960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:39.552965Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3305
2025-09-30T14:59:39.552998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3305
2025-09-30T14:59:39.553196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.553210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.553242Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:39.553265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:39.553269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:39.553271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:39.553284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:39.553295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:39.553313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:39.553557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.553567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.553585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:39.554007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3306 partition: 0 MaxSeqNo: 42 sessionId: src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0
2025-09-30T14:59:39.554417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5c891ab3-85dfe96a-fc42a97a-70056c62_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:39.557857Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0] Write session: try to update token
2025-09-30T14:59:39.557878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:39.568857Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:39.568888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:39.568890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:39.568893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:39.568903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897075404481990:13074]
2025-09-30T14:59:39.568908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897075404481990:13074]
2025-09-30T14:59:39.568913Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897075404481990:13074]
2025-09-30T14:59:39.568965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:39.568973Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.568977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:39.568975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:39.568996Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:39.569004Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:39.569134Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:39.575325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3306 sessionId: src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:39.578650Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:39.625174Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897075494286100:2695]
2025-09-30T14:59:39.625513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3305, pipe: [1:7555897075494286100:2695]
2025-09-30T14:59:39.693534Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:39.693966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.693988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.694010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494286100:2695], now have 1 active actors on pipe
2025-09-30T14:59:39.694670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:39.694693Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:39.694717Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:39.694779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3306 reason: error at write: Disconnected sessionId: src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0
2025-09-30T14:59:39.694986Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3306 sessionId: src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0 is DEAD
2025-09-30T14:59:39.695072Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897075494286100:2695]
2025-09-30T14:59:39.695119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:39.695167Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:39.695178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0] Write session will restart in 0.006626s
2025-09-30T14:59:39.695201Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0] Write session: Do CDS request
2025-09-30T14:59:39.695209Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:39.702832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:39.702920Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:39.702947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3307
2025-09-30T14:59:39.703084Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3307 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:39.703116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3307 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:39.703127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3307 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:39.703131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:39.704525Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3307 sessionId:  describe result for acl check
2025-09-30T14:59:39.704575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:39.704583Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:39.704585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:39.704591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897075494286135:2625] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:39.705173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897075494286135:2625] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:39.707574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897075494286135:2625] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:39.709601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:39.712239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:39.712511Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:39.712524Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:39.712538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:39.712613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:39.712559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897075494286135:2625] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:39.712659Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897075404482182:13084]
2025-09-30T14:59:39.712578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897075494286135:2625] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:39.712582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897075494286135:2625] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:39.712591Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3307 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:39.713442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:39.713828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:39.713894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:39.714240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:39.714300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.714307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.714308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.714309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.714310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.714311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.714312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.714313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.714314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.714315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.714316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.714317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.714318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.714319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.714319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.714324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.714331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.714334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.714336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.714339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.714341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.714344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.714346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.714349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.714353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.714356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.714358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.714360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.714363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.714366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.714372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.714377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.714382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.714386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.714388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.714392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.714394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.714398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.714401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.714404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.714407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.714410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.714413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.714417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.714419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.714423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.714428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.714433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.714437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.714441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.714446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.714451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.714456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.714462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.714469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.714474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.714478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.714483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.714488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.714492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.714550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:39.723036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:39.724223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:39.724247Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:39.724250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:39.724255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:39.724262Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3306 [2:7555897075404482182:13084]
2025-09-30T14:59:39.724278Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:39.724291Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:39.724293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:39.724295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:39.724297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:39.724314Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:39.724322Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:39.724327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:39.724381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.724387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.724388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.724390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:39.724392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:39.724447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:39.724452Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.724461Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.724482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.724500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:39.724518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897075404482177:13084]
2025-09-30T14:59:39.724523Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897075404482177:13084]
2025-09-30T14:59:39.724525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897075404482177:13084]
2025-09-30T14:59:39.724532Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:39.724543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:39.724553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:39.724559Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:39.724588Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:39.724595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897075404482177:13084]
2025-09-30T14:59:39.724596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:39.724611Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:39.724613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:39.724620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:39.724637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494286250:2625], now have 1 active actors on pipe
2025-09-30T14:59:39.724645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494286102:2454], now have 1 active actors on pipe
2025-09-30T14:59:39.724776Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3306
2025-09-30T14:59:39.724778Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3306
2025-09-30T14:59:39.724857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.724868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.724889Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3c7b0a93-9cff6707-4031b947-4995281f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:39.724900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:39.724903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:39.724904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:39.724912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:39.724920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:39.724931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:39.725133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.725139Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.725151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:39.725277Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3307 partition: 0 MaxSeqNo: 42 sessionId: src_id|3c7b0a93-9cff6707-4031b947-4995281f_0
2025-09-30T14:59:39.725677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7576e07b-3f401bcd-7b988f3d-171c4e9b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3c7b0a93-9cff6707-4031b947-4995281f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:39.728920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7b0a93-9cff6707-4031b947-4995281f_0] Write session: try to update token
2025-09-30T14:59:39.728946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7b0a93-9cff6707-4031b947-4995281f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:39.740758Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:39.740782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:39.740787Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:39.740789Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:39.740797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897075404482177:13084]
2025-09-30T14:59:39.740801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897075404482177:13084]
2025-09-30T14:59:39.740804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897075404482177:13084]
2025-09-30T14:59:39.740839Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:39.740847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.740849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:39.741005Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:39.743467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:39.743490Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:39.743495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:39.764135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3307 sessionId: src_id|3c7b0a93-9cff6707-4031b947-4995281f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:39.767546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:39.794666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897075494286261:2695]
2025-09-30T14:59:39.795129Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3306, pipe: [1:7555897075494286261:2695]
2025-09-30T14:59:39.858740Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:39.859224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.859297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.859328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494286261:2695], now have 1 active actors on pipe
2025-09-30T14:59:39.861241Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:39.862499Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:39.862604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3307 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3c7b0a93-9cff6707-4031b947-4995281f_0
2025-09-30T14:59:39.862987Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7b0a93-9cff6707-4031b947-4995281f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:39.863000Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7b0a93-9cff6707-4031b947-4995281f_0] Write session will restart in 0.005978s
2025-09-30T14:59:39.863059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7b0a93-9cff6707-4031b947-4995281f_0] Write session: Do CDS request
2025-09-30T14:59:39.863065Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7b0a93-9cff6707-4031b947-4995281f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:39.862801Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3307 sessionId: src_id|3c7b0a93-9cff6707-4031b947-4995281f_0 is DEAD
2025-09-30T14:59:39.862997Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897075494286261:2695]
2025-09-30T14:59:39.863012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:39.869772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7b0a93-9cff6707-4031b947-4995281f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:39.871629Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:39.871647Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3308
2025-09-30T14:59:39.871962Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3308 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:39.871994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3308 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:39.872000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3308 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:39.872004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:39.872967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3308 sessionId:  describe result for acl check
2025-09-30T14:59:39.872995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:39.872997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:39.873000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:39.873005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897075494286286:2619] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:39.873578Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897075494286286:2619] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:39.878253Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897075494286286:2619] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:39.885966Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897075494286286:2619] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:39.885986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897075494286286:2619] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:39.885990Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897075494286286:2619] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:39.885999Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3308 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:39.898828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:39.902143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:39.902419Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:39.902436Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:39.902450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:39.902535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:39.902585Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897075404482334:13086]
2025-09-30T14:59:39.903301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:39.904019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:39.904083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:39.904493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:39.904575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.904581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.904583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.904584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.904586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.904587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.904588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.904590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.904591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.904592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.904594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.904595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.904596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.904597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.904599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.904606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.904617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.904622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.904628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.904633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.904637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.904642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.904646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.904650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.904654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.904658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.904664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.904667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.904671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.904675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.904684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.904701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:39.904708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.904715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:39.904721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.904728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:39.904733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.904739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:39.904745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.904751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:39.904756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.904762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:39.904767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.904773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:39.904778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.904784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:39.904788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.904793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:39.904802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.904807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:39.904812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.904818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.904823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.904829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.904834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.904840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.904845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.904854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:39.904859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.904865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:39.904914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:39.911304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:39.912432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:39.912457Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:39.912461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:39.912481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:39.912489Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3307 [2:7555897075404482334:13086]
2025-09-30T14:59:39.912508Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:39.913565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3307
2025-09-30T14:59:39.913596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3307
2025-09-30T14:59:39.912526Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:39.912538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:39.912543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:39.912545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:39.912561Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:39.912571Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:39.912577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:39.912642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.912644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.912646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.912650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:39.912653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:39.912726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:39.912729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.912747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:39.912760Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:39.912775Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:39.912792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897075404482329:13086]
2025-09-30T14:59:39.912794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897075404482329:13086]
2025-09-30T14:59:39.912796Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897075404482329:13086]
2025-09-30T14:59:39.912809Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:39.912823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:39.912837Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:39.912840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:39.912879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897075404482329:13086]
2025-09-30T14:59:39.912881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:39.913076Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:39.913080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:39.913083Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:39.913089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:39.914397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494286354:2619], now have 1 active actors on pipe
2025-09-30T14:59:39.914410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494286265:2454], now have 1 active actors on pipe
2025-09-30T14:59:39.914429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.914436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.914465Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|11b4493d-f0833d8-ac1806ae-8751c456_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:39.914475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:39.914480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:39.914484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:39.914495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:39.914508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:39.914524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:39.915135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:39.915146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:39.915165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:39.915330Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3308 partition: 0 MaxSeqNo: 42 sessionId: src_id|11b4493d-f0833d8-ac1806ae-8751c456_0
2025-09-30T14:59:39.915712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3c7b0a93-9cff6707-4031b947-4995281f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|11b4493d-f0833d8-ac1806ae-8751c456_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:39.918382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11b4493d-f0833d8-ac1806ae-8751c456_0] Write session: try to update token
2025-09-30T14:59:39.918404Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11b4493d-f0833d8-ac1806ae-8751c456_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:39.941717Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:39.941745Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:39.941748Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:39.941751Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:39.941761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897075404482329:13086]
2025-09-30T14:59:39.941766Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897075404482329:13086]
2025-09-30T14:59:39.941773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897075404482329:13086]
2025-09-30T14:59:39.941823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:39.941831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:39.941833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:39.941841Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:39.941852Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:39.941859Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:39.942018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:39.950760Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3308 sessionId: src_id|11b4493d-f0833d8-ac1806ae-8751c456_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:39.953579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:39.963480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897075494286437:2695]
2025-09-30T14:59:39.964057Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3307, pipe: [1:7555897075494286437:2695]
2025-09-30T14:59:40.103758Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:40.104209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:40.104218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:40.104241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897075494286437:2695], now have 1 active actors on pipe
2025-09-30T14:59:40.104574Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:40.105081Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897075494286437:2695]
2025-09-30T14:59:40.105116Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:40.105119Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:40.105175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3308 reason: error at write: Disconnected sessionId: src_id|11b4493d-f0833d8-ac1806ae-8751c456_0
2025-09-30T14:59:40.105348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3308 sessionId: src_id|11b4493d-f0833d8-ac1806ae-8751c456_0 is DEAD
2025-09-30T14:59:40.105553Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:40.107571Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b4493d-f0833d8-ac1806ae-8751c456_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:40.107585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b4493d-f0833d8-ac1806ae-8751c456_0] Write session will restart in 0.009281s
2025-09-30T14:59:40.107613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b4493d-f0833d8-ac1806ae-8751c456_0] Write session: Do CDS request
2025-09-30T14:59:40.107622Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b4493d-f0833d8-ac1806ae-8751c456_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:40.119920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|11b4493d-f0833d8-ac1806ae-8751c456_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:40.123649Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:40.123666Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3309
2025-09-30T14:59:40.123892Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3309 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:40.123945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3309 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:40.123952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3309 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:40.123959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:40.124435Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3309 sessionId:  describe result for acl check
2025-09-30T14:59:40.124479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:40.124481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:40.124483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:40.124493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897079789253750:2609] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:40.125109Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897079789253750:2609] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:40.127899Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897079789253750:2609] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:40.130815Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897079789253750:2609] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:40.130834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897079789253750:2609] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:40.130838Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897079789253750:2609] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:40.130847Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3309 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:40.173508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:40.176980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:40.177234Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:40.177238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:40.177249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:40.177343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:40.177383Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897079699449783:13088]
2025-09-30T14:59:40.178035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:40.180105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:40.180193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:40.180849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:40.180927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.180928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.180930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.180932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.180933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.180935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.180937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.180938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.180940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.180941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.180943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.180945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.180946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.180948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.180949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.180957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.180969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.180974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.180979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.180984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.180989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.180993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.180998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.181002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.181007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.181012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.181016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.181020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.181024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.181029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.181037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.181046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.181054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.181060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.181067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.181073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.181078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.181085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.181090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.181097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.181102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.181109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.181115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.181121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.181126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.181132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.181137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.181143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.181148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.181154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.181160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.181166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.181172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.181178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.181186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.181191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.181197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.181203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.181207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.181213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.181262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:40.192506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:40.193799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:40.193806Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:40.193809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:40.193817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:40.193825Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3308 [2:7555897079699449783:13088]
2025-09-30T14:59:40.193845Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:40.193864Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:40.193867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:40.193870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:40.193872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:40.193890Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:40.193899Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:40.193906Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:40.193974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.193976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.193978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.193982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:40.193984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:40.194063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:40.194066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.194081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.194095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.194114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:40.194131Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897079699449778:13088]
2025-09-30T14:59:40.194134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897079699449778:13088]
2025-09-30T14:59:40.194136Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897079699449778:13088]
2025-09-30T14:59:40.194148Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:40.194163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:40.194179Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:40.194182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:40.194185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:40.194190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:40.194191Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:40.194226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897079789253736:2454], now have 1 active actors on pipe
2025-09-30T14:59:40.194231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897079789253785:2609], now have 1 active actors on pipe
2025-09-30T14:59:40.194233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897079699449778:13088]
2025-09-30T14:59:40.194244Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:40.194273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:40.195469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:40.195488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:40.195517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:40.195527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:40.195531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:40.195534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:40.195545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:40.195559Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:40.195579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:40.195149Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3308
2025-09-30T14:59:40.195194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3308
2025-09-30T14:59:40.196230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3309 partition: 0 MaxSeqNo: 42 sessionId: src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0
2025-09-30T14:59:40.196636Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|11b4493d-f0833d8-ac1806ae-8751c456_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:40.196035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:40.196051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:40.196073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:40.199537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0] Write session: try to update token
2025-09-30T14:59:40.199558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:40.206807Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897079789253895:2695]
2025-09-30T14:59:40.207425Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3308, pipe: [1:7555897079789253895:2695]
2025-09-30T14:59:40.207323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897079789253895:2695], now have 1 active actors on pipe
2025-09-30T14:59:40.211861Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:40.211885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:40.211888Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:40.211890Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:40.211899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897079699449778:13088]
2025-09-30T14:59:40.211903Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897079699449778:13088]
2025-09-30T14:59:40.211908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897079699449778:13088]
2025-09-30T14:59:40.211949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:40.211956Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.211964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:40.212110Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:40.215672Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:40.215690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:40.215695Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:40.229735Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3309 sessionId: src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:40.232620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:40.383108Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:40.383598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:40.383608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:40.383939Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:40.384600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:40.384613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0] Write session will restart in 0.006590s
2025-09-30T14:59:40.384639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0] Write session: Do CDS request
2025-09-30T14:59:40.384654Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:40.384092Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:40.384113Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:40.384118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:40.384164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897079789253895:2695]
2025-09-30T14:59:40.384182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3309 reason: error at write: Disconnected sessionId: src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0
2025-09-30T14:59:40.384403Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3309 sessionId: src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0 is DEAD
2025-09-30T14:59:40.395824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:40.395953Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:40.395973Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3310
2025-09-30T14:59:40.396184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3310 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:40.396223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3310 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:40.396234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3310 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:40.396242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:40.396699Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3310 sessionId:  describe result for acl check
2025-09-30T14:59:40.396735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:40.396741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:40.396744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:40.396751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897079789253923:2586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:40.397320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897079789253923:2586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:40.405239Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897079789253923:2586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:40.421055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897079789253923:2586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:40.421078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897079789253923:2586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:40.421082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897079789253923:2586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:40.421092Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3310 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:40.423466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:40.427517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:40.428068Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:40.428085Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:40.428102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:40.428196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:40.428249Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897079699449939:13091]
2025-09-30T14:59:40.428918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:40.430154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:40.430223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:40.430626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:40.430688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.430690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.430691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.430693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.430694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.430696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.430698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.430700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.430701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.430703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.430704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.430706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.430708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.430709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.430711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.430719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.430730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.430735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.430740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.430744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.430749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.430754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.430758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.430763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.430769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.430774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.430778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.430783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.430788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.430792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.430803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.430812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.430818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.430826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.430832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.430838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.430843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.430849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.430855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.430861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.430866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.430872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.430879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.430885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.430889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.430895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.430900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.430906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.430911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.430917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.430922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.430929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.430934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.430940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.430949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.430954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.430959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.430965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.430970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.430976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.431039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:40.439319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:40.440603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:40.440615Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:40.440618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:40.440622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:40.440634Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3309 [2:7555897079699449939:13091]
2025-09-30T14:59:40.440656Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:40.440676Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:40.440680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:40.440683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:40.440686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:40.440703Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:40.440711Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:40.440732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:40.440809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.440811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.440813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.440817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:40.440820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:40.440897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:40.440900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.440914Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.440927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.440945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:40.440968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897079699449933:13091]
2025-09-30T14:59:40.440971Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897079699449933:13091]
2025-09-30T14:59:40.440972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897079699449933:13091]
2025-09-30T14:59:40.440988Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:40.441002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:40.442150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3309
2025-09-30T14:59:40.442189Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3309
2025-09-30T14:59:40.446637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3310 partition: 0 MaxSeqNo: 42 sessionId: src_id|90b2676c-e69b3b46-863329b3-629ba412_0
2025-09-30T14:59:40.441019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:40.441028Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:40.441071Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897079699449933:13091]
2025-09-30T14:59:40.441073Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:40.441327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:40.441331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:40.441333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:40.441339Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:40.444091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897079789254059:2586], now have 1 active actors on pipe
2025-09-30T14:59:40.444100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897079789253905:2454], now have 1 active actors on pipe
2025-09-30T14:59:40.444120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:40.444129Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:40.444170Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|90b2676c-e69b3b46-863329b3-629ba412_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:40.444182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:40.444187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:40.444191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:40.444207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:40.444223Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:40.444242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:40.446410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:40.446421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:40.446451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:40.450885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aa427a23-57eb4f1f-54dbfea3-293b589f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|90b2676c-e69b3b46-863329b3-629ba412_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:40.453893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2676c-e69b3b46-863329b3-629ba412_0] Write session: try to update token
2025-09-30T14:59:40.453926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2676c-e69b3b46-863329b3-629ba412_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:40.460419Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:40.460445Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:40.460448Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:40.460451Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:40.460479Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897079699449933:13091]
2025-09-30T14:59:40.460485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897079699449933:13091]
2025-09-30T14:59:40.460489Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897079699449933:13091]
2025-09-30T14:59:40.460536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:40.460551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.460554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:40.460706Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:40.462641Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:40.462660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:40.462669Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:40.484295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897079789254075:2695]
2025-09-30T14:59:40.484685Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3309, pipe: [1:7555897079789254075:2695]
2025-09-30T14:59:40.491340Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3310 sessionId: src_id|90b2676c-e69b3b46-863329b3-629ba412_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:40.494280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:40.584404Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:40.584787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897079789254075:2695], now have 1 active actors on pipe
2025-09-30T14:59:40.584827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:40.584839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:40.585188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897079789254075:2695]
2025-09-30T14:59:40.585231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:40.585234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:40.585299Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3310 reason: error at write: Disconnected sessionId: src_id|90b2676c-e69b3b46-863329b3-629ba412_0
2025-09-30T14:59:40.585480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3310 sessionId: src_id|90b2676c-e69b3b46-863329b3-629ba412_0 is DEAD
2025-09-30T14:59:40.585623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:40.585147Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:40.587370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2676c-e69b3b46-863329b3-629ba412_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:40.587382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2676c-e69b3b46-863329b3-629ba412_0] Write session will restart in 0.005854s
2025-09-30T14:59:40.587406Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2676c-e69b3b46-863329b3-629ba412_0] Write session: Do CDS request
2025-09-30T14:59:40.587415Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2676c-e69b3b46-863329b3-629ba412_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:40.594911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2676c-e69b3b46-863329b3-629ba412_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:40.595292Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:40.595310Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3311
2025-09-30T14:59:40.595462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3311 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:40.595494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3311 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:40.595499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3311 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:40.595504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:40.596441Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3311 sessionId:  describe result for acl check
2025-09-30T14:59:40.596491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:40.596492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:40.596494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:40.596500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897079789254102:2554] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:40.597067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897079789254102:2554] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:40.606812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897079789254102:2554] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:40.616859Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897079789254102:2554] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:40.616879Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897079789254102:2554] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:40.616882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897079789254102:2554] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:40.616890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3311 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:40.625304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:40.628514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:40.628744Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:40.628749Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:40.628759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:40.628805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:40.628843Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897079699450122:13100]
2025-09-30T14:59:40.629578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:40.637964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:40.638057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:40.638497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:40.638581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.638588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.638590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.638592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.638593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.638595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.638596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.638597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.638599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.638600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.638602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.638604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.638605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.638607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.638609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.638615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.638625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.638630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.638634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.638638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.638643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.638647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.638651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.638655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.638660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.638665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.638669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.638673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.638677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.638681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.638690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.638698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.638705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.638711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.638716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.638722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.638727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.638732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.638738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.638746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.638752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.638763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.638768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.638775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.638784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.638790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.638801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.638806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.638811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.638816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.638827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.638832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.638843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.638848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.638858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.638864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.638873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.638879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.638885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.638890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.638936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:40.651914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:40.654000Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3310
2025-09-30T14:59:40.654002Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3310
2025-09-30T14:59:40.653074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:40.653098Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:40.653101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:40.653107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:40.653114Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3310 [2:7555897079699450122:13100]
2025-09-30T14:59:40.653133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:40.653153Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:40.653157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:40.653161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:40.653163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:40.653183Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:40.653191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:40.653200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:40.653279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.653281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.653287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.653290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:40.653293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:40.653369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:40.653372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.653387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.653398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.653413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:40.653431Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897079699450112:13100]
2025-09-30T14:59:40.653436Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897079699450112:13100]
2025-09-30T14:59:40.653438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897079699450112:13100]
2025-09-30T14:59:40.653454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:40.653469Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:40.653483Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:40.653486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:40.653528Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897079699450112:13100]
2025-09-30T14:59:40.653530Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:40.653699Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:40.653701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:40.653704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:40.653711Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:40.653884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897079789254222:2554], now have 1 active actors on pipe
2025-09-30T14:59:40.653893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897079789254078:2454], now have 1 active actors on pipe
2025-09-30T14:59:40.654359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:40.654370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:40.654409Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|57152c7f-a89d9637-13b14f44-5c347d04_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:40.654422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:40.654447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:40.654451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:40.654467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:40.654496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:40.654518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:40.654714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:40.654736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:40.654758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:40.655051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3311 partition: 0 MaxSeqNo: 42 sessionId: src_id|57152c7f-a89d9637-13b14f44-5c347d04_0
2025-09-30T14:59:40.659377Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|90b2676c-e69b3b46-863329b3-629ba412_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|57152c7f-a89d9637-13b14f44-5c347d04_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:40.662501Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57152c7f-a89d9637-13b14f44-5c347d04_0] Write session: try to update token
2025-09-30T14:59:40.662532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57152c7f-a89d9637-13b14f44-5c347d04_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:40.669878Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:40.669903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:40.669906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:40.669908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:40.669918Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897079699450112:13100]
2025-09-30T14:59:40.669922Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897079699450112:13100]
2025-09-30T14:59:40.669926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897079699450112:13100]
2025-09-30T14:59:40.669967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:40.669974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.669977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:40.669989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:40.669997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:40.670001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:40.670119Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:40.683641Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897079789254263:2695]
2025-09-30T14:59:40.684554Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3310, pipe: [1:7555897079789254263:2695]
2025-09-30T14:59:40.719989Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3311 sessionId: src_id|57152c7f-a89d9637-13b14f44-5c347d04_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:40.725368Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:40.821177Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:40.822267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897079789254263:2695], now have 1 active actors on pipe
2025-09-30T14:59:40.822308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:40.822316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:40.823439Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57152c7f-a89d9637-13b14f44-5c347d04_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:40.823451Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57152c7f-a89d9637-13b14f44-5c347d04_0] Write session will restart in 0.009043s
2025-09-30T14:59:40.823475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57152c7f-a89d9637-13b14f44-5c347d04_0] Write session: Do CDS request
2025-09-30T14:59:40.823481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57152c7f-a89d9637-13b14f44-5c347d04_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:40.823485Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:40.822981Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897079789254263:2695]
2025-09-30T14:59:40.822981Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:40.822986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:40.823012Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:40.823050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3311 reason: error at write: Disconnected sessionId: src_id|57152c7f-a89d9637-13b14f44-5c347d04_0
2025-09-30T14:59:40.823266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3311 sessionId: src_id|57152c7f-a89d9637-13b14f44-5c347d04_0 is DEAD
2025-09-30T14:59:40.837908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|57152c7f-a89d9637-13b14f44-5c347d04_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:40.840854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:40.840871Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3312
2025-09-30T14:59:40.841305Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3312 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:40.841348Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3312 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:40.841353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3312 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:40.841357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:40.841762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3312 sessionId:  describe result for acl check
2025-09-30T14:59:40.841789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:40.841792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:40.841811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:40.841818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897079789254358:2548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:40.842353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897079789254358:2548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:40.845126Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897079789254358:2548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:40.847454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:40.850330Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897079789254358:2548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:40.850347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897079789254358:2548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:40.850351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897079789254358:2548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:40.850363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3312 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:40.850117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:40.850465Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:40.850470Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:40.850485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:40.850555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:40.850589Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897079699450298:13109]
2025-09-30T14:59:40.851308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:40.851693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:40.851761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:40.852129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:40.852201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.852210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.852211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.852212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.852213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.852214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.852215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.852216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.852217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.852218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.852219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.852221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.852222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.852223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.852223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.852230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.852240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.852244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.852248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.852251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.852255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.852259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.852263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.852267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.852271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.852274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.852278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.852281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.852285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.852291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.852298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.852306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:40.852312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.852317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:40.852322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.852327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:40.852330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.852335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:40.852340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.852345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:40.852350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.852355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:40.852359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.852364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:40.852368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.852373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:40.852378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.852384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:40.852388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.852394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:40.852399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.852405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.852410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.852416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.852421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.852426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.852441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.852446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:40.852452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.852458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:40.852517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:40.859018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:40.860116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:40.860132Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:40.860136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:40.860140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:40.860153Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3311 [2:7555897079699450298:13109]
2025-09-30T14:59:40.860172Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:40.860191Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:40.860196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:40.860200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:40.860203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:40.860220Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:40.860228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:40.860235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:40.860305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.860312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.860315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.860319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:40.860323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:40.860405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:40.860409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.860426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:40.860441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:40.860474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:40.860497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897079789254419:2548], now have 1 active actors on pipe
2025-09-30T14:59:40.860504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897079699450292:13109]
2025-09-30T14:59:40.860506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897079699450292:13109]
2025-09-30T14:59:40.860509Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897079699450292:13109]
2025-09-30T14:59:40.860524Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:40.860535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897079789254266:2454], now have 1 active actors on pipe
2025-09-30T14:59:40.860540Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:40.860544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:40.860553Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:40.860558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:40.860560Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:40.860563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:40.860601Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897079699450292:13109]
2025-09-30T14:59:40.860615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:40.860620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3311
2025-09-30T14:59:40.860630Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3311
2025-09-30T14:59:40.860657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:40.860917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:40.860931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:40.860961Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b789c032-7a90b775-276d66c7-13af2e71_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:40.860991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:40.860999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:40.861002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:40.861013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:40.861024Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:40.861048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:40.861504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:40.861514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:40.861533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:40.861659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3312 partition: 0 MaxSeqNo: 42 sessionId: src_id|b789c032-7a90b775-276d66c7-13af2e71_0
2025-09-30T14:59:40.862594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|57152c7f-a89d9637-13b14f44-5c347d04_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b789c032-7a90b775-276d66c7-13af2e71_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:40.865490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b789c032-7a90b775-276d66c7-13af2e71_0] Write session: try to update token
2025-09-30T14:59:40.865514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b789c032-7a90b775-276d66c7-13af2e71_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:40.876387Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:40.876406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:40.876417Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897079699450292:13109]
2025-09-30T14:59:40.876485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:40.876708Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:40.876916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:40.877067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:40.877219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:40.877417Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:40.877453Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:40.877717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:40.889492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3312 sessionId: src_id|b789c032-7a90b775-276d66c7-13af2e71_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:40.890372Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:40.890391Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:40.890393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:40.890395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:40.890406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897079699450292:13109]
2025-09-30T14:59:40.890411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897079699450292:13109]
2025-09-30T14:59:40.890416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897079699450292:13109]
2025-09-30T14:59:40.890460Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:40.890467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:40.890470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:40.890560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:40.890575Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:40.890580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:40.890621Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:40.892457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:40.923168Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897079789254444:2695]
2025-09-30T14:59:40.923601Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3311, pipe: [1:7555897079789254444:2695]
2025-09-30T14:59:41.016100Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:41.016445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.016455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.016491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897079789254444:2695], now have 1 active actors on pipe
2025-09-30T14:59:41.016771Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:41.016802Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:41.019360Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b789c032-7a90b775-276d66c7-13af2e71_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:41.019379Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b789c032-7a90b775-276d66c7-13af2e71_0] Write session will restart in 0.005567s
2025-09-30T14:59:41.019405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b789c032-7a90b775-276d66c7-13af2e71_0] Write session: Do CDS request
2025-09-30T14:59:41.019411Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b789c032-7a90b775-276d66c7-13af2e71_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:41.016820Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:41.016885Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3312 reason: error at write: Disconnected sessionId: src_id|b789c032-7a90b775-276d66c7-13af2e71_0
2025-09-30T14:59:41.017067Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3312 sessionId: src_id|b789c032-7a90b775-276d66c7-13af2e71_0 is DEAD
2025-09-30T14:59:41.017201Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:41.017235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897079789254444:2695]
2025-09-30T14:59:41.027822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b789c032-7a90b775-276d66c7-13af2e71_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:41.028365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:41.028386Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3313
2025-09-30T14:59:41.029431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3313 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:41.029475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3313 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:41.029481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3313 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:41.029496Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:41.030591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3313 sessionId:  describe result for acl check
2025-09-30T14:59:41.030617Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:41.030618Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:41.030620Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:41.030625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897084084221754:2536] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:41.031142Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897084084221754:2536] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:41.036509Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897084084221754:2536] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:41.042565Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897084084221754:2536] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:41.042587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897084084221754:2536] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:41.042591Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897084084221754:2536] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:41.042601Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3313 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:41.056326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:41.060689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:41.060978Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:41.060989Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:41.061003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:41.061073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:41.061122Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897083994417754:13111]
2025-09-30T14:59:41.061781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:41.063231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:41.063322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:41.063760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:41.063863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.063870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.063872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.063874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.063875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.063877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.063878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.063880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.063882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.063884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.063885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.063887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.063888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.063889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.063891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.063898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.063908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.063912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.063917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.063921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.063937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.063941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.063946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.063950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.063954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.063957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.063961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.063964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.063968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.063971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.063981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.063998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.064005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.064011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.064017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.064022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.064026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.064032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.064038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.064054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.064059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.064064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.064071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.064076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.064081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.064086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.064091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.064096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.064100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.064106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.064111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.064124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.064129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.064135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.064140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.064152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.064157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.064163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.064170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.064180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.064226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:41.070297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:41.071724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:41.071742Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:41.071745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:41.071750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:41.071758Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3312 [2:7555897083994417754:13111]
2025-09-30T14:59:41.071779Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:41.071802Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:41.071811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:41.071814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:41.071816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:41.071837Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:41.071850Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:41.071868Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:41.071949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.071958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.071960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.071965Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:41.071968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:41.072384Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3312
2025-09-30T14:59:41.072441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3312
2025-09-30T14:59:41.072519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:41.072538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.072554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.072573Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.072591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:41.072622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084221745:2454], now have 1 active actors on pipe
2025-09-30T14:59:41.072630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084221822:2536], now have 1 active actors on pipe
2025-09-30T14:59:41.072647Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897083994417749:13111]
2025-09-30T14:59:41.072657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897083994417749:13111]
2025-09-30T14:59:41.072660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897083994417749:13111]
2025-09-30T14:59:41.072682Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:41.072689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:41.072693Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:41.072696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:41.072700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:41.072717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:41.072721Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:41.072740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.072745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.072792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897083994417749:13111]
2025-09-30T14:59:41.072805Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:41.072823Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|70a7087-f5366698-93ad5b18-3b3e025f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:41.072827Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:41.072835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:41.072840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:41.072842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:41.072854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:41.072870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:41.073045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:41.073731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.073744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.073767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:41.073889Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3313 partition: 0 MaxSeqNo: 42 sessionId: src_id|70a7087-f5366698-93ad5b18-3b3e025f_0
2025-09-30T14:59:41.074355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b789c032-7a90b775-276d66c7-13af2e71_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|70a7087-f5366698-93ad5b18-3b3e025f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:41.077693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70a7087-f5366698-93ad5b18-3b3e025f_0] Write session: try to update token
2025-09-30T14:59:41.077717Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70a7087-f5366698-93ad5b18-3b3e025f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:41.089263Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:41.089283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:41.089286Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:41.089288Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:41.089299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897083994417749:13111]
2025-09-30T14:59:41.089305Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897083994417749:13111]
2025-09-30T14:59:41.089310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897083994417749:13111]
2025-09-30T14:59:41.089353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:41.089360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.089363Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:41.089375Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:41.089381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:41.089386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:41.089514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:41.097418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3313 sessionId: src_id|70a7087-f5366698-93ad5b18-3b3e025f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:41.100724Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:41.117169Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897084084221914:2695]
2025-09-30T14:59:41.117465Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3312, pipe: [1:7555897084084221914:2695]
2025-09-30T14:59:41.211872Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:41.212345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.212362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.212408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084221914:2695], now have 1 active actors on pipe
2025-09-30T14:59:41.212669Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:41.213054Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897084084221914:2695]
2025-09-30T14:59:41.213083Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:41.213128Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:41.213134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:41.213195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3313 reason: error at write: Disconnected sessionId: src_id|70a7087-f5366698-93ad5b18-3b3e025f_0
2025-09-30T14:59:41.213371Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3313 sessionId: src_id|70a7087-f5366698-93ad5b18-3b3e025f_0 is DEAD
2025-09-30T14:59:41.217254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a7087-f5366698-93ad5b18-3b3e025f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:41.217267Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a7087-f5366698-93ad5b18-3b3e025f_0] Write session will restart in 0.006025s
2025-09-30T14:59:41.217292Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a7087-f5366698-93ad5b18-3b3e025f_0] Write session: Do CDS request
2025-09-30T14:59:41.217302Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a7087-f5366698-93ad5b18-3b3e025f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:41.224843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|70a7087-f5366698-93ad5b18-3b3e025f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:41.224933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:41.224951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3314
2025-09-30T14:59:41.225120Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3314 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:41.225163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3314 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:41.225168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3314 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:41.225175Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:41.225645Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3314 sessionId:  describe result for acl check
2025-09-30T14:59:41.225683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:41.225690Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:41.225692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:41.225698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897084084222033:2513] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:41.226241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897084084222033:2513] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:41.227153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:41.228180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897084084222033:2513] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:41.229305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:41.229510Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:41.229514Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:41.229523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:41.229573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:41.229611Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897083994417912:13114]
2025-09-30T14:59:41.230318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:41.230617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:41.230668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:41.230967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897084084222033:2513] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:41.230984Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897084084222033:2513] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:41.230987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897084084222033:2513] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:41.231001Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3314 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:41.231018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:41.231099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.231106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.231108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.231109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.231110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.231111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.231113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.231114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.231116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.231118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.231119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.231120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.231122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.231123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.231125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.231132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.231143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.231147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.231151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.231170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.231174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.231179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.231183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.231188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.231192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.231196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.231201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.231205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.231216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.231220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.231228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.231258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.231266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.231278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.231289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.231296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.231300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.231306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.231311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.231317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.231323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.231340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.231352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.231358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.231367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.231371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.231376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.231381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.231387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.231393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.231401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.231406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.231411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.231422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.231427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.231438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.231443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.231449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.231460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.231465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.231518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:41.237165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:41.238106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:41.238121Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:41.238125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:41.238130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:41.238137Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3313 [2:7555897083994417912:13114]
2025-09-30T14:59:41.238156Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:41.238174Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:41.238182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:41.238186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:41.238188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:41.238204Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:41.238212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:41.238219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:41.238281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.238288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.238291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.238295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:41.238298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:41.238382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:41.238389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.238404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.238421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.238443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:41.238478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084221917:2454], now have 1 active actors on pipe
2025-09-30T14:59:41.238486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222072:2513], now have 1 active actors on pipe
2025-09-30T14:59:41.238496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897083994417907:13114]
2025-09-30T14:59:41.238502Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897083994417907:13114]
2025-09-30T14:59:41.238504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897083994417907:13114]
2025-09-30T14:59:41.238519Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:41.238539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:41.238546Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:41.238551Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:41.238554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:41.238558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:41.238567Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:41.238583Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3313
2025-09-30T14:59:41.238591Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3313
2025-09-30T14:59:41.238606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897083994417907:13114]
2025-09-30T14:59:41.238614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:41.238629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:41.238639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.238645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.238681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:41.238689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:41.238692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:41.238695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:41.238905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:41.238927Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:41.238961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:41.239155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.239163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.239179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:41.242165Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3314 partition: 0 MaxSeqNo: 42 sessionId: src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0
2025-09-30T14:59:41.242576Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|70a7087-f5366698-93ad5b18-3b3e025f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:41.245906Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0] Write session: try to update token
2025-09-30T14:59:41.245930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:41.259830Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:41.259848Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:41.259850Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:41.259852Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:41.259862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897083994417907:13114]
2025-09-30T14:59:41.259868Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897083994417907:13114]
2025-09-30T14:59:41.259873Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897083994417907:13114]
2025-09-30T14:59:41.259915Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:41.259924Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.259922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:41.259927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:41.259930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:41.259936Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:41.260074Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:41.264714Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3314 sessionId: src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:41.268033Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:41.312730Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897084084222081:2695]
2025-09-30T14:59:41.313052Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3313, pipe: [1:7555897084084222081:2695]
2025-09-30T14:59:41.379368Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:41.379841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.379853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.379897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222081:2695], now have 1 active actors on pipe
2025-09-30T14:59:41.380210Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:41.380282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:41.380310Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:41.380377Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3314 reason: error at write: Disconnected sessionId: src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0
2025-09-30T14:59:41.380592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3314 sessionId: src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0 is DEAD
2025-09-30T14:59:41.380670Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:41.380717Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897084084222081:2695]
2025-09-30T14:59:41.385627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:41.385645Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0] Write session will restart in 0.008891s
2025-09-30T14:59:41.385676Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0] Write session: Do CDS request
2025-09-30T14:59:41.385687Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:41.395978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:41.396197Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:41.396218Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3315
2025-09-30T14:59:41.396378Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3315 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:41.396429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3315 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:41.396440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3315 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:41.396445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:41.396997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3315 sessionId:  describe result for acl check
2025-09-30T14:59:41.397043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:41.397046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:41.397048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:41.397054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897084084222206:2468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:41.397664Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897084084222206:2468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:41.399456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:41.400156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897084084222206:2468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:41.402253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:41.402592Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:41.402603Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:41.402615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:41.402676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:41.402724Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897083994418070:13116]
2025-09-30T14:59:41.403332Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897084084222206:2468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:41.403353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897084084222206:2468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:41.403357Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897084084222206:2468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:41.403367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3315 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:41.403436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:41.403867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:41.403951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:41.404318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:41.404420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.404428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.404430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.404431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.404432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.404434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.404435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.404437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.404438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.404439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.404441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.404442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.404444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.404445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.404447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.404454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.404480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.404484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.404489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.404493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.404497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.404501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.404506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.404510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.404516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.404520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.404523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.404527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.404531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.404535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.404544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.404552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.404559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.404565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.404570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.404576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.404580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.404586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.404594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.404599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.404605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.404611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.404616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.404620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.404625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.404629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.404634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.404650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.404654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.404659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.404663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.404668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.404672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.404676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.404680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.404699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.404703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.404708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.404713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.404717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.404757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:41.410871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:41.412193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:41.412215Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:41.412219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:41.412223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:41.412232Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3314 [2:7555897083994418070:13116]
2025-09-30T14:59:41.412252Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:41.412271Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:41.412275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:41.412279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:41.412282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:41.412301Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:41.412313Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:41.412323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:41.412399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.412430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.412436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.412440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:41.412443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:41.412530Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:41.412538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.412552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.412563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.412578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:41.412604Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897083994418065:13116]
2025-09-30T14:59:41.412606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897083994418065:13116]
2025-09-30T14:59:41.412609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897083994418065:13116]
2025-09-30T14:59:41.412618Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:41.412634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:41.412648Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:41.412652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:41.412655Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:41.412657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:41.412659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:41.412703Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222244:2468], now have 1 active actors on pipe
2025-09-30T14:59:41.412713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222089:2454], now have 1 active actors on pipe
2025-09-30T14:59:41.412715Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897083994418065:13116]
2025-09-30T14:59:41.412723Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:41.412785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3314
2025-09-30T14:59:41.412787Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3314
2025-09-30T14:59:41.412753Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:41.412904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.412914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.412949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:41.412979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:41.412988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:41.412991Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:41.413003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:41.413019Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:41.413163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:41.413399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.413411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.413430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:41.413530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3315 partition: 0 MaxSeqNo: 42 sessionId: src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0
2025-09-30T14:59:41.413988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a37eb81f-1a73e62c-504ff860-6a67e99a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:41.417348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0] Write session: try to update token
2025-09-30T14:59:41.417374Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:41.434308Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:41.434327Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:41.434339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897083994418065:13116]
2025-09-30T14:59:41.434395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:41.434414Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:41.434594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:41.434790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:41.434969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:41.435135Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:41.435381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:41.435450Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:41.439684Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:41.439705Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:41.439707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:41.439722Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:41.439733Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897083994418065:13116]
2025-09-30T14:59:41.439738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897083994418065:13116]
2025-09-30T14:59:41.439744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897083994418065:13116]
2025-09-30T14:59:41.439790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:41.439801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.439805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:41.439958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:41.440093Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:41.440106Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:41.440111Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:41.441160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3315 sessionId: src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:41.444271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:41.481225Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897084084222259:2695]
2025-09-30T14:59:41.481616Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3314, pipe: [1:7555897084084222259:2695]
2025-09-30T14:59:41.557948Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:41.558328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.558342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.558366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222259:2695], now have 1 active actors on pipe
2025-09-30T14:59:41.558757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:41.558759Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897084084222259:2695]
2025-09-30T14:59:41.558784Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:41.558856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3315 reason: status is not ok: tablet will be restarted right now sessionId: src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0
2025-09-30T14:59:41.559053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3315 sessionId: src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0 is DEAD
2025-09-30T14:59:41.558593Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:41.559600Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:41.559608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0] Write session will restart in 0.008378s
2025-09-30T14:59:41.559632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0] Write session: Do CDS request
2025-09-30T14:59:41.559639Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:41.568815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:41.568985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:41.569002Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3316
2025-09-30T14:59:41.569370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3316 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:41.569424Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3316 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:41.569436Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3316 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:41.569442Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:41.569977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3316 sessionId:  describe result for acl check
2025-09-30T14:59:41.570019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:41.570022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:41.570024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:41.570030Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897084084222292:2478] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:41.570593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897084084222292:2478] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:41.573568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897084084222292:2478] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:41.579201Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897084084222292:2478] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:41.579222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897084084222292:2478] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:41.579226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897084084222292:2478] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:41.576121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:41.579241Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3316 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:41.578964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:41.579266Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:41.579271Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:41.579284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:41.579353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:41.579396Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897083994418244:13120]
2025-09-30T14:59:41.580086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:41.580782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:41.580819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:41.581093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:41.581138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.581139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.581140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.581141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.581143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.581144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.581145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.581146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.581147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.581148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.581149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.581150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.581151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.581151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.581152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.581157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.581164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.581167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.581169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.581172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.581174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.581177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.581180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.581182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.581185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.581187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.581190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.581192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.581195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.581197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.581202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.581220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.581224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.581228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.581232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.581235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.581238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.581242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.581246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.581253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.581259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.581264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.581270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.581276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.581281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.581287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.581290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.581293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.581295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.581299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.581303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.581307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.581310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.581313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.581316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.581320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.581323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.581326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.581329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.581335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.581365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:41.588371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:41.589710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:41.589730Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:41.589733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:41.589736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:41.589744Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3315 [2:7555897083994418244:13120]
2025-09-30T14:59:41.589763Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:41.589780Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:41.589783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:41.589787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:41.589789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:41.589807Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:41.589813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:41.589835Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:41.589909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.589918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.589921Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.589925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:41.589928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:41.590004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:41.590012Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.590025Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.590036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.590054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:41.590076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897083994418239:13120]
2025-09-30T14:59:41.590087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897083994418239:13120]
2025-09-30T14:59:41.590090Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897083994418239:13120]
2025-09-30T14:59:41.590102Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:41.590118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222261:2454], now have 1 active actors on pipe
2025-09-30T14:59:41.590122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222417:2478], now have 1 active actors on pipe
2025-09-30T14:59:41.590131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:41.590135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:41.590139Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:41.590142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:41.590151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:41.590154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:41.590190Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897083994418239:13120]
2025-09-30T14:59:41.590205Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:41.590225Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:41.590239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3315
2025-09-30T14:59:41.590250Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3315
2025-09-30T14:59:41.590345Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.590355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.590380Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:41.590393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:41.590396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:41.590399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:41.590410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:41.590427Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:41.590448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:41.590689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.590706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.590733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:41.590836Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3316 partition: 0 MaxSeqNo: 42 sessionId: src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0
2025-09-30T14:59:41.595433Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|82ee1aa9-f0db800b-52b0ed-de11bc4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:41.598700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0] Write session: try to update token
2025-09-30T14:59:41.598732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:41.608269Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:41.608299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:41.608303Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:41.608305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:41.608316Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897083994418239:13120]
2025-09-30T14:59:41.608320Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897083994418239:13120]
2025-09-30T14:59:41.608326Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897083994418239:13120]
2025-09-30T14:59:41.608374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:41.608381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.608384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:41.608385Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:41.608393Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:41.608398Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:41.608571Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:41.621553Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3316 sessionId: src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:41.624993Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:41.658819Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897084084222442:2695]
2025-09-30T14:59:41.659153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3315, pipe: [1:7555897084084222442:2695]
2025-09-30T14:59:41.726427Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:41.726839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.726854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.726893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222442:2695], now have 1 active actors on pipe
2025-09-30T14:59:41.727080Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:41.727175Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:41.727188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:41.727238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897084084222442:2695]
2025-09-30T14:59:41.727289Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3316 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0
2025-09-30T14:59:41.727511Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3316 sessionId: src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0 is DEAD
2025-09-30T14:59:41.727701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:41.727714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0] Write session will restart in 0.007141s
2025-09-30T14:59:41.727742Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0] Write session: Do CDS request
2025-09-30T14:59:41.727750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:41.735825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:41.735971Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:41.736006Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3317
2025-09-30T14:59:41.736160Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3317 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:41.736196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3317 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:41.736208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3317 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:41.736213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:41.736775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3317 sessionId:  describe result for acl check
2025-09-30T14:59:41.736816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:41.736818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:41.736820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:41.736827Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897084084222477:2450] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:41.737472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897084084222477:2450] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:41.739793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897084084222477:2450] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:41.744340Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897084084222477:2450] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:41.744361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897084084222477:2450] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:41.744366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897084084222477:2450] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:41.744376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3317 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:41.746527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:41.749048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:41.749394Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:41.749407Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:41.749420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:41.749484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:41.749536Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897083994418442:13136]
2025-09-30T14:59:41.750264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:41.751631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:41.751709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:41.752125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:41.752191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.752193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.752195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.752196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.752198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.752199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.752209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.752211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.752213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.752214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.752215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.752216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.752218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.752219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.752220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.752227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.752239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.752243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.752248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.752252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.752257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.752261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.752265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.752269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.752274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.752278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.752282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.752285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.752289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.752293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.752302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.752314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.752321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.752328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.752334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.752340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.752345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.752351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.752357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.752364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.752368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.752374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.752380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.752385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.752390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.752396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.752401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.752407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.752412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.752418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.752423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.752428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.752432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.752437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.752443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.752448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.752453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.752469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.752477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.752483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.752543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:41.760512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:41.761720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:41.761737Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:41.761740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:41.761744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:41.761751Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3316 [2:7555897083994418442:13136]
2025-09-30T14:59:41.761771Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:41.761789Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:41.761792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:41.761796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:41.761798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:41.761816Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:41.761824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:41.761832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:41.761916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.761925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.761929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.761933Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:41.761936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:41.762009Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:41.762017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.762032Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.762049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.762073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:41.762100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222607:2450], now have 1 active actors on pipe
2025-09-30T14:59:41.762107Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897083994418437:13136]
2025-09-30T14:59:41.762109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897083994418437:13136]
2025-09-30T14:59:41.762111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897083994418437:13136]
2025-09-30T14:59:41.762125Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:41.762136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222456:2454], now have 1 active actors on pipe
2025-09-30T14:59:41.762142Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:41.762144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:41.762145Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:41.762147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:41.762160Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:41.762167Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:41.762210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897083994418437:13136]
2025-09-30T14:59:41.762220Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:41.762245Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:41.762374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.762386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.762413Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b3f89daf-7057a839-a4f47685-87d4d051_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:41.762425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:41.762431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:41.762439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:41.762450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:41.762466Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:41.762483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:41.762783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.762793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.762808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:41.762237Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3316
2025-09-30T14:59:41.762231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3316
2025-09-30T14:59:41.762951Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3317 partition: 0 MaxSeqNo: 42 sessionId: src_id|b3f89daf-7057a839-a4f47685-87d4d051_0
2025-09-30T14:59:41.763362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f841eda9-1cedfc4f-b9d9fec4-7605458c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b3f89daf-7057a839-a4f47685-87d4d051_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:41.766480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f89daf-7057a839-a4f47685-87d4d051_0] Write session: try to update token
2025-09-30T14:59:41.766503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f89daf-7057a839-a4f47685-87d4d051_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:41.776243Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:41.776266Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:41.776273Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:41.776275Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:41.776285Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897083994418437:13136]
2025-09-30T14:59:41.776290Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897083994418437:13136]
2025-09-30T14:59:41.776294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897083994418437:13136]
2025-09-30T14:59:41.776339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:41.776345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.776348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:41.776347Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:41.776354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:41.776358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:41.776514Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:41.783705Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: CLIENT_DEADLINE_EXCEEDED. Description: [ { <main>: Error: GRpc error: (4): Deadline Exceeded } { <main>: Error: Grpc error response on endpoint localhost:11802 } ]
2025-09-30T14:59:41.785527Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3317 sessionId: src_id|b3f89daf-7057a839-a4f47685-87d4d051_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:41.788454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:41.827257Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897084084222621:2695]
2025-09-30T14:59:41.828453Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3316, pipe: [1:7555897084084222621:2695]
2025-09-30T14:59:41.897602Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:41.898067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.898078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.898119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222621:2695], now have 1 active actors on pipe
2025-09-30T14:59:41.898369Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:41.898424Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897084084222621:2695]
2025-09-30T14:59:41.898426Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:41.898430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:41.898414Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:41.898510Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3317 reason: error at write: Disconnected sessionId: src_id|b3f89daf-7057a839-a4f47685-87d4d051_0
2025-09-30T14:59:41.898829Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f89daf-7057a839-a4f47685-87d4d051_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:41.898840Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f89daf-7057a839-a4f47685-87d4d051_0] Write session will restart in 0.009133s
2025-09-30T14:59:41.898864Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f89daf-7057a839-a4f47685-87d4d051_0] Write session: Do CDS request
2025-09-30T14:59:41.898870Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f89daf-7057a839-a4f47685-87d4d051_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:41.898687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3317 sessionId: src_id|b3f89daf-7057a839-a4f47685-87d4d051_0 is DEAD
2025-09-30T14:59:41.909088Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f89daf-7057a839-a4f47685-87d4d051_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:41.909354Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:41.909371Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3318
2025-09-30T14:59:41.909523Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3318 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:41.909561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3318 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:41.909572Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3318 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:41.909577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:41.910302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3318 sessionId:  describe result for acl check
2025-09-30T14:59:41.910343Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:41.910346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:41.910348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:41.910354Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897084084222684:2439] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:41.910928Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897084084222684:2439] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:41.913765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897084084222684:2439] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:41.916696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897084084222684:2439] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:41.916713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897084084222684:2439] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:41.916717Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897084084222684:2439] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:41.916730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3318 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:41.916901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:41.920292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:41.920583Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:41.920592Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:41.920603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:41.920662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:41.920708Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897083994418602:13138]
2025-09-30T14:59:41.921448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:41.921983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:41.922045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:41.922422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:41.922493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.922504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.922505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.922506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.922508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.922510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.922512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.922514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.922515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.922517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.922518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.922520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.922521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.922523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.922524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.922530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.922541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.922545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.922550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.922555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.922560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.922565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.922569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.922574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.922579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.922583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.922587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.922601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.922605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.922610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.922618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.922626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:41.922633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.922640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:41.922645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.922652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:41.922658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.922663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:41.922668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.922674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:41.922678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.922683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:41.922688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.922694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:41.922699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.922706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:41.922710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.922716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:41.922720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.922726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:41.922731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.922737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.922742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.922748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.922761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.922767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.922772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.922778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:41.922784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.922791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:41.922840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:41.929273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:41.930333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:41.930355Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:41.930358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:41.930364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:41.930373Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3317 [2:7555897083994418602:13138]
2025-09-30T14:59:41.930395Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:41.930415Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:41.930425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:41.930429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:41.930432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:41.930451Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:41.930465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:41.930474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:41.930549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.930557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.930564Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.930569Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:41.930572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:41.930662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:41.930670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.930686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:41.930700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:41.930726Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:41.930746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222795:2439], now have 1 active actors on pipe
2025-09-30T14:59:41.930751Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222638:2454], now have 1 active actors on pipe
2025-09-30T14:59:41.930758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897083994418596:13138]
2025-09-30T14:59:41.930761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897083994418596:13138]
2025-09-30T14:59:41.930764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897083994418596:13138]
2025-09-30T14:59:41.930778Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:41.930795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:41.930803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:41.930810Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:41.930812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:41.930819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:41.930823Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:41.930851Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3317
2025-09-30T14:59:41.930865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897083994418596:13138]
2025-09-30T14:59:41.930881Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:41.930909Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:41.930904Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3317
2025-09-30T14:59:41.931176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.931187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.931218Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:41.931232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:41.931237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:41.931239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:41.931277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:41.931294Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:41.931313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:41.931474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:41.931482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:41.931495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:41.931696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3318 partition: 0 MaxSeqNo: 42 sessionId: src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0
2025-09-30T14:59:41.935582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b3f89daf-7057a839-a4f47685-87d4d051_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:41.938975Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0] Write session: try to update token
2025-09-30T14:59:41.939006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:41.950326Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:41.950349Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:41.950352Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:41.950355Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:41.950366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897083994418596:13138]
2025-09-30T14:59:41.950370Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897083994418596:13138]
2025-09-30T14:59:41.950376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897083994418596:13138]
2025-09-30T14:59:41.950420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:41.950435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:41.950439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:41.950609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:41.952796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:41.952817Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:41.952827Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:41.969756Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3318 sessionId: src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:41.972934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:41.999444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897084084222807:2695]
2025-09-30T14:59:42.009744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3317, pipe: [1:7555897084084222807:2695]
2025-09-30T14:59:42.079198Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:42.079816Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.079836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.079856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897084084222807:2695], now have 1 active actors on pipe
2025-09-30T14:59:42.080256Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:42.083496Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897084084222807:2695]
2025-09-30T14:59:42.083542Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:42.083646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3318 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0
2025-09-30T14:59:42.083850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3318 sessionId: src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0 is DEAD
2025-09-30T14:59:42.084168Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:42.087722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:42.087738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0] Write session will restart in 0.006499s
2025-09-30T14:59:42.087765Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0] Write session: Do CDS request
2025-09-30T14:59:42.087772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:42.095887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:42.099663Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:42.099681Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3319
2025-09-30T14:59:42.099886Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3319 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:42.099920Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3319 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:42.099927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3319 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:42.099936Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:42.100323Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3319 sessionId:  describe result for acl check
2025-09-30T14:59:42.100371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:42.100374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:42.100376Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:42.100382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897088379190201:2440] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:42.100942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897088379190201:2440] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:42.103156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897088379190201:2440] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:42.104513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:42.108069Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:42.108325Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:42.108337Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:42.108348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:42.108405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:42.108449Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897088289386058:13140]
2025-09-30T14:59:42.108493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897088379190201:2440] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:42.108512Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897088379190201:2440] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:42.108515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897088379190201:2440] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:42.108525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3319 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:42.109077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:42.109405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:42.109459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:42.109823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:42.109892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.109898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.109900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.109901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.109903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.109904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.109906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.109907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.109908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.109910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.109911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.109913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.109914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.109915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.109917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.109922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.109933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.109938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.109942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.109946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.109951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.109955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.109959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.109963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.109967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.109969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.109972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.109975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.109977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.109979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.109988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.109993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.109998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.110001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.110004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.110007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.110010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.110014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.110016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.110020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.110022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.110025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.110028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.110031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.110034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.110037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.110040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.110044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.110046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.110049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.110052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.110055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.110058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.110062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.110064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.110068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.110071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.110074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.110077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.110081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.110127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:42.124582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:42.125500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:42.125519Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:42.125522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:42.125527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:42.125536Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3318 [2:7555897088289386058:13140]
2025-09-30T14:59:42.125555Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:42.125571Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:42.125574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:42.125578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:42.125580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:42.125600Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:42.125616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:42.125624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:42.125704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.125712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.125715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.125718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:42.125721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:42.125807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:42.125815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.125831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.125843Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.125867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:42.125888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897088289386053:13140]
2025-09-30T14:59:42.125895Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897088289386053:13140]
2025-09-30T14:59:42.125898Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897088289386053:13140]
2025-09-30T14:59:42.125914Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:42.125934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:42.125954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:42.125957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:42.125994Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897088289386053:13140]
2025-09-30T14:59:42.125996Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:42.127768Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:42.127784Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:42.127787Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:42.127797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:42.128119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3318
2025-09-30T14:59:42.128164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3318
2025-09-30T14:59:42.127984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379190111:2454], now have 1 active actors on pipe
2025-09-30T14:59:42.128013Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379190273:2440], now have 1 active actors on pipe
2025-09-30T14:59:42.128598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.128615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.128648Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f74582e-55bf8717-8d6f505-625e8caa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:42.128663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:42.128668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:42.128671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:42.128685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:42.128705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:42.128728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:42.129476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.129492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.129518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:42.129749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3319 partition: 0 MaxSeqNo: 42 sessionId: src_id|5f74582e-55bf8717-8d6f505-625e8caa_0
2025-09-30T14:59:42.131399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f94856cb-daa929ec-e616e5a-87ea15e4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5f74582e-55bf8717-8d6f505-625e8caa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:42.134196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f74582e-55bf8717-8d6f505-625e8caa_0] Write session: try to update token
2025-09-30T14:59:42.134216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f74582e-55bf8717-8d6f505-625e8caa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:42.156055Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:42.156081Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:42.156084Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:42.156086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:42.156096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897088289386053:13140]
2025-09-30T14:59:42.156101Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897088289386053:13140]
2025-09-30T14:59:42.156106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897088289386053:13140]
2025-09-30T14:59:42.156151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:42.156159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.156162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:42.156315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:42.156423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:42.156440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:42.156444Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:42.168713Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3319 sessionId: src_id|5f74582e-55bf8717-8d6f505-625e8caa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:42.171634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:42.180041Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897088379190284:2695]
2025-09-30T14:59:42.180385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3318, pipe: [1:7555897088379190284:2695]
2025-09-30T14:59:42.277090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:42.277654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.277673Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.277690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379190284:2695], now have 1 active actors on pipe
2025-09-30T14:59:42.277939Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:42.277934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:42.277953Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897088379190284:2695]
2025-09-30T14:59:42.277982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:42.277986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:42.278047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3319 reason: error at write: Disconnected sessionId: src_id|5f74582e-55bf8717-8d6f505-625e8caa_0
2025-09-30T14:59:42.278258Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3319 sessionId: src_id|5f74582e-55bf8717-8d6f505-625e8caa_0 is DEAD
2025-09-30T14:59:42.279490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f74582e-55bf8717-8d6f505-625e8caa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:42.279505Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f74582e-55bf8717-8d6f505-625e8caa_0] Write session will restart in 0.009521s
2025-09-30T14:59:42.279536Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f74582e-55bf8717-8d6f505-625e8caa_0] Write session: Do CDS request
2025-09-30T14:59:42.279547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f74582e-55bf8717-8d6f505-625e8caa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:42.291967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f74582e-55bf8717-8d6f505-625e8caa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:42.295494Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:42.295515Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3320
2025-09-30T14:59:42.295710Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3320 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:42.295742Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3320 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:42.295752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3320 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:42.295756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:42.296271Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3320 sessionId:  describe result for acl check
2025-09-30T14:59:42.296312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:42.296315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:42.296316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:42.296322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897088379190322:2430] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:42.296918Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897088379190322:2430] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:42.314035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897088379190322:2430] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:42.319383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:42.321770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897088379190322:2430] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:42.321790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897088379190322:2430] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:42.321796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897088379190322:2430] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:42.321806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3320 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:42.328161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:42.328451Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:42.328483Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:42.328497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:42.328566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:42.328615Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897088289386223:13143]
2025-09-30T14:59:42.329260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:42.329756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:42.329834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:42.330218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:42.330302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.330308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.330309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.330311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.330312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.330313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.330315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.330316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.330317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.330319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.330320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.330322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.330323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.330324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.330326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.330332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.330345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.330349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.330353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.330357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.330361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.330365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.330369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.330373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.330377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.330381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.330385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.330388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.330392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.330395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.330407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.330415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.330422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.330427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.330433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.330438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.330442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.330447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.330453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.330457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.330465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.330470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.330490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.330496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.330500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.330506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.330511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.330516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.330531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.330536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.330541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.330545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.330550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.330555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.330560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.330565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.330569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.330574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.330580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.330585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.330631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:42.336872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:42.338093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:42.338110Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:42.338113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:42.338117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:42.338124Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3319 [2:7555897088289386223:13143]
2025-09-30T14:59:42.338142Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:42.338161Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:42.338164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:42.338167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:42.338170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:42.338187Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:42.338195Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:42.338203Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:42.338271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.338281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.338284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.338287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:42.338290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:42.338364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:42.338373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.338390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.338403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.338421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:42.338446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379190287:2454], now have 1 active actors on pipe
2025-09-30T14:59:42.338458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897088289386216:13143]
2025-09-30T14:59:42.338461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897088289386216:13143]
2025-09-30T14:59:42.338463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897088289386216:13143]
2025-09-30T14:59:42.338478Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:42.338490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379190446:2430], now have 1 active actors on pipe
2025-09-30T14:59:42.338504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:42.338519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:42.338523Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:42.338560Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897088289386216:13143]
2025-09-30T14:59:42.338568Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:42.338595Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3319
2025-09-30T14:59:42.338659Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3319
2025-09-30T14:59:42.338904Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:42.338915Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:42.338918Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:42.338924Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:42.339174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.339183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.339227Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:42.339238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:42.339259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:42.339262Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:42.339279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:42.339293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:42.339313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:42.339901Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3320 partition: 0 MaxSeqNo: 42 sessionId: src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0
2025-09-30T14:59:42.340408Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f74582e-55bf8717-8d6f505-625e8caa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:42.339742Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.339756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.339777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:42.343774Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0] Write session: try to update token
2025-09-30T14:59:42.343799Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:42.352945Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:42.352971Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:42.352974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:42.352977Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:42.352987Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897088289386216:13143]
2025-09-30T14:59:42.352992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897088289386216:13143]
2025-09-30T14:59:42.352997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897088289386216:13143]
2025-09-30T14:59:42.353042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:42.353049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.353052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:42.353059Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:42.353066Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:42.353075Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:42.353240Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:42.366958Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3320 sessionId: src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:42.370322Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:42.378874Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897088379190464:2695]
2025-09-30T14:59:42.379138Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3319, pipe: [1:7555897088379190464:2695]
2025-09-30T14:59:42.481021Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:42.481406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.481417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.481439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379190464:2695], now have 1 active actors on pipe
2025-09-30T14:59:42.481734Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:42.482277Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897088379190464:2695]
2025-09-30T14:59:42.482312Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:42.482350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:42.482429Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3320 reason: status is not ok: tablet will be restarted right now sessionId: src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0
2025-09-30T14:59:42.482617Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3320 sessionId: src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0 is DEAD
2025-09-30T14:59:42.483097Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:42.483110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0] Write session will restart in 0.009222s
2025-09-30T14:59:42.483134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0] Write session: Do CDS request
2025-09-30T14:59:42.483141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:42.493849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:42.494305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:42.494326Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3321
2025-09-30T14:59:42.494505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3321 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:42.494553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3321 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:42.494577Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3321 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:42.494587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:42.495052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3321 sessionId:  describe result for acl check
2025-09-30T14:59:42.495088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:42.495096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:42.495098Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:42.495105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897088379190482:2406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:42.495696Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897088379190482:2406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:42.497919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897088379190482:2406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:42.502545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897088379190482:2406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:42.502564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897088379190482:2406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:42.502568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897088379190482:2406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:42.502579Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3321 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:42.512676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:42.515454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:42.515685Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:42.515689Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:42.515701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:42.515765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:42.515805Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897088289386386:13145]
2025-09-30T14:59:42.516538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:42.520125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:42.520231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:42.520751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:42.520856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.520858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.520860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.520861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.520863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.520865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.520866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.520868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.520870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.520872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.520873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.520875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.520877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.520878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.520880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.520888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.520900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.520905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.520909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.520914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.520918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.520923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.520928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.520933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.520938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.520942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.520947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.520952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.520956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.520961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.520971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.520981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.520989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.520996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.521005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.521011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.521018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.521024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.521030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.521036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.521041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.521047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.521052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.521057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.521062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.521066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.521074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.521079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.521085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.521090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.521094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.521099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.521104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.521109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.521113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.521118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.521124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.521128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.521133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.521138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.521184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:42.529358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:42.530398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:42.530419Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:42.530422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:42.530427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:42.530434Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3320 [2:7555897088289386386:13145]
2025-09-30T14:59:42.530454Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:42.530473Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:42.530476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:42.530480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:42.530482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:42.530499Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:42.530506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:42.530514Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:42.530582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.530585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.530587Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.530591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:42.530594Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:42.530680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:42.530683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.530697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.530710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.530725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:42.530743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897088289386381:13145]
2025-09-30T14:59:42.530745Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897088289386381:13145]
2025-09-30T14:59:42.530747Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897088289386381:13145]
2025-09-30T14:59:42.530757Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:42.530767Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:42.530772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379190469:2454], now have 1 active actors on pipe
2025-09-30T14:59:42.530772Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:42.530775Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:42.530781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:42.530796Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:42.530799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:42.530805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379190551:2406], now have 1 active actors on pipe
2025-09-30T14:59:42.530845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897088289386381:13145]
2025-09-30T14:59:42.530856Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:42.530995Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:42.531094Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3320
2025-09-30T14:59:42.531142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3320
2025-09-30T14:59:42.531496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.531522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.531552Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:42.531566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:42.531575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:42.531579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:42.531593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:42.531611Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:42.531634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:42.531909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.531917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.531933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:42.532229Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3321 partition: 0 MaxSeqNo: 42 sessionId: src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0
2025-09-30T14:59:42.532724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f63c71ad-2938319d-bf0f5b0f-23d48e3e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:42.535899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0] Write session: try to update token
2025-09-30T14:59:42.535929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:42.544815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:42.544836Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:42.544839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:42.544842Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:42.544852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897088289386381:13145]
2025-09-30T14:59:42.544857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897088289386381:13145]
2025-09-30T14:59:42.544862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897088289386381:13145]
2025-09-30T14:59:42.544905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:42.544913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.544916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:42.544921Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:42.544928Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:42.544933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:42.545077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:42.567041Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3321 sessionId: src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:42.570081Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:42.580013Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897088379190642:2695]
2025-09-30T14:59:42.583019Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3320, pipe: [1:7555897088379190642:2695]
2025-09-30T14:59:42.668545Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:42.669164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.669185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.669207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379190642:2695], now have 1 active actors on pipe
2025-09-30T14:59:42.669807Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:42.669709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897088379190642:2695]
2025-09-30T14:59:42.669744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:42.669746Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:42.669748Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:42.669814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3321 reason: error at write: Disconnected sessionId: src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0
2025-09-30T14:59:42.670017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3321 sessionId: src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0 is DEAD
2025-09-30T14:59:42.670193Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:42.670205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0] Write session will restart in 0.005625s
2025-09-30T14:59:42.670230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0] Write session: Do CDS request
2025-09-30T14:59:42.670241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:42.678089Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:42.678216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:42.678233Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3322
2025-09-30T14:59:42.678441Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3322 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:42.678475Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3322 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:42.678480Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3322 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:42.678485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:42.678984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3322 sessionId:  describe result for acl check
2025-09-30T14:59:42.679022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:42.679089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:42.679091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:42.679100Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897088379190655:2397] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:42.679709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897088379190655:2397] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:42.683346Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897088379190655:2397] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:42.691854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897088379190655:2397] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:42.691876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897088379190655:2397] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:42.691880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897088379190655:2397] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:42.691890Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3322 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:42.700997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:42.707714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:42.707990Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:42.708001Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:42.708012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:42.708087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:42.708130Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897088289386577:13149]
2025-09-30T14:59:42.708860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:42.709258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:42.709321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:42.709677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:42.709756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.709762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.709763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.709764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.709766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.709767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.709768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.709770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.709772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.709773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.709775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.709776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.709777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.709779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.709780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.709787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.709799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.709803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.709808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.709812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.709816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.709820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.709824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.709829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.709835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.709839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.709844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.709848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.709853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.709857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.709864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.709872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.709879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.709884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.709889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.709901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.709905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.709910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.709917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.709925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.709929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.709934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.709941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.709945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.709949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.709954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.709959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.709965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.709970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.709976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.709982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.710014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.710019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.710024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.710031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.710038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.710043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.710049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.710054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.710059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.710111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:42.717938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:42.718871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:42.718892Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:42.718896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:42.718901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:42.718909Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3321 [2:7555897088289386577:13149]
2025-09-30T14:59:42.718926Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:42.718944Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:42.718947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:42.718951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:42.718954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:42.718972Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:42.718981Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:42.718988Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:42.719056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.719059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.719061Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.719066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:42.719069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:42.719149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:42.719152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.719167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.719182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.719202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:42.719220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897088289386559:13149]
2025-09-30T14:59:42.719223Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897088289386559:13149]
2025-09-30T14:59:42.719225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897088289386559:13149]
2025-09-30T14:59:42.719241Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:42.719280Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:42.719295Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:42.719298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:42.719337Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897088289386559:13149]
2025-09-30T14:59:42.719340Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:42.719637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:42.719640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379190644:2454], now have 1 active actors on pipe
2025-09-30T14:59:42.719648Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379190731:2397], now have 1 active actors on pipe
2025-09-30T14:59:42.719647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:42.719650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:42.719658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:42.720004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3321
2025-09-30T14:59:42.720047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3321
2025-09-30T14:59:42.720899Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3322 partition: 0 MaxSeqNo: 42 sessionId: src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0
2025-09-30T14:59:42.720322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.720334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.720364Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:42.720374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:42.720379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:42.720382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:42.720395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:42.720408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:42.720436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:42.720715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.720719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.720736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:42.723570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ad1581c2-1d60d5e0-5278b749-9866ef15_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:42.726606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0] Write session: try to update token
2025-09-30T14:59:42.726628Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:42.738076Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:42.738097Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:42.738100Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:42.738102Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:42.738112Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897088289386559:13149]
2025-09-30T14:59:42.738118Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897088289386559:13149]
2025-09-30T14:59:42.738135Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897088289386559:13149]
2025-09-30T14:59:42.738180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:42.738189Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.738191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:42.738418Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:42.740502Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:42.740514Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:42.740519Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:42.761834Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3322 sessionId: src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:42.765343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:42.768347Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897088379190840:2695]
2025-09-30T14:59:42.768736Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3321, pipe: [1:7555897088379190840:2695]
2025-09-30T14:59:42.879063Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:42.879588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.879607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.879627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379190840:2695], now have 1 active actors on pipe
2025-09-30T14:59:42.879830Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:42.879854Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:42.879859Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:42.879886Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897088379190840:2695]
2025-09-30T14:59:42.879937Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3322 reason: error at write: Disconnected sessionId: src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0
2025-09-30T14:59:42.880305Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:42.880330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0] Write session will restart in 0.007604s
2025-09-30T14:59:42.880355Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0] Write session: Do CDS request
2025-09-30T14:59:42.880362Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:42.880123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3322 sessionId: src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0 is DEAD
2025-09-30T14:59:42.880123Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:42.889778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:42.889915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:42.889933Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3323
2025-09-30T14:59:42.890111Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3323 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:42.890152Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3323 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:42.890158Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3323 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:42.890163Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:42.890820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3323 sessionId:  describe result for acl check
2025-09-30T14:59:42.890858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:42.890860Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:42.890862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:42.890868Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897088379190897:8194] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:42.891458Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897088379190897:8194] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:42.894772Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897088379190897:8194] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:42.897199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:42.897844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897088379190897:8194] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:42.897861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897088379190897:8194] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:42.897865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897088379190897:8194] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:42.897874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3323 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:42.899695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:42.899913Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:42.899925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:42.899937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:42.899995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:42.900038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897088289386767:13163]
2025-09-30T14:59:42.900759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:42.901092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:42.901140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:42.901477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:42.901551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.901558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.901559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.901561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.901562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.901563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.901565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.901566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.901567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.901569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.901570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.901571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.901573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.901574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.901576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.901582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.901592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.901596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.901600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.901604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.901609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.901613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.901618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.901622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.901627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.901631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.901636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.901641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.901645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.901650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.901658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.901666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:42.901673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.901680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:42.901685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.901691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:42.901697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.901703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:42.901708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.901715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:42.901720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.901726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:42.901731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.901737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:42.901741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.901747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:42.901753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.901759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:42.901765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.901772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:42.901777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.901782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.901787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.901792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.901797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.901812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.901817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.901823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:42.901833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.901839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:42.901911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:42.908116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:42.909073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:42.909092Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:42.909096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:42.909100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:42.909108Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3322 [2:7555897088289386767:13163]
2025-09-30T14:59:42.909128Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:42.909144Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:42.909153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:42.909157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:42.909160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:42.909177Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:42.909190Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:42.909199Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:42.909288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.909301Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.909304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.909308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:42.909311Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:42.909385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:42.909394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.909407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:42.909423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:42.909446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:42.909470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897088289386761:13163]
2025-09-30T14:59:42.909477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897088289386761:13163]
2025-09-30T14:59:42.909480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897088289386761:13163]
2025-09-30T14:59:42.909497Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:42.909517Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:42.909518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379190856:2454], now have 1 active actors on pipe
2025-09-30T14:59:42.909528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:42.909535Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:42.909538Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:42.909544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:42.909548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:42.909556Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379191020:8194], now have 1 active actors on pipe
2025-09-30T14:59:42.909597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897088289386761:13163]
2025-09-30T14:59:42.909613Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:42.909637Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:42.909869Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3322
2025-09-30T14:59:42.909926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3322
2025-09-30T14:59:42.910131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.910147Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.910176Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:42.910190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:42.910199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:42.910202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:42.910216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:42.910228Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:42.910248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:42.910481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:42.910496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:42.910520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:42.910655Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3323 partition: 0 MaxSeqNo: 42 sessionId: src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0
2025-09-30T14:59:42.911110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d30011b4-47cb0d1d-54b3537c-bb75ba8e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:42.914212Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0] Write session: try to update token
2025-09-30T14:59:42.914235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:42.929264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:42.929299Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:42.929315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897088289386761:13163]
2025-09-30T14:59:42.929377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:42.929394Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:42.929697Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:42.929893Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:42.930110Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:42.930418Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:42.930832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:42.930896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:42.934338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:42.934360Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:42.934362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:42.934365Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:42.934376Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897088289386761:13163]
2025-09-30T14:59:42.934380Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897088289386761:13163]
2025-09-30T14:59:42.934384Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897088289386761:13163]
2025-09-30T14:59:42.934427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:42.934435Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:42.934438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:42.934440Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:42.934447Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:42.934453Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:42.934593Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:42.935839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3323 sessionId: src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:42.939043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:42.980354Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897088379191031:2695]
2025-09-30T14:59:42.980756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3322, pipe: [1:7555897088379191031:2695]
2025-09-30T14:59:43.056076Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:43.056804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.056822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.056848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897088379191031:2695], now have 1 active actors on pipe
2025-09-30T14:59:43.057155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:43.057183Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:43.057263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3323 reason: error at write: Disconnected sessionId: src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0
2025-09-30T14:59:43.057276Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:43.057324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897088379191031:2695]
2025-09-30T14:59:43.057484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3323 sessionId: src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0 is DEAD
2025-09-30T14:59:43.057671Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:43.057682Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0] Write session will restart in 0.007831s
2025-09-30T14:59:43.057709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0] Write session: Do CDS request
2025-09-30T14:59:43.057716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:43.057081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:43.066866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:43.066963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:43.066982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3324
2025-09-30T14:59:43.067163Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3324 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:43.067212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3324 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:43.067223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3324 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:43.067228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:43.067826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3324 sessionId:  describe result for acl check
2025-09-30T14:59:43.067871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:43.067874Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:43.067876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:43.067884Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897092674158345:2310] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:43.068511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897092674158345:2310] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:43.073484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897092674158345:2310] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:43.076398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:43.076665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897092674158345:2310] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:43.076710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897092674158345:2310] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:43.076714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897092674158345:2310] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:43.076726Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3324 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:43.079449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:43.079713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:43.079723Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:43.079734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:43.079803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:43.079868Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897092584354230:13165]
2025-09-30T14:59:43.080573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:43.080982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:43.081063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:43.081443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:43.081539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.081547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.081548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.081549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.081550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.081552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.081553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.081554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.081555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.081556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.081558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.081559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.081560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.081561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.081563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.081570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.081580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.081584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.081589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.081593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.081597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.081601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.081605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.081609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.081614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.081618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.081622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.081626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.081631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.081635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.081644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.081653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.081659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.081664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.081669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.081674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.081679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.081685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.081689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.081695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.081700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.081705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.081711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.081716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.081721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.081726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.081732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.081737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.081742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.081750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.081755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.081761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.081765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.081778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.081784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.081795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.081800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.081806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.081817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.081827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.081875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:43.087848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:43.089198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:43.089221Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:43.089224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:43.089228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:43.089235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3323 [2:7555897092584354230:13165]
2025-09-30T14:59:43.089255Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:43.089273Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:43.089283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:43.089287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:43.089289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:43.089307Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:43.089314Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:43.089321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:43.089392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.089402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.089405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.089410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:43.089412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:43.089502Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:43.089513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.089531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.089545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.089565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:43.089596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674158329:2454], now have 1 active actors on pipe
2025-09-30T14:59:43.089605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674158493:2310], now have 1 active actors on pipe
2025-09-30T14:59:43.089612Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897092584354224:13165]
2025-09-30T14:59:43.089615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897092584354224:13165]
2025-09-30T14:59:43.089618Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897092584354224:13165]
2025-09-30T14:59:43.089634Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:43.089649Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:43.089656Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:43.089658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:43.089668Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:43.089677Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:43.089686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:43.089727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897092584354224:13165]
2025-09-30T14:59:43.089736Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:43.089742Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:43.089663Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3323
2025-09-30T14:59:43.089727Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3323
2025-09-30T14:59:43.089781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.089792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.089820Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:43.089827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:43.089831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:43.089833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:43.089845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:43.089857Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:43.089871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:43.090223Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.090239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.090261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:43.090546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3324 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0
2025-09-30T14:59:43.090967Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d3f04095-33aa26a9-92e6f953-bfd2869c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:43.093956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0] Write session: try to update token
2025-09-30T14:59:43.093985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:43.105649Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:43.105670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:43.105672Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:43.105675Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:43.105687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897092584354224:13165]
2025-09-30T14:59:43.105692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897092584354224:13165]
2025-09-30T14:59:43.105696Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897092584354224:13165]
2025-09-30T14:59:43.105741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:43.105748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.105752Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:43.105901Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:43.107569Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:43.107581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:43.107585Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:43.110621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3324 sessionId: src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:43.113714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:43.157459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897092674158508:2695]
2025-09-30T14:59:43.157935Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3323, pipe: [1:7555897092674158508:2695]
2025-09-30T14:59:43.222088Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:43.222455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.222470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.222514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674158508:2695], now have 1 active actors on pipe
2025-09-30T14:59:43.223104Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:43.223946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:43.224007Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:43.224091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3324 reason: status is not ok: tablet will be restarted right now sessionId: src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0
2025-09-30T14:59:43.224273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3324 sessionId: src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0 is DEAD
2025-09-30T14:59:43.224385Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897092674158508:2695]
2025-09-30T14:59:43.224643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:43.224655Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0] Write session will restart in 0.005759s
2025-09-30T14:59:43.224683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0] Write session: Do CDS request
2025-09-30T14:59:43.224690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:43.231761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:43.234073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:43.234091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3325
2025-09-30T14:59:43.234559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3325 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:43.234597Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3325 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:43.234602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3325 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:43.234607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:43.235142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3325 sessionId:  describe result for acl check
2025-09-30T14:59:43.235176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:43.235178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:43.235180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:43.235186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897092674158525:8204] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:43.235823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897092674158525:8204] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:43.240650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897092674158525:8204] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:43.246545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897092674158525:8204] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:43.246567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897092674158525:8204] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:43.246571Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897092674158525:8204] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:43.246580Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3325 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:43.253929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:43.257178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:43.257458Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:43.257463Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:43.257477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:43.257551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:43.257617Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897092584354400:13168]
2025-09-30T14:59:43.258294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:43.258771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:43.258836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:43.259259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:43.259330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.259337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.259339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.259340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.259342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.259343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.259345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.259346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.259348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.259349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.259351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.259353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.259354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.259355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.259356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.259363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.259374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.259379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.259383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.259388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.259393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.259397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.259402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.259406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.259411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.259415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.259419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.259424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.259428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.259432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.259442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.259451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.259458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.259464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.259470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.259475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.259481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.259486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.259502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.259507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.259513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.259519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.259524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.259529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.259535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.259541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.259547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.259562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.259572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.259579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.259592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.259602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.259608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.259615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.259620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.259627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.259631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.259637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.259642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.259647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.259693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:43.266623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:43.268618Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3324
2025-09-30T14:59:43.268680Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3324
2025-09-30T14:59:43.268062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:43.268089Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:43.268091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:43.268096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:43.268104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3324 [2:7555897092584354400:13168]
2025-09-30T14:59:43.268125Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:43.268145Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:43.268149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:43.268153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:43.268155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:43.268172Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:43.268180Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:43.268187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:43.268260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.268263Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.268265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.268270Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:43.268273Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:43.268350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:43.268353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.268372Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.268385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.268403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:43.268420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897092584354395:13168]
2025-09-30T14:59:43.268423Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897092584354395:13168]
2025-09-30T14:59:43.268426Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897092584354395:13168]
2025-09-30T14:59:43.268435Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:43.268466Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:43.268482Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:43.268485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:43.268485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:43.268499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:43.268502Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:43.268526Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897092584354395:13168]
2025-09-30T14:59:43.268531Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:43.268534Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:43.268542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674158510:2454], now have 1 active actors on pipe
2025-09-30T14:59:43.268546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674158606:8204], now have 1 active actors on pipe
2025-09-30T14:59:43.269067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.269080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.269110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:43.269119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:43.269123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:43.269126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:43.269150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:43.269162Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:43.269179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:43.275338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.275385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.275431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:43.277456Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3325 partition: 0 MaxSeqNo: 42 sessionId: src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0
2025-09-30T14:59:43.277900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddef4ca-d595440d-286aa155-bb27b34e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:43.281248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0] Write session: try to update token
2025-09-30T14:59:43.281279Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:43.289303Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:43.289325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:43.289328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:43.289331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:43.289340Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897092584354395:13168]
2025-09-30T14:59:43.289345Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897092584354395:13168]
2025-09-30T14:59:43.289349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897092584354395:13168]
2025-09-30T14:59:43.289394Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:43.289402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.289405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:43.289556Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:43.291148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:43.291156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:43.291160Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:43.312884Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3325 sessionId: src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:43.315839Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:43.324344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897092674158688:2695]
2025-09-30T14:59:43.324945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3324, pipe: [1:7555897092674158688:2695]
2025-09-30T14:59:43.415435Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:43.415842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.415859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.415881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674158688:2695], now have 1 active actors on pipe
2025-09-30T14:59:43.416232Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:43.416996Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:43.417008Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0] Write session will restart in 0.007993s
2025-09-30T14:59:43.416444Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:43.417038Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0] Write session: Do CDS request
2025-09-30T14:59:43.416505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897092674158688:2695]
2025-09-30T14:59:43.416525Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:43.417044Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:43.416528Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:43.416604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3325 reason: error at write: Disconnected sessionId: src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0
2025-09-30T14:59:43.416826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3325 sessionId: src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0 is DEAD
2025-09-30T14:59:43.426106Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:43.426638Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:43.426656Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3326
2025-09-30T14:59:43.426842Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3326 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:43.426884Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3326 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:43.426903Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3326 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:43.426921Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:43.427526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3326 sessionId:  describe result for acl check
2025-09-30T14:59:43.427582Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:43.427586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:43.427590Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:43.427598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897092674158734:8211] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:43.428236Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897092674158734:8211] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:43.436364Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897092674158734:8211] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:43.439841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897092674158734:8211] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:43.439862Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897092674158734:8211] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:43.439866Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897092674158734:8211] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:43.439877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3326 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:43.441417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:43.447100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:43.447389Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:43.447402Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:43.447416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:43.447492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:43.447541Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897092584354570:13170]
2025-09-30T14:59:43.448213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:43.448648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:43.448707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:43.449064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:43.449143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.449151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.449152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.449154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.449155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.449156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.449158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.449159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.449160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.449162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.449163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.449164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.449166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.449168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.449169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.449175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.449187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.449191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.449196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.449200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.449205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.449210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.449214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.449219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.449224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.449229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.449233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.449238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.449242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.449247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.449256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.449265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.449272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.449280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.449285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.449290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.449294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.449299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.449304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.449310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.449314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.449322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.449327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.449332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.449336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.449341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.449346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.449351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.449356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.449362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.449367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.449373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.449377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.449382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.449388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.449394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.449398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.449404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.449409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.449414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.449464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:43.456094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:43.457222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:43.457243Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:43.457246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:43.457252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:43.457260Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3325 [2:7555897092584354570:13170]
2025-09-30T14:59:43.457280Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:43.457299Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:43.457303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:43.457306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:43.457309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:43.457329Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:43.457338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:43.457346Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:43.457420Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.457431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.457434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.457438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:43.457441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:43.457519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:43.457527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.457542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.457554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.457578Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:43.457600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897092584354565:13170]
2025-09-30T14:59:43.457610Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897092584354565:13170]
2025-09-30T14:59:43.457613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897092584354565:13170]
2025-09-30T14:59:43.457622Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:43.457638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:43.457658Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:43.457666Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:43.457677Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:43.457687Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:43.457689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:43.457710Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897092584354565:13170]
2025-09-30T14:59:43.457713Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:43.457717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:43.457725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674158862:8211], now have 1 active actors on pipe
2025-09-30T14:59:43.457735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674158696:2454], now have 1 active actors on pipe
2025-09-30T14:59:43.458165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.458183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.458232Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:43.458243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:43.458247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:43.458250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:43.458265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:43.458279Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:43.458299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:43.457869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3325
2025-09-30T14:59:43.457933Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3325
2025-09-30T14:59:43.459905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.459926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.459964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:43.460273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3326 partition: 0 MaxSeqNo: 42 sessionId: src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0
2025-09-30T14:59:43.460755Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ec3a3015-f7ae239c-c677107d-dbef826d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:43.464001Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0] Write session: try to update token
2025-09-30T14:59:43.464031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:43.472600Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:43.472619Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:43.472622Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:43.472625Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:43.472635Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897092584354565:13170]
2025-09-30T14:59:43.472641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897092584354565:13170]
2025-09-30T14:59:43.472646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897092584354565:13170]
2025-09-30T14:59:43.472688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:43.472695Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.472698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:43.472730Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:43.472740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:43.472745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:43.472865Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:43.485663Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3326 sessionId: src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:43.488826Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:43.516885Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897092674158876:2695]
2025-09-30T14:59:43.517288Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3325, pipe: [1:7555897092674158876:2695]
2025-09-30T14:59:43.602239Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:43.602892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.602910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.602930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674158876:2695], now have 1 active actors on pipe
2025-09-30T14:59:43.603228Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:43.603709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:43.603720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0] Write session will restart in 0.007229s
2025-09-30T14:59:43.603745Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0] Write session: Do CDS request
2025-09-30T14:59:43.603751Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:43.603226Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:43.603237Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897092674158876:2695]
2025-09-30T14:59:43.603255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:43.603272Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:43.603337Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3326 reason: error at write: Disconnected sessionId: src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0
2025-09-30T14:59:43.603541Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3326 sessionId: src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0 is DEAD
2025-09-30T14:59:43.611844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:43.612041Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:43.612073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3327
2025-09-30T14:59:43.612275Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3327 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:43.612314Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3327 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:43.612326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3327 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:43.612331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:43.612895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3327 sessionId:  describe result for acl check
2025-09-30T14:59:43.612935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:43.612942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:43.612944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:43.612951Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897092674158894:8215] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:43.613528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897092674158894:8215] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:43.616542Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897092674158894:8215] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:43.620326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897092674158894:8215] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:43.620349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897092674158894:8215] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:43.620353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897092674158894:8215] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:43.620362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3327 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:43.621678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:43.624482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:43.624806Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:43.624818Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:43.624831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:43.624896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:43.624939Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897092584354752:13173]
2025-09-30T14:59:43.625671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:43.626109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:43.626162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:43.626519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:43.626595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.626600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.626601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.626602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.626603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.626605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.626606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.626607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.626608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.626609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.626610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.626611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.626612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.626612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.626613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.626618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.626629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.626633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.626637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.626640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.626644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.626647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.626651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.626656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.626661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.626665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.626668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.626672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.626676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.626679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.626688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.626696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.626702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.626708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.626714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.626719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.626724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.626730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.626736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.626741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.626746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.626751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.626762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.626767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.626772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.626777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.626782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.626787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.626791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.626796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.626801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.626813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.626819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.626854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.626864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.626869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.626874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.626880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.626886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.626891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.626934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:43.633024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:43.634048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:43.634068Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:43.634072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:43.634077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:43.634084Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3326 [2:7555897092584354752:13173]
2025-09-30T14:59:43.634103Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:43.634121Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:43.634124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:43.634127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:43.634130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:43.634148Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:43.634156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:43.634164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:43.634237Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.634247Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.634250Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.634254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:43.634257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:43.634338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:43.634347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.634360Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.634370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.634385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:43.634401Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897092584354747:13173]
2025-09-30T14:59:43.634409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897092584354747:13173]
2025-09-30T14:59:43.634411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897092584354747:13173]
2025-09-30T14:59:43.634423Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:43.634437Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:43.634441Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:43.634442Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:43.634446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:43.634456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:43.634464Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:43.634474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674159042:8215], now have 1 active actors on pipe
2025-09-30T14:59:43.634478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674158879:2454], now have 1 active actors on pipe
2025-09-30T14:59:43.634511Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897092584354747:13173]
2025-09-30T14:59:43.634525Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:43.634559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:43.634659Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3326
2025-09-30T14:59:43.634755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3326
2025-09-30T14:59:43.635067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.635078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.635106Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|16898fee-21150cc3-81342085-5b76d4e4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:43.635120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:43.635125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:43.635127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:43.635139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:43.635152Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:43.635171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:43.636359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.636398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.636443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:43.636602Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3327 partition: 0 MaxSeqNo: 42 sessionId: src_id|16898fee-21150cc3-81342085-5b76d4e4_0
2025-09-30T14:59:43.637023Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a9b2b611-12e6d896-c6303ff-1621bcd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|16898fee-21150cc3-81342085-5b76d4e4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:43.640072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16898fee-21150cc3-81342085-5b76d4e4_0] Write session: try to update token
2025-09-30T14:59:43.640096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16898fee-21150cc3-81342085-5b76d4e4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:43.649708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:43.649727Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:43.649730Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:43.649733Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:43.649744Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897092584354747:13173]
2025-09-30T14:59:43.649753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897092584354747:13173]
2025-09-30T14:59:43.649758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897092584354747:13173]
2025-09-30T14:59:43.649805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:43.649815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.649823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:43.649824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:43.649832Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:43.649837Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:43.649984Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:43.656806Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3327 sessionId: src_id|16898fee-21150cc3-81342085-5b76d4e4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:43.659986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:43.703266Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897092674159057:2695]
2025-09-30T14:59:43.703610Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3326, pipe: [1:7555897092674159057:2695]
2025-09-30T14:59:43.772039Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:43.772527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.772550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.772595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674159057:2695], now have 1 active actors on pipe
2025-09-30T14:59:43.774293Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:43.775317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:43.775391Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897092674159057:2695]
2025-09-30T14:59:43.775419Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:43.775494Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3327 reason: status is not ok: tablet will be restarted right now sessionId: src_id|16898fee-21150cc3-81342085-5b76d4e4_0
2025-09-30T14:59:43.775690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3327 sessionId: src_id|16898fee-21150cc3-81342085-5b76d4e4_0 is DEAD
2025-09-30T14:59:43.775872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16898fee-21150cc3-81342085-5b76d4e4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:43.775885Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16898fee-21150cc3-81342085-5b76d4e4_0] Write session will restart in 0.006216s
2025-09-30T14:59:43.775908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16898fee-21150cc3-81342085-5b76d4e4_0] Write session: Do CDS request
2025-09-30T14:59:43.775916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16898fee-21150cc3-81342085-5b76d4e4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:43.783800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|16898fee-21150cc3-81342085-5b76d4e4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:43.783887Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:43.783905Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3328
2025-09-30T14:59:43.784076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3328 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:43.784113Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3328 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:43.784119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3328 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:43.784124Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:43.784565Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3328 sessionId:  describe result for acl check
2025-09-30T14:59:43.784596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:43.784598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:43.784600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:43.784605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897092674159117:8233] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:43.785205Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897092674159117:8233] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:43.788472Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897092674159117:8233] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:43.790520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:43.793167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:43.793536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897092674159117:8233] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:43.793554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897092674159117:8233] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:43.793557Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897092674159117:8233] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:43.793566Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3328 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:43.794680Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:43.794696Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:43.794715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:43.794808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:43.794979Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897092584354938:13178]
2025-09-30T14:59:43.795683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:43.796133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:43.796195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:43.796609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:43.796718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.796726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.796728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.796729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.796730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.796731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.796733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.796734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.796735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.796736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.796738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.796739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.796740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.796741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.796743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.796750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.796760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.796764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.796770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.796785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.796789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.796792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.796797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.796802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.796806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.796810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.796815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.796820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.796824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.796828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.796837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.796846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.796853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.796860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.796864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.796872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.796876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.796882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.796887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.796893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.796896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.796908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.796915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.796920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.796924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.796929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.796933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.796938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.796943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.796949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.796962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.796969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.796979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.796985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.796994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.797000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.797005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.797011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.797017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.797023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.797073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:43.802993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:43.804244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:43.804261Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:43.804264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:43.804268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:43.804275Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3327 [2:7555897092584354938:13178]
2025-09-30T14:59:43.804292Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:43.804308Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:43.804312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:43.804315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:43.804318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:43.804336Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:43.804348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:43.804356Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:43.804428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.804437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.804439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.804443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:43.804445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:43.804528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:43.804537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.804551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.804562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.804584Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:43.804609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674159074:2454], now have 1 active actors on pipe
2025-09-30T14:59:43.804617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674159239:8233], now have 1 active actors on pipe
2025-09-30T14:59:43.804624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897092584354932:13178]
2025-09-30T14:59:43.804626Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897092584354932:13178]
2025-09-30T14:59:43.804628Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897092584354932:13178]
2025-09-30T14:59:43.804644Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:43.804662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:43.804665Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:43.804670Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:43.804672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:43.804681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:43.804686Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:43.804725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897092584354932:13178]
2025-09-30T14:59:43.804738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:43.804745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:43.804738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3327
2025-09-30T14:59:43.804789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3327
2025-09-30T14:59:43.804914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.804928Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.804959Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:43.804972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:43.804976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:43.804979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:43.804990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:43.805007Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:43.805041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:43.805301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.805316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.805340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:43.805462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3328 partition: 0 MaxSeqNo: 42 sessionId: src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0
2025-09-30T14:59:43.805895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|16898fee-21150cc3-81342085-5b76d4e4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:43.809141Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0] Write session: try to update token
2025-09-30T14:59:43.809167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:43.818059Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:43.818080Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:43.818083Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:43.818086Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:43.818095Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897092584354932:13178]
2025-09-30T14:59:43.818099Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897092584354932:13178]
2025-09-30T14:59:43.818103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897092584354932:13178]
2025-09-30T14:59:43.818143Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:43.818148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:43.818150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.818153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:43.818155Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:43.818159Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:43.818307Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:43.833808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3328 sessionId: src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:43.836963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:43.875808Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897092674159262:2695]
2025-09-30T14:59:43.876670Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3327, pipe: [1:7555897092674159262:2695]
2025-09-30T14:59:43.934693Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:43.935281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.935299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.935323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674159262:2695], now have 1 active actors on pipe
2025-09-30T14:59:43.935615Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:43.936089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:43.936101Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0] Write session will restart in 0.005552s
2025-09-30T14:59:43.936127Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0] Write session: Do CDS request
2025-09-30T14:59:43.936143Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:43.935588Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:43.935647Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:43.935651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:43.935655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897092674159262:2695]
2025-09-30T14:59:43.935719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3328 reason: error at write: Disconnected sessionId: src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0
2025-09-30T14:59:43.935915Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3328 sessionId: src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0 is DEAD
2025-09-30T14:59:43.942852Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:43.942915Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:43.942942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3329
2025-09-30T14:59:43.943093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3329 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:43.943130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3329 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:43.943142Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3329 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:43.943146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:43.943741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3329 sessionId:  describe result for acl check
2025-09-30T14:59:43.943781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:43.943783Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:43.943785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:43.943792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897092674159291:8251] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:43.944373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897092674159291:8251] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:43.947986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897092674159291:8251] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:43.955265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:43.955897Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897092674159291:8251] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:43.955919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897092674159291:8251] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:43.955923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897092674159291:8251] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:43.955934Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3329 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:43.958549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:43.958809Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:43.958821Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:43.958834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:43.958891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:43.958939Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897092584355133:13190]
2025-09-30T14:59:43.959679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:43.960044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:43.960092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:43.960444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:43.960537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.960543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.960544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.960545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.960546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.960548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.960549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.960551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.960553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.960555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.960557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.960558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.960560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.960561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.960563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.960569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.960580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.960585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.960588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.960593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.960598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.960602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.960606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.960609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.960614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.960618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.960623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.960627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.960632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.960636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.960645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.960654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:43.960661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.960672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:43.960677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.960687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:43.960694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.960704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:43.960711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.960719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:43.960728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.960734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:43.960742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.960749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:43.960758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.960763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:43.960768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.960773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:43.960778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.960784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:43.960793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.960799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.960807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.960813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.960821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.960828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.960836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.960841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:43.960850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.960856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:43.960906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:43.966808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:43.968199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:43.968219Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:43.968222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:43.968226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:43.968235Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3328 [2:7555897092584355133:13190]
2025-09-30T14:59:43.968253Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:43.968272Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:43.968275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:43.968279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:43.968281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:43.968298Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:43.968306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:43.968319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:43.968393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.968403Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.968405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.968408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:43.968410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:43.968482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:43.968489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.968500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:43.968510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:43.968521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:43.968538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897092584355127:13190]
2025-09-30T14:59:43.968543Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897092584355127:13190]
2025-09-30T14:59:43.968545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897092584355127:13190]
2025-09-30T14:59:43.968553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:43.968564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674159276:2454], now have 1 active actors on pipe
2025-09-30T14:59:43.968565Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:43.968568Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:43.968570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:43.968573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897092674159445:8251], now have 1 active actors on pipe
2025-09-30T14:59:43.968577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:43.968587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:43.968601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:43.968634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897092584355127:13190]
2025-09-30T14:59:43.968649Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:43.968682Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:43.968713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3328
2025-09-30T14:59:43.968715Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3328
2025-09-30T14:59:43.968806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.968819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.968849Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba02da0f-c0794361-49afa626-1c4888ff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:43.968865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:43.968869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:43.968872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:43.968897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:43.968911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:43.968929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:43.969153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:43.969182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:43.969208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:43.969312Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3329 partition: 0 MaxSeqNo: 42 sessionId: src_id|ba02da0f-c0794361-49afa626-1c4888ff_0
2025-09-30T14:59:43.969758Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fb8df0b7-8cbb5366-ebbcce6f-446b943_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ba02da0f-c0794361-49afa626-1c4888ff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:43.973113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba02da0f-c0794361-49afa626-1c4888ff_0] Write session: try to update token
2025-09-30T14:59:43.973138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba02da0f-c0794361-49afa626-1c4888ff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:43.982019Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:43.982044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:43.982047Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:43.982049Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:43.982060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897092584355127:13190]
2025-09-30T14:59:43.982065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897092584355127:13190]
2025-09-30T14:59:43.982069Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897092584355127:13190]
2025-09-30T14:59:43.982113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:43.982121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:43.982123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:43.982125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:43.982132Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:43.982141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:43.982309Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:43.989375Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3329 sessionId: src_id|ba02da0f-c0794361-49afa626-1c4888ff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:43.992462Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:44.036059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897096969126752:2695]
2025-09-30T14:59:44.036464Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3328, pipe: [1:7555897096969126752:2695]
2025-09-30T14:59:44.105415Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:44.105850Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.105860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.105881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969126752:2695], now have 1 active actors on pipe
2025-09-30T14:59:44.106057Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:44.106722Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:44.106777Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:44.106858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3329 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba02da0f-c0794361-49afa626-1c4888ff_0
2025-09-30T14:59:44.106964Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897096969126752:2695]
2025-09-30T14:59:44.107066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3329 sessionId: src_id|ba02da0f-c0794361-49afa626-1c4888ff_0 is DEAD
2025-09-30T14:59:44.107282Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba02da0f-c0794361-49afa626-1c4888ff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:44.107295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba02da0f-c0794361-49afa626-1c4888ff_0] Write session will restart in 0.006162s
2025-09-30T14:59:44.107320Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba02da0f-c0794361-49afa626-1c4888ff_0] Write session: Do CDS request
2025-09-30T14:59:44.107326Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba02da0f-c0794361-49afa626-1c4888ff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:44.114846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba02da0f-c0794361-49afa626-1c4888ff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:44.114926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:44.114942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3330
2025-09-30T14:59:44.115142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3330 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:44.115190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3330 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:44.115197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3330 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:44.115203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:44.116231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3330 sessionId:  describe result for acl check
2025-09-30T14:59:44.116269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:44.116271Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:44.116277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:44.116283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897096969126789:8257] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:44.116898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897096969126789:8257] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:44.119643Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897096969126789:8257] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:44.122171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897096969126789:8257] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:44.122187Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897096969126789:8257] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:44.122190Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897096969126789:8257] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:44.122246Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3330 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:44.122240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:44.124657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:44.124865Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:44.124875Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:44.124886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:44.124944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:44.124984Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897096879322602:13192]
2025-09-30T14:59:44.125636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:44.125968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:44.126011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:44.126333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:44.126396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.126402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.126404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.126405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.126406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.126408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.126409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.126410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.126411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.126413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.126414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.126415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.126416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.126417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.126418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.126424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.126435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.126441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.126445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.126449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.126454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.126458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.126463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.126468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.126472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.126477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.126481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.126485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.126489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.126493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.126502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.126509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.126519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.126525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.126531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.126537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.126542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.126548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.126553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.126559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.126564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.126569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.126574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.126580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.126585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.126590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.126595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.126602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.126607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.126612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.126617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.126622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.126627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.126633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.126638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.126644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.126649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.126654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.126659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.126664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.126716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:44.132498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:44.133654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:44.133672Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:44.133675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:44.133679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:44.133686Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3329 [2:7555897096879322602:13192]
2025-09-30T14:59:44.133704Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:44.133721Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:44.133724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:44.133728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:44.133731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:44.133750Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:44.133763Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:44.133769Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:44.133845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.133853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.133855Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.133859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:44.133861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:44.133928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:44.133936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.133949Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.133964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.133985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:44.134009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969126924:8257], now have 1 active actors on pipe
2025-09-30T14:59:44.134017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969126754:2454], now have 1 active actors on pipe
2025-09-30T14:59:44.134023Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897096879322596:13192]
2025-09-30T14:59:44.134026Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897096879322596:13192]
2025-09-30T14:59:44.134028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897096879322596:13192]
2025-09-30T14:59:44.134040Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:44.134060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:44.134063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:44.134066Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:44.134069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:44.134077Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:44.134080Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:44.134115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897096879322596:13192]
2025-09-30T14:59:44.134123Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:44.134150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:44.134126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3329
2025-09-30T14:59:44.134129Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3329
2025-09-30T14:59:44.134317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.134332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.134361Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:44.134369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:44.134372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:44.134375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:44.134387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:44.134402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:44.134418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:44.134625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.134633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.134646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:44.134750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3330 partition: 0 MaxSeqNo: 42 sessionId: src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0
2025-09-30T14:59:44.135152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba02da0f-c0794361-49afa626-1c4888ff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:44.138286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0] Write session: try to update token
2025-09-30T14:59:44.138314Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:44.147315Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:44.147336Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:44.147339Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:44.147341Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:44.147351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897096879322596:13192]
2025-09-30T14:59:44.147356Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897096879322596:13192]
2025-09-30T14:59:44.147361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897096879322596:13192]
2025-09-30T14:59:44.147409Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:44.147418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.147421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:44.147589Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:44.150686Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:44.150704Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:44.150709Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:44.159462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3330 sessionId: src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:44.162378Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:44.207059Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897096969126936:2695]
2025-09-30T14:59:44.207356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3329, pipe: [1:7555897096969126936:2695]
2025-09-30T14:59:44.268202Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:44.268660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.268678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.268698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969126936:2695], now have 1 active actors on pipe
2025-09-30T14:59:44.268922Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:44.268926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:44.268951Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:44.269004Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:44.269026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3330 reason: error at write: Disconnected sessionId: src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0
2025-09-30T14:59:44.269049Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897096969126936:2695]
2025-09-30T14:59:44.269223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3330 sessionId: src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0 is DEAD
2025-09-30T14:59:44.269373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:44.269383Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0] Write session will restart in 0.005851s
2025-09-30T14:59:44.269409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0] Write session: Do CDS request
2025-09-30T14:59:44.269418Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:44.276865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:44.277013Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:44.277031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3331
2025-09-30T14:59:44.277168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3331 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:44.277212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3331 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:44.277223Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3331 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:44.277228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:44.277736Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3331 sessionId:  describe result for acl check
2025-09-30T14:59:44.277782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:44.277792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:44.277794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:44.277801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897096969126953:8253] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:44.278539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897096969126953:8253] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:44.281252Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897096969126953:8253] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:44.285501Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897096969126953:8253] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:44.285519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897096969126953:8253] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:44.285522Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897096969126953:8253] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:44.285533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3331 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:44.287220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:44.289831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:44.290105Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:44.290115Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:44.290127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:44.290190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:44.290232Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897096879322778:13195]
2025-09-30T14:59:44.290965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:44.291372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:44.291454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:44.291855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:44.291929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.291935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.291936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.291937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.291939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.291940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.291942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.291944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.291945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.291947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.291948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.291949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.291950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.291951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.291952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.291968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.291978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.291982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.291987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.291991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.291994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.291998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.292003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.292007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.292013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.292017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.292020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.292024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.292028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.292032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.292041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.292052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.292060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.292067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.292071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.292078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.292082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.292087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.292093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.292100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.292115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.292120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.292126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.292132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.292137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.292143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.292149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.292155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.292160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.292166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.292171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.292181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.292186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.292191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.292195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.292201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.292206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.292212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.292217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.292223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.292272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:44.298467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:44.299873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:44.299901Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:44.299904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:44.299908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:44.299916Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3330 [2:7555897096879322778:13195]
2025-09-30T14:59:44.299934Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:44.299953Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:44.299956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:44.299959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:44.299962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:44.299981Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:44.300002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:44.300010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:44.300088Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.300096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.300098Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.300102Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:44.300104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:44.300196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:44.300203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.300219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.300230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.300245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:44.300264Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897096879322773:13195]
2025-09-30T14:59:44.300272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897096879322773:13195]
2025-09-30T14:59:44.300274Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897096879322773:13195]
2025-09-30T14:59:44.300283Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:44.300298Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:44.300316Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:44.300324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:44.300333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:44.300343Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:44.300353Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:44.300365Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897096879322773:13195]
2025-09-30T14:59:44.300368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:44.300372Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:44.300379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969127105:8253], now have 1 active actors on pipe
2025-09-30T14:59:44.300383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969126938:2454], now have 1 active actors on pipe
2025-09-30T14:59:44.300701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.300714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.300743Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:44.300759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:44.300786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:44.300788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:44.300800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:44.300814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:44.300836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:44.301080Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.301095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.301120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:44.301757Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1bc84ed1-668444b2-15fc3c9b-38066c90_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:44.300515Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3330
2025-09-30T14:59:44.300516Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3330
2025-09-30T14:59:44.301297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3331 partition: 0 MaxSeqNo: 42 sessionId: src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0
2025-09-30T14:59:44.304884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0] Write session: try to update token
2025-09-30T14:59:44.304903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:44.314365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:44.314388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:44.314399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897096879322773:13195]
2025-09-30T14:59:44.314456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:44.314455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:44.314730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:44.314916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:44.315093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:44.315306Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:44.315585Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:44.315644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:44.322339Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3331 sessionId: src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:44.325697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:44.325989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.326027Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.326070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:44.326255Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:44.328374Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:44.328401Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:44.328404Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:44.328406Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:44.328416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897096879322773:13195]
2025-09-30T14:59:44.328420Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897096879322773:13195]
2025-09-30T14:59:44.328425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897096879322773:13195]
2025-09-30T14:59:44.328481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:44.328489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.328492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:44.328619Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:44.328637Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:44.328643Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:44.328681Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:44.369193Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897096969127127:2695]
2025-09-30T14:59:44.369572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3330, pipe: [1:7555897096969127127:2695]
2025-09-30T14:59:44.449707Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:44.450030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969127127:2695], now have 1 active actors on pipe
2025-09-30T14:59:44.459275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.459305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.459506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.459581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.459656Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.459728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.459783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.459794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.459876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.459953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.460023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.460103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.460152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.460159Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.460241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.460316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.460393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.460487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.460636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.460645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.460720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.460803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.460885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.460969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.461031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.461042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.461124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.461203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.461271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.461340Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.461398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.461408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.461483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.461559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.461637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.461721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.461775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.461783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.461868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.461952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.462034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.462117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.462167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.462178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.462256Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.462328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.462394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.462471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.462544Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.462552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.462631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.462701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.462776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.462853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.462923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.462931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.463015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.463091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.463167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.463260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.463314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.463325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.463697Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:44.463709Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897096969127127:2695]
2025-09-30T14:59:44.463714Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:44.463744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:44.463747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3331 reason: error at write: Disconnected sessionId: src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0
2025-09-30T14:59:44.464013Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3331 sessionId: src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0 is DEAD
2025-09-30T14:59:44.464123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:44.464136Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0] Write session will restart in 0.007756s
2025-09-30T14:59:44.464160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0] Write session: Do CDS request
2025-09-30T14:59:44.464166Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:44.464632Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:44.472812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:44.472909Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:44.472927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3332
2025-09-30T14:59:44.473080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3332 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:44.473117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3332 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:44.473122Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3332 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:44.473127Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:44.473681Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3332 sessionId:  describe result for acl check
2025-09-30T14:59:44.473725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:44.473732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:44.473733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:44.473740Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897096969127158:8270] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:44.474381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897096969127158:8270] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:44.477367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897096969127158:8270] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:44.480050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:44.480088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897096969127158:8270] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:44.480102Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897096969127158:8270] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:44.480106Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897096969127158:8270] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:44.480114Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3332 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:44.482773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:44.483006Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:44.483019Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:44.483031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:44.483092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:44.483139Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897096879322953:13197]
2025-09-30T14:59:44.483825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:44.484234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:44.484315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:44.484715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:44.484802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.484808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.484809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.484811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.484812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.484814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.484815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.484816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.484818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.484819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.484820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.484822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.484823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.484824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.484825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.484832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.484842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.484846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.484849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.484853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.484858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.484863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.484867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.484872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.484877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.484881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.484885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.484889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.484893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.484897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.484907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.484916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.484923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.484930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.484935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.484941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.484946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.484952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.484958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.484964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.484969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.484975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.484981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.484988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.484994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.485000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.485006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.485011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.485018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.485026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.485038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.485043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.485051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.485057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.485063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.485069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.485073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.485079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.485084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.485090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.485137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:44.491648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:44.493033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:44.493052Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:44.493055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:44.493059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:44.493067Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3331 [2:7555897096879322953:13197]
2025-09-30T14:59:44.493086Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:44.493102Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:44.493106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:44.493109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:44.493111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:44.493129Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:44.493137Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:44.493145Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:44.493205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.493218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.493220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.493223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:44.493226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:44.493297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:44.493305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.493319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.493335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.493356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:44.493375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969127304:8270], now have 1 active actors on pipe
2025-09-30T14:59:44.493379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969127133:2454], now have 1 active actors on pipe
2025-09-30T14:59:44.493386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897096879322947:13197]
2025-09-30T14:59:44.493388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897096879322947:13197]
2025-09-30T14:59:44.493391Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897096879322947:13197]
2025-09-30T14:59:44.493404Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:44.493419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:44.493441Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:44.493443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:44.493476Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:44.493481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897096879322947:13197]
2025-09-30T14:59:44.493484Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:44.493485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:44.493487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:44.493493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:44.493510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3331
2025-09-30T14:59:44.493510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3331
2025-09-30T14:59:44.493608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.493624Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.493659Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:44.493674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:44.493679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:44.493682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:44.493696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:44.493710Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:44.493727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:44.493872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.493880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.493893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:44.494006Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3332 partition: 0 MaxSeqNo: 42 sessionId: src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0
2025-09-30T14:59:44.494481Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|78d1e6ce-95c18a9d-6763f24-32f3de06_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:44.497441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0] Write session: try to update token
2025-09-30T14:59:44.497468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:44.506617Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:44.506640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:44.506643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:44.506646Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:44.506656Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897096879322947:13197]
2025-09-30T14:59:44.506661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897096879322947:13197]
2025-09-30T14:59:44.506665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897096879322947:13197]
2025-09-30T14:59:44.506709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:44.506717Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.506720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:44.506727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:44.506742Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:44.506747Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:44.506881Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:44.515695Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3332 sessionId: src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:44.518788Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:44.563924Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897096969127317:2695]
2025-09-30T14:59:44.564265Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3331, pipe: [1:7555897096969127317:2695]
2025-09-30T14:59:44.626954Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:44.627349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.627364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.627386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969127317:2695], now have 1 active actors on pipe
2025-09-30T14:59:44.627742Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897096969127317:2695]
2025-09-30T14:59:44.627760Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:44.627765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:44.627789Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:44.627834Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3332 reason: error at write: Disconnected sessionId: src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0
2025-09-30T14:59:44.627934Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:44.628085Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3332 sessionId: src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0 is DEAD
2025-09-30T14:59:44.628205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:44.628214Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0] Write session will restart in 0.007624s
2025-09-30T14:59:44.628238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0] Write session: Do CDS request
2025-09-30T14:59:44.628244Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:44.636866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:44.637015Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:44.637035Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3333
2025-09-30T14:59:44.637188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3333 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:44.637227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3333 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:44.637240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3333 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:44.637244Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:44.637735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3333 sessionId:  describe result for acl check
2025-09-30T14:59:44.637776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:44.637782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:44.637784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:44.637790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897096969127343:8278] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:44.638434Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897096969127343:8278] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:44.641258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897096969127343:8278] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:44.648005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:44.648072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897096969127343:8278] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:44.648089Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897096969127343:8278] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:44.648093Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897096969127343:8278] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:44.648102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3333 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:44.651770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:44.652051Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:44.652062Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:44.652073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:44.652135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:44.652182Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897096879323141:13200]
2025-09-30T14:59:44.652912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:44.653261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:44.653309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:44.653665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:44.653727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.653729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.653730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.653732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.653733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.653735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.653736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.653738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.653739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.653741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.653742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.653744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.653745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.653747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.653748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.653754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.653766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.653770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.653775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.653780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.653784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.653789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.653794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.653799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.653804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.653808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.653812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.653816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.653820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.653825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.653834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.653842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.653849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.653855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.653861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.653867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.653872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.653878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.653884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.653890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.653895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.653901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.653907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.653913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.653919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.653924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.653929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.653934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.653940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.653945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.653951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.653958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.653963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.653969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.653974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.653980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.653987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.653992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.653997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.654001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.654057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:44.661418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:44.662385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:44.662405Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:44.662409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:44.662414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:44.662421Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3332 [2:7555897096879323141:13200]
2025-09-30T14:59:44.662439Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:44.662457Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:44.662470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:44.662474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:44.662477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:44.662496Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:44.662503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:44.662511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:44.662582Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.662590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.662593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.662597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:44.662600Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:44.662677Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:44.662686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.662700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.662711Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.662728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:44.662754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969127318:2454], now have 1 active actors on pipe
2025-09-30T14:59:44.662758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969127489:8278], now have 1 active actors on pipe
2025-09-30T14:59:44.662765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897096879323134:13200]
2025-09-30T14:59:44.662768Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897096879323134:13200]
2025-09-30T14:59:44.662770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897096879323134:13200]
2025-09-30T14:59:44.662782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:44.662795Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:44.662798Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:44.662798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:44.662800Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:44.662813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:44.662816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:44.662857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897096879323134:13200]
2025-09-30T14:59:44.662860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:44.662874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:44.662897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.662903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.662848Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3332
2025-09-30T14:59:44.662869Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3332
2025-09-30T14:59:44.662933Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:44.662947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:44.662951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:44.662953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:44.662964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:44.662979Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:44.662996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:44.663174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.663182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.663197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:44.663354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3333 partition: 0 MaxSeqNo: 42 sessionId: src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0
2025-09-30T14:59:44.663848Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fe808740-b45218e3-5fc2578b-b0a61aff_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:44.666921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0] Write session: try to update token
2025-09-30T14:59:44.666946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:44.676762Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:44.676784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:44.676795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897096879323134:13200]
2025-09-30T14:59:44.676848Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:44.676861Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:44.677046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:44.677212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:44.677382Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:44.677551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:44.677780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:44.677822Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:44.683118Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3333 sessionId: src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:44.686288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:44.686554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.686584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.686623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:44.686729Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:44.689900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:44.689921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:44.689923Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:44.689926Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:44.689936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897096879323134:13200]
2025-09-30T14:59:44.689941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897096879323134:13200]
2025-09-30T14:59:44.689945Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897096879323134:13200]
2025-09-30T14:59:44.689985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:44.689989Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:44.689993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.689996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:44.689997Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:44.690001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:44.690149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:44.727731Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897096969127503:2695]
2025-09-30T14:59:44.728351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3332, pipe: [1:7555897096969127503:2695]
2025-09-30T14:59:44.808945Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:44.818875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.818910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.819120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.819192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.819299Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.819378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.819437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.819442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.819533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.819604Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.819676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.819749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.819795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.819799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.819878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.819945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.820016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.820087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.820131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.820134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.820213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.820278Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.820350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.820420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.820486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.820490Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.820565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.820637Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.820707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.820773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.820844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.820853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.820938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.821006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.821077Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.821152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.821224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.821228Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.821310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.821377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.821450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.821524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.821572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.821575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.821652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.821723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.821794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.821866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.821913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.821917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.821993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.822055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.822128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.822200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.822251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.822254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.822338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:44.822403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:44.822474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:44.822551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:44.822597Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:44.822601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:44.822694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969127503:2695], now have 1 active actors on pipe
2025-09-30T14:59:44.823160Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897096969127503:2695]
2025-09-30T14:59:44.823200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:44.823280Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:44.823283Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:44.823356Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3333 reason: error at write: Disconnected sessionId: src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0
2025-09-30T14:59:44.823569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3333 sessionId: src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0 is DEAD
2025-09-30T14:59:44.825157Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:44.825173Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0] Write session will restart in 0.005080s
2025-09-30T14:59:44.825205Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0] Write session: Do CDS request
2025-09-30T14:59:44.825212Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:44.824765Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:44.835432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:44.835964Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:44.835983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3334
2025-09-30T14:59:44.848308Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3334 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:44.848385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3334 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:44.848392Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3334 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:44.848402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:44.850687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3334 sessionId:  describe result for acl check
2025-09-30T14:59:44.850746Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:44.850749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:44.850753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:44.850760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897096969127590:8295] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:44.851402Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897096969127590:8295] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:44.855305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897096969127590:8295] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:44.859729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897096969127590:8295] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:44.859757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897096969127590:8295] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:44.859760Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897096969127590:8295] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:44.859775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3334 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:44.861246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:44.864230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:44.864721Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:44.864738Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:44.864755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:44.864836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:44.864892Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897096879323333:13205]
2025-09-30T14:59:44.865695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:44.866161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:44.866231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:44.866666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:44.866750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.866761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.866763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.866765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.866766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.866767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.866769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.866770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.866771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.866773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.866784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.866785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.866786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.866788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.866789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.866796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.866807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.866811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.866816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.866821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.866825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.866829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.866834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.866838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.866842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.866846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.866851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.866855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.866859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.866864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.866872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.866897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:44.866904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.866917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:44.866924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.866930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:44.866936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.866943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:44.866954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.866960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:44.866972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.866984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:44.866989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.867000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:44.867005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.867011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:44.867016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.867022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:44.867032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.867038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:44.867048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.867054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.867064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.867069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.867079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.867085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.867097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.867103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:44.867108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.867113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:44.867162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:44.877105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:44.878236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:44.878253Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:44.878255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:44.878259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:44.878266Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3333 [2:7555897096879323333:13205]
2025-09-30T14:59:44.878283Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:44.878300Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:44.878304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:44.878307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:44.878310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:44.878329Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:44.878337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:44.878344Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:44.878410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.878413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.878415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.878419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:44.878421Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:44.878501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:44.878505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.878519Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:44.878533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:44.878552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:44.878570Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897096879323328:13205]
2025-09-30T14:59:44.878573Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897096879323328:13205]
2025-09-30T14:59:44.878575Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897096879323328:13205]
2025-09-30T14:59:44.878589Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:44.878604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:44.878608Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:44.878612Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:44.878614Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:44.878621Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:44.878624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:44.878634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969127691:8295], now have 1 active actors on pipe
2025-09-30T14:59:44.878639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969127505:2454], now have 1 active actors on pipe
2025-09-30T14:59:44.878676Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897096879323328:13205]
2025-09-30T14:59:44.878684Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:44.878728Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:44.879649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.879659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.879705Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:44.879717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:44.879722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:44.879726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:44.879739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:44.879753Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:44.879771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:44.880389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:44.880395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:44.880422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:44.881738Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9ccd4e14-755b6a69-fe118fd5-722a3bd7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:44.878963Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3333
2025-09-30T14:59:44.878998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3333
2025-09-30T14:59:44.880559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3334 partition: 0 MaxSeqNo: 42 sessionId: src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0
2025-09-30T14:59:44.887880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0] Write session: try to update token
2025-09-30T14:59:44.887908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:44.898767Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:44.898792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:44.898794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:44.898796Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:44.898806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897096879323328:13205]
2025-09-30T14:59:44.898810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897096879323328:13205]
2025-09-30T14:59:44.898814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897096879323328:13205]
2025-09-30T14:59:44.898854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:44.898861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:44.898864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:44.898887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:44.898895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:44.898903Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:44.899044Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:44.913864Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3334 sessionId: src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:44.917152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:44.921324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897096969127727:2695]
2025-09-30T14:59:44.921873Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3333, pipe: [1:7555897096969127727:2695]
2025-09-30T14:59:45.020799Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:45.022124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.022145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.022168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897096969127727:2695], now have 1 active actors on pipe
2025-09-30T14:59:45.022513Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897096969127727:2695]
2025-09-30T14:59:45.022545Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:45.022551Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:45.022567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:45.022620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3334 reason: error at write: Disconnected sessionId: src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0
2025-09-30T14:59:45.022541Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:45.022845Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3334 sessionId: src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0 is DEAD
2025-09-30T14:59:45.023163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:45.023176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0] Write session will restart in 0.009424s
2025-09-30T14:59:45.023218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0] Write session: Do CDS request
2025-09-30T14:59:45.023232Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:45.033953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:45.034061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:45.034082Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3335
2025-09-30T14:59:45.034297Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3335 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:45.034329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3335 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:45.034335Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3335 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:45.034340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:45.035045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3335 sessionId:  describe result for acl check
2025-09-30T14:59:45.035086Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:45.035088Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:45.035090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:45.035097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897101264095054:8316] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:45.035724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897101264095054:8316] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:45.040939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897101264095054:8316] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:45.044749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897101264095054:8316] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:45.044770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897101264095054:8316] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:45.044773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897101264095054:8316] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:45.044783Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3335 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:45.046771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:45.049515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:45.049846Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:45.049861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:45.049873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:45.049937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:45.049984Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897101174290831:13217]
2025-09-30T14:59:45.050664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:45.051049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:45.051116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:45.051516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:45.051602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.051613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.051614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.051615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.051617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.051618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.051619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.051621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.051622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.051623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.051625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.051626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.051628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.051629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.051630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.051637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.051648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.051653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.051657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.051661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.051665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.051669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.051673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.051677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.051683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.051688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.051709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.051713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.051717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.051721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.051730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.051739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.051745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.051751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.051757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.051763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.051768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.051774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.051779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.051785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.051790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.051795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.051801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.051813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.051818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.051824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.051829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.051841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.051847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.051852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.051856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.051861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.051866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.051872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.051882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.051888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.051898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.051904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.051909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.051920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.051966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:45.058028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:45.059043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:45.059070Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:45.059074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:45.059079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:45.059087Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3334 [2:7555897101174290831:13217]
2025-09-30T14:59:45.059107Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:45.059126Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:45.059129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:45.059133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:45.059135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:45.059154Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:45.059163Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:45.059171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:45.059271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.059282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.059285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.059289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:45.059292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:45.059371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:45.059379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.059397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.059410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.059434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:45.059452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897101174290825:13217]
2025-09-30T14:59:45.059455Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897101174290825:13217]
2025-09-30T14:59:45.059458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897101174290825:13217]
2025-09-30T14:59:45.059467Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:45.059485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:45.059490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:45.059498Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:45.059500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:45.059508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:45.059513Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:45.059524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095025:2454], now have 1 active actors on pipe
2025-09-30T14:59:45.059528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095197:8316], now have 1 active actors on pipe
2025-09-30T14:59:45.059568Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897101174290825:13217]
2025-09-30T14:59:45.059584Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:45.059614Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3334
2025-09-30T14:59:45.059632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3334
2025-09-30T14:59:45.059657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:45.059849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.059863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.059891Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:45.059905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:45.059918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:45.059920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:45.059933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:45.059945Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:45.059969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:45.060177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.060190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.060214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:45.060385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3335 partition: 0 MaxSeqNo: 42 sessionId: src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0
2025-09-30T14:59:45.060960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31e5069e-8ac86b7d-dfff00fa-547855b0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:45.064531Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0] Write session: try to update token
2025-09-30T14:59:45.064560Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:45.080858Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:45.080885Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:45.080896Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897101174290825:13217]
2025-09-30T14:59:45.080957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:45.080963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:45.081162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:45.081332Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:45.081490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:45.081639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:45.082017Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:45.082073Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:45.083942Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3335 sessionId: src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:45.086914Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:45.087269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.087293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.088704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:45.088746Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:45.088750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:45.088752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:45.088754Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:45.088765Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897101174290825:13217]
2025-09-30T14:59:45.088770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897101174290825:13217]
2025-09-30T14:59:45.088774Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897101174290825:13217]
2025-09-30T14:59:45.088809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:45.088816Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:45.088822Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:45.088822Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.088825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:45.088826Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:45.088982Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:45.088966Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:45.122485Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897101264095212:2695]
2025-09-30T14:59:45.122754Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3334, pipe: [1:7555897101264095212:2695]
2025-09-30T14:59:45.217492Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:45.227931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.227969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.228182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.228247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.228322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.228388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.228768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.228779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.228866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.228932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.229002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.229369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.229415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.229419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.229495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.229558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.229657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.229764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.229826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.229829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.229902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.229970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.230040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.230111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.230157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.230160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.230239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.230309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.230377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.230448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.230513Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.230517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.230593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.230664Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.230733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.230805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.230929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.230933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.231011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.231079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.231150Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.231216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.231577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.231591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.231672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.231736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.231810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.231877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.231923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.231927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.231998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.232061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.232127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.232192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.232238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.232243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.232313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.232375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.232503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.232578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.232625Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.232629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.232700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095212:2695], now have 1 active actors on pipe
2025-09-30T14:59:45.233685Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:45.233757Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897101264095212:2695]
2025-09-30T14:59:45.233791Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:45.233799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:45.233844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3335 reason: error at write: Disconnected sessionId: src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0
2025-09-30T14:59:45.233906Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:45.234069Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3335 sessionId: src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0 is DEAD
2025-09-30T14:59:45.234245Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:45.234256Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0] Write session will restart in 0.006990s
2025-09-30T14:59:45.234280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0] Write session: Do CDS request
2025-09-30T14:59:45.234286Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:45.246126Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:45.246293Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:45.246313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3336
2025-09-30T14:59:45.246519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3336 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:45.246573Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3336 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:45.246587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3336 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:45.246591Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:45.248320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3336 sessionId:  describe result for acl check
2025-09-30T14:59:45.248362Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:45.248371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:45.248373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:45.248379Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897101264095282:8315] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:45.249198Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897101264095282:8315] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:45.254186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897101264095282:8315] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:45.256524Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:45.259155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:45.259263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897101264095282:8315] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:45.259286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897101264095282:8315] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:45.259290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897101264095282:8315] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:45.259300Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3336 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:45.259591Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:45.259607Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:45.259623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:45.259713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:45.259758Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897101174291012:13220]
2025-09-30T14:59:45.260497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:45.260974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:45.261044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:45.261523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:45.261600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.261601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.261602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.261603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.261605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.261606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.261607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.261609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.261611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.261612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.261614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.261615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.261617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.261618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.261619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.261626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.261640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.261644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.261649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.261654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.261659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.261664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.261668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.261673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.261678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.261683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.261688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.261693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.261697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.261702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.261711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.261720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.261727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.261735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.261741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.261748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.261753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.261760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.261766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.261772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.261777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.261784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.261790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.261797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.261802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.261820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.261826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.261832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.261837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.261843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.261849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.261855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.261861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.261867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.261874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.261882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.261886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.261892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.261900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.261905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.261966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:45.272036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:45.273099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:45.273120Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:45.273124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:45.273130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:45.273138Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3335 [2:7555897101174291012:13220]
2025-09-30T14:59:45.273160Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:45.273178Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:45.273190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:45.273194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:45.273197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:45.273216Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:45.273225Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:45.273234Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:45.273313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.273324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.273327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.273332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:45.273335Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:45.273413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:45.273422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.273436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.273458Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.273476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:45.273494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897101174291006:13220]
2025-09-30T14:59:45.273497Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897101174291006:13220]
2025-09-30T14:59:45.273500Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897101174291006:13220]
2025-09-30T14:59:45.273508Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:45.273525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:45.273548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:45.273556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:45.273569Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095391:8315], now have 1 active actors on pipe
2025-09-30T14:59:45.273574Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095215:2454], now have 1 active actors on pipe
2025-09-30T14:59:45.273589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:45.273609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897101174291006:13220]
2025-09-30T14:59:45.273610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:45.273612Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:45.273613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:45.273620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:45.273639Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3335
2025-09-30T14:59:45.273671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3335
2025-09-30T14:59:45.273826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.273841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.273882Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d63a4f18-b9723340-41abb98f-dd744169_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:45.273912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:45.273922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:45.273925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:45.273939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:45.273953Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:45.273979Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:45.274289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.274304Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.274336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:45.274478Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3336 partition: 0 MaxSeqNo: 42 sessionId: src_id|d63a4f18-b9723340-41abb98f-dd744169_0
2025-09-30T14:59:45.274940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|577d6def-2d73eca0-ad36bac3-8b10c9f9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d63a4f18-b9723340-41abb98f-dd744169_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:45.278020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d63a4f18-b9723340-41abb98f-dd744169_0] Write session: try to update token
2025-09-30T14:59:45.278044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d63a4f18-b9723340-41abb98f-dd744169_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:45.290852Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:45.290882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:45.290893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897101174291006:13220]
2025-09-30T14:59:45.290947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:45.290963Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:45.291164Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:45.291369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:45.291543Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:45.291729Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:45.291960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:45.292010Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:45.296996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3336 sessionId: src_id|d63a4f18-b9723340-41abb98f-dd744169_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:45.300457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:45.300899Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.300929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.300971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:45.301078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:45.303848Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:45.303868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:45.303871Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:45.303873Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:45.303888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897101174291006:13220]
2025-09-30T14:59:45.303893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897101174291006:13220]
2025-09-30T14:59:45.303897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897101174291006:13220]
2025-09-30T14:59:45.303942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:45.303945Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:45.303951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:45.303955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.303956Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:45.303958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:45.304123Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:45.333929Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897101264095402:2695]
2025-09-30T14:59:45.334368Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3335, pipe: [1:7555897101264095402:2695]
2025-09-30T14:59:45.430356Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:45.431087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095402:2695], now have 1 active actors on pipe
2025-09-30T14:59:45.442542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.442591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.442833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.442943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.443054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.443141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.443591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.443610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.443708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.443805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.443898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.444009Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.444068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.444082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.444217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.444351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.444435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.444530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.444601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.444612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.444693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.444768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.444873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.444955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.445017Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.445026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.445110Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.445188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.445269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.445350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.445408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.445421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.445534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.445630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.445705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.445780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.445836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.445844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.445927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.446007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.446095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.446177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.446230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.446237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.446319Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.446399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.446473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.446557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.446615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.446618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.446700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.446772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.446872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.447023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.447106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.447119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.447313Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.447421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.447514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.447610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.447687Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.447697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.448123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:45.448155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:45.448155Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:45.448191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3336 reason: error at write: Disconnected sessionId: src_id|d63a4f18-b9723340-41abb98f-dd744169_0
2025-09-30T14:59:45.448226Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897101264095402:2695]
2025-09-30T14:59:45.448410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3336 sessionId: src_id|d63a4f18-b9723340-41abb98f-dd744169_0 is DEAD
2025-09-30T14:59:45.448828Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63a4f18-b9723340-41abb98f-dd744169_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:45.448841Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63a4f18-b9723340-41abb98f-dd744169_0] Write session will restart in 0.005477s
2025-09-30T14:59:45.448868Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63a4f18-b9723340-41abb98f-dd744169_0] Write session: Do CDS request
2025-09-30T14:59:45.448875Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63a4f18-b9723340-41abb98f-dd744169_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:45.449168Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:45.456167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d63a4f18-b9723340-41abb98f-dd744169_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:45.456251Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:45.456271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3337
2025-09-30T14:59:45.456418Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3337 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:45.456485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3337 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:45.456497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3337 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:45.456502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:45.456942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3337 sessionId:  describe result for acl check
2025-09-30T14:59:45.456980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:45.456989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:45.456991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:45.456998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897101264095428:8341] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:45.457569Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897101264095428:8341] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:45.461767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897101264095428:8341] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:45.466478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897101264095428:8341] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:45.466499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897101264095428:8341] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:45.466502Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897101264095428:8341] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:45.466525Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3337 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:45.468205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:45.471197Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:45.471528Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:45.471540Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:45.471554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:45.471619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:45.471665Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897101174291193:13222]
2025-09-30T14:59:45.472350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:45.472869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:45.472929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:45.473319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:45.473397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.473404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.473405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.473407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.473409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.473410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.473412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.473413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.473415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.473416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.473418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.473419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.473420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.473422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.473423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.473430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.473442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.473446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.473451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.473454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.473459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.473463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.473467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.473471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.473475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.473479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.473483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.473487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.473491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.473495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.473503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.473512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.473519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.473525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.473530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.473536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.473541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.473547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.473552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.473557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.473562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.473568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.473574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.473580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.473585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.473590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.473596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.473602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.473606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.473627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.473638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.473643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.473657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.473667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.473672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.473685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.473690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.473701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.473707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.473718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.473778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:45.479905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:45.481698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:45.481721Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:45.481725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:45.481730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:45.481738Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3336 [2:7555897101174291193:13222]
2025-09-30T14:59:45.481758Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:45.481776Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:45.481780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:45.481785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:45.481787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:45.481804Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:45.481812Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:45.481819Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:45.481901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.481909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.481912Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.481916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:45.481919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:45.481993Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:45.481996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.482011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.482024Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.482042Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:45.482059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897101174291188:13222]
2025-09-30T14:59:45.482061Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897101174291188:13222]
2025-09-30T14:59:45.482064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897101174291188:13222]
2025-09-30T14:59:45.482085Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:45.482101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:45.482119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:45.482129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:45.482153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:45.482158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:45.482160Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:45.482170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897101174291188:13222]
2025-09-30T14:59:45.482174Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:45.482204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095586:8341], now have 1 active actors on pipe
2025-09-30T14:59:45.482208Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:45.482225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095413:2454], now have 1 active actors on pipe
2025-09-30T14:59:45.482351Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3336
2025-09-30T14:59:45.482363Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3336
2025-09-30T14:59:45.482504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.482525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.482568Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:45.482585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:45.482594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:45.482597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:45.482611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:45.482625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:45.482650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:45.482898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.482909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.482927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:45.483037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3337 partition: 0 MaxSeqNo: 42 sessionId: src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0
2025-09-30T14:59:45.483535Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d63a4f18-b9723340-41abb98f-dd744169_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:45.486776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0] Write session: try to update token
2025-09-30T14:59:45.486801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:45.495928Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:45.495952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:45.495954Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:45.495957Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:45.495968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897101174291188:13222]
2025-09-30T14:59:45.495976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897101174291188:13222]
2025-09-30T14:59:45.495982Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897101174291188:13222]
2025-09-30T14:59:45.496027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:45.496036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.496039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:45.496110Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:45.496126Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:45.496130Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:45.496202Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:45.506182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3337 sessionId: src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:45.509421Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:45.551134Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897101264095601:2695]
2025-09-30T14:59:45.551666Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3336, pipe: [1:7555897101264095601:2695]
2025-09-30T14:59:45.621853Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:45.622500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.622520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.622565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095601:2695], now have 1 active actors on pipe
2025-09-30T14:59:45.622851Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:45.623173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897101264095601:2695]
2025-09-30T14:59:45.623200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:45.623232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:45.623234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:45.623315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3337 reason: error at write: Disconnected sessionId: src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0
2025-09-30T14:59:45.623515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3337 sessionId: src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0 is DEAD
2025-09-30T14:59:45.625021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:45.625033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0] Write session will restart in 0.006650s
2025-09-30T14:59:45.625061Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0] Write session: Do CDS request
2025-09-30T14:59:45.625071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:45.632802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:45.633138Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:45.633159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3338
2025-09-30T14:59:45.633325Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3338 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:45.633362Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3338 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:45.633374Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3338 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:45.633378Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:45.633830Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3338 sessionId:  describe result for acl check
2025-09-30T14:59:45.633869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:45.633871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:45.633873Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:45.633882Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897101264095613:8348] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:45.634492Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897101264095613:8348] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:45.636678Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897101264095613:8348] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:45.639577Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897101264095613:8348] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:45.639599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897101264095613:8348] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:45.639603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897101264095613:8348] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:45.639619Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3338 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:45.653589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:45.657608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:45.657899Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:45.657912Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:45.657924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:45.658012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:45.658061Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897101174291388:13225]
2025-09-30T14:59:45.658797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:45.659239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:45.659316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:45.659703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:45.659777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.659784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.659785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.659787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.659788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.659789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.659791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.659792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.659794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.659795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.659797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.659798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.659800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.659802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.659803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.659809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.659821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.659826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.659831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.659835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.659840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.659844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.659849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.659853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.659857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.659861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.659864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.659869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.659874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.659877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.659888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.659897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.659910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.659922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.659932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.659938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.659951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.659961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.659970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.659974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.659979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.659986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.659995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.660001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.660010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.660018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.660026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.660032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.660040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.660047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.660056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.660075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.660084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.660090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.660099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.660108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.660116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.660123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.660132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.660138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.660191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:45.668056Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3337
2025-09-30T14:59:45.668062Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3337
2025-09-30T14:59:45.666515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:45.667568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:45.667577Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:45.667581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:45.667586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:45.667595Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3337 [2:7555897101174291388:13225]
2025-09-30T14:59:45.667614Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:45.667633Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:45.667638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:45.667641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:45.667644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:45.667663Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:45.667672Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:45.667680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:45.667757Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.667759Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.667762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.667769Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:45.667772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:45.667866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:45.667869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.667884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.667897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.667917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:45.667939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095652:8348], now have 1 active actors on pipe
2025-09-30T14:59:45.667943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095603:2454], now have 1 active actors on pipe
2025-09-30T14:59:45.667950Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897101174291383:13225]
2025-09-30T14:59:45.667953Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897101174291383:13225]
2025-09-30T14:59:45.667956Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897101174291383:13225]
2025-09-30T14:59:45.667972Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:45.667987Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:45.668004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:45.668008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:45.668007Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:45.668012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:45.668015Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:45.668052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897101174291383:13225]
2025-09-30T14:59:45.668057Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:45.668084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:45.668424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.668430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.668486Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:45.668494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:45.668498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:45.668501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:45.668512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:45.668523Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:45.668540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:45.668712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.668717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.668733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:45.668826Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3338 partition: 0 MaxSeqNo: 42 sessionId: src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0
2025-09-30T14:59:45.669251Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8052243d-950f2d0c-123ab90c-a21a64c8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:45.672733Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0] Write session: try to update token
2025-09-30T14:59:45.672758Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:45.688259Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:45.688283Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:45.688285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:45.688287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:45.688299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897101174291383:13225]
2025-09-30T14:59:45.688304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897101174291383:13225]
2025-09-30T14:59:45.688308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897101174291383:13225]
2025-09-30T14:59:45.688354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:45.688361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.688364Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:45.688363Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:45.688371Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:45.688376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:45.688529Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:45.693140Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3338 sessionId: src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:45.696430Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:45.722060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897101264095793:2695]
2025-09-30T14:59:45.722474Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3337, pipe: [1:7555897101264095793:2695]
2025-09-30T14:59:45.807056Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:45.807405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.807423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.807466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095793:2695], now have 1 active actors on pipe
2025-09-30T14:59:45.807712Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:45.807877Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:45.807886Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:45.807963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897101264095793:2695]
2025-09-30T14:59:45.807980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3338 reason: status is not ok: tablet will be restarted right now sessionId: src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0
2025-09-30T14:59:45.808168Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3338 sessionId: src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0 is DEAD
2025-09-30T14:59:45.808342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:45.808357Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0] Write session will restart in 0.007631s
2025-09-30T14:59:45.808382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0] Write session: Do CDS request
2025-09-30T14:59:45.808387Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:45.816878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:45.817274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:45.817294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3339
2025-09-30T14:59:45.817551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3339 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:45.817588Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3339 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:45.817598Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3339 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:45.817603Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:45.818139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3339 sessionId:  describe result for acl check
2025-09-30T14:59:45.818179Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:45.818186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:45.818188Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:45.818194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897101264095852:8350] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:45.818775Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897101264095852:8350] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:45.821553Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897101264095852:8350] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:45.824048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:45.826898Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897101264095852:8350] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:45.826920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897101264095852:8350] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:45.826924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897101264095852:8350] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:45.826933Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3339 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:45.827217Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:45.827475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:45.827486Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:45.827496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:45.827552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:45.827597Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897101174291571:13228]
2025-09-30T14:59:45.828311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:45.828675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:45.828726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:45.829071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:45.829143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.829150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.829151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.829153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.829155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.829156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.829157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.829159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.829160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.829161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.829163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.829164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.829165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.829166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.829168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.829173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.829184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.829188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.829193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.829197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.829201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.829206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.829210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.829214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.829219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.829223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.829228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.829232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.829236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.829240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.829248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.829256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:45.829261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.829266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:45.829271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.829277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:45.829281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.829285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:45.829290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.829297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:45.829302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.829308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:45.829313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.829318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:45.829322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.829327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:45.829332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.829336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:45.829344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.829355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:45.829360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.829370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.829375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.829380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.829390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.829395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.829400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.829410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:45.829418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.829427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:45.829472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:45.835372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:45.836318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:45.836338Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:45.836341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:45.836345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:45.836353Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3338 [2:7555897101174291571:13228]
2025-09-30T14:59:45.836373Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:45.836389Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:45.836393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:45.836397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:45.836400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:45.836419Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:45.836427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:45.836435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:45.836518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.836528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.836531Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.836534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:45.836537Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:45.836801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3338
2025-09-30T14:59:45.836818Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3338
2025-09-30T14:59:45.836611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:45.836623Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.836637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:45.836650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:45.836668Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:45.836688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095974:8350], now have 1 active actors on pipe
2025-09-30T14:59:45.836693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264095796:2454], now have 1 active actors on pipe
2025-09-30T14:59:45.836699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897101174291565:13228]
2025-09-30T14:59:45.836701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897101174291565:13228]
2025-09-30T14:59:45.836703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897101174291565:13228]
2025-09-30T14:59:45.836716Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:45.836734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:45.836739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:45.836743Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:45.836745Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:45.836751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:45.836755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:45.836795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897101174291565:13228]
2025-09-30T14:59:45.836803Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:45.836818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:45.836864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.836869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.836897Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:45.836905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:45.836909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:45.836912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:45.836923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:45.836933Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:45.836948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:45.837184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.837196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.837214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:45.837440Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3339 partition: 0 MaxSeqNo: 42 sessionId: src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0
2025-09-30T14:59:45.837861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|12d25f22-d6a9d621-c4ea484e-53564dcf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:45.841217Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0] Write session: try to update token
2025-09-30T14:59:45.841241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:45.856815Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:45.856841Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:45.856854Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897101174291565:13228]
2025-09-30T14:59:45.856915Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:45.856999Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:45.857153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:45.857341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:45.857519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:45.857690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:45.858035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:45.858093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:45.859162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3339 sessionId: src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:45.862382Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:45.862689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.862717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.862797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:45.862934Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:45.864191Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:45.864210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:45.864213Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:45.864215Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:45.864227Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897101174291565:13228]
2025-09-30T14:59:45.864232Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897101174291565:13228]
2025-09-30T14:59:45.864237Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897101174291565:13228]
2025-09-30T14:59:45.864282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:45.864290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:45.864293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:45.864301Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:45.864307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:45.864311Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:45.864474Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:45.907978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897101264096008:2695]
2025-09-30T14:59:45.908369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3338, pipe: [1:7555897101264096008:2695]
2025-09-30T14:59:45.987239Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:45.997316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:45.997350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:45.997594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.997676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.997762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.997842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.997901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.997914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.998185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.998261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.998337Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.998700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.998757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.998768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.998858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.998930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.999014Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.999093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.999148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.999160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.999263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.999347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.999428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.999512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.999563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.999571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:45.999654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:45.999725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:45.999796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:45.999873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:45.999932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:45.999944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:46.000028Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:46.000105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:46.000177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:46.000248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:46.000312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:46.000321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:46.000399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:46.000488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:46.000561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:46.000632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:46.000681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:46.000691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:46.000762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:46.000833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:46.000903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:46.000972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:46.001022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:46.001029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:46.001104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:46.001172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:46.001243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:46.001314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:46.001364Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:46.001372Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:46.001444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:46.001512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:46.001585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:46.001659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:46.001710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:46.001717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:46.001796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897101264096008:2695], now have 1 active actors on pipe
2025-09-30T14:59:46.002117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897101264096008:2695]
2025-09-30T14:59:46.002118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:46.002123Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:46.002159Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:46.002162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3339 reason: error at write: Disconnected sessionId: src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0
2025-09-30T14:59:46.002422Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3339 sessionId: src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0 is DEAD
2025-09-30T14:59:46.002876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:46.002887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0] Write session will restart in 0.007231s
2025-09-30T14:59:46.002915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0] Write session: Do CDS request
2025-09-30T14:59:46.002922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:46.002920Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:46.011811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:46.011996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:46.012027Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3340
2025-09-30T14:59:46.012181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3340 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:46.012220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3340 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:46.012225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3340 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:46.012230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:46.013445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3340 sessionId:  describe result for acl check
2025-09-30T14:59:46.013489Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:46.013491Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:46.013493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:46.013499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897105559063366:8378] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:46.014082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897105559063366:8378] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:46.017238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897105559063366:8378] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:46.021438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:46.021365Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897105559063366:8378] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:46.021387Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897105559063366:8378] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:46.021391Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897105559063366:8378] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:46.021401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3340 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:46.024675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:46.024969Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:46.024983Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:46.024995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:46.025076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:46.025121Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897105469259085:13242]
2025-09-30T14:59:46.025863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:46.026365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:46.026439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:46.026878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:46.026980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.026992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.026994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.026995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.026996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.026998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.027000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.027001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.027002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.027004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.027005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.027006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.027008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.027010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.027011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.027019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.027032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.027036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.027041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.027045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.027050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.027055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.027060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.027064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.027069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.027073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.027078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.027083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.027087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.027092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.027120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.027131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.027138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.027145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.027150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.027156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.027161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.027168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.027174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.027180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.027185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.027191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.027198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.027204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.027209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.027215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.027221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.027226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.027231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.027240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.027266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.027273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.027278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.027284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.027290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.027296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.027301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.027308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.027314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.027320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.027371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:46.033721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:46.035609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3339
2025-09-30T14:59:46.035075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:46.035082Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:46.035085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:46.035090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:46.035098Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3339 [2:7555897105469259085:13242]
2025-09-30T14:59:46.035117Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:46.035138Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:46.035142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:46.035145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:46.035148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:46.035170Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:46.035177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:46.035185Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:46.035282Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.035285Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.035287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.035290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:46.035294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:46.035369Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:46.035373Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.035388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.035400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.035418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:46.035437Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897105469259079:13242]
2025-09-30T14:59:46.035441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897105469259079:13242]
2025-09-30T14:59:46.035444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897105469259079:13242]
2025-09-30T14:59:46.035454Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:46.035471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:46.035486Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:46.035486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:46.035489Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:46.035490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:46.035493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:46.035501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559063498:8378], now have 1 active actors on pipe
2025-09-30T14:59:46.035505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559063322:2454], now have 1 active actors on pipe
2025-09-30T14:59:46.035549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897105469259079:13242]
2025-09-30T14:59:46.035563Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:46.035589Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:46.035691Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.035702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.035759Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:46.035778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:46.035784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:46.035787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:46.035801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:46.035815Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:46.035851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:46.035612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3339
2025-09-30T14:59:46.036025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.036042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.036060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:46.036190Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3340 partition: 0 MaxSeqNo: 42 sessionId: src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0
2025-09-30T14:59:46.036691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05f0e6b-b85bb9c3-a126deb6-bf4e6d56_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:46.046008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0] Write session: try to update token
2025-09-30T14:59:46.046044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:46.048954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:46.048981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:46.048993Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897105469259079:13242]
2025-09-30T14:59:46.049047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:46.049236Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:46.049240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:46.049391Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:46.049546Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:46.049700Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:46.049914Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:46.049960Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:46.061474Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:46.061501Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:46.061504Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:46.061507Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:46.061518Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897105469259079:13242]
2025-09-30T14:59:46.061524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897105469259079:13242]
2025-09-30T14:59:46.061529Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897105469259079:13242]
2025-09-30T14:59:46.061575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:46.061577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:46.061583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.061584Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:46.061586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:46.061587Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:46.061751Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:46.064060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3340 sessionId: src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:46.067633Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:46.102459Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897105559063511:2695]
2025-09-30T14:59:46.102830Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3339, pipe: [1:7555897105559063511:2695]
2025-09-30T14:59:46.181509Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:46.182023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.182042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.182066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559063511:2695], now have 1 active actors on pipe
2025-09-30T14:59:46.182325Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:46.182373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:46.182442Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:46.182444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897105559063511:2695]
2025-09-30T14:59:46.182445Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:46.182509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3340 reason: error at write: Disconnected sessionId: src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0
2025-09-30T14:59:46.182719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3340 sessionId: src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0 is DEAD
2025-09-30T14:59:46.182916Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:46.182928Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0] Write session will restart in 0.008574s
2025-09-30T14:59:46.182955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0] Write session: Do CDS request
2025-09-30T14:59:46.182965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:46.192889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:46.192927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:46.192946Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3341
2025-09-30T14:59:46.193147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3341 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:46.193185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3341 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:46.193192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3341 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:46.193196Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:46.194195Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3341 sessionId:  describe result for acl check
2025-09-30T14:59:46.194244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:46.194246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:46.194248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:46.194254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897105559063548:8389] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:46.194820Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897105559063548:8389] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:46.198057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897105559063548:8389] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:46.201527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897105559063548:8389] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:46.201551Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897105559063548:8389] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:46.201555Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897105559063548:8389] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:46.201564Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3341 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:46.204987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:46.205694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:46.205929Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:46.205942Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:46.205954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:46.206012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:46.206090Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897105469259270:13244]
2025-09-30T14:59:46.206734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:46.207187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:46.207282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:46.207678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:46.207757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.207759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.207760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.207761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.207763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.207764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.207766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.207767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.207768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.207770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.207772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.207773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.207774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.207776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.207777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.207783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.207806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.207810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.207813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.207817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.207820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.207824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.207827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.207831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.207835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.207840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.207845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.207849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.207853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.207856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.207868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.207875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.207882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.207888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.207893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.207899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.207905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.207911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.207915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.207921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.207926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.207931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.207936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.207942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.207947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.207953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.207958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.207964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.207968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.207974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.207979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.207986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.207990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.207995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.208001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.208009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.208013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.208017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.208022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.208027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.208073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:46.214188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:46.215186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:46.215206Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:46.215210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:46.215215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:46.215224Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3340 [2:7555897105469259270:13244]
2025-09-30T14:59:46.215266Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:46.215286Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:46.215290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:46.215293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:46.215296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:46.215314Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:46.215329Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:46.215337Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:46.215413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.215422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.215424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.215428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:46.215430Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:46.215503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:46.215515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.215528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.215539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.215555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:46.215574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897105469259265:13244]
2025-09-30T14:59:46.215577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897105469259265:13244]
2025-09-30T14:59:46.215579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897105469259265:13244]
2025-09-30T14:59:46.215595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:46.215613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559063513:2454], now have 1 active actors on pipe
2025-09-30T14:59:46.215760Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3340
2025-09-30T14:59:46.215618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559063692:8389], now have 1 active actors on pipe
2025-09-30T14:59:46.215627Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:46.215642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:46.215646Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:46.215658Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:46.215662Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:46.215685Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:46.215690Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897105469259265:13244]
2025-09-30T14:59:46.215694Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:46.215697Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:46.215831Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3340
2025-09-30T14:59:46.215941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.215957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.215986Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a2163da4-8ae08293-940d2030-d72bcac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:46.216000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:46.216009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:46.216012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:46.216025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:46.216046Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:46.216073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:46.216263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.216272Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.216288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:46.216474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3341 partition: 0 MaxSeqNo: 42 sessionId: src_id|a2163da4-8ae08293-940d2030-d72bcac_0
2025-09-30T14:59:46.216960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e8d35426-c35b61fa-5b0a1cec-1f209951_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a2163da4-8ae08293-940d2030-d72bcac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:46.220233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2163da4-8ae08293-940d2030-d72bcac_0] Write session: try to update token
2025-09-30T14:59:46.220255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2163da4-8ae08293-940d2030-d72bcac_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:46.229444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:46.229468Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:46.229471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:46.229474Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:46.229485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897105469259265:13244]
2025-09-30T14:59:46.229490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897105469259265:13244]
2025-09-30T14:59:46.229494Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897105469259265:13244]
2025-09-30T14:59:46.229591Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:46.229601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:46.229605Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:46.229671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:46.229685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.229688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:46.229885Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:46.238188Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3341 sessionId: src_id|a2163da4-8ae08293-940d2030-d72bcac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:46.241444Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:46.282686Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897105559063706:2695]
2025-09-30T14:59:46.283051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3340, pipe: [1:7555897105559063706:2695]
2025-09-30T14:59:46.349610Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:46.350309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.350328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.350371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559063706:2695], now have 1 active actors on pipe
2025-09-30T14:59:46.350606Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:46.350952Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:46.351027Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897105559063706:2695]
2025-09-30T14:59:46.351551Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2163da4-8ae08293-940d2030-d72bcac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:46.351563Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2163da4-8ae08293-940d2030-d72bcac_0] Write session will restart in 0.008708s
2025-09-30T14:59:46.351060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:46.351140Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3341 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a2163da4-8ae08293-940d2030-d72bcac_0
2025-09-30T14:59:46.351591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2163da4-8ae08293-940d2030-d72bcac_0] Write session: Do CDS request
2025-09-30T14:59:46.351359Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3341 sessionId: src_id|a2163da4-8ae08293-940d2030-d72bcac_0 is DEAD
2025-09-30T14:59:46.351598Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2163da4-8ae08293-940d2030-d72bcac_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:46.361863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a2163da4-8ae08293-940d2030-d72bcac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:46.362039Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:46.362064Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3342
2025-09-30T14:59:46.362263Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3342 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:46.362317Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3342 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:46.362332Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3342 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:46.362339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:46.363106Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3342 sessionId:  describe result for acl check
2025-09-30T14:59:46.363148Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:46.363156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:46.363158Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:46.363164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897105559063764:8399] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:46.363778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897105559063764:8399] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:46.366876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897105559063764:8399] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:46.370266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:46.370456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897105559063764:8399] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:46.370476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897105559063764:8399] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:46.370480Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897105559063764:8399] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:46.370491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3342 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:46.371094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:46.371322Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:46.371332Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:46.371343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:46.371396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:46.371442Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897105469259454:13247]
2025-09-30T14:59:46.372070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:46.373429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:46.373501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:46.373925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:46.373986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.373992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.373992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.373993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.373994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.373995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.373996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.373997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.373998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.373999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.374000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.374001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.374002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.374002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.374003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.374009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.374015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.374018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.374021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.374024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.374026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.374029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.374031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.374034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.374037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.374039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.374042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.374044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.374047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.374049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.374056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.374061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.374066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.374071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.374074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.374077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.374082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.374086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.374093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.374099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.374103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.374109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.374114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.374118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.374121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.374124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.374127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.374130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.374133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.374136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.374140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.374143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.374146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.374149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.374152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.374155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.374158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.374160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.374163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.374166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.374194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:46.380520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:46.381968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:46.381987Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:46.381990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:46.381995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:46.382002Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3341 [2:7555897105469259454:13247]
2025-09-30T14:59:46.382020Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:46.382037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:46.382041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:46.382045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:46.382048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:46.382064Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:46.382071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:46.382078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:46.382156Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.382169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.382172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.382175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:46.382178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:46.382251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:46.382259Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.382274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.382287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.382310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:46.382334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559063895:8399], now have 1 active actors on pipe
2025-09-30T14:59:46.382343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559063707:2454], now have 1 active actors on pipe
2025-09-30T14:59:46.382349Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897105469259447:13247]
2025-09-30T14:59:46.382352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897105469259447:13247]
2025-09-30T14:59:46.382354Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897105469259447:13247]
2025-09-30T14:59:46.382366Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:46.382381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:46.382382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:46.382386Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:46.382388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:46.382398Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:46.382402Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:46.382445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897105469259447:13247]
2025-09-30T14:59:46.382403Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3341
2025-09-30T14:59:46.382453Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:46.382456Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:46.382420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3341
2025-09-30T14:59:46.382468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.382473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.382524Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:46.382541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:46.382545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:46.382547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:46.382558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:46.382572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:46.382601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:46.382755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.382764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.382789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:46.382872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3342 partition: 0 MaxSeqNo: 42 sessionId: src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0
2025-09-30T14:59:46.383285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a2163da4-8ae08293-940d2030-d72bcac_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:46.386490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0] Write session: try to update token
2025-09-30T14:59:46.386514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:46.395922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:46.395947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:46.395950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:46.395953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:46.395964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897105469259447:13247]
2025-09-30T14:59:46.395970Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897105469259447:13247]
2025-09-30T14:59:46.395974Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897105469259447:13247]
2025-09-30T14:59:46.396022Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:46.396030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.396033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:46.396048Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:46.396068Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:46.396073Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:46.396197Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:46.404541Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3342 sessionId: src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:46.407759Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:46.451184Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897105559063910:2695]
2025-09-30T14:59:46.451564Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3341, pipe: [1:7555897105559063910:2695]
2025-09-30T14:59:46.514921Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:46.515321Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.515338Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.515360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559063910:2695], now have 1 active actors on pipe
2025-09-30T14:59:46.515753Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:46.515676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:46.515695Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:46.515695Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897105559063910:2695]
2025-09-30T14:59:46.515737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:46.515764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3342 reason: error at write: Disconnected sessionId: src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0
2025-09-30T14:59:46.515989Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3342 sessionId: src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0 is DEAD
2025-09-30T14:59:46.516160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:46.516172Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0] Write session will restart in 0.005426s
2025-09-30T14:59:46.516198Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0] Write session: Do CDS request
2025-09-30T14:59:46.516204Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:46.522855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:46.523007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:46.523026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3343
2025-09-30T14:59:46.523285Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3343 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:46.523346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3343 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:46.523360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3343 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:46.523366Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:46.523945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3343 sessionId:  describe result for acl check
2025-09-30T14:59:46.523989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:46.523997Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:46.523999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:46.524005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897105559063919:8406] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:46.524635Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897105559063919:8406] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:46.527319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897105559063919:8406] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:46.530411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897105559063919:8406] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:46.530431Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897105559063919:8406] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:46.530435Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897105559063919:8406] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:46.530445Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3343 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:46.538328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:46.538934Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:46.539142Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:46.539153Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:46.539164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:46.539222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:46.539288Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897105469259639:13249]
2025-09-30T14:59:46.539967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:46.541466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:46.541539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:46.541937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:46.542007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.542015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.542016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.542017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.542018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.542020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.542021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.542022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.542023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.542025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.542026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.542027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.542028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.542029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.542030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.542036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.542047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.542051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.542056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.542060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.542064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.542068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.542072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.542076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.542081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.542085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.542089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.542093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.542098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.542102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.542111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.542119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.542126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.542131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.542136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.542145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.542152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.542162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.542170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.542180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.542185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.542190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.542200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.542205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.542210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.542216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.542221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.542226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.542230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.542234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.542239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.542243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.542247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.542265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.542274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.542279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.542284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.542291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.542296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.542301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.542356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:46.548556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:46.549656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:46.549677Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:46.549680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:46.549685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:46.549694Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3342 [2:7555897105469259639:13249]
2025-09-30T14:59:46.549715Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:46.549734Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:46.549737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:46.549741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:46.549744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:46.549767Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:46.549774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:46.549781Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:46.549857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.549866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.549869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.549873Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:46.549876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:46.549954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:46.549962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.549983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.550002Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.550019Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:46.550046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559063963:8406], now have 1 active actors on pipe
2025-09-30T14:59:46.550054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559063911:2454], now have 1 active actors on pipe
2025-09-30T14:59:46.550062Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897105469259634:13249]
2025-09-30T14:59:46.550064Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897105469259634:13249]
2025-09-30T14:59:46.550067Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897105469259634:13249]
2025-09-30T14:59:46.550082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:46.550098Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:46.550101Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:46.550116Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:46.550109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:46.550120Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:46.550119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:46.550169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897105469259634:13249]
2025-09-30T14:59:46.550161Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3342
2025-09-30T14:59:46.550186Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:46.550167Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3342
2025-09-30T14:59:46.550198Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:46.550245Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.550257Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.550286Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ff1c342-8ef11642-42a05f50-9c50535c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:46.550300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:46.550305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:46.550307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:46.550321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:46.550332Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:46.550347Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:46.550548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.550558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.550575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:46.550671Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3343 partition: 0 MaxSeqNo: 42 sessionId: src_id|ff1c342-8ef11642-42a05f50-9c50535c_0
2025-09-30T14:59:46.551123Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a65777b-4e37af12-ce8c15df-9a2f1ff1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ff1c342-8ef11642-42a05f50-9c50535c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:46.554420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1c342-8ef11642-42a05f50-9c50535c_0] Write session: try to update token
2025-09-30T14:59:46.554444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1c342-8ef11642-42a05f50-9c50535c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:46.565540Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:46.565568Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:46.565572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:46.565575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:46.565589Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897105469259634:13249]
2025-09-30T14:59:46.565595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897105469259634:13249]
2025-09-30T14:59:46.565600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897105469259634:13249]
2025-09-30T14:59:46.565652Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:46.565661Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.565664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:46.565869Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:46.568121Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:46.568144Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:46.568150Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:46.576850Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3343 sessionId: src_id|ff1c342-8ef11642-42a05f50-9c50535c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:46.580135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:46.616021Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897105559064107:2695]
2025-09-30T14:59:46.616477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3342, pipe: [1:7555897105559064107:2695]
2025-09-30T14:59:46.688882Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:46.689396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.689426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.689452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559064107:2695], now have 1 active actors on pipe
2025-09-30T14:59:46.689757Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:46.689773Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:46.689782Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:46.689829Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897105559064107:2695]
2025-09-30T14:59:46.689862Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3343 reason: error at write: Disconnected sessionId: src_id|ff1c342-8ef11642-42a05f50-9c50535c_0
2025-09-30T14:59:46.690042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3343 sessionId: src_id|ff1c342-8ef11642-42a05f50-9c50535c_0 is DEAD
2025-09-30T14:59:46.689743Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:46.691491Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1c342-8ef11642-42a05f50-9c50535c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:46.691506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1c342-8ef11642-42a05f50-9c50535c_0] Write session will restart in 0.008379s
2025-09-30T14:59:46.691541Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1c342-8ef11642-42a05f50-9c50535c_0] Write session: Do CDS request
2025-09-30T14:59:46.691552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1c342-8ef11642-42a05f50-9c50535c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:46.700887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1c342-8ef11642-42a05f50-9c50535c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:46.700929Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:46.700948Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3344
2025-09-30T14:59:46.703492Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3344 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:46.703548Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3344 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:46.703570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3344 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:46.703581Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:46.704093Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3344 sessionId:  describe result for acl check
2025-09-30T14:59:46.704139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:46.704141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:46.704143Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:46.704150Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897105559064208:5501] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:46.704785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897105559064208:5501] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:46.706956Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897105559064208:5501] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:46.708614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:46.711330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:46.711600Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:46.711612Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:46.711625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:46.711694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:46.711748Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897105469259839:13253]
2025-09-30T14:59:46.711802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897105559064208:5501] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:46.711822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897105559064208:5501] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:46.711826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897105559064208:5501] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:46.711835Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3344 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:46.712472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:46.712890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:46.712975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:46.713381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:46.713467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.713475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.713477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.713478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.713480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.713482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.713483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.713484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.713486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.713488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.713489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.713490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.713492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.713493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.713494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.713500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.713511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.713515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.713520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.713524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.713529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.713533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.713538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.713542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.713546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.713551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.713555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.713560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.713564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.713567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.713576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.713585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.713592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.713598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.713603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.713609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.713614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.713620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.713625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.713631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.713635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.713639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.713647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.713652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.713666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.713672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.713677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.713683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.713689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.713695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.713700Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.713705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.713710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.713716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.713727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.713740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.713746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.713756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.713761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.713767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.713817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:46.720167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:46.721541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:46.721565Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:46.721568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:46.721573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:46.721580Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3343 [2:7555897105469259839:13253]
2025-09-30T14:59:46.721597Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:46.721614Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:46.721617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:46.721621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:46.721623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:46.721643Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:46.721650Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:46.721662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:46.721731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.721740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.721742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.721745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:46.721748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:46.721829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:46.721832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.721859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.721875Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.721891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:46.721918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559064108:2454], now have 1 active actors on pipe
2025-09-30T14:59:46.721922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559064293:5501], now have 1 active actors on pipe
2025-09-30T14:59:46.721929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897105469259834:13253]
2025-09-30T14:59:46.721931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897105469259834:13253]
2025-09-30T14:59:46.721934Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897105469259834:13253]
2025-09-30T14:59:46.721953Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:46.721969Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:46.721974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:46.721989Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:46.721992Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:46.721994Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:46.721997Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:46.722035Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897105469259834:13253]
2025-09-30T14:59:46.722023Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3343
2025-09-30T14:59:46.722024Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3343
2025-09-30T14:59:46.722043Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:46.722049Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:46.722104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.722116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.722147Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|53c81dc-cd38f5da-251241ee-42f32e20_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:46.722163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:46.722167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:46.722170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:46.722182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:46.722192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:46.722210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:46.722474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.722505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.722531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:46.722674Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3344 partition: 0 MaxSeqNo: 42 sessionId: src_id|53c81dc-cd38f5da-251241ee-42f32e20_0
2025-09-30T14:59:46.723160Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ff1c342-8ef11642-42a05f50-9c50535c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|53c81dc-cd38f5da-251241ee-42f32e20_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:46.726293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53c81dc-cd38f5da-251241ee-42f32e20_0] Write session: try to update token
2025-09-30T14:59:46.726318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53c81dc-cd38f5da-251241ee-42f32e20_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:46.749522Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3344 sessionId: src_id|53c81dc-cd38f5da-251241ee-42f32e20_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:46.746554Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:46.746579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:46.746609Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897105469259834:13253]
2025-09-30T14:59:46.746681Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:46.746688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:46.746936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:46.747144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:46.747342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:46.747530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:46.747961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:46.748033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:46.749424Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:46.749429Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:46.749434Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:46.749453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:46.749461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897105469259834:13253]
2025-09-30T14:59:46.749468Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897105469259834:13253]
2025-09-30T14:59:46.749472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897105469259834:13253]
2025-09-30T14:59:46.749507Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:46.749514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.749516Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:46.749534Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:46.749541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:46.749546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:46.749685Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:46.752556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:46.790114Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897105559064305:2695]
2025-09-30T14:59:46.790466Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3343, pipe: [1:7555897105559064305:2695]
2025-09-30T14:59:46.823816Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:59:46.823855Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-09-30T14:59:46.872235Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:46.872617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.872635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.872658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559064305:2695], now have 1 active actors on pipe
2025-09-30T14:59:46.872995Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897105559064305:2695]
2025-09-30T14:59:46.873031Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:46.873044Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 19
2025-09-30T14:59:46.873072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:46.873075Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:46.873149Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3344 reason: error at write: Disconnected sessionId: src_id|53c81dc-cd38f5da-251241ee-42f32e20_0
2025-09-30T14:59:46.873360Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3344 sessionId: src_id|53c81dc-cd38f5da-251241ee-42f32e20_0 is DEAD
2025-09-30T14:59:46.873545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53c81dc-cd38f5da-251241ee-42f32e20_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:46.873559Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53c81dc-cd38f5da-251241ee-42f32e20_0] Write session will restart in 0.006313s
2025-09-30T14:59:46.873585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53c81dc-cd38f5da-251241ee-42f32e20_0] Write session: Do CDS request
2025-09-30T14:59:46.873613Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53c81dc-cd38f5da-251241ee-42f32e20_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:46.873009Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:46.880873Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|53c81dc-cd38f5da-251241ee-42f32e20_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:46.880991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:46.881010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3345
2025-09-30T14:59:46.881167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3345 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:46.881212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3345 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:46.881222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3345 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:46.881227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:46.881762Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3345 sessionId:  describe result for acl check
2025-09-30T14:59:46.881802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:46.881805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:46.881806Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:46.881813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897105559064355:8418] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:46.882388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897105559064355:8418] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:46.885778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897105559064355:8418] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:46.888810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897105559064355:8418] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:46.888831Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897105559064355:8418] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:46.888835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897105559064355:8418] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:46.888844Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3345 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:46.890474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:46.893270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:46.893713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:46.893726Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:46.893738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:46.893801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:46.893850Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897105469260029:13256]
2025-09-30T14:59:46.894533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:46.894881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:46.894930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:46.895315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:46.895387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.895394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.895395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.895397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.895398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.895400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.895402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.895403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.895406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.895407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.895408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.895410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.895412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.895413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.895414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.895420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.895431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.895436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.895440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.895444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.895449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.895453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.895457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.895461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.895466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.895470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.895474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.895479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.895484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.895488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.895497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.895506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:46.895512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.895518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:46.895523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.895529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:46.895534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.895540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:46.895545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.895551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:46.895556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.895563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:46.895568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.895574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:46.895579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.895585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:46.895591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.895597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:46.895602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.895609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:46.895617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.895623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.895628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.895633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.895638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.895643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.895647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.895653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:46.895660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.895666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:46.895713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:46.901748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:46.902741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:46.902762Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:46.902767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:46.902772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:46.902781Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3344 [2:7555897105469260029:13256]
2025-09-30T14:59:46.902807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:46.902826Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:46.902830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:46.902835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:46.902837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:46.902857Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:46.902871Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:46.902879Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:46.902961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.902969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.902972Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.902976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:46.902980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:46.903069Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:46.903081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.903097Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:46.903111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:46.903133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:46.903164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559064340:2454], now have 1 active actors on pipe
2025-09-30T14:59:46.903169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559064522:8418], now have 1 active actors on pipe
2025-09-30T14:59:46.903176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897105469260024:13256]
2025-09-30T14:59:46.903179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897105469260024:13256]
2025-09-30T14:59:46.903183Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897105469260024:13256]
2025-09-30T14:59:46.903197Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:46.903212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:46.903213Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:46.903218Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:46.903230Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:46.903233Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:46.903233Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:46.903299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897105469260024:13256]
2025-09-30T14:59:46.903314Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:46.903348Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:46.903307Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3344
2025-09-30T14:59:46.903331Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3344
2025-09-30T14:59:46.903496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.903521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.903573Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:46.903586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:46.903595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:46.903598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:46.903609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:46.903620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:46.903693Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:59:46.903732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:46.903974Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:46.903984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:46.903998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:46.904001Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 25 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:59:46.904064Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:59:46.904198Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3345 partition: 0 MaxSeqNo: 42 sessionId: src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0
2025-09-30T14:59:46.904632Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|53c81dc-cd38f5da-251241ee-42f32e20_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:46.907840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0] Write session: try to update token
2025-09-30T14:59:46.907860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:46.919874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:46.919899Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:46.919902Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:46.919904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:46.919915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897105469260024:13256]
2025-09-30T14:59:46.919920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897105469260024:13256]
2025-09-30T14:59:46.919924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897105469260024:13256]
2025-09-30T14:59:46.919969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:46.919977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:46.919980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:46.920138Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:46.920230Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:46.920245Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:46.920249Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:46.928636Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3345 sessionId: src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:46.931755Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:46.973407Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897105559064564:2695]
2025-09-30T14:59:46.973701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3344, pipe: [1:7555897105559064564:2695]
2025-09-30T14:59:47.040539Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:47.040931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.040949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.040970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897105559064564:2695], now have 1 active actors on pipe
2025-09-30T14:59:47.041207Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:47.041270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:47.041288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:47.041303Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:47.041318Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 0
2025-09-30T14:59:47.041357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3345 reason: error at write: Disconnected sessionId: src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0
2025-09-30T14:59:47.041376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897105559064564:2695]
2025-09-30T14:59:47.041719Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:47.041729Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0] Write session will restart in 0.005704s
2025-09-30T14:59:47.041754Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0] Write session: Do CDS request
2025-09-30T14:59:47.041762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:47.041971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3345 sessionId: src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0 is DEAD
2025-09-30T14:59:47.048840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:47.048966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:47.048985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3346
2025-09-30T14:59:47.049102Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3346 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:47.049155Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3346 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:47.049166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3346 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:47.049171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:47.049612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3346 sessionId:  describe result for acl check
2025-09-30T14:59:47.049657Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:47.049659Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:47.049661Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:47.049666Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897109854031892:8444] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:47.050269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897109854031892:8444] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:47.055554Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897109854031892:8444] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:47.059687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897109854031892:8444] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:47.059707Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897109854031892:8444] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:47.059711Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897109854031892:8444] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:47.059720Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3346 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:47.060615Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:47.063514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:47.064045Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:47.064062Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:47.064077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:47.064156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:47.064216Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897109764227551:13271]
2025-09-30T14:59:47.064947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:47.065421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:47.065482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:47.065894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:47.065969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.065974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.065976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.065977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.065978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.065980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.065983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.065984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.065985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.065987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.065988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.065990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.065991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.065992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.065994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.066001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.066012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.066017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.066021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.066026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.066031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.066036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.066040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.066044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.066050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.066053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.066058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.066062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.066066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.066071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.066080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.066089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.066097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.066103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.066112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.066119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.066125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.066131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.066136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.066142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.066147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.066153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.066160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.066166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.066181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.066186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.066192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.066204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.066208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.066215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.066226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.066231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.066243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.066248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.066253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.066258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.066267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.066272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.066276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.066299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.066343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:47.073787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:47.075190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:47.075220Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:47.075223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:47.075228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:47.075237Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3345 [2:7555897109764227551:13271]
2025-09-30T14:59:47.075283Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:47.075304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:47.075308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:47.075311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:47.075314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:47.075341Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:47.075350Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:47.075358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:47.075467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.075479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.075482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.075486Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:47.075488Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:47.075585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:47.075597Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.075614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.075625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.075642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:47.075665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897109764227546:13271]
2025-09-30T14:59:47.075675Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897109764227546:13271]
2025-09-30T14:59:47.075678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897109764227546:13271]
2025-09-30T14:59:47.075689Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:47.075701Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:47.075705Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:47.075707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:47.075708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854031877:2454], now have 1 active actors on pipe
2025-09-30T14:59:47.075719Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:47.075737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:47.075751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:47.075760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032058:8444], now have 1 active actors on pipe
2025-09-30T14:59:47.075814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897109764227546:13271]
2025-09-30T14:59:47.075836Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:47.075850Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:47.075833Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3345
2025-09-30T14:59:47.075889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3345
2025-09-30T14:59:47.075926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.075942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.076008Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 85826639 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:59:47.076057Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|31c96afe-178bf541-956d8649-de6805d5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:47.076074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:47.076082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:47.076086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:47.076099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:47.076123Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:47.076148Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:47.076274Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 26 DataSize: 85826639 UsedReserveSize: 0
2025-09-30T14:59:47.076317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:59:47.076525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.076540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.076566Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:47.076717Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3346 partition: 0 MaxSeqNo: 42 sessionId: src_id|31c96afe-178bf541-956d8649-de6805d5_0
2025-09-30T14:59:47.077147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c7cd1693-f7c01fbe-571a661b-a1382209_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|31c96afe-178bf541-956d8649-de6805d5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:47.080589Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c96afe-178bf541-956d8649-de6805d5_0] Write session: try to update token
2025-09-30T14:59:47.080618Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c96afe-178bf541-956d8649-de6805d5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:47.089195Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:47.089218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:47.089229Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897109764227546:13271]
2025-09-30T14:59:47.089279Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:47.089288Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:47.089502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:47.089665Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:47.089830Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:47.089985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:47.090241Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:47.090285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:47.099489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3346 sessionId: src_id|31c96afe-178bf541-956d8649-de6805d5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:47.101030Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:47.101056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:47.101059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:47.101061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:47.101073Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897109764227546:13271]
2025-09-30T14:59:47.101077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897109764227546:13271]
2025-09-30T14:59:47.101087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897109764227546:13271]
2025-09-30T14:59:47.101130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:47.101138Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.101144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:47.101148Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:47.101157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:47.101163Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:47.101308Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:47.102683Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:47.141353Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897109854032074:2695]
2025-09-30T14:59:47.141667Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3345, pipe: [1:7555897109854032074:2695]
2025-09-30T14:59:47.219079Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:47.219636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.219653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.219677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032074:2695], now have 1 active actors on pipe
2025-09-30T14:59:47.219915Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:47.219920Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 44 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897109854032074:2695]
2025-09-30T14:59:47.219933Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:47.219946Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:47.219980Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:47.220016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3346 reason: error at write: Disconnected sessionId: src_id|31c96afe-178bf541-956d8649-de6805d5_0
2025-09-30T14:59:47.220217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3346 sessionId: src_id|31c96afe-178bf541-956d8649-de6805d5_0 is DEAD
2025-09-30T14:59:47.220388Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c96afe-178bf541-956d8649-de6805d5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:47.220396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c96afe-178bf541-956d8649-de6805d5_0] Write session will restart in 0.008677s
2025-09-30T14:59:47.220421Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c96afe-178bf541-956d8649-de6805d5_0] Write session: Do CDS request
2025-09-30T14:59:47.220447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c96afe-178bf541-956d8649-de6805d5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:47.231296Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|31c96afe-178bf541-956d8649-de6805d5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:47.231363Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:47.231393Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3347
2025-09-30T14:59:47.231556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3347 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:47.231604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3347 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:47.231616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3347 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:47.231621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:47.232116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3347 sessionId:  describe result for acl check
2025-09-30T14:59:47.232155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:47.232164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:47.232166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:47.232173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897109854032170:8456] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:47.232756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897109854032170:8456] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:47.235226Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897109854032170:8456] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:47.236244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:47.238800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:47.239126Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:47.239138Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:47.239150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:47.239204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:47.239239Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897109764227743:13275]
2025-09-30T14:59:47.239273Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897109854032170:8456] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:47.239289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897109854032170:8456] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:47.239293Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897109854032170:8456] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:47.239302Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3347 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:47.239925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:47.240430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:47.240491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:47.240838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:47.240906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.240915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.240916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.240917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.240919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.240920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.240921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.240922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.240923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.240925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.240926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.240927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.240928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.240930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.240931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.240937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.240947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.240951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.240955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.240959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.240963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.240967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.240971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.240974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.240980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.240983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.240987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.240991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.240994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.240999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.241008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.241017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.241024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.241030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.241035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.241041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.241046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.241052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.241056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.241062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.241066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.241070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.241075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.241081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.241085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.241091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.241096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.241101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.241106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.241112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.241117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.241122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.241127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.241133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.241137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.241142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.241148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.241153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.241160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.241166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.241211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:47.246880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:47.248186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:47.248203Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:47.248205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:47.248210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:47.248217Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3346 [2:7555897109764227743:13275]
2025-09-30T14:59:47.248233Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:47.248249Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:47.248253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:47.248256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:47.248259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:47.248275Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:47.248288Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:47.248297Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:47.248367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.248374Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.248376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.248379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:47.248382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:47.248466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:47.248478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.248490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.248500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.248520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:47.248545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032267:8456], now have 1 active actors on pipe
2025-09-30T14:59:47.248553Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032080:2454], now have 1 active actors on pipe
2025-09-30T14:59:47.248561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897109764227738:13275]
2025-09-30T14:59:47.248563Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897109764227738:13275]
2025-09-30T14:59:47.248565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897109764227738:13275]
2025-09-30T14:59:47.248578Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:47.248593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:47.248594Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:47.248598Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:47.248601Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:47.248609Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:47.248613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:47.248654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897109764227738:13275]
2025-09-30T14:59:47.248668Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:47.248676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:47.248671Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3346
2025-09-30T14:59:47.248674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3346
2025-09-30T14:59:47.248912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.248923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.248949Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:47.248961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:47.248966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:47.248973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:47.248985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:47.249003Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:47.249018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:47.249276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.249302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.249326Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:47.249462Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3347 partition: 0 MaxSeqNo: 42 sessionId: src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0
2025-09-30T14:59:47.249854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|31c96afe-178bf541-956d8649-de6805d5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:47.252825Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0] Write session: try to update token
2025-09-30T14:59:47.252846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:47.261200Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:47.261222Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:47.261233Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897109764227738:13275]
2025-09-30T14:59:47.261283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:47.261282Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:47.261474Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:47.261636Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:47.261790Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:47.261949Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:47.262162Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:47.262207Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:47.268444Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3347 sessionId: src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:47.272157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:47.273207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.273237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.273318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:47.274710Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:47.274734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:47.274736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:47.274738Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:47.274749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897109764227738:13275]
2025-09-30T14:59:47.274755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897109764227738:13275]
2025-09-30T14:59:47.274761Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897109764227738:13275]
2025-09-30T14:59:47.274806Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:47.274814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.274817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:47.274965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:47.274973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:47.274977Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:47.275028Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:47.274921Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:47.320036Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897109854032278:2695]
2025-09-30T14:59:47.320477Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 45 pipe creation result: OK TabletId: 72075186224037892 Generation: 3346, pipe: [1:7555897109854032278:2695]
2025-09-30T14:59:47.393786Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:47.403890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.403930Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.404138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:47.404226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:47.404314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:47.404387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:47.404803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:47.404817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:47.404896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:47.404973Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:47.405052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:47.405132Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:47.405179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:47.405188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:47.405264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:47.405341Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:47.405412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:47.405485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:47.405537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:47.405545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:47.405628Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:47.405705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:47.405775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:47.405849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:47.405901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:47.405910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:47.405991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:47.406066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:47.406149Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:47.406222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:47.406271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:47.406279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:47.406356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:47.406424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:47.406500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:47.406570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:47.406619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:47.406629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:47.406705Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:47.406771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:47.406851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:47.406923Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:47.406975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:47.406982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:47.407053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:47.407126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:47.407200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:47.407292Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:47.407366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:47.407375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:47.407445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:47.407514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:47.407583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:47.407654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:47.407704Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:47.407713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:47.407791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:47.407862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:47.407936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:47.408010Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:47.408060Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:47.408064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:47.408143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032278:2695], now have 1 active actors on pipe
2025-09-30T14:59:47.408533Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 45 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897109854032278:2695]
2025-09-30T14:59:47.408590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:47.408593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:47.408597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:47.408631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3347 reason: error at write: Disconnected sessionId: src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0
2025-09-30T14:59:47.408863Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3347 sessionId: src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0 is DEAD
2025-09-30T14:59:47.409046Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:47.409059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0] Write session will restart in 0.007497s
2025-09-30T14:59:47.409082Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0] Write session: Do CDS request
2025-09-30T14:59:47.409089Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:47.409172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:47.417872Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:47.417984Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:47.418005Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3348
2025-09-30T14:59:47.418196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3348 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:47.418231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3348 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:47.418237Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3348 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:47.418241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:47.418685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3348 sessionId:  describe result for acl check
2025-09-30T14:59:47.418731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:47.418733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:47.418735Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:47.418744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897109854032301:8458] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:47.419411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897109854032301:8458] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:47.422671Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897109854032301:8458] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:47.426442Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897109854032301:8458] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:47.426462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897109854032301:8458] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:47.426466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897109854032301:8458] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:47.426477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3348 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:47.428072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:47.431269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:47.431534Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:47.431547Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:47.431560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:47.431629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:47.431676Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897109764227935:13277]
2025-09-30T14:59:47.432353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:47.432826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:47.432910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:47.433287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:47.433363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.433364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.433366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.433367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.433368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.433370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.433371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.433372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.433374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.433375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.433377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.433378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.433379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.433380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.433382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.433390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.433402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.433406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.433411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.433415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.433419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.433423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.433427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.433431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.433435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.433439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.433443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.433447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.433451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.433454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.433467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.433478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.433485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.433493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.433499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.433505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.433516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.433525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.433546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.433553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.433560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.433567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.433574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.433581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.433594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.433600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.433613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.433624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.433636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.433645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.433652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.433658Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.433664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.433692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.433697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.433703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.433709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.433715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.433721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.433727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.433785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:47.439957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:47.441086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:47.441105Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:47.441108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:47.441112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:47.441119Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3347 [2:7555897109764227935:13277]
2025-09-30T14:59:47.441136Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:47.441152Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:47.441156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:47.441160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:47.441162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:47.441178Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:47.441191Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:47.441198Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:47.441279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.441286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.441288Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.441291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:47.441294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:47.441368Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:47.441376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.441391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.441408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.441442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:47.441465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032286:2454], now have 1 active actors on pipe
2025-09-30T14:59:47.441474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032470:8458], now have 1 active actors on pipe
2025-09-30T14:59:47.441480Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897109764227930:13277]
2025-09-30T14:59:47.441482Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897109764227930:13277]
2025-09-30T14:59:47.441485Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897109764227930:13277]
2025-09-30T14:59:47.441499Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:47.441519Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:47.441518Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:47.441523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:47.441525Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:47.441537Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:47.441545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:47.441583Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897109764227930:13277]
2025-09-30T14:59:47.441591Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:47.441568Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3347
2025-09-30T14:59:47.441590Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3347
2025-09-30T14:59:47.441619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:47.441631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.441636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.441665Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:47.441676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:47.441679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:47.441682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:47.441691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:47.441700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:47.441717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:47.442145Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3348 partition: 0 MaxSeqNo: 42 sessionId: src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0
2025-09-30T14:59:47.442023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.442035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.442053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:47.442565Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9cd930b1-e3aa7e40-3455e85e-3e76c169_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:47.445624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0] Write session: try to update token
2025-09-30T14:59:47.445652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:47.455501Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:47.455528Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:47.455538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897109764227930:13277]
2025-09-30T14:59:47.455593Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:47.455598Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:47.455807Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:47.456090Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:47.456258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:47.456428Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:47.456676Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:47.456727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:47.466501Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3348 sessionId: src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:47.469896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:47.469966Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:47.469991Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:47.469994Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:47.469996Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:47.470007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897109764227930:13277]
2025-09-30T14:59:47.470011Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897109764227930:13277]
2025-09-30T14:59:47.470016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897109764227930:13277]
2025-09-30T14:59:47.470063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:47.470072Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.470074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:47.470102Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:47.470118Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:47.470123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:47.470233Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:47.508943Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897109854032489:2695]
2025-09-30T14:59:47.509540Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 46 pipe creation result: OK TabletId: 72075186224037892 Generation: 3347, pipe: [1:7555897109854032489:2695]
2025-09-30T14:59:47.588559Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:47.588904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.588919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.588941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032489:2695], now have 1 active actors on pipe
2025-09-30T14:59:47.589330Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:47.589387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:47.589413Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:47.589417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:47.589448Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 46 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897109854032489:2695]
2025-09-30T14:59:47.589487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3348 reason: error at write: Disconnected sessionId: src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0
2025-09-30T14:59:47.589686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3348 sessionId: src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0 is DEAD
2025-09-30T14:59:47.589854Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:47.589867Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0] Write session will restart in 0.008492s
2025-09-30T14:59:47.589893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0] Write session: Do CDS request
2025-09-30T14:59:47.589904Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:47.600337Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:47.600989Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:47.601007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3349
2025-09-30T14:59:47.601175Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3349 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:47.601224Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3349 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:47.601234Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3349 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:47.601239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:47.601754Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3349 sessionId:  describe result for acl check
2025-09-30T14:59:47.601800Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:47.601802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:47.601804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:47.601811Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897109854032549:8457] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:47.602393Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897109854032549:8457] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:47.607151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897109854032549:8457] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:47.610075Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:47.610456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897109854032549:8457] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:47.610474Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897109854032549:8457] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:47.610481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897109854032549:8457] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:47.610493Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3349 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:47.613614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:47.613898Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:47.613910Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:47.613923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:47.613984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:47.614032Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897109764228139:13280]
2025-09-30T14:59:47.614822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:47.615286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:47.615345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:47.615764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:47.615844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.615853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.615854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.615855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.615857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.615860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.615861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.615863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.615864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.615866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.615867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.615868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.615869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.615871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.615872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.615878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.615888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.615892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.615896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.615900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.615904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.615908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.615912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.615916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.615921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.615924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.615928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.615932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.615936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.615940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.615949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.615957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.615964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.615971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.615976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.615982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.615988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.615995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.616001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.616007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.616012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.616017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.616022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.616026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.616031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.616036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.616042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.616047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.616053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.616059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.616064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.616070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.616076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.616081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.616087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.616094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.616100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.616107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.616113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.616129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.616180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:47.622547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:47.623867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:47.623887Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:47.623891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:47.623896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:47.623905Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3348 [2:7555897109764228139:13280]
2025-09-30T14:59:47.623925Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:47.623945Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:47.623958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:47.623965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:47.623968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:47.623987Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:47.623995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:47.624005Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:47.624081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.624091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.624093Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.624096Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:47.624099Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:47.624183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:47.624192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.624209Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.624221Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.624245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:47.624271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032679:8457], now have 1 active actors on pipe
2025-09-30T14:59:47.624284Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897109764228133:13280]
2025-09-30T14:59:47.624291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897109764228133:13280]
2025-09-30T14:59:47.624294Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897109764228133:13280]
2025-09-30T14:59:47.624310Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:47.624325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032491:2454], now have 1 active actors on pipe
2025-09-30T14:59:47.624334Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:47.624348Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:47.624351Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:47.624370Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:47.624394Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:47.624396Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897109764228133:13280]
2025-09-30T14:59:47.624399Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:47.624402Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:47.624410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:47.624396Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3348
2025-09-30T14:59:47.624416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3348
2025-09-30T14:59:47.624558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.624577Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.624607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:47.624622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:47.624626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:47.624649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:47.624668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:47.624687Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:47.624723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:47.624913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.624924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.624940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:47.625033Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3349 partition: 0 MaxSeqNo: 42 sessionId: src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0
2025-09-30T14:59:47.625499Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e628e03-48cb7d83-fe736257-59bbdee4_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:47.628848Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0] Write session: try to update token
2025-09-30T14:59:47.628875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:47.638743Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:47.638776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:47.638779Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:47.638782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:47.638798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897109764228133:13280]
2025-09-30T14:59:47.638806Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897109764228133:13280]
2025-09-30T14:59:47.638815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897109764228133:13280]
2025-09-30T14:59:47.638881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:47.638893Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:47.638902Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:47.638902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.638906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:47.638907Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:47.639157Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:47.645979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3349 sessionId: src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:47.649142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:47.689676Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897109854032692:2695]
2025-09-30T14:59:47.690010Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 47 pipe creation result: OK TabletId: 72075186224037892 Generation: 3348, pipe: [1:7555897109854032692:2695]
2025-09-30T14:59:47.757346Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:47.757884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.757905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.757927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032692:2695], now have 1 active actors on pipe
2025-09-30T14:59:47.758250Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:47.758490Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:47.758493Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:47.758498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:47.758559Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 47 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897109854032692:2695]
2025-09-30T14:59:47.758567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3349 reason: error at write: Disconnected sessionId: src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0
2025-09-30T14:59:47.758775Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3349 sessionId: src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0 is DEAD
2025-09-30T14:59:47.758958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:47.758971Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0] Write session will restart in 0.008959s
2025-09-30T14:59:47.759005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0] Write session: Do CDS request
2025-09-30T14:59:47.759011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:47.768824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:47.768994Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:47.769030Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3350
2025-09-30T14:59:47.769202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3350 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:47.769238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3350 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:47.769249Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3350 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:47.769253Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:47.769763Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3350 sessionId:  describe result for acl check
2025-09-30T14:59:47.769803Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:47.769805Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:47.769807Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:47.769816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897109854032743:8468] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:47.770427Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897109854032743:8468] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:47.773224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897109854032743:8468] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:47.776055Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897109854032743:8468] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:47.776074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897109854032743:8468] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:47.776079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897109854032743:8468] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:47.776088Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3350 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:47.776931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:47.779759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:47.780119Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:47.780136Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:47.780153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:47.780238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:47.780283Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897109764228334:13283]
2025-09-30T14:59:47.781013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:47.781422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:47.781488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:47.781852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:47.781940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.781949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.781950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.781951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.781953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.781954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.781956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.781957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.781959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.781961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.781962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.781963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.781965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.781966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.781967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.781974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.781997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.782001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.782006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.782011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.782016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.782021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.782025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.782028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.782033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.782038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.782042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.782047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.782051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.782055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.782066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.782076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.782082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.782089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.782095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.782101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.782112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.782118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.782125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.782132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.782137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.782144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.782156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.782162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.782174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.782180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.782191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.782197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.782207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.782216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.782228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.782235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.782240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.782246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.782252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.782259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.782264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.782271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.782276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.782282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.782335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:47.788248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:47.789504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:47.789523Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:47.789526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:47.789530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:47.789540Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3349 [2:7555897109764228334:13283]
2025-09-30T14:59:47.789556Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:47.789586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:47.789596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:47.789599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:47.789602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:47.789619Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:47.789631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:47.789639Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:47.789713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.789722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.789724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.789728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:47.789730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:47.789810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:47.789819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.789835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.789846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.789865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:47.789889Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032693:2454], now have 1 active actors on pipe
2025-09-30T14:59:47.789905Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897109764228329:13283]
2025-09-30T14:59:47.789908Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897109764228329:13283]
2025-09-30T14:59:47.789910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897109764228329:13283]
2025-09-30T14:59:47.789924Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:47.789935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032882:8468], now have 1 active actors on pipe
2025-09-30T14:59:47.789943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:47.789952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:47.789958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:47.789961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:47.789964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:47.789966Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:47.790000Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897109764228329:13283]
2025-09-30T14:59:47.790009Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:47.790019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:47.790003Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3349
2025-09-30T14:59:47.790015Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3349
2025-09-30T14:59:47.790190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.790204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.790239Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cad15111-fad4219b-a724269d-82fb25d8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:47.790254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:47.790263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:47.790265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:47.790276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:47.790290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:47.790314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:47.790469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.790480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.790504Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:47.790610Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3350 partition: 0 MaxSeqNo: 42 sessionId: src_id|cad15111-fad4219b-a724269d-82fb25d8_0
2025-09-30T14:59:47.791059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f9cc1e7a-2f7eecd-7259f4d9-ec44a293_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cad15111-fad4219b-a724269d-82fb25d8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:47.794225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cad15111-fad4219b-a724269d-82fb25d8_0] Write session: try to update token
2025-09-30T14:59:47.794255Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cad15111-fad4219b-a724269d-82fb25d8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:47.804026Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:47.804056Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:47.804059Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:47.804061Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:47.804072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897109764228329:13283]
2025-09-30T14:59:47.804077Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897109764228329:13283]
2025-09-30T14:59:47.804082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897109764228329:13283]
2025-09-30T14:59:47.804136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:47.804141Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:47.804145Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.804148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:47.804149Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:47.804153Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:47.804331Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:47.811685Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3350 sessionId: src_id|cad15111-fad4219b-a724269d-82fb25d8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:47.815684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:47.859326Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897109854032898:2695]
2025-09-30T14:59:47.863366Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 48 pipe creation result: OK TabletId: 72075186224037892 Generation: 3349, pipe: [1:7555897109854032898:2695]
2025-09-30T14:59:47.923960Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:47.924389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.924399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.924420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032898:2695], now have 1 active actors on pipe
2025-09-30T14:59:47.924742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:47.924779Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 48 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897109854032898:2695]
2025-09-30T14:59:47.924785Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:47.924790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:47.924812Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:47.924866Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3350 reason: error at write: Disconnected sessionId: src_id|cad15111-fad4219b-a724269d-82fb25d8_0
2025-09-30T14:59:47.925051Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3350 sessionId: src_id|cad15111-fad4219b-a724269d-82fb25d8_0 is DEAD
2025-09-30T14:59:47.925253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad15111-fad4219b-a724269d-82fb25d8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:47.925273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad15111-fad4219b-a724269d-82fb25d8_0] Write session will restart in 0.009914s
2025-09-30T14:59:47.925298Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad15111-fad4219b-a724269d-82fb25d8_0] Write session: Do CDS request
2025-09-30T14:59:47.925307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad15111-fad4219b-a724269d-82fb25d8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:47.936803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cad15111-fad4219b-a724269d-82fb25d8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:47.937245Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:47.937275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3351
2025-09-30T14:59:47.937401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3351 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:47.937433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3351 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:47.937439Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3351 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:47.937445Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:47.937997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3351 sessionId:  describe result for acl check
2025-09-30T14:59:47.938034Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:47.938043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:47.938045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:47.938050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897109854032992:8483] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:47.938604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897109854032992:8483] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:47.941687Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897109854032992:8483] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:47.944395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:47.947105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897109854032992:8483] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:47.947137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897109854032992:8483] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:47.947141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897109854032992:8483] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:47.947150Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3351 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:47.947297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:47.947555Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:47.947567Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:47.947578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:47.947646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:47.947689Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897109764228528:13285]
2025-09-30T14:59:47.948397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:47.948816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:47.948874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:47.949266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:47.949342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.949349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.949351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.949352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.949353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.949356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.949357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.949358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.949360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.949361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.949363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.949365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.949366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.949368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.949369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.949375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.949387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.949391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.949396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.949400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.949406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.949410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.949415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.949420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.949425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.949429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.949434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.949439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.949443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.949447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.949455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.949464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:47.949471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.949478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:47.949487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.949494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:47.949500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.949506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:47.949511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.949517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:47.949533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.949540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:47.949545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.949551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:47.949556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.949564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:47.949568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.949574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:47.949579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.949585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:47.949590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.949594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.949599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.949604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.949615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.949621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.949625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.949630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:47.949640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.949645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:47.949691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:47.957282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:47.958568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:47.958589Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:47.958592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:47.958597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:47.958607Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3350 [2:7555897109764228528:13285]
2025-09-30T14:59:47.958624Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:47.958640Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:47.958643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:47.958647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:47.958649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:47.958666Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:47.958675Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:47.958683Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:47.958763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.958774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.958776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.958780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:47.958782Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:47.958854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:47.958866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.958881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:47.958894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:47.958913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:47.958932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897109764228522:13285]
2025-09-30T14:59:47.958942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897109764228522:13285]
2025-09-30T14:59:47.958944Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897109764228522:13285]
2025-09-30T14:59:47.958956Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:47.958964Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:47.958968Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:47.958971Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:47.958972Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854033102:8483], now have 1 active actors on pipe
2025-09-30T14:59:47.958977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897109854032911:2454], now have 1 active actors on pipe
2025-09-30T14:59:47.958986Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:47.959002Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:47.959012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:47.959056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897109764228522:13285]
2025-09-30T14:59:47.959068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:47.959080Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:47.959079Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3350
2025-09-30T14:59:47.959084Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3350
2025-09-30T14:59:47.959153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.959164Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.959193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:47.959208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:47.959214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:47.959217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:47.959228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:47.959239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:47.959287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:47.959473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:47.959485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:47.959501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:47.959594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3351 partition: 0 MaxSeqNo: 42 sessionId: src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0
2025-09-30T14:59:47.960005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad15111-fad4219b-a724269d-82fb25d8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:47.962980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0] Write session: try to update token
2025-09-30T14:59:47.963004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:47.972867Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:47.972893Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:47.972896Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:47.972898Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:47.972909Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897109764228522:13285]
2025-09-30T14:59:47.972915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897109764228522:13285]
2025-09-30T14:59:47.972919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897109764228522:13285]
2025-09-30T14:59:47.972967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:47.972980Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:47.972982Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:47.973154Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:47.973409Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:47.973439Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:47.973448Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:47.981330Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3351 sessionId: src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:47.984264Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:48.025044Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897114149000424:2695]
2025-09-30T14:59:48.025382Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 49 pipe creation result: OK TabletId: 72075186224037892 Generation: 3350, pipe: [1:7555897114149000424:2695]
2025-09-30T14:59:48.108408Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:48.108827Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.108854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.108876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149000424:2695], now have 1 active actors on pipe
2025-09-30T14:59:48.109172Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:48.109683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:48.109696Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0] Write session will restart in 0.006383s
2025-09-30T14:59:48.109734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0] Write session: Do CDS request
2025-09-30T14:59:48.109741Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:48.109212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 49 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897114149000424:2695]
2025-09-30T14:59:48.109227Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:48.109232Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:48.109251Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:48.109303Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3351 reason: error at write: Disconnected sessionId: src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0
2025-09-30T14:59:48.109503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3351 sessionId: src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0 is DEAD
2025-09-30T14:59:48.117859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:48.118137Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:48.118155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3352
2025-09-30T14:59:48.118318Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3352 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:48.118354Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3352 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:48.118364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3352 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:48.118368Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:48.118820Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3352 sessionId:  describe result for acl check
2025-09-30T14:59:48.118861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:48.118863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:48.118865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:48.118871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897114149000457:8502] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:48.119487Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897114149000457:8502] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:48.122203Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897114149000457:8502] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:48.125906Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897114149000457:8502] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:48.125923Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897114149000457:8502] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:48.125927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897114149000457:8502] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:48.125936Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3352 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:48.127627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:48.130382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:48.130783Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:48.130794Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:48.130806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:48.130870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:48.130920Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897114059196055:13299]
2025-09-30T14:59:48.131605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:48.131969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:48.132018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:48.132387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:48.132477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.132484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.132486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.132487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.132489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.132490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.132492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.132493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.132495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.132496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.132497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.132498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.132499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.132501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.132502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.132509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.132520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.132524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.132528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.132532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.132537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.132542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.132546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.132550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.132556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.132560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.132564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.132568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.132573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.132577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.132585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.132593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.132599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.132606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.132611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.132617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.132622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.132632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.132637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.132642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.132649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.132653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.132659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.132665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.132670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.132676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.132681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.132687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.132692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.132697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.132702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.132708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.132714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.132719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.132726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.132732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.132736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.132741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.132745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.132750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.132796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:48.138740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:48.139958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:48.139977Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:48.139980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:48.139984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:48.139991Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3351 [2:7555897114059196055:13299]
2025-09-30T14:59:48.140009Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:48.140026Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:48.140030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:48.140033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:48.140035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:48.140057Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:48.140064Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:48.140071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:48.140141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.140152Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.140153Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.140157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:48.140159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:48.140348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:48.140358Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.140371Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.140384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.140404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:48.140442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897114059196050:13299]
2025-09-30T14:59:48.140444Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897114059196050:13299]
2025-09-30T14:59:48.140446Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897114059196050:13299]
2025-09-30T14:59:48.140462Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:48.140478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:48.140495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:48.140503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:48.140542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897114059196050:13299]
2025-09-30T14:59:48.140550Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:48.140578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149000622:8502], now have 1 active actors on pipe
2025-09-30T14:59:48.140590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149000437:2454], now have 1 active actors on pipe
2025-09-30T14:59:48.140620Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:48.140632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:48.140636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:48.140642Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:48.140800Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3351
2025-09-30T14:59:48.140847Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3351
2025-09-30T14:59:48.140854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.140868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.140912Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2feb5843-5ad4564c-ac609c68-34711c86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:48.140930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:48.140935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:48.140938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:48.140949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:48.140976Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:48.140997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:48.141246Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.141261Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.141284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:48.141437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3352 partition: 0 MaxSeqNo: 42 sessionId: src_id|2feb5843-5ad4564c-ac609c68-34711c86_0
2025-09-30T14:59:48.141965Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e38570a1-c15e6d58-c230e57b-80f7f8db_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2feb5843-5ad4564c-ac609c68-34711c86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:48.145138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2feb5843-5ad4564c-ac609c68-34711c86_0] Write session: try to update token
2025-09-30T14:59:48.145163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2feb5843-5ad4564c-ac609c68-34711c86_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:48.154423Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:48.154459Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:48.154471Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897114059196050:13299]
2025-09-30T14:59:48.154539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:48.154540Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:48.154876Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:48.155123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:48.155360Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:48.155771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:48.156105Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:48.156174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:48.162218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3352 sessionId: src_id|2feb5843-5ad4564c-ac609c68-34711c86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:48.165431Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:48.165885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.165919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.165944Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:48.165947Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:48.165950Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:48.165952Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:48.165962Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897114059196050:13299]
2025-09-30T14:59:48.165967Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897114059196050:13299]
2025-09-30T14:59:48.165973Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897114059196050:13299]
2025-09-30T14:59:48.166013Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:48.166028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:48.166030Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:48.166035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.166039Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:48.166039Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:48.166217Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:48.209346Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897114149000641:2695]
2025-09-30T14:59:48.210222Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 50 pipe creation result: OK TabletId: 72075186224037892 Generation: 3351, pipe: [1:7555897114149000641:2695]
2025-09-30T14:59:48.283318Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:48.283723Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:48.283763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149000641:2695], now have 1 active actors on pipe
2025-09-30T14:59:48.284141Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:48.284254Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:48.284263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:48.284350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3352 reason: error at write: Disconnected sessionId: src_id|2feb5843-5ad4564c-ac609c68-34711c86_0
2025-09-30T14:59:48.284519Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3352 sessionId: src_id|2feb5843-5ad4564c-ac609c68-34711c86_0 is DEAD
2025-09-30T14:59:48.284707Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2feb5843-5ad4564c-ac609c68-34711c86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:48.284720Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2feb5843-5ad4564c-ac609c68-34711c86_0] Write session will restart in 0.007006s
2025-09-30T14:59:48.284762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2feb5843-5ad4564c-ac609c68-34711c86_0] Write session: Do CDS request
2025-09-30T14:59:48.284772Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2feb5843-5ad4564c-ac609c68-34711c86_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:48.284939Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 50 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897114149000641:2695]
2025-09-30T14:59:48.284962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:48.292868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2feb5843-5ad4564c-ac609c68-34711c86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:48.292982Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:48.293014Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3353
2025-09-30T14:59:48.293162Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3353 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:48.293199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3353 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:48.293209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3353 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:48.293215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:48.293756Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3353 sessionId:  describe result for acl check
2025-09-30T14:59:48.293821Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:48.293833Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:48.293836Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:48.293845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897114149000658:8522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:48.294510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897114149000658:8522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:48.297503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897114149000658:8522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:48.301625Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897114149000658:8522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:48.301646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897114149000658:8522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:48.301650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897114149000658:8522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:48.301659Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3353 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:48.305402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:48.308004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:48.308270Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:48.308285Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:48.308298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:48.308361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:48.308680Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897114059196253:13302]
2025-09-30T14:59:48.309405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:48.316906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:48.317044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:48.317528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:48.317632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.317634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.317635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.317637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.317638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.317640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.317641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.317643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.317644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.317646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.317647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.317649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.317650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.317652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.317653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.317659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.317670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.317675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.317680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.317685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.317690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.317694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.317699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.317704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.317709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.317714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.317718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.317723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.317728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.317732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.317743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.317753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.317760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.317767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.317773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.317778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.317786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.317792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.317797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.317804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.317808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.317815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.317820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.317827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.317832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.317838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.317843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.317849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.317854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.317860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.317866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.317871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.317876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.317881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.317890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.317897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.317902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.317909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.317915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.317921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.317972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:48.324313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:48.326035Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3352
2025-09-30T14:59:48.326078Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3352
2025-09-30T14:59:48.325553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:48.325561Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:48.325563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:48.325567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:48.325574Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3352 [2:7555897114059196253:13302]
2025-09-30T14:59:48.325590Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:48.325610Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:48.325614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:48.325618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:48.325620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:48.325638Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:48.325645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:48.325653Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:48.325720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.325723Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.325725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.325729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:48.325731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:48.325813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:48.325816Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.325830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.325841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.325856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:48.325874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149000818:8522], now have 1 active actors on pipe
2025-09-30T14:59:48.325881Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897114059196248:13302]
2025-09-30T14:59:48.325884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897114059196248:13302]
2025-09-30T14:59:48.325886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897114059196248:13302]
2025-09-30T14:59:48.325903Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:48.325914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149000643:2454], now have 1 active actors on pipe
2025-09-30T14:59:48.325923Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:48.325936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:48.325939Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:48.325981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897114059196248:13302]
2025-09-30T14:59:48.325983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:48.326031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:48.326037Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:48.326040Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:48.326046Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:48.326548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.326565Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.326607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:48.326617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:48.326621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:48.326623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:48.326635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:48.326647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:48.326665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:48.326861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.326868Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.326892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:48.326976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3353 partition: 0 MaxSeqNo: 42 sessionId: src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0
2025-09-30T14:59:48.327469Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2feb5843-5ad4564c-ac609c68-34711c86_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:48.330672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0] Write session: try to update token
2025-09-30T14:59:48.330700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:48.340757Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:48.340782Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:48.340793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897114059196248:13302]
2025-09-30T14:59:48.340851Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:48.341079Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:48.341275Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:48.341465Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:48.341647Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:48.341919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:48.341985Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:48.342084Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:48.352694Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3353 sessionId: src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:48.353739Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:48.353766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:48.353768Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:48.353771Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:48.353784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897114059196248:13302]
2025-09-30T14:59:48.353792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897114059196248:13302]
2025-09-30T14:59:48.353797Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897114059196248:13302]
2025-09-30T14:59:48.353840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:48.353848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.353851Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:48.354018Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:48.355324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:48.355345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:48.355349Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:48.355947Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:48.384961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897114149000852:2695]
2025-09-30T14:59:48.385313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 51 pipe creation result: OK TabletId: 72075186224037892 Generation: 3352, pipe: [1:7555897114149000852:2695]
2025-09-30T14:59:48.475040Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:48.475549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.475571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.475593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149000852:2695], now have 1 active actors on pipe
2025-09-30T14:59:48.478077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 51 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897114149000852:2695]
2025-09-30T14:59:48.478011Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:48.478627Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:48.478638Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0] Write session will restart in 0.008332s
2025-09-30T14:59:48.478670Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0] Write session: Do CDS request
2025-09-30T14:59:48.478677Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:48.478146Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:48.478156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:48.478238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3353 reason: error at write: Disconnected sessionId: src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0
2025-09-30T14:59:48.478354Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:48.478433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3353 sessionId: src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0 is DEAD
2025-09-30T14:59:48.491788Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:48.493129Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:48.493148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3354
2025-09-30T14:59:48.493336Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3354 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:48.493383Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3354 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:48.493389Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3354 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:48.493395Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:48.494437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3354 sessionId:  describe result for acl check
2025-09-30T14:59:48.494482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:48.494484Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:48.494486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:48.494493Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897114149000882:8530] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:48.495076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897114149000882:8530] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:48.503414Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897114149000882:8530] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:48.507665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897114149000882:8530] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:48.507685Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897114149000882:8530] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:48.507689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897114149000882:8530] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:48.507709Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3354 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:48.510179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:48.513660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:48.513999Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:48.514021Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:48.514034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:48.514108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:48.514170Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897114059196450:13304]
2025-09-30T14:59:48.514936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:48.515483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:48.515572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:48.515997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:48.516076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.516078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.516079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.516080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.516082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.516083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.516085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.516086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.516088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.516089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.516090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.516091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.516093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.516094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.516096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.516102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.516111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.516115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.516120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.516124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.516128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.516132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.516136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.516141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.516145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.516149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.516153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.516157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.516162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.516166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.516175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.516184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.516190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.516196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.516200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.516207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.516213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.516219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.516224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.516230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.516235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.516241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.516246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.516252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.516258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.516263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.516268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.516274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.516279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.516285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.516290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.516296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.516301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.516307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.516312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.516317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.516322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.516328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.516333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.516338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.516385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:48.523236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:48.524216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:48.524236Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:48.524240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:48.524244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:48.524252Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3353 [2:7555897114059196450:13304]
2025-09-30T14:59:48.524273Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:48.524293Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:48.524297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:48.524300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:48.524303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:48.524322Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:48.524331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:48.524339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:48.524413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.524439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.524442Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.524447Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:48.524450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:48.524547Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:48.524555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.524571Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.524590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.524615Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:48.524643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149001041:8530], now have 1 active actors on pipe
2025-09-30T14:59:48.524654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149000857:2454], now have 1 active actors on pipe
2025-09-30T14:59:48.524661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897114059196445:13304]
2025-09-30T14:59:48.524664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897114059196445:13304]
2025-09-30T14:59:48.524667Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897114059196445:13304]
2025-09-30T14:59:48.524685Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:48.524704Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:48.524726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:48.524734Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:48.524777Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897114059196445:13304]
2025-09-30T14:59:48.524785Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:48.524798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:48.524811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:48.524813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:48.524761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3353
2025-09-30T14:59:48.524821Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:48.524773Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3353
2025-09-30T14:59:48.524936Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.524947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.524974Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:48.524986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:48.524992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:48.524999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:48.525015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:48.525026Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:48.525048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:48.525296Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.525312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.525336Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:48.525470Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3354 partition: 0 MaxSeqNo: 42 sessionId: src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0
2025-09-30T14:59:48.525871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d23da245-dc68a992-6a432dc0-eaab6e2d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:48.529182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0] Write session: try to update token
2025-09-30T14:59:48.529216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:48.539028Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:48.539067Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:48.539070Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:48.539073Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:48.539082Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897114059196445:13304]
2025-09-30T14:59:48.539088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897114059196445:13304]
2025-09-30T14:59:48.539092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897114059196445:13304]
2025-09-30T14:59:48.539140Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:48.539148Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.539151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:48.539339Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:48.542313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:48.542340Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:48.542346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:48.551282Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3354 sessionId: src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:48.554471Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:48.579461Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897114149001063:2695]
2025-09-30T14:59:48.580356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 52 pipe creation result: OK TabletId: 72075186224037892 Generation: 3353, pipe: [1:7555897114149001063:2695]
2025-09-30T14:59:48.731141Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:48.731830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.731854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.731877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149001063:2695], now have 1 active actors on pipe
2025-09-30T14:59:48.732138Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:48.732168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:48.732239Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3354 reason: error at write: Disconnected sessionId: src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0
2025-09-30T14:59:48.732299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:48.732649Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:48.732661Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0] Write session will restart in 0.009621s
2025-09-30T14:59:48.732694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0] Write session: Do CDS request
2025-09-30T14:59:48.732700Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:48.732467Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3354 sessionId: src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0 is DEAD
2025-09-30T14:59:48.732535Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:48.732594Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 52 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897114149001063:2695]
2025-09-30T14:59:48.744254Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:48.744360Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:48.744378Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3355
2025-09-30T14:59:48.744577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3355 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:48.744629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3355 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:48.744641Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3355 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:48.744646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:48.745133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3355 sessionId:  describe result for acl check
2025-09-30T14:59:48.745173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:48.745183Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:48.745185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:48.745192Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897114149001138:8533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:48.745794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897114149001138:8533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:48.749067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897114149001138:8533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:48.751735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:48.755091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:48.755399Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:48.755415Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:48.755430Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:48.755509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:48.755563Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897114059196663:13308]
2025-09-30T14:59:48.755471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897114149001138:8533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:48.755494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897114149001138:8533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:48.755499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897114149001138:8533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:48.755509Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3355 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:48.756259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:48.756674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:48.756760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:48.757160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:48.757268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.757278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.757280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.757281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.757283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.757284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.757286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.757287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.757289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.757290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.757292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.757293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.757295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.757296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.757297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.757304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.757315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.757319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.757324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.757327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.757332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.757336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.757340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.757343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.757347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.757351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.757354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.757358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.757361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.757366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.757375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.757384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.757390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.757397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.757402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.757406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.757411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.757416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.757421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.757427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.757431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.757437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.757442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.757449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.757453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.757458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.757475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.757481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.757486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.757491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.757496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.757501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.757506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.757510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.757516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.757521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.757526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.757533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.757539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.757543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.757593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:48.763999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:48.765255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:48.765281Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:48.765284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:48.765288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:48.765296Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3354 [2:7555897114059196663:13308]
2025-09-30T14:59:48.765317Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:48.765336Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:48.765342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:48.765346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:48.765348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:48.765367Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:48.765380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:48.765388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:48.765464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.765472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.765475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.765478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:48.765482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:48.765558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:48.765566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.765581Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.765592Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.765613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:48.765638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897114059196658:13308]
2025-09-30T14:59:48.765646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897114059196658:13308]
2025-09-30T14:59:48.765648Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897114059196658:13308]
2025-09-30T14:59:48.765659Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:48.765676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149001260:8533], now have 1 active actors on pipe
2025-09-30T14:59:48.765684Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:48.765689Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:48.765690Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149001066:2454], now have 1 active actors on pipe
2025-09-30T14:59:48.765694Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:48.765699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:48.765714Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:48.765717Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:48.765772Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897114059196658:13308]
2025-09-30T14:59:48.765782Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:48.765820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:48.766002Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3354
2025-09-30T14:59:48.766048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3354
2025-09-30T14:59:48.766108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.766127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.766161Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|79fda56-2b39a65-fa413199-a5eea3f5_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:48.766187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:48.766193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:48.766201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:48.766215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:48.766235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:48.766259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:48.767749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.767766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.767796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:48.768021Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3355 partition: 0 MaxSeqNo: 42 sessionId: src_id|79fda56-2b39a65-fa413199-a5eea3f5_0
2025-09-30T14:59:48.768470Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b51006e6-2ef873a9-ce7a2859-db6ab65_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|79fda56-2b39a65-fa413199-a5eea3f5_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:48.771629Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79fda56-2b39a65-fa413199-a5eea3f5_0] Write session: try to update token
2025-09-30T14:59:48.771654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79fda56-2b39a65-fa413199-a5eea3f5_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:48.790650Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:48.790676Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:48.790691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897114059196658:13308]
2025-09-30T14:59:48.790755Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:48.790983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:48.791084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:48.791287Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:48.791459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:48.791633Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:48.791866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:48.791926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:48.796174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3355 sessionId: src_id|79fda56-2b39a65-fa413199-a5eea3f5_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:48.799982Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:48.800537Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.800567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.800589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:48.800592Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:48.800595Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:48.800597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:48.800608Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897114059196658:13308]
2025-09-30T14:59:48.800613Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897114059196658:13308]
2025-09-30T14:59:48.800616Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897114059196658:13308]
2025-09-30T14:59:48.800670Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:48.800670Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:48.800676Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:48.800680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:48.800686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.800689Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:48.800854Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:48.833439Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897114149001272:2695]
2025-09-30T14:59:48.833825Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 53 pipe creation result: OK TabletId: 72075186224037892 Generation: 3354, pipe: [1:7555897114149001272:2695]
2025-09-30T14:59:48.920097Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:48.920840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:48.920891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149001272:2695], now have 1 active actors on pipe
2025-09-30T14:59:48.921750Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79fda56-2b39a65-fa413199-a5eea3f5_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:48.921762Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79fda56-2b39a65-fa413199-a5eea3f5_0] Write session will restart in 0.006815s
2025-09-30T14:59:48.921787Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79fda56-2b39a65-fa413199-a5eea3f5_0] Write session: Do CDS request
2025-09-30T14:59:48.921793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79fda56-2b39a65-fa413199-a5eea3f5_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:48.921038Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:48.921124Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 53 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897114149001272:2695]
2025-09-30T14:59:48.921147Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:48.921152Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:48.921155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:48.921241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3355 reason: error at write: Disconnected sessionId: src_id|79fda56-2b39a65-fa413199-a5eea3f5_0
2025-09-30T14:59:48.921444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3355 sessionId: src_id|79fda56-2b39a65-fa413199-a5eea3f5_0 is DEAD
2025-09-30T14:59:48.929889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|79fda56-2b39a65-fa413199-a5eea3f5_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:48.929944Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:48.929966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3356
2025-09-30T14:59:48.930158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3356 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:48.930207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3356 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:48.930213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3356 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:48.930218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:48.930688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3356 sessionId:  describe result for acl check
2025-09-30T14:59:48.930734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:48.930736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:48.930738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:48.930748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897114149001302:8538] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:48.931749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897114149001302:8538] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:48.933792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897114149001302:8538] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:48.938961Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897114149001302:8538] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:48.938987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897114149001302:8538] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:48.938991Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897114149001302:8538] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:48.939000Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3356 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:48.945173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:48.948906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:48.949161Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:48.949179Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:48.949192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:48.949276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:48.949325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897114059196863:13310]
2025-09-30T14:59:48.950051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:48.950657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:48.950721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:48.951123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:48.951192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.951194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.951195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.951197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.951198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.951200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.951201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.951203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.951205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.951206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.951207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.951209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.951211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.951212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.951213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.951220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.951231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.951235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.951239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.951259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.951264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.951268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.951273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.951278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.951283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.951286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.951291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.951296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.951300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.951305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.951316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.951325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:48.951333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.951339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:48.951345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.951350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:48.951354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.951359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:48.951365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.951370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:48.951375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.951381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:48.951386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.951392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:48.951397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.951403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:48.951407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.951412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:48.951417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.951422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:48.951427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.951436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.951440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.951445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.951452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.951456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.951461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.951467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:48.951472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.951478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:48.951528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:48.959629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:48.961122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:48.961144Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:48.961146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:48.961152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:48.961160Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3355 [2:7555897114059196863:13310]
2025-09-30T14:59:48.961181Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:48.961198Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:48.961209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:48.961213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:48.961215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:48.961234Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:48.961250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:48.961259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:48.961333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.961341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.961344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.961348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:48.961351Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:48.961429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:48.961437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.961454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:48.961473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:48.961498Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:48.961525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897114059196858:13310]
2025-09-30T14:59:48.961527Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897114059196858:13310]
2025-09-30T14:59:48.961530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897114059196858:13310]
2025-09-30T14:59:48.961546Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:48.961561Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:48.961577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:48.961581Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:48.961624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897114059196858:13310]
2025-09-30T14:59:48.961627Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:48.961723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:48.961727Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:48.961730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:48.961736Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:48.961893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149001289:2454], now have 1 active actors on pipe
2025-09-30T14:59:48.961904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897114149001412:8538], now have 1 active actors on pipe
2025-09-30T14:59:48.961967Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3355
2025-09-30T14:59:48.961986Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3355
2025-09-30T14:59:48.962236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.962247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.962275Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|978b0718-5d78175f-defdc87f-ccfd0863_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:48.962285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:48.962290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:48.962292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:48.962305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:48.962316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:48.962333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:48.962729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.962741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.962757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:48.966411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3356 partition: 0 MaxSeqNo: 42 sessionId: src_id|978b0718-5d78175f-defdc87f-ccfd0863_0
2025-09-30T14:59:48.966853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|79fda56-2b39a65-fa413199-a5eea3f5_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|978b0718-5d78175f-defdc87f-ccfd0863_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:48.970024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|978b0718-5d78175f-defdc87f-ccfd0863_0] Write session: try to update token
2025-09-30T14:59:48.970050Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|978b0718-5d78175f-defdc87f-ccfd0863_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:48.979608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:48.979629Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:48.979640Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897114059196858:13310]
2025-09-30T14:59:48.979695Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:48.979706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:48.980033Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:48.980226Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:48.980392Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:48.980575Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:48.980909Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:48.980951Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:48.986586Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3356 sessionId: src_id|978b0718-5d78175f-defdc87f-ccfd0863_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:48.989713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:48.990621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:48.990653Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:48.990678Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:48.990686Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:48.990690Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:48.990693Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:48.990702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897114059196858:13310]
2025-09-30T14:59:48.990707Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897114059196858:13310]
2025-09-30T14:59:48.990711Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897114059196858:13310]
2025-09-30T14:59:48.990756Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:48.990763Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:48.990771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:48.990771Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:48.990774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:48.990776Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:48.990921Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:49.021428Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897118443968793:2695]
2025-09-30T14:59:49.026480Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 54 pipe creation result: OK TabletId: 72075186224037892 Generation: 3355, pipe: [1:7555897118443968793:2695]
2025-09-30T14:59:49.112475Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:49.113092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:49.113138Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443968793:2695], now have 1 active actors on pipe
2025-09-30T14:59:49.115142Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:49.115724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978b0718-5d78175f-defdc87f-ccfd0863_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:49.115737Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978b0718-5d78175f-defdc87f-ccfd0863_0] Write session will restart in 0.006243s
2025-09-30T14:59:49.115763Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978b0718-5d78175f-defdc87f-ccfd0863_0] Write session: Do CDS request
2025-09-30T14:59:49.115768Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978b0718-5d78175f-defdc87f-ccfd0863_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:49.115261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:49.115270Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:49.115347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3356 reason: error at write: Disconnected sessionId: src_id|978b0718-5d78175f-defdc87f-ccfd0863_0
2025-09-30T14:59:49.115517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3356 sessionId: src_id|978b0718-5d78175f-defdc87f-ccfd0863_0 is DEAD
2025-09-30T14:59:49.115681Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 54 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897118443968793:2695]
2025-09-30T14:59:49.115696Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:49.122814Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|978b0718-5d78175f-defdc87f-ccfd0863_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:49.122922Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:49.122949Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3357
2025-09-30T14:59:49.123049Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3357 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:49.123081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3357 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:49.123089Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3357 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:49.123097Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:49.123546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3357 sessionId:  describe result for acl check
2025-09-30T14:59:49.123585Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:49.123587Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:49.123589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:49.123595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897118443968823:8573] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:49.124156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897118443968823:8573] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:49.127598Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897118443968823:8573] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:49.132046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897118443968823:8573] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:49.132067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897118443968823:8573] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:49.132071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897118443968823:8573] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:49.132080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3357 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:49.136073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:49.139391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:49.139656Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:49.139669Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:49.139681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:49.139742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:49.139791Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897118354164395:13318]
2025-09-30T14:59:49.140496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:49.140936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:49.141007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:49.141379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:49.141473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.141483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.141485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.141486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.141487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.141489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.141490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.141491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.141493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.141494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.141496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.141497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.141498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.141499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.141500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.141507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.141518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.141523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.141527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.141532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.141536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.141540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.141544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.141548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.141556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.141560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.141564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.141568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.141572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.141576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.141588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.141596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.141603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.141608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.141613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.141618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.141623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.141628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.141633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.141638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.141644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.141649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.141653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.141659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.141663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.141667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.141673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.141678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.141683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.141689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.141693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.141698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.141703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.141709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.141714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.141719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.141724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.141728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.141733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.141737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.141779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:49.147969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:49.149137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:49.149155Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:49.149158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:49.149163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:49.149171Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3356 [2:7555897118354164395:13318]
2025-09-30T14:59:49.149190Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:49.149208Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:49.149212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:49.149216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:49.149219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:49.149236Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:49.149243Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:49.149250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:49.149319Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.149330Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.149332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.149336Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:49.149339Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:49.149417Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:49.149426Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.149440Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.149451Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.149467Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:49.149490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897118354164389:13318]
2025-09-30T14:59:49.149499Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897118354164389:13318]
2025-09-30T14:59:49.149501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897118354164389:13318]
2025-09-30T14:59:49.149511Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:49.149523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:49.149527Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:49.149528Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:49.149530Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:49.149544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:49.149552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:49.149564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443968808:2454], now have 1 active actors on pipe
2025-09-30T14:59:49.149568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443969000:8573], now have 1 active actors on pipe
2025-09-30T14:59:49.149606Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897118354164389:13318]
2025-09-30T14:59:49.149615Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:49.149631Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:49.149590Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3356
2025-09-30T14:59:49.149614Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3356
2025-09-30T14:59:49.149878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.149897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.149945Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|151f6011-785d3e7b-587c80d1-a7172a98_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:49.149956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:49.149961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:49.149963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:49.149985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:49.149998Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:49.150018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:49.150251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.150266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.150290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:49.150416Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3357 partition: 0 MaxSeqNo: 42 sessionId: src_id|151f6011-785d3e7b-587c80d1-a7172a98_0
2025-09-30T14:59:49.150871Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|978b0718-5d78175f-defdc87f-ccfd0863_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|151f6011-785d3e7b-587c80d1-a7172a98_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:49.153905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151f6011-785d3e7b-587c80d1-a7172a98_0] Write session: try to update token
2025-09-30T14:59:49.153929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151f6011-785d3e7b-587c80d1-a7172a98_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:49.164579Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:49.164607Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:49.164610Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:49.164612Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:49.164623Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897118354164389:13318]
2025-09-30T14:59:49.164627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897118354164389:13318]
2025-09-30T14:59:49.164636Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897118354164389:13318]
2025-09-30T14:59:49.164686Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:49.164693Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.164696Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:49.164696Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:49.164703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:49.164708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:49.164882Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:49.177943Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3357 sessionId: src_id|151f6011-785d3e7b-587c80d1-a7172a98_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:49.180840Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:49.215891Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897118443969026:2695]
2025-09-30T14:59:49.216556Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 55 pipe creation result: OK TabletId: 72075186224037892 Generation: 3356, pipe: [1:7555897118443969026:2695]
2025-09-30T14:59:49.284493Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:49.285021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.285044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.285068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443969026:2695], now have 1 active actors on pipe
2025-09-30T14:59:49.285351Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:49.285450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 55 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897118443969026:2695]
2025-09-30T14:59:49.285862Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:49.285945Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3357 reason: status is not ok: tablet will be restarted right now sessionId: src_id|151f6011-785d3e7b-587c80d1-a7172a98_0
2025-09-30T14:59:49.285980Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:49.286123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3357 sessionId: src_id|151f6011-785d3e7b-587c80d1-a7172a98_0 is DEAD
2025-09-30T14:59:49.286573Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151f6011-785d3e7b-587c80d1-a7172a98_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:49.286585Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151f6011-785d3e7b-587c80d1-a7172a98_0] Write session will restart in 0.005879s
2025-09-30T14:59:49.286621Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151f6011-785d3e7b-587c80d1-a7172a98_0] Write session: Do CDS request
2025-09-30T14:59:49.286628Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151f6011-785d3e7b-587c80d1-a7172a98_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:49.294423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|151f6011-785d3e7b-587c80d1-a7172a98_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:49.294829Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:49.294847Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3358
2025-09-30T14:59:49.294954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3358 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:49.294982Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3358 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:49.294988Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3358 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:49.294992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:49.295419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3358 sessionId:  describe result for acl check
2025-09-30T14:59:49.295460Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:49.295462Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:49.295464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:49.295471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897118443969041:8583] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:49.296043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897118443969041:8583] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:49.299131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897118443969041:8583] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:49.314515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897118443969041:8583] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:49.314536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897118443969041:8583] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:49.314539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897118443969041:8583] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:49.314549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3358 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:49.315530Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:49.319215Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:49.319820Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:49.319839Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:49.319855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:49.319940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:49.319989Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897118354164598:13327]
2025-09-30T14:59:49.320714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:49.321677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:49.321772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:49.322191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:49.322271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.322273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.322274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.322276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.322277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.322279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.322280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.322283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.322284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.322286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.322288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.322289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.322291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.322293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.322294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.322311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.322322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.322326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.322331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.322336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.322341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.322346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.322350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.322354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.322358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.322362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.322366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.322370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.322373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.322376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.322387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.322395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.322401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.322407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.322413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.322417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.322421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.322427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.322433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.322438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.322443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.322448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.322464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.322469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.322475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.322480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.322485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.322490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.322497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.322503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.322509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.322514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.322519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.322524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.322529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.322535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.322540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.322545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.322551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.322559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.322608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:49.335606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:49.336817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:49.336842Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:49.336844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:49.336849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:49.336857Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3357 [2:7555897118354164598:13327]
2025-09-30T14:59:49.336876Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:49.336896Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:49.336899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:49.336903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:49.336906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:49.336924Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:49.336943Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:49.336950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:49.337020Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.337028Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.337030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.337033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:49.337036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:49.337113Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:49.337120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.337133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.337146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.337169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:49.337194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443969226:8583], now have 1 active actors on pipe
2025-09-30T14:59:49.337203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443969027:2454], now have 1 active actors on pipe
2025-09-30T14:59:49.337209Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897118354164593:13327]
2025-09-30T14:59:49.337212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897118354164593:13327]
2025-09-30T14:59:49.337214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897118354164593:13327]
2025-09-30T14:59:49.337227Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:49.337240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:49.337241Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:49.337244Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:49.337247Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:49.337257Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:49.337268Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:49.337316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3357
2025-09-30T14:59:49.337306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897118354164593:13327]
2025-09-30T14:59:49.337318Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:49.337330Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3357
2025-09-30T14:59:49.337325Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:49.337412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.337430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.337460Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8ddab354-acb38f94-ca952048-394a389b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:49.337475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:49.337484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:49.337488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:49.337499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:49.337519Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:49.337551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:49.337731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.337740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.337756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:49.337848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3358 partition: 0 MaxSeqNo: 42 sessionId: src_id|8ddab354-acb38f94-ca952048-394a389b_0
2025-09-30T14:59:49.338226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|151f6011-785d3e7b-587c80d1-a7172a98_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8ddab354-acb38f94-ca952048-394a389b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:49.341546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddab354-acb38f94-ca952048-394a389b_0] Write session: try to update token
2025-09-30T14:59:49.341575Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddab354-acb38f94-ca952048-394a389b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:49.351658Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:49.351689Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:49.351692Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:49.351694Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:49.351703Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897118354164593:13327]
2025-09-30T14:59:49.351709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897118354164593:13327]
2025-09-30T14:59:49.351713Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897118354164593:13327]
2025-09-30T14:59:49.351761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:49.351768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.351771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:49.351774Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:49.351793Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:49.351809Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:49.351927Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:49.369211Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3358 sessionId: src_id|8ddab354-acb38f94-ca952048-394a389b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:49.372210Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:49.388756Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897118443969254:2695]
2025-09-30T14:59:49.389304Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 56 pipe creation result: OK TabletId: 72075186224037892 Generation: 3357, pipe: [1:7555897118443969254:2695]
2025-09-30T14:59:49.481043Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:49.481060Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:49.481060Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:49.479994Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:49.480436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.480447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.480469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443969254:2695], now have 1 active actors on pipe
2025-09-30T14:59:49.480951Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:49.481466Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddab354-acb38f94-ca952048-394a389b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:49.481475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddab354-acb38f94-ca952048-394a389b_0] Write session will restart in 0.008813s
2025-09-30T14:59:49.481502Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddab354-acb38f94-ca952048-394a389b_0] Write session: Do CDS request
2025-09-30T14:59:49.481511Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddab354-acb38f94-ca952048-394a389b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:49.481105Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 56 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897118443969254:2695]
2025-09-30T14:59:49.481123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3358 reason: error at write: Disconnected sessionId: src_id|8ddab354-acb38f94-ca952048-394a389b_0
2025-09-30T14:59:49.481297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3358 sessionId: src_id|8ddab354-acb38f94-ca952048-394a389b_0 is DEAD
2025-09-30T14:59:49.491794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddab354-acb38f94-ca952048-394a389b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:49.492275Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:49.492295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3359
2025-09-30T14:59:49.492549Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3359 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:49.492607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3359 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:49.492613Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3359 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:49.492618Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:49.493066Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3359 sessionId:  describe result for acl check
2025-09-30T14:59:49.493092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:49.493094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:49.493096Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:49.493103Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897118443969274:8586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:49.493683Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897118443969274:8586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:49.502488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897118443969274:8586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:49.513052Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897118443969274:8586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:49.513071Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897118443969274:8586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:49.513075Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897118443969274:8586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:49.513085Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3359 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:49.522701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:49.526776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:49.526977Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:49.526980Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:49.526989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:49.527041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:49.527076Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897118354164801:13329]
2025-09-30T14:59:49.527733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:49.528225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:49.528306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:49.528718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:49.528809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.528810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.528812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.528813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.528815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.528816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.528818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.528820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.528821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.528823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.528824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.528825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.528827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.528828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.528829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.528836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.528859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.528863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.528868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.528873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.528878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.528883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.528887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.528891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.528896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.528900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.528904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.528908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.528912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.528916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.528926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.528934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.528939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.528945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.528952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.528957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.528961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.528966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.528971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.528977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.528981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.528986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.528992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.528997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.529002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.529008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.529014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.529019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.529024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.529029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.529034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.529040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.529044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.529049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.529054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.529059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.529066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.529071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.529076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.529081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.529144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:49.535141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:49.536494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:49.536520Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:49.536523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:49.536527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:49.536535Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3358 [2:7555897118354164801:13329]
2025-09-30T14:59:49.536553Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:49.536570Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:49.536574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:49.536578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:49.536581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:49.536600Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:49.536607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:49.536616Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:49.536687Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.536700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.536702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.536706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:49.536709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:49.536774Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:49.536784Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.536800Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.536813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.536831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:49.536853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443969408:8586], now have 1 active actors on pipe
2025-09-30T14:59:49.536857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443969259:2454], now have 1 active actors on pipe
2025-09-30T14:59:49.536865Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897118354164794:13329]
2025-09-30T14:59:49.536870Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897118354164794:13329]
2025-09-30T14:59:49.536872Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897118354164794:13329]
2025-09-30T14:59:49.536883Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:49.536894Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:49.536897Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:49.536900Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:49.536902Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:49.536919Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:49.536922Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:49.536965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897118354164794:13329]
2025-09-30T14:59:49.536975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:49.536978Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:49.537007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.537019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.536946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3358
2025-09-30T14:59:49.536990Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3358
2025-09-30T14:59:49.537052Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e02ad436-678b7932-67efe602-b67052f3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:49.537070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:49.537074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:49.537077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:49.537089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:49.537099Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:49.537120Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:49.537471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.537482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.537501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:49.537637Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3359 partition: 0 MaxSeqNo: 42 sessionId: src_id|e02ad436-678b7932-67efe602-b67052f3_0
2025-09-30T14:59:49.538026Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8ddab354-acb38f94-ca952048-394a389b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e02ad436-678b7932-67efe602-b67052f3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:49.541036Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e02ad436-678b7932-67efe602-b67052f3_0] Write session: try to update token
2025-09-30T14:59:49.541060Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e02ad436-678b7932-67efe602-b67052f3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:49.553948Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:49.553974Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:49.553978Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:49.553981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:49.553992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897118354164794:13329]
2025-09-30T14:59:49.553998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897118354164794:13329]
2025-09-30T14:59:49.554003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897118354164794:13329]
2025-09-30T14:59:49.554050Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:49.554058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.554060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:49.554077Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:49.554095Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:49.554100Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:49.554237Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:49.558547Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3359 sessionId: src_id|e02ad436-678b7932-67efe602-b67052f3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:49.561889Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:49.580986Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897118443969470:2695]
2025-09-30T14:59:49.581503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 57 pipe creation result: OK TabletId: 72075186224037892 Generation: 3358, pipe: [1:7555897118443969470:2695]
2025-09-30T14:59:49.704215Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:49.704826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.704848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.704893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443969470:2695], now have 1 active actors on pipe
2025-09-30T14:59:49.705159Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:49.705642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 57 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897118443969470:2695]
2025-09-30T14:59:49.705688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:49.705735Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:49.705815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3359 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e02ad436-678b7932-67efe602-b67052f3_0
2025-09-30T14:59:49.705981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3359 sessionId: src_id|e02ad436-678b7932-67efe602-b67052f3_0 is DEAD
2025-09-30T14:59:49.707351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02ad436-678b7932-67efe602-b67052f3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:49.707365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02ad436-678b7932-67efe602-b67052f3_0] Write session will restart in 0.009607s
2025-09-30T14:59:49.707392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02ad436-678b7932-67efe602-b67052f3_0] Write session: Do CDS request
2025-09-30T14:59:49.707399Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02ad436-678b7932-67efe602-b67052f3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:49.723721Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e02ad436-678b7932-67efe602-b67052f3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:49.724166Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:49.724184Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3360
2025-09-30T14:59:49.727413Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3360 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:49.727481Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3360 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:49.727487Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3360 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:49.727492Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:49.728275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3360 sessionId:  describe result for acl check
2025-09-30T14:59:49.728316Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:49.728318Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:49.728324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:49.728331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897118443969507:8591] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:49.729000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897118443969507:8591] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:49.734958Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897118443969507:8591] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:49.740456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897118443969507:8591] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:49.740478Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897118443969507:8591] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:49.740482Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897118443969507:8591] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:49.740491Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3360 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:49.744578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:49.747878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:49.748298Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:49.748311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:49.748328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:49.748449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:49.748503Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897118354165019:13333]
2025-09-30T14:59:49.749234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:49.750185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:49.750242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:49.750668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:49.750761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.750762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.750765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.750767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.750769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.750771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.750772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.750774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.750775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.750776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.750778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.750779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.750780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.750781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.750783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.750791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.750802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.750806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.750811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.750815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.750819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.750824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.750828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.750832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.750837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.750841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.750846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.750850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.750855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.750860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.750873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.750882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.750890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.750896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.750902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.750908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.750913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.750941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.750947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.750954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.750959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.750966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.750971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.750977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.750982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.750988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.750993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.750999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.751004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.751011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.751016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.751022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.751027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.751033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.751039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.751045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.751050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.751056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.751061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.751067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.751113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:49.757605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:49.758914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:49.758937Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:49.758940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:49.758944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:49.758965Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3359 [2:7555897118354165019:13333]
2025-09-30T14:59:49.758982Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:49.759001Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:49.759005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:49.759008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:49.759011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:49.759031Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:49.759039Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:49.759048Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:49.759127Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.759141Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.759144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.759147Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:49.759150Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:49.759229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:49.759240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.759275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.759482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3359
2025-09-30T14:59:49.759495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3359
2025-09-30T14:59:49.759287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.759314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:49.759335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443969636:8591], now have 1 active actors on pipe
2025-09-30T14:59:49.759339Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443969473:2454], now have 1 active actors on pipe
2025-09-30T14:59:49.759346Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897118354165014:13333]
2025-09-30T14:59:49.759348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897118354165014:13333]
2025-09-30T14:59:49.759351Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897118354165014:13333]
2025-09-30T14:59:49.759367Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:49.759381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:49.759397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:49.759400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:49.759410Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:49.759414Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:49.759418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:49.759440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897118354165014:13333]
2025-09-30T14:59:49.759444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:49.759446Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:49.760116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.760144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.760178Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:49.760193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:49.760204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:49.760207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:49.760231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:49.760244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:49.760267Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:49.763587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3360 partition: 0 MaxSeqNo: 42 sessionId: src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0
2025-09-30T14:59:49.763219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.763264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.763297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:49.767396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e02ad436-678b7932-67efe602-b67052f3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:49.770715Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0] Write session: try to update token
2025-09-30T14:59:49.770743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:49.774846Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:49.774872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:49.774874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:49.774877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:49.774887Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897118354165014:13333]
2025-09-30T14:59:49.774892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897118354165014:13333]
2025-09-30T14:59:49.774897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897118354165014:13333]
2025-09-30T14:59:49.774951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:49.774953Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:49.774960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.774961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:49.774963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:49.774964Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:49.775115Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:49.795551Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3360 sessionId: src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:49.798549Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:49.805858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897118443969684:2695]
2025-09-30T14:59:49.806519Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 58 pipe creation result: OK TabletId: 72075186224037892 Generation: 3359, pipe: [1:7555897118443969684:2695]
2025-09-30T14:59:49.900828Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:49.901216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.901232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.901253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443969684:2695], now have 1 active actors on pipe
2025-09-30T14:59:49.901484Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:49.901486Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:49.901503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:49.901561Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:49.901582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3360 reason: error at write: Disconnected sessionId: src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0
2025-09-30T14:59:49.901619Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 58 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897118443969684:2695]
2025-09-30T14:59:49.901772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3360 sessionId: src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0 is DEAD
2025-09-30T14:59:49.903668Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:49.903688Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0] Write session will restart in 0.006170s
2025-09-30T14:59:49.903736Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0] Write session: Do CDS request
2025-09-30T14:59:49.903746Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:49.910925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:49.910998Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:49.911031Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3361
2025-09-30T14:59:49.911210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3361 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:49.911290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3361 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:49.911313Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3361 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:49.911325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:49.911875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3361 sessionId:  describe result for acl check
2025-09-30T14:59:49.911922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:49.911924Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:49.911929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:49.911935Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897118443969716:8613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:49.912546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897118443969716:8613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:49.915465Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897118443969716:8613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:49.919231Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897118443969716:8613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:49.919277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897118443969716:8613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:49.919281Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897118443969716:8613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:49.919290Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3361 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:49.922933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:49.926188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:49.926453Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:49.926474Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:49.926487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:49.926564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:49.926627Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897118354165223:13335]
2025-09-30T14:59:49.927386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:49.927825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:49.927886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:49.928193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:49.928497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.928509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.928511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.928512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.928513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.928515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.928516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.928518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.928519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.928521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.928522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.928524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.928525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.928526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.928528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.928537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.928548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.928552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.928559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.928564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.928568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.928572Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.928576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.928580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.928583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.928587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.928590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.928594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.928598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.928602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.928612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.928620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:49.928626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.928631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:49.928636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.928641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:49.928646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.928651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:49.928656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.928662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:49.928666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.928670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:49.928675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.928679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:49.928684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.928689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:49.928696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.928701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:49.928705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.928710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:49.928714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.928718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.928723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.928729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.928734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.928739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.928750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.928756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:49.928768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.928778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:49.928838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:49.935622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:49.936672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:49.936698Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:49.936702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:49.936706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:49.936714Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3360 [2:7555897118354165223:13335]
2025-09-30T14:59:49.936736Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:49.936755Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:49.936758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:49.936762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:49.936764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:49.936781Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:49.936789Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:49.936797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:49.936879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.936891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.936894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.936897Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:49.936900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:49.937155Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:49.937168Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.937183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:49.937200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:49.937168Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3360
2025-09-30T14:59:49.937169Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3360
2025-09-30T14:59:49.937224Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:49.937251Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443969701:2454], now have 1 active actors on pipe
2025-09-30T14:59:49.937259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897118443969855:8613], now have 1 active actors on pipe
2025-09-30T14:59:49.937273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.937284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.937303Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897118354165218:13335]
2025-09-30T14:59:49.937310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897118354165218:13335]
2025-09-30T14:59:49.937312Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897118354165218:13335]
2025-09-30T14:59:49.937327Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:49.937342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:49.937351Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:49.937359Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:49.937362Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:49.937364Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:49.937368Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:49.937385Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:49.937397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:49.937405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:49.937411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:49.937421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:49.937431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:49.937472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897118354165218:13335]
2025-09-30T14:59:49.937488Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:49.937506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:49.937523Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:49.937761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.937778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.937803Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:49.937914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3361 partition: 0 MaxSeqNo: 42 sessionId: src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0
2025-09-30T14:59:49.938349Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ceb1e124-28c9d960-f3008e32-dfee1a3a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:49.941667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0] Write session: try to update token
2025-09-30T14:59:49.941693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:49.961266Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:49.961294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:49.961306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897118354165218:13335]
2025-09-30T14:59:49.961363Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:49.961373Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:49.961817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:49.962006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:49.962165Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:49.962327Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:49.962553Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:49.962608Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:49.963674Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3361 sessionId: src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:49.966754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:49.966996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:49.967030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:49.967174Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:49.967070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:49.968571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:49.968576Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:49.968579Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:49.968581Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:49.968592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897118354165218:13335]
2025-09-30T14:59:49.968596Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897118354165218:13335]
2025-09-30T14:59:49.968600Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897118354165218:13335]
2025-09-30T14:59:49.968651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:49.968660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:49.968660Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:49.968664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:49.968667Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:49.968675Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:49.968836Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:50.001851Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897122738937209:2695]
2025-09-30T14:59:50.002216Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 59 pipe creation result: OK TabletId: 72075186224037892 Generation: 3360, pipe: [1:7555897122738937209:2695]
2025-09-30T14:59:50.089064Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:50.098392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:50.098428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:50.098631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.098721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.098804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.098883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.098939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.098944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.099033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.099105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.099180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.099308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.099444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.099458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.099551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.099636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.099719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.099811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.099867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.099876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.099964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.100052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.100134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.100213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.100271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.100281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.100361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.100455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.100532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.100606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.100662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.100671Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.100754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.100829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.100904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.100980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.101035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.101044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.101119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.101186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.101263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.101384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.101443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.101452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.101528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.101599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.101680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.101755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.101872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.101887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.101966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.102043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.102674Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.102765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.102811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.102815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.102896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.102961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.103032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.103106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.103155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.103158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.103264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897122738937209:2695], now have 1 active actors on pipe
2025-09-30T14:59:50.103994Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:50.104050Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 59 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897122738937209:2695]
2025-09-30T14:59:50.104082Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:50.104087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:50.104115Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3361 reason: error at write: Disconnected sessionId: src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0
2025-09-30T14:59:50.104097Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:50.104320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3361 sessionId: src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0 is DEAD
2025-09-30T14:59:50.104500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:50.104509Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0] Write session will restart in 0.008200s
2025-09-30T14:59:50.104546Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0] Write session: Do CDS request
2025-09-30T14:59:50.104552Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:50.113801Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:50.113931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:50.113954Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3362
2025-09-30T14:59:50.114093Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3362 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:50.114130Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3362 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:50.114137Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3362 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:50.114146Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:50.114737Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3362 sessionId:  describe result for acl check
2025-09-30T14:59:50.114776Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:50.114779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:50.114781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:50.114786Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897122738937227:8614] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:50.115388Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897122738937227:8614] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:50.121232Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897122738937227:8614] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:50.125204Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897122738937227:8614] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:50.125222Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897122738937227:8614] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:50.125227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897122738937227:8614] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:50.125244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3362 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:50.127592Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:50.130219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:50.130488Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:50.130493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:50.130506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:50.130567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:50.130602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897122649132728:13337]
2025-09-30T14:59:50.131278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:50.131706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:50.131779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:50.132127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:50.132204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.132205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.132207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.132208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.132209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.132211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.132212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.132213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.132214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.132216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.132217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.132218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.132220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.132221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.132222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.132228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.132237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.132241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.132245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.132249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.132254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.132257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.132261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.132265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.132268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.132272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.132275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.132279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.132282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.132286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.132295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.132303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.132310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.132316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.132321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.132327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.132331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.132336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.132342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.132347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.132352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.132357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.132362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.132367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.132372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.132378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.132383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.132389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.132393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.132399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.132404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.132410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.132414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.132431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.132439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.132445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.132450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.132456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.132461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.132467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.132512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:50.138924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:50.140123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:50.140131Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:50.140137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:50.140141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:50.140149Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3361 [2:7555897122649132728:13337]
2025-09-30T14:59:50.140165Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:50.140182Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:50.140186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:50.140189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:50.140194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:50.140212Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:50.140222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:50.140228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:50.140294Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.140296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.140299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.140302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:50.140304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:50.140381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:50.140384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.140398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.140410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.140439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:50.140460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897122649132719:13337]
2025-09-30T14:59:50.140463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897122649132719:13337]
2025-09-30T14:59:50.140464Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897122649132719:13337]
2025-09-30T14:59:50.140475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:50.140488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:50.140503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:50.140506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:50.140507Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:50.140511Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:50.140514Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:50.140549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897122738937409:8614], now have 1 active actors on pipe
2025-09-30T14:59:50.140553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897122649132719:13337]
2025-09-30T14:59:50.140562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:50.140567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:50.140568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897122738937212:2454], now have 1 active actors on pipe
2025-09-30T14:59:50.142579Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3361
2025-09-30T14:59:50.142625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3361
2025-09-30T14:59:50.143071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:50.143098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:50.143138Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:50.143156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:50.143161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:50.143164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:50.143178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:50.143205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:50.143227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:50.144327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:50.144356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:50.144383Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:50.148529Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3362 partition: 0 MaxSeqNo: 42 sessionId: src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0
2025-09-30T14:59:50.148994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7a5e080b-c18fc4bc-c5dddc6a-7ee6913_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:50.152187Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0] Write session: try to update token
2025-09-30T14:59:50.152213Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:50.156770Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:50.156800Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:50.156803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:50.156805Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:50.156815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897122649132719:13337]
2025-09-30T14:59:50.156820Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897122649132719:13337]
2025-09-30T14:59:50.156824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897122649132719:13337]
2025-09-30T14:59:50.156872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:50.156882Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.156885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:50.156887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:50.156895Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:50.156899Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:50.157045Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:50.183883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3362 sessionId: src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:50.186634Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:50.203116Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897122738937446:2695]
2025-09-30T14:59:50.207845Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 60 pipe creation result: OK TabletId: 72075186224037892 Generation: 3361, pipe: [1:7555897122738937446:2695]
2025-09-30T14:59:50.290491Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:50.290891Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:50.290908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:50.290927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897122738937446:2695], now have 1 active actors on pipe
2025-09-30T14:59:50.291189Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:50.291203Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 60 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897122738937446:2695]
2025-09-30T14:59:50.291208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:50.291222Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:50.291288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3362 reason: error at write: Disconnected sessionId: src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0
2025-09-30T14:59:50.291479Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3362 sessionId: src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0 is DEAD
2025-09-30T14:59:50.291211Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:50.291876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:50.291887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0] Write session will restart in 0.007629s
2025-09-30T14:59:50.291911Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0] Write session: Do CDS request
2025-09-30T14:59:50.291920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:50.300800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:50.300951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:50.300969Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3363
2025-09-30T14:59:50.301142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3363 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:50.301192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3363 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:50.301205Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3363 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:50.301209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:50.301673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3363 sessionId:  describe result for acl check
2025-09-30T14:59:50.301714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:50.301721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:50.301723Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:50.301729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897122738937470:8648] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:50.302298Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897122738937470:8648] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:50.305978Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897122738937470:8648] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:50.310734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897122738937470:8648] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:50.310753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897122738937470:8648] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:50.310757Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897122738937470:8648] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:50.310766Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3363 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:50.313856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:50.318380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:50.318673Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:50.318688Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:50.318701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:50.318763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:50.318823Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897122649132967:13352]
2025-09-30T14:59:50.319545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:50.320117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:50.320198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:50.320621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:50.320726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.320734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.320735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.320737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.320738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.320740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.320742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.320743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.320745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.320746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.320748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.320749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.320751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.320753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.320754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.320761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.320774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.320779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.320783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.320788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.320792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.320796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.320801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.320805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.320810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.320814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.320818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.320823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.320827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.320831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.320841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.320851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.320858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.320865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.320870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.320877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.320882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.320888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.320894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.320899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.320905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.320911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.320917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.320922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.320928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.320934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.320939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.320945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.320951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.320963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.320969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.320975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.320980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.320986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.320992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.320997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.321009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.321015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.321026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.321032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.321095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:50.328306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:50.329730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:50.329755Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:50.329758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:50.329763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:50.329771Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3362 [2:7555897122649132967:13352]
2025-09-30T14:59:50.329792Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:50.329811Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:50.329814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:50.329818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:50.329821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:50.329839Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:50.329852Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:50.329864Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:50.329931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.329941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.329943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.329948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:50.329951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:50.330043Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:50.330051Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.330065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.330079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.330092Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:50.330105Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897122649132961:13352]
2025-09-30T14:59:50.330111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897122649132961:13352]
2025-09-30T14:59:50.330113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897122649132961:13352]
2025-09-30T14:59:50.330124Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:50.330142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:50.330152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:50.330154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:50.330181Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:50.330185Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:50.330189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:50.330193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897122649132961:13352]
2025-09-30T14:59:50.330196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:50.330296Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:50.330482Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3362
2025-09-30T14:59:50.330482Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3362
2025-09-30T14:59:50.330993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897122738937449:2454], now have 1 active actors on pipe
2025-09-30T14:59:50.331011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897122738937648:8648], now have 1 active actors on pipe
2025-09-30T14:59:50.331035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:50.331041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:50.331082Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:50.331096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:50.331100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:50.331103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:50.331114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:50.331126Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:50.331143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:50.331584Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:50.331600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:50.331623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:50.331722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3363 partition: 0 MaxSeqNo: 42 sessionId: src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0
2025-09-30T14:59:50.332489Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2903dcc2-cc77d4b9-c5f83203-d23b3776_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:50.335514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0] Write session: try to update token
2025-09-30T14:59:50.335538Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:50.347465Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:50.347489Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:50.347492Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:50.347494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:50.347504Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897122649132961:13352]
2025-09-30T14:59:50.347510Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897122649132961:13352]
2025-09-30T14:59:50.347514Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897122649132961:13352]
2025-09-30T14:59:50.347554Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:50.347567Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.347561Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:50.347575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:50.347579Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:50.347588Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:50.347728Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:50.369639Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3363 sessionId: src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:50.372705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:50.392011Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897122738937669:2695]
2025-09-30T14:59:50.395795Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 61 pipe creation result: OK TabletId: 72075186224037892 Generation: 3362, pipe: [1:7555897122738937669:2695]
2025-09-30T14:59:50.477746Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:50.478354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:50.478363Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:50.478381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897122738937669:2695], now have 1 active actors on pipe
2025-09-30T14:59:50.478755Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:50.479571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 61 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897122738937669:2695]
2025-09-30T14:59:50.479609Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:50.479674Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:50.479739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3363 reason: status is not ok: tablet will be restarted right now sessionId: src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0
2025-09-30T14:59:50.479924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3363 sessionId: src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0 is DEAD
2025-09-30T14:59:50.480273Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:50.480291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0] Write session will restart in 0.007485s
2025-09-30T14:59:50.480319Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0] Write session: Do CDS request
2025-09-30T14:59:50.480325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:50.489773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:50.490284Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:50.490305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3364
2025-09-30T14:59:50.490533Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3364 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:50.490564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3364 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:50.490570Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3364 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:50.490574Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:50.491019Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3364 sessionId:  describe result for acl check
2025-09-30T14:59:50.491049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:50.491051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:50.491053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:50.491059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897122738937683:8657] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:50.491720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897122738937683:8657] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:50.498421Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897122738937683:8657] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:50.537189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897122738937683:8657] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:50.537211Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897122738937683:8657] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:50.537214Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897122738937683:8657] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:50.537224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3364 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:50.584551Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897122738937879:2695]
2025-09-30T14:59:50.594023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:50.598411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:50.598678Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:50.598682Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:50.598693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:50.598756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:50.598799Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897122649133177:13354]
2025-09-30T14:59:50.599469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:50.604010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:50.604113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:50.604575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:50.604676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.604703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.604704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.604706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.604707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.604709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.604711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.604713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.604714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.604715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.604717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.604718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.604720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.604721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.604723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.604730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.604741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.604745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.604749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.604753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.604757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.604761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.604765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.604769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.604773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.604777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.604781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.604784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.604788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.604791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.604801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.604810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.604817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.604823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.604829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.604834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.604840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.604847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.604853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.604859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.604864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.604869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.604875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.604880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.604885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.604890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.604895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.604901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.604905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.604911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.604916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.604922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.604927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.604933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.604939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.604945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.604950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.604956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.604963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.604970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.605020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:50.620512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:50.622011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:50.622021Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:50.622023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:50.622028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:50.622036Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3363 [2:7555897122649133177:13354]
2025-09-30T14:59:50.622060Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:50.622078Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:50.622083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:50.622087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:50.622089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:50.622107Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:50.622115Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:50.622123Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:50.622200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.622203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.622205Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.622210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:50.622213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:50.622293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:50.622295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.622313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.622327Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.622344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:50.622361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897122649133169:13354]
2025-09-30T14:59:50.622364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897122649133169:13354]
2025-09-30T14:59:50.622367Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897122649133169:13354]
2025-09-30T14:59:50.622382Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:50.622397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:50.622411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:50.622414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:50.622457Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897122649133169:13354]
2025-09-30T14:59:50.622460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:50.622554Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:50.622559Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:50.622561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:50.622569Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:50.622892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897122738937879:2695], now have 1 active actors on pipe
2025-09-30T14:59:50.622901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897122738937733:8657], now have 1 active actors on pipe
2025-09-30T14:59:50.622905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897122738937674:2454], now have 1 active actors on pipe
2025-09-30T14:59:50.625051Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 62 pipe creation result: OK TabletId: 72075186224037892 Generation: 3363, pipe: [1:7555897122738937879:2695]
2025-09-30T14:59:50.625111Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3363
2025-09-30T14:59:50.625136Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3363
2025-09-30T14:59:50.632612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3364 partition: 0 MaxSeqNo: 42 sessionId: src_id|37285856-987c841a-8ba27e47-81987610_0
2025-09-30T14:59:50.631768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:50.631800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:50.631843Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|37285856-987c841a-8ba27e47-81987610_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:50.631857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:50.631863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:50.631867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:50.631882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:50.631901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:50.631927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:50.632440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:50.632446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:50.632465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:50.633643Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4cbeafc8-6a36e532-cd502ac3-3b611ed6_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|37285856-987c841a-8ba27e47-81987610_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:50.636653Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37285856-987c841a-8ba27e47-81987610_0] Write session: try to update token
2025-09-30T14:59:50.636675Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37285856-987c841a-8ba27e47-81987610_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:50.664730Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3364 sessionId: src_id|37285856-987c841a-8ba27e47-81987610_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:50.667870Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:50.669853Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:50.669882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:50.669893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897122649133169:13354]
2025-09-30T14:59:50.669946Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:50.670202Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:50.670375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:50.670536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:50.670727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:50.671094Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:50.671142Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:50.671147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:50.671276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:50.671298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:50.671334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:50.679607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:50.715533Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:50.715562Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:50.715565Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:50.715567Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:50.715579Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897122649133169:13354]
2025-09-30T14:59:50.715588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897122649133169:13354]
2025-09-30T14:59:50.715593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897122649133169:13354]
2025-09-30T14:59:50.715639Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:50.715646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.715649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:50.715650Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:50.715658Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:50.715663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:50.715800Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:50.859157Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:50.870876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:50.870916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:50.871124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.871205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.871635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.871721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.872311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.872330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.872430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.872499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.872571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.872649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.872702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.872711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.872789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.872856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.872970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.873044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.873095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.873104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.873194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.873270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.873349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.873428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.873486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.873495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.873585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.873663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.873735Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.873806Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.873854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.873858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.873932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.873998Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.874067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.874135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.874205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.874208Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.874284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.874348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.874415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.874478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.874542Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.874548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.874623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.874685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.874747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.874808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.874851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.874854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.875121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.875187Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.875706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.875796Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.875851Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.875859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.875942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:50.876011Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:50.876086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:50.876161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:50.876216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:50.876226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:50.876684Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 62 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897122738937879:2695]
2025-09-30T14:59:50.876725Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:50.876771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:50.876774Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:50.876804Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3364 reason: error at write: Disconnected sessionId: src_id|37285856-987c841a-8ba27e47-81987610_0
2025-09-30T14:59:50.876980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3364 sessionId: src_id|37285856-987c841a-8ba27e47-81987610_0 is DEAD
2025-09-30T14:59:50.877291Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37285856-987c841a-8ba27e47-81987610_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:50.877313Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37285856-987c841a-8ba27e47-81987610_0] Write session will restart in 0.005984s
2025-09-30T14:59:50.877339Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37285856-987c841a-8ba27e47-81987610_0] Write session: Do CDS request
2025-09-30T14:59:50.877345Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37285856-987c841a-8ba27e47-81987610_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:50.877213Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:50.884826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|37285856-987c841a-8ba27e47-81987610_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:50.884986Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:50.885016Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3365
2025-09-30T14:59:50.885143Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3365 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:50.885193Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3365 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:50.885210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3365 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:50.885214Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:50.885653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3365 sessionId:  describe result for acl check
2025-09-30T14:59:50.885689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:50.885691Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:50.885693Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:50.885699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897122738937905:8672] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:50.886241Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897122738937905:8672] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:50.889608Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897122738937905:8672] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:50.895490Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897122738937905:8672] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:50.895510Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897122738937905:8672] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:50.895514Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897122738937905:8672] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:50.895524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3365 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:50.910472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:50.913887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:50.914231Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:50.914247Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:50.914260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:50.914325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:50.914371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897122649133396:13358]
2025-09-30T14:59:50.915090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:50.915659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:50.915713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:50.916091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:50.916154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.916155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.916157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.916158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.916160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.916162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.916164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.916165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.916167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.916168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.916170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.916171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.916173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.916174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.916175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.916182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.916193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.916197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.916202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.916207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.916211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.916216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.916220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.916225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.916230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.916235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.916239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.916259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.916263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.916267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.916279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.916288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:50.916295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.916301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:50.916307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.916314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:50.916320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.916326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:50.916331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.916337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:50.916342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.916348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:50.916353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.916359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:50.916365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.916371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:50.916376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.916383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:50.916388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.916393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:50.916398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.916404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.916409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.916433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.916440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.916446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.916451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.916457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:50.916465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.916472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:50.916521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:50.928336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:50.929420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:50.929444Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:50.929447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:50.929452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:50.929460Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3364 [2:7555897122649133396:13358]
2025-09-30T14:59:50.929484Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:50.929504Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:50.929508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:50.929512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:50.929515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:50.929534Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:50.929542Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:50.929548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:50.929625Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.929629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.929632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.929637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:50.929640Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:50.929718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:50.929722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.929738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:50.929750Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:50.929767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:50.929786Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897122649133390:13358]
2025-09-30T14:59:50.929789Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897122649133390:13358]
2025-09-30T14:59:50.929792Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897122649133390:13358]
2025-09-30T14:59:50.929807Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:50.929824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:50.929841Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:50.929844Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:50.929892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897122649133390:13358]
2025-09-30T14:59:50.929895Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:50.930415Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3364
2025-09-30T14:59:50.930300Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:50.930310Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:50.930312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:50.930318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:50.930843Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3364
2025-09-30T14:59:50.930781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897122738937958:8672], now have 1 active actors on pipe
2025-09-30T14:59:50.930794Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897122738937897:2454], now have 1 active actors on pipe
2025-09-30T14:59:50.930810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:50.930817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:50.930845Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:50.930855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:50.930860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:50.930863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:50.930876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:50.930890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:50.930907Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:50.931393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:50.931405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:50.931427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:50.931608Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3365 partition: 0 MaxSeqNo: 42 sessionId: src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0
2025-09-30T14:59:50.932090Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|37285856-987c841a-8ba27e47-81987610_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:50.935207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0] Write session: try to update token
2025-09-30T14:59:50.935233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:50.975678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897122738938124:2695]
2025-09-30T14:59:50.976116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897122738938124:2695], now have 1 active actors on pipe
2025-09-30T14:59:50.977200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 63 pipe creation result: OK TabletId: 72075186224037892 Generation: 3364, pipe: [1:7555897122738938124:2695]
2025-09-30T14:59:50.983129Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:50.983155Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:50.983157Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:50.983159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:50.983169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897122649133390:13358]
2025-09-30T14:59:50.983173Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897122649133390:13358]
2025-09-30T14:59:50.983177Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897122649133390:13358]
2025-09-30T14:59:50.983216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:50.983223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:50.983226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:50.983444Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:50.986090Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:50.986099Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:50.986103Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:50.978728Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3365 sessionId: src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:50.981771Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:51.142686Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:51.145225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:51.145240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0] Write session will restart in 0.008693s
2025-09-30T14:59:51.145263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0] Write session: Do CDS request
2025-09-30T14:59:51.145270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:51.143348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:51.143377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:51.143692Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:51.144785Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:51.144789Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:51.144793Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:51.144844Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 63 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897122738938124:2695]
2025-09-30T14:59:51.144869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3365 reason: error at write: Disconnected sessionId: src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0
2025-09-30T14:59:51.145050Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3365 sessionId: src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0 is DEAD
2025-09-30T14:59:51.154885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:51.155121Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:51.155140Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3366
2025-09-30T14:59:51.155499Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3366 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:51.155551Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3366 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:51.155558Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3366 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:51.155562Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:51.156099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3366 sessionId:  describe result for acl check
2025-09-30T14:59:51.156128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:51.156131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:51.156132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:51.156147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897127033905437:8674] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:51.156779Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897127033905437:8674] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:51.162519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897127033905437:8674] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:51.172727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897127033905437:8674] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:51.172749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897127033905437:8674] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:51.172753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897127033905437:8674] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:51.172764Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3366 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:51.192734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:51.196056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:51.196349Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:51.196354Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:51.196367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:51.196441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:51.196484Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897126944100901:13360]
2025-09-30T14:59:51.197197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:51.199171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:51.199287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:51.199695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:51.199779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.199781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.199782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.199784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.199785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.199787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.199789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.199790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.199792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.199793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.199795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.199797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.199798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.199800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.199802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.199808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.199820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.199824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.199829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.199833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.199838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.199841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.199846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.199850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.199855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.199859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.199875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.199879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.199882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.199886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.199897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.199906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.199913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.199919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.199925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.199931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.199937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.199943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.199949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.199955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.199961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.199966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.199972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.199977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.199984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.199990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.199996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.200002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.200010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.200017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.200022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.200036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.200041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.200047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.200053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.200059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.200064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.200068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.200072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.200077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.200123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:51.209491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:51.210387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:51.210393Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:51.210396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:51.210400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:51.210408Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3365 [2:7555897126944100901:13360]
2025-09-30T14:59:51.210428Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:51.210446Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:51.210449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:51.210452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:51.210455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:51.210470Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:51.210478Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:51.210485Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:51.210549Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.210552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.210841Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3365
2025-09-30T14:59:51.210555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.210891Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3365
2025-09-30T14:59:51.210559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:51.210562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:51.210638Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:51.210641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.210654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.210666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.210683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:51.210699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897126944100896:13360]
2025-09-30T14:59:51.210702Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897126944100896:13360]
2025-09-30T14:59:51.210705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897126944100896:13360]
2025-09-30T14:59:51.210714Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:51.210726Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:51.210729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897127033905429:2454], now have 1 active actors on pipe
2025-09-30T14:59:51.210730Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:51.210733Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:51.210736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897127033905491:8674], now have 1 active actors on pipe
2025-09-30T14:59:51.210743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:51.210758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:51.210761Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:51.210794Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897126944100896:13360]
2025-09-30T14:59:51.210804Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:51.210811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:51.210935Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:51.210944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:51.210975Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:51.210985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:51.210989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:51.210992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:51.211004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:51.211018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:51.211037Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:51.211358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:51.211385Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:51.211407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:51.211521Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3366 partition: 0 MaxSeqNo: 42 sessionId: src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0
2025-09-30T14:59:51.211938Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aeb2f0d3-4af7f723-61dbb11c-7cdb111e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:51.214812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0] Write session: try to update token
2025-09-30T14:59:51.214835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:51.228608Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:51.228632Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:51.228635Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:51.228637Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:51.228646Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897126944100896:13360]
2025-09-30T14:59:51.228650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897126944100896:13360]
2025-09-30T14:59:51.228654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897126944100896:13360]
2025-09-30T14:59:51.228699Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:51.228706Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.228706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:51.228713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:51.228719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:51.228724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:51.228857Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:51.244985Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897127033905660:2695]
2025-09-30T14:59:51.245371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 64 pipe creation result: OK TabletId: 72075186224037892 Generation: 3365, pipe: [1:7555897127033905660:2695]
2025-09-30T14:59:51.261519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3366 sessionId: src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:51.264438Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:51.346951Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:51.348084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897127033905660:2695], now have 1 active actors on pipe
2025-09-30T14:59:51.348119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:51.348125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:51.349700Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:51.349751Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 64 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897127033905660:2695]
2025-09-30T14:59:51.350220Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:51.349770Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:51.350233Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0] Write session will restart in 0.005911s
2025-09-30T14:59:51.349778Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:51.349835Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3366 reason: error at write: Disconnected sessionId: src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0
2025-09-30T14:59:51.349997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3366 sessionId: src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0 is DEAD
2025-09-30T14:59:51.350259Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0] Write session: Do CDS request
2025-09-30T14:59:51.350265Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:51.349974Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:51.357777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:51.360757Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:51.360777Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3367
2025-09-30T14:59:51.360930Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3367 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:51.360968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3367 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:51.360980Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3367 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:51.360984Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:51.361485Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3367 sessionId:  describe result for acl check
2025-09-30T14:59:51.361528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:51.361531Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:51.361533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:51.361539Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897127033905691:8700] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:51.362131Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897127033905691:8700] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:51.368674Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897127033905691:8700] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:51.378328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897127033905691:8700] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:51.378350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897127033905691:8700] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:51.378353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897127033905691:8700] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:51.378363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3367 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:51.388679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:51.392608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:51.393144Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:51.393158Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:51.393172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:51.393247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:51.393300Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897126944101149:13375]
2025-09-30T14:59:51.394032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:51.395498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:51.395584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:51.396077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:51.396191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.396192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.396193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.396195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.396196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.396197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.396199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.396200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.396202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.396203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.396204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.396205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.396207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.396208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.396209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.396217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.396226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.396230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.396234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.396237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.396241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.396245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.396249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.396253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.396258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.396261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.396265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.396269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.396273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.396277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.396289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.396298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.396304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.396310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.396320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.396326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.396331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.396337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.396342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.396348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.396353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.396360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.396365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.396372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.396377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.396383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.396388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.396393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.396397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.396402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.396407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.396428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.396434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.396440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.396446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.396452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.396457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.396462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.396467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.396473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.396516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:51.405262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:51.406699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:51.406726Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:51.406729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:51.406734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:51.406742Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3366 [2:7555897126944101149:13375]
2025-09-30T14:59:51.406762Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:51.406781Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:51.406785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:51.406789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:51.406791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:51.406808Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:51.406818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:51.406831Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:51.406901Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.406909Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.406911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.406916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:51.406918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:51.406994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:51.407003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.407018Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.407036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.407062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:51.407085Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897126944101143:13375]
2025-09-30T14:59:51.407093Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897126944101143:13375]
2025-09-30T14:59:51.407096Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897126944101143:13375]
2025-09-30T14:59:51.407107Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:51.407128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:51.407130Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:51.407144Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:51.407147Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:51.407147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:51.407150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:51.407162Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897127033905822:8700], now have 1 active actors on pipe
2025-09-30T14:59:51.407166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897127033905673:2454], now have 1 active actors on pipe
2025-09-30T14:59:51.407203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897126944101143:13375]
2025-09-30T14:59:51.407214Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:51.407366Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3366
2025-09-30T14:59:51.407366Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3366
2025-09-30T14:59:51.407647Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:51.408552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:51.408570Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:51.408610Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a02cd12d-94891aeb-c8dad489-a961231a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:51.408627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:51.408631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:51.408634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:51.408647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:51.408661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:51.408681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:51.409020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:51.409036Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:51.409061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:51.409231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3367 partition: 0 MaxSeqNo: 42 sessionId: src_id|a02cd12d-94891aeb-c8dad489-a961231a_0
2025-09-30T14:59:51.411119Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cad8c5ee-1847f899-9e527a5a-8495be50_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a02cd12d-94891aeb-c8dad489-a961231a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:51.414289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a02cd12d-94891aeb-c8dad489-a961231a_0] Write session: try to update token
2025-09-30T14:59:51.414317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a02cd12d-94891aeb-c8dad489-a961231a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:51.433503Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:51.433531Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:51.433534Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:51.433536Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:51.433548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897126944101143:13375]
2025-09-30T14:59:51.433555Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897126944101143:13375]
2025-09-30T14:59:51.433559Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897126944101143:13375]
2025-09-30T14:59:51.433606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:51.433614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.433617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:51.433780Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:51.435527Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:51.435549Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:51.435560Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:51.442077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3367 sessionId: src_id|a02cd12d-94891aeb-c8dad489-a961231a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:51.445252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:51.450252Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897127033905897:2695]
2025-09-30T14:59:51.451581Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 65 pipe creation result: OK TabletId: 72075186224037892 Generation: 3366, pipe: [1:7555897127033905897:2695]
2025-09-30T14:59:51.568090Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:51.568655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:51.568677Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:51.568702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897127033905897:2695], now have 1 active actors on pipe
2025-09-30T14:59:51.569033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 65 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897127033905897:2695]
2025-09-30T14:59:51.569072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:51.569076Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:51.569138Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3367 reason: error at write: Disconnected sessionId: src_id|a02cd12d-94891aeb-c8dad489-a961231a_0
2025-09-30T14:59:51.569306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3367 sessionId: src_id|a02cd12d-94891aeb-c8dad489-a961231a_0 is DEAD
2025-09-30T14:59:51.569317Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:51.569689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a02cd12d-94891aeb-c8dad489-a961231a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:51.569702Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a02cd12d-94891aeb-c8dad489-a961231a_0] Write session will restart in 0.007243s
2025-09-30T14:59:51.569142Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:51.569734Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a02cd12d-94891aeb-c8dad489-a961231a_0] Write session: Do CDS request
2025-09-30T14:59:51.569744Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a02cd12d-94891aeb-c8dad489-a961231a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:51.577776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a02cd12d-94891aeb-c8dad489-a961231a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:51.579435Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:51.579459Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3368
2025-09-30T14:59:51.583502Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3368 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:51.583553Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3368 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:51.583559Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3368 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:51.583564Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:51.587690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3368 sessionId:  describe result for acl check
2025-09-30T14:59:51.587733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:51.587736Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:51.587741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:51.587748Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897127033905961:8703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:51.588304Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897127033905961:8703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:51.595517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897127033905961:8703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:51.599294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897127033905961:8703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:51.599315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897127033905961:8703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:51.599319Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897127033905961:8703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:51.599328Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3368 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:51.600376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:51.602963Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:51.603225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:51.603240Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:51.603288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:51.603377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:51.603439Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897126944101360:13377]
2025-09-30T14:59:51.604127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:51.604778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:51.604847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:51.605230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:51.605313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.605321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.605322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.605324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.605325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.605327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.605328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.605330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.605331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.605332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.605335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.605336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.605338Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.605339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.605341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.605347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.605358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.605362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.605367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.605371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.605375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.605380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.605385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.605389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.605394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.605398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.605403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.605407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.605411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.605415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.605424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.605433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.605439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.605444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.605449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.605454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.605459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.605465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.605471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.605476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.605480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.605486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.605492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.605497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.605509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.605514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.605520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.605526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.605549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.605560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.605565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.605571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.605576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.605582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.605593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.605603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.605608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.605613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.605623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.605628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.605682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:51.613210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:51.614420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:51.614450Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:51.614453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:51.614458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:51.614466Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3367 [2:7555897126944101360:13377]
2025-09-30T14:59:51.614486Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:51.614504Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:51.614507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:51.614511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:51.614514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:51.614535Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:51.614549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:51.614558Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:51.614636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.614646Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.614649Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.614653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:51.614655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:51.614742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:51.614753Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.614768Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.614778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.614802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:51.614828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897126944101355:13377]
2025-09-30T14:59:51.614835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897126944101355:13377]
2025-09-30T14:59:51.614838Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897126944101355:13377]
2025-09-30T14:59:51.614855Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:51.614875Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:51.614892Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:51.614896Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:51.614903Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:51.614906Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:51.614908Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:51.614941Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897126944101355:13377]
2025-09-30T14:59:51.614945Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:51.615011Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:51.615425Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3367
2025-09-30T14:59:51.615478Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3367
2025-09-30T14:59:51.615809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897127033906106:8703], now have 1 active actors on pipe
2025-09-30T14:59:51.615823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897127033905900:2454], now have 1 active actors on pipe
2025-09-30T14:59:51.616555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:51.616572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:51.616607Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66b66736-73dd5d01-7fffc557-87f5c646_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:51.616620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:51.616624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:51.616628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:51.616641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:51.616658Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:51.616681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:51.617676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:51.617696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:51.617726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:51.617912Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3368 partition: 0 MaxSeqNo: 42 sessionId: src_id|66b66736-73dd5d01-7fffc557-87f5c646_0
2025-09-30T14:59:51.618330Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a02cd12d-94891aeb-c8dad489-a961231a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|66b66736-73dd5d01-7fffc557-87f5c646_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:51.621626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66b66736-73dd5d01-7fffc557-87f5c646_0] Write session: try to update token
2025-09-30T14:59:51.621658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66b66736-73dd5d01-7fffc557-87f5c646_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:51.635346Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:51.635369Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:51.635372Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:51.635374Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:51.635387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897126944101355:13377]
2025-09-30T14:59:51.635393Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897126944101355:13377]
2025-09-30T14:59:51.635399Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897126944101355:13377]
2025-09-30T14:59:51.635445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:51.635453Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.635457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:51.635462Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:51.635471Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:51.635476Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:51.635609Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:51.653071Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3368 sessionId: src_id|66b66736-73dd5d01-7fffc557-87f5c646_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:51.656171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:51.668945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897127033906119:2695]
2025-09-30T14:59:51.672535Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 66 pipe creation result: OK TabletId: 72075186224037892 Generation: 3367, pipe: [1:7555897127033906119:2695]
2025-09-30T14:59:51.756972Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:51.757706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:51.757718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:51.757739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897127033906119:2695], now have 1 active actors on pipe
2025-09-30T14:59:51.758165Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 66 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897127033906119:2695]
2025-09-30T14:59:51.758214Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:51.758044Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:51.758297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3368 reason: status is not ok: tablet will be restarted right now sessionId: src_id|66b66736-73dd5d01-7fffc557-87f5c646_0
2025-09-30T14:59:51.758484Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3368 sessionId: src_id|66b66736-73dd5d01-7fffc557-87f5c646_0 is DEAD
2025-09-30T14:59:51.758625Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:51.759122Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b66736-73dd5d01-7fffc557-87f5c646_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:51.759139Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b66736-73dd5d01-7fffc557-87f5c646_0] Write session will restart in 0.006733s
2025-09-30T14:59:51.759163Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b66736-73dd5d01-7fffc557-87f5c646_0] Write session: Do CDS request
2025-09-30T14:59:51.759169Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b66736-73dd5d01-7fffc557-87f5c646_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:51.766831Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66b66736-73dd5d01-7fffc557-87f5c646_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:51.767122Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:51.767149Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3369
2025-09-30T14:59:51.767448Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3369 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:51.767503Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3369 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:51.767512Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3369 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:51.767517Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:51.768004Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3369 sessionId:  describe result for acl check
2025-09-30T14:59:51.768036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:51.768039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:51.768041Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:51.768048Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897127033906135:8711] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:51.768688Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897127033906135:8711] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:51.771342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897127033906135:8711] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:51.775260Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897127033906135:8711] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:51.775283Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897127033906135:8711] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:51.775289Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897127033906135:8711] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:51.775299Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3369 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:51.796117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:51.802640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:51.802930Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:51.802945Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:51.802960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:51.803044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:51.803100Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897126944101587:13381]
2025-09-30T14:59:51.803846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:51.804714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:51.804793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:51.805219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:51.805323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.805325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.805326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.805328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.805330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.805331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.805332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.805334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.805336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.805337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.805339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.805340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.805341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.805343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.805344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.805352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.805362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.805367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.805371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.805375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.805379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.805383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.805387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.805391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.805396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.805400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.805404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.805409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.805413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.805417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.805427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.805437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:51.805444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.805450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:51.805456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.805461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:51.805467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.805473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:51.805479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.805485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:51.805491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.805497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:51.805502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.805508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:51.805513Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.805518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:51.805524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.805530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:51.805535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.805541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:51.805547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.805552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.805556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.805562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.805568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.805573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.805578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.805583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:51.805590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.805596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:51.805642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:51.812454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:51.813502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:51.813527Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:51.813531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:51.813536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:51.813544Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3368 [2:7555897126944101587:13381]
2025-09-30T14:59:51.813565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:51.813586Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:51.813590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:51.813594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:51.813596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:51.813616Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:51.813624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:51.813632Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:51.813708Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.813722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.813724Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.813728Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:51.813731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:51.813809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:51.813814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.813831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:51.813842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:51.813857Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:51.813877Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897126944101581:13381]
2025-09-30T14:59:51.813879Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897126944101581:13381]
2025-09-30T14:59:51.813882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897126944101581:13381]
2025-09-30T14:59:51.813892Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:51.813910Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:51.813926Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:51.813930Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:51.813972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897126944101581:13381]
2025-09-30T14:59:51.813975Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:51.814019Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:51.814022Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:51.814024Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:51.814031Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:51.814309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897127033906172:8711], now have 1 active actors on pipe
2025-09-30T14:59:51.814333Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897127033906122:2454], now have 1 active actors on pipe
2025-09-30T14:59:51.814335Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3368
2025-09-30T14:59:51.814379Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3368
2025-09-30T14:59:51.814561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:51.814589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:51.814623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:51.814639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:51.814648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:51.814651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:51.814669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:51.814688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:51.814708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:51.815204Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:51.815220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:51.815270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:51.815437Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3369 partition: 0 MaxSeqNo: 42 sessionId: src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0
2025-09-30T14:59:51.819396Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66b66736-73dd5d01-7fffc557-87f5c646_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:51.822463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0] Write session: try to update token
2025-09-30T14:59:51.822495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:51.841444Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:51.841469Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:51.841481Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897126944101581:13381]
2025-09-30T14:59:51.841538Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:51.841772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:51.841940Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:51.842146Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:51.842303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:51.842517Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:51.842563Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:51.842680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:51.848153Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:51.848181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:51.848185Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:51.848188Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:51.848199Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897126944101581:13381]
2025-09-30T14:59:51.848204Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897126944101581:13381]
2025-09-30T14:59:51.848210Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897126944101581:13381]
2025-09-30T14:59:51.848258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:51.848267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:51.848271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:51.848278Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:51.848286Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:51.848297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:51.848457Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:51.856486Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3369 sessionId: src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:51.859369Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897127033906346:2695]
2025-09-30T14:59:51.860255Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 67 pipe creation result: OK TabletId: 72075186224037892 Generation: 3368, pipe: [1:7555897127033906346:2695]
2025-09-30T14:59:51.860533Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:51.984955Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:51.985264Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897127033906346:2695], now have 1 active actors on pipe
2025-09-30T14:59:51.985293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:51.985301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:51.986133Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 67 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897127033906346:2695]
2025-09-30T14:59:51.986178Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:51.986182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:51.986679Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:51.986691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0] Write session will restart in 0.008123s
2025-09-30T14:59:51.986718Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0] Write session: Do CDS request
2025-09-30T14:59:51.986724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:51.986241Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3369 reason: error at write: Disconnected sessionId: src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0
2025-09-30T14:59:51.986427Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3369 sessionId: src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0 is DEAD
2025-09-30T14:59:51.986642Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:51.992392Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:51.995834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:51.997410Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:51.997432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3370
2025-09-30T14:59:51.998682Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3370 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:51.998729Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3370 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:51.998735Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3370 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:51.998741Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:51.999260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3370 sessionId:  describe result for acl check
2025-09-30T14:59:51.999300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:51.999303Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:51.999305Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:51.999312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897127033906388:8737] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:51.999782Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897127033906388:8737] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:52.004995Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897127033906388:8737] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:52.017567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:52.017326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897127033906388:8737] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:52.017349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897127033906388:8737] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:52.017352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897127033906388:8737] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:52.017360Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3370 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:52.020834Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:52.021060Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:52.021071Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:52.021083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:52.021137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:52.021184Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897131239069098:13383]
2025-09-30T14:59:52.021708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:52.022045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:52.022098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:52.022353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:52.022394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.022395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.022396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.022398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.022399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.022400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.022401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.022402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.022403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.022404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.022405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.022406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.022407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.022408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.022409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.022414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.022421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.022424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.022426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.022429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.022432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.022435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.022437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.022441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.022445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.022449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.022453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.022457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.022460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.022463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.022472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.022481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.022486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.022491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.022496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.022501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.022505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.022510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.022515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.022520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.022524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.022530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.022536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.022542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.022547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.022553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.022559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.022565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.022570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.022577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.022583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.022588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.022592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.022597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.022602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.022607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.022611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.022635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.022641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.022646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.022692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:52.031110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:52.032294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:52.032304Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:52.032306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:52.032311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:52.032319Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3369 [2:7555897131239069098:13383]
2025-09-30T14:59:52.032338Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:52.032357Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:52.032361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:52.032364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:52.032367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:52.032386Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:52.032393Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:52.032401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:52.032494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.032497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.032499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.032503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:52.032505Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:52.032588Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:52.032591Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.032607Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.032620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.032636Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:52.032655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897131239069092:13383]
2025-09-30T14:59:52.032658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897131239069092:13383]
2025-09-30T14:59:52.032661Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897131239069092:13383]
2025-09-30T14:59:52.032671Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:52.032688Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:52.032698Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:52.032702Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:52.032703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:52.032704Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:52.032706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:52.032749Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897131239069092:13383]
2025-09-30T14:59:52.032760Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:52.032771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897127033906364:2454], now have 1 active actors on pipe
2025-09-30T14:59:52.032779Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897131328873864:8737], now have 1 active actors on pipe
2025-09-30T14:59:52.033012Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:52.033398Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3369
2025-09-30T14:59:52.033447Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3369
2025-09-30T14:59:52.037911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:52.037940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:52.037980Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:52.037996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:52.038000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:52.038004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:52.038021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:52.038041Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:52.038061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:52.040124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:52.040151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:52.040188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:52.041071Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3370 partition: 0 MaxSeqNo: 42 sessionId: src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0
2025-09-30T14:59:52.042860Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b71e24ab-4d3a67b2-8f19d183-9043c3d0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:52.046777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0] Write session: try to update token
2025-09-30T14:59:52.046827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:52.052295Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:52.052325Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:52.052328Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:52.052330Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:52.052342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897131239069092:13383]
2025-09-30T14:59:52.052348Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897131239069092:13383]
2025-09-30T14:59:52.052352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897131239069092:13383]
2025-09-30T14:59:52.052399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:52.052424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.052428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:52.052619Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:52.055122Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:52.055142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:52.055147Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:52.087572Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897131328873878:2695]
2025-09-30T14:59:52.088542Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 68 pipe creation result: OK TabletId: 72075186224037892 Generation: 3369, pipe: [1:7555897131328873878:2695]
2025-09-30T14:59:52.112950Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3370 sessionId: src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:52.116305Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:52.191652Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:52.192316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897131328873878:2695], now have 1 active actors on pipe
2025-09-30T14:59:52.192346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:52.192353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:52.196029Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:52.196120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 68 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897131328873878:2695]
2025-09-30T14:59:52.196151Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:52.196154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:52.196243Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3370 reason: error at write: Disconnected sessionId: src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0
2025-09-30T14:59:52.196457Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3370 sessionId: src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0 is DEAD
2025-09-30T14:59:52.197011Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:52.197021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0] Write session will restart in 0.008029s
2025-09-30T14:59:52.197051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0] Write session: Do CDS request
2025-09-30T14:59:52.197057Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:52.196422Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:52.207783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:52.208159Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:52.208178Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3371
2025-09-30T14:59:52.208524Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3371 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:52.208561Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3371 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:52.208567Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3371 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:52.208575Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:52.209346Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3371 sessionId:  describe result for acl check
2025-09-30T14:59:52.209390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:52.209392Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:52.209394Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:52.209400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897131328873891:8734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:52.209970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897131328873891:8734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:52.215987Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897131328873891:8734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:52.230766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897131328873891:8734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:52.230790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897131328873891:8734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:52.230794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897131328873891:8734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:52.230803Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3371 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:52.256977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:52.262400Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:52.262718Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:52.262732Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:52.262746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:52.262824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:52.262874Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897131239069314:13385]
2025-09-30T14:59:52.263570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:52.264309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:52.264376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:52.264844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:52.264949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.264956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.264957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.264959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.264960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.264962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.264963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.264965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.264966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.264967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.264969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.264971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.264972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.264974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.264975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.264983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.264994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.264998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.265002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.265007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.265011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.265015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.265020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.265025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.265032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.265037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.265042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.265047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.265050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.265055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.265065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.265074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.265082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.265089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.265096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.265102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.265109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.265115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.265121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.265127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.265133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.265139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.265144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.265149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.265153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.265160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.265167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.265173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.265178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.265186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.265192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.265199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.265221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.265227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.265235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.265241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.265245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.265250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.265255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.265260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.265305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:52.275280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:52.276711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:52.276736Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:52.276740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:52.276744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:52.276752Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3370 [2:7555897131239069314:13385]
2025-09-30T14:59:52.276770Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:52.276790Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:52.276794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:52.276798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:52.276801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:52.276820Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:52.276834Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:52.276842Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:52.276916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.276934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.276937Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.276941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:52.276948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:52.277030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:52.277033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.277048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.277058Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.277079Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:52.277102Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897131239069308:13385]
2025-09-30T14:59:52.277109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897131239069308:13385]
2025-09-30T14:59:52.277111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897131239069308:13385]
2025-09-30T14:59:52.277120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:52.277133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:52.277136Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:52.277152Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:52.277156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:52.277158Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:52.277161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:52.277166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897131328873966:8734], now have 1 active actors on pipe
2025-09-30T14:59:52.277169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897131328873880:2454], now have 1 active actors on pipe
2025-09-30T14:59:52.277211Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897131239069308:13385]
2025-09-30T14:59:52.277230Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:52.277493Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3370
2025-09-30T14:59:52.277596Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3370
2025-09-30T14:59:52.277273Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:52.278040Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:52.278054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:52.278091Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|47f07e39-958a8f09-40221c06-c6007982_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:52.278101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:52.278105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:52.278107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:52.278121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:52.278150Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:52.278167Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:52.278473Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:52.278485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:52.278502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:52.278774Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3371 partition: 0 MaxSeqNo: 42 sessionId: src_id|47f07e39-958a8f09-40221c06-c6007982_0
2025-09-30T14:59:52.279301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|112d3a0f-57faf874-b8f63c68-e1c54d7e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|47f07e39-958a8f09-40221c06-c6007982_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:52.282952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47f07e39-958a8f09-40221c06-c6007982_0] Write session: try to update token
2025-09-30T14:59:52.282978Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47f07e39-958a8f09-40221c06-c6007982_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:52.296285Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897131328874101:2695]
2025-09-30T14:59:52.300047Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 69 pipe creation result: OK TabletId: 72075186224037892 Generation: 3370, pipe: [1:7555897131328874101:2695]
2025-09-30T14:59:52.300123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897131328874101:2695], now have 1 active actors on pipe
2025-09-30T14:59:52.311338Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:52.311362Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:52.311366Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:52.311368Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:52.311382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897131239069308:13385]
2025-09-30T14:59:52.311387Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897131239069308:13385]
2025-09-30T14:59:52.311392Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897131239069308:13385]
2025-09-30T14:59:52.311431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:52.311437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.311439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:52.311591Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:52.314006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:52.314029Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:52.314035Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:52.332924Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3371 sessionId: src_id|47f07e39-958a8f09-40221c06-c6007982_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:52.336191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:52.506819Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:52.507498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:52.507525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:52.508032Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:52.508110Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 69 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897131328874101:2695]
2025-09-30T14:59:52.508582Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f07e39-958a8f09-40221c06-c6007982_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:52.508139Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:52.508595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f07e39-958a8f09-40221c06-c6007982_0] Write session will restart in 0.007198s
2025-09-30T14:59:52.508148Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:52.508227Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3371 reason: error at write: Disconnected sessionId: src_id|47f07e39-958a8f09-40221c06-c6007982_0
2025-09-30T14:59:52.508401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3371 sessionId: src_id|47f07e39-958a8f09-40221c06-c6007982_0 is DEAD
2025-09-30T14:59:52.508589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:52.508650Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f07e39-958a8f09-40221c06-c6007982_0] Write session: Do CDS request
2025-09-30T14:59:52.508660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f07e39-958a8f09-40221c06-c6007982_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:52.516881Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|47f07e39-958a8f09-40221c06-c6007982_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:52.517271Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:52.517294Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3372
2025-09-30T14:59:52.517449Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3372 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:52.517498Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3372 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:52.517509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3372 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:52.517515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:52.518014Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3372 sessionId:  describe result for acl check
2025-09-30T14:59:52.518047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:52.518053Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:52.518054Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:52.518059Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897131328874154:8765] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:52.518996Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897131328874154:8765] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:52.525621Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897131328874154:8765] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:52.535276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897131328874154:8765] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:52.535300Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897131328874154:8765] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:52.535308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897131328874154:8765] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:52.535320Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3372 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:52.548020Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:52.550952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:52.551146Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:52.551148Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:52.551157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:52.551195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:52.551224Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897131239069567:13400]
2025-09-30T14:59:52.551842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:52.552402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:52.552482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:52.552830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:52.552910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.552912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.552913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.552914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.552915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.552916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.552917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.552918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.552920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.552921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.552922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.552923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.552925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.552926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.552927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.552934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.552946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.552950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.552955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.552958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.552962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.552967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.552971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.552975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.552980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.552983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.552987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.552991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.552994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.552997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.553006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.553014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.553021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.553026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.553033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.553038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.553042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.553047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.553052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.553058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.553062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.553069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.553073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.553078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.553083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.553088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.553093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.553099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.553106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.553112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.553120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.553127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.553131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.553137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.553142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.553147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.553151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.553157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.553162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.553167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.553215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:52.561032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:52.562168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:52.562177Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:52.562181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:52.562185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:52.562194Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3371 [2:7555897131239069567:13400]
2025-09-30T14:59:52.562212Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:52.562228Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:52.562230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:52.562232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:52.562234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:52.562248Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:52.562253Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:52.562259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:52.562332Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.562334Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.562337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.562341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:52.562344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:52.562424Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:52.562427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.562444Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.562457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.562475Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:52.562490Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897131239069562:13400]
2025-09-30T14:59:52.562493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897131239069562:13400]
2025-09-30T14:59:52.562495Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897131239069562:13400]
2025-09-30T14:59:52.562515Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:52.562530Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:52.562544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:52.562547Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:52.562575Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:52.562578Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:52.562581Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:52.562592Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897131239069562:13400]
2025-09-30T14:59:52.562596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:52.562683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:52.562773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897131328874258:8765], now have 1 active actors on pipe
2025-09-30T14:59:52.562783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897131328874139:2454], now have 1 active actors on pipe
2025-09-30T14:59:52.563282Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3371
2025-09-30T14:59:52.563320Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3371
2025-09-30T14:59:52.563497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:52.563521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:52.563556Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:52.563565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:52.563578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:52.563581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:52.563594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:52.563608Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:52.563643Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:52.563901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:52.563914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:52.563939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:52.564443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3372 partition: 0 MaxSeqNo: 42 sessionId: src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0
2025-09-30T14:59:52.564926Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|47f07e39-958a8f09-40221c06-c6007982_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:52.568062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0] Write session: try to update token
2025-09-30T14:59:52.568087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:52.581772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:52.581803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:52.581806Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:52.581808Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:52.581819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897131239069562:13400]
2025-09-30T14:59:52.581824Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897131239069562:13400]
2025-09-30T14:59:52.581828Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897131239069562:13400]
2025-09-30T14:59:52.581876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:52.581885Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.581887Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:52.582060Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:52.584382Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:52.584403Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:52.584425Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:52.604344Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3372 sessionId: src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:52.607645Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:52.612777Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897131328874360:2695]
2025-09-30T14:59:52.613207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 70 pipe creation result: OK TabletId: 72075186224037892 Generation: 3371, pipe: [1:7555897131328874360:2695]
2025-09-30T14:59:52.739998Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:52.740858Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:52.740872Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:52.740919Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897131328874360:2695], now have 1 active actors on pipe
2025-09-30T14:59:52.741191Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:52.741608Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:52.741688Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:52.741692Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3372 reason: status is not ok: tablet will be restarted right now sessionId: src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0
2025-09-30T14:59:52.741760Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 70 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897131328874360:2695]
2025-09-30T14:59:52.741882Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3372 sessionId: src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0 is DEAD
2025-09-30T14:59:52.742262Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:52.742274Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0] Write session will restart in 0.008595s
2025-09-30T14:59:52.742301Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0] Write session: Do CDS request
2025-09-30T14:59:52.742307Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:52.751789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:52.752344Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:52.752365Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3373
2025-09-30T14:59:52.752559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3373 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:52.752600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3373 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:52.752605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3373 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:52.752612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:52.753173Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3373 sessionId:  describe result for acl check
2025-09-30T14:59:52.753215Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:52.753225Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:52.753228Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:52.753234Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897131328874378:8770] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:52.753794Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897131328874378:8770] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:52.757466Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897131328874378:8770] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:52.765160Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897131328874378:8770] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:52.765181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897131328874378:8770] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:52.765186Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897131328874378:8770] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:52.765196Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3373 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:52.775590Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:52.780515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:52.780818Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:52.780834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:52.780847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:52.780915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:52.780972Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897131239069797:13404]
2025-09-30T14:59:52.781712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:52.783914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:52.784038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:52.784480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:52.784576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.784578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.784579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.784582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.784583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.784584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.784586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.784588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.784590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.784591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.784593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.784594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.784595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.784597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.784598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.784606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.784617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.784621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.784625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.784643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.784648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.784652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.784656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.784660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.784665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.784669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.784672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.784676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.784679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.784683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.784696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.784704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:52.784712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.784719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:52.784724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.784730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:52.784736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.784742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:52.784748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.784754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:52.784759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.784765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:52.784781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.784786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:52.784791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.784797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:52.784802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.784806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:52.784814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.784820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:52.784825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.784831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.784836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.784842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.784848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.784854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.784859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.784865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:52.784870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.784876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:52.784921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:52.791504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:52.792884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:52.792912Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:52.792915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:52.792920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:52.792928Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3372 [2:7555897131239069797:13404]
2025-09-30T14:59:52.792948Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:52.792972Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:52.792976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:52.792980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:52.792983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:52.793004Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:52.793011Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:52.793020Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:52.793106Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.793107Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.793110Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.793114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:52.793117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:52.793211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:52.793215Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.793230Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:52.793241Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:52.793267Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:52.793286Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897131239069792:13404]
2025-09-30T14:59:52.793289Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897131239069792:13404]
2025-09-30T14:59:52.793291Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897131239069792:13404]
2025-09-30T14:59:52.793307Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:52.793323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:52.793338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:52.793342Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:52.793388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897131239069792:13404]
2025-09-30T14:59:52.793393Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:52.793945Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:52.793949Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:52.793952Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:52.793958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:52.794181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897131328874489:8770], now have 1 active actors on pipe
2025-09-30T14:59:52.794190Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897131328874363:2454], now have 1 active actors on pipe
2025-09-30T14:59:52.794651Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3372
2025-09-30T14:59:52.794689Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3372
2025-09-30T14:59:52.794946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:52.794971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:52.795023Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:52.795043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:52.795048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:52.795052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:52.795067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:52.795096Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:52.795117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:52.797430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:52.797454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:52.797498Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:52.797672Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3373 partition: 0 MaxSeqNo: 42 sessionId: src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0
2025-09-30T14:59:52.798897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|eb96f7a0-aeee657b-288816f2-be4f46d0_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:52.802325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0] Write session: try to update token
2025-09-30T14:59:52.802356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:52.816741Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:52.816766Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:52.816769Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:52.816772Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:52.816783Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897131239069792:13404]
2025-09-30T14:59:52.816788Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897131239069792:13404]
2025-09-30T14:59:52.816793Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897131239069792:13404]
2025-09-30T14:59:52.816841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:52.816849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:52.816853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:52.817017Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:52.820546Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:52.820576Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:52.820581Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:52.827042Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3373 sessionId: src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:52.830427Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:52.841946Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897131328874587:2695]
2025-09-30T14:59:52.842915Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 71 pipe creation result: OK TabletId: 72075186224037892 Generation: 3372, pipe: [1:7555897131328874587:2695]
2025-09-30T14:59:52.999368Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:53.000198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:53.000210Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:53.000232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897131328874587:2695], now have 1 active actors on pipe
2025-09-30T14:59:53.000939Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:53.000956Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:53.001018Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3373 reason: error at write: Disconnected sessionId: src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0
2025-09-30T14:59:53.001212Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3373 sessionId: src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0 is DEAD
2025-09-30T14:59:53.000848Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:53.001415Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 71 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897131328874587:2695]
2025-09-30T14:59:53.001437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:53.001691Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:53.001705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0] Write session will restart in 0.007310s
2025-09-30T14:59:53.001730Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0] Write session: Do CDS request
2025-09-30T14:59:53.001740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:53.009821Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:53.009931Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:53.009952Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3374
2025-09-30T14:59:53.010264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3374 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:53.010298Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3374 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:53.010305Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3374 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:53.010309Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:53.010846Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3374 sessionId:  describe result for acl check
2025-09-30T14:59:53.010886Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:53.010888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:53.010890Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:53.010895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897135623841916:8784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:53.011372Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897135623841916:8784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:53.022476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897135623841916:8784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:53.031980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897135623841916:8784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:53.032005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897135623841916:8784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:53.032009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897135623841916:8784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:53.032020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3374 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:53.041309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:53.055099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:53.055428Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:53.055444Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:53.055458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:53.055538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:53.055581Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897135534037312:13406]
2025-09-30T14:59:53.056315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:53.057052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:53.057121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:53.057544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:53.057606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.057607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.057609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.057610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.057612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.057614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.057615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.057617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.057618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.057620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.057621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.057623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.057624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.057625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.057627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.057633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.057645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.057651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.057656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.057661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.057666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.057670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.057675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.057680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.057687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.057692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.057697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.057702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.057706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.057711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.057721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.057730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.057737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.057744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.057749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.057756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.057762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.057768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.057774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.057780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.057786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.057793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.057798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.057805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.057810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.057819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.057825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.057832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.057838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.057844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.057851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.057858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.057864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.057871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.057876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.057882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.057887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.057893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.057900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.057906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.057959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:53.068458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:53.069540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:53.069549Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:53.069552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:53.069557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:53.069567Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3373 [2:7555897135534037312:13406]
2025-09-30T14:59:53.069587Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:53.069607Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:53.069611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:53.069615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:53.069617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:53.069637Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:53.069645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:53.069654Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:53.069734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.069738Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.069741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.069745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:53.069748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:53.069825Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:53.069829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.069846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.069860Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.069881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:53.069911Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897135534037307:13406]
2025-09-30T14:59:53.069914Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897135534037307:13406]
2025-09-30T14:59:53.069917Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897135534037307:13406]
2025-09-30T14:59:53.069925Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:53.069942Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:53.069961Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:53.069964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:53.069979Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:53.069984Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:53.069987Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:53.070008Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897135534037307:13406]
2025-09-30T14:59:53.070012Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:53.070022Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897135623842078:8784], now have 1 active actors on pipe
2025-09-30T14:59:53.070023Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:53.070026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897135623841903:2454], now have 1 active actors on pipe
2025-09-30T14:59:53.070470Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3373
2025-09-30T14:59:53.070523Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3373
2025-09-30T14:59:53.071050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:53.071071Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:53.071103Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:53.071114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:53.071124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:53.071127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:53.071140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:53.071160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:53.071192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:53.071638Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:53.071651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:53.071672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:53.072020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3374 partition: 0 MaxSeqNo: 42 sessionId: src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0
2025-09-30T14:59:53.075803Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95e5c74b-724cc31e-862fcfc7-16ba613b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:53.079709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0] Write session: try to update token
2025-09-30T14:59:53.079742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:53.101489Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897135623842126:2695]
2025-09-30T14:59:53.102153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 72 pipe creation result: OK TabletId: 72075186224037892 Generation: 3373, pipe: [1:7555897135623842126:2695]
2025-09-30T14:59:53.101732Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:53.101757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:53.101759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:53.101761Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:53.101770Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897135534037307:13406]
2025-09-30T14:59:53.101775Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897135534037307:13406]
2025-09-30T14:59:53.101779Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897135534037307:13406]
2025-09-30T14:59:53.101821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:53.101829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.101832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:53.101848Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:53.101855Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:53.101863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:53.101990Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:53.119852Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3374 sessionId: src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:53.127566Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:53.231570Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:53.231878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897135623842126:2695], now have 1 active actors on pipe
2025-09-30T14:59:53.231925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:53.231931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:53.232259Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:53.232905Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 72 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897135623842126:2695]
2025-09-30T14:59:53.232952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:53.233037Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3374 reason: status is not ok: tablet will be restarted right now sessionId: src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0
2025-09-30T14:59:53.233077Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:53.233213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3374 sessionId: src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0 is DEAD
2025-09-30T14:59:53.235543Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:53.235553Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0] Write session will restart in 0.007262s
2025-09-30T14:59:53.235588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0] Write session: Do CDS request
2025-09-30T14:59:53.235597Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:53.244138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:53.244234Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:53.244261Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3375
2025-09-30T14:59:53.244463Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3375 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:53.244522Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3375 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:53.244533Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3375 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:53.244538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:53.244965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3375 sessionId:  describe result for acl check
2025-09-30T14:59:53.244999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:53.245005Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:53.245007Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:53.245012Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897135623842147:8797] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:53.245564Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897135623842147:8797] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:53.250312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897135623842147:8797] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:53.255235Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897135623842147:8797] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:53.255276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897135623842147:8797] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:53.255280Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897135623842147:8797] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:53.255291Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3375 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:53.263142Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:53.270112Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:53.270496Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:53.270513Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:53.270528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:53.270601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:53.270656Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897135534037532:13409]
2025-09-30T14:59:53.271374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:53.272115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:53.272217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:53.272690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:53.272777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.272784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.272786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.272788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.272789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.272791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.272793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.272795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.272797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.272798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.272800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.272802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.272803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.272805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.272807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.272813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.272825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.272831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.272836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.272841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.272847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.272852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.272857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.272862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.272867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.272872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.272877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.272881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.272885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.272890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.272902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.272912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.272919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.272926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.272931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.272938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.272944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.272950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.272956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.272963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.272969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.272982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.272988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.272995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.273000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.273008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.273014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.273026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.273032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.273044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.273051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.273062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.273068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.273074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.273085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.273091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.273096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.273108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.273113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.273119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.273173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:53.289635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:53.291055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:53.291081Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:53.291083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:53.291088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:53.291097Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3374 [2:7555897135534037532:13409]
2025-09-30T14:59:53.291115Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:53.291135Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:53.291140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:53.291143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:53.291146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:53.291166Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:53.291175Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:53.291182Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:53.291295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.291305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.291308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.291312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:53.291315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:53.291405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:53.291416Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.291433Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.291449Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.291466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:53.291488Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897135534037527:13409]
2025-09-30T14:59:53.291491Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897135534037527:13409]
2025-09-30T14:59:53.291493Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897135534037527:13409]
2025-09-30T14:59:53.291513Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:53.291529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:53.291544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:53.291548Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:53.291593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897135534037527:13409]
2025-09-30T14:59:53.291596Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:53.291739Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:53.291755Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:53.291758Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:53.291766Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:53.292068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897135623842289:8797], now have 1 active actors on pipe
2025-09-30T14:59:53.292087Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897135623842132:2454], now have 1 active actors on pipe
2025-09-30T14:59:53.292401Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3374
2025-09-30T14:59:53.292458Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3374
2025-09-30T14:59:53.293421Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3375 partition: 0 MaxSeqNo: 42 sessionId: src_id|87d2acb8-7e73d17e-76803f49-fef353af_0
2025-09-30T14:59:53.292736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:53.292752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:53.292788Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|87d2acb8-7e73d17e-76803f49-fef353af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:53.292807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:53.292813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:53.292816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:53.292829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:53.292845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:53.292865Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:53.293216Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:53.293225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:53.293247Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:53.297344Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|424fc26b-48d9410b-94bb8a31-7cb8ff7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|87d2acb8-7e73d17e-76803f49-fef353af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:53.301234Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d2acb8-7e73d17e-76803f49-fef353af_0] Write session: try to update token
2025-09-30T14:59:53.301266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d2acb8-7e73d17e-76803f49-fef353af_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:53.308175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:53.308204Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:53.308207Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:53.308210Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:53.308220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897135534037527:13409]
2025-09-30T14:59:53.308225Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897135534037527:13409]
2025-09-30T14:59:53.308230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897135534037527:13409]
2025-09-30T14:59:53.308275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:53.308283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.308287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:53.308291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:53.308299Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:53.308304Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:53.308455Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:53.325894Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3375 sessionId: src_id|87d2acb8-7e73d17e-76803f49-fef353af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:53.329179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:53.333794Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897135623842358:2695]
2025-09-30T14:59:53.334454Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 73 pipe creation result: OK TabletId: 72075186224037892 Generation: 3374, pipe: [1:7555897135623842358:2695]
2025-09-30T14:59:53.501904Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:53.502760Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:53.502774Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:53.502797Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897135623842358:2695], now have 1 active actors on pipe
2025-09-30T14:59:53.505247Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:53.505992Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d2acb8-7e73d17e-76803f49-fef353af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:53.506007Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d2acb8-7e73d17e-76803f49-fef353af_0] Write session will restart in 0.008294s
2025-09-30T14:59:53.506036Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d2acb8-7e73d17e-76803f49-fef353af_0] Write session: Do CDS request
2025-09-30T14:59:53.506043Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d2acb8-7e73d17e-76803f49-fef353af_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:53.503924Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:53.504001Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 73 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897135623842358:2695]
2025-09-30T14:59:53.504032Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:53.504034Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:53.504102Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3375 reason: error at write: Disconnected sessionId: src_id|87d2acb8-7e73d17e-76803f49-fef353af_0
2025-09-30T14:59:53.504287Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3375 sessionId: src_id|87d2acb8-7e73d17e-76803f49-fef353af_0 is DEAD
2025-09-30T14:59:53.515920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|87d2acb8-7e73d17e-76803f49-fef353af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:53.524303Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:53.524324Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3376
2025-09-30T14:59:53.524629Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3376 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:53.524668Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3376 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:53.524673Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3376 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:53.524679Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:53.525880Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3376 sessionId:  describe result for acl check
2025-09-30T14:59:53.525937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:53.525939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:53.525940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:53.525948Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897135623842408:8809] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:53.526665Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897135623842408:8809] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:53.537276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897135623842408:8809] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:53.546741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897135623842408:8809] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:53.546766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897135623842408:8809] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:53.546770Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897135623842408:8809] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:53.546779Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3376 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:53.570523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:53.571795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:53.572073Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:53.572078Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:53.572092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:53.572169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:53.572214Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897135534037788:13417]
2025-09-30T14:59:53.572957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:53.573740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:53.573818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:53.574212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:53.574318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.574320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.574321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.574323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.574325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.574326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.574328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.574329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.574331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.574332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.574333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.574335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.574336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.574337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.574339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.574346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.574362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.574366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.574370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.574374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.574378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.574382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.574386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.574390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.574395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.574398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.574402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.574406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.574409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.574413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.574423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.574432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.574440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.574446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.574452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.574458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.574464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.574470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.574476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.574482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.574488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.574494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.574500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.574506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.574511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.574516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.574525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.574530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.574536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.574542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.574547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.574554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.574559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.574564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.574571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.574579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.574583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.574589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.574593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.574599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.574645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:53.589012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:53.590395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:53.590417Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:53.590420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:53.590424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:53.590433Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3375 [2:7555897135534037788:13417]
2025-09-30T14:59:53.590451Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:53.590469Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:53.590474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:53.590477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:53.590479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:53.590497Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:53.590504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:53.590512Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:53.591959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3375
2025-09-30T14:59:53.591998Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3375
2025-09-30T14:59:53.590589Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.590606Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.590610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.590614Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:53.590617Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:53.590709Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:53.590712Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.590730Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.590742Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.590761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:53.590781Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897135534037783:13417]
2025-09-30T14:59:53.590784Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897135534037783:13417]
2025-09-30T14:59:53.590787Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897135534037783:13417]
2025-09-30T14:59:53.590796Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:53.590813Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:53.590816Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:53.590820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:53.590823Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:53.590828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:53.590832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:53.590843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897135623842522:8809], now have 1 active actors on pipe
2025-09-30T14:59:53.590847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897135623842382:2454], now have 1 active actors on pipe
2025-09-30T14:59:53.590888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897135534037783:13417]
2025-09-30T14:59:53.590900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:53.590988Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:53.592726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:53.592746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:53.592782Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|56c4d410-a37b0397-a82550f5-26d068bd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:53.592793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:53.592799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:53.592803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:53.592818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:53.592834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:53.592855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:53.594896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:53.594918Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:53.594952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:53.595968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3376 partition: 0 MaxSeqNo: 42 sessionId: src_id|56c4d410-a37b0397-a82550f5-26d068bd_0
2025-09-30T14:59:53.596429Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|87d2acb8-7e73d17e-76803f49-fef353af_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|56c4d410-a37b0397-a82550f5-26d068bd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:53.599699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c4d410-a37b0397-a82550f5-26d068bd_0] Write session: try to update token
2025-09-30T14:59:53.599729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c4d410-a37b0397-a82550f5-26d068bd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:53.603290Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897135623842617:2695]
2025-09-30T14:59:53.604003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897135623842617:2695], now have 1 active actors on pipe
2025-09-30T14:59:53.604060Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 74 pipe creation result: OK TabletId: 72075186224037892 Generation: 3375, pipe: [1:7555897135623842617:2695]
2025-09-30T14:59:53.610568Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:53.610594Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:53.610597Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:53.610604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:53.610615Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897135534037783:13417]
2025-09-30T14:59:53.610620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897135534037783:13417]
2025-09-30T14:59:53.610624Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897135534037783:13417]
2025-09-30T14:59:53.610671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:53.610680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.610683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:53.610856Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:53.612391Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:53.612418Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:53.612423Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:53.645200Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3376 sessionId: src_id|56c4d410-a37b0397-a82550f5-26d068bd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:53.648293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:53.775278Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:53.775874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:53.775896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:53.776326Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:53.776860Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:53.776944Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3376 reason: status is not ok: tablet will be restarted right now sessionId: src_id|56c4d410-a37b0397-a82550f5-26d068bd_0
2025-09-30T14:59:53.777111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3376 sessionId: src_id|56c4d410-a37b0397-a82550f5-26d068bd_0 is DEAD
2025-09-30T14:59:53.777270Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:53.777301Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 74 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897135623842617:2695]
2025-09-30T14:59:53.781540Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c4d410-a37b0397-a82550f5-26d068bd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:53.781557Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c4d410-a37b0397-a82550f5-26d068bd_0] Write session will restart in 0.009634s
2025-09-30T14:59:53.781584Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c4d410-a37b0397-a82550f5-26d068bd_0] Write session: Do CDS request
2025-09-30T14:59:53.781591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c4d410-a37b0397-a82550f5-26d068bd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:53.795713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|56c4d410-a37b0397-a82550f5-26d068bd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:53.795867Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:53.795888Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3377
2025-09-30T14:59:53.796110Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3377 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:53.796170Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3377 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:53.796184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3377 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:53.796189Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:53.796682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3377 sessionId:  describe result for acl check
2025-09-30T14:59:53.796725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:53.796739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:53.796742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:53.796749Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897135623842638:8825] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:53.797352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897135623842638:8825] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:53.815156Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897135623842638:8825] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:53.828194Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897135623842638:8825] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:53.828213Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897135623842638:8825] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:53.828216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897135623842638:8825] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:53.828224Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3377 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:53.829669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:53.835600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:53.835889Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:53.835902Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:53.835913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:53.835990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:53.836038Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897135534038021:13427]
2025-09-30T14:59:53.836733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:53.838311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:53.838393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:53.838731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:53.838794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.838795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.838795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.838797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.838798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.838799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.838800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.838801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.838802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.838802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.838803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.838804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.838805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.838805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.838806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.838811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.838818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.838821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.838823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.838826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.838829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.838831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.838834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.838836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.838839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.838841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.838844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.838846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.838849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.838851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.838858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.838867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:53.838872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.838875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:53.838878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.838881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:53.838884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.838892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:53.838896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.838900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:53.838903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.838906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:53.838909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.838913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:53.838915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.838918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:53.838921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.838924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:53.838926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.838928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:53.838931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.838934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.838936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.838939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.838942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.838945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.838947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.838950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:53.838955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.838957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:53.838981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:53.859979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:53.861385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:53.861392Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:53.861393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:53.861396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:53.861401Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3376 [2:7555897135534038021:13427]
2025-09-30T14:59:53.861414Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:53.861427Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:53.861430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:53.861432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:53.861434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:53.861446Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:53.861451Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:53.861456Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:53.861525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.861527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.861529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.861533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:53.861535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:53.861616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:53.861619Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.861632Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:53.861644Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:53.861662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:53.861678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897135534038014:13427]
2025-09-30T14:59:53.861684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897135534038014:13427]
2025-09-30T14:59:53.861686Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897135534038014:13427]
2025-09-30T14:59:53.861695Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:53.861709Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:53.861724Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:53.861728Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:53.861767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897135534038014:13427]
2025-09-30T14:59:53.861770Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:53.862937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3376
2025-09-30T14:59:53.862983Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3376
2025-09-30T14:59:53.862470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:53.862484Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:53.862487Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:53.862493Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:53.864031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897135623842837:8825], now have 1 active actors on pipe
2025-09-30T14:59:53.864052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897135623842622:2454], now have 1 active actors on pipe
2025-09-30T14:59:53.865599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:53.865616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:53.865654Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:53.865668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:53.865673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:53.865676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:53.865699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:53.865716Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:53.865749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:53.869696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:53.869728Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:53.869785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:53.870012Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3377 partition: 0 MaxSeqNo: 42 sessionId: src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0
2025-09-30T14:59:53.870461Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|56c4d410-a37b0397-a82550f5-26d068bd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:53.873647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0] Write session: try to update token
2025-09-30T14:59:53.873677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:53.879585Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897135623842850:2695]
2025-09-30T14:59:53.881117Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:53.881140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:53.881143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:53.881146Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:53.881158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897135534038014:13427]
2025-09-30T14:59:53.881164Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897135534038014:13427]
2025-09-30T14:59:53.881169Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897135534038014:13427]
2025-09-30T14:59:53.881214Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:53.881223Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:53.881226Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:53.881378Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:53.882959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:53.882979Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:53.882983Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:53.883444Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 75 pipe creation result: OK TabletId: 72075186224037892 Generation: 3376, pipe: [1:7555897135623842850:2695]
2025-09-30T14:59:53.906060Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3377 sessionId: src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:53.909165Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:54.070322Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:54.070800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897135623842850:2695], now have 1 active actors on pipe
2025-09-30T14:59:54.070832Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:54.070838Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:54.071165Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:54.071143Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 75 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897135623842850:2695]
2025-09-30T14:59:54.071178Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:54.071231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:54.071234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:54.071325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3377 reason: error at write: Disconnected sessionId: src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0
2025-09-30T14:59:54.071530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3377 sessionId: src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0 is DEAD
2025-09-30T14:59:54.071712Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:54.071724Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0] Write session will restart in 0.008819s
2025-09-30T14:59:54.071759Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0] Write session: Do CDS request
2025-09-30T14:59:54.071769Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:54.081737Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:54.082148Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:54.082167Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3378
2025-09-30T14:59:54.082346Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3378 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:54.082399Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3378 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:54.082406Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3378 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:54.082410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:54.083869Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3378 sessionId:  describe result for acl check
2025-09-30T14:59:54.083920Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:54.083930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:54.083932Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:54.083939Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897139918810182:8836] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:54.084517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897139918810182:8836] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:54.090202Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897139918810182:8836] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:54.095025Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897139918810182:8836] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:54.095047Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897139918810182:8836] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:54.095050Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897139918810182:8836] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:54.095058Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3378 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:54.105722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:54.108550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:54.108817Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:54.108822Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:54.108835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:54.108901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:54.108949Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897139829005538:13429]
2025-09-30T14:59:54.109642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:54.110038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:54.110096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:54.110558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:54.110647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.110654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.110655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.110656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.110657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.110659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.110660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.110662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.110663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.110664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.110666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.110667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.110669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.110670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.110672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.110679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.110690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.110694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.110698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.110702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.110707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.110712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.110716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.110721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.110727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.110731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.110735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.110739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.110743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.110748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.110757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.110766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.110774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.110795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.110801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.110807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.110818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.110825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.110831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.110837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.110841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.110847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.110852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.110857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.110862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.110868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.110872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.110877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.110882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.110888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.110893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.110899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.110905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.110910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.110919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.110926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.110931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.110937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.110941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.110946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.110988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:54.117618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:54.118709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:54.118737Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:54.118741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:54.118745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:54.118753Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3377 [2:7555897139829005538:13429]
2025-09-30T14:59:54.118772Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:54.118789Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:54.118794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:54.118797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:54.118800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:54.118818Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:54.118825Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:54.118832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:54.118900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.118910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.118913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.118917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:54.118920Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:54.118997Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:54.119007Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.119021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.119034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.119053Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:54.119088Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897139829005533:13429]
2025-09-30T14:59:54.119092Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897139829005533:13429]
2025-09-30T14:59:54.119094Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897139829005533:13429]
2025-09-30T14:59:54.119103Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:54.119115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:54.119119Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:54.119122Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:54.119123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897139918810166:2454], now have 1 active actors on pipe
2025-09-30T14:59:54.119131Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:54.119147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:54.119151Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:54.119158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897139918810301:8836], now have 1 active actors on pipe
2025-09-30T14:59:54.119195Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897139829005533:13429]
2025-09-30T14:59:54.119203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:54.119217Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:54.119226Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3377
2025-09-30T14:59:54.119314Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3377
2025-09-30T14:59:54.119414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:54.119433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:54.119464Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8c310bb4-ea24a020-89e7f08f-6854065_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:54.119480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:54.119484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:54.119487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:54.119500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:54.119527Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:54.119551Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:54.119914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:54.119929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:54.119952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:54.120507Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5391d1e6-f24c2d46-2b907ee6-6b2d47af_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8c310bb4-ea24a020-89e7f08f-6854065_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:54.120117Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3378 partition: 0 MaxSeqNo: 42 sessionId: src_id|8c310bb4-ea24a020-89e7f08f-6854065_0
2025-09-30T14:59:54.123738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c310bb4-ea24a020-89e7f08f-6854065_0] Write session: try to update token
2025-09-30T14:59:54.123761Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c310bb4-ea24a020-89e7f08f-6854065_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:54.139468Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:54.139494Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:54.139505Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897139829005533:13429]
2025-09-30T14:59:54.139556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:54.139737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:54.139886Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:54.140036Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:54.140183Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:54.140238Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:54.140419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:54.140460Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:54.142388Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3378 sessionId: src_id|8c310bb4-ea24a020-89e7f08f-6854065_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:54.145265Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:54.146589Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:54.146616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:54.146651Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:54.146916Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:54.160365Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:54.160392Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:54.160395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:54.160397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:54.160425Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897139829005533:13429]
2025-09-30T14:59:54.160430Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897139829005533:13429]
2025-09-30T14:59:54.160435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897139829005533:13429]
2025-09-30T14:59:54.160479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:54.160490Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.160493Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:54.160653Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:54.162455Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:54.162474Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:54.162479Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:54.171117Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897139918810395:2695]
2025-09-30T14:59:54.171655Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 76 pipe creation result: OK TabletId: 72075186224037892 Generation: 3377, pipe: [1:7555897139918810395:2695]
2025-09-30T14:59:54.342849Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:54.343663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897139918810395:2695], now have 1 active actors on pipe
2025-09-30T14:59:54.352958Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:54.352993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:54.353185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:54.353259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:54.353348Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:54.353417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:54.353465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:54.353470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:54.353546Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:54.353612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:54.353685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:54.353758Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:54.353801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:54.353804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:54.353881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:54.353947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:54.354016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:54.354088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:54.354531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:54.354538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:54.354621Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:54.354692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:54.354764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:54.354837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:54.354884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:54.354887Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:54.354969Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:54.355049Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:54.355122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:54.355195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:54.355870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:54.355896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:54.356038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:54.356152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:54.356226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:54.356302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:54.356350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:54.356353Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:54.356456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:54.356532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:54.356620Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:54.356749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:54.356805Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:54.356809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:54.356897Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:54.356971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:54.357048Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:54.357125Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:54.357178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:54.357182Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:54.357342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:54.357414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:54.357487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:54.357567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:54.357629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:54.357633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:54.357716Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:54.357820Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:54.357932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:54.358006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:54.358055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:54.358058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:54.359376Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 76 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897139918810395:2695]
2025-09-30T14:59:54.359415Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:54.359458Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:54.359461Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:54.359504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3378 reason: error at write: Disconnected sessionId: src_id|8c310bb4-ea24a020-89e7f08f-6854065_0
2025-09-30T14:59:54.359691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3378 sessionId: src_id|8c310bb4-ea24a020-89e7f08f-6854065_0 is DEAD
2025-09-30T14:59:54.359455Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:54.360333Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c310bb4-ea24a020-89e7f08f-6854065_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:54.360342Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c310bb4-ea24a020-89e7f08f-6854065_0] Write session will restart in 0.009826s
2025-09-30T14:59:54.360367Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c310bb4-ea24a020-89e7f08f-6854065_0] Write session: Do CDS request
2025-09-30T14:59:54.360373Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c310bb4-ea24a020-89e7f08f-6854065_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:54.371900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8c310bb4-ea24a020-89e7f08f-6854065_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:54.371942Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:54.371963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3379
2025-09-30T14:59:54.372199Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3379 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:54.372242Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3379 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:54.372247Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3379 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:54.372252Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:54.372694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3379 sessionId:  describe result for acl check
2025-09-30T14:59:54.372727Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:54.372729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:54.372731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:54.372737Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897139918810414:8841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:54.373315Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897139918810414:8841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:54.378689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897139918810414:8841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:54.395013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897139918810414:8841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:54.395039Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897139918810414:8841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:54.395042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897139918810414:8841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:54.395055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3379 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:54.424374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:54.434540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:54.435015Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:54.435033Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:54.435051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:54.435134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:54.435176Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897139829005762:13432]
2025-09-30T14:59:54.435877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:54.437420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:54.437511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:54.437946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:54.438064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.438066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.438068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.438069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.438071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.438073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.438075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.438077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.438078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.438079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.438081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.438082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.438084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.438085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.438087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.438096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.438107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.438112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.438117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.438121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.438126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.438130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.438134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.438137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.438142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.438146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.438150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.438155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.438159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.438163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.438176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.438186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.438192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.438198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.438204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.438209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.438215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.438221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.438237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.438243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.438248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.438252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.438258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.438263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.438268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.438274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.438280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.438288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.438324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.438330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.438336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.438341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.438350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.438355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.438361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.438366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.438372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.438377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.438382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.438388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.438437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:54.447092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:54.448518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:54.448541Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:54.448544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:54.448548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:54.448556Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3378 [2:7555897139829005762:13432]
2025-09-30T14:59:54.448576Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:54.448595Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:54.448599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:54.448603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:54.448605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:54.448627Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:54.448638Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:54.448652Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:54.448729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.448739Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.448741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.448745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:54.448747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:54.448829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:54.448840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.448856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.448869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.448889Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:54.448907Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897139829005757:13432]
2025-09-30T14:59:54.448910Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897139829005757:13432]
2025-09-30T14:59:54.448912Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897139829005757:13432]
2025-09-30T14:59:54.448923Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:54.448940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897139918810507:8841], now have 1 active actors on pipe
2025-09-30T14:59:54.448941Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:54.448947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897139918810398:2454], now have 1 active actors on pipe
2025-09-30T14:59:54.448948Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:54.448950Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:54.448954Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:54.448969Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:54.448973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:54.449015Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897139829005757:13432]
2025-09-30T14:59:54.449171Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3378
2025-09-30T14:59:54.449023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:54.449174Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3378
2025-09-30T14:59:54.449445Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:54.449585Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:54.449602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:54.449634Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|624d8829-eff2256a-5439c92d-75e3c52c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:54.449646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:54.449666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:54.449671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:54.449686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:54.449701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:54.449725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:54.449967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:54.449982Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:54.450001Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:54.450139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3379 partition: 0 MaxSeqNo: 42 sessionId: src_id|624d8829-eff2256a-5439c92d-75e3c52c_0
2025-09-30T14:59:54.450517Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8c310bb4-ea24a020-89e7f08f-6854065_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|624d8829-eff2256a-5439c92d-75e3c52c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:54.453632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|624d8829-eff2256a-5439c92d-75e3c52c_0] Write session: try to update token
2025-09-30T14:59:54.453674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|624d8829-eff2256a-5439c92d-75e3c52c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:54.462607Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897139918810635:2695]
2025-09-30T14:59:54.466240Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 77 pipe creation result: OK TabletId: 72075186224037892 Generation: 3378, pipe: [1:7555897139918810635:2695]
2025-09-30T14:59:54.466212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897139918810635:2695], now have 1 active actors on pipe
2025-09-30T14:59:54.482257Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:54.482282Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:54.482285Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:54.482287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:54.482301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897139829005757:13432]
2025-09-30T14:59:54.482306Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897139829005757:13432]
2025-09-30T14:59:54.482310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897139829005757:13432]
2025-09-30T14:59:54.482354Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:54.482359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.482366Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:54.482389Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:54.482397Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:54.482402Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:54.482515Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:54.486598Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3379 sessionId: src_id|624d8829-eff2256a-5439c92d-75e3c52c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:54.490078Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:54.621253Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:54.621826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:54.621847Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:54.622529Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:54.622570Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:54.623340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624d8829-eff2256a-5439c92d-75e3c52c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:54.623354Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624d8829-eff2256a-5439c92d-75e3c52c_0] Write session will restart in 0.009524s
2025-09-30T14:59:54.623382Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624d8829-eff2256a-5439c92d-75e3c52c_0] Write session: Do CDS request
2025-09-30T14:59:54.623389Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624d8829-eff2256a-5439c92d-75e3c52c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:54.622645Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 77 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897139918810635:2695]
2025-09-30T14:59:54.622684Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:54.622690Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:54.622802Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3379 reason: error at write: Disconnected sessionId: src_id|624d8829-eff2256a-5439c92d-75e3c52c_0
2025-09-30T14:59:54.622990Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3379 sessionId: src_id|624d8829-eff2256a-5439c92d-75e3c52c_0 is DEAD
2025-09-30T14:59:54.634192Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|624d8829-eff2256a-5439c92d-75e3c52c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:54.634593Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:54.634616Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3380
2025-09-30T14:59:54.634762Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3380 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:54.634800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3380 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:54.634806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3380 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:54.634810Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:54.636236Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3380 sessionId:  describe result for acl check
2025-09-30T14:59:54.636275Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:54.636277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:54.636278Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:54.636285Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897139918810684:8863] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:54.636795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897139918810684:8863] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:54.643135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897139918810684:8863] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:54.654237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897139918810684:8863] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:54.654259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897139918810684:8863] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:54.654263Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897139918810684:8863] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:54.654272Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3380 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:54.662266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:54.666531Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:54.666796Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:54.666809Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:54.666824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:54.666881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:54.666922Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897139829006035:13447]
2025-09-30T14:59:54.667662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:54.668281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:54.668350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:54.668768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:54.668866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.668868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.668869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.668870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.668872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.668874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.668875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.668877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.668878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.668880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.668882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.668883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.668885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.668887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.668889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.668897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.668908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.668912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.668917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.668922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.668927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.668932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.668936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.668941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.668946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.668951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.668955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.668959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.668964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.668968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.668978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.668990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.668997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.669004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.669010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.669016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.669022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.669028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.669034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.669040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.669045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.669051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.669057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.669064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.669069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.669075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.669082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.669088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.669093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.669098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.669105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.669111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.669116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.669123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.669128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.669134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.669139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.669145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.669151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.669158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.669209Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:54.677222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:54.678323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:54.678332Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:54.678336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:54.678341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:54.678348Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3379 [2:7555897139829006035:13447]
2025-09-30T14:59:54.678369Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:54.678388Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:54.678392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:54.678396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:54.678399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:54.678418Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:54.678426Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:54.678435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:54.678513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.678515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.678518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.678523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:54.678525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:54.678608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:54.678611Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.678629Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.678643Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.678662Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:54.678681Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897139829006030:13447]
2025-09-30T14:59:54.678684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897139829006030:13447]
2025-09-30T14:59:54.678688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897139829006030:13447]
2025-09-30T14:59:54.678707Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:54.678726Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:54.678743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:54.678747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:54.679179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897139829006030:13447]
2025-09-30T14:59:54.679184Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:54.679596Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:54.679610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:54.679613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:54.679619Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:54.680066Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3379
2025-09-30T14:59:54.680121Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3379
2025-09-30T14:59:54.680596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897139918810846:8863], now have 1 active actors on pipe
2025-09-30T14:59:54.680618Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897139918810665:2454], now have 1 active actors on pipe
2025-09-30T14:59:54.680896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:54.680905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:54.680941Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:54.680955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:54.680959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:54.680963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:54.680977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:54.680993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:54.681023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:54.681533Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:54.681549Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:54.681573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:54.681730Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3380 partition: 0 MaxSeqNo: 42 sessionId: src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0
2025-09-30T14:59:54.682253Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|624d8829-eff2256a-5439c92d-75e3c52c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:54.685700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0] Write session: try to update token
2025-09-30T14:59:54.685730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:54.699572Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:54.699598Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:54.699602Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:54.699604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:54.699614Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897139829006030:13447]
2025-09-30T14:59:54.699620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897139829006030:13447]
2025-09-30T14:59:54.699625Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897139829006030:13447]
2025-09-30T14:59:54.699671Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:54.699680Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.699683Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:54.699848Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:54.703972Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:54.703998Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:54.704003Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:54.721326Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3380 sessionId: src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:54.722599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897139918810894:2695]
2025-09-30T14:59:54.723101Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 78 pipe creation result: OK TabletId: 72075186224037892 Generation: 3379, pipe: [1:7555897139918810894:2695]
2025-09-30T14:59:54.724597Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:54.848686Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:54.849184Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897139918810894:2695], now have 1 active actors on pipe
2025-09-30T14:59:54.849211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:54.849219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:54.849750Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:54.849767Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:54.849844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3380 reason: error at write: Disconnected sessionId: src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0
2025-09-30T14:59:54.850038Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3380 sessionId: src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0 is DEAD
2025-09-30T14:59:54.850197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:54.850238Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 78 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897139918810894:2695]
2025-09-30T14:59:54.850462Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:54.850475Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0] Write session will restart in 0.006769s
2025-09-30T14:59:54.850500Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0] Write session: Do CDS request
2025-09-30T14:59:54.850506Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:54.850700Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:54.858822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:54.858977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:54.858996Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3381
2025-09-30T14:59:54.862258Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3381 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:54.862320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3381 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:54.862327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3381 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:54.862334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:54.862959Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3381 sessionId:  describe result for acl check
2025-09-30T14:59:54.863015Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:54.863018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:54.863020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:54.863026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897139918810918:8869] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:54.863753Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897139918810918:8869] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:54.871888Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897139918810918:8869] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:54.883374Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897139918810918:8869] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:54.883397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897139918810918:8869] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:54.883401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897139918810918:8869] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:54.883412Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3381 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:54.898795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:54.902515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:54.902782Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:54.902787Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:54.902798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:54.902854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:54.902895Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897139829006260:13450]
2025-09-30T14:59:54.903621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:54.904270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:54.904333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:54.904726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:54.904803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.904804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.904805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.904806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.904808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.904809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.904810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.904811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.904813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.904814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.904816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.904817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.904818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.904820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.904821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.904843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.904853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.904857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.904861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.904865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.904869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.904874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.904878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.904882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.904887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.904891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.904895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.904898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.904902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.904906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.904915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.904925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:54.904932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.904938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:54.904942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.904948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:54.904953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.904958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:54.904964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.904969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:54.904974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.904980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:54.904986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.904991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:54.904996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.905002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:54.905007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.905012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:54.905016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.905025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:54.905030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.905035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.905040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.905046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.905050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.905055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.905059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.905064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:54.905069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.905074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:54.905121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:54.912839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:54.914057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:54.914082Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:54.914086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:54.914091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:54.914100Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3380 [2:7555897139829006260:13450]
2025-09-30T14:59:54.914120Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:54.914140Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:54.914149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:54.914153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:54.914156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:54.914174Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:54.914187Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:54.914196Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:54.914278Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.914286Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.914289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.914293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:54.914296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:54.914375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:54.914384Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.914400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:54.914411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:54.914427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:54.914447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897139918810898:2454], now have 1 active actors on pipe
2025-09-30T14:59:54.914451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897139918811045:8869], now have 1 active actors on pipe
2025-09-30T14:59:54.914459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897139829006254:13450]
2025-09-30T14:59:54.914461Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897139829006254:13450]
2025-09-30T14:59:54.914463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897139829006254:13450]
2025-09-30T14:59:54.914475Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:54.914485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:54.914488Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:54.914488Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:54.914491Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:54.914504Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:54.914508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:54.914550Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897139829006254:13450]
2025-09-30T14:59:54.914562Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:54.914595Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:54.915260Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3380
2025-09-30T14:59:54.915308Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3380
2025-09-30T14:59:54.915562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:54.915583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:54.915623Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:54.915633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:54.915638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:54.915642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:54.915654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:54.915670Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:54.915712Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:54.919413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:54.919438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:54.919478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:54.919713Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3381 partition: 0 MaxSeqNo: 42 sessionId: src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0
2025-09-30T14:59:54.920178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6965d4e9-6018b2d2-3610eb8b-87d67c35_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:54.924920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0] Write session: try to update token
2025-09-30T14:59:54.924950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:54.952293Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897139918811143:2695]
2025-09-30T14:59:54.953130Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 79 pipe creation result: OK TabletId: 72075186224037892 Generation: 3380, pipe: [1:7555897139918811143:2695]
2025-09-30T14:59:54.954516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897139918811143:2695], now have 1 active actors on pipe
2025-09-30T14:59:54.954547Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:54.954551Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:54.954561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897139829006254:13450]
2025-09-30T14:59:54.954614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:54.954680Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:54.954882Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:54.955047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:54.955224Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:54.955403Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:54.955634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:54.955689Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:54.961772Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:54.961798Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:54.961801Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:54.961803Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:54.961814Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897139829006254:13450]
2025-09-30T14:59:54.961819Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897139829006254:13450]
2025-09-30T14:59:54.961823Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897139829006254:13450]
2025-09-30T14:59:54.961863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:54.961871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:54.961874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:54.962037Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:54.964892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:54.964917Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:54.964922Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:54.989632Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3381 sessionId: src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:54.992732Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:55.118895Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:55.119957Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:55.119977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:55.124134Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:55.124154Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:55.124225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3381 reason: error at write: Disconnected sessionId: src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0
2025-09-30T14:59:55.124430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3381 sessionId: src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0 is DEAD
2025-09-30T14:59:55.124605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 79 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897139918811143:2695]
2025-09-30T14:59:55.124620Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:55.125018Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:55.125028Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0] Write session will restart in 0.005094s
2025-09-30T14:59:55.125053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0] Write session: Do CDS request
2025-09-30T14:59:55.125060Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:55.125994Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:55.132744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:55.136172Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:55.136192Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3382
2025-09-30T14:59:55.137145Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3382 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:55.137192Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3382 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:55.137197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3382 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:55.137219Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:55.137678Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3382 sessionId:  describe result for acl check
2025-09-30T14:59:55.137713Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:55.137715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:55.137718Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:55.137724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897144213778457:8880] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:55.138302Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897144213778457:8880] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:55.146018Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897144213778457:8880] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:55.163568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897144213778457:8880] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:55.163589Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897144213778457:8880] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:55.163593Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897144213778457:8880] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:55.163603Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3382 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:55.185433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:55.188786Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:55.189085Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:55.189090Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:55.189102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:55.189159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:55.189225Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897144123973783:13452]
2025-09-30T14:59:55.189867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:55.190439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:55.190496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:55.190860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:55.190938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.190940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.190941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.190942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.190944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.190945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.190947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.190948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.190950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.190951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.190953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.190954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.190956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.190957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.190958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.190966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.190978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.190982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.190987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.190991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.190995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.190998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.191002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.191006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.191011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.191015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.191018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.191021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.191025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.191030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.191038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.191046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.191052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.191058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.191082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.191088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.191093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.191098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.191105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.191110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.191115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.191119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.191125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.191129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.191133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.191139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.191147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.191151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.191157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.191162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.191167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.191172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.191177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.191183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.191187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.191193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.191198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.191204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.191211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.191216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.191282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:55.199151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:55.200678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:55.200687Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:55.200689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:55.200693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:55.200701Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3381 [2:7555897144123973783:13452]
2025-09-30T14:59:55.200720Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:55.200738Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:55.200742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:55.200746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:55.200748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:55.200767Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:55.200774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:55.200782Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:55.200853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.200856Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.200858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.200862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:55.200864Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:55.200941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:55.200944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.200959Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.200969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.200986Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:55.201004Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897144123973777:13452]
2025-09-30T14:59:55.201006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897144123973777:13452]
2025-09-30T14:59:55.201009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897144123973777:13452]
2025-09-30T14:59:55.201017Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:55.201032Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:55.201046Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:55.201049Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:55.201075Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:55.201087Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:55.201087Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897144123973777:13452]
2025-09-30T14:59:55.201089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:55.201089Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:55.201096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:55.201117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897144213778542:8880], now have 1 active actors on pipe
2025-09-30T14:59:55.201121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897144213778442:2454], now have 1 active actors on pipe
2025-09-30T14:59:55.201803Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3381
2025-09-30T14:59:55.201858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3381
2025-09-30T14:59:55.203600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:55.203627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:55.203664Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:55.203676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:55.203681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:55.203685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:55.203699Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:55.203717Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:55.203737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:55.206926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:55.206956Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:55.206996Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:55.207208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3382 partition: 0 MaxSeqNo: 42 sessionId: src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0
2025-09-30T14:59:55.207807Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|347df1c9-dd373098-f3e7cb63-2072ee1c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:55.210950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0] Write session: try to update token
2025-09-30T14:59:55.210977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:55.225244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897144213778672:2695]
2025-09-30T14:59:55.225870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897144213778672:2695], now have 1 active actors on pipe
2025-09-30T14:59:55.225927Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 80 pipe creation result: OK TabletId: 72075186224037892 Generation: 3381, pipe: [1:7555897144213778672:2695]
2025-09-30T14:59:55.234843Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:55.234876Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:55.234879Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:55.234882Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:55.234893Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897144123973777:13452]
2025-09-30T14:59:55.234899Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897144123973777:13452]
2025-09-30T14:59:55.234906Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897144123973777:13452]
2025-09-30T14:59:55.234958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:55.234968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.234971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:55.235166Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:55.237796Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:55.237820Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:55.237824Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:55.245559Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3382 sessionId: src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:55.248676Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:55.383064Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:55.383823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:55.383843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:55.385149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:55.385163Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:55.385231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3382 reason: error at write: Disconnected sessionId: src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0
2025-09-30T14:59:55.385426Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3382 sessionId: src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0 is DEAD
2025-09-30T14:59:55.385593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:55.385634Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 80 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897144213778672:2695]
2025-09-30T14:59:55.386226Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:55.386235Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0] Write session will restart in 0.008876s
2025-09-30T14:59:55.386263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0] Write session: Do CDS request
2025-09-30T14:59:55.386268Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:55.386651Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:55.400817Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:55.401181Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:55.401203Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3383
2025-09-30T14:59:55.401384Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3383 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:55.401418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3383 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:55.401425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3383 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:55.401430Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:55.402000Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3383 sessionId:  describe result for acl check
2025-09-30T14:59:55.402040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:55.402043Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:55.402045Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:55.402051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897144213778711:8899] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:55.402646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897144213778711:8899] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:55.416369Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897144213778711:8899] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:55.424734Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897144213778711:8899] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:55.424761Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897144213778711:8899] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:55.424766Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897144213778711:8899] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:55.424775Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3383 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:55.433081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:55.436681Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:55.436954Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:55.436959Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:55.436974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:55.437049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:55.437093Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897144123974011:13455]
2025-09-30T14:59:55.437733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:55.438264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:55.438335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:55.438697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:55.438767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.438768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.438769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.438770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.438771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.438772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.438773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.438774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.438776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.438776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.438777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.438778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.438779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.438780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.438780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.438785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.438793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.438796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.438799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.438802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.438805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.438807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.438810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.438813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.438816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.438818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.438821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.438823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.438826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.438828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.438837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.438842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.438847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.438850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.438853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.438857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.438860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.438863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.438867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.438870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.438874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.438877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.438894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.438899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.438902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.438906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.438910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.438914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.438917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.438921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.438924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.438929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.438932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.438936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.438939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.438942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.438945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.438949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.438952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.438955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.438983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:55.446479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:55.447938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:55.447961Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:55.447964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:55.447968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:55.447974Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3382 [2:7555897144123974011:13455]
2025-09-30T14:59:55.447994Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:55.448010Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:55.448013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:55.448016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:55.448019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:55.448035Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:55.448041Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:55.448047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:55.448109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.448111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.448112Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.448116Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:55.448118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:55.448173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:55.448176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.448187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.448193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.448203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:55.448216Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897144123974005:13455]
2025-09-30T14:59:55.448218Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897144123974005:13455]
2025-09-30T14:59:55.448219Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897144123974005:13455]
2025-09-30T14:59:55.448229Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:55.448240Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:55.448249Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:55.448251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:55.448283Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897144123974005:13455]
2025-09-30T14:59:55.448284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:55.448532Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:55.448541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:55.448543Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:55.448549Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:55.449020Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3382
2025-09-30T14:59:55.449089Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3382
2025-09-30T14:59:55.452196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897144213778887:8899], now have 1 active actors on pipe
2025-09-30T14:59:55.452229Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897144213778686:2454], now have 1 active actors on pipe
2025-09-30T14:59:55.452266Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:55.452279Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:55.452326Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:55.452339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:55.452344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:55.452348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:55.452363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:55.452382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:55.452422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:55.453307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:55.453332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:55.453361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:55.455051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7cd2554c-96d2ecf-d5728814-d6b16dfa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:55.458468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0] Write session: try to update token
2025-09-30T14:59:55.458497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:55.453526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3383 partition: 0 MaxSeqNo: 42 sessionId: src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0
2025-09-30T14:59:55.467671Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:55.467700Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:55.467704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:55.467706Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:55.467718Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897144123974005:13455]
2025-09-30T14:59:55.467724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897144123974005:13455]
2025-09-30T14:59:55.467729Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897144123974005:13455]
2025-09-30T14:59:55.467776Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:55.467787Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.467790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:55.467995Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:55.471125Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:55.471152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:55.471156Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:55.486117Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3383 sessionId: src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:55.487173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897144213778923:2695]
2025-09-30T14:59:55.489078Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 81 pipe creation result: OK TabletId: 72075186224037892 Generation: 3382, pipe: [1:7555897144213778923:2695]
2025-09-30T14:59:55.489364Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:55.626333Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:55.626837Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897144213778923:2695], now have 1 active actors on pipe
2025-09-30T14:59:55.626884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:55.626892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:55.628110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:55.628124Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0] Write session will restart in 0.008479s
2025-09-30T14:59:55.627647Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:55.628150Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0] Write session: Do CDS request
2025-09-30T14:59:55.628188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:55.627594Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:55.627612Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:55.627694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3383 reason: error at write: Disconnected sessionId: src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0
2025-09-30T14:59:55.627909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3383 sessionId: src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0 is DEAD
2025-09-30T14:59:55.628068Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:55.628270Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 81 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897144213778923:2695]
2025-09-30T14:59:55.637883Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:55.638274Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:55.638295Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3384
2025-09-30T14:59:55.638470Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3384 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:55.638515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3384 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:55.638520Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3384 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:55.638526Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:55.639017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3384 sessionId:  describe result for acl check
2025-09-30T14:59:55.639068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:55.639074Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:55.639076Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:55.639082Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897144213778951:5220] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:55.639698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897144213778951:5220] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:55.643922Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897144213778951:5220] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:55.650609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897144213778951:5220] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:55.650632Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897144213778951:5220] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:55.650638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897144213778951:5220] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:55.650647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3384 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:55.670505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:55.674169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:55.674475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:55.674493Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:55.674508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:55.674584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:55.674629Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897144123974288:13463]
2025-09-30T14:59:55.675347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:55.676161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:55.676229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:55.677396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:55.677540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.677541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.677542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.677544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.677545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.677547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.677548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.677550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.677551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.677553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.677554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.677555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.677557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.677558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.677559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.677566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.677577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.677581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.677585Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.677589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.677593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.677597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.677601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.677605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.677610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.677614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.677617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.677621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.677625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.677628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.677637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.677647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.677653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.677659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.677664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.677669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.677673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.677679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.677684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.677690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.677694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.677699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.677703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.677709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.677714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.677718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.677727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.677731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.677735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.677740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.677744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.677749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.677753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.677758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.677763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.677769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.677773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.677778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.677784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.677789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.677840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:55.685234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:55.686490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:55.686521Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:55.686525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:55.686529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:55.686537Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3383 [2:7555897144123974288:13463]
2025-09-30T14:59:55.686559Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:55.686582Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:55.686586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:55.686589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:55.686592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:55.686610Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:55.686623Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:55.686631Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:55.686704Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.686713Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.686715Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.686719Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:55.686721Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:55.686799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:55.686808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.686823Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.686836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.686854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:55.686876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897144213778939:2454], now have 1 active actors on pipe
2025-09-30T14:59:55.686885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897144213779026:5220], now have 1 active actors on pipe
2025-09-30T14:59:55.686892Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897144123974265:13463]
2025-09-30T14:59:55.686894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897144123974265:13463]
2025-09-30T14:59:55.686897Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897144123974265:13463]
2025-09-30T14:59:55.686913Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:55.686934Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:55.686942Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:55.686952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:55.686955Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:55.686957Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:55.686960Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:55.686956Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3383
2025-09-30T14:59:55.686995Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897144123974265:13463]
2025-09-30T14:59:55.687004Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:55.686974Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3383
2025-09-30T14:59:55.687023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:55.687025Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:55.687032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:55.687085Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|edee7d51-d485162e-3886f90f-56067068_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:55.687097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:55.687101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:55.687103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:55.687114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:55.687127Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:55.687151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:55.687444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:55.687465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:55.687502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:55.687644Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3384 partition: 0 MaxSeqNo: 42 sessionId: src_id|edee7d51-d485162e-3886f90f-56067068_0
2025-09-30T14:59:55.688040Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|aacb2b0f-311540e2-a3f75062-896dc26b_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|edee7d51-d485162e-3886f90f-56067068_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:55.691466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edee7d51-d485162e-3886f90f-56067068_0] Write session: try to update token
2025-09-30T14:59:55.691497Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edee7d51-d485162e-3886f90f-56067068_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:55.702109Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:55.702140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:55.702143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:55.702145Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:55.702155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897144123974265:13463]
2025-09-30T14:59:55.702161Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897144123974265:13463]
2025-09-30T14:59:55.702165Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897144123974265:13463]
2025-09-30T14:59:55.702210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:55.702218Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.702220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:55.702379Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:55.704477Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:55.704498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:55.704503Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:55.724362Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3384 sessionId: src_id|edee7d51-d485162e-3886f90f-56067068_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:55.727718Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:55.728588Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897144213779183:2695]
2025-09-30T14:59:55.729529Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 82 pipe creation result: OK TabletId: 72075186224037892 Generation: 3383, pipe: [1:7555897144213779183:2695]
2025-09-30T14:59:55.851555Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:55.852018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:55.852042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:55.852063Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897144213779183:2695], now have 1 active actors on pipe
2025-09-30T14:59:55.852336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:55.852352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:55.852505Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 82 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897144213779183:2695]
2025-09-30T14:59:55.852504Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3384 reason: error at write: Disconnected sessionId: src_id|edee7d51-d485162e-3886f90f-56067068_0
2025-09-30T14:59:55.852533Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:55.852686Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3384 sessionId: src_id|edee7d51-d485162e-3886f90f-56067068_0 is DEAD
2025-09-30T14:59:55.852845Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edee7d51-d485162e-3886f90f-56067068_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:55.852853Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edee7d51-d485162e-3886f90f-56067068_0] Write session will restart in 0.008957s
2025-09-30T14:59:55.852879Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edee7d51-d485162e-3886f90f-56067068_0] Write session: Do CDS request
2025-09-30T14:59:55.852887Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edee7d51-d485162e-3886f90f-56067068_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:55.853296Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:55.863769Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|edee7d51-d485162e-3886f90f-56067068_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:55.864305Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:55.864327Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3385
2025-09-30T14:59:55.865077Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3385 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:55.865126Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3385 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:55.865131Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3385 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:55.865139Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:55.866210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3385 sessionId:  describe result for acl check
2025-09-30T14:59:55.866256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:55.866264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:55.866267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:55.866274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897144213779222:5231] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:55.866883Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897144213779222:5231] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:55.876347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897144213779222:5231] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:55.883714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897144213779222:5231] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:55.883738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897144213779222:5231] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:55.883744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897144213779222:5231] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:55.883754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3385 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:55.887386Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:55.891535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:55.891827Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:55.891833Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:55.891848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:55.891927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:55.891973Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897144123974518:13473]
2025-09-30T14:59:55.892674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:55.893716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:55.893789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:55.894567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:55.894669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.894671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.894672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.894673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.894675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.894676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.894677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.894679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.894680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.894681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.894683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.894684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.894686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.894687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.894688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.894696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.894707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.894711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.894714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.894718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.894722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.894726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.894730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.894734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.894738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.894742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.894746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.894750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.894754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.894757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.894769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.894777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:55.894783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.894789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:55.894796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.894804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:55.894808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.894813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:55.894818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.894822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:55.894827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.894832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:55.894837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.894843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:55.894847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.894852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:55.894860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.894865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:55.894870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.894875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:55.894880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.894885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.894890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.894895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.894899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.894904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.894908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.894913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:55.894917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.894922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:55.894969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:55.901913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:55.903153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:55.903162Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:55.903165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:55.903170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:55.903178Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3384 [2:7555897144123974518:13473]
2025-09-30T14:59:55.903196Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:55.903217Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:55.903221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:55.903224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:55.903227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:55.903268Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:55.903276Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:55.903285Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:55.903375Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.903378Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.903383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.903386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:55.903389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:55.903469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:55.903471Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.903487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:55.903497Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:55.903514Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:55.903534Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897144123974513:13473]
2025-09-30T14:59:55.903536Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897144123974513:13473]
2025-09-30T14:59:55.903538Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897144123974513:13473]
2025-09-30T14:59:55.903557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:55.903574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:55.903590Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:55.903594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:55.903605Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:55.903610Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:55.903613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:55.903642Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897144123974513:13473]
2025-09-30T14:59:55.903645Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:55.903696Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:55.903748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897144213779188:2454], now have 1 active actors on pipe
2025-09-30T14:59:55.903757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897144213779397:5231], now have 1 active actors on pipe
2025-09-30T14:59:55.903968Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3384
2025-09-30T14:59:55.904023Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3384
2025-09-30T14:59:55.907448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:55.907479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:55.907517Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:55.907533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:55.907538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:55.907542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:55.907558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:55.907589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:55.907612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:55.908074Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:55.908095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:55.908130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:55.908261Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3385 partition: 0 MaxSeqNo: 42 sessionId: src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0
2025-09-30T14:59:55.908674Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|edee7d51-d485162e-3886f90f-56067068_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:55.911945Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0] Write session: try to update token
2025-09-30T14:59:55.911970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:55.925278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:55.925302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:55.925313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897144123974513:13473]
2025-09-30T14:59:55.925366Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:55.925376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:55.925586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:55.925759Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:55.925905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:55.926085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:55.926283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:55.926321Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:55.933008Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3385 sessionId: src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:55.936500Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:55.936842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:55.936870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:55.936908Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:55.937056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:55.953368Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:55.953393Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:55.953395Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:55.953397Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:55.953408Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897144123974513:13473]
2025-09-30T14:59:55.953412Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897144123974513:13473]
2025-09-30T14:59:55.953416Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897144123974513:13473]
2025-09-30T14:59:55.953463Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:55.953470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:55.953472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:55.953446Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897144213779435:2695]
2025-09-30T14:59:55.953688Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:55.953699Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:55.953703Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:55.955212Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 83 pipe creation result: OK TabletId: 72075186224037892 Generation: 3384, pipe: [1:7555897144213779435:2695]
2025-09-30T14:59:55.954315Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:56.085754Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:56.086271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897144213779435:2695], now have 1 active actors on pipe
2025-09-30T14:59:56.097357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:56.097394Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:56.097596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:56.097666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:56.097734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:56.097812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:56.097857Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:56.097869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:56.097955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:56.098023Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:56.098098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:56.098180Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:56.098227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:56.098231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:56.098312Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:56.098381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:56.098452Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:56.098526Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:56.098575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:56.098578Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:56.098661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:56.098738Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:56.098811Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:56.098881Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:56.098927Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:56.098931Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:56.099034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:56.099103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:56.099175Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:56.099515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:56.099575Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:56.099579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:56.099658Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:56.099727Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:56.099790Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:56.099861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:56.099909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:56.099914Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:56.099988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:56.100058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:56.100127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:56.100192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:56.100239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:56.100242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:56.100320Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:56.100408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:56.100477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:56.100548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:56.100596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:56.100599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:56.100676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:56.100748Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:56.100824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:56.100896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:56.100944Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:56.100946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:56.101026Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:56.101096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:56.101171Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:56.101248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:56.101298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:56.101301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:56.102841Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:56.103412Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 83 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897144213779435:2695]
2025-09-30T14:59:56.103457Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:56.103493Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3385 reason: status is not ok: tablet will be restarted right now sessionId: src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0
2025-09-30T14:59:56.103667Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3385 sessionId: src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0 is DEAD
2025-09-30T14:59:56.103738Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:56.103915Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:56.103925Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0] Write session will restart in 0.006618s
2025-09-30T14:59:56.103949Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0] Write session: Do CDS request
2025-09-30T14:59:56.103955Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:56.113185Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:56.113731Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:56.113758Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3386
2025-09-30T14:59:56.114076Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3386 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:56.114111Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3386 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:56.114116Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3386 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:56.114121Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:56.114977Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3386 sessionId:  describe result for acl check
2025-09-30T14:59:56.115021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:56.115023Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:56.115026Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:56.115033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897148508746750:5234] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:56.115725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897148508746750:5234] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:56.139324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897148508746750:5234] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:56.148125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897148508746750:5234] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:56.148151Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897148508746750:5234] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:56.148155Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897148508746750:5234] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:56.148164Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3386 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:56.158682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:56.161271Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:56.161571Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:56.161576Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:56.161591Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:56.161665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:56.161711Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897148418942044:13475]
2025-09-30T14:59:56.162359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:56.162975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:56.163033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:56.163422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:56.163721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.163723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.163724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.163726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.163727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.163728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.163730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.163731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.163733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.163734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.163735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.163737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.163738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.163740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.163741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.163748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.163759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.163763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.163767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.163771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.163775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.163778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.163782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.163785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.163789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.163793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.163796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.163799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.163802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.163806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.163815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.163826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.163832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.163838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.163842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.163847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.163852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.163857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.163863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.163868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.163872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.163879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.163883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.163888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.163893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.163898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.163902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.163906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.163910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.163915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.163919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.163924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.163929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.163934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.163939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.163944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.163947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.163952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.163957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.163964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.164005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:56.171994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:56.173337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:56.173366Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:56.173370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:56.173375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:56.173385Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3385 [2:7555897148418942044:13475]
2025-09-30T14:59:56.173405Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:56.173435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:56.173439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:56.173442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:56.173445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:56.173463Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:56.173471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:56.173481Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:56.173552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.173555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.173558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.173562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:56.173565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:56.173801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:56.173805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.173821Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.173836Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.173858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:56.173878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897148418942039:13475]
2025-09-30T14:59:56.173880Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897148418942039:13475]
2025-09-30T14:59:56.173883Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897148418942039:13475]
2025-09-30T14:59:56.173900Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:56.173916Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:56.173933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:56.173936Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:56.173980Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897148418942039:13475]
2025-09-30T14:59:56.173983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:56.174798Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:56.174809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:56.174812Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:56.174818Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:56.175356Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3385
2025-09-30T14:59:56.175420Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3385
2025-09-30T14:59:56.179349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897148508746913:5234], now have 1 active actors on pipe
2025-09-30T14:59:56.179380Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897148508746736:2454], now have 1 active actors on pipe
2025-09-30T14:59:56.179497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:56.179508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:56.179547Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:56.179560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:56.179565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:56.179569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:56.179586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:56.179605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:56.179626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:56.180091Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:56.180101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:56.180119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:56.180294Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3386 partition: 0 MaxSeqNo: 42 sessionId: src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0
2025-09-30T14:59:56.180836Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3dca6059-a9c3379f-4f4560fc-ebc4afaf_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:56.184214Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0] Write session: try to update token
2025-09-30T14:59:56.184241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:56.200060Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:56.200088Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:56.200091Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:56.200093Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:56.200104Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897148418942039:13475]
2025-09-30T14:59:56.200109Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897148418942039:13475]
2025-09-30T14:59:56.200113Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897148418942039:13475]
2025-09-30T14:59:56.200164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:56.200173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.200175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:56.200351Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:56.203690Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:56.203714Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:56.203720Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:56.207605Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897148508746975:2695]
2025-09-30T14:59:56.213586Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 84 pipe creation result: OK TabletId: 72075186224037892 Generation: 3385, pipe: [1:7555897148508746975:2695]
2025-09-30T14:59:56.214506Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3386 sessionId: src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:56.217792Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:56.332987Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:56.334356Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897148508746975:2695], now have 1 active actors on pipe
2025-09-30T14:59:56.334393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:56.334401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:56.335026Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:56.335049Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:56.335129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3386 reason: error at write: Disconnected sessionId: src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0
2025-09-30T14:59:56.335356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 84 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897148508746975:2695]
2025-09-30T14:59:56.335367Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3386 sessionId: src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0 is DEAD
2025-09-30T14:59:56.335374Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:56.335072Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:56.339591Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:56.339608Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0] Write session will restart in 0.006700s
2025-09-30T14:59:56.339635Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0] Write session: Do CDS request
2025-09-30T14:59:56.339646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:56.347797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:56.351464Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:56.351490Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3387
2025-09-30T14:59:56.351731Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3387 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:56.351781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3387 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:56.351788Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3387 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:56.351793Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:56.352858Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3387 sessionId:  describe result for acl check
2025-09-30T14:59:56.352895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:56.352900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:56.352907Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:56.352914Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897148508747003:5242] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:56.353398Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897148508747003:5242] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:56.367411Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897148508747003:5242] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:56.375718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:56.375335Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897148508747003:5242] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:56.375358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897148508747003:5242] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:56.375361Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897148508747003:5242] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:56.375373Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3387 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:56.379423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:56.379971Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:56.379977Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:56.379992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:56.380113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:56.380160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897148418942277:13478]
2025-09-30T14:59:56.380897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:56.381496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:56.381573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:56.381975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:56.382053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.382055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.382057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.382058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.382060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.382061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.382062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.382064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.382065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.382067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.382068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.382069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.382071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.382073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.382074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.382082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.382095Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.382100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.382104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.382109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.382113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.382118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.382122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.382125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.382129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.382132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.382136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.382140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.382144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.382149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.382158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.382167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.382173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.382179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.382188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.382194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.382199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.382205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.382210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.382216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.382221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.382227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.382233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.382239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.382244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.382250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.382255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.382275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.382280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.382285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.382291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.382296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.382301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.382307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.382312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.382319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.382323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.382329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.382336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.382343Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.382395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:56.393607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:56.394967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:56.394978Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:56.394981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:56.394986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:56.394995Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3386 [2:7555897148418942277:13478]
2025-09-30T14:59:56.395016Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:56.395037Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:56.395040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:56.395042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:56.395044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:56.395064Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:56.395072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:56.395082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:56.395172Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.395178Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.395180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.395184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:56.395187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:56.395295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:56.395298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.395314Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.395324Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.395340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:56.395359Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897148418942270:13478]
2025-09-30T14:59:56.395361Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897148418942270:13478]
2025-09-30T14:59:56.395363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897148418942270:13478]
2025-09-30T14:59:56.395380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:56.395397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:56.395411Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:56.395415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:56.395460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897148418942270:13478]
2025-09-30T14:59:56.395463Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:56.395820Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:56.395836Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:56.395839Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:56.395844Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:56.396307Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897148508747208:5242], now have 1 active actors on pipe
2025-09-30T14:59:56.396317Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897148508746978:2454], now have 1 active actors on pipe
2025-09-30T14:59:56.396938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:56.396951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:56.396991Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:56.397019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:56.397024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:56.397028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:56.397043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:56.397060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:56.397082Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:56.396416Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3386
2025-09-30T14:59:56.396459Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3386
2025-09-30T14:59:56.400732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:56.400775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:56.400822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:56.401073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3387 partition: 0 MaxSeqNo: 42 sessionId: src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0
2025-09-30T14:59:56.403727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ffb8eaf2-f95d0146-a1f5636b-8d5e33a1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:56.407176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0] Write session: try to update token
2025-09-30T14:59:56.407205Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:56.417802Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:56.417834Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:56.417837Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:56.417839Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:56.417851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897148418942270:13478]
2025-09-30T14:59:56.417857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897148418942270:13478]
2025-09-30T14:59:56.417862Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897148418942270:13478]
2025-09-30T14:59:56.417913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:56.417922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.417925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:56.418091Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:56.423745Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:56.423768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:56.423773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:56.435188Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897148508747222:2695]
2025-09-30T14:59:56.437967Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 85 pipe creation result: OK TabletId: 72075186224037892 Generation: 3386, pipe: [1:7555897148508747222:2695]
2025-09-30T14:59:56.439431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3387 sessionId: src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:56.442573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:56.573727Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:56.574269Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897148508747222:2695], now have 1 active actors on pipe
2025-09-30T14:59:56.574306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:56.574314Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:56.575006Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:56.576976Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:56.576991Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0] Write session will restart in 0.008023s
2025-09-30T14:59:56.577019Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0] Write session: Do CDS request
2025-09-30T14:59:56.577027Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:56.575317Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:56.575343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:56.575414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3387 reason: error at write: Disconnected sessionId: src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0
2025-09-30T14:59:56.575636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3387 sessionId: src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0 is DEAD
2025-09-30T14:59:56.575862Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 85 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897148508747222:2695]
2025-09-30T14:59:56.575881Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:56.585868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:56.587927Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:56.587951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3388
2025-09-30T14:59:56.588208Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3388 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:56.588245Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3388 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:56.588251Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3388 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:56.588255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:56.589576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3388 sessionId:  describe result for acl check
2025-09-30T14:59:56.589634Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:56.589636Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:56.589638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:56.589646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897148508747238:5252] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:56.590312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897148508747238:5252] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:56.599351Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897148508747238:5252] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:56.605328Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897148508747238:5252] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:56.605348Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897148508747238:5252] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:56.605352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897148508747238:5252] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:56.605363Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3388 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:56.634688Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:56.638581Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:56.639081Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:56.639087Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:56.639104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:56.639195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:56.639267Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897148418942512:13480]
2025-09-30T14:59:56.639912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:56.641112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:56.641193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:56.641598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:56.641695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.641697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.641698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.641699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.641701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.641703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.641704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.641706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.641707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.641709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.641710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.641711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.641713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.641714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.641716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.641723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.641735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.641740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.641744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.641747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.641751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.641756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.641759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.641763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.641767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.641771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.641775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.641778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.641782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.641786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.641796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.641804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.641812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.641818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.641824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.641830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.641836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.641841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.641846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.641851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.641856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.641862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.641872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.641878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.641883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.641890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.641896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.641902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.641907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.641912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.641917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.641923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.641928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.641933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.641938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.641943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.641948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.641953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.641958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.641963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.642007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:56.649634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:56.650820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:56.650845Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:56.650849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:56.650854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:56.650862Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3387 [2:7555897148418942512:13480]
2025-09-30T14:59:56.650883Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:56.650901Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:56.650905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:56.650909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:56.650912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:56.650933Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:56.650958Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:56.650977Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:56.651059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.651067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.651070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.651074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:56.651077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:56.651164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:56.651173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.651192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.651212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.651238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:56.651517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3387
2025-09-30T14:59:56.651571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3387
2025-09-30T14:59:56.652261Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897148418942504:13480]
2025-09-30T14:59:56.652279Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897148418942504:13480]
2025-09-30T14:59:56.652282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897148418942504:13480]
2025-09-30T14:59:56.652298Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:56.652323Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897148508747228:2454], now have 1 active actors on pipe
2025-09-30T14:59:56.652329Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897148508747277:5252], now have 1 active actors on pipe
2025-09-30T14:59:56.652355Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:56.652362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:56.652407Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:56.652432Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:56.652437Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:56.652501Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:56.652512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:56.652516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:56.652519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:56.652531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:56.652548Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:56.652557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897148418942504:13480]
2025-09-30T14:59:56.652565Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:56.652605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:56.652676Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:56.652679Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:56.652681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:56.652688Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:56.655924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:56.655954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:56.655997Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:56.657688Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3388 partition: 0 MaxSeqNo: 42 sessionId: src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0
2025-09-30T14:59:56.658271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|66f755e8-3866a558-5a9ea80b-30ba0f02_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:56.661711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0] Write session: try to update token
2025-09-30T14:59:56.661743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:56.677334Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897148508747466:2695]
2025-09-30T14:59:56.683230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897148508747466:2695], now have 1 active actors on pipe
2025-09-30T14:59:56.690031Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 86 pipe creation result: OK TabletId: 72075186224037892 Generation: 3387, pipe: [1:7555897148508747466:2695]
2025-09-30T14:59:56.698906Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:56.698936Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:56.698949Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897148418942504:13480]
2025-09-30T14:59:56.698999Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:56.699016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:56.699222Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:56.699423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:56.699601Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:56.699771Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:56.700050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:56.700104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:56.721578Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3388 sessionId: src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:56.724744Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:56.723634Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:56.723661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:56.723667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:56.723669Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:56.723682Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897148418942504:13480]
2025-09-30T14:59:56.723687Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897148418942504:13480]
2025-09-30T14:59:56.723691Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897148418942504:13480]
2025-09-30T14:59:56.723734Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:56.723741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.723744Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:56.723912Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:56.726727Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:56.726736Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:56.726740Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:56.886313Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:56.887012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:56.887033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:56.888056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:56.888071Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0] Write session will restart in 0.005389s
2025-09-30T14:59:56.888099Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0] Write session: Do CDS request
2025-09-30T14:59:56.887497Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:56.888106Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:56.887479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 86 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897148508747466:2695]
2025-09-30T14:59:56.887518Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:56.887570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:56.887573Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:56.887646Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3388 reason: error at write: Disconnected sessionId: src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0
2025-09-30T14:59:56.887840Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3388 sessionId: src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0 is DEAD
2025-09-30T14:59:56.894792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:56.894947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:56.894966Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3389
2025-09-30T14:59:56.895135Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3389 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:56.895185Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3389 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:56.895204Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3389 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:56.895210Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:56.896186Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3389 sessionId:  describe result for acl check
2025-09-30T14:59:56.896238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:56.896246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:56.896249Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:56.896256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897148508747504:5271] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:56.896921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897148508747504:5271] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:56.904003Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897148508747504:5271] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:56.912708Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897148508747504:5271] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:56.912738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897148508747504:5271] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:56.912742Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897148508747504:5271] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:56.912765Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3389 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:56.937354Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:56.943166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:56.943494Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:56.943500Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:56.943515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:56.943593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:56.943638Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897148418942793:13496]
2025-09-30T14:59:56.944301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:56.944927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:56.945011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:56.945393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:56.945461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.945463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.945464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.945466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.945467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.945469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.945471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.945473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.945475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.945476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.945478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.945479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.945495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.945497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.945498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.945505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.945515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.945520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.945524Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.945527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.945531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.945535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.945538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.945542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.945547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.945552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.945557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.945562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.945567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.945571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.945582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.945592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:56.945599Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.945607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:56.945611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.945617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:56.945621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.945628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:56.945634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.945640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:56.945646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.945654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:56.945659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.945665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:56.945670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.945677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:56.945683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.945701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:56.945707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.945713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:56.945722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.945728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.945733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.945738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.945743Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.945748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.945752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.945757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:56.945763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.945768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:56.945814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:56.957375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:56.958631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:56.958641Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:56.958644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:56.958648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:56.958656Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3388 [2:7555897148418942793:13496]
2025-09-30T14:59:56.958672Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:56.958690Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:56.958698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:56.958702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:56.958704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:56.958722Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:56.958730Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:56.958737Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:56.958808Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.958810Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.958811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.958815Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:56.958817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:56.958900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:56.958903Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.958917Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:56.958927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:56.958943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:56.958961Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897148418942787:13496]
2025-09-30T14:59:56.958963Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897148418942787:13496]
2025-09-30T14:59:56.958965Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897148418942787:13496]
2025-09-30T14:59:56.958974Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:56.958990Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:56.959004Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:56.959007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:56.959128Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:56.959133Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:56.959135Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:56.959187Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897148418942787:13496]
2025-09-30T14:59:56.959196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:56.959205Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:56.959322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897148508747497:2454], now have 1 active actors on pipe
2025-09-30T14:59:56.959335Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897148508747556:5271], now have 1 active actors on pipe
2025-09-30T14:59:56.959854Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3388
2025-09-30T14:59:56.959896Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3388
2025-09-30T14:59:56.964095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:56.964131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:56.964171Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:56.964186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:56.964191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:56.964195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:56.964211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:56.964230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:56.964262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:56.968286Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3389 partition: 0 MaxSeqNo: 42 sessionId: src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0
2025-09-30T14:59:56.967989Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:56.968021Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:56.968065Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:56.971567Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|109f49c2-2cd96cb1-2aaa7c97-9c1bcafe_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:56.974860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0] Write session: try to update token
2025-09-30T14:59:56.974889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:56.979453Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:56.979481Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:56.979484Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:56.979486Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:56.979496Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897148418942787:13496]
2025-09-30T14:59:56.979501Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897148418942787:13496]
2025-09-30T14:59:56.979506Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897148418942787:13496]
2025-09-30T14:59:56.979552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:56.979561Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:56.979563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:56.979727Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:56.982863Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:56.982873Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:56.982879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:56.990538Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897148508747750:2695]
2025-09-30T14:59:56.991125Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 87 pipe creation result: OK TabletId: 72075186224037892 Generation: 3388, pipe: [1:7555897148508747750:2695]
2025-09-30T14:59:57.005139Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3389 sessionId: src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:57.008150Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:57.121272Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:57.121791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897148508747750:2695], now have 1 active actors on pipe
2025-09-30T14:59:57.122292Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 87 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897148508747750:2695]
2025-09-30T14:59:57.122343Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:57.122350Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:57.122414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3389 reason: error at write: Disconnected sessionId: src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0
2025-09-30T14:59:57.122593Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3389 sessionId: src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0 is DEAD
2025-09-30T14:59:57.122596Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:57.121856Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:57.121869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:57.122291Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:57.123447Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:57.123460Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0] Write session will restart in 0.009400s
2025-09-30T14:59:57.123486Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0] Write session: Do CDS request
2025-09-30T14:59:57.123495Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:57.135712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:57.136146Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:57.136165Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3390
2025-09-30T14:59:57.136334Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3390 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:57.136364Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3390 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:57.136369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3390 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:57.136375Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:57.139425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3390 sessionId:  describe result for acl check
2025-09-30T14:59:57.139476Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:57.139479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:57.139481Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:57.139488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897152803715119:5280] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:57.140092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897152803715119:5280] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:57.144731Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897152803715119:5280] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:57.151424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897152803715119:5280] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:57.151447Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897152803715119:5280] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:57.151451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897152803715119:5280] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:57.151462Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3390 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:57.157050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:57.160301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:57.160768Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:57.160773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:57.160788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:57.160866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:57.160911Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897152713910323:13498]
2025-09-30T14:59:57.161648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:57.162335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:57.162410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:57.162808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:57.162896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.162898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.162899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.162901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.162902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.162903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.162905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.162906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.162907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.162908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.162910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.162911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.162913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.162914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.162915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.162922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.162932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.162936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.162939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.162944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.162947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.162952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.162955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.162959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.162963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.162966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.162970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.162977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.162981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.162984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.162996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.163004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.163009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.163015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.163020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.163024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.163029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.163037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.163043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.163048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.163052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.163057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.163061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.163066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.163070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.163075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.163079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.163083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.163087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.163092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.163097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.163102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.163106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.163111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.163115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.163120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.163125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.163129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.163137Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.163142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.163186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:57.171387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:57.172611Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:57.172620Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:57.172623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:57.172628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:57.172637Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3389 [2:7555897152713910323:13498]
2025-09-30T14:59:57.172657Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:57.172677Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:57.172681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:57.172685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:57.172700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:57.172719Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:57.172727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:57.172735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:57.172834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.172838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.172841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.172845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:57.172848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:57.172930Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:57.172936Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.172952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.172964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.172984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:57.173002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897152713910318:13498]
2025-09-30T14:59:57.173005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897152713910318:13498]
2025-09-30T14:59:57.173007Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897152713910318:13498]
2025-09-30T14:59:57.173015Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:57.173030Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:57.173047Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:57.173050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:57.173050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:57.173063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:57.173065Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:57.173089Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897152713910318:13498]
2025-09-30T14:59:57.173093Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:57.173096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:57.173103Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897152803715262:5280], now have 1 active actors on pipe
2025-09-30T14:59:57.173108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897152803715049:2454], now have 1 active actors on pipe
2025-09-30T14:59:57.174087Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3389
2025-09-30T14:59:57.174126Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3389
2025-09-30T14:59:57.178441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:57.178474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:57.178525Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|535b59c7-945d440b-e857446f-955e6861_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:57.178539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:57.178545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:57.178550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:57.178569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:57.178589Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:57.178614Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:57.179161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:57.179176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:57.179200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:57.179410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3390 partition: 0 MaxSeqNo: 42 sessionId: src_id|535b59c7-945d440b-e857446f-955e6861_0
2025-09-30T14:59:57.183802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|96a4e3c0-281d1c02-31f8c3cc-45453d84_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|535b59c7-945d440b-e857446f-955e6861_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:57.187087Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|535b59c7-945d440b-e857446f-955e6861_0] Write session: try to update token
2025-09-30T14:59:57.187112Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|535b59c7-945d440b-e857446f-955e6861_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:57.191639Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:57.191666Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:57.191670Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:57.191673Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:57.191692Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897152713910318:13498]
2025-09-30T14:59:57.191701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897152713910318:13498]
2025-09-30T14:59:57.191706Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897152713910318:13498]
2025-09-30T14:59:57.191755Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:57.191764Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.191767Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:57.191952Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:57.194355Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:57.194376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:57.194381Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:57.219116Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3390 sessionId: src_id|535b59c7-945d440b-e857446f-955e6861_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:57.222290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:57.222642Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897152803715290:2695]
2025-09-30T14:59:57.223593Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 88 pipe creation result: OK TabletId: 72075186224037892 Generation: 3389, pipe: [1:7555897152803715290:2695]
2025-09-30T14:59:57.347053Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:57.347605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:57.347623Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:57.347644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897152803715290:2695], now have 1 active actors on pipe
2025-09-30T14:59:57.347883Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:57.347892Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:57.347903Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:57.347971Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3390 reason: error at write: Disconnected sessionId: src_id|535b59c7-945d440b-e857446f-955e6861_0
2025-09-30T14:59:57.348120Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:57.348162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3390 sessionId: src_id|535b59c7-945d440b-e857446f-955e6861_0 is DEAD
2025-09-30T14:59:57.348173Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 88 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897152803715290:2695]
2025-09-30T14:59:57.352316Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|535b59c7-945d440b-e857446f-955e6861_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:57.352332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|535b59c7-945d440b-e857446f-955e6861_0] Write session will restart in 0.007993s
2025-09-30T14:59:57.352358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|535b59c7-945d440b-e857446f-955e6861_0] Write session: Do CDS request
2025-09-30T14:59:57.352368Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|535b59c7-945d440b-e857446f-955e6861_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:57.363759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|535b59c7-945d440b-e857446f-955e6861_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:57.364132Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:57.364153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3391
2025-09-30T14:59:57.364314Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3391 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:57.364357Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3391 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:57.364370Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3391 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:57.364376Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:57.364854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3391 sessionId:  describe result for acl check
2025-09-30T14:59:57.364901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:57.364909Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:57.364915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:57.364921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897152803715311:5289] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:57.365525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897152803715311:5289] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:57.372105Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897152803715311:5289] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:57.377397Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897152803715311:5289] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:57.377419Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897152803715311:5289] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:57.377423Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897152803715311:5289] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:57.377433Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3391 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:57.380647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:57.383800Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:57.384279Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:57.384286Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:57.384301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:57.384418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:57.384478Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897152713910560:13501]
2025-09-30T14:59:57.385194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:57.391263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:57.391367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:57.391793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:57.391870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.391872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.391873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.391875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.391877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.391878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.391880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.391881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.391883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.391885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.391886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.391888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.391890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.391891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.391893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.391899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.391911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.391916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.391921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.391927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.391932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.391937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.391942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.391947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.391954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.391959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.391963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.391968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.391974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.391978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.391990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.392002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.392008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.392015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.392021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.392026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.392031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.392037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.392048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.392055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.392060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.392067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.392073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.392080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.392085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.392091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.392097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.392104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.392110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.392116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.392123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.392128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.392133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.392141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.392146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.392152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.392157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.392163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.392169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.392175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.392224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:57.399306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:57.400609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:57.400618Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:57.400622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:57.400626Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:57.400634Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3390 [2:7555897152713910560:13501]
2025-09-30T14:59:57.400653Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:57.400671Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:57.400675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:57.400678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:57.400681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:57.400700Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:57.400707Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:57.400716Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:57.400796Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.400799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.400801Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.400805Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:57.400807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:57.400891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:57.400894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.400911Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.400925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.400944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:57.400964Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897152713910555:13501]
2025-09-30T14:59:57.400966Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897152713910555:13501]
2025-09-30T14:59:57.400969Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897152713910555:13501]
2025-09-30T14:59:57.400985Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:57.401000Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:57.401015Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:57.401019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:57.401065Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897152713910555:13501]
2025-09-30T14:59:57.401068Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:57.401633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:57.401644Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:57.401646Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:57.401651Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:57.402085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897152803715293:2454], now have 1 active actors on pipe
2025-09-30T14:59:57.402097Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897152803715524:5289], now have 1 active actors on pipe
2025-09-30T14:59:57.402323Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3390
2025-09-30T14:59:57.402367Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3390
2025-09-30T14:59:57.402776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:57.402788Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:57.402818Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60660c6-133d205a-4964194a-d36728fa_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:57.402830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:57.402834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:57.402837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:57.402852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:57.402867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:57.402883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:57.403176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:57.403203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:57.403220Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:57.403438Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3391 partition: 0 MaxSeqNo: 42 sessionId: src_id|60660c6-133d205a-4964194a-d36728fa_0
2025-09-30T14:59:57.403830Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|535b59c7-945d440b-e857446f-955e6861_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|60660c6-133d205a-4964194a-d36728fa_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:57.406957Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60660c6-133d205a-4964194a-d36728fa_0] Write session: try to update token
2025-09-30T14:59:57.406985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60660c6-133d205a-4964194a-d36728fa_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:57.424272Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:57.424302Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:57.424305Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:57.424308Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:57.424318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897152713910555:13501]
2025-09-30T14:59:57.424324Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897152713910555:13501]
2025-09-30T14:59:57.424334Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897152713910555:13501]
2025-09-30T14:59:57.424381Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:57.424407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.424415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:57.424576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:57.425728Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:57.425763Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:57.425768Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:57.449351Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897152803715544:2695]
2025-09-30T14:59:57.449678Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 89 pipe creation result: OK TabletId: 72075186224037892 Generation: 3390, pipe: [1:7555897152803715544:2695]
2025-09-30T14:59:57.450725Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3391 sessionId: src_id|60660c6-133d205a-4964194a-d36728fa_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:57.453884Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:57.578903Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:57.579322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897152803715544:2695], now have 1 active actors on pipe
2025-09-30T14:59:57.579378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:57.579389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:57.579720Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:57.581699Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:57.581761Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:57.581847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3391 reason: status is not ok: tablet will be restarted right now sessionId: src_id|60660c6-133d205a-4964194a-d36728fa_0
2025-09-30T14:59:57.582206Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60660c6-133d205a-4964194a-d36728fa_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:57.582218Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60660c6-133d205a-4964194a-d36728fa_0] Write session will restart in 0.007847s
2025-09-30T14:59:57.582247Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60660c6-133d205a-4964194a-d36728fa_0] Write session: Do CDS request
2025-09-30T14:59:57.582254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60660c6-133d205a-4964194a-d36728fa_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:57.582046Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3391 sessionId: src_id|60660c6-133d205a-4964194a-d36728fa_0 is DEAD
2025-09-30T14:59:57.582276Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 89 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897152803715544:2695]
2025-09-30T14:59:57.591935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60660c6-133d205a-4964194a-d36728fa_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:57.592070Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:57.592092Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3392
2025-09-30T14:59:57.592234Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3392 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:57.592263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3392 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:57.592268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3392 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:57.592275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:57.592815Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3392 sessionId:  describe result for acl check
2025-09-30T14:59:57.592844Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:57.592846Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:57.592851Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:57.592863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897152803715562:5298] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:57.593443Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897152803715562:5298] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:57.600764Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897152803715562:5298] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:57.606227Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897152803715562:5298] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:57.606250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897152803715562:5298] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:57.606254Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897152803715562:5298] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:57.606264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3392 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:57.622904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:57.627024Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:57.627613Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:57.627630Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:57.627647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:57.627739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:57.627793Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897152713910795:13503]
2025-09-30T14:59:57.628534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:57.628902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:57.628954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:57.629277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:57.629340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.629341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.629342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.629344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.629345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.629346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.629347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.629349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.629350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.629351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.629352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.629354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.629355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.629356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.629357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.629363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.629374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.629378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.629381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.629385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.629389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.629393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.629397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.629401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.629405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.629409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.629412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.629416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.629420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.629424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.629433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.629440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.629446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.629452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.629457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.629462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.629467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.629472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.629477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.629482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.629487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.629492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.629496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.629502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.629507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.629512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.629519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.629525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.629529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.629534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.629538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.629542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.629548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.629553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.629558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.629563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.629567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.629573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.629578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.629583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.629624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:57.638969Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3391
2025-09-30T14:59:57.639027Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3391
2025-09-30T14:59:57.636687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:57.637861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:57.637867Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:57.637870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:57.637874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:57.637881Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3391 [2:7555897152713910795:13503]
2025-09-30T14:59:57.637900Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:57.637917Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:57.637922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:57.637924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:57.637926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:57.637944Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:57.637950Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:57.637957Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:57.638031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.638033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.638035Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.638038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:57.638040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:57.638117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:57.638119Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.638133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.638144Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.638159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:57.638176Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897152713910789:13503]
2025-09-30T14:59:57.638179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897152713910789:13503]
2025-09-30T14:59:57.638180Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897152713910789:13503]
2025-09-30T14:59:57.638196Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:57.638212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:57.638229Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:57.638232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:57.638252Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:57.638256Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:57.638258Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:57.638272Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897152713910789:13503]
2025-09-30T14:59:57.638276Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:57.638357Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:57.638410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897152803715547:2454], now have 1 active actors on pipe
2025-09-30T14:59:57.638415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897152803715633:5298], now have 1 active actors on pipe
2025-09-30T14:59:57.639535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:57.639557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:57.639590Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:57.639601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:57.639606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:57.639612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:57.639624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:57.639647Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:57.639667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:57.640099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:57.640113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:57.640144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:57.640325Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3392 partition: 0 MaxSeqNo: 42 sessionId: src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0
2025-09-30T14:59:57.640761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60660c6-133d205a-4964194a-d36728fa_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:57.643998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0] Write session: try to update token
2025-09-30T14:59:57.644024Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:57.654874Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:57.654910Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:57.654913Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:57.654916Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:57.654927Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897152713910789:13503]
2025-09-30T14:59:57.654932Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897152713910789:13503]
2025-09-30T14:59:57.654937Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897152713910789:13503]
2025-09-30T14:59:57.654974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:57.654983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.654985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:57.655164Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:57.655166Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:57.655173Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:57.655177Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:57.677365Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3392 sessionId: src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:57.680640Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:57.680753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897152803715790:2695]
2025-09-30T14:59:57.681223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 90 pipe creation result: OK TabletId: 72075186224037892 Generation: 3391, pipe: [1:7555897152803715790:2695]
2025-09-30T14:59:57.786156Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:57.786630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:57.786641Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:57.786663Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897152803715790:2695], now have 1 active actors on pipe
2025-09-30T14:59:57.787010Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:57.787690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:57.787102Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:57.787177Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:57.787179Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:57.787275Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3392 reason: error at write: Disconnected sessionId: src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0
2025-09-30T14:59:57.787705Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0] Write session will restart in 0.009561s
2025-09-30T14:59:57.787473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3392 sessionId: src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0 is DEAD
2025-09-30T14:59:57.787672Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 90 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897152803715790:2695]
2025-09-30T14:59:57.787756Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0] Write session: Do CDS request
2025-09-30T14:59:57.787777Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:57.799840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:57.803451Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:57.803474Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3393
2025-09-30T14:59:57.803859Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3393 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:57.803904Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3393 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:57.803909Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3393 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:57.803914Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:57.804350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3393 sessionId:  describe result for acl check
2025-09-30T14:59:57.804407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:57.804410Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:57.804412Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:57.804418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897152803715820:5322] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:57.805009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897152803715820:5322] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:57.818574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897152803715820:5322] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:57.829345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897152803715820:5322] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:57.829371Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897152803715820:5322] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:57.829375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897152803715820:5322] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:57.829385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3393 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:57.837275Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:57.841536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:57.842241Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:57.842248Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:57.842267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:57.842366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:57.842408Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897152713911081:13513]
2025-09-30T14:59:57.843117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:57.843702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:57.843772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:57.844152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:57.844211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.844212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.844214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.844215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.844217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.844218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.844220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.844221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.844222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.844224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.844225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.844227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.844228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.844230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.844231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.844237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.844248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.844253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.844258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.844263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.844268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.844272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.844277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.844281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.844285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.844289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.844293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.844298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.844302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.844306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.844314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.844324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:57.844331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.844336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:57.844341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.844347Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:57.844352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.844357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:57.844363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.844368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:57.844373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.844378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:57.844404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.844410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:57.844415Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.844421Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:57.844426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.844432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:57.844437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.844443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:57.844451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.844457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.844463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.844468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.844473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.844479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.844484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.844489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:57.844495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.844500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:57.844553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:57.852507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:57.853732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:57.853742Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:57.853744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:57.853748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:57.853755Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3392 [2:7555897152713911081:13513]
2025-09-30T14:59:57.853770Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:57.853784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:57.853788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:57.853791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:57.853793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:57.853810Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:57.853817Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:57.853827Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:57.853890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.853891Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.853893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.853896Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:57.853898Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:57.853970Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:57.853974Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.853990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:57.854003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:57.854023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:57.854041Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897152713911069:13513]
2025-09-30T14:59:57.854043Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897152713911069:13513]
2025-09-30T14:59:57.854045Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897152713911069:13513]
2025-09-30T14:59:57.854061Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:57.854081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:57.854095Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:57.854098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:57.854144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897152713911069:13513]
2025-09-30T14:59:57.854147Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:57.854186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897152803715806:2454], now have 1 active actors on pipe
2025-09-30T14:59:57.854191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897152803715992:5322], now have 1 active actors on pipe
2025-09-30T14:59:57.854316Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:57.854320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:57.854323Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:57.854329Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:57.855456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:57.855466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:57.855256Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3392
2025-09-30T14:59:57.855307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3392
2025-09-30T14:59:57.855504Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44c4ab8-c6b99828-77f88067-d8423245_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:57.855535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:57.855541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:57.855545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:57.856199Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3393 partition: 0 MaxSeqNo: 42 sessionId: src_id|44c4ab8-c6b99828-77f88067-d8423245_0
2025-09-30T14:59:57.855561Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:57.855581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:57.855599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:57.855855Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:57.855864Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:57.855898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:57.859673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5f3ec407-6bf10c05-d6f012b5-7875f6a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44c4ab8-c6b99828-77f88067-d8423245_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:57.862778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4ab8-c6b99828-77f88067-d8423245_0] Write session: try to update token
2025-09-30T14:59:57.862804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4ab8-c6b99828-77f88067-d8423245_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:57.869079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:57.869104Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:57.869107Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:57.869109Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:57.869119Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897152713911069:13513]
2025-09-30T14:59:57.869126Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897152713911069:13513]
2025-09-30T14:59:57.869130Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897152713911069:13513]
2025-09-30T14:59:57.869176Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:57.869184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:57.869191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:57.869205Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:57.869214Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:57.869218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:57.869348Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:57.887195Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897152803716061:2695]
2025-09-30T14:59:57.887744Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 91 pipe creation result: OK TabletId: 72075186224037892 Generation: 3392, pipe: [1:7555897152803716061:2695]
2025-09-30T14:59:57.887992Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3393 sessionId: src_id|44c4ab8-c6b99828-77f88067-d8423245_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:57.890885Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:57.999367Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:57.999841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897152803716061:2695], now have 1 active actors on pipe
2025-09-30T14:59:57.999870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:57.999877Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:58.000299Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:58.001134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4ab8-c6b99828-77f88067-d8423245_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:58.001147Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4ab8-c6b99828-77f88067-d8423245_0] Write session will restart in 0.007483s
2025-09-30T14:59:58.000516Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 91 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897152803716061:2695]
2025-09-30T14:59:58.000565Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:58.000599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:58.000601Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:58.001171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4ab8-c6b99828-77f88067-d8423245_0] Write session: Do CDS request
2025-09-30T14:59:58.000675Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3393 reason: error at write: Disconnected sessionId: src_id|44c4ab8-c6b99828-77f88067-d8423245_0
2025-09-30T14:59:58.000867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3393 sessionId: src_id|44c4ab8-c6b99828-77f88067-d8423245_0 is DEAD
2025-09-30T14:59:58.001177Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4ab8-c6b99828-77f88067-d8423245_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:58.009843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4ab8-c6b99828-77f88067-d8423245_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:58.009958Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:58.009988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3394
2025-09-30T14:59:58.010167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3394 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:58.010220Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3394 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:58.010225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3394 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:58.010231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:58.010850Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3394 sessionId:  describe result for acl check
2025-09-30T14:59:58.010893Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:58.010895Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:58.010901Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:58.010908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897157098683389:5340] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:58.011499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897157098683389:5340] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:58.016165Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897157098683389:5340] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:58.025331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897157098683389:5340] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:58.025353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897157098683389:5340] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:58.025360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897157098683389:5340] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:58.025370Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3394 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:58.036477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:58.039365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:58.039723Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:58.039734Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:58.039748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:58.039824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:58.039871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897157008878613:13521]
2025-09-30T14:59:58.040565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:58.041558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:58.041630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:58.042007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:58.042100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.042107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.042109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.042111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.042113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.042114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.042115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.042117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.042118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.042119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.042121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.042122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.042123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.042125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.042126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.042133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.042144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.042148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.042152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.042156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.042160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.042163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.042167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.042171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.042175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.042178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.042183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.042186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.042190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.042194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.042203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.042211Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.042220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.042226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.042231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.042237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.042242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.042247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.042252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.042257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.042261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.042266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.042271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.042277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.042282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.042288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.042294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.042299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.042304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.042309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.042314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.042326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.042332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.042337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.042341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.042346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.042350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.042355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.042360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.042364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.042410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:58.049817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:58.051212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:58.051234Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:58.051237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:58.051240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:58.051268Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3393 [2:7555897157008878613:13521]
2025-09-30T14:59:58.051286Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:58.051304Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:58.051307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:58.051310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:58.051312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:58.051329Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:58.051336Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:58.051343Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:58.051413Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.051423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.051425Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.051428Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:58.051431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:58.051501Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:58.051504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.051517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.051527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.051542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:58.051561Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897157008878608:13521]
2025-09-30T14:59:58.051564Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897157008878608:13521]
2025-09-30T14:59:58.051566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897157008878608:13521]
2025-09-30T14:59:58.051583Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:58.051597Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:58.051611Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:58.051613Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:58.051655Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897157008878608:13521]
2025-09-30T14:59:58.051664Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:58.051701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098683506:5340], now have 1 active actors on pipe
2025-09-30T14:59:58.051711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098683374:2454], now have 1 active actors on pipe
2025-09-30T14:59:58.051765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:58.051779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:58.051781Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:58.051797Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:58.051919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3393
2025-09-30T14:59:58.051931Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3393
2025-09-30T14:59:58.052152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:58.052169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:58.052214Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:58.052224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:58.052229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:58.052231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:58.052243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:58.052268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:58.052290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:58.052892Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:58.052911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:58.052946Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:58.053072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3394 partition: 0 MaxSeqNo: 42 sessionId: src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0
2025-09-30T14:59:58.053485Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44c4ab8-c6b99828-77f88067-d8423245_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:58.057482Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0] Write session: try to update token
2025-09-30T14:59:58.057508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:58.067941Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:58.067963Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:58.067966Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:58.067969Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:58.067978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897157008878608:13521]
2025-09-30T14:59:58.067986Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897157008878608:13521]
2025-09-30T14:59:58.067990Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897157008878608:13521]
2025-09-30T14:59:58.068033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:58.068040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.068044Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:58.068181Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:58.069276Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:58.069285Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:58.069289Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:58.084891Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3394 sessionId: src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:58.088231Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:58.100657Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897157098683617:2695]
2025-09-30T14:59:58.101030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 92 pipe creation result: OK TabletId: 72075186224037892 Generation: 3393, pipe: [1:7555897157098683617:2695]
2025-09-30T14:59:58.196472Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:58.197100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:58.197123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:58.197145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098683617:2695], now have 1 active actors on pipe
2025-09-30T14:59:58.197443Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:58.199788Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:58.199804Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0] Write session will restart in 0.009937s
2025-09-30T14:59:58.199832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0] Write session: Do CDS request
2025-09-30T14:59:58.199839Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:58.199283Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 92 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897157098683617:2695]
2025-09-30T14:59:58.199293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:58.199298Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:58.199328Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:58.199380Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3394 reason: error at write: Disconnected sessionId: src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0
2025-09-30T14:59:58.199569Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3394 sessionId: src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0 is DEAD
2025-09-30T14:59:58.213886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:58.214381Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:58.214402Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3395
2025-09-30T14:59:58.214558Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3395 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:58.214585Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3395 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:58.214590Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3395 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:58.214594Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:58.215008Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3395 sessionId:  describe result for acl check
2025-09-30T14:59:58.215038Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:58.215040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:58.215057Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:58.215063Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897157098683638:5349] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:58.215662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897157098683638:5349] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:58.221500Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897157098683638:5349] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:58.225441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897157098683638:5349] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:58.225464Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897157098683638:5349] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:58.225468Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897157098683638:5349] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:58.225477Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3395 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:58.232595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:58.236562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:58.236850Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:58.236866Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:58.236882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:58.236956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:58.237018Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897157008878853:13523]
2025-09-30T14:59:58.237678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:58.238181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:58.238286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:58.238758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:58.238879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.238891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.238893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.238894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.238896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.238897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.238899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.238901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.238902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.238911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.238913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.238914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.238916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.238917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.238919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.238927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.238939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.238943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.238947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.238951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.238955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.238960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.238964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.238968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.238972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.238976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.238980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.238985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.238989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.238994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.239003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.239012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.239020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.239027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.239033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.239043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.239048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.239056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.239062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.239069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.239075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.239081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.239087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.239093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.239097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.239103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.239109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.239114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.239121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.239127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.239132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.239140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.239144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.239150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.239157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.239162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.239166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.239171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.239176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.239181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.239229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:58.245699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:58.246852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:58.246876Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:58.246879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:58.246884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:58.246892Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3394 [2:7555897157008878853:13523]
2025-09-30T14:59:58.246911Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:58.246927Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:58.246930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:58.246934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:58.246937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:58.246955Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:58.246964Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:58.246973Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:58.247054Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.247074Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.247077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.247081Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:58.247085Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:58.247195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:58.247210Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.247283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.247305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.247325Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:58.247352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897157008878848:13523]
2025-09-30T14:59:58.247355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897157008878848:13523]
2025-09-30T14:59:58.247357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897157008878848:13523]
2025-09-30T14:59:58.247378Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:58.247401Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:58.247423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:58.247427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:58.247450Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:58.247454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:58.247457Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:58.247473Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897157008878848:13523]
2025-09-30T14:59:58.247480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:58.247550Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:58.248035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098683796:5349], now have 1 active actors on pipe
2025-09-30T14:59:58.248050Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098683622:2454], now have 1 active actors on pipe
2025-09-30T14:59:58.247858Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3394
2025-09-30T14:59:58.247903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3394
2025-09-30T14:59:58.248137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:58.248155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:58.248186Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|486d1c73-c8a83629-41a09792-8a54dafb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:58.248197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:58.248213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:58.248216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:58.248230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:58.248244Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:58.248263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:58.248951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:58.248966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:58.248986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:58.249160Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3395 partition: 0 MaxSeqNo: 42 sessionId: src_id|486d1c73-c8a83629-41a09792-8a54dafb_0
2025-09-30T14:59:58.249648Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f585602a-49c809a2-cbbb827e-bd7ca82a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|486d1c73-c8a83629-41a09792-8a54dafb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:58.252977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|486d1c73-c8a83629-41a09792-8a54dafb_0] Write session: try to update token
2025-09-30T14:59:58.253004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|486d1c73-c8a83629-41a09792-8a54dafb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:58.265589Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:58.265614Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:58.265627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897157008878848:13523]
2025-09-30T14:59:58.265679Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:58.265716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:58.265903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:58.266060Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:58.266232Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:58.266396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:58.266640Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:58.266696Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:58.277148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3395 sessionId: src_id|486d1c73-c8a83629-41a09792-8a54dafb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:58.280208Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:58.281559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:58.281607Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:58.281632Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:58.281643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:58.281647Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:58.281649Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:58.281659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897157008878848:13523]
2025-09-30T14:59:58.281664Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897157008878848:13523]
2025-09-30T14:59:58.281668Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897157008878848:13523]
2025-09-30T14:59:58.281717Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:58.281722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:58.281729Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.281732Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:58.281735Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:58.281739Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:58.281897Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:58.298364Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897157098683869:2695]
2025-09-30T14:59:58.298879Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 93 pipe creation result: OK TabletId: 72075186224037892 Generation: 3394, pipe: [1:7555897157098683869:2695]
2025-09-30T14:59:58.405214Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:58.405937Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:58.406052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:58.406055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:58.406144Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3395 reason: error at write: Disconnected sessionId: src_id|486d1c73-c8a83629-41a09792-8a54dafb_0
2025-09-30T14:59:58.406302Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3395 sessionId: src_id|486d1c73-c8a83629-41a09792-8a54dafb_0 is DEAD
2025-09-30T14:59:58.406503Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 93 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897157098683869:2695]
2025-09-30T14:59:58.406691Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:58.407376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|486d1c73-c8a83629-41a09792-8a54dafb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:58.407392Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|486d1c73-c8a83629-41a09792-8a54dafb_0] Write session will restart in 0.005299s
2025-09-30T14:59:58.407417Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|486d1c73-c8a83629-41a09792-8a54dafb_0] Write session: Do CDS request
2025-09-30T14:59:58.407422Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|486d1c73-c8a83629-41a09792-8a54dafb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:58.405717Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:58.405756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098683869:2695], now have 1 active actors on pipe
2025-09-30T14:59:58.415751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|486d1c73-c8a83629-41a09792-8a54dafb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:58.416133Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:58.416153Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3396
2025-09-30T14:59:58.419431Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3396 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:58.419490Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3396 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:58.419497Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3396 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:58.419502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:58.420785Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3396 sessionId:  describe result for acl check
2025-09-30T14:59:58.420829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:58.420832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:58.420834Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:58.420841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897157098683902:5359] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:58.421456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897157098683902:5359] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:58.430981Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897157098683902:5359] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:58.444321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897157098683902:5359] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:58.444342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897157098683902:5359] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:58.444345Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897157098683902:5359] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:58.444355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3396 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:58.446548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:58.452034Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:58.452315Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:58.452329Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:58.452344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:58.452439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:58.452498Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897157008879091:13526]
2025-09-30T14:59:58.453164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:58.453740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:58.453835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:58.454247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:58.454370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.454381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.454382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.454383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.454385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.454387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.454388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.454390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.454391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.454393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.454394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.454396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.454398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.454399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.454401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.454408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.454420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.454424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.454429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.454434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.454438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.454442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.454446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.454450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.454454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.454458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.454462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.454466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.454470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.454474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.454487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.454496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.454504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.454510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.454517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.454522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.454527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.454533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.454539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.454545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.454549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.454554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.454560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.454566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.454584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.454590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.454596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.454602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.454607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.454612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.454618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.454627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.454632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.454637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.454642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.454648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.454654Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.454674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.454680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.454686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.454734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:58.461449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:58.462948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:58.462973Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:58.462976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:58.462981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:58.462988Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3395 [2:7555897157008879091:13526]
2025-09-30T14:59:58.463013Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:58.463035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:58.463039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:58.463042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:58.463045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:58.463068Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:58.463085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:58.463093Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:58.463175Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.463184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.463186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.463190Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:58.463192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:58.463817Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3395
2025-09-30T14:59:58.463874Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3395
2025-09-30T14:59:58.463284Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:58.463292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.463308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.463318Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.463333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:58.463352Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897157008879086:13526]
2025-09-30T14:59:58.463355Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897157008879086:13526]
2025-09-30T14:59:58.463357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897157008879086:13526]
2025-09-30T14:59:58.463368Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:58.463383Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:58.463396Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:58.463400Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:58.463407Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:58.463411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:58.463413Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:58.463441Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897157008879086:13526]
2025-09-30T14:59:58.463444Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:58.463448Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:58.463454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098683876:2454], now have 1 active actors on pipe
2025-09-30T14:59:58.463458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098684110:5359], now have 1 active actors on pipe
2025-09-30T14:59:58.464226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:58.464244Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:58.464275Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:58.464294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:58.464300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:58.464303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:58.464316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:58.464336Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:58.464358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:58.464568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:58.464576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:58.464593Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:58.467369Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3396 partition: 0 MaxSeqNo: 42 sessionId: src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0
2025-09-30T14:59:58.467863Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|486d1c73-c8a83629-41a09792-8a54dafb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:58.471020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0] Write session: try to update token
2025-09-30T14:59:58.471051Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:58.480763Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:58.480790Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:58.480792Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:58.480794Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:58.480804Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897157008879086:13526]
2025-09-30T14:59:58.480810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897157008879086:13526]
2025-09-30T14:59:58.480815Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897157008879086:13526]
2025-09-30T14:59:58.480859Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:58.480867Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.480870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:58.480872Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:58.480881Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:58.480887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:58.481019Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:58.504630Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3396 sessionId: src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:58.507055Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897157098684127:2695]
2025-09-30T14:59:58.508021Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:58.509062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 94 pipe creation result: OK TabletId: 72075186224037892 Generation: 3395, pipe: [1:7555897157098684127:2695]
2025-09-30T14:59:58.639352Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:58.639692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:58.639709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:58.639731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098684127:2695], now have 1 active actors on pipe
2025-09-30T14:59:58.640213Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:58.643517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:58.643577Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 94 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897157098684127:2695]
2025-09-30T14:59:58.643599Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:58.643680Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3396 reason: status is not ok: tablet will be restarted right now sessionId: src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0
2025-09-30T14:59:58.643861Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3396 sessionId: src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0 is DEAD
2025-09-30T14:59:58.644332Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T14:59:58.644340Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0] Write session will restart in 0.008177s
2025-09-30T14:59:58.644365Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0] Write session: Do CDS request
2025-09-30T14:59:58.644370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:58.653838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:58.653941Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:58.653963Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3397
2025-09-30T14:59:58.655020Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3397 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:58.655083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3397 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:58.655100Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3397 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:58.655104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:58.655587Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3397 sessionId:  describe result for acl check
2025-09-30T14:59:58.655633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:58.655650Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:58.655652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:58.655658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897157098684140:5376] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:58.656272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897157098684140:5376] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:58.660943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897157098684140:5376] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:58.667108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897157098684140:5376] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:58.667130Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897157098684140:5376] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:58.667137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897157098684140:5376] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:58.667148Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3397 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:58.696407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:58.698669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:58.699020Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:58.699032Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:58.699044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:58.699110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:58.699157Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897157008879344:13528]
2025-09-30T14:59:58.699908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:58.701093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:58.701156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:58.701554Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:58.701617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.701624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.701625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.701627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.701629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.701631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.701632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.701634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.701635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.701636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.701638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.701639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.701641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.701643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.701645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.701652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.701663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.701668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.701672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.701677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.701681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.701684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.701688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.701692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.701696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.701699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.701703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.701707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.701711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.701715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.701724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.701732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:58.701739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.701744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:58.701749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.701756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:58.701760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.701766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:58.701771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.701776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:58.701781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.701787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:58.701800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.701805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:58.701815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.701820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:58.701830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.701840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:58.701845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.701851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:58.701861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.701866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.701871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.701876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.701886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.701891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.701896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.701902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:58.701914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.701919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:58.701964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:58.712300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:58.713706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:58.713730Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:58.713733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:58.713737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:58.713750Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3396 [2:7555897157008879344:13528]
2025-09-30T14:59:58.713769Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:58.713786Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:58.713808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:58.713812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:58.713814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:58.713832Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:58.713839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:58.713847Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:58.713918Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.713927Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.713929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.713932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:58.713935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:58.714015Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:58.714017Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.714031Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:58.714041Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:58.714059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:58.714076Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897157008879339:13528]
2025-09-30T14:59:58.714078Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897157008879339:13528]
2025-09-30T14:59:58.714080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897157008879339:13528]
2025-09-30T14:59:58.714096Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:58.714114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:58.714129Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:58.714132Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:58.714146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:58.714159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:58.714161Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:58.714172Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897157008879339:13528]
2025-09-30T14:59:58.714176Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:58.714267Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:58.714357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098684179:5376], now have 1 active actors on pipe
2025-09-30T14:59:58.714371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098684130:2454], now have 1 active actors on pipe
2025-09-30T14:59:58.714437Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3396
2025-09-30T14:59:58.714492Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3396
2025-09-30T14:59:58.714645Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:58.714662Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:58.714711Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:58.714725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:58.714729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:58.714733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:58.714746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:58.714759Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:58.714777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:58.715359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:58.715374Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:58.715407Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:58.715499Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3397 partition: 0 MaxSeqNo: 42 sessionId: src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0
2025-09-30T14:59:58.715931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d6c812ea-dac49315-205143a9-a5ecfaec_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:58.719107Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0] Write session: try to update token
2025-09-30T14:59:58.719131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:58.730751Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:58.730780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:58.730784Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:58.730786Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:58.730798Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897157008879339:13528]
2025-09-30T14:59:58.730803Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897157008879339:13528]
2025-09-30T14:59:58.730808Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897157008879339:13528]
2025-09-30T14:59:58.730854Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:58.730861Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:58.730865Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:58.730879Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:58.730901Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:58.730906Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:58.731022Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:58.744968Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897157098684378:2695]
2025-09-30T14:59:58.748706Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 95 pipe creation result: OK TabletId: 72075186224037892 Generation: 3396, pipe: [1:7555897157098684378:2695]
2025-09-30T14:59:58.750295Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3397 sessionId: src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:58.753239Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:58.960607Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:58.962641Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:58.962656Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0] Write session will restart in 0.008747s
2025-09-30T14:59:58.962680Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0] Write session: Do CDS request
2025-09-30T14:59:58.962686Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:58.961169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098684378:2695], now have 1 active actors on pipe
2025-09-30T14:59:58.961205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:58.961214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:58.961664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 95 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897157098684378:2695]
2025-09-30T14:59:58.961677Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:58.961682Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:58.961748Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3397 reason: error at write: Disconnected sessionId: src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0
2025-09-30T14:59:58.961935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3397 sessionId: src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0 is DEAD
2025-09-30T14:59:58.962218Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:58.967965Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:58.975876Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:58.975975Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:58.975995Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3398
2025-09-30T14:59:58.978142Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3398 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:58.978203Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3398 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:58.978209Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3398 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:58.978215Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:58.978744Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3398 sessionId:  describe result for acl check
2025-09-30T14:59:58.978785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:58.978787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:58.978801Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:58.978808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897157098684437:5390] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:58.979401Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897157098684437:5390] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:58.982562Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897157098684437:5390] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:58.990322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897157098684437:5390] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:58.990344Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897157098684437:5390] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:58.990347Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897157098684437:5390] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:58.990355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3398 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:59.012035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:59.018629Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:59.018908Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:59.018925Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:59.018942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:59.019021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:59.019087Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897161303846918:13544]
2025-09-30T14:59:59.019770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:59.020277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:59.020341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:59.020709Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:59.020790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.020791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.020792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.020794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.020795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.020797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.020798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.020799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.020801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.020802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.020803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.020804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.020805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.020806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.020808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.020815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.020826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.020830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.020835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.020838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.020842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.020846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.020849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.020853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.020858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.020863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.020866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.020870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.020873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.020877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.020891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.020900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.020906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.020911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.020917Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.020923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.020927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.020932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.020938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.020943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.020947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.020951Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.020956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.020961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.020965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.020971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.020976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.020981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.020984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.020989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.020994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.020999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.021004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.021009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.021014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.021018Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.021023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.021028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.021032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.021040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.021082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:59.034059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:59.035175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:59.035199Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:59.035202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:59.035207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:59.035214Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3397 [2:7555897161303846918:13544]
2025-09-30T14:59:59.035230Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:59.035267Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:59.035270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:59.035273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:59.035276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:59.035296Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:59.035303Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:59.035319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:59.035390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.035398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.035400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.035404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:59.035407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:59.035484Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:59.035487Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.035503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.035517Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.035535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:59.035553Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897161303846913:13544]
2025-09-30T14:59:59.035562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897161303846913:13544]
2025-09-30T14:59:59.035565Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897161303846913:13544]
2025-09-30T14:59:59.035575Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:59.035591Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:59.035607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:59.035614Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:59.035621Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:59.035632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:59.035634Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:59.035654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897161303846913:13544]
2025-09-30T14:59:59.035662Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:59.035738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:59.036393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3397
2025-09-30T14:59:59.036454Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3397
2025-09-30T14:59:59.036613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098684410:2454], now have 1 active actors on pipe
2025-09-30T14:59:59.036626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897157098684476:5390], now have 1 active actors on pipe
2025-09-30T14:59:59.036676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.036683Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.036712Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7086aab1-30d2343-ad23013-d7080c1f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:59.036723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:59.036728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:59.036730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:59.036742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:59.036755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:59.036773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:59.037072Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.037085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.037108Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:59.037297Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3398 partition: 0 MaxSeqNo: 42 sessionId: src_id|7086aab1-30d2343-ad23013-d7080c1f_0
2025-09-30T14:59:59.037722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|943b8f30-20fa7b3e-f4e8743f-544a774f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7086aab1-30d2343-ad23013-d7080c1f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:59.040704Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7086aab1-30d2343-ad23013-d7080c1f_0] Write session: try to update token
2025-09-30T14:59:59.040732Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7086aab1-30d2343-ad23013-d7080c1f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:59.052481Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:59.052503Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:59.052506Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:59.052509Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:59.052519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897161303846913:13544]
2025-09-30T14:59:59.052524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897161303846913:13544]
2025-09-30T14:59:59.052530Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897161303846913:13544]
2025-09-30T14:59:59.052575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:59.052583Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.052586Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:59.052601Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:59.052609Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:59.052613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:59.052748Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:59.061704Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897161393651964:2695]
2025-09-30T14:59:59.062562Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 96 pipe creation result: OK TabletId: 72075186224037892 Generation: 3397, pipe: [1:7555897161393651964:2695]
2025-09-30T14:59:59.072883Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3398 sessionId: src_id|7086aab1-30d2343-ad23013-d7080c1f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:59.075936Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:59.174544Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:59.175207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897161393651964:2695], now have 1 active actors on pipe
2025-09-30T14:59:59.175238Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.175254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.176083Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 96 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897161393651964:2695]
2025-09-30T14:59:59.176119Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:59.176155Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:59.176164Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:59.176238Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3398 reason: error at write: Disconnected sessionId: src_id|7086aab1-30d2343-ad23013-d7080c1f_0
2025-09-30T14:59:59.176432Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3398 sessionId: src_id|7086aab1-30d2343-ad23013-d7080c1f_0 is DEAD
2025-09-30T14:59:59.175699Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:59.179570Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7086aab1-30d2343-ad23013-d7080c1f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:59.179589Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7086aab1-30d2343-ad23013-d7080c1f_0] Write session will restart in 0.005208s
2025-09-30T14:59:59.179626Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7086aab1-30d2343-ad23013-d7080c1f_0] Write session: Do CDS request
2025-09-30T14:59:59.179637Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7086aab1-30d2343-ad23013-d7080c1f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:59.185846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7086aab1-30d2343-ad23013-d7080c1f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:59.186042Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:59.186063Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3399
2025-09-30T14:59:59.187480Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3399 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:59.187530Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3399 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:59.187535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3399 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:59.187540Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:59.188099Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3399 sessionId:  describe result for acl check
2025-09-30T14:59:59.188164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:59.188167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:59.188173Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:59.188180Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897161393651982:5398] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:59.188889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897161393651982:5398] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:59.197046Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897161393651982:5398] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:59.203778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897161393651982:5398] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:59.203799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897161393651982:5398] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:59.203802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897161393651982:5398] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:59.203811Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3399 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:59.215200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:59.218755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:59.219008Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:59.219020Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:59.219033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:59.219101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:59.219151Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897161303847162:13546]
2025-09-30T14:59:59.219842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:59.220562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:59.220639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:59.221088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:59.221220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.221222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.221224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.221225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.221226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.221228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.221230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.221231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.221233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.221234Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.221235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.221237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.221238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.221240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.221241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.221248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.221259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.221263Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.221267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.221271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.221275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.221279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.221283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.221287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.221291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.221296Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.221300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.221303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.221307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.221312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.221323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.221331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.221339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.221346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.221351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.221357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.221377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.221384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.221389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.221396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.221401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.221407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.221412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.221418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.221424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.221429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.221439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.221447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.221473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.221484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.221489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.221499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.221504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.221509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.221517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.221522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.221527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.221535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.221539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.221545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.221587Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:59.227916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:59.229332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:59.229352Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:59.229354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:59.229358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:59.229366Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3398 [2:7555897161303847162:13546]
2025-09-30T14:59:59.229384Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:59.229402Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:59.229406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:59.229409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:59.229411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:59.229429Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:59.229435Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:59.229443Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:59.229513Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.229527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.229529Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.229533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:59.229536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:59.229616Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:59.229626Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.229642Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.229654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.229676Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:59.229701Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897161393651966:2454], now have 1 active actors on pipe
2025-09-30T14:59:59.229709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897161393652098:5398], now have 1 active actors on pipe
2025-09-30T14:59:59.229716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897161303847155:13546]
2025-09-30T14:59:59.229724Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897161303847155:13546]
2025-09-30T14:59:59.229725Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897161303847155:13546]
2025-09-30T14:59:59.229738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:59.229756Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:59.229758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:59.229774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:59.229777Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:59.229778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:59.229780Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:59.229825Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897161303847155:13546]
2025-09-30T14:59:59.229837Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:59.229878Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:59.229868Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3398
2025-09-30T14:59:59.229926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3398
2025-09-30T14:59:59.230137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.230161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.230193Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:59.230208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:59.230221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:59.230224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:59.230235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:59.230248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:59.230265Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:59.230697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.230713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.230737Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:59.230818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3399 partition: 0 MaxSeqNo: 42 sessionId: src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0
2025-09-30T14:59:59.231283Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7086aab1-30d2343-ad23013-d7080c1f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:59.234340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0] Write session: try to update token
2025-09-30T14:59:59.234367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:59.249851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:59.249868Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:59.249878Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897161303847155:13546]
2025-09-30T14:59:59.249927Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:59.249927Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:59.250108Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:59.250258Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:59.250412Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:59.250557Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:59.250791Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:59.250839Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:59.259600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3399 sessionId: src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:59.262532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:59.265977Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.266003Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.267227Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:59.267283Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:59.267294Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:59.267297Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:59.267300Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:59.267310Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897161303847155:13546]
2025-09-30T14:59:59.267314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897161303847155:13546]
2025-09-30T14:59:59.267318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897161303847155:13546]
2025-09-30T14:59:59.267345Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:59.267353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:59.267357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:59.267359Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.267362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:59.267362Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:59.267394Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:59.267495Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:59.275841Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897161393652217:2695]
2025-09-30T14:59:59.276371Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 97 pipe creation result: OK TabletId: 72075186224037892 Generation: 3398, pipe: [1:7555897161393652217:2695]
2025-09-30T14:59:59.385172Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:59.385826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897161393652217:2695], now have 1 active actors on pipe
2025-09-30T14:59:59.395772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.395802Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.396004Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.396070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.396135Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.396203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.396700Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.396708Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.396793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.396860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.396962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.397295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.397550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.397554Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.397635Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.397698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.397765Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.397833Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.397876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.397880Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.397959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.398259Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.398334Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.398406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.398451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.398455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.398532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.398596Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.398660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.398725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.398775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.398778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.398852Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.398916Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.398980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.399045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.399230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.399239Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.399332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.399403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.399481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.399555Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.399609Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.399612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.399698Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.399768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.399886Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.399965Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.400041Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.400045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.400128Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.400200Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.400280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.400357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.400422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.400426Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.400510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.400583Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.400657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.400744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.400791Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.400795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.401655Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:59.402355Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 97 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897161393652217:2695]
2025-09-30T14:59:59.402373Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:59.402400Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:59.402403Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:59.402443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3399 reason: error at write: Disconnected sessionId: src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0
2025-09-30T14:59:59.402630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3399 sessionId: src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0 is DEAD
2025-09-30T14:59:59.402945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:59.402957Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0] Write session will restart in 0.008300s
2025-09-30T14:59:59.402983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0] Write session: Do CDS request
2025-09-30T14:59:59.402990Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:59.414827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:59.415115Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:59.415147Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3400
2025-09-30T14:59:59.415385Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3400 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:59.415451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3400 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:59.415458Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3400 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:59.415465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:59.415994Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3400 sessionId:  describe result for acl check
2025-09-30T14:59:59.416033Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:59.416040Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:59.416042Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:59.416049Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897161393652239:5421] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:59.416756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897161393652239:5421] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:59.420695Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897161393652239:5421] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:59.426172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897161393652239:5421] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:59.426200Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897161393652239:5421] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:59.426208Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897161393652239:5421] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:59.426219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3400 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:59.435715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:59.439945Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:59.440634Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:59.440652Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:59.440674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:59.440783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:59.440837Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897161303847407:13549]
2025-09-30T14:59:59.441489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:59.442210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:59.442283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:59.442679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:59.442779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.442781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.442783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.442784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.442786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.442788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.442789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.442791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.442792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.442793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.442795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.442796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.442797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.442799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.442800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.442808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.442819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.442823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.442828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.442832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.442836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.442840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.442844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.442848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.442852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.442856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.442860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.442864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.442868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.442872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.442881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.442890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.442895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.442901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.442907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.442913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.442918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.442923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.442928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.442933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.442938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.442944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.442949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.442955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.442959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.442965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.442971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.442977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.442982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.442988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.442993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.443002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.443007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.443013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.443019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.443024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.443029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.443034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.443039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.443044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.443091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:59.454043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:59.455112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:59.455131Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:59.455135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:59.455140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:59.455148Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3399 [2:7555897161303847407:13549]
2025-09-30T14:59:59.455169Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:59.455190Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:59.455194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:59.455197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:59.455199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:59.455218Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:59.455228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:59.455235Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:59.455338Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.455341Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.455343Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.455347Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:59.455350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:59.455427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:59.455436Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.455450Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.455462Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.455479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:59.455500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897161393652224:2454], now have 1 active actors on pipe
2025-09-30T14:59:59.455509Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897161393652385:5421], now have 1 active actors on pipe
2025-09-30T14:59:59.455515Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897161303847402:13549]
2025-09-30T14:59:59.455517Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897161303847402:13549]
2025-09-30T14:59:59.455519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897161303847402:13549]
2025-09-30T14:59:59.455533Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:59.455551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:59.455555Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:59.455558Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:59.455561Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:59.455574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:59.455577Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:59.455622Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897161303847402:13549]
2025-09-30T14:59:59.455630Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:59.455659Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:59.455874Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3399
2025-09-30T14:59:59.455926Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3399
2025-09-30T14:59:59.457505Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3400 partition: 0 MaxSeqNo: 42 sessionId: src_id|44027ddc-3fde393-837de92a-35eb0883_0
2025-09-30T14:59:59.458093Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|343360e4-b89d0317-bc3abebf-f70f9af7_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|44027ddc-3fde393-837de92a-35eb0883_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:59.456031Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.456046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.456076Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|44027ddc-3fde393-837de92a-35eb0883_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:59.456086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:59.456089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:59.456092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:59.456104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:59.456118Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:59.456134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:59.457316Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.457325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.457352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:59.461692Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44027ddc-3fde393-837de92a-35eb0883_0] Write session: try to update token
2025-09-30T14:59:59.461720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44027ddc-3fde393-837de92a-35eb0883_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:59.473278Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:59.473313Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:59.473325Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897161303847402:13549]
2025-09-30T14:59:59.473377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:59.473578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:59.473752Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:59.473903Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:59.474050Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:59.474536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:59.474592Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:59.474965Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:59.487367Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:59.487384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:59.487388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:59.487389Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:59.487400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897161303847402:13549]
2025-09-30T14:59:59.487405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897161303847402:13549]
2025-09-30T14:59:59.487411Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897161303847402:13549]
2025-09-30T14:59:59.487457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:59.487457Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:59.487467Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:59.487470Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.487473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:59.487480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:59.487625Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:59.486070Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3400 sessionId: src_id|44027ddc-3fde393-837de92a-35eb0883_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:59.489182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:59.502555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897161393652479:2695]
2025-09-30T14:59:59.503267Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 98 pipe creation result: OK TabletId: 72075186224037892 Generation: 3399, pipe: [1:7555897161393652479:2695]
2025-09-30T14:59:59.604363Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:59.604793Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.604810Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.604836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897161393652479:2695], now have 1 active actors on pipe
2025-09-30T14:59:59.605221Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:59.605285Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:59.605288Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:59.605363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3400 reason: error at write: Disconnected sessionId: src_id|44027ddc-3fde393-837de92a-35eb0883_0
2025-09-30T14:59:59.605087Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:59.605545Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3400 sessionId: src_id|44027ddc-3fde393-837de92a-35eb0883_0 is DEAD
2025-09-30T14:59:59.605716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44027ddc-3fde393-837de92a-35eb0883_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:59.605728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44027ddc-3fde393-837de92a-35eb0883_0] Write session will restart in 0.008710s
2025-09-30T14:59:59.605752Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44027ddc-3fde393-837de92a-35eb0883_0] Write session: Do CDS request
2025-09-30T14:59:59.605773Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44027ddc-3fde393-837de92a-35eb0883_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:59.605758Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 98 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897161393652479:2695]
2025-09-30T14:59:59.619608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|44027ddc-3fde393-837de92a-35eb0883_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:59.619743Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:59.619764Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3401
2025-09-30T14:59:59.620026Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3401 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:59.620064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3401 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:59.620074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3401 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:59.620078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:59.620721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3401 sessionId:  describe result for acl check
2025-09-30T14:59:59.620784Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:59.620787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:59.620789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:59.620795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897161393652557:5412] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:59.621385Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897161393652557:5412] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:59.625456Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897161393652557:5412] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:59.632267Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897161393652557:5412] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:59.632290Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897161393652557:5412] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:59.632294Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897161393652557:5412] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:59.632306Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3401 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:59.632772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:59.635948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:59.636213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:59.636224Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:59.636249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:59.636319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:59.636371Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897161303847651:13551]
2025-09-30T14:59:59.637066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:59.637505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:59.637570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:59.638194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:59.638306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.638315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.638316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.638317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.638319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.638321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.638322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.638324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.638325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.638327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.638328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.638329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.638331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.638332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.638333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.638341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.638352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.638356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.638360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.638364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.638369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.638373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.638377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.638382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.638387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.638390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.638394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.638398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.638402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.638406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.638417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.638426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.638438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.638444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.638450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.638455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.638460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.638465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.638472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.638477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.638483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.638488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.638493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.638499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.638503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.638509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.638514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.638519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.638523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.638528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.638533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.638538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.638543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.638548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.638561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.638567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.638571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.638576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.638582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.638593Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.638636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:59.644882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:59.646096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:59.646115Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:59.646118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:59.646121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:59.646129Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3400 [2:7555897161303847651:13551]
2025-09-30T14:59:59.646147Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:59.646165Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:59.646169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:59.646172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:59.646175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:59.646192Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:59.646200Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:59.646212Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:59.646655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3400
2025-09-30T14:59:59.646280Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.646703Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3400
2025-09-30T14:59:59.646295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.646297Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.646300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:59.646304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:59.646379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:59.646382Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.646397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.646411Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.646429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:59.646447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897161303847645:13551]
2025-09-30T14:59:59.646450Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897161303847645:13551]
2025-09-30T14:59:59.646452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897161303847645:13551]
2025-09-30T14:59:59.646460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:59.646477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897161393652721:5412], now have 1 active actors on pipe
2025-09-30T14:59:59.646484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897161393652482:2454], now have 1 active actors on pipe
2025-09-30T14:59:59.646486Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:59.646489Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:59.646490Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:59.646496Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:59.646505Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:59.646508Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:59.646549Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897161303847645:13551]
2025-09-30T14:59:59.646561Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:59.646567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:59.646744Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.646755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.646791Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36d1e909-55caba3-9c9751bb-22c75bb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:59.646801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:59.646806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:59.646808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:59.646821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:59.646834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:59.646866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:59.647141Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.647156Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.647194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:59.647349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3401 partition: 0 MaxSeqNo: 42 sessionId: src_id|36d1e909-55caba3-9c9751bb-22c75bb_0
2025-09-30T14:59:59.647714Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|44027ddc-3fde393-837de92a-35eb0883_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|36d1e909-55caba3-9c9751bb-22c75bb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:59.650966Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d1e909-55caba3-9c9751bb-22c75bb_0] Write session: try to update token
2025-09-30T14:59:59.650987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d1e909-55caba3-9c9751bb-22c75bb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:59.669676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3401 sessionId: src_id|36d1e909-55caba3-9c9751bb-22c75bb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:59.664841Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T14:59:59.664858Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:59.664869Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897161303847645:13551]
2025-09-30T14:59:59.664928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:59:59.665119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T14:59:59.665271Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:59.665422Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:59.665584Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T14:59:59.665930Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T14:59:59.666069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T14:59:59.666128Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T14:59:59.672643Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:59:59.672884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.672904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.672942Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:59:59.673212Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:59:59.676725Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:59.676747Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:59.676750Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:59.676752Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:59.676763Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897161303847645:13551]
2025-09-30T14:59:59.676767Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897161303847645:13551]
2025-09-30T14:59:59.676771Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897161303847645:13551]
2025-09-30T14:59:59.676819Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:59.676826Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.676830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:59.676980Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:59.679357Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:59.679376Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:59.679380Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:59.706120Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897161393652734:2695]
2025-09-30T14:59:59.706602Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 99 pipe creation result: OK TabletId: 72075186224037892 Generation: 3400, pipe: [1:7555897161393652734:2695]
2025-09-30T14:59:59.802192Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T14:59:59.802571Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897161393652734:2695], now have 1 active actors on pipe
2025-09-30T14:59:59.812672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.812702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.812896Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.812976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.813046Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.813117Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.813174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.813185Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.813262Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.813330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.813401Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.813474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.813523Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.813532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.813613Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.813682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.813753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.813824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.813875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.813878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.813952Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.814019Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.814096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.814165Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.814222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.814231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.814302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.814368Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.814437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.814511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.814558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.814567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.814639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.814922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.815008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.815073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.815133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.815136Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.815212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.815289Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.815357Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.815423Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.815468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.815471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.815548Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.815606Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.815670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.815746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.815801Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.815804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.815901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.815970Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.816038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.816106Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.816152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.816155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.816231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T14:59:59.816290Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T14:59:59.816359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T14:59:59.816444Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T14:59:59.816489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T14:59:59.816493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T14:59:59.819576Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T14:59:59.819732Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 99 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897161393652734:2695]
2025-09-30T14:59:59.819754Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T14:59:59.819758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T14:59:59.819777Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T14:59:59.819789Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3401 reason: error at write: Disconnected sessionId: src_id|36d1e909-55caba3-9c9751bb-22c75bb_0
2025-09-30T14:59:59.819826Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1661: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 closed with error: reason# too much attempts to restart pipe
2025-09-30T14:59:59.819917Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 34 consumer shared/user session shared/user_1_34_9210698993788309934_v1 is DEAD
2025-09-30T14:59:59.819981Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3401 sessionId: src_id|36d1e909-55caba3-9c9751bb-22c75bb_0 is DEAD
2025-09-30T14:59:59.820351Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d1e909-55caba3-9c9751bb-22c75bb_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T14:59:59.820364Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d1e909-55caba3-9c9751bb-22c75bb_0] Write session will restart in 0.009213s
2025-09-30T14:59:59.820404Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d1e909-55caba3-9c9751bb-22c75bb_0] Write session: Do CDS request
2025-09-30T14:59:59.820410Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d1e909-55caba3-9c9751bb-22c75bb_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T14:59:59.820842Z :ERROR: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got error. Status: UNAVAILABLE. Description: <main>: Error: too much attempts to restart pipe, code: 500027 
2025-09-30T14:59:59.820883Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555897071199317972:2716] disconnected; active server actors: 1
2025-09-30T14:59:59.820899Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555897071199317972:2716] client user disconnected session shared/user_1_34_9210698993788309934_v1
2025-09-30T14:59:59.820965Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:59:59.820972Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:59:59.820981Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Reconnecting session to cluster  in 0.008499s
2025-09-30T14:59:59.831607Z :DEBUG: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Successfully connected. Initializing session
2025-09-30T14:59:59.832170Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|36d1e909-55caba3-9c9751bb-22c75bb_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:59.835729Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:59:59.835750Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:59:59.835754Z node 1 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 35
2025-09-30T14:59:59.835759Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3402
2025-09-30T14:59:59.835955Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3402 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:59:59.835987Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 35 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:59:59.836011Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3402 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T14:59:59.836017Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3402 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:59:59.836020Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:59:59.836044Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 read init: from# ipv6:[::1]:54586, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:59:59.836154Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 auth for : user
2025-09-30T14:59:59.836690Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 Handle describe topics response
2025-09-30T14:59:59.836717Z node 1 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 auth is DEAD
2025-09-30T14:59:59.836741Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:59:59.836747Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3402 sessionId:  describe result for acl check
2025-09-30T14:59:59.836785Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:59:59.836787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:59:59.836789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:59:59.837157Z :INFO: [/Root] [/Root] [3a66799f-5d8bd9f1-2dccc6d0-71fd43f4] [] Got InitResponse. ReadSessionId: shared/user_1_35_3181766952260320716_v1
2025-09-30T14:59:59.836795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897161393652765:5433] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:59:59.837044Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:59:59.837506Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897161393652765:5433] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:59:59.837614Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555897161393652767:5425] connected; active server actors: 1
2025-09-30T14:59:59.837847Z node 1 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [1:7555897161393652767:5425] session shared/user_1_35_3181766952260320716_v1
2025-09-30T14:59:59.837864Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:59:59.837878Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:59:59.837892Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_1_35_3181766952260320716_v1" (Sender=[1:7555897161393652752:5425], Pipe=[1:7555897161393652767:5425], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:59:59.837902Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:59:59.837916Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:59:59.837926Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_1_35_3181766952260320716_v1" (Sender=[1:7555897161393652752:5425], Pipe=[1:7555897161393652767:5425], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:59:59.837940Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_1_35_3181766952260320716_v1" sender [1:7555897161393652752:5425] lock partition 0 for ReadingSession "shared/user_1_35_3181766952260320716_v1" (Sender=[1:7555897161393652752:5425], Pipe=[1:7555897161393652767:5425], Partitions=[], ActiveFamilyCount=1) generation 1 step 35
2025-09-30T14:59:59.837954Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:59:59.837970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000038s
2025-09-30T14:59:59.838209Z node 1 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 35 Session: "shared/user_1_35_3181766952260320716_v1" ClientId: "user" PipeClient { RawX1: 7555897161393652767 RawX2: 4503603922343217 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:59:59.838234Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:59:59.842079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897161393652765:5433] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:59:59.847887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897161393652765:5433] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:59:59.847908Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897161393652765:5433] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:59:59.847912Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897161393652765:5433] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:59:59.847931Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3402 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:59:59.856924Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:59:59.861582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:59:59.861874Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:59:59.861887Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T14:59:59.861912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:59:59.861993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:59:59.862055Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897161303847911:13555]
2025-09-30T14:59:59.862730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T14:59:59.863864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T14:59:59.863958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T14:59:59.864589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T14:59:59.864714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.864716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.864717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.864719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.864720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.864722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.864723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.864725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.864726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.864727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.864729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.864730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.864732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.864733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.864735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.864742Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.864753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.864757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.864775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.864779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.864784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.864788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.864792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.864795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.864800Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.864803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.864807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.864811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.864815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.864819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.864830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.864838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T14:59:59.864845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.864850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T14:59:59.864856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.864862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T14:59:59.864867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.864872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T14:59:59.864877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.864883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T14:59:59.864888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.864894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T14:59:59.864899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.864903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T14:59:59.864909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.864915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T14:59:59.864920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.864925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T14:59:59.864931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.864935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T14:59:59.864941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.864949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.864954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.864959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.864965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.864971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.864975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.864980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T14:59:59.864986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.864991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T14:59:59.865037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T14:59:59.872411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T14:59:59.874552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3401
2025-09-30T14:59:59.874604Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3401
2025-09-30T14:59:59.874632Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 3401, pipe: [1:7555897161393652787:5444]
2025-09-30T14:59:59.873635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T14:59:59.873659Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T14:59:59.873662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:59:59.873666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:59:59.873674Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3401 [2:7555897161303847911:13555]
2025-09-30T14:59:59.873694Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T14:59:59.873713Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T14:59:59.873716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:59.873720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:59.873723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:59.873743Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T14:59:59.873751Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:59:59.873760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:59:59.873837Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.873840Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.873841Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.873846Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T14:59:59.873849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T14:59:59.873945Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T14:59:59.873948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.873964Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T14:59:59.873976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T14:59:59.873994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T14:59:59.874012Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897161303847905:13555]
2025-09-30T14:59:59.874016Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897161303847905:13555]
2025-09-30T14:59:59.874018Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897161303847905:13555]
2025-09-30T14:59:59.874036Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T14:59:59.874054Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T14:59:59.874071Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T14:59:59.874074Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:59:59.874106Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T14:59:59.874112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T14:59:59.874115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897161303847905:13555]
2025-09-30T14:59:59.874115Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T14:59:59.874118Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T14:59:59.874123Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T14:59:59.874280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897161393652737:2454], now have 1 active actors on pipe
2025-09-30T14:59:59.874288Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897161393652891:5433], now have 1 active actors on pipe
2025-09-30T14:59:59.874293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897161393652787:5444], now have 1 active actors on pipe
2025-09-30T14:59:59.874860Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.874870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.874890Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.874902Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.874912Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_1_35_3181766952260320716_v1 on pipe: [1:7555897161393652787:5444]
2025-09-30T14:59:59.874944Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9a3f6312-abd476f9-222562e0-18f02083_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:59:59.874955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:59.874959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:59.874962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:59.874977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:59.874993Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:59:59.875007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:59.875011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:59.875013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:59:59.875033Z node 2 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_1_35_3181766952260320716_v1
2025-09-30T14:59:59.875036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:59.875073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:59.875095Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:59:59.875680Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:59:59.875699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:59:59.875722Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:59:59.875746Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_1_35_3181766952260320716_v1:1 with generation 3401
2025-09-30T14:59:59.875911Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3402 partition: 0 MaxSeqNo: 42 sessionId: src_id|9a3f6312-abd476f9-222562e0-18f02083_0
2025-09-30T14:59:59.878686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:59:59.878729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:59:59.878740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:59:59.878742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:59:59.878745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:59:59.878756Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:167: [72075186224037892][Partition][0][StateIdle] Blobs compaction in progress
2025-09-30T14:59:59.878770Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:59:59.879016Z node 1 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 42 WriteTimestampMS: 1759243818000 SizeLag: 18537654 WriteTimestampEstimateMS: 1759244399874 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:59:59.879042Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 42 readOffset 0 committedOffset 0
2025-09-30T14:59:59.879090Z node 1 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 sending to client partition status
2025-09-30T14:59:59.879846Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|36d1e909-55caba3-9c9751bb-22c75bb_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9a3f6312-abd476f9-222562e0-18f02083_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:59:59.884128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a3f6312-abd476f9-222562e0-18f02083_0] Write session: try to update token
2025-09-30T14:59:59.884161Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a3f6312-abd476f9-222562e0-18f02083_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T14:59:59.892504Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T14:59:59.892524Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T14:59:59.892527Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T14:59:59.892529Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T14:59:59.892548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897161303847905:13555]
2025-09-30T14:59:59.892551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897161303847905:13555]
2025-09-30T14:59:59.892556Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897161303847905:13555]
2025-09-30T14:59:59.892601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T14:59:59.892610Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T14:59:59.892613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T14:59:59.892642Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T14:59:59.892659Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T14:59:59.892663Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T14:59:59.892789Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T14:59:59.911858Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3402 sessionId: src_id|9a3f6312-abd476f9-222562e0-18f02083_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:59:59.914943Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:00.045183Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:00.045668Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.045684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.046054Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_1_35_3181766952260320716_v1
2025-09-30T15:00:00.046075Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:00.046892Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_1_35_3181766952260320716_v1
2025-09-30T15:00:00.047258Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a3f6312-abd476f9-222562e0-18f02083_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T15:00:00.047271Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a3f6312-abd476f9-222562e0-18f02083_0] Write session will restart in 0.008282s
2025-09-30T15:00:00.047296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a3f6312-abd476f9-222562e0-18f02083_0] Write session: Do CDS request
2025-09-30T15:00:00.047304Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a3f6312-abd476f9-222562e0-18f02083_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:00.046744Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:00.046803Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T15:00:00.046878Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3402 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9a3f6312-abd476f9-222562e0-18f02083_0
2025-09-30T15:00:00.047077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3402 sessionId: src_id|9a3f6312-abd476f9-222562e0-18f02083_0 is DEAD
2025-09-30T15:00:00.047241Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 0 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897161393652787:5444]
2025-09-30T15:00:00.056889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9a3f6312-abd476f9-222562e0-18f02083_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:00.057034Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:00.057057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3403
2025-09-30T15:00:00.057244Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3403 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:00.057301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3403 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:00.057327Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3403 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:00.057333Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:00.057811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3403 sessionId:  describe result for acl check
2025-09-30T15:00:00.057858Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:00.057861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:00.057863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:00.057870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897165688620342:5461] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:00.058533Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897165688620342:5461] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:00.060725Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897165688620342:5461] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:00.064750Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897165688620342:5461] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:00.064774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897165688620342:5461] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:00.064778Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897165688620342:5461] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:00.064789Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3403 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:00.092747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:00.094882Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:00.095537Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:00.095556Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:00.095575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:00.095683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:00.095740Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897165598815493:13569]
2025-09-30T15:00:00.096462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:00.096932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:00.097000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:00.097354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:00.097440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.097441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.097443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.097444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.097445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.097447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.097449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.097451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.097452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.097453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.097455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.097457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.097458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.097459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.097461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.097468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.097479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.097483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.097488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.097493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.097498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.097502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.097506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.097510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.097515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.097519Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.097523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.097527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.097531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.097535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.097544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.097552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.097559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.097565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.097570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.097577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.097581Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.097586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.097592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.097597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.097605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.097610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.097615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.097621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.097625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.097630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.097636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.097642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.097648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.097653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.097659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.097664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.097669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.097674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.097695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.097701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.097705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.097711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.097717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.097723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.097768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:00.104565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:00.105667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:00.105688Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:00.105692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:00.105697Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:00.105705Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3402 [2:7555897165598815493:13569]
2025-09-30T15:00:00.105727Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:00.105751Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:00.105754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:00.105758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:00.105760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:00.105780Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:00.105788Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:00.105803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:00.105884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.105893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.105895Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.105900Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:00.105902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:00.105984Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:00.105990Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.106005Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.106016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.106034Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:00.106053Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897165598815488:13569]
2025-09-30T15:00:00.106056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897165598815488:13569]
2025-09-30T15:00:00.106059Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897165598815488:13569]
2025-09-30T15:00:00.106082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:00.106098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:00.106114Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:00.106117Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:00.106160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897165598815488:13569]
2025-09-30T15:00:00.106164Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:00.106182Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:00.106186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688620380:5461], now have 1 active actors on pipe
2025-09-30T15:00:00.106187Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:00.106189Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:00.106197Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:00.106448Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688620334:2454], now have 1 active actors on pipe
2025-09-30T15:00:00.106583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3402
2025-09-30T15:00:00.106646Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3402
2025-09-30T15:00:00.106679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.106692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.106721Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:00.106734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:00.106738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:00.106746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:00.106758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:00.106784Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:00.106808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:00.107043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.107056Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.107084Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:00.107268Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3403 partition: 0 MaxSeqNo: 42 sessionId: src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0
2025-09-30T15:00:00.107715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9a3f6312-abd476f9-222562e0-18f02083_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:00.111136Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0] Write session: try to update token
2025-09-30T15:00:00.111163Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:00.123520Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:00.123541Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:00.123544Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:00.123546Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:00.123557Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897165598815488:13569]
2025-09-30T15:00:00.123562Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897165598815488:13569]
2025-09-30T15:00:00.123566Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897165598815488:13569]
2025-09-30T15:00:00.123613Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:00.123620Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.123624Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:00.123681Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:00.123693Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:00.123706Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:00.123787Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:00.140867Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3403 sessionId: src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:00.143409Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897165688620587:5444]
2025-09-30T15:00:00.144153Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 1 pipe creation result: OK TabletId: 72075186224037892 Generation: 3402, pipe: [1:7555897165688620587:5444]
2025-09-30T15:00:00.144299Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:00.254571Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:00.255511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688620587:5444], now have 1 active actors on pipe
2025-09-30T15:00:00.255557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.255567Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.260074Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 1 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897165688620587:5444]
2025-09-30T15:00:00.260112Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:00.260153Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:00.260156Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:00.259596Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:00.260230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3403 reason: error at write: Disconnected sessionId: src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0
2025-09-30T15:00:00.261176Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:00.261191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0] Write session will restart in 0.006138s
2025-09-30T15:00:00.261223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0] Write session: Do CDS request
2025-09-30T15:00:00.261229Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:00.260473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3403 sessionId: src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0 is DEAD
2025-09-30T15:00:00.269486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:00.270059Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:00.270084Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3404
2025-09-30T15:00:00.270489Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3404 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:00.270544Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3404 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:00.270550Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3404 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:00.270555Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:00.271132Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3404 sessionId:  describe result for acl check
2025-09-30T15:00:00.271174Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:00.271176Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:00.271178Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:00.271185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897165688620602:5479] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:00.271875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897165688620602:5479] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:00.274789Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897165688620602:5479] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:00.281517Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897165688620602:5479] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:00.281540Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897165688620602:5479] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:00.281545Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897165688620602:5479] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:00.281556Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3404 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:00.303743Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:00.307602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:00.307893Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:00.307898Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:00.307913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:00.307981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:00.308054Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897165598815742:13572]
2025-09-30T15:00:00.308842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:00.309622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:00.309716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:00.310157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:00.310255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.310264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.310266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.310268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.310270Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.310271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.310273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.310275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.310277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.310279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.310281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.310283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.310284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.310286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.310288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.310295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.310306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.310310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.310314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.310318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.310322Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.310326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.310331Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.310335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.310340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.310344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.310348Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.310352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.310356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.310360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.310371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.310381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.310388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.310394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.310400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.310405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.310410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.310416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.310422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.310428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.310433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.310438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.310443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.310449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.310455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.310461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.310467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.310473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.310479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.310485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.310492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.310498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.310503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.310510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.310536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.310543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.310549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.310555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.310560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.310566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.310614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:00.323157Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:00.324863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:00.324888Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:00.324892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:00.324898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:00.324907Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3403 [2:7555897165598815742:13572]
2025-09-30T15:00:00.324931Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:00.324957Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:00.324962Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:00.324966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:00.324967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:00.324988Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:00.324995Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:00.325006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:00.325095Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.325109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.325111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.325114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:00.325118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:00.325211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:00.325219Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.325233Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.325244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.325261Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:00.325297Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897165598815737:13572]
2025-09-30T15:00:00.325299Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897165598815737:13572]
2025-09-30T15:00:00.325301Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897165598815737:13572]
2025-09-30T15:00:00.325311Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:00.325324Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:00.325327Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:00.325331Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:00.325333Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:00.325341Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:00.325345Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:00.325397Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688620589:2454], now have 1 active actors on pipe
2025-09-30T15:00:00.325406Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897165598815737:13572]
2025-09-30T15:00:00.325418Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:00.325424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688620660:5479], now have 1 active actors on pipe
2025-09-30T15:00:00.325432Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:00.325570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3403
2025-09-30T15:00:00.325592Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3403
2025-09-30T15:00:00.325753Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.325775Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.326144Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c88c094e-151c66b7-8203b5c0-8167688f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:00.326162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:00.326166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:00.326170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:00.326185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:00.326199Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:00.326232Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:00.330330Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.330350Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.330408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:00.330600Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3404 partition: 0 MaxSeqNo: 42 sessionId: src_id|c88c094e-151c66b7-8203b5c0-8167688f_0
2025-09-30T15:00:00.331073Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8b758ad5-d63a2001-f0c1751f-4ef74953_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c88c094e-151c66b7-8203b5c0-8167688f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:00.334667Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88c094e-151c66b7-8203b5c0-8167688f_0] Write session: try to update token
2025-09-30T15:00:00.334698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88c094e-151c66b7-8203b5c0-8167688f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:00.339989Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T15:00:00.340012Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:00.340025Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897165598815737:13572]
2025-09-30T15:00:00.340084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T15:00:00.340307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T15:00:00.340503Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:00.340680Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:00.340857Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:00.341100Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T15:00:00.341154Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T15:00:00.341341Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T15:00:00.361357Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:00.361380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:00.361384Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:00.361387Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:00.361400Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897165598815737:13572]
2025-09-30T15:00:00.361405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897165598815737:13572]
2025-09-30T15:00:00.361409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897165598815737:13572]
2025-09-30T15:00:00.361457Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:00.361468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.361472Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:00.361670Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:00.361719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:00.361732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:00.361737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:00.358376Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3404 sessionId: src_id|c88c094e-151c66b7-8203b5c0-8167688f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:00.361790Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897165688620844:5444]
2025-09-30T15:00:00.361880Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:00.362701Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 2 pipe creation result: OK TabletId: 72075186224037892 Generation: 3403, pipe: [1:7555897165688620844:5444]
2025-09-30T15:00:00.508615Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:00.509085Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.509099Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.509124Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688620844:5444], now have 1 active actors on pipe
2025-09-30T15:00:00.509446Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:00.509890Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:00.509950Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T15:00:00.509961Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 2 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897165688620844:5444]
2025-09-30T15:00:00.510053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3404 reason: status is not ok: tablet will be restarted right now sessionId: src_id|c88c094e-151c66b7-8203b5c0-8167688f_0
2025-09-30T15:00:00.510426Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88c094e-151c66b7-8203b5c0-8167688f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T15:00:00.510450Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88c094e-151c66b7-8203b5c0-8167688f_0] Write session will restart in 0.009845s
2025-09-30T15:00:00.510264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3404 sessionId: src_id|c88c094e-151c66b7-8203b5c0-8167688f_0 is DEAD
2025-09-30T15:00:00.510480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88c094e-151c66b7-8203b5c0-8167688f_0] Write session: Do CDS request
2025-09-30T15:00:00.510487Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88c094e-151c66b7-8203b5c0-8167688f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:00.522856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c88c094e-151c66b7-8203b5c0-8167688f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:00.523028Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:00.523052Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3405
2025-09-30T15:00:00.523286Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3405 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:00.523340Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3405 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:00.523347Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3405 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:00.523353Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:00.524217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3405 sessionId:  describe result for acl check
2025-09-30T15:00:00.524269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:00.524272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:00.524274Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:00.524287Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897165688620869:5496] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:00.524970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897165688620869:5496] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:00.528967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897165688620869:5496] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:00.533574Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897165688620869:5496] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:00.533596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897165688620869:5496] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:00.533601Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897165688620869:5496] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:00.533610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3405 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:00.553888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:00.557545Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:00.557852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:00.557865Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:00.557876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:00.557944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:00.558006Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897165598815992:13574]
2025-09-30T15:00:00.558731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:00.559532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:00.559602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:00.560002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:00.560106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.560108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.560110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.560111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.560113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.560114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.560115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.560117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.560119Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.560120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.560122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.560123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.560125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.560126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.560128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.560136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.560147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.560151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.560156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.560161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.560165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.560169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.560173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.560177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.560182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.560185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.560188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.560190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.560193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.560195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.560204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.560213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.560220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.560225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.560231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.560236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.560241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.560246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.560251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.560256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.560261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.560267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.560276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.560282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.560287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.560292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.560298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.560303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.560307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.560312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.560318Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.560323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.560328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.560334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.560339Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.560345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.560349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.560355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.560365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.560386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.560439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:00.571225Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3404
2025-09-30T15:00:00.571285Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3404
2025-09-30T15:00:00.568935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:00.570616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:00.570627Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:00.570630Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:00.570634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:00.570642Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3404 [2:7555897165598815992:13574]
2025-09-30T15:00:00.570662Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:00.570681Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:00.570686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:00.570688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:00.570691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:00.570710Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:00.570718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:00.570725Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:00.570809Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.570811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.570813Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.570817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:00.570820Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:00.570905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:00.570908Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.570925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.570935Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.570952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:00.570972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897165598815987:13574]
2025-09-30T15:00:00.570975Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897165598815987:13574]
2025-09-30T15:00:00.570978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897165598815987:13574]
2025-09-30T15:00:00.570990Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:00.571006Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:00.571006Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:00.571010Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:00.571013Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:00.571024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:00.571027Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:00.571038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688620904:5496], now have 1 active actors on pipe
2025-09-30T15:00:00.571042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688620855:2454], now have 1 active actors on pipe
2025-09-30T15:00:00.571080Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897165598815987:13574]
2025-09-30T15:00:00.571090Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:00.571224Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:00.573249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.573273Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.573331Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:00.573349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:00.573354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:00.573357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:00.573373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:00.573391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:00.573416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:00.573939Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.573953Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.573990Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:00.575191Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3405 partition: 0 MaxSeqNo: 42 sessionId: src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0
2025-09-30T15:00:00.579409Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c88c094e-151c66b7-8203b5c0-8167688f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:00.583065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0] Write session: try to update token
2025-09-30T15:00:00.583095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:00.595701Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:00.595721Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:00.595724Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:00.595726Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:00.595738Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897165598815987:13574]
2025-09-30T15:00:00.595743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897165598815987:13574]
2025-09-30T15:00:00.595748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897165598815987:13574]
2025-09-30T15:00:00.595797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:00.595807Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.595811Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:00.595996Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:00.597480Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:00.597489Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:00.597494Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:00.610062Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897165688621112:5444]
2025-09-30T15:00:00.610679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 3 pipe creation result: OK TabletId: 72075186224037892 Generation: 3404, pipe: [1:7555897165688621112:5444]
2025-09-30T15:00:00.627589Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3405 sessionId: src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:00.631029Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:00.721672Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:00.722219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688621112:5444], now have 1 active actors on pipe
2025-09-30T15:00:00.722284Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.722293Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.722705Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:00.723098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:00.723118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:00.723186Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:00.723235Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 3 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897165688621112:5444]
2025-09-30T15:00:00.723396Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3405 reason: error at write: Disconnected sessionId: src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0
2025-09-30T15:00:00.723607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3405 sessionId: src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0 is DEAD
2025-09-30T15:00:00.724078Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:00.724096Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0] Write session will restart in 0.008549s
2025-09-30T15:00:00.724142Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0] Write session: Do CDS request
2025-09-30T15:00:00.724152Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:00.733940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:00.734058Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:00.734080Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3406
2025-09-30T15:00:00.734278Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3406 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:00.734322Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3406 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:00.734329Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3406 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:00.734334Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:00.735276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3406 sessionId:  describe result for acl check
2025-09-30T15:00:00.735322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:00.735324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:00.735327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:00.735334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897165688621136:5505] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:00.735954Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897165688621136:5505] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:00.743662Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897165688621136:5505] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:00.747994Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897165688621136:5505] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:00.748019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897165688621136:5505] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:00.748024Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897165688621136:5505] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:00.748035Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3406 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:00.764297Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:00.767878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:00.768156Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:00.768170Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:00.768183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:00.768260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:00.768309Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897165598816255:13578]
2025-09-30T15:00:00.769028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:00.769466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:00.769526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:00.769881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:00.769971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.769972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.769974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.769976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.769977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.769978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.769979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.769981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.769982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.769984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.769986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.769987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.769989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.769990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.769992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.769998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.770008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.770012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.770016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.770020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.770025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.770030Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.770034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.770038Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.770042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.770046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.770050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.770053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.770057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.770061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.770073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.770082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.770088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.770093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.770098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.770103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.770109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.770115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.770121Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.770126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.770131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.770136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.770142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.770148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.770152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.770159Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.770164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.770169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.770174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.770200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.770206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.770212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.770217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.770222Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.770227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.770232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.770236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.770242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.770248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.770253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.770302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:00.777564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:00.778847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:00.778866Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:00.778870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:00.778875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:00.778883Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3405 [2:7555897165598816255:13578]
2025-09-30T15:00:00.778903Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:00.778924Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:00.778927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:00.778930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:00.778932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:00.778954Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:00.778967Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:00.778974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:00.779060Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.779070Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.779073Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.779077Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:00.779080Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:00.779162Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:00.779171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.779187Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.779198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.779217Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:00.779240Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897165598816250:13578]
2025-09-30T15:00:00.779265Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897165598816250:13578]
2025-09-30T15:00:00.779267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897165598816250:13578]
2025-09-30T15:00:00.779284Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:00.779301Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688621213:5505], now have 1 active actors on pipe
2025-09-30T15:00:00.779309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688621114:2454], now have 1 active actors on pipe
2025-09-30T15:00:00.779309Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:00.779312Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:00.779315Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:00.779314Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:00.779331Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:00.779335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:00.779415Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897165598816250:13578]
2025-09-30T15:00:00.779427Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:00.779490Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:00.779495Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3405
2025-09-30T15:00:00.779615Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3405
2025-09-30T15:00:00.779709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.779724Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.779758Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:00.779768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:00.779773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:00.779775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:00.779788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:00.779802Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:00.779822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:00.780174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.780188Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.780213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:00.780385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3406 partition: 0 MaxSeqNo: 42 sessionId: src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0
2025-09-30T15:00:00.780805Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cdb81e10-94deb943-807b5fff-a37c0bbd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:00.784267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0] Write session: try to update token
2025-09-30T15:00:00.784294Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:00.795752Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:00.795776Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:00.795780Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:00.795783Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:00.795795Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897165598816250:13578]
2025-09-30T15:00:00.795801Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897165598816250:13578]
2025-09-30T15:00:00.795807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897165598816250:13578]
2025-09-30T15:00:00.795858Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:00.795868Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.795872Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:00.795933Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:00.795954Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:00.795960Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:00.796077Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:00.804923Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3406 sessionId: src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:00.808194Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:00.824176Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897165688621372:5444]
2025-09-30T15:00:00.824664Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 4 pipe creation result: OK TabletId: 72075186224037892 Generation: 3405, pipe: [1:7555897165688621372:5444]
2025-09-30T15:00:00.919802Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:00.920213Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.920225Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.920249Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688621372:5444], now have 1 active actors on pipe
2025-09-30T15:00:00.920543Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:00.920692Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 4 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897165688621372:5444]
2025-09-30T15:00:00.920705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:00.920710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:00.920757Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:00.920781Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3406 reason: error at write: Disconnected sessionId: src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0
2025-09-30T15:00:00.920973Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3406 sessionId: src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0 is DEAD
2025-09-30T15:00:00.921174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:00.921188Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0] Write session will restart in 0.009771s
2025-09-30T15:00:00.921230Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0] Write session: Do CDS request
2025-09-30T15:00:00.921241Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:00.932138Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:00.932838Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:00.932860Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3407
2025-09-30T15:00:00.934996Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3407 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:00.935081Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3407 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:00.935088Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3407 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:00.935095Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:00.936072Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3407 sessionId:  describe result for acl check
2025-09-30T15:00:00.936128Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:00.936136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:00.936138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:00.936144Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897165688621399:6320] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:00.936822Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897165688621399:6320] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:00.945069Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897165688621399:6320] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:00.954097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897165688621399:6320] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:00.954116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897165688621399:6320] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:00.954119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897165688621399:6320] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:00.954128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3407 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:00.968067Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:00.973948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:00.974217Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:00.974231Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:00.974242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:00.974300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:00.974339Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897165598816518:13580]
2025-09-30T15:00:00.975127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:00.975558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:00.975609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:00.975980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:00.976036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.976043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.976045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.976046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.976047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.976048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.976050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.976051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.976052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.976054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.976055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.976056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.976058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.976059Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.976060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.976066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.976076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.976080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.976085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.976089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.976093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.976096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.976101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.976105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.976109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.976113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.976117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.976120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.976125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.976128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.976136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.976143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:00.976149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.976155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:00.976160Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.976166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:00.976171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.976176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:00.976181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.976187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:00.976192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.976197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:00.976203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.976208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:00.976213Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.976217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:00.976225Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.976230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:00.976236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.976242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:00.976246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.976264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.976268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.976274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.976279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.976284Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.976288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.976293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:00.976297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.976303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:00.976352Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:00.990067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:00.991625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:00.991646Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:00.991649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:00.991653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:00.991661Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3406 [2:7555897165598816518:13580]
2025-09-30T15:00:00.991679Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:00.991697Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:00.991701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:00.991705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:00.991707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:00.991727Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:00.991735Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:00.991742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:00.991832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.991842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.991844Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.991848Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:00.991850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:00.991942Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:00.991951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:00.991967Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:00.991983Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:00.992003Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:00.992027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897165598816513:13580]
2025-09-30T15:00:00.992034Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897165598816513:13580]
2025-09-30T15:00:00.992036Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897165598816513:13580]
2025-09-30T15:00:00.992053Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:00.992084Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:00.992104Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:00.992112Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:00.992129Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:00.992148Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:00.992151Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:00.992158Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897165598816513:13580]
2025-09-30T15:00:00.992167Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:00.992253Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:00.992429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688621527:6320], now have 1 active actors on pipe
2025-09-30T15:00:00.992446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897165688621376:2454], now have 1 active actors on pipe
2025-09-30T15:00:00.993158Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3406
2025-09-30T15:00:00.993200Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3406
2025-09-30T15:00:00.995110Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ead6c6ba-3709cb7f-6b0e9c10-82e65c67_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:00.993561Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.993576Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.993609Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:00.993624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:00.993628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:00.993631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:00.993652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:00.993668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:00.993685Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:00.994214Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:00.994221Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:00.994248Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:00.994660Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3407 partition: 0 MaxSeqNo: 42 sessionId: src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0
2025-09-30T15:00:00.998639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0] Write session: try to update token
2025-09-30T15:00:00.998662Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:01.013020Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:01.013044Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:01.013048Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:01.013050Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:01.013063Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897165598816513:13580]
2025-09-30T15:00:01.013068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897165598816513:13580]
2025-09-30T15:00:01.013072Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897165598816513:13580]
2025-09-30T15:00:01.013126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:01.013136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.013139Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:01.013142Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:01.013152Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:01.013157Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:01.013312Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:01.023441Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897169983588959:5444]
2025-09-30T15:00:01.023769Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 5 pipe creation result: OK TabletId: 72075186224037892 Generation: 3406, pipe: [1:7555897169983588959:5444]
2025-09-30T15:00:01.035080Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3407 sessionId: src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:01.038632Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:01.189459Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:01.189854Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897169983588959:5444], now have 1 active actors on pipe
2025-09-30T15:00:01.189894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:01.189904Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:01.195626Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:01.195648Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:01.195687Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 5 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897169983588959:5444]
2025-09-30T15:00:01.195706Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:01.195739Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3407 reason: error at write: Disconnected sessionId: src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0
2025-09-30T15:00:01.196095Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:01.196108Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0] Write session will restart in 0.006866s
2025-09-30T15:00:01.196134Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0] Write session: Do CDS request
2025-09-30T15:00:01.196141Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:01.195934Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3407 sessionId: src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0 is DEAD
2025-09-30T15:00:01.195670Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:01.203854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:01.207517Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:01.207544Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3408
2025-09-30T15:00:01.209182Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3408 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:01.209260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3408 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:01.209272Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3408 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:01.209278Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:01.210016Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3408 sessionId:  describe result for acl check
2025-09-30T15:00:01.210072Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:01.210083Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:01.210085Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:01.210091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897169983588984:5517] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:01.210832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897169983588984:5517] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:01.213854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897169983588984:5517] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:01.218113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897169983588984:5517] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:01.218136Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897169983588984:5517] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:01.218140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897169983588984:5517] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:01.218151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3408 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:01.243915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:01.245234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:01.245475Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:01.245481Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:01.245494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:01.245559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:01.245602Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897169893784094:13594]
2025-09-30T15:00:01.246306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:01.249028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:01.249114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:01.249526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:01.249624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.249633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.249634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.249635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.249637Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.249639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.249641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.249642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.249644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.249646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.249647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.249649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.249650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.249651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.249653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.249661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.249672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.249677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.249681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.249685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.249690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.249694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.249699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.249703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.249708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.249713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.249716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.249719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.249724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.249728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.249738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.249748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.249754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.249759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.249766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.249772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.249776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.249781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.249786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.249792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.249796Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.249801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.249807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.249811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.249816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.249821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.249827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.249832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.249837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.249842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.249847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.249853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.249859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.249875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.249880Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.249885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.249890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.249895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.249901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.249907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.249956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:01.256959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:01.258349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:01.258372Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:01.258375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:01.258380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:01.258388Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3407 [2:7555897169893784094:13594]
2025-09-30T15:00:01.258407Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:01.258425Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:01.258429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:01.258432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:01.258434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:01.258451Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:01.258459Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:01.258468Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:01.258542Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.258557Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.258559Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.258562Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:01.258565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:01.258654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:01.258669Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.258685Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.258702Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.258722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:01.258743Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897169893784089:13594]
2025-09-30T15:00:01.258750Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897169893784089:13594]
2025-09-30T15:00:01.258753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897169893784089:13594]
2025-09-30T15:00:01.258771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:01.258795Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:01.258816Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:01.258824Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:01.258867Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897169893784089:13594]
2025-09-30T15:00:01.258878Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:01.258884Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:01.258887Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:01.258890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:01.258896Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:01.258903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897169983589022:5517], now have 1 active actors on pipe
2025-09-30T15:00:01.259102Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3407
2025-09-30T15:00:01.259111Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897169983588975:2454], now have 1 active actors on pipe
2025-09-30T15:00:01.259290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3407
2025-09-30T15:00:01.259433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:01.259450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:01.259485Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:01.259496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:01.259501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:01.259505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:01.259518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:01.259537Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:01.259558Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:01.259836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:01.259845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:01.259866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:01.260179Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3408 partition: 0 MaxSeqNo: 42 sessionId: src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0
2025-09-30T15:00:01.260620Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1cebac93-1c69a4cf-43f88f62-7e8889ba_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:01.263911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0] Write session: try to update token
2025-09-30T15:00:01.263939Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:01.274361Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:01.274385Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:01.274388Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:01.274390Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:01.274402Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897169893784089:13594]
2025-09-30T15:00:01.274407Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897169893784089:13594]
2025-09-30T15:00:01.274413Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897169893784089:13594]
2025-09-30T15:00:01.274468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:01.274477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.274486Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:01.274491Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:01.274495Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:01.274500Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:01.274655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:01.284928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3408 sessionId: src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:01.288352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:01.296033Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897169983589234:5444]
2025-09-30T15:00:01.296386Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 6 pipe creation result: OK TabletId: 72075186224037892 Generation: 3407, pipe: [1:7555897169983589234:5444]
2025-09-30T15:00:01.395200Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:01.395580Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:01.395599Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:01.395622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897169983589234:5444], now have 1 active actors on pipe
2025-09-30T15:00:01.396060Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:01.396153Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:01.396229Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 6 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897169983589234:5444]
2025-09-30T15:00:01.396263Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:01.396267Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:01.396350Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3408 reason: error at write: Disconnected sessionId: src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0
2025-09-30T15:00:01.396620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3408 sessionId: src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0 is DEAD
2025-09-30T15:00:01.396785Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:01.396796Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0] Write session will restart in 0.006641s
2025-09-30T15:00:01.396825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0] Write session: Do CDS request
2025-09-30T15:00:01.396833Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:01.405049Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:01.405099Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:01.405120Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3409
2025-09-30T15:00:01.407703Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3409 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:01.407768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3409 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:01.407776Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3409 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:01.407782Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:01.408381Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3409 sessionId:  describe result for acl check
2025-09-30T15:00:01.408424Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:01.408430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:01.408432Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:01.408439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897169983589260:5527] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:01.409090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897169983589260:5527] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:01.416246Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897169983589260:5527] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:01.426113Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897169983589260:5527] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:01.426137Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897169983589260:5527] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:01.426141Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897169983589260:5527] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:01.426151Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3409 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:01.442512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:01.446507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:01.446797Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:01.446810Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:01.446827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:01.446909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:01.446963Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897169893784346:13597]
2025-09-30T15:00:01.447672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:01.448325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:01.448420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:01.448859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:01.449062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.449073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.449074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.449076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.449077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.449078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.449080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.449081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.449082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.449083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.449085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.449086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.449087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.449089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.449090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.449100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.449120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.449125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.449130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.449135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.449140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.449144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.449148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.449153Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.449161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.449166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.449170Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.449174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.449178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.449182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.449193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.449203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.449212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.449219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.449224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.449231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.449237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.449250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.449256Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.449268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.449274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.449280Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.449286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.449303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.449314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.449320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.449335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.449345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.449351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.449362Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.449368Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.449379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.449384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.449396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.449407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.449413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.449423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.449428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.449436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.449442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.449493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:01.458490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:01.460040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:01.460060Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:01.460063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:01.460067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:01.460074Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3408 [2:7555897169893784346:13597]
2025-09-30T15:00:01.460094Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:01.460114Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:01.460117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:01.460120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:01.460122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:01.460142Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:01.460149Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:01.460156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:01.460235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.460245Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.460248Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.460251Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:01.460254Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:01.460540Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:01.460551Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.460566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.460579Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.460598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:01.460608Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897169983589386:5527], now have 1 active actors on pipe
2025-09-30T15:00:01.460612Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897169983589244:2454], now have 1 active actors on pipe
2025-09-30T15:00:01.460634Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897169893784341:13597]
2025-09-30T15:00:01.460638Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897169893784341:13597]
2025-09-30T15:00:01.460641Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897169893784341:13597]
2025-09-30T15:00:01.460656Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:01.460671Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:01.460678Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:01.460681Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:01.460683Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:01.460687Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:01.460690Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:01.460732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897169893784341:13597]
2025-09-30T15:00:01.460738Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:01.460671Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3408
2025-09-30T15:00:01.460737Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3408
2025-09-30T15:00:01.460847Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:01.461038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:01.461052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:01.461084Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:01.461092Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:01.461096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:01.461099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:01.461111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:01.461132Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:01.461151Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:01.461862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:01.461878Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:01.461906Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:01.462057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3409 partition: 0 MaxSeqNo: 42 sessionId: src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0
2025-09-30T15:00:01.463716Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|7c369022-c3dd199-1b6d4737-bb9a8817_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:01.476389Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0] Write session: try to update token
2025-09-30T15:00:01.476424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:01.481914Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:01.481937Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:01.481941Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:01.481943Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:01.481954Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897169893784341:13597]
2025-09-30T15:00:01.481958Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897169893784341:13597]
2025-09-30T15:00:01.481968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897169893784341:13597]
2025-09-30T15:00:01.482027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:01.482036Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.482038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:01.482064Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:01.482074Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:01.482079Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:01.482222Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:01.499384Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897169983589508:5444]
2025-09-30T15:00:01.499837Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 7 pipe creation result: OK TabletId: 72075186224037892 Generation: 3408, pipe: [1:7555897169983589508:5444]
2025-09-30T15:00:01.511473Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3409 sessionId: src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:01.516743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:01.608078Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:01.608783Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897169983589508:5444], now have 1 active actors on pipe
2025-09-30T15:00:01.608819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:01.608828Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:01.609195Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:01.609811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:01.609825Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0] Write session will restart in 0.006926s
2025-09-30T15:00:01.609861Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0] Write session: Do CDS request
2025-09-30T15:00:01.609869Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:01.609263Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 7 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897169983589508:5444]
2025-09-30T15:00:01.609300Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:01.609311Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:01.609316Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:01.609401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3409 reason: error at write: Disconnected sessionId: src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0
2025-09-30T15:00:01.609607Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3409 sessionId: src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0 is DEAD
2025-09-30T15:00:01.617884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:01.619432Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:01.619466Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3410
2025-09-30T15:00:01.620743Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3410 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:01.620806Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3410 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:01.620818Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3410 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:01.620824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:01.621338Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3410 sessionId:  describe result for acl check
2025-09-30T15:00:01.621370Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:01.621373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:01.621375Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:01.621382Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897169983589527:5533] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:01.622139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897169983589527:5533] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:01.626738Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897169983589527:5533] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:01.630773Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897169983589527:5533] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:01.630795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897169983589527:5533] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:01.630799Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897169983589527:5533] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:01.630808Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3410 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:01.637845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:01.641379Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:01.641681Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:01.641687Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:01.641701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:01.641774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:01.641845Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897169893784599:13599]
2025-09-30T15:00:01.642538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:01.643166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:01.643236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:01.643646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:01.643739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.643745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.643746Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.643748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.643749Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.643751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.643753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.643754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.643756Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.643757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.643759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.643760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.643762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.643763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.643764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.643770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.643781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.643784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.643789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.643794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.643799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.643804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.643808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.643813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.643818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.643823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.643827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.643832Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.643837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.643852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.643862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.643873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.643885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.643895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.643902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.643911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.643921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.643927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.643937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.643942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.643948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.643953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.643958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.643964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.643973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.643979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.643988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.643995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.644003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.644010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.644016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.644026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.644031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.644040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.644047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.644056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.644063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.644070Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.644079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.644084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.644132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:01.650247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:01.652112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:01.652130Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:01.652133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:01.652138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:01.652145Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3409 [2:7555897169893784599:13599]
2025-09-30T15:00:01.652163Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:01.652180Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:01.652185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:01.652189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:01.652192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:01.652210Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:01.652219Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:01.652228Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:01.652300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.652310Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.652313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.652317Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:01.652320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:01.652427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:01.652439Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.652454Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.652469Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.652489Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:01.652513Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897169893784594:13599]
2025-09-30T15:00:01.652521Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897169893784594:13599]
2025-09-30T15:00:01.652524Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897169893784594:13599]
2025-09-30T15:00:01.652540Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:01.652556Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:01.652578Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:01.652586Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:01.652631Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897169893784594:13599]
2025-09-30T15:00:01.652642Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:01.652657Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:01.652663Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:01.652666Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:01.652672Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:01.652951Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897169983589670:5533], now have 1 active actors on pipe
2025-09-30T15:00:01.652971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897169983589511:2454], now have 1 active actors on pipe
2025-09-30T15:00:01.653193Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3409
2025-09-30T15:00:01.653249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3409
2025-09-30T15:00:01.653469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:01.653486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:01.653522Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|13a5b044-9249602f-f9a20b1-890b7a67_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:01.653533Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:01.653544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:01.653546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:01.653560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:01.653575Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:01.653601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:01.653992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:01.654016Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:01.654038Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:01.654169Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3410 partition: 0 MaxSeqNo: 42 sessionId: src_id|13a5b044-9249602f-f9a20b1-890b7a67_0
2025-09-30T15:00:01.654642Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|c4f3ec4e-c98a8e7f-cbf4b895-6b476a29_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|13a5b044-9249602f-f9a20b1-890b7a67_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:01.657893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a5b044-9249602f-f9a20b1-890b7a67_0] Write session: try to update token
2025-09-30T15:00:01.657921Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a5b044-9249602f-f9a20b1-890b7a67_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:01.670851Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T15:00:01.670877Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:01.670889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897169893784594:13599]
2025-09-30T15:00:01.670947Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T15:00:01.671150Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T15:00:01.671375Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:01.671551Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:01.671732Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:01.671968Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T15:00:01.672016Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T15:00:01.675360Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T15:00:01.685393Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:01.685420Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:01.685423Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:01.685425Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:01.685438Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897169893784594:13599]
2025-09-30T15:00:01.685448Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897169893784594:13599]
2025-09-30T15:00:01.685453Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897169893784594:13599]
2025-09-30T15:00:01.685506Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:01.685515Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.685518Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:01.685603Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:01.685613Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:01.685618Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:01.685688Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:01.690069Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3410 sessionId: src_id|13a5b044-9249602f-f9a20b1-890b7a67_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:01.695503Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:01.709321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897169983589772:5444]
2025-09-30T15:00:01.709858Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 8 pipe creation result: OK TabletId: 72075186224037892 Generation: 3409, pipe: [1:7555897169983589772:5444]
2025-09-30T15:00:01.879281Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:01.879740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:01.879759Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:01.879781Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897169983589772:5444], now have 1 active actors on pipe
2025-09-30T15:00:01.880035Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:01.880176Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:01.880200Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:01.880200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 8 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897169983589772:5444]
2025-09-30T15:00:01.880240Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:01.880266Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3410 reason: error at write: Disconnected sessionId: src_id|13a5b044-9249602f-f9a20b1-890b7a67_0
2025-09-30T15:00:01.880689Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a5b044-9249602f-f9a20b1-890b7a67_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:01.880701Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a5b044-9249602f-f9a20b1-890b7a67_0] Write session will restart in 0.006914s
2025-09-30T15:00:01.880728Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a5b044-9249602f-f9a20b1-890b7a67_0] Write session: Do CDS request
2025-09-30T15:00:01.880740Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a5b044-9249602f-f9a20b1-890b7a67_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:01.880502Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3410 sessionId: src_id|13a5b044-9249602f-f9a20b1-890b7a67_0 is DEAD
2025-09-30T15:00:01.888838Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|13a5b044-9249602f-f9a20b1-890b7a67_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:01.895164Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:01.895188Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3411
2025-09-30T15:00:01.898675Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3411 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:01.898740Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3411 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:01.898746Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3411 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:01.898752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:01.899489Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3411 sessionId:  describe result for acl check
2025-09-30T15:00:01.899535Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:01.899546Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:01.899550Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:01.899556Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897169983589835:5548] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:01.900171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897169983589835:5548] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:01.906965Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897169983589835:5548] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:01.912967Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897169983589835:5548] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:01.912993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897169983589835:5548] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:01.912998Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897169983589835:5548] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:01.913009Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3411 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:01.916792Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:01.920917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:01.921203Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:01.921215Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:01.921229Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:01.921307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:01.921365Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897169893784869:13603]
2025-09-30T15:00:01.922167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:01.922666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:01.922745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:01.923185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:01.923295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.923307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.923308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.923309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.923311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.923312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.923314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.923316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.923317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.923319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.923320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.923321Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.923323Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.923325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.923326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.923334Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.923356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.923361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.923366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.923371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.923375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.923380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.923386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.923390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.923395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.923400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.923404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.923408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.923412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.923417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.923426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.923438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:01.923446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.923453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:01.923459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.923465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:01.923471Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.923477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:01.923483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.923488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:01.923493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.923500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:01.923507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.923512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:01.923517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.923523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:01.923530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.923545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:01.923550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.923557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:01.923562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.923568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.923574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.923580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.923586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.923592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.923597Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.923603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:01.923609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.923616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:01.923666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:01.930667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:01.932150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:01.932171Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:01.932174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:01.932178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:01.932190Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3410 [2:7555897169893784869:13603]
2025-09-30T15:00:01.932207Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:01.932226Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:01.932230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:01.932234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:01.932237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:01.932257Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:01.932264Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:01.932272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:01.932350Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.932361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.932376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.932380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:01.932383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:01.932468Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:01.932478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.932494Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:01.932510Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:01.932533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:01.932559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897169983590026:5548], now have 1 active actors on pipe
2025-09-30T15:00:01.932572Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897169893784864:13603]
2025-09-30T15:00:01.932574Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897169893784864:13603]
2025-09-30T15:00:01.932577Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897169893784864:13603]
2025-09-30T15:00:01.932595Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:01.932611Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897169983589780:2454], now have 1 active actors on pipe
2025-09-30T15:00:01.932622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:01.932623Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:01.932629Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:01.932632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:01.932641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:01.932644Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:01.932685Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897169893784864:13603]
2025-09-30T15:00:01.932698Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:01.932707Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:01.932881Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3410
2025-09-30T15:00:01.932929Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3410
2025-09-30T15:00:01.933068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:01.933088Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:01.933132Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4f0808f-6afe567e-d0524c8e-368e6719_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:01.933147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:01.933151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:01.933154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:01.933166Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:01.933179Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:01.933196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:01.933432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:01.933455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:01.933622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3411 partition: 0 MaxSeqNo: 42 sessionId: src_id|4f0808f-6afe567e-d0524c8e-368e6719_0
2025-09-30T15:00:01.934056Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|13a5b044-9249602f-f9a20b1-890b7a67_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4f0808f-6afe567e-d0524c8e-368e6719_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:01.933481Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:01.937109Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0808f-6afe567e-d0524c8e-368e6719_0] Write session: try to update token
2025-09-30T15:00:01.937131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0808f-6afe567e-d0524c8e-368e6719_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:01.946625Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T15:00:01.946648Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:01.946658Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897169893784864:13603]
2025-09-30T15:00:01.946706Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T15:00:01.946718Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T15:00:01.946972Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T15:00:01.947147Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:01.947386Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:01.947634Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:01.948067Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T15:00:01.948144Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T15:00:01.957753Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3411 sessionId: src_id|4f0808f-6afe567e-d0524c8e-368e6719_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:01.960096Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:01.960116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:01.960120Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:01.960122Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:01.960133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897169893784864:13603]
2025-09-30T15:00:01.960138Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897169893784864:13603]
2025-09-30T15:00:01.960144Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897169893784864:13603]
2025-09-30T15:00:01.960192Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:01.960200Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:01.960203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:01.960990Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:01.960355Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:01.961291Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:01.961297Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:01.961305Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:01.980582Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897169983590042:5444]
2025-09-30T15:00:01.980896Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 9 pipe creation result: OK TabletId: 72075186224037892 Generation: 3410, pipe: [1:7555897169983590042:5444]
2025-09-30T15:00:02.078057Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:02.078740Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.078762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.078785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897169983590042:5444], now have 1 active actors on pipe
2025-09-30T15:00:02.079118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:02.079135Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:02.079200Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 9 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897169983590042:5444]
2025-09-30T15:00:02.079211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3411 reason: error at write: Disconnected sessionId: src_id|4f0808f-6afe567e-d0524c8e-368e6719_0
2025-09-30T15:00:02.079228Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:02.079673Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0808f-6afe567e-d0524c8e-368e6719_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:02.079685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0808f-6afe567e-d0524c8e-368e6719_0] Write session will restart in 0.007305s
2025-09-30T15:00:02.079709Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0808f-6afe567e-d0524c8e-368e6719_0] Write session: Do CDS request
2025-09-30T15:00:02.079715Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0808f-6afe567e-d0524c8e-368e6719_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:02.079019Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:02.079411Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3411 sessionId: src_id|4f0808f-6afe567e-d0524c8e-368e6719_0 is DEAD
2025-09-30T15:00:02.089285Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0808f-6afe567e-d0524c8e-368e6719_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:02.089361Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:02.089388Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3412
2025-09-30T15:00:02.089814Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3412 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:02.089867Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3412 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:02.089875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3412 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:02.089879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:02.091659Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3412 sessionId:  describe result for acl check
2025-09-30T15:00:02.091716Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:02.091720Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:02.091722Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:02.091729Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897174278557361:5561] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:02.092439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897174278557361:5561] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:02.094946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897174278557361:5561] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:02.100119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897174278557361:5561] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:02.100140Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897174278557361:5561] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:02.100147Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897174278557361:5561] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:02.100158Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3412 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:02.145736Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:02.147104Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:02.147352Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:02.147365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:02.147377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:02.147450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:02.147497Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897174188752449:13611]
2025-09-30T15:00:02.148165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:02.150761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:02.150858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:02.151328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:02.151438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.151445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.151446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.151447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.151449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.151450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.151451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.151453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.151454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.151455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.151457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.151458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.151472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.151474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.151475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.151484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.151494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.151498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.151501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.151505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.151510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.151514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.151518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.151522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.151527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.151530Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.151535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.151539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.151543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.151547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.151557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.151566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.151574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.151579Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.151586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.151602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.151608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.151614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.151619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.151624Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.151629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.151635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.151640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.151645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.151655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.151660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.151665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.151671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.151676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.151682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.151687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.151694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.151698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.151703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.151707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.151711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.151715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.151719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.151724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.151730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.151773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:02.161737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:02.162906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:02.162931Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:02.162934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:02.162938Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:02.162945Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3411 [2:7555897174188752449:13611]
2025-09-30T15:00:02.162964Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:02.162981Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:02.162985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:02.162988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:02.162990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:02.163009Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:02.163023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:02.163031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:02.163104Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.163114Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.163117Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.163121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:02.163123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:02.163203Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:02.163211Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.163227Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.163238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.163275Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:02.163298Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278557403:5561], now have 1 active actors on pipe
2025-09-30T15:00:02.163302Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278557353:2454], now have 1 active actors on pipe
2025-09-30T15:00:02.163308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897174188752444:13611]
2025-09-30T15:00:02.163311Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897174188752444:13611]
2025-09-30T15:00:02.163313Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897174188752444:13611]
2025-09-30T15:00:02.163322Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:02.163339Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:02.163347Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:02.163352Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:02.163354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:02.163354Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:02.163358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:02.163397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897174188752444:13611]
2025-09-30T15:00:02.163415Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:02.163439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.163449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.163473Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:02.163502Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:02.163510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:02.163514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:02.163517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:02.163528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:02.163540Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:02.163568Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:02.163349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3411
2025-09-30T15:00:02.163387Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3411
2025-09-30T15:00:02.164076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.164098Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.164133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:02.164514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3412 partition: 0 MaxSeqNo: 42 sessionId: src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0
2025-09-30T15:00:02.164945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4f0808f-6afe567e-d0524c8e-368e6719_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:02.168282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0] Write session: try to update token
2025-09-30T15:00:02.168307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:02.178006Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:02.178030Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:02.178033Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:02.178035Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:02.178046Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897174188752444:13611]
2025-09-30T15:00:02.178052Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897174188752444:13611]
2025-09-30T15:00:02.178056Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897174188752444:13611]
2025-09-30T15:00:02.178116Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:02.178123Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:02.178123Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:02.178127Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:02.178130Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.178133Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:02.178297Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:02.178774Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897174278557640:5444]
2025-09-30T15:00:02.180214Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 10 pipe creation result: OK TabletId: 72075186224037892 Generation: 3411, pipe: [1:7555897174278557640:5444]
2025-09-30T15:00:02.196232Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3412 sessionId: src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:02.200552Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:02.305783Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:02.306362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278557640:5444], now have 1 active actors on pipe
2025-09-30T15:00:02.306436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.306451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.306767Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:02.306924Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:02.306948Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:02.306951Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 10 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897174278557640:5444]
2025-09-30T15:00:02.306971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:02.307026Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3412 reason: error at write: Disconnected sessionId: src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0
2025-09-30T15:00:02.307222Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3412 sessionId: src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0 is DEAD
2025-09-30T15:00:02.307633Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:02.307646Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0] Write session will restart in 0.008151s
2025-09-30T15:00:02.307683Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0] Write session: Do CDS request
2025-09-30T15:00:02.307694Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:02.316823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:02.318057Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:02.318078Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3413
2025-09-30T15:00:02.318271Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3413 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:02.318331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3413 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:02.318343Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3413 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:02.318349Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:02.318872Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3413 sessionId:  describe result for acl check
2025-09-30T15:00:02.318917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:02.318919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:02.318921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:02.318927Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897174278557655:5575] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:02.319449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897174278557655:5575] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:02.324440Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897174278557655:5575] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:02.333541Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897174278557655:5575] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:02.333566Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897174278557655:5575] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:02.333570Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897174278557655:5575] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:02.333581Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3413 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:02.346441Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:02.349591Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:02.349860Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:02.349872Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:02.349885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:02.349949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:02.350003Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897174188752714:13620]
2025-09-30T15:00:02.350687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:02.351193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:02.351302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:02.351712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:02.351806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.351814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.351815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.351816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.351818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.351820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.351822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.351823Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.351825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.351826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.351828Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.351830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.351831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.351833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.351834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.351853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.351863Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.351868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.351872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.351876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.351879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.351883Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.351887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.351891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.351897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.351901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.351905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.351909Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.351913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.351916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.351927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.351941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.351948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.351953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.351959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.351969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.351975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.351985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.351994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.352000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.352005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.352010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.352016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.352021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.352026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.352031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.352036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.352047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.352052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.352063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.352068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.352078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.352084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.352093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.352099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.352110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.352115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.352131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.352141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.352146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.352196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:02.359359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:02.360807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:02.360830Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:02.360833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:02.360838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:02.360846Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3412 [2:7555897174188752714:13620]
2025-09-30T15:00:02.360870Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:02.360891Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:02.360895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:02.360898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:02.360900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:02.360919Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:02.360928Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:02.360935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:02.361011Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.361021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.361023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.361027Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:02.361030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:02.361111Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:02.361120Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.361136Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.361151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.361170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:02.361189Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897174188752709:13620]
2025-09-30T15:00:02.361198Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897174188752709:13620]
2025-09-30T15:00:02.361201Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897174188752709:13620]
2025-09-30T15:00:02.361217Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:02.361234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278557756:5575], now have 1 active actors on pipe
2025-09-30T15:00:02.361239Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:02.361243Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278557642:2454], now have 1 active actors on pipe
2025-09-30T15:00:02.361243Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:02.361246Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:02.361251Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:02.361266Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:02.361272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:02.361318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897174188752709:13620]
2025-09-30T15:00:02.361329Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:02.361337Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:02.361395Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3412
2025-09-30T15:00:02.361491Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3412
2025-09-30T15:00:02.361657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.361669Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.361701Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:02.361714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:02.361720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:02.361722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:02.361734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:02.361747Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:02.361763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:02.362045Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.362057Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.362076Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:02.362542Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3413 partition: 0 MaxSeqNo: 42 sessionId: src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0
2025-09-30T15:00:02.363034Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b0280f01-9c201185-ab750a1a-8f06ef9c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:02.366421Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0] Write session: try to update token
2025-09-30T15:00:02.366450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:02.375838Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:02.375869Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:02.375872Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:02.375874Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:02.375884Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897174188752709:13620]
2025-09-30T15:00:02.375889Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897174188752709:13620]
2025-09-30T15:00:02.375894Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897174188752709:13620]
2025-09-30T15:00:02.375948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:02.375958Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.375961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:02.375975Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:02.375993Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:02.376001Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:02.376130Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:02.389167Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3413 sessionId: src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:02.392526Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:02.406647Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897174278557912:5444]
2025-09-30T15:00:02.407045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 11 pipe creation result: OK TabletId: 72075186224037892 Generation: 3412, pipe: [1:7555897174278557912:5444]
2025-09-30T15:00:02.495136Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:02.495538Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.495557Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.495605Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278557912:5444], now have 1 active actors on pipe
2025-09-30T15:00:02.496213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 11 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897174278557912:5444]
2025-09-30T15:00:02.496218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:02.496223Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:02.496258Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:02.496285Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:02.496307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3413 reason: error at write: Disconnected sessionId: src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0
2025-09-30T15:00:02.496527Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3413 sessionId: src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0 is DEAD
2025-09-30T15:00:02.496922Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:02.496934Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0] Write session will restart in 0.008832s
2025-09-30T15:00:02.496960Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0] Write session: Do CDS request
2025-09-30T15:00:02.496969Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:02.506859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:02.507309Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:02.507330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3414
2025-09-30T15:00:02.507542Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3414 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:02.507576Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3414 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:02.507582Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3414 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:02.507586Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:02.508057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3414 sessionId:  describe result for acl check
2025-09-30T15:00:02.508097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:02.508099Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:02.508101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:02.508108Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897174278557934:5586] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:02.508721Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897174278557934:5586] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:02.515378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897174278557934:5586] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:02.521701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897174278557934:5586] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:02.521724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897174278557934:5586] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:02.521728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897174278557934:5586] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:02.521736Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3414 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:02.535720Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:02.539870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:02.540153Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:02.540168Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:02.540183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:02.540267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:02.540325Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897174188752971:13622]
2025-09-30T15:00:02.541004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:02.541405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:02.541491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:02.541929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:02.542021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.542033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.542034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.542035Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.542037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.542039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.542041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.542043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.542044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.542046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.542048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.542049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.542051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.542052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.542054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.542061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.542073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.542079Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.542084Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.542089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.542094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.542099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.542104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.542109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.542115Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.542120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.542125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.542130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.542134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.542139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.542148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.542158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.542165Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.542175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.542181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.542188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.542193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.542198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.542203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.542208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.542212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.542218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.542223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.542228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.542233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.542238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.542243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.542248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.542253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.542257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.542262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.542267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.542272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.542277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.542282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.542288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.542293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.542298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.542304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.542310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.542373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:02.549607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:02.550620Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:02.550649Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:02.550652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:02.550657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:02.550665Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3413 [2:7555897174188752971:13622]
2025-09-30T15:00:02.550684Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:02.550703Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:02.550711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:02.550715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:02.550717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:02.550735Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:02.550747Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:02.550760Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:02.550834Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.550842Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.550845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.550849Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:02.550852Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:02.550929Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:02.550938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.550951Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.550962Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.550978Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:02.550997Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897174188752966:13622]
2025-09-30T15:00:02.551006Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897174188752966:13622]
2025-09-30T15:00:02.551009Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897174188752966:13622]
2025-09-30T15:00:02.551023Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:02.551044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278558052:5586], now have 1 active actors on pipe
2025-09-30T15:00:02.551053Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278557918:2454], now have 1 active actors on pipe
2025-09-30T15:00:02.551061Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:02.551063Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:02.551069Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:02.551072Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:02.551075Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:02.551078Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:02.551120Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897174188752966:13622]
2025-09-30T15:00:02.551134Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:02.551146Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:02.551125Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3413
2025-09-30T15:00:02.551129Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3413
2025-09-30T15:00:02.551395Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.551413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.551445Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:02.551455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:02.551459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:02.551462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:02.551475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:02.551489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:02.551507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:02.551719Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.551732Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.551755Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:02.551967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3414 partition: 0 MaxSeqNo: 42 sessionId: src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0
2025-09-30T15:00:02.552398Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|60ba9990-6addb9cf-d7fe7a0d-61cabf3_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:02.555878Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0] Write session: try to update token
2025-09-30T15:00:02.555907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:02.568085Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:02.568113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:02.568116Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:02.568118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:02.568128Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897174188752966:13622]
2025-09-30T15:00:02.568134Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897174188752966:13622]
2025-09-30T15:00:02.568139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897174188752966:13622]
2025-09-30T15:00:02.568185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:02.568193Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.568196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:02.568216Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:02.568229Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:02.568234Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:02.568342Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:02.574746Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3414 sessionId: src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:02.578191Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:02.596571Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897174278558183:5444]
2025-09-30T15:00:02.597356Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 12 pipe creation result: OK TabletId: 72075186224037892 Generation: 3413, pipe: [1:7555897174278558183:5444]
2025-09-30T15:00:02.697895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T15:00:02.697914Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0] Write session will restart in 0.009421s
2025-09-30T15:00:02.697940Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0] Write session: Do CDS request
2025-09-30T15:00:02.697946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:02.697412Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T15:00:02.697515Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3414 reason: status is not ok: tablet will be restarted right now sessionId: src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0
2025-09-30T15:00:02.697708Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3414 sessionId: src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0 is DEAD
2025-09-30T15:00:02.697849Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 12 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897174278558183:5444]
2025-09-30T15:00:02.697862Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:02.695772Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:02.696631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.696644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.696689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278558183:5444], now have 1 active actors on pipe
2025-09-30T15:00:02.696927Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:02.708847Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:02.709026Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:02.709051Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3415
2025-09-30T15:00:02.709184Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3415 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:02.709218Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3415 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:02.709228Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3415 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:02.709240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:02.709722Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3415 sessionId:  describe result for acl check
2025-09-30T15:00:02.709762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:02.709765Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:02.709767Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:02.709774Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897174278558201:5596] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:02.710380Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897174278558201:5596] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:02.713097Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897174278558201:5596] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:02.717919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897174278558201:5596] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:02.717943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897174278558201:5596] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:02.717947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897174278558201:5596] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:02.717956Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3415 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:02.732460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:02.737240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:02.737522Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:02.737526Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:02.737538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:02.737602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:02.737648Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897174188753243:13626]
2025-09-30T15:00:02.738355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:02.739536Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:02.739606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:02.740171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:02.740258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.740265Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.740266Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.740267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.740268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.740269Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.740271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.740272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.740274Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.740275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.740277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.740278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.740279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.740281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.740282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.740288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.740299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.740304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.740308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.740312Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.740316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.740320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.740324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.740328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.740333Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.740337Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.740341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.740345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.740350Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.740353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.740379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.740388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.740394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.740400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.740406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.740412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.740417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.740423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.740441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.740446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.740452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.740457Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.740463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.740469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.740474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.740480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.740485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.740491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.740496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.740502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.740510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.740516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.740521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.740526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.740531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.740537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.740541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.740547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.740553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.740558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.740608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:02.746964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:02.747987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:02.748007Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:02.748010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:02.748015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:02.748023Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3414 [2:7555897174188753243:13626]
2025-09-30T15:00:02.748043Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:02.748063Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:02.748066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:02.748069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:02.748073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:02.748091Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:02.748098Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:02.748106Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:02.748179Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.748181Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.748183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.748188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:02.748191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:02.748274Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:02.748277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.748290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.748302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.748320Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:02.748339Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897174188753237:13626]
2025-09-30T15:00:02.748342Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897174188753237:13626]
2025-09-30T15:00:02.748344Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897174188753237:13626]
2025-09-30T15:00:02.748354Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:02.748379Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:02.748388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:02.748388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278558186:2454], now have 1 active actors on pipe
2025-09-30T15:00:02.748391Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:02.748395Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:02.748410Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:02.748414Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:02.748420Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278558283:5596], now have 1 active actors on pipe
2025-09-30T15:00:02.748459Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897174188753237:13626]
2025-09-30T15:00:02.748470Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:02.748500Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:02.748709Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.748718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.748756Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|5825f84d-60666091-31cc57fe-67a83a64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:02.748767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:02.748772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:02.748775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:02.748790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:02.748805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:02.748826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:02.749633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.749652Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.749676Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:02.750323Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9dd43b50-25736280-5ac4b2f0-f8b1eb76_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|5825f84d-60666091-31cc57fe-67a83a64_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:02.748516Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3414
2025-09-30T15:00:02.748575Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3414
2025-09-30T15:00:02.749837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3415 partition: 0 MaxSeqNo: 42 sessionId: src_id|5825f84d-60666091-31cc57fe-67a83a64_0
2025-09-30T15:00:02.755155Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5825f84d-60666091-31cc57fe-67a83a64_0] Write session: try to update token
2025-09-30T15:00:02.755183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5825f84d-60666091-31cc57fe-67a83a64_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:02.773429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:02.773450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:02.773453Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:02.773455Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:02.773465Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897174188753237:13626]
2025-09-30T15:00:02.773470Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897174188753237:13626]
2025-09-30T15:00:02.773475Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897174188753237:13626]
2025-09-30T15:00:02.773525Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:02.773530Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:02.773534Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.773537Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:02.773538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:02.773541Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:02.773701Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:02.785530Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3415 sessionId: src_id|5825f84d-60666091-31cc57fe-67a83a64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:02.788512Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:02.797894Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897174278558451:5444]
2025-09-30T15:00:02.798583Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 13 pipe creation result: OK TabletId: 72075186224037892 Generation: 3414, pipe: [1:7555897174278558451:5444]
2025-09-30T15:00:02.895050Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:02.895984Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.896007Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.896052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278558451:5444], now have 1 active actors on pipe
2025-09-30T15:00:02.896496Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:02.898912Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:02.898978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 13 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897174278558451:5444]
2025-09-30T15:00:02.899072Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T15:00:02.899162Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3415 reason: status is not ok: tablet will be restarted right now sessionId: src_id|5825f84d-60666091-31cc57fe-67a83a64_0
2025-09-30T15:00:02.899363Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3415 sessionId: src_id|5825f84d-60666091-31cc57fe-67a83a64_0 is DEAD
2025-09-30T15:00:02.899532Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5825f84d-60666091-31cc57fe-67a83a64_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T15:00:02.899545Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5825f84d-60666091-31cc57fe-67a83a64_0] Write session will restart in 0.006075s
2025-09-30T15:00:02.899569Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5825f84d-60666091-31cc57fe-67a83a64_0] Write session: Do CDS request
2025-09-30T15:00:02.899575Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5825f84d-60666091-31cc57fe-67a83a64_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:02.906820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|5825f84d-60666091-31cc57fe-67a83a64_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:02.909635Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:02.909659Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3416
2025-09-30T15:00:02.909877Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3416 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:02.909918Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3416 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:02.909931Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3416 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:02.909935Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:02.910414Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3416 sessionId:  describe result for acl check
2025-09-30T15:00:02.910449Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:02.910451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:02.910453Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:02.910459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897174278558471:5595] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:02.911051Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897174278558471:5595] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:02.920216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897174278558471:5595] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:02.924035Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897174278558471:5595] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:02.924061Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897174278558471:5595] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:02.924065Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897174278558471:5595] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:02.924075Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3416 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:02.935595Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:02.939438Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:02.939717Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:02.939730Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:02.939744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:02.939818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:02.939871Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897174188753504:13628]
2025-09-30T15:00:02.940608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:02.941096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:02.941176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:02.941717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:02.941834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.941836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.941838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.941839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.941841Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.941842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.941844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.941845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.941847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.941848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.941849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.941850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.941852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.941853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.941854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.941861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.941872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.941877Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.941881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.941886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.941890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.941894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.941898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.941902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.941906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.941910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.941914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.941918Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.941922Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.941926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.941937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.941946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:02.941952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.941961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:02.941967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.941972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:02.941977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.941982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:02.941988Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.941994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:02.941999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.942006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:02.942012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.942017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:02.942022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.942028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:02.942032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.942037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:02.942042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.942048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:02.942054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.942061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.942066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.942072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.942077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.942082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.942090Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.942096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:02.942102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.942108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:02.942155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:02.948619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:02.949693Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:02.949715Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:02.949719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:02.949724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:02.949735Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3415 [2:7555897174188753504:13628]
2025-09-30T15:00:02.949757Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:02.949781Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:02.949785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:02.949790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:02.949793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:02.949814Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:02.949828Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:02.949838Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:02.950386Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.950398Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.950400Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.950404Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:02.950408Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:02.950500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:02.950503Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.950520Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:02.950535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:02.950558Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:02.950580Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897174188753499:13628]
2025-09-30T15:00:02.950582Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897174188753499:13628]
2025-09-30T15:00:02.950585Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897174188753499:13628]
2025-09-30T15:00:02.950603Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:02.950622Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:02.950641Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:02.950645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:02.950693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897174188753499:13628]
2025-09-30T15:00:02.950697Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:02.951084Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:02.951097Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:02.951100Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:02.951108Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:02.951342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278558602:5595], now have 1 active actors on pipe
2025-09-30T15:00:02.951358Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278558456:2454], now have 1 active actors on pipe
2025-09-30T15:00:02.951815Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3415
2025-09-30T15:00:02.951858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3415
2025-09-30T15:00:02.954131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.954154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.954208Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:02.954223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:02.954239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:02.954242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:02.954258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:02.954278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:02.954305Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:02.954626Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:02.954636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:02.954655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:02.955767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3416 partition: 0 MaxSeqNo: 42 sessionId: src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0
2025-09-30T15:00:02.956197Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|5825f84d-60666091-31cc57fe-67a83a64_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:02.959972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0] Write session: try to update token
2025-09-30T15:00:02.959998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:02.969264Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:02.969287Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:02.969290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:02.969293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:02.969304Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897174188753499:13628]
2025-09-30T15:00:02.969309Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897174188753499:13628]
2025-09-30T15:00:02.969314Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897174188753499:13628]
2025-09-30T15:00:02.969367Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:02.969376Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:02.969379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:02.969386Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:02.969395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:02.969399Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:02.969536Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:02.993535Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3416 sessionId: src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:02.996556Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:02.999712Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897174278558736:5444]
2025-09-30T15:00:03.000207Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 14 pipe creation result: OK TabletId: 72075186224037892 Generation: 3415, pipe: [1:7555897174278558736:5444]
2025-09-30T15:00:03.095265Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:03.095831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.095841Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.095862Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897174278558736:5444], now have 1 active actors on pipe
2025-09-30T15:00:03.096325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 14 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897174278558736:5444]
2025-09-30T15:00:03.096390Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:03.096393Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:03.096454Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3416 reason: error at write: Disconnected sessionId: src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0
2025-09-30T15:00:03.096510Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:03.096626Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3416 sessionId: src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0 is DEAD
2025-09-30T15:00:03.096742Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:03.102012Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:03.102025Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0] Write session will restart in 0.006567s
2025-09-30T15:00:03.102070Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0] Write session: Do CDS request
2025-09-30T15:00:03.102081Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:03.109829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:03.111405Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:03.111439Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3417
2025-09-30T15:00:03.111577Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3417 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:03.111622Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3417 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:03.111627Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3417 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:03.111632Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:03.112182Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3417 sessionId:  describe result for acl check
2025-09-30T15:00:03.112248Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:03.112256Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:03.112258Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:03.112264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897178573526079:5613] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:03.112856Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897178573526079:5613] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:03.116441Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897178573526079:5613] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:03.120915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897178573526079:5613] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:03.120938Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897178573526079:5613] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:03.120942Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897178573526079:5613] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:03.120952Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3417 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:03.127711Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:03.131346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:03.131625Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:03.131631Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:03.131646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:03.131735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:03.131781Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897178483721073:13632]
2025-09-30T15:00:03.132453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:03.133201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:03.133275Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:03.133668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:03.133764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.133766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.133767Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.133768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.133770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.133771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.133772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.133774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.133775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.133776Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.133778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.133779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.133780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.133782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.133783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.133791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.133801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.133805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.133810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.133814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.133817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.133822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.133826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.133830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.133834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.133839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.133843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.133848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.133852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.133856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.133865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.133874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.133881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.133887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.133892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.133899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.133903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.133908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.133914Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.133919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.133924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.133930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.133936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.133943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.133947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.133953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.133957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.133963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.133972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.133978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.133984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.133989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.133995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.134000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.134005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.134011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.134016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.134022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.134027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.134033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.134082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:03.140387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:03.141775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:03.141783Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:03.141786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:03.141790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:03.141797Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3416 [2:7555897178483721073:13632]
2025-09-30T15:00:03.141815Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:03.141833Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:03.141837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:03.141840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:03.141842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:03.141859Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:03.141866Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:03.141873Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:03.141944Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.141947Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.141948Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.141952Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:03.141955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:03.142037Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:03.142040Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.142056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.142067Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.142084Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:03.142103Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897178483721068:13632]
2025-09-30T15:00:03.142106Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897178483721068:13632]
2025-09-30T15:00:03.142108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897178483721068:13632]
2025-09-30T15:00:03.142120Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:03.142138Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:03.142155Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:03.142158Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:03.142200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897178483721068:13632]
2025-09-30T15:00:03.142203Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:03.142207Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:03.142211Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:03.142214Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:03.142221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:03.142655Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3416
2025-09-30T15:00:03.142655Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3416
2025-09-30T15:00:03.142754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573526219:5613], now have 1 active actors on pipe
2025-09-30T15:00:03.142769Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573526034:2454], now have 1 active actors on pipe
2025-09-30T15:00:03.142894Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.142909Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.142937Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:03.142947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:03.142950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:03.142954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:03.142967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:03.142987Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:03.143005Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:03.143370Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.143387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.143411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:03.145270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|2e027489-b9e94d37-436ea77-a2dc75fd_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:03.143536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3417 partition: 0 MaxSeqNo: 42 sessionId: src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0
2025-09-30T15:00:03.154135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0] Write session: try to update token
2025-09-30T15:00:03.154165Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:03.162708Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:03.162729Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:03.162734Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:03.162736Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:03.162748Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897178483721068:13632]
2025-09-30T15:00:03.162757Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897178483721068:13632]
2025-09-30T15:00:03.162764Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897178483721068:13632]
2025-09-30T15:00:03.162812Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:03.162824Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.162829Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:03.162850Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:03.162857Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:03.162860Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:03.162997Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:03.196627Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897178573526319:5444]
2025-09-30T15:00:03.196987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 15 pipe creation result: OK TabletId: 72075186224037892 Generation: 3416, pipe: [1:7555897178573526319:5444]
2025-09-30T15:00:03.198900Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3417 sessionId: src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:03.202127Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:03.322616Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:03.323157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573526319:5444], now have 1 active actors on pipe
2025-09-30T15:00:03.323183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.323191Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.324002Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:03.324017Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0] Write session will restart in 0.007405s
2025-09-30T15:00:03.323498Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:03.323518Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:03.323605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3417 reason: error at write: Disconnected sessionId: src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0
2025-09-30T15:00:03.323794Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3417 sessionId: src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0 is DEAD
2025-09-30T15:00:03.324052Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0] Write session: Do CDS request
2025-09-30T15:00:03.324059Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:03.323851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:03.323912Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 15 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897178573526319:5444]
2025-09-30T15:00:03.323533Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:03.332854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:03.333155Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:03.333177Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3418
2025-09-30T15:00:03.334621Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3418 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:03.334676Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3418 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:03.334682Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3418 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:03.334687Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:03.335123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3418 sessionId:  describe result for acl check
2025-09-30T15:00:03.335159Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:03.335161Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:03.335164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:03.335170Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897178573526346:5641] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:03.335900Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897178573526346:5641] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:03.339655Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897178573526346:5641] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:03.347919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897178573526346:5641] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:03.347940Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897178573526346:5641] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:03.347945Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897178573526346:5641] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:03.347954Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3418 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:03.368594Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:03.370212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:03.370583Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:03.370601Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:03.370632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:03.370733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:03.370787Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897178483721359:13645]
2025-09-30T15:00:03.371480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:03.372063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:03.372146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:03.372571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:03.372664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.372671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.372672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.372674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.372676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.372677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.372679Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.372681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.372683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.372684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.372686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.372687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.372688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.372690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.372691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.372699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.372727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.372731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.372736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.372740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.372745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.372750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.372754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.372760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.372765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.372769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.372774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.372778Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.372783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.372788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.372798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.372807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.372815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.372822Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.372830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.372837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.372843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.372848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.372858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.372865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.372870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.372876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.372882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.372889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.372894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.372900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.372905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.372911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.372915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.372920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.372926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.372931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.372936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.372942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.372948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.372953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.372958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.372964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.372971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.372977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.373025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:03.380671Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:03.382506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:03.382531Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:03.382535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:03.382539Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:03.382546Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3417 [2:7555897178483721359:13645]
2025-09-30T15:00:03.382565Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:03.382583Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:03.382587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:03.382590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:03.382592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:03.382610Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:03.382617Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:03.382624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:03.382700Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.382716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.382718Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.382722Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:03.382725Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:03.382803Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:03.382814Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.382831Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.382845Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.382863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:03.382882Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897178483721354:13645]
2025-09-30T15:00:03.382886Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897178483721354:13645]
2025-09-30T15:00:03.382888Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897178483721354:13645]
2025-09-30T15:00:03.382897Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:03.382912Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:03.382929Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:03.382933Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:03.382951Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:03.382956Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:03.382958Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:03.382979Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897178483721354:13645]
2025-09-30T15:00:03.382983Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:03.382992Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573526459:5641], now have 1 active actors on pipe
2025-09-30T15:00:03.382993Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:03.383008Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573526330:2454], now have 1 active actors on pipe
2025-09-30T15:00:03.383118Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3417
2025-09-30T15:00:03.383156Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3417
2025-09-30T15:00:03.383398Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.383413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.383442Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:03.383452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:03.383459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:03.383462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:03.383475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:03.383489Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:03.383506Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:03.383874Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.383884Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.383901Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:03.384063Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3418 partition: 0 MaxSeqNo: 42 sessionId: src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0
2025-09-30T15:00:03.384537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e79fde8-41c439fd-78f99338-ccba8f0f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:03.387745Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0] Write session: try to update token
2025-09-30T15:00:03.387773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:03.400908Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T15:00:03.400929Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:03.400940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897178483721354:13645]
2025-09-30T15:00:03.400998Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T15:00:03.401006Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T15:00:03.401192Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T15:00:03.401897Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:03.402066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:03.402216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:03.402455Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T15:00:03.402506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T15:00:03.409739Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3418 sessionId: src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:03.411642Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:03.411665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:03.411668Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:03.411671Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:03.411683Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897178483721354:13645]
2025-09-30T15:00:03.411688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897178483721354:13645]
2025-09-30T15:00:03.411693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897178483721354:13645]
2025-09-30T15:00:03.411740Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:03.411748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.411751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:03.411759Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:03.411769Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:03.411773Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:03.411958Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:03.413169Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:03.423945Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897178573526605:5444]
2025-09-30T15:00:03.424295Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 16 pipe creation result: OK TabletId: 72075186224037892 Generation: 3417, pipe: [1:7555897178573526605:5444]
2025-09-30T15:00:03.530399Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:03.531181Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.531205Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.531226Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573526605:5444], now have 1 active actors on pipe
2025-09-30T15:00:03.531747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:03.532593Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T15:00:03.532599Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 16 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897178573526605:5444]
2025-09-30T15:00:03.532623Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:03.532704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3418 reason: status is not ok: tablet will be restarted right now sessionId: src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0
2025-09-30T15:00:03.533270Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T15:00:03.533285Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0] Write session will restart in 0.008688s
2025-09-30T15:00:03.533311Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0] Write session: Do CDS request
2025-09-30T15:00:03.533318Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:03.532900Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3418 sessionId: src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0 is DEAD
2025-09-30T15:00:03.543318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:03.543330Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:03.543350Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3419
2025-09-30T15:00:03.544023Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3419 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:03.544073Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3419 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:03.544079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3419 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:03.544083Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:03.544589Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3419 sessionId:  describe result for acl check
2025-09-30T15:00:03.544631Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:03.544638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:03.544640Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:03.544649Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897178573526626:5645] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:03.545243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897178573526626:5645] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:03.550167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897178573526626:5645] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:03.556216Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897178573526626:5645] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:03.556238Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897178573526626:5645] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:03.556242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897178573526626:5645] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:03.556251Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3419 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:03.578392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:03.583310Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:03.583847Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:03.583861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:03.583878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:03.583967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:03.584021Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897178483721621:13647]
2025-09-30T15:00:03.584782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:03.585418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:03.585498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:03.585872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:03.585994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.585995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.585997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.585999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.586000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.586002Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.586003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.586004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.586006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.586007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.586009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.586010Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.586011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.586013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.586015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.586021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.586032Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.586036Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.586039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.586044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.586048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.586051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.586055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.586058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.586062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.586065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.586069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.586073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.586077Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.586081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.586093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.586120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.586127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.586133Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.586138Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.586144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.586149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.586155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.586161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.586166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.586171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.586177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.586182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.586191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.586196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.586202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.586208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.586214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.586219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.586226Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.586232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.586239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.586244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.586248Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.586253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.586258Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.586262Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.586267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.586272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.586277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.586325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:03.593458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:03.594984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:03.595004Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:03.595008Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:03.595012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:03.595020Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3418 [2:7555897178483721621:13647]
2025-09-30T15:00:03.595041Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:03.595060Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:03.595064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:03.595068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:03.595070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:03.595089Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:03.595103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:03.595111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:03.595186Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.595195Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.595197Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.595201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:03.595204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:03.595342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:03.595370Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.595387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.595401Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.595422Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:03.595447Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897178483721616:13647]
2025-09-30T15:00:03.595460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897178483721616:13647]
2025-09-30T15:00:03.595463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897178483721616:13647]
2025-09-30T15:00:03.595483Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:03.595510Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573526611:2454], now have 1 active actors on pipe
2025-09-30T15:00:03.595520Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573526712:5645], now have 1 active actors on pipe
2025-09-30T15:00:03.595529Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:03.595536Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:03.595541Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:03.595544Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:03.595549Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:03.595552Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:03.595598Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897178483721616:13647]
2025-09-30T15:00:03.595614Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:03.595632Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:03.595645Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3418
2025-09-30T15:00:03.595667Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3418
2025-09-30T15:00:03.596064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.596079Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.596110Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:03.596136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:03.596147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:03.596149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:03.596162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:03.596177Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:03.596195Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:03.602322Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.602349Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.602390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:03.602629Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3419 partition: 0 MaxSeqNo: 42 sessionId: src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0
2025-09-30T15:00:03.603053Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|e6fb69db-c9a355cc-4d993432-a5de12c8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:03.606044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0] Write session: try to update token
2025-09-30T15:00:03.606070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:03.614175Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:03.614203Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:03.614208Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:03.614211Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:03.614230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897178483721616:13647]
2025-09-30T15:00:03.614238Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897178483721616:13647]
2025-09-30T15:00:03.614245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897178483721616:13647]
2025-09-30T15:00:03.614296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:03.614305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.614307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:03.614307Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:03.614315Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:03.614320Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:03.614516Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:03.628016Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3419 sessionId: src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:03.631107Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:03.632876Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897178573526881:5444]
2025-09-30T15:00:03.633455Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 17 pipe creation result: OK TabletId: 72075186224037892 Generation: 3418, pipe: [1:7555897178573526881:5444]
2025-09-30T15:00:03.748145Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:03.748665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.748686Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.748733Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573526881:5444], now have 1 active actors on pipe
2025-09-30T15:00:03.749524Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:03.749546Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:03.749616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3419 reason: error at write: Disconnected sessionId: src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0
2025-09-30T15:00:03.749796Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3419 sessionId: src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0 is DEAD
2025-09-30T15:00:03.749114Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:03.749851Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:03.749908Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 17 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897178573526881:5444]
2025-09-30T15:00:03.750021Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:03.750033Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0] Write session will restart in 0.007334s
2025-09-30T15:00:03.750062Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0] Write session: Do CDS request
2025-09-30T15:00:03.750072Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:03.758840Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:03.758983Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:03.759010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3420
2025-09-30T15:00:03.759202Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3420 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:03.759240Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3420 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:03.759264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3420 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:03.759269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:03.759811Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3420 sessionId:  describe result for acl check
2025-09-30T15:00:03.759861Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:03.759869Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:03.759871Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:03.759878Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897178573526897:5652] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:03.760508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897178573526897:5652] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:03.765876Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897178573526897:5652] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:03.771646Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897178573526897:5652] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:03.771673Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897178573526897:5652] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:03.771677Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897178573526897:5652] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:03.771687Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3420 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:03.781532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:03.785199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:03.785477Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:03.785488Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:03.785502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:03.785573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:03.785622Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897178483721900:13651]
2025-09-30T15:00:03.786309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:03.786838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:03.786907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:03.787607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:03.787701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.787702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.787704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.787705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.787707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.787708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.787710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.787711Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.787713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.787714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.787716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.787717Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.787718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.787720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.787721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.787728Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.787740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.787745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.787750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.787754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.787759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.787764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.787768Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.787772Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.787780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.787784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.787788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.787792Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.787797Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.787802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.787810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.787820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.787827Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.787834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.787839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.787846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.787851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.787856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.787862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.787868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.787873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.787879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.787884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.787890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.787895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.787901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.787907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.787913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.787920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.787927Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.787933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.787939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.787946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.787952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.787957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.787963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.787967Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.787973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.787979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.787985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.788034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:03.795478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:03.796979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:03.796998Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:03.797001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:03.797005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:03.797012Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3419 [2:7555897178483721900:13651]
2025-09-30T15:00:03.797029Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:03.797049Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:03.797053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:03.797056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:03.797058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:03.797075Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:03.797081Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:03.797088Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:03.797157Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.797167Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.797170Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.797174Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:03.797177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:03.797249Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:03.797252Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.797266Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.797277Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.797293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:03.797318Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897178483721895:13651]
2025-09-30T15:00:03.797328Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897178483721895:13651]
2025-09-30T15:00:03.797331Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897178483721895:13651]
2025-09-30T15:00:03.797341Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:03.797358Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:03.797380Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:03.797382Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:03.797388Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:03.797388Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:03.797393Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:03.797437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573527040:5652], now have 1 active actors on pipe
2025-09-30T15:00:03.797446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573526884:2454], now have 1 active actors on pipe
2025-09-30T15:00:03.797449Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897178483721895:13651]
2025-09-30T15:00:03.797461Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:03.797470Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:03.797628Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3419
2025-09-30T15:00:03.797631Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3419
2025-09-30T15:00:03.797749Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.797766Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.797796Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:03.797812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:03.797822Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:03.797825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:03.797840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:03.797853Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:03.797876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:03.798121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.798134Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.798157Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:03.798420Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3420 partition: 0 MaxSeqNo: 42 sessionId: src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0
2025-09-30T15:00:03.798876Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|99a26b48-e72a2063-20fc0e54-eb40ada2_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:03.802091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0] Write session: try to update token
2025-09-30T15:00:03.802118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:03.817803Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T15:00:03.817826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:03.817837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897178483721895:13651]
2025-09-30T15:00:03.817898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T15:00:03.817905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T15:00:03.818206Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T15:00:03.818385Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:03.818544Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:03.819065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:03.819323Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T15:00:03.819381Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T15:00:03.824679Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:03.824704Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:03.824707Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:03.824710Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:03.824722Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897178483721895:13651]
2025-09-30T15:00:03.824727Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897178483721895:13651]
2025-09-30T15:00:03.824732Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897178483721895:13651]
2025-09-30T15:00:03.824786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:03.824799Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.824802Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:03.824896Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:03.824905Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:03.824910Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:03.824979Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:03.828173Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3420 sessionId: src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:03.832619Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:03.849963Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897178573527156:5444]
2025-09-30T15:00:03.850388Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 18 pipe creation result: OK TabletId: 72075186224037892 Generation: 3419, pipe: [1:7555897178573527156:5444]
2025-09-30T15:00:03.944605Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:03.945446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.945465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.945487Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573527156:5444], now have 1 active actors on pipe
2025-09-30T15:00:03.946092Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:03.946158Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 18 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897178573527156:5444]
2025-09-30T15:00:03.946197Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:03.946211Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:03.946216Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:03.946282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3420 reason: error at write: Disconnected sessionId: src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0
2025-09-30T15:00:03.946464Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3420 sessionId: src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0 is DEAD
2025-09-30T15:00:03.947480Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:03.947493Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0] Write session will restart in 0.007536s
2025-09-30T15:00:03.947527Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0] Write session: Do CDS request
2025-09-30T15:00:03.947537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:03.956879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:03.956993Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:03.957024Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3421
2025-09-30T15:00:03.957197Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3421 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:03.957264Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3421 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:03.957276Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3421 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:03.957280Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:03.957870Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3421 sessionId:  describe result for acl check
2025-09-30T15:00:03.957910Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:03.957929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:03.957937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:03.957944Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897178573527179:5655] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:03.958544Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897178573527179:5655] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:03.962000Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897178573527179:5655] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:03.967771Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897178573527179:5655] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:03.967791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897178573527179:5655] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:03.967795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897178573527179:5655] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:03.967804Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3421 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:03.977518Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:03.980980Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:03.981580Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:03.981598Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:03.981615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:03.981706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:03.981753Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897178483722164:13653]
2025-09-30T15:00:03.982442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:03.982904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:03.982997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:03.983389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:03.983483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.983485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.983486Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.983488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.983489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.983491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.983493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.983494Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.983495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.983497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.983499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.983501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.983503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.983504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.983505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.983512Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.983523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.983527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.983531Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.983535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.983540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.983544Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.983548Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.983552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.983557Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.983561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.983565Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.983569Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.983573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.983577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.983586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.983595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:03.983602Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.983609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:03.983616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.983623Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:03.983628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.983634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:03.983639Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.983644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:03.983649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.983655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:03.983660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.983666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:03.983673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.983678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:03.983685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.983691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:03.983696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.983702Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:03.983707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.983713Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.983719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.983724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.983730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.983736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.983741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.983747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:03.983752Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.983758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:03.983809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:03.990299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:03.991715Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:03.991733Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:03.991736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:03.991740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:03.991748Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3420 [2:7555897178483722164:13653]
2025-09-30T15:00:03.991766Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:03.991784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:03.991788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:03.991791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:03.991793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:03.991811Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:03.991818Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:03.991826Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:03.991894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.991904Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.991907Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.991910Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:03.991913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:03.992006Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:03.992013Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:03.992029Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:03.992048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:03.992066Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:03.992093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573527311:5655], now have 1 active actors on pipe
2025-09-30T15:00:03.992101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897178573527160:2454], now have 1 active actors on pipe
2025-09-30T15:00:03.992108Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897178483722159:13653]
2025-09-30T15:00:03.992111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897178483722159:13653]
2025-09-30T15:00:03.992115Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897178483722159:13653]
2025-09-30T15:00:03.992137Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:03.992153Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:03.992156Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:03.992163Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:03.992166Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:03.992171Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:03.992174Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:03.992182Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3420
2025-09-30T15:00:03.992214Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897178483722159:13653]
2025-09-30T15:00:03.992206Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3420
2025-09-30T15:00:03.992218Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:03.992221Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:03.992234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.992240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.992294Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:03.992308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:03.992312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:03.992315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:03.992326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:03.992335Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:03.992376Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:03.992601Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:03.992617Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:03.992644Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:03.992760Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3421 partition: 0 MaxSeqNo: 42 sessionId: src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0
2025-09-30T15:00:03.993156Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|fd612d75-84b820a9-9e1fcf42-3b9fc900_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:03.996336Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0] Write session: try to update token
2025-09-30T15:00:03.996387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:04.006613Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:04.006640Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:04.006643Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:04.006645Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:04.006654Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897178483722159:13653]
2025-09-30T15:00:04.006660Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897178483722159:13653]
2025-09-30T15:00:04.006665Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897178483722159:13653]
2025-09-30T15:00:04.006710Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:04.006731Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.006741Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:04.006870Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:04.006887Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:04.006892Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:04.007291Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:04.013546Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3421 sessionId: src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:04.016959Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:04.046576Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897182868494740:5444]
2025-09-30T15:00:04.047090Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 19 pipe creation result: OK TabletId: 72075186224037892 Generation: 3420, pipe: [1:7555897182868494740:5444]
2025-09-30T15:00:04.129433Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:04.129773Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:04.129795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:04.129843Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868494740:5444], now have 1 active actors on pipe
2025-09-30T15:00:04.130081Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:04.130218Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:04.130252Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:04.130313Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 19 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897182868494740:5444]
2025-09-30T15:00:04.130320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3421 reason: error at write: Disconnected sessionId: src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0
2025-09-30T15:00:04.130335Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:04.130514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3421 sessionId: src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0 is DEAD
2025-09-30T15:00:04.130685Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:04.130697Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0] Write session will restart in 0.007060s
2025-09-30T15:00:04.130722Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0] Write session: Do CDS request
2025-09-30T15:00:04.130732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:04.138795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:04.138926Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:04.138947Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3422
2025-09-30T15:00:04.139147Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3422 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:04.139197Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3422 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:04.139208Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3422 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:04.139213Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:04.139879Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3422 sessionId:  describe result for acl check
2025-09-30T15:00:04.139915Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:04.139917Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:04.139919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:04.139925Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897182868494751:5682] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:04.140513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897182868494751:5682] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:04.142832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897182868494751:5682] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:04.150242Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897182868494751:5682] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:04.150268Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897182868494751:5682] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:04.150272Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897182868494751:5682] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:04.150281Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3422 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:04.173536Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:04.176983Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:04.177225Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:04.177230Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:04.177243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:04.177307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:04.177354Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897182778689738:13655]
2025-09-30T15:00:04.178020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:04.178549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:04.178610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:04.178960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:04.179039Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.179040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.179042Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.179043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.179045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.179047Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.179048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.179050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.179051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.179053Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.179055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.179056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.179063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.179065Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.179066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.179073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.179083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.179087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.179092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.179097Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.179101Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.179108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.179112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.179116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.179124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.179128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.179132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.179136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.179141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.179145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.179154Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.179162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.179169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.179175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.179180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.179187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.179191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.179196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.179202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.179208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.179212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.179218Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.179224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.179230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.179235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.179260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.179267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.179272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.179277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.179282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.179288Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.179294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.179300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.179309Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.179313Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.179319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.179324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.179330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.179335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.179341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.179393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:04.187644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:04.190628Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3421
2025-09-30T15:00:04.190673Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3421
2025-09-30T15:00:04.189102Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:04.189122Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:04.189125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:04.189129Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:04.189136Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3421 [2:7555897182778689738:13655]
2025-09-30T15:00:04.189152Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:04.189173Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:04.189177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:04.189180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:04.189182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:04.189201Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:04.189209Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:04.189216Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:04.189293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.189295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.189298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.189302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:04.189304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:04.189387Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:04.189390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.189406Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.189419Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.189434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:04.189452Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897182778689732:13655]
2025-09-30T15:00:04.189456Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897182778689732:13655]
2025-09-30T15:00:04.189458Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897182778689732:13655]
2025-09-30T15:00:04.189473Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:04.189487Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:04.189502Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:04.189506Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:04.189548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897182778689732:13655]
2025-09-30T15:00:04.189551Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:04.189650Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:04.189652Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:04.189655Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:04.189660Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:04.191309Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868494742:2454], now have 1 active actors on pipe
2025-09-30T15:00:04.191325Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868494801:5682], now have 1 active actors on pipe
2025-09-30T15:00:04.191346Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:04.191352Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:04.191391Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:04.191402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:04.191407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:04.191411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:04.191425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:04.191439Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:04.191458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:04.193948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:04.193967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:04.194006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:04.194201Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3422 partition: 0 MaxSeqNo: 42 sessionId: src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0
2025-09-30T15:00:04.194900Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|89b7f7ec-2f6d5511-393b2a94-c3561191_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:04.198097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0] Write session: try to update token
2025-09-30T15:00:04.198124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:04.209205Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:04.209224Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:04.209226Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:04.209229Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:04.209241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897182778689732:13655]
2025-09-30T15:00:04.209246Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897182778689732:13655]
2025-09-30T15:00:04.209251Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897182778689732:13655]
2025-09-30T15:00:04.209296Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:04.209304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.209307Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:04.209313Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:04.209322Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:04.209327Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:04.209460Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:04.223927Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3422 sessionId: src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:04.227157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:04.230350Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897182868495016:5444]
2025-09-30T15:00:04.230950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 20 pipe creation result: OK TabletId: 72075186224037892 Generation: 3421, pipe: [1:7555897182868495016:5444]
2025-09-30T15:00:04.333571Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:04.334035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:04.334047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:04.334068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868495016:5444], now have 1 active actors on pipe
2025-09-30T15:00:04.335422Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:04.335443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:04.335513Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3422 reason: error at write: Disconnected sessionId: src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0
2025-09-30T15:00:04.335718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3422 sessionId: src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0 is DEAD
2025-09-30T15:00:04.335951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:04.335963Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0] Write session will restart in 0.007258s
2025-09-30T15:00:04.335988Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0] Write session: Do CDS request
2025-09-30T15:00:04.335995Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:04.335140Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:04.335897Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 20 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897182868495016:5444]
2025-09-30T15:00:04.335919Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:04.345227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:04.345395Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:04.345418Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3423
2025-09-30T15:00:04.345572Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3423 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:04.345614Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3423 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:04.345625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3423 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:04.345630Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:04.346385Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3423 sessionId:  describe result for acl check
2025-09-30T15:00:04.346426Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:04.346428Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:04.346430Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:04.346438Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897182868495058:5695] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:04.346903Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897182868495058:5695] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:04.351029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897182868495058:5695] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:04.357463Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897182868495058:5695] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:04.357488Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897182868495058:5695] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:04.357494Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897182868495058:5695] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:04.357505Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3423 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:04.375327Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:04.379999Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:04.380252Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:04.380257Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:04.380268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:04.380326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:04.380384Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897182778690029:13670]
2025-09-30T15:00:04.381112Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:04.381853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:04.381913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:04.382293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:04.382374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.382376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.382378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.382379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.382381Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.382383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.382384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.382386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.382387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.382389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.382391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.382392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.382393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.382396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.382397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.382403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.382414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.382419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.382423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.382427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.382433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.382438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.382442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.382446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.382451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.382455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.382459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.382463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.382468Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.382472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.382483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.382492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.382499Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.382505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.382510Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.382517Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.382522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.382529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.382535Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.382541Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.382546Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.382552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.382558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.382564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.382570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.382575Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.382580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.382588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.382592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.382598Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.382603Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.382608Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.382614Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.382619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.382625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.382631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.382636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.382642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.382647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.382653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.382698Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:04.393191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:04.394327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:04.394353Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:04.394357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:04.394361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:04.394369Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3422 [2:7555897182778690029:13670]
2025-09-30T15:00:04.394388Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:04.394408Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:04.395277Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3422
2025-09-30T15:00:04.394412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:04.395346Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3422
2025-09-30T15:00:04.394415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:04.394418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:04.394436Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:04.394444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:04.394452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:04.394532Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.394535Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.394538Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.394541Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:04.394545Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:04.394631Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:04.394634Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.394651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.394664Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.394682Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:04.394701Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897182778690024:13670]
2025-09-30T15:00:04.394705Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897182778690024:13670]
2025-09-30T15:00:04.394708Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897182778690024:13670]
2025-09-30T15:00:04.394725Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:04.394741Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:04.394758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:04.394762Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:04.394807Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897182778690024:13670]
2025-09-30T15:00:04.394811Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:04.394914Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:04.394917Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:04.394920Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:04.394926Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:04.396991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868495043:2454], now have 1 active actors on pipe
2025-09-30T15:00:04.397015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868495158:5695], now have 1 active actors on pipe
2025-09-30T15:00:04.397044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:04.397052Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:04.397084Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca8ca53c-4706606-8f56d637-908db736_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:04.397103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:04.397108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:04.397112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:04.397126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:04.397149Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:04.397172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:04.397525Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:04.397552Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:04.397579Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:04.398443Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3423 partition: 0 MaxSeqNo: 42 sessionId: src_id|ca8ca53c-4706606-8f56d637-908db736_0
2025-09-30T15:00:04.398893Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|9abc8040-d727e156-7ccdfd54-850d3b88_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ca8ca53c-4706606-8f56d637-908db736_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:04.402093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ca53c-4706606-8f56d637-908db736_0] Write session: try to update token
2025-09-30T15:00:04.402120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ca53c-4706606-8f56d637-908db736_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:04.416339Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:04.416380Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:04.416383Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:04.416386Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:04.416397Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897182778690024:13670]
2025-09-30T15:00:04.416403Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897182778690024:13670]
2025-09-30T15:00:04.416409Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897182778690024:13670]
2025-09-30T15:00:04.416464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:04.416474Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.416477Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:04.416498Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:04.416517Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:04.416522Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:04.416655Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:04.425741Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3423 sessionId: src_id|ca8ca53c-4706606-8f56d637-908db736_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:04.428710Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:04.435541Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897182868495319:5444]
2025-09-30T15:00:04.436743Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 21 pipe creation result: OK TabletId: 72075186224037892 Generation: 3422, pipe: [1:7555897182868495319:5444]
2025-09-30T15:00:04.540949Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:04.541331Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:04.541344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:04.541365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868495319:5444], now have 1 active actors on pipe
2025-09-30T15:00:04.542452Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:04.542008Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 21 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897182868495319:5444]
2025-09-30T15:00:04.542054Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:04.542101Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:04.542108Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:04.542174Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3423 reason: error at write: Disconnected sessionId: src_id|ca8ca53c-4706606-8f56d637-908db736_0
2025-09-30T15:00:04.542352Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3423 sessionId: src_id|ca8ca53c-4706606-8f56d637-908db736_0 is DEAD
2025-09-30T15:00:04.547424Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ca53c-4706606-8f56d637-908db736_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:04.547441Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ca53c-4706606-8f56d637-908db736_0] Write session will restart in 0.009355s
2025-09-30T15:00:04.547467Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ca53c-4706606-8f56d637-908db736_0] Write session: Do CDS request
2025-09-30T15:00:04.547477Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ca53c-4706606-8f56d637-908db736_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:04.557786Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ca53c-4706606-8f56d637-908db736_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:04.559415Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:04.559438Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3424
2025-09-30T15:00:04.559654Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3424 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:04.559691Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3424 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:04.559696Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3424 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:04.559704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:04.570263Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3424 sessionId:  describe result for acl check
2025-09-30T15:00:04.570320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:04.570326Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:04.570329Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:04.570337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897182868495350:5704] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:04.570947Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897182868495350:5704] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:04.583929Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897182868495350:5704] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:04.596937Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897182868495350:5704] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:04.596970Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897182868495350:5704] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:04.596975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897182868495350:5704] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:04.596986Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3424 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:04.611562Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:04.616474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:04.616804Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:04.616817Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:04.616830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:04.616898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:04.616947Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897182778690298:13672]
2025-09-30T15:00:04.617705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:04.618595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:04.618664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:04.619099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:04.619182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.619184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.619186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.619188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.619190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.619192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.619194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.619195Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.619197Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.619199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.619200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.619202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.619203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.619205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.619207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.619214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.619228Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.619233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.619239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.619260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.619264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.619268Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.619273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.619277Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.619282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.619287Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.619291Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.619295Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.619301Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.619306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.619317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.619327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.619335Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.619342Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.619349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.619358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.619364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.619370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.619376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.619382Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.619388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.619394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.619401Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.619407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.619412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.619420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.619426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.619432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.619438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.619445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.619452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.619459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.619464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.619470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.619476Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.619483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.619488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.619495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.619500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.619507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.619560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:04.627528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:04.629719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3423
2025-09-30T15:00:04.629126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:04.629936Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3423
2025-09-30T15:00:04.629152Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:04.629156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:04.629161Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:04.629170Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3423 [2:7555897182778690298:13672]
2025-09-30T15:00:04.629191Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:04.629210Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:04.629215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:04.629219Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:04.629222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:04.629241Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:04.629250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:04.629259Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:04.629342Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.629344Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.629349Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.629353Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:04.629356Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:04.629443Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:04.629446Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.629464Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.629479Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.629500Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:04.629519Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897182778690293:13672]
2025-09-30T15:00:04.629522Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897182778690293:13672]
2025-09-30T15:00:04.629525Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897182778690293:13672]
2025-09-30T15:00:04.629544Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:04.629560Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868495325:2454], now have 1 active actors on pipe
2025-09-30T15:00:04.629562Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:04.629564Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868495501:5704], now have 1 active actors on pipe
2025-09-30T15:00:04.629567Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:04.629570Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:04.629573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:04.630153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:04.630157Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:04.630359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:04.630366Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:04.630386Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897182778690293:13672]
2025-09-30T15:00:04.630402Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:04.630429Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:04.631075Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:04.631095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:04.631103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:04.631107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:04.631126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:04.631143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:04.631207Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:04.632153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:04.632168Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:04.632194Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:04.632446Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3424 partition: 0 MaxSeqNo: 42 sessionId: src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0
2025-09-30T15:00:04.634306Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca8ca53c-4706606-8f56d637-908db736_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:04.637423Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0] Write session: try to update token
2025-09-30T15:00:04.637456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:04.641987Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897182868495598:5444]
2025-09-30T15:00:04.642287Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868495598:5444], now have 1 active actors on pipe
2025-09-30T15:00:04.642359Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 22 pipe creation result: OK TabletId: 72075186224037892 Generation: 3423, pipe: [1:7555897182868495598:5444]
2025-09-30T15:00:04.648090Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:04.648115Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:04.648118Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:04.648121Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:04.648132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897182778690293:13672]
2025-09-30T15:00:04.648137Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897182778690293:13672]
2025-09-30T15:00:04.648142Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897182778690293:13672]
2025-09-30T15:00:04.648191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:04.648201Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.648204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:04.648382Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:04.651365Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:04.651387Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:04.651395Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:04.671676Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3424 sessionId: src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:04.675149Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:04.775650Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:04.776025Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:04.776044Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:04.777547Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:04.777561Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0] Write session will restart in 0.006490s
2025-09-30T15:00:04.777588Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0] Write session: Do CDS request
2025-09-30T15:00:04.777595Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:04.776812Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:04.776837Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:04.776926Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 22 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897182868495598:5444]
2025-09-30T15:00:04.776949Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:04.776952Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:04.777031Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3424 reason: error at write: Disconnected sessionId: src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0
2025-09-30T15:00:04.777217Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3424 sessionId: src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0 is DEAD
2025-09-30T15:00:04.785829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:04.786073Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:04.786094Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3425
2025-09-30T15:00:04.786226Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3425 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:04.786259Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3425 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:04.786269Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3425 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:04.786273Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:04.786799Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3425 sessionId:  describe result for acl check
2025-09-30T15:00:04.786839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:04.786841Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:04.786847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:04.786854Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897182868495618:5703] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:04.787448Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897182868495618:5703] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:04.790955Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897182868495618:5703] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:04.796832Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897182868495618:5703] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:04.796857Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897182868495618:5703] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:04.796863Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897182868495618:5703] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:04.796874Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3425 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:04.831405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:04.838081Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:04.838372Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:04.838385Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:04.838398Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:04.838462Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:04.838505Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897182778690580:13676]
2025-09-30T15:00:04.839235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:04.839744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:04.839810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:04.840171Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:04.840233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.840235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.840236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.840238Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.840239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.840241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.840242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.840244Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.840246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.840247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.840249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.840250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.840252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.840253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.840255Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.840261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.840272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.840276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.840281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.840285Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.840289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.840294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.840298Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.840302Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.840307Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.840311Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.840315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.840320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.840324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.840328Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.840336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.840344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:04.840367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.840373Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:04.840379Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.840385Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:04.840391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.840396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:04.840402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.840407Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:04.840412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.840418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:04.840424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.840429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:04.840434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.840441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:04.840446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.840452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:04.840459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.840465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:04.840469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.840473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.840477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.840482Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.840487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.840493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.840498Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.840503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:04.840509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.840514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:04.840580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:04.847267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:04.848425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:04.848432Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:04.848435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:04.848439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:04.848447Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3424 [2:7555897182778690580:13676]
2025-09-30T15:00:04.848465Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:04.848484Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:04.848488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:04.848491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:04.848494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:04.848511Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:04.848518Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:04.848932Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3424
2025-09-30T15:00:04.848525Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:04.848946Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3424
2025-09-30T15:00:04.848590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.848593Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.848595Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.848598Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:04.848601Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:04.848684Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:04.848688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.848703Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:04.848716Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:04.848735Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:04.848753Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897182778690575:13676]
2025-09-30T15:00:04.848756Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897182778690575:13676]
2025-09-30T15:00:04.848758Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897182778690575:13676]
2025-09-30T15:00:04.848766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:04.848780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:04.848797Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:04.848799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:04.848803Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:04.848811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:04.848813Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:04.848842Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868495707:5703], now have 1 active actors on pipe
2025-09-30T15:00:04.848848Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868495603:2454], now have 1 active actors on pipe
2025-09-30T15:00:04.848851Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897182778690575:13676]
2025-09-30T15:00:04.848858Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:04.848867Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:04.849260Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:04.849276Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:04.849312Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:04.849321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:04.849325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:04.849328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:04.849339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:04.849350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:04.849375Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:04.849654Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:04.849666Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:04.849684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:04.849777Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3425 partition: 0 MaxSeqNo: 42 sessionId: src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0
2025-09-30T15:00:04.850178Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|422b1d60-e90ac2a-fd285fef-c99404d1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:04.853444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0] Write session: try to update token
2025-09-30T15:00:04.853473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:04.867899Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:04.867921Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:04.867925Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:04.867927Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:04.867938Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897182778690575:13676]
2025-09-30T15:00:04.867943Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897182778690575:13676]
2025-09-30T15:00:04.867947Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897182778690575:13676]
2025-09-30T15:00:04.867994Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:04.868001Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:04.868004Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:04.868174Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:04.871700Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:04.871719Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:04.871724Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:04.876978Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897182868495882:5444]
2025-09-30T15:00:04.877411Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 23 pipe creation result: OK TabletId: 72075186224037892 Generation: 3424, pipe: [1:7555897182868495882:5444]
2025-09-30T15:00:04.881395Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3425 sessionId: src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:04.884620Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:04.990771Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:04.991127Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868495882:5444], now have 1 active actors on pipe
2025-09-30T15:00:04.991170Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:04.991178Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:04.991607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T15:00:04.991733Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3425 reason: status is not ok: tablet will be restarted right now sessionId: src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0
2025-09-30T15:00:04.991899Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 23 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897182868495882:5444]
2025-09-30T15:00:04.991928Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:04.991932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3425 sessionId: src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0 is DEAD
2025-09-30T15:00:04.991505Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:04.992085Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T15:00:04.992113Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0] Write session will restart in 0.006743s
2025-09-30T15:00:04.992137Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0] Write session: Do CDS request
2025-09-30T15:00:04.992144Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:04.999932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:05.000038Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:05.000061Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3426
2025-09-30T15:00:05.000229Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3426 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:05.000290Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3426 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:05.000301Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3426 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:05.000306Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:05.001065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3426 sessionId:  describe result for acl check
2025-09-30T15:00:05.001119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:05.001125Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:05.001127Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:05.001135Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897187163463210:5734] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:05.001699Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897187163463210:5734] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:05.006264Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897187163463210:5734] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:05.011325Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897187163463210:5734] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:05.011352Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897187163463210:5734] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:05.011356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897187163463210:5734] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:05.011367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3426 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:05.025659Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:05.029600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:05.029848Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:05.029861Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:05.029873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:05.029936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:05.029980Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897187073658145:13678]
2025-09-30T15:00:05.030675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:05.031108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:05.031190Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:05.031642Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:05.031824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.031833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.031834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.031836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.031837Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.031839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.031840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.031842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.031843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.031845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.031846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.031848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.031849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.031850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.031851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.031873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.031885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.031889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.031894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.031898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.031903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.031907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.031911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.031915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.031920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.031924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.031928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.031932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.031937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.031940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.031950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.031959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.031966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.031972Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.031977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.031983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.031987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.031993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.031998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.032004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.032033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.032040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.032045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.032051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.032056Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.032062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.032071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.032078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.032083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.032089Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.032093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.032099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.032104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.032109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.032114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.032120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.032124Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.032131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.032136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.032142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.032187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:05.038962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:05.040631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:05.040654Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:05.040657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:05.040662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:05.040670Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3425 [2:7555897187073658145:13678]
2025-09-30T15:00:05.040690Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:05.040706Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:05.040710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:05.040713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:05.040715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:05.040734Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:05.040742Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:05.040749Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:05.040817Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.040830Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.040832Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.040835Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:05.040838Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:05.040913Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:05.040916Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.040931Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.040943Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.040961Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:05.040978Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897187073658140:13678]
2025-09-30T15:00:05.040981Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897187073658140:13678]
2025-09-30T15:00:05.040983Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897187073658140:13678]
2025-09-30T15:00:05.040992Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:05.041008Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:05.041024Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:05.041026Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:05.041068Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897187073658140:13678]
2025-09-30T15:00:05.041071Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:05.041089Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:05.041093Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:05.041096Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:05.041102Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:05.041422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163463349:5734], now have 1 active actors on pipe
2025-09-30T15:00:05.041431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897182868495886:2454], now have 1 active actors on pipe
2025-09-30T15:00:05.041489Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3425
2025-09-30T15:00:05.041544Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3425
2025-09-30T15:00:05.041808Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.041819Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.041850Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:05.041867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:05.041872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:05.041875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:05.041886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:05.041898Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:05.041915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:05.042495Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.042514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.042540Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:05.042694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3426 partition: 0 MaxSeqNo: 42 sessionId: src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0
2025-09-30T15:00:05.043114Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b6e0213d-baeb5b87-83ef9c83-b7f0c031_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:05.046475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0] Write session: try to update token
2025-09-30T15:00:05.046507Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:05.057104Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:05.057136Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:05.057140Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:05.057143Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:05.057155Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897187073658140:13678]
2025-09-30T15:00:05.057160Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897187073658140:13678]
2025-09-30T15:00:05.057166Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897187073658140:13678]
2025-09-30T15:00:05.057220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:05.057235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.057239Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:05.057479Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:05.059325Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:05.059348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:05.059353Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:05.074236Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3426 sessionId: src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:05.077510Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:05.092377Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897187163463469:5444]
2025-09-30T15:00:05.092674Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 24 pipe creation result: OK TabletId: 72075186224037892 Generation: 3425, pipe: [1:7555897187163463469:5444]
2025-09-30T15:00:05.176483Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:05.177101Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.177121Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.177144Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163463469:5444], now have 1 active actors on pipe
2025-09-30T15:00:05.177441Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:05.177460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:05.177479Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 24 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897187163463469:5444]
2025-09-30T15:00:05.177517Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:05.177536Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3426 reason: error at write: Disconnected sessionId: src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0
2025-09-30T15:00:05.177499Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:05.177723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3426 sessionId: src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0 is DEAD
2025-09-30T15:00:05.177897Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:05.177909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0] Write session will restart in 0.005133s
2025-09-30T15:00:05.177935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0] Write session: Do CDS request
2025-09-30T15:00:05.177958Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:05.184884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:05.184956Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:05.184979Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3427
2025-09-30T15:00:05.185186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3427 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:05.185225Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3427 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:05.185231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3427 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:05.185235Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:05.185764Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3427 sessionId:  describe result for acl check
2025-09-30T15:00:05.185808Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:05.185810Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:05.185812Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:05.185818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897187163463485:5730] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:05.186439Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897187163463485:5730] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:05.189647Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897187163463485:5730] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:05.194686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897187163463485:5730] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:05.194710Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897187163463485:5730] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:05.194714Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897187163463485:5730] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:05.194722Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3427 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:05.215453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:05.219809Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:05.220086Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:05.220102Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:05.220117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:05.220217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:05.220268Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897187073658415:13680]
2025-09-30T15:00:05.220992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:05.221589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:05.221664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:05.222062Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:05.222166Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.222174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.222175Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.222176Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.222178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.222179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.222180Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.222182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.222183Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.222184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.222185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.222187Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.222188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.222189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.222191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.222199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.222210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.222215Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.222219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.222223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.222227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.222231Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.222236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.222240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.222245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.222249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.222253Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.222257Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.222260Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.222264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.222273Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.222281Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.222299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.222306Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.222315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.222320Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.222325Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.222330Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.222336Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.222341Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.222345Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.222351Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.222358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.222365Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.222372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.222377Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.222384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.222396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.222400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.222406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.222419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.222425Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.222435Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.222440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.222446Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.222455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.222463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.222467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.222477Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.222483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.222537Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:05.228858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:05.230239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:05.230265Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:05.230267Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:05.230271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:05.230279Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3426 [2:7555897187073658415:13680]
2025-09-30T15:00:05.230297Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:05.230313Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:05.230316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:05.230319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:05.230321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:05.230339Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:05.230347Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:05.230354Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:05.230418Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.230429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.230431Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.230434Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:05.230438Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:05.230524Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:05.230533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.230548Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.230560Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.230576Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:05.230595Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897187073658410:13680]
2025-09-30T15:00:05.230597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897187073658410:13680]
2025-09-30T15:00:05.230599Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897187073658410:13680]
2025-09-30T15:00:05.230608Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:05.230739Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3426
2025-09-30T15:00:05.230801Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3426
2025-09-30T15:00:05.230624Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:05.230633Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:05.230636Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:05.230639Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:05.230642Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:05.230645Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:05.230657Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163463472:2454], now have 1 active actors on pipe
2025-09-30T15:00:05.230697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163463540:5730], now have 1 active actors on pipe
2025-09-30T15:00:05.230699Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897187073658410:13680]
2025-09-30T15:00:05.230710Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:05.230723Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:05.231592Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3427 partition: 0 MaxSeqNo: 42 sessionId: src_id|8decae0d-d791d244-1020746d-77730a17_0
2025-09-30T15:00:05.232051Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|bc0d6e03-b29e6de9-216fb6bb-33e6a607_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|8decae0d-d791d244-1020746d-77730a17_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:05.230968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.230994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.231020Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|8decae0d-d791d244-1020746d-77730a17_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:05.231028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:05.231032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:05.231035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:05.231047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:05.231060Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:05.231078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:05.231455Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.231482Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.231503Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:05.235225Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8decae0d-d791d244-1020746d-77730a17_0] Write session: try to update token
2025-09-30T15:00:05.235496Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8decae0d-d791d244-1020746d-77730a17_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:05.245549Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:05.245572Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:05.245575Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:05.245578Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:05.245588Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897187073658410:13680]
2025-09-30T15:00:05.245593Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897187073658410:13680]
2025-09-30T15:00:05.245597Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897187073658410:13680]
2025-09-30T15:00:05.245645Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:05.245653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.245655Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:05.245820Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:05.246114Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:05.246133Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:05.246137Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:05.253872Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3427 sessionId: src_id|8decae0d-d791d244-1020746d-77730a17_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:05.257047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:05.277363Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897187163463750:5444]
2025-09-30T15:00:05.277606Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 25 pipe creation result: OK TabletId: 72075186224037892 Generation: 3426, pipe: [1:7555897187163463750:5444]
2025-09-30T15:00:05.366658Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:05.367093Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.367118Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.367145Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163463750:5444], now have 1 active actors on pipe
2025-09-30T15:00:05.367744Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:05.368174Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8decae0d-d791d244-1020746d-77730a17_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:05.368199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8decae0d-d791d244-1020746d-77730a17_0] Write session will restart in 0.009813s
2025-09-30T15:00:05.368227Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8decae0d-d791d244-1020746d-77730a17_0] Write session: Do CDS request
2025-09-30T15:00:05.368234Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8decae0d-d791d244-1020746d-77730a17_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:05.367665Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 25 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897187163463750:5444]
2025-09-30T15:00:05.367713Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:05.367716Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:05.367800Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3427 reason: error at write: Disconnected sessionId: src_id|8decae0d-d791d244-1020746d-77730a17_0
2025-09-30T15:00:05.367999Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3427 sessionId: src_id|8decae0d-d791d244-1020746d-77730a17_0 is DEAD
2025-09-30T15:00:05.368010Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:05.379802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|8decae0d-d791d244-1020746d-77730a17_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:05.379932Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:05.379985Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3428
2025-09-30T15:00:05.380174Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3428 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:05.380230Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3428 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:05.380248Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3428 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:05.380255Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:05.380855Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3428 sessionId:  describe result for acl check
2025-09-30T15:00:05.380930Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:05.380943Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:05.380946Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:05.380957Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897187163463793:5751] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:05.381781Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897187163463793:5751] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:05.385407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897187163463793:5751] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:05.391579Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897187163463793:5751] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:05.391605Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897187163463793:5751] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:05.391610Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897187163463793:5751] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:05.391625Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3428 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:05.410863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:05.414480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:05.414769Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:05.414783Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:05.414798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:05.414868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:05.414919Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897187073658724:13695]
2025-09-30T15:00:05.415706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:05.416254Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:05.416317Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:05.416761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:05.416836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.416838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.416839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.416840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.416842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.416843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.416845Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.416847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.416849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.416850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.416851Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.416853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.416854Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.416856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.416857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.416864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.416876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.416881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.416885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.416890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.416895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.416899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.416904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.416908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.416915Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.416919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.416924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.416928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.416932Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.416937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.416945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.416955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.416963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.416969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.416975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.416981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.416987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.416993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.416999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.417006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.417011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.417017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.417025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.417034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.417040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.417046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.417051Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.417057Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.417063Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.417069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.417075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.417082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.417087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.417093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.417100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.417106Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.417111Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.417117Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.417127Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.417132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.417181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:05.423629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:05.425250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:05.425275Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:05.425278Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:05.425283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:05.425290Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3427 [2:7555897187073658724:13695]
2025-09-30T15:00:05.425310Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:05.425332Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:05.425335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:05.425339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:05.425342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:05.425362Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:05.425369Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:05.425377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:05.425466Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.425476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.425478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.425482Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:05.425485Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:05.425566Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:05.425575Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.425590Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.425608Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.425630Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:05.425649Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897187073658719:13695]
2025-09-30T15:00:05.425657Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897187073658719:13695]
2025-09-30T15:00:05.425659Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897187073658719:13695]
2025-09-30T15:00:05.425679Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:05.425703Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:05.425718Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:05.425727Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:05.425765Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:05.425769Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897187073658719:13695]
2025-09-30T15:00:05.425771Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:05.425779Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:05.425783Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:05.425792Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:05.425949Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163463876:5751], now have 1 active actors on pipe
2025-09-30T15:00:05.425959Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163463777:2454], now have 1 active actors on pipe
2025-09-30T15:00:05.426048Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3427
2025-09-30T15:00:05.426055Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3427
2025-09-30T15:00:05.426365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.426390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.426423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|77a2b4e9-307b3018-73677f45-50d2b573_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:05.426433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:05.426437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:05.426441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:05.426453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:05.426468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:05.426486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:05.426829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.426844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.426871Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:05.427078Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3428 partition: 0 MaxSeqNo: 42 sessionId: src_id|77a2b4e9-307b3018-73677f45-50d2b573_0
2025-09-30T15:00:05.427761Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|8decae0d-d791d244-1020746d-77730a17_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|77a2b4e9-307b3018-73677f45-50d2b573_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:05.430800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a2b4e9-307b3018-73677f45-50d2b573_0] Write session: try to update token
2025-09-30T15:00:05.430824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a2b4e9-307b3018-73677f45-50d2b573_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:05.440184Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T15:00:05.440209Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:05.440220Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897187073658719:13695]
2025-09-30T15:00:05.440283Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T15:00:05.440494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T15:00:05.440662Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:05.440799Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:05.441025Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:05.441311Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T15:00:05.441355Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T15:00:05.441621Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T15:00:05.450186Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3428 sessionId: src_id|77a2b4e9-307b3018-73677f45-50d2b573_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:05.452882Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:05.452904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:05.452907Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:05.452909Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:05.452919Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897187073658719:13695]
2025-09-30T15:00:05.452924Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897187073658719:13695]
2025-09-30T15:00:05.452929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897187073658719:13695]
2025-09-30T15:00:05.452968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:05.452976Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.452979Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:05.452984Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:05.452991Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:05.453000Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:05.453149Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:05.453658Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:05.467857Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897187163464061:5444]
2025-09-30T15:00:05.468249Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 26 pipe creation result: OK TabletId: 72075186224037892 Generation: 3427, pipe: [1:7555897187163464061:5444]
2025-09-30T15:00:05.572143Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:05.572964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.572986Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.573012Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163464061:5444], now have 1 active actors on pipe
2025-09-30T15:00:05.573250Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:05.574223Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a2b4e9-307b3018-73677f45-50d2b573_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T15:00:05.574236Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a2b4e9-307b3018-73677f45-50d2b573_0] Write session will restart in 0.005169s
2025-09-30T15:00:05.573707Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T15:00:05.573847Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3428 reason: status is not ok: tablet will be restarted right now sessionId: src_id|77a2b4e9-307b3018-73677f45-50d2b573_0
2025-09-30T15:00:05.573883Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:05.574263Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a2b4e9-307b3018-73677f45-50d2b573_0] Write session: Do CDS request
2025-09-30T15:00:05.573934Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 26 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897187163464061:5444]
2025-09-30T15:00:05.574039Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3428 sessionId: src_id|77a2b4e9-307b3018-73677f45-50d2b573_0 is DEAD
2025-09-30T15:00:05.574269Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a2b4e9-307b3018-73677f45-50d2b573_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:05.580808Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|77a2b4e9-307b3018-73677f45-50d2b573_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:05.581069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:05.581091Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3429
2025-09-30T15:00:05.581276Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3429 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:05.581326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3429 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:05.581339Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3429 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:05.581344Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:05.581965Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3429 sessionId:  describe result for acl check
2025-09-30T15:00:05.582013Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:05.582019Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:05.582021Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:05.582028Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897187163464077:5754] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:05.582607Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897187163464077:5754] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:05.585163Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897187163464077:5754] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:05.589312Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897187163464077:5754] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:05.589333Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897187163464077:5754] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:05.589337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897187163464077:5754] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:05.589348Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3429 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:05.610710Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:05.614253Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:05.614548Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:05.614561Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:05.614574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:05.614634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:05.614693Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897187073658998:13697]
2025-09-30T15:00:05.617856Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:05.618547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:05.618629Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:05.619075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:05.619174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.619184Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.619188Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.619189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.619191Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.619194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.619196Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.619198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.619199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.619200Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.619202Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.619203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.619207Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.619210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.619212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.619220Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.619230Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.619235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.619239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.619264Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.619272Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.619276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.619279Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.619283Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.619289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.619293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.619297Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.619300Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.619304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.619308Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.619324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.619332Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.619340Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.619346Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.619356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.619364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.619369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.619375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.619380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.619386Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.619394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.619402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.619408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.619413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.619418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.619423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.619429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.619434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.619450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.619458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.619479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.619485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.619490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.619495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.619500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.619505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.619509Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.619514Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.619527Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.619532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.619577Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:05.630522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:05.632925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:05.632952Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:05.632959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:05.632964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:05.632973Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3428 [2:7555897187073658998:13697]
2025-09-30T15:00:05.632993Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:05.633017Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:05.633023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:05.633026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:05.633030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:05.633562Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3428
2025-09-30T15:00:05.633049Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:05.633065Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:05.633072Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:05.633159Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.633164Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.633166Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.633169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:05.633173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:05.633289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:05.633292Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.633312Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.633323Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.633340Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:05.633363Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897187073658993:13697]
2025-09-30T15:00:05.633366Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897187073658993:13697]
2025-09-30T15:00:05.633368Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897187073658993:13697]
2025-09-30T15:00:05.633380Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:05.633397Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:05.633413Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:05.633416Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:05.633415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:05.633420Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:05.633426Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:05.633853Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163464141:5754], now have 1 active actors on pipe
2025-09-30T15:00:05.633869Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163464064:2454], now have 1 active actors on pipe
2025-09-30T15:00:05.633874Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897187073658993:13697]
2025-09-30T15:00:05.633889Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:05.633800Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3428
2025-09-30T15:00:05.634020Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:05.634192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.634206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.634244Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:05.634270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:05.634282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:05.634285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:05.634300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:05.634321Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:05.634351Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:05.635707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.635729Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.635767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:05.638474Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3429 partition: 0 MaxSeqNo: 42 sessionId: src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0
2025-09-30T15:00:05.638933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|77a2b4e9-307b3018-73677f45-50d2b573_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:05.642434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0] Write session: try to update token
2025-09-30T15:00:05.642463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:05.650798Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:05.650823Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:05.650826Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:05.650828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:05.650846Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897187073658993:13697]
2025-09-30T15:00:05.650853Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897187073658993:13697]
2025-09-30T15:00:05.650857Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897187073658993:13697]
2025-09-30T15:00:05.650905Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:05.650919Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.650922Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:05.650938Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:05.650959Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:05.650966Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:05.651576Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:05.665519Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3429 sessionId: src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:05.668740Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:05.674324Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897187163464345:5444]
2025-09-30T15:00:05.676421Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 27 pipe creation result: OK TabletId: 72075186224037892 Generation: 3428, pipe: [1:7555897187163464345:5444]
2025-09-30T15:00:05.771363Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:05.772055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.772073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.772096Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163464345:5444], now have 1 active actors on pipe
2025-09-30T15:00:05.772399Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:05.772398Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 27 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897187163464345:5444]
2025-09-30T15:00:05.772440Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:05.772443Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:05.772509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3429 reason: error at write: Disconnected sessionId: src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0
2025-09-30T15:00:05.772685Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3429 sessionId: src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0 is DEAD
2025-09-30T15:00:05.772729Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:05.773189Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:05.773199Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0] Write session will restart in 0.009287s
2025-09-30T15:00:05.773228Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0] Write session: Do CDS request
2025-09-30T15:00:05.773238Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:05.783819Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:05.784270Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:05.784291Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3430
2025-09-30T15:00:05.784565Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3430 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:05.784605Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3430 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:05.784620Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3430 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:05.784635Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:05.785194Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3430 sessionId:  describe result for acl check
2025-09-30T15:00:05.785240Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:05.785243Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:05.785244Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:05.785251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897187163464362:5759] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:05.785853Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897187163464362:5759] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:05.799450Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897187163464362:5759] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:05.809568Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897187163464362:5759] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:05.809596Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897187163464362:5759] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:05.809600Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897187163464362:5759] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:05.809610Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3430 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:05.836752Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:05.843492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:05.843826Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:05.843840Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:05.843855Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:05.843935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:05.844008Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897187073659285:13701]
2025-09-30T15:00:05.844726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:05.845299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:05.845356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:05.845656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:05.845714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.845721Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.845723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.845724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.845726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.845727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.845729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.845730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.845732Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.845733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.845734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.845736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.845737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.845739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.845740Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.845747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.845755Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.845758Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.845761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.845763Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.845766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.845769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.845771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.845774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.845777Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.845779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.845782Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.845784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.845786Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.845789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.845798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.845803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:05.845807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.845811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:05.845814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.845817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:05.845821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.845825Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:05.845829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.845833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:05.845836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.845840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:05.845843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.845846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:05.845849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.845852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:05.845857Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.845861Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:05.845864Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.845867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:05.845870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.845873Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.845876Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.845879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.845884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.845887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.845890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.845892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:05.845895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.845898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:05.845928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:05.857247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:05.858726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:05.858746Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:05.858748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:05.858751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:05.858756Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3429 [2:7555897187073659285:13701]
2025-09-30T15:00:05.858769Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:05.858784Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:05.858786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:05.858788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:05.858789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:05.858803Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:05.858808Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:05.858814Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:05.858871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.858877Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.858879Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.858881Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:05.858883Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:05.858938Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:05.858941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.858957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:05.858971Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:05.858981Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:05.858996Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897187073659280:13701]
2025-09-30T15:00:05.859002Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897187073659280:13701]
2025-09-30T15:00:05.859005Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897187073659280:13701]
2025-09-30T15:00:05.859011Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:05.859021Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:05.859031Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:05.859037Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:05.859050Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:05.859062Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:05.859067Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:05.859073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163464439:5759], now have 1 active actors on pipe
2025-09-30T15:00:05.859079Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897187073659280:13701]
2025-09-30T15:00:05.859082Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:05.859086Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:05.859095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163464347:2454], now have 1 active actors on pipe
2025-09-30T15:00:05.859349Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3429
2025-09-30T15:00:05.859390Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3429
2025-09-30T15:00:05.859616Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.859634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.859666Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:05.859674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:05.859678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:05.859680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:05.859689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:05.859700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:05.859715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:05.859967Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:05.859976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:05.859994Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:05.860779Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|dff6d0d8-87c066ac-fc925aad-c9aafd86_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:05.860315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3430 partition: 0 MaxSeqNo: 42 sessionId: src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0
2025-09-30T15:00:05.863826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0] Write session: try to update token
2025-09-30T15:00:05.863854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:05.872321Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897187163464629:5444]
2025-09-30T15:00:05.875925Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897187163464629:5444], now have 1 active actors on pipe
2025-09-30T15:00:05.876045Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 28 pipe creation result: OK TabletId: 72075186224037892 Generation: 3429, pipe: [1:7555897187163464629:5444]
2025-09-30T15:00:05.889890Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:05.889915Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:05.889917Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:05.889919Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:05.889931Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897187073659280:13701]
2025-09-30T15:00:05.889936Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897187073659280:13701]
2025-09-30T15:00:05.889940Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897187073659280:13701]
2025-09-30T15:00:05.889987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:05.889996Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:05.889999Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:05.890008Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:05.890016Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:05.890021Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:05.890248Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:05.896367Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3430 sessionId: src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:05.899521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:06.011663Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:06.012015Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.012035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.013293Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:06.013309Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 28 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897187163464629:5444]
2025-09-30T15:00:06.013328Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:06.013339Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:06.013418Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3430 reason: error at write: Disconnected sessionId: src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0
2025-09-30T15:00:06.013779Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:06.013874Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:06.013886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0] Write session will restart in 0.009739s
2025-09-30T15:00:06.013913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0] Write session: Do CDS request
2025-09-30T15:00:06.013920Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:06.013616Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3430 sessionId: src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0 is DEAD
2025-09-30T15:00:06.024946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:06.025237Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:06.025259Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3431
2025-09-30T15:00:06.025461Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3431 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:06.025500Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3431 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:06.025509Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3431 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:06.025514Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:06.025968Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3431 sessionId:  describe result for acl check
2025-09-30T15:00:06.026009Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:06.026020Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:06.026022Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:06.026029Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897191458431960:5775] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:06.026660Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897191458431960:5775] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:06.033090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897191458431960:5775] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:06.038658Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897191458431960:5775] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:06.038686Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897191458431960:5775] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:06.038689Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897191458431960:5775] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:06.038700Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3431 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:06.051475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:06.055494Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:06.055758Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:06.055773Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:06.055788Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:06.055878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:06.055924Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897191368626855:13703]
2025-09-30T15:00:06.056619Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:06.057144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:06.057201Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:06.057562Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:06.057635Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.057641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.057643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.057644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.057646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.057647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.057648Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.057650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.057652Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.057653Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.057655Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.057656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.057657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.057659Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.057660Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.057666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.057677Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.057681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.057685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.057688Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.057692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.057696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.057701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.057705Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.057712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.057716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.057719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.057723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.057727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.057731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.057739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.057747Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.057754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.057760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.057766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.057771Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.057779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.057785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.057790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.057794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.057808Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.057813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.057819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.057824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.057829Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.057835Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.057846Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.057852Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.057862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.057868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.057878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.057884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.057893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.057901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.057910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.057916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.057925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.057931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.057936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.057942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.057991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:06.064025Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:06.065668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:06.065687Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:06.065690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:06.065694Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:06.065701Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3430 [2:7555897191368626855:13703]
2025-09-30T15:00:06.065718Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:06.065737Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:06.065740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:06.065743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:06.065745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:06.065765Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:06.065772Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:06.065780Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:06.065853Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.065863Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.065866Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.065869Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:06.065871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:06.065946Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:06.065954Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.065969Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.065985Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.066000Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:06.066022Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897191368626850:13703]
2025-09-30T15:00:06.066027Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897191368626850:13703]
2025-09-30T15:00:06.066028Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897191368626850:13703]
2025-09-30T15:00:06.066045Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:06.066063Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:06.066082Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:06.066091Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:06.066127Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:06.066132Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897191368626850:13703]
2025-09-30T15:00:06.066135Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:06.066140Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:06.066143Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:06.066150Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:06.066432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458431944:2454], now have 1 active actors on pipe
2025-09-30T15:00:06.066446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458432067:5775], now have 1 active actors on pipe
2025-09-30T15:00:06.066551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3430
2025-09-30T15:00:06.066567Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3430
2025-09-30T15:00:06.066917Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.066932Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.066960Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:06.066977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:06.066982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:06.066985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:06.066996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:06.067010Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:06.067033Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:06.067439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.067450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.067465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:06.067612Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3431 partition: 0 MaxSeqNo: 42 sessionId: src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0
2025-09-30T15:00:06.068037Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1c999f19-20e3d74b-9dfcc792-5f872ae1_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:06.071098Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0] Write session: try to update token
2025-09-30T15:00:06.071122Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:06.082880Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T15:00:06.082904Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:06.082915Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897191368626850:13703]
2025-09-30T15:00:06.082966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T15:00:06.082973Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T15:00:06.083270Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T15:00:06.083447Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:06.083619Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:06.083774Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:06.084007Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T15:00:06.084066Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T15:00:06.093335Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3431 sessionId: src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:06.095954Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:06.095976Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:06.095979Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:06.095981Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:06.095992Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897191368626850:13703]
2025-09-30T15:00:06.095998Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897191368626850:13703]
2025-09-30T15:00:06.096003Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897191368626850:13703]
2025-09-30T15:00:06.096048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:06.096056Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.096059Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:06.096058Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:06.096065Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:06.096069Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:06.096212Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:06.096448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:06.114574Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897191458432223:5444]
2025-09-30T15:00:06.115077Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 29 pipe creation result: OK TabletId: 72075186224037892 Generation: 3430, pipe: [1:7555897191458432223:5444]
2025-09-30T15:00:06.213276Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:06.213693Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.213707Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.213731Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458432223:5444], now have 1 active actors on pipe
2025-09-30T15:00:06.214166Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:06.214213Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 29 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897191458432223:5444]
2025-09-30T15:00:06.214257Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:06.214302Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T15:00:06.214402Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3431 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0
2025-09-30T15:00:06.214621Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3431 sessionId: src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0 is DEAD
2025-09-30T15:00:06.214812Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T15:00:06.214823Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0] Write session will restart in 0.005237s
2025-09-30T15:00:06.214865Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0] Write session: Do CDS request
2025-09-30T15:00:06.214872Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:06.221844Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:06.221988Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:06.222010Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3432
2025-09-30T15:00:06.222201Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3432 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:06.222254Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3432 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:06.222260Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3432 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:06.222265Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:06.222779Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3432 sessionId:  describe result for acl check
2025-09-30T15:00:06.222824Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:06.222826Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:06.222829Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:06.222835Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897191458432239:5784] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:06.223504Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897191458432239:5784] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:06.225692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897191458432239:5784] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:06.229949Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897191458432239:5784] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:06.229971Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897191458432239:5784] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:06.229975Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897191458432239:5784] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:06.229983Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3432 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:06.249446Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:06.253515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:06.253840Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:06.253846Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:06.253860Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:06.253941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:06.254040Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897191368627132:13705]
2025-09-30T15:00:06.254766Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:06.255305Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:06.255389Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:06.255785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:06.255878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.255886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.255888Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.255889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.255891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.255892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.255894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.255895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.255897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.255898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.255900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.255901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.255903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.255904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.255906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.255912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.255924Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.255930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.255934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.255939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.255943Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.255948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.255952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.255957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.255964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.255968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.255973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.255978Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.255982Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.255985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.256013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.256024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.256037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.256044Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.256054Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.256064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.256074Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.256080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.256085Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.256110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.256122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.256128Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.256134Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.256140Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.256145Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.256151Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.256156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.256162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.256169Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.256174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.256179Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.256185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.256189Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.256194Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.256199Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.256205Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.256210Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.256216Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.256221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.256227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.256276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:06.263375Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:06.264962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:06.264984Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:06.264987Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:06.264992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:06.264999Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3431 [2:7555897191368627132:13705]
2025-09-30T15:00:06.265016Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:06.265035Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:06.265038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:06.265041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:06.265043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:06.265061Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:06.265069Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:06.265076Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:06.265161Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.265169Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.265173Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.265177Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:06.265180Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:06.265257Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:06.265265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.265279Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.265289Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.265304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:06.265322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897191368627127:13705]
2025-09-30T15:00:06.265330Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897191368627127:13705]
2025-09-30T15:00:06.265332Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897191368627127:13705]
2025-09-30T15:00:06.265345Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:06.265360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458432324:5784], now have 1 active actors on pipe
2025-09-30T15:00:06.265360Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:06.265364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:06.265366Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:06.265369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458432226:2454], now have 1 active actors on pipe
2025-09-30T15:00:06.265377Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:06.265390Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:06.265394Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:06.265435Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897191368627127:13705]
2025-09-30T15:00:06.265449Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:06.265451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3431
2025-09-30T15:00:06.265460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3431
2025-09-30T15:00:06.265485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:06.265682Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.265689Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.265715Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:06.265723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:06.265735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:06.265737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:06.265748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:06.265764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:06.265787Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:06.266000Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.266018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.266061Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:06.266180Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3432 partition: 0 MaxSeqNo: 42 sessionId: src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0
2025-09-30T15:00:06.266594Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ca800c4c-69ce13b-78ad0ec3-bea18541_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:06.269676Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0] Write session: try to update token
2025-09-30T15:00:06.269699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:06.280265Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:06.280290Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:06.280293Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:06.280296Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:06.280308Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897191368627127:13705]
2025-09-30T15:00:06.280315Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897191368627127:13705]
2025-09-30T15:00:06.280322Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897191368627127:13705]
2025-09-30T15:00:06.280399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:06.280408Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:06.280412Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.280415Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:06.280416Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:06.280420Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:06.280620Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:06.290785Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3432 sessionId: src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:06.294235Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:06.315327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897191458432509:5444]
2025-09-30T15:00:06.315745Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 30 pipe creation result: OK TabletId: 72075186224037892 Generation: 3431, pipe: [1:7555897191458432509:5444]
2025-09-30T15:00:06.401575Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:06.402198Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.402218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.402242Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458432509:5444], now have 1 active actors on pipe
2025-09-30T15:00:06.402554Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:06.402572Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:06.402634Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3432 reason: error at write: Disconnected sessionId: src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0
2025-09-30T15:00:06.402549Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:06.402814Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3432 sessionId: src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0 is DEAD
2025-09-30T15:00:06.402994Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:06.403005Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0] Write session will restart in 0.009486s
2025-09-30T15:00:06.403032Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0] Write session: Do CDS request
2025-09-30T15:00:06.403039Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:06.402962Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:06.402998Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 30 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897191458432509:5444]
2025-09-30T15:00:06.413963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:06.413970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:06.413990Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3433
2025-09-30T15:00:06.415264Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3433 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:06.415319Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3433 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:06.415326Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3433 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:06.415331Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:06.415927Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3433 sessionId:  describe result for acl check
2025-09-30T15:00:06.415983Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:06.415986Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:06.415989Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:06.415999Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897191458432558:5812] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:06.416652Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897191458432558:5812] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:06.422167Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897191458432558:5812] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:06.428221Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897191458432558:5812] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:06.428247Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897191458432558:5812] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:06.428251Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897191458432558:5812] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:06.428261Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3433 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:06.441161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:06.446721Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:06.446986Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:06.447000Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:06.447011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:06.447076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:06.447132Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897191368627446:13718]
2025-09-30T15:00:06.447821Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:06.448395Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:06.448465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:06.448839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:06.448946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.448954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.448955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.448956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.448958Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.448959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.448961Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.448962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.448964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.448964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.448966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.448968Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.448969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.448970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.448971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.448979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.448989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.448993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.448998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.449001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.449005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.449009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.449012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.449016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.449020Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.449024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.449028Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.449033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.449037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.449041Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.449052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.449061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.449068Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.449073Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.449080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.449086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.449094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.449099Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.449104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.449109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.449114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.449120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.449125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.449142Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.449146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.449152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.449158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.449163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.449167Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.449173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.449178Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.449193Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.449198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.449204Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.449208Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.449214Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.449219Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.449224Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.449235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.449241Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.449292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:06.456925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:06.458358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:06.458383Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:06.458387Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:06.458391Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:06.458400Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3432 [2:7555897191368627446:13718]
2025-09-30T15:00:06.458419Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:06.458437Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:06.458440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:06.458444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:06.458446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:06.458463Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:06.458471Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:06.458477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:06.458552Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.458563Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.458565Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.458572Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:06.458574Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:06.458654Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:06.458663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.458679Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.458697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.458720Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:06.458740Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897191368627439:13718]
2025-09-30T15:00:06.458752Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897191368627439:13718]
2025-09-30T15:00:06.458755Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897191368627439:13718]
2025-09-30T15:00:06.458766Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:06.458784Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:06.458800Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:06.458803Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:06.458806Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:06.458809Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:06.458811Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:06.458845Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897191368627439:13718]
2025-09-30T15:00:06.458864Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:06.458876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458432693:5812], now have 1 active actors on pipe
2025-09-30T15:00:06.458885Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458432530:2454], now have 1 active actors on pipe
2025-09-30T15:00:06.458890Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:06.459125Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3432
2025-09-30T15:00:06.459213Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3432
2025-09-30T15:00:06.459315Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.459344Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.459372Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4ed53924-b25f328c-14031431-d836eb58_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:06.459382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:06.459386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:06.459390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:06.459402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:06.459417Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:06.459435Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:06.459631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.459655Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.459684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:06.459842Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3433 partition: 0 MaxSeqNo: 42 sessionId: src_id|4ed53924-b25f328c-14031431-d836eb58_0
2025-09-30T15:00:06.460935Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|6e51a1a4-43e67e95-a4058391-48aee99d_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|4ed53924-b25f328c-14031431-d836eb58_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:06.464277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed53924-b25f328c-14031431-d836eb58_0] Write session: try to update token
2025-09-30T15:00:06.464305Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed53924-b25f328c-14031431-d836eb58_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:06.478446Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T15:00:06.478471Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:06.478483Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897191368627439:13718]
2025-09-30T15:00:06.478541Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T15:00:06.478559Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T15:00:06.478840Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T15:00:06.479023Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:06.479188Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:06.479545Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:06.479810Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T15:00:06.479872Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T15:00:06.484927Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:06.484953Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:06.484956Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:06.484958Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:06.484968Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897191368627439:13718]
2025-09-30T15:00:06.484972Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897191368627439:13718]
2025-09-30T15:00:06.484976Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897191368627439:13718]
2025-09-30T15:00:06.485021Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:06.485030Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.485033Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:06.485036Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:06.485044Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:06.485049Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:06.485184Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:06.492721Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3433 sessionId: src_id|4ed53924-b25f328c-14031431-d836eb58_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:06.495734Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:06.503121Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897191458432826:5444]
2025-09-30T15:00:06.503705Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 31 pipe creation result: OK TabletId: 72075186224037892 Generation: 3432, pipe: [1:7555897191458432826:5444]
2025-09-30T15:00:06.602418Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:06.603115Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.603130Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.603153Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458432826:5444], now have 1 active actors on pipe
2025-09-30T15:00:06.603602Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:06.603621Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:06.603703Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3433 reason: error at write: Disconnected sessionId: src_id|4ed53924-b25f328c-14031431-d836eb58_0
2025-09-30T15:00:06.603903Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:06.603947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 31 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897191458432826:5444]
2025-09-30T15:00:06.604140Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed53924-b25f328c-14031431-d836eb58_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:06.604153Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed53924-b25f328c-14031431-d836eb58_0] Write session will restart in 0.007359s
2025-09-30T15:00:06.604185Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed53924-b25f328c-14031431-d836eb58_0] Write session: Do CDS request
2025-09-30T15:00:06.604191Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed53924-b25f328c-14031431-d836eb58_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:06.604053Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3433 sessionId: src_id|4ed53924-b25f328c-14031431-d836eb58_0 is DEAD
2025-09-30T15:00:06.603589Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:06.614293Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed53924-b25f328c-14031431-d836eb58_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:06.614650Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:06.614675Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3434
2025-09-30T15:00:06.614818Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3434 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:06.614875Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3434 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:06.614892Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3434 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:06.614908Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:06.615538Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3434 sessionId:  describe result for acl check
2025-09-30T15:00:06.615584Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:06.615586Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:06.615588Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:06.615595Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897191458432839:5814] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:06.616224Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897191458432839:5814] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:06.620672Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897191458432839:5814] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:06.634381Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897191458432839:5814] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:06.634403Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897191458432839:5814] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:06.634407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897191458432839:5814] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:06.634416Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3434 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:06.652870Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:06.656933Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:06.657213Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:06.657219Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:06.657232Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:06.657314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:06.657360Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897191368627723:13722]
2025-09-30T15:00:06.657996Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:06.658394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:06.658456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:06.658805Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:06.658893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.658895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.658895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.658897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.658898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.658899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.658901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.658902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.658904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.658905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.658907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.658908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.658910Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.658911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.658913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.658919Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.658930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.658934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.658937Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.658941Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.658945Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.658949Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.658954Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.658959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.658963Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.658966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.658969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.658973Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.658976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.658980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.658991Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.658999Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.659006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.659011Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.659016Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.659022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.659027Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.659033Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.659043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.659049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.659055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.659061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.659066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.659072Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.659078Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.659083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.659088Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.659094Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.659098Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.659104Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.659108Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.659113Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.659118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.659126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.659130Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.659135Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.659139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.659144Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.659149Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.659155Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.659221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:06.665622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:06.667067Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:06.667088Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:06.667091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:06.667096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:06.667104Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3433 [2:7555897191368627723:13722]
2025-09-30T15:00:06.667121Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:06.667143Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:06.667146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:06.667149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:06.667152Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:06.667170Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:06.667178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:06.667193Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:06.667293Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.667295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.667298Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.667302Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:06.667305Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:06.667379Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:06.667388Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.667405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.667423Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.667445Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:06.667469Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897191368627718:13722]
2025-09-30T15:00:06.667472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897191368627718:13722]
2025-09-30T15:00:06.667474Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897191368627718:13722]
2025-09-30T15:00:06.667489Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:06.667499Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:06.667504Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:06.667507Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458432941:5814], now have 1 active actors on pipe
2025-09-30T15:00:06.667506Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:06.667511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458432828:2454], now have 1 active actors on pipe
2025-09-30T15:00:06.667520Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:06.667536Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:06.667539Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:06.667586Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897191368627718:13722]
2025-09-30T15:00:06.667599Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:06.667666Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3433
2025-09-30T15:00:06.667758Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3433
2025-09-30T15:00:06.667874Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:06.668126Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.668143Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.668172Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|95342d50-47c82316-ec8531d4-5507ee9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:06.668181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:06.668185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:06.668188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:06.668200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:06.668214Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:06.668231Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:06.668825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.668839Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.668863Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:06.669231Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3434 partition: 0 MaxSeqNo: 42 sessionId: src_id|95342d50-47c82316-ec8531d4-5507ee9_0
2025-09-30T15:00:06.669605Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|4ed53924-b25f328c-14031431-d836eb58_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|95342d50-47c82316-ec8531d4-5507ee9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:06.672711Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95342d50-47c82316-ec8531d4-5507ee9_0] Write session: try to update token
2025-09-30T15:00:06.672739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95342d50-47c82316-ec8531d4-5507ee9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:06.682192Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:06.682214Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:06.682218Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:06.682220Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:06.682230Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897191368627718:13722]
2025-09-30T15:00:06.682236Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897191368627718:13722]
2025-09-30T15:00:06.682244Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897191368627718:13722]
2025-09-30T15:00:06.682295Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:06.682304Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.682308Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:06.682309Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:06.682316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:06.682321Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:06.682472Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:06.694010Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3434 sessionId: src_id|95342d50-47c82316-ec8531d4-5507ee9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:06.697352Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:06.707432Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897191458433115:5444]
2025-09-30T15:00:06.707786Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 32 pipe creation result: OK TabletId: 72075186224037892 Generation: 3433, pipe: [1:7555897191458433115:5444]
2025-09-30T15:00:06.801334Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:06.801696Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.801718Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.801761Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458433115:5444], now have 1 active actors on pipe
2025-09-30T15:00:06.802828Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:06.803428Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:06.803448Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:06.803450Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 32 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897191458433115:5444]
2025-09-30T15:00:06.803471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:06.803528Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3434 reason: error at write: Disconnected sessionId: src_id|95342d50-47c82316-ec8531d4-5507ee9_0
2025-09-30T15:00:06.803724Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3434 sessionId: src_id|95342d50-47c82316-ec8531d4-5507ee9_0 is DEAD
2025-09-30T15:00:06.803913Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95342d50-47c82316-ec8531d4-5507ee9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:06.803931Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95342d50-47c82316-ec8531d4-5507ee9_0] Write session will restart in 0.005186s
2025-09-30T15:00:06.803972Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95342d50-47c82316-ec8531d4-5507ee9_0] Write session: Do CDS request
2025-09-30T15:00:06.803983Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95342d50-47c82316-ec8531d4-5507ee9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:06.810803Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|95342d50-47c82316-ec8531d4-5507ee9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:06.810831Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:06.810854Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3435
2025-09-30T15:00:06.811068Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3435 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:06.811123Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3435 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:06.811129Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3435 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:06.811133Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:06.811697Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3435 sessionId:  describe result for acl check
2025-09-30T15:00:06.811728Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:06.811730Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:06.811732Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:06.811739Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897191458433129:5835] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:06.812407Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897191458433129:5835] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:06.815471Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897191458433129:5835] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:06.827473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897191458433129:5835] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:06.827499Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897191458433129:5835] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:06.827503Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897191458433129:5835] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:06.827513Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3435 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:06.842408Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:06.846670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:06.846942Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:06.846957Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:06.846971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:06.847046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:06.847091Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897191368628016:13726]
2025-09-30T15:00:06.847783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:06.848773Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:06.848847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:06.849261Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:06.849344Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.849353Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.849354Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.849355Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.849356Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.849358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.849360Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.849361Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.849363Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.849364Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.849366Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.849367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.849369Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.849370Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.849371Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.849378Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.849388Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.849392Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.849397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.849402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.849405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.849409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.849412Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.849417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.849423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.849428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.849432Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.849436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.849440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.849444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.849456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.849465Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:06.849472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.849478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:06.849485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.849490Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:06.849495Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.849500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:06.849505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.849511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:06.849516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.849521Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:06.849528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.849534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:06.849538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.849543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:06.849550Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.849556Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:06.849561Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.849566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:06.849571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.849576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.849589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.849595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.849606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.849612Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.849625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.849633Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:06.849638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.849647Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:06.849695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:06.855751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:06.857417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:06.857446Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:06.857449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:06.857453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:06.857460Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3434 [2:7555897191368628016:13726]
2025-09-30T15:00:06.857484Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:06.857505Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:06.857511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:06.857514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:06.857516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:06.857537Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:06.857554Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:06.857562Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:06.857641Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.857650Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.857653Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.857657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:06.857659Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:06.857737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:06.857747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.857761Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:06.857772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:06.857790Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:06.857812Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458433230:5835], now have 1 active actors on pipe
2025-09-30T15:00:06.857824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458433117:2454], now have 1 active actors on pipe
2025-09-30T15:00:06.857831Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897191368628011:13726]
2025-09-30T15:00:06.857833Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897191368628011:13726]
2025-09-30T15:00:06.857835Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897191368628011:13726]
2025-09-30T15:00:06.857848Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:06.857860Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:06.857862Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:06.857863Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:06.857864Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:06.857877Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:06.857880Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:06.857926Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897191368628011:13726]
2025-09-30T15:00:06.857944Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:06.857973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:06.857969Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3434
2025-09-30T15:00:06.857971Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3434
2025-09-30T15:00:06.858219Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.858236Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.858270Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:06.858288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:06.858292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:06.858294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:06.858306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:06.858319Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:06.858343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:06.858741Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.858754Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.858776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:06.858967Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3435 partition: 0 MaxSeqNo: 42 sessionId: src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0
2025-09-30T15:00:06.859490Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|95342d50-47c82316-ec8531d4-5507ee9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:06.862816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0] Write session: try to update token
2025-09-30T15:00:06.862842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:06.872730Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:06.872757Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:06.872759Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:06.872762Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:06.872773Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897191368628011:13726]
2025-09-30T15:00:06.872778Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897191368628011:13726]
2025-09-30T15:00:06.872782Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897191368628011:13726]
2025-09-30T15:00:06.872833Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:06.872847Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:06.872850Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:06.873025Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:06.875324Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:06.875348Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:06.875354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:06.885926Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3435 sessionId: src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:06.889356Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:06.903530Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897191458433406:5444]
2025-09-30T15:00:06.903947Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 33 pipe creation result: OK TabletId: 72075186224037892 Generation: 3434, pipe: [1:7555897191458433406:5444]
2025-09-30T15:00:06.992507Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:06.993131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:06.993152Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:06.993174Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458433406:5444], now have 1 active actors on pipe
2025-09-30T15:00:06.993547Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:06.993570Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:06.993657Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3435 reason: error at write: Disconnected sessionId: src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0
2025-09-30T15:00:06.993441Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:06.993848Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3435 sessionId: src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0 is DEAD
2025-09-30T15:00:06.993908Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:06.993950Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 33 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897191458433406:5444]
2025-09-30T15:00:06.994358Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:06.994370Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0] Write session will restart in 0.007603s
2025-09-30T15:00:06.994395Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0] Write session: Do CDS request
2025-09-30T15:00:06.994405Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:07.002874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:07.002991Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:07.003011Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3436
2025-09-30T15:00:07.003171Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3436 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:07.003202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3436 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:07.003207Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3436 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:07.003211Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:07.004023Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3436 sessionId:  describe result for acl check
2025-09-30T15:00:07.004068Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:07.004070Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:07.004078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:07.004084Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897195753400726:5841] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:07.005400Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897195753400726:5841] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:07.008560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897195753400726:5841] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:07.013092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897195753400726:5841] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:07.013115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897195753400726:5841] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:07.013119Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897195753400726:5841] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:07.013128Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3436 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:07.046177Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:07.047131Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:07.047360Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:07.047365Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:07.047376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:07.047433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:07.047476Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897195663595591:13728]
2025-09-30T15:00:07.048212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:07.050791Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:07.050890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:07.051329Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:07.051431Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.051440Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.051441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.051442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.051444Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.051445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.051447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.051448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.051449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.051450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.051451Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.051452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.051454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.051455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.051456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.051463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.051473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.051478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.051481Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.051485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.051489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.051492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.051496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.051501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.051505Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.051508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.051511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.051515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.051518Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.051522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.051534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.051542Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.051549Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.051555Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.051560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.051564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.051568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.051573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.051578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.051584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.051589Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.051595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.051600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.051605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.051610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.051615Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.051622Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.051627Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.051631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.051636Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.051641Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.051657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.051663Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.051667Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.051672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.051676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.051681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.051685Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.051691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.051696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.051754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:07.058953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:07.060828Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3435
2025-09-30T15:00:07.060879Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3435
2025-09-30T15:00:07.060148Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:07.060173Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:07.060177Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:07.060182Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:07.060190Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3435 [2:7555897195663595591:13728]
2025-09-30T15:00:07.060210Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:07.060231Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:07.060235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:07.060240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:07.060242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:07.060262Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:07.060269Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:07.060278Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:07.060380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.060383Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.060385Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.060389Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:07.060392Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:07.060473Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:07.060476Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.060492Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.060504Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.060523Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:07.060542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897195663595585:13728]
2025-09-30T15:00:07.060545Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897195663595585:13728]
2025-09-30T15:00:07.060547Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897195663595585:13728]
2025-09-30T15:00:07.060557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:07.060574Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:07.060580Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:07.060587Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:07.060590Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:07.060594Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:07.060598Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:07.060646Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897191458433410:2454], now have 1 active actors on pipe
2025-09-30T15:00:07.060650Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753400780:5841], now have 1 active actors on pipe
2025-09-30T15:00:07.060653Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897195663595585:13728]
2025-09-30T15:00:07.060667Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:07.060738Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:07.061043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.061051Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.061081Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:07.061090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:07.061094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:07.061096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:07.061108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:07.061120Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:07.061137Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:07.064815Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.064840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.064879Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:07.067091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3436 partition: 0 MaxSeqNo: 42 sessionId: src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0
2025-09-30T15:00:07.067537Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d7d7bc9e-d09afe4a-d82abf15-eb080b2c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:07.070719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0] Write session: try to update token
2025-09-30T15:00:07.070743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:07.081161Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:07.081187Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:07.081190Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:07.081192Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:07.081203Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897195663595585:13728]
2025-09-30T15:00:07.081208Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897195663595585:13728]
2025-09-30T15:00:07.081212Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897195663595585:13728]
2025-09-30T15:00:07.081260Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:07.081268Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.081271Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:07.081437Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:07.082951Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:07.082961Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:07.082967Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:07.093942Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897195753401003:5444]
2025-09-30T15:00:07.094327Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 34 pipe creation result: OK TabletId: 72075186224037892 Generation: 3435, pipe: [1:7555897195753401003:5444]
2025-09-30T15:00:07.099168Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3436 sessionId: src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:07.102402Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:07.205059Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:07.205573Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753401003:5444], now have 1 active actors on pipe
2025-09-30T15:00:07.205647Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.205661Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.205970Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:07.206039Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 34 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897195753401003:5444]
2025-09-30T15:00:07.206047Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:07.206052Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:07.206271Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:07.206868Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3436 reason: error at write: Disconnected sessionId: src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0
2025-09-30T15:00:07.207225Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:07.207240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0] Write session will restart in 0.005310s
2025-09-30T15:00:07.207064Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3436 sessionId: src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0 is DEAD
2025-09-30T15:00:07.207280Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0] Write session: Do CDS request
2025-09-30T15:00:07.207317Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:07.213832Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:07.214286Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:07.214313Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3437
2025-09-30T15:00:07.214471Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3437 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:07.214535Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3437 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:07.214547Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3437 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:07.214552Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:07.215042Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3437 sessionId:  describe result for acl check
2025-09-30T15:00:07.215090Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:07.215092Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:07.215094Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:07.215101Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897195753401018:5844] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:07.215733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897195753401018:5844] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:07.218277Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897195753401018:5844] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:07.225536Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897195753401018:5844] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:07.225559Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897195753401018:5844] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:07.225563Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897195753401018:5844] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:07.225573Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3437 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:07.244119Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:07.247975Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:07.248232Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:07.248238Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:07.248250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:07.248324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:07.248375Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897195663595873:13730]
2025-09-30T15:00:07.249060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:07.249817Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:07.249903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:07.250292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:07.250402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.250410Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.250411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.250413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.250414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.250416Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.250417Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.250419Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.250420Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.250422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.250423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.250424Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.250426Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.250427Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.250428Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.250436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.250447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.250452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.250456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.250460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.250464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.250469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.250474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.250478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.250484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.250488Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.250493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.250496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.250500Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.250504Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.250516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.250526Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.250533Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.250540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.250547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.250553Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.250558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.250564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.250574Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.250580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.250584Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.250590Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.250595Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.250600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.250605Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.250610Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.250616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.250621Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.250628Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.250634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.250640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.250646Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.250651Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.250656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.250662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.250668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.250674Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.250680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.250686Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.250692Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.250761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:07.257815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:07.258974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:07.258999Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:07.259003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:07.259007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:07.259015Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3436 [2:7555897195663595873:13730]
2025-09-30T15:00:07.259034Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:07.259054Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:07.259057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:07.259060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:07.259063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:07.259082Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:07.259089Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:07.259097Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:07.259171Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.259183Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.259185Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.259188Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:07.259191Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:07.259291Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:07.259300Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.259315Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.259333Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.259357Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:07.259382Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897195663595868:13730]
2025-09-30T15:00:07.259385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897195663595868:13730]
2025-09-30T15:00:07.259388Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897195663595868:13730]
2025-09-30T15:00:07.259398Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:07.259411Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:07.259415Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:07.259418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753401006:2454], now have 1 active actors on pipe
2025-09-30T15:00:07.259418Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:07.259422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753401082:5844], now have 1 active actors on pipe
2025-09-30T15:00:07.259427Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:07.259444Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:07.259448Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:07.259470Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3436
2025-09-30T15:00:07.259532Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3436
2025-09-30T15:00:07.259709Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897195663595868:13730]
2025-09-30T15:00:07.259729Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:07.259746Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:07.259767Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.259776Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.259812Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:07.259824Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:07.259828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:07.259835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:07.259845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:07.259856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:07.259876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:07.260193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.260209Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.260234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:07.260315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3437 partition: 0 MaxSeqNo: 42 sessionId: src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0
2025-09-30T15:00:07.260727Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|1b78e2c9-46f2cbaa-4c894ec-2757167f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:07.263765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0] Write session: try to update token
2025-09-30T15:00:07.263789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:07.283948Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3437 sessionId: src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:07.283571Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:07.283599Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:07.283604Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:07.283606Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:07.283620Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897195663595868:13730]
2025-09-30T15:00:07.283627Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897195663595868:13730]
2025-09-30T15:00:07.283633Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897195663595868:13730]
2025-09-30T15:00:07.283688Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:07.283697Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.283701Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:07.283708Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:07.283716Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:07.283721Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:07.283899Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:07.287207Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:07.306164Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897195753401294:5444]
2025-09-30T15:00:07.306560Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 35 pipe creation result: OK TabletId: 72075186224037892 Generation: 3436, pipe: [1:7555897195753401294:5444]
2025-09-30T15:00:07.407696Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:07.408713Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.408725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.408762Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753401294:5444], now have 1 active actors on pipe
2025-09-30T15:00:07.410033Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:07.413679Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 35 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897195753401294:5444]
2025-09-30T15:00:07.413721Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:07.413765Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T15:00:07.413851Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3437 reason: status is not ok: tablet will be restarted right now sessionId: src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0
2025-09-30T15:00:07.414045Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3437 sessionId: src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0 is DEAD
2025-09-30T15:00:07.414248Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T15:00:07.414261Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0] Write session will restart in 0.008783s
2025-09-30T15:00:07.414289Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0] Write session: Do CDS request
2025-09-30T15:00:07.414295Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:07.424208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:07.427334Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:07.427355Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3438
2025-09-30T15:00:07.427647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3438 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:07.427684Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3438 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:07.427690Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3438 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:07.427694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:07.428267Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3438 sessionId:  describe result for acl check
2025-09-30T15:00:07.428320Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:07.428322Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:07.428324Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:07.428331Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897195753401381:10188] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:07.428921Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897195753401381:10188] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:07.436036Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897195753401381:10188] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:07.444079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897195753401381:10188] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:07.444111Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897195753401381:10188] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:07.444115Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897195753401381:10188] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:07.444125Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3438 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:07.451186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:07.455359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:07.455645Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:07.455659Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:07.455673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:07.455754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:07.455804Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897195663596184:13743]
2025-09-30T15:00:07.456491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:07.457359Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:07.457434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:07.457795Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:07.457892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.457894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.457895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.457896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.457897Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.457898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.457899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.457900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.457902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.457903Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.457904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.457905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.457906Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.457907Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.457931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.457939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.457950Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.457955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.457959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.457964Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.457969Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.457974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.457977Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.457981Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.457985Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.457990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.457994Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.457997Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.458001Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.458004Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.458014Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.458023Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.458029Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.458034Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.458040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.458046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.458050Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.458055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.458060Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.458066Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.458071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.458075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.458081Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.458086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.458091Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.458096Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.458100Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.458105Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.458110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.458116Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.458125Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.458131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.458136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.458141Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.458147Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.458152Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.458158Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.458163Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.458168Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.458174Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.458223Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:07.468843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:07.471423Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3437
2025-09-30T15:00:07.471468Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3437
2025-09-30T15:00:07.473104Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3438 partition: 0 MaxSeqNo: 42 sessionId: src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0
2025-09-30T15:00:07.473660Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|ba3a2d5-2e5a1057-fa39bef2-6141af7f_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:07.470172Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:07.470214Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:07.470217Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:07.470221Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:07.470228Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3437 [2:7555897195663596184:13743]
2025-09-30T15:00:07.470247Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:07.470264Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:07.470268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:07.470271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:07.470273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:07.470292Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:07.470300Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:07.470307Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:07.470390Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.470393Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.470396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.470399Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:07.470402Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:07.470478Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:07.470481Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.470499Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.470511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.470527Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:07.470546Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897195663596177:13743]
2025-09-30T15:00:07.470548Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897195663596177:13743]
2025-09-30T15:00:07.470551Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897195663596177:13743]
2025-09-30T15:00:07.470566Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:07.470587Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:07.470604Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:07.470607Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:07.470650Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897195663596177:13743]
2025-09-30T15:00:07.470653Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:07.470973Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:07.470977Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:07.470980Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:07.470991Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:07.471411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753401544:10188], now have 1 active actors on pipe
2025-09-30T15:00:07.471417Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753401317:2454], now have 1 active actors on pipe
2025-09-30T15:00:07.472382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.472391Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.472423Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:07.472436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:07.472441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:07.472444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:07.472458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:07.472474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:07.472493Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:07.472921Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.472926Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.472948Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:07.476973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0] Write session: try to update token
2025-09-30T15:00:07.477002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:07.491079Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:07.491113Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:07.491117Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:07.491119Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:07.491133Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897195663596177:13743]
2025-09-30T15:00:07.491139Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897195663596177:13743]
2025-09-30T15:00:07.491145Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897195663596177:13743]
2025-09-30T15:00:07.491206Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:07.491216Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.491220Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:07.491218Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:07.491227Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:07.491235Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:07.491442Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:07.501218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3438 sessionId: src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:07.504607Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:07.513856Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897195753401619:5444]
2025-09-30T15:00:07.514223Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 36 pipe creation result: OK TabletId: 72075186224037892 Generation: 3437, pipe: [1:7555897195753401619:5444]
2025-09-30T15:00:07.641124Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:07.641941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.641960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.642006Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753401619:5444], now have 1 active actors on pipe
2025-09-30T15:00:07.642252Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:07.642339Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:07.642358Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:07.642425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3438 reason: error at write: Disconnected sessionId: src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0
2025-09-30T15:00:07.642611Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3438 sessionId: src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0 is DEAD
2025-09-30T15:00:07.642712Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:07.642801Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:07.642761Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 36 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897195753401619:5444]
2025-09-30T15:00:07.642832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0] Write session will restart in 0.008274s
2025-09-30T15:00:07.642895Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0] Write session: Do CDS request
2025-09-30T15:00:07.642908Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:07.652798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:07.653367Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:07.653390Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3439
2025-09-30T15:00:07.655368Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3439 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:07.655419Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3439 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:07.655425Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3439 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:07.655431Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:07.656119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3439 sessionId:  describe result for acl check
2025-09-30T15:00:07.656162Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:07.656164Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:07.656166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:07.656172Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897195753401638:10206] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:07.656762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897195753401638:10206] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:07.661031Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897195753401638:10206] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:07.667091Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897195753401638:10206] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:07.667116Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897195753401638:10206] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:07.667120Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897195753401638:10206] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:07.667129Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3439 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:07.682359Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:07.686745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:07.687095Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:07.687113Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:07.687131Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:07.687212Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:07.687295Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897195663596476:13747]
2025-09-30T15:00:07.688143Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:07.688750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:07.688875Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:07.689319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:07.689423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.689436Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.689437Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.689439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.689441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.689442Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.689443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.689445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.689447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.689448Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.689449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.689450Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.689452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.689453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.689455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.689464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.689475Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.689480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.689485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.689489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.689493Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.689497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.689502Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.689507Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.689511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.689515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.689520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.689523Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.689528Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.689532Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.689543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.689552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.689560Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.689566Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.689571Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.689578Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.689583Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.689604Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.689609Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.689625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.689631Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.689643Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.689649Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.689656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.689662Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.689672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.689684Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.689690Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.689701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.689707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.689720Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.689726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.689737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.689744Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.689751Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.689757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.689762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.689769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.689780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.689787Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.689840Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:07.698005Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:07.698990Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:07.699013Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:07.699017Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:07.699021Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:07.699029Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3438 [2:7555897195663596476:13747]
2025-09-30T15:00:07.699048Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:07.699067Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:07.699071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:07.699074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:07.699077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:07.699096Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:07.699103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:07.699111Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:07.699182Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.699196Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.699198Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.699202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:07.699204Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:07.699299Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:07.699472Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3438
2025-09-30T15:00:07.699303Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.699316Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.699519Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3438
2025-09-30T15:00:07.699329Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.699345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:07.699367Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753401747:10206], now have 1 active actors on pipe
2025-09-30T15:00:07.699371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753401621:2454], now have 1 active actors on pipe
2025-09-30T15:00:07.699379Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897195663596468:13747]
2025-09-30T15:00:07.699381Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897195663596468:13747]
2025-09-30T15:00:07.699383Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897195663596468:13747]
2025-09-30T15:00:07.699396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:07.699415Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:07.699431Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:07.699434Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:07.699459Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:07.699463Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:07.699466Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:07.699477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897195663596468:13747]
2025-09-30T15:00:07.699481Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:07.699485Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:07.699763Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.699778Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.699807Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|d2f7de0d-8e597663-d981254d-4249258c_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:07.699819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:07.699823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:07.699826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:07.699838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:07.699848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:07.699867Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:07.700160Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.700172Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.700192Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:07.700393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3439 partition: 0 MaxSeqNo: 42 sessionId: src_id|d2f7de0d-8e597663-d981254d-4249258c_0
2025-09-30T15:00:07.700942Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|3993fce1-b0918f5e-4571d80f-34d6643a_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|d2f7de0d-8e597663-d981254d-4249258c_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:07.703964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f7de0d-8e597663-d981254d-4249258c_0] Write session: try to update token
2025-09-30T15:00:07.703987Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f7de0d-8e597663-d981254d-4249258c_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:07.717287Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:07.717331Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:07.717335Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:07.717337Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:07.717350Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897195663596468:13747]
2025-09-30T15:00:07.717357Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897195663596468:13747]
2025-09-30T15:00:07.717364Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897195663596468:13747]
2025-09-30T15:00:07.717427Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:07.717437Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.717441Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:07.717446Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:07.717458Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:07.717464Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:07.717759Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:07.728993Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3439 sessionId: src_id|d2f7de0d-8e597663-d981254d-4249258c_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:07.732271Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:07.743183Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897195753401912:5444]
2025-09-30T15:00:07.744061Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 37 pipe creation result: OK TabletId: 72075186224037892 Generation: 3438, pipe: [1:7555897195753401912:5444]
2025-09-30T15:00:07.838052Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:07.838866Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.838876Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.838898Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753401912:5444], now have 1 active actors on pipe
2025-09-30T15:00:07.839168Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:07.839898Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f7de0d-8e597663-d981254d-4249258c_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:07.839910Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f7de0d-8e597663-d981254d-4249258c_0] Write session will restart in 0.008377s
2025-09-30T15:00:07.839939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f7de0d-8e597663-d981254d-4249258c_0] Write session: Do CDS request
2025-09-30T15:00:07.839946Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f7de0d-8e597663-d981254d-4249258c_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:07.839460Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:07.839478Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:07.839546Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3439 reason: error at write: Disconnected sessionId: src_id|d2f7de0d-8e597663-d981254d-4249258c_0
2025-09-30T15:00:07.839723Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3439 sessionId: src_id|d2f7de0d-8e597663-d981254d-4249258c_0 is DEAD
2025-09-30T15:00:07.839937Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 37 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897195753401912:5444]
2025-09-30T15:00:07.839953Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:07.849810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f7de0d-8e597663-d981254d-4249258c_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:07.849977Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:07.850007Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3440
2025-09-30T15:00:07.850265Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3440 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:07.850307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3440 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:07.850315Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3440 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:07.850320Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:07.850750Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3440 sessionId:  describe result for acl check
2025-09-30T15:00:07.850791Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:07.850793Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:07.850795Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:07.850804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897195753401930:10212] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:07.851390Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897195753401930:10212] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:07.854237Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897195753401930:10212] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:07.858575Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897195753401930:10212] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:07.858599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897195753401930:10212] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:07.858603Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897195753401930:10212] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:07.858613Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3440 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:07.884090Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:07.888390Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:07.888775Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:07.888780Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:07.888793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:07.888870Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:07.888914Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897195663596771:13751]
2025-09-30T15:00:07.889656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:07.890293Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:07.890358Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:07.890736Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:07.890799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.890801Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.890802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.890803Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.890804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.890806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.890807Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.890809Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.890811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.890812Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.890813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.890815Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.890816Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.890818Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.890820Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.890826Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.890838Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.890844Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.890849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.890853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.890858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.890862Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.890867Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.890872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.890878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.890882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.890887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.890891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.890896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.890901Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.890912Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.890921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:07.890928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.890935Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:07.890940Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.890946Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:07.890952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.890959Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:07.890965Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.890971Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:07.890976Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.890983Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:07.890989Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.890995Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:07.891000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.891006Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:07.891012Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.891019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:07.891024Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.891031Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:07.891037Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.891043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.891049Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.891055Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.891061Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.891069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.891075Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.891080Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:07.891086Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.891092Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:07.891146Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:07.899227Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:07.900682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:07.900701Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:07.900704Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:07.900708Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:07.900715Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3439 [2:7555897195663596771:13751]
2025-09-30T15:00:07.900734Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:07.900753Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:07.900756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:07.900760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:07.900761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:07.900779Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:07.900786Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:07.900793Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:07.900874Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.900884Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.900886Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.900890Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:07.900893Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:07.900968Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:07.900977Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.900991Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:07.901008Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:07.901023Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:07.901043Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753401914:2454], now have 1 active actors on pipe
2025-09-30T15:00:07.901055Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897195663596766:13751]
2025-09-30T15:00:07.901058Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897195663596766:13751]
2025-09-30T15:00:07.901060Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897195663596766:13751]
2025-09-30T15:00:07.901078Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:07.901089Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753402017:10212], now have 1 active actors on pipe
2025-09-30T15:00:07.901103Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:07.901109Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:07.901112Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:07.901119Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:07.901125Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:07.901127Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:07.901170Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897195663596766:13751]
2025-09-30T15:00:07.901183Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:07.901190Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:07.901393Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3439
2025-09-30T15:00:07.901446Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3439
2025-09-30T15:00:07.901534Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.901550Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.901583Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:07.901599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:07.901603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:07.901606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:07.901622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:07.901635Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:07.901660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:07.902169Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.902186Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.902212Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:07.902721Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3440 partition: 0 MaxSeqNo: 42 sessionId: src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0
2025-09-30T15:00:07.903171Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|d2f7de0d-8e597663-d981254d-4249258c_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:07.906419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0] Write session: try to update token
2025-09-30T15:00:07.906449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:07.920369Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T15:00:07.920394Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:07.920405Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897195663596766:13751]
2025-09-30T15:00:07.920457Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T15:00:07.920657Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T15:00:07.920832Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:07.921012Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:07.921177Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:07.921423Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T15:00:07.921472Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T15:00:07.921580Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T15:00:07.925906Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3440 sessionId: src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:07.928850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:07.929095Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:07.929122Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:07.929161Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T15:00:07.929261Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T15:00:07.934922Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:07.935235Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:07.935261Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:07.935263Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:07.935276Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897195663596766:13751]
2025-09-30T15:00:07.935282Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897195663596766:13751]
2025-09-30T15:00:07.935287Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897195663596766:13751]
2025-09-30T15:00:07.935337Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:07.935345Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:07.935348Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:07.935346Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:07.935354Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:07.935358Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:07.935507Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:07.943422Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897195753402208:5444]
2025-09-30T15:00:07.947752Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 38 pipe creation result: OK TabletId: 72075186224037892 Generation: 3439, pipe: [1:7555897195753402208:5444]
2025-09-30T15:00:08.055426Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:08.056062Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897195753402208:5444], now have 1 active actors on pipe
2025-09-30T15:00:08.065463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.065501Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.065706Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 1 size: 511959
2025-09-30T15:00:08.065772Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 1 messageNo: 1 size: 511959
2025-09-30T15:00:08.065844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 2 messageNo: 1 size: 511959
2025-09-30T15:00:08.065911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 3 messageNo: 1 size: 511959
2025-09-30T15:00:08.065960Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size: 205040
2025-09-30T15:00:08.065966Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T15:00:08.066042Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 1 size: 511959
2025-09-30T15:00:08.066105Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 1 messageNo: 1 size: 511959
2025-09-30T15:00:08.066173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 2 messageNo: 1 size: 511959
2025-09-30T15:00:08.066633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 3 messageNo: 1 size: 511959
2025-09-30T15:00:08.066692Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size: 205040
2025-09-30T15:00:08.066697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T15:00:08.066799Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 1 size: 511959
2025-09-30T15:00:08.066915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 1 messageNo: 1 size: 511959
2025-09-30T15:00:08.066991Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 2 messageNo: 1 size: 511959
2025-09-30T15:00:08.067066Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 3 messageNo: 1 size: 511959
2025-09-30T15:00:08.067113Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size: 205040
2025-09-30T15:00:08.067116Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T15:00:08.070398Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:08.070417Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:08.070451Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3440 reason: error at write: Disconnected sessionId: src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0
2025-09-30T15:00:08.070474Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:08.070518Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 38 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897195753402208:5444]
2025-09-30T15:00:08.070643Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3440 sessionId: src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0 is DEAD
2025-09-30T15:00:08.070909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:08.070921Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0] Write session will restart in 0.009682s
2025-09-30T15:00:08.070945Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0] Write session: Do CDS request
2025-09-30T15:00:08.070951Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:08.067419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 1 size: 511959
2025-09-30T15:00:08.067497Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 1 messageNo: 1 size: 511959
2025-09-30T15:00:08.067563Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 2 messageNo: 1 size: 511959
2025-09-30T15:00:08.067631Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 3 messageNo: 1 size: 511959
2025-09-30T15:00:08.067675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size: 205040
2025-09-30T15:00:08.067678Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T15:00:08.067756Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 1 size: 511959
2025-09-30T15:00:08.067825Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 1 messageNo: 1 size: 511959
2025-09-30T15:00:08.067922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 2 messageNo: 1 size: 511959
2025-09-30T15:00:08.067988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 3 messageNo: 1 size: 511959
2025-09-30T15:00:08.068032Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size: 205040
2025-09-30T15:00:08.068035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T15:00:08.068109Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 1 size: 511959
2025-09-30T15:00:08.068173Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 1 messageNo: 1 size: 511959
2025-09-30T15:00:08.068241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 2 messageNo: 1 size: 511959
2025-09-30T15:00:08.068306Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 3 messageNo: 1 size: 511959
2025-09-30T15:00:08.068405Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size: 205040
2025-09-30T15:00:08.068409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T15:00:08.068527Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 1 size: 511959
2025-09-30T15:00:08.068632Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 1 messageNo: 1 size: 511959
2025-09-30T15:00:08.068699Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 2 messageNo: 1 size: 511959
2025-09-30T15:00:08.068768Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 3 messageNo: 1 size: 511959
2025-09-30T15:00:08.068831Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size: 205040
2025-09-30T15:00:08.068835Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T15:00:08.068910Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 1 size: 511959
2025-09-30T15:00:08.068971Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 1 messageNo: 1 size: 511959
2025-09-30T15:00:08.069035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 2 messageNo: 1 size: 511959
2025-09-30T15:00:08.069100Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 3 messageNo: 1 size: 511959
2025-09-30T15:00:08.069237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size: 205040
2025-09-30T15:00:08.069240Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T15:00:08.069318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 1 size: 511959
2025-09-30T15:00:08.069382Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 1 messageNo: 1 size: 511959
2025-09-30T15:00:08.069450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 2 messageNo: 1 size: 511959
2025-09-30T15:00:08.069517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 3 messageNo: 1 size: 511959
2025-09-30T15:00:08.069582Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size: 205040
2025-09-30T15:00:08.069588Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T15:00:08.069660Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 1 size: 511959
2025-09-30T15:00:08.069725Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 1 messageNo: 1 size: 511959
2025-09-30T15:00:08.069789Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 2 messageNo: 1 size: 511959
2025-09-30T15:00:08.069859Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 3 messageNo: 1 size: 511959
2025-09-30T15:00:08.069903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1973: [PQ: 72075186224037892] got client PART message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size: 205040
2025-09-30T15:00:08.069905Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 4 messageNo: 1 size 205040 offset: -1
2025-09-30T15:00:08.071034Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:08.082348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:08.082563Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:08.082585Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3441
2025-09-30T15:00:08.082979Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3441 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:08.083029Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3441 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:08.083036Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3441 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:08.083040Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:08.083718Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3441 sessionId:  describe result for acl check
2025-09-30T15:00:08.083751Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:08.083754Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:08.083756Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:08.083762Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897200048369535:10218] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:08.084356Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897200048369535:10218] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:08.090337Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897200048369535:10218] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:08.097153Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897200048369535:10218] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:08.097181Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897200048369535:10218] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:08.097185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897200048369535:10218] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:08.097194Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3441 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:08.113237Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:08.117415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:08.117667Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:08.117679Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:08.117691Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:08.117750Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:08.117793Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897199958564351:13753]
2025-09-30T15:00:08.118478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:08.118891Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:08.118955Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:08.119372Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:08.119447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.119453Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.119455Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.119456Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.119458Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.119460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.119461Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.119463Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.119464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.119466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.119467Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.119469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.119470Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.119472Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.119474Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.119480Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.119491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.119496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.119501Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.119506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.119511Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.119516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.119520Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.119525Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.119529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.119534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.119538Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.119543Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.119547Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.119551Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.119559Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.119567Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.119573Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.119580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.119586Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.119592Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.119596Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.119601Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.119607Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.119613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.119617Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.119634Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.119640Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.119645Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.119650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.119656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.119661Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.119669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.119681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.119687Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.119695Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.119701Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.119706Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.119712Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.119716Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.119722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.119727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.119733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.119739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.119745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.119793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:08.126314Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:08.127466Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:08.127481Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:08.127484Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:08.127489Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:08.127496Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3440 [2:7555897199958564351:13753]
2025-09-30T15:00:08.127515Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:08.127532Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:08.127534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:08.127538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:08.127540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:08.127558Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:08.127565Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:08.127573Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:08.127647Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.127657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.127660Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.127663Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:08.127666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:08.127737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:08.127747Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.127762Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.127773Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.127797Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:08.127826Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048369519:2454], now have 1 active actors on pipe
2025-09-30T15:00:08.127830Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048369640:10218], now have 1 active actors on pipe
2025-09-30T15:00:08.127837Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897199958564346:13753]
2025-09-30T15:00:08.127839Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897199958564346:13753]
2025-09-30T15:00:08.127842Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897199958564346:13753]
2025-09-30T15:00:08.127860Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:08.127874Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:08.127898Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:08.127905Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:08.127942Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897199958564346:13753]
2025-09-30T15:00:08.127950Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:08.128047Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:08.128052Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:08.128054Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:08.128060Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:08.128332Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.128360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.128387Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:08.128401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:08.128405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:08.128407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:08.128419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:08.128431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:08.128453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:08.128818Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.128829Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.128845Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:08.128072Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3440
2025-09-30T15:00:08.128145Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3440
2025-09-30T15:00:08.129007Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3441 partition: 0 MaxSeqNo: 42 sessionId: src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0
2025-09-30T15:00:08.129446Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a67e6ed4-5a7b76e3-a00dce4b-30d4d328_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:08.132619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0] Write session: try to update token
2025-09-30T15:00:08.132649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:08.145152Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:08.145175Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:08.145177Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:08.145181Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:08.145194Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897199958564346:13753]
2025-09-30T15:00:08.145200Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897199958564346:13753]
2025-09-30T15:00:08.145206Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897199958564346:13753]
2025-09-30T15:00:08.145264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:08.145272Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.145276Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:08.145459Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:08.145558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:08.145577Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:08.145583Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:08.151189Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3441 sessionId: src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:08.154795Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:08.170747Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897200048369814:5444]
2025-09-30T15:00:08.171227Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 39 pipe creation result: OK TabletId: 72075186224037892 Generation: 3440, pipe: [1:7555897200048369814:5444]
2025-09-30T15:00:08.273312Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:08.273667Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.273679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.273726Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048369814:5444], now have 1 active actors on pipe
2025-09-30T15:00:08.274896Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:08.274909Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0] Write session will restart in 0.007244s
2025-09-30T15:00:08.274933Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0] Write session: Do CDS request
2025-09-30T15:00:08.274939Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:08.274235Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:08.274244Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 39 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897200048369814:5444]
2025-09-30T15:00:08.274290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:08.274329Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:08.274332Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:08.274397Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3441 reason: error at write: Disconnected sessionId: src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0
2025-09-30T15:00:08.274726Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3441 sessionId: src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0 is DEAD
2025-09-30T15:00:08.283853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:08.284046Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:08.284069Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3442
2025-09-30T15:00:08.284218Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3442 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:08.284282Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3442 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:08.284295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3442 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:08.284300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:08.284749Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3442 sessionId:  describe result for acl check
2025-09-30T15:00:08.284787Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:08.284790Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:08.284792Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:08.284797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897200048369827:10236] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:08.285373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897200048369827:10236] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:08.287334Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897200048369827:10236] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:08.296560Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897200048369827:10236] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:08.296599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897200048369827:10236] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:08.296604Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897200048369827:10236] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:08.296620Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3442 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:08.331470Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:08.337416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:08.337713Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:08.337728Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:08.337757Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:08.337842Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:08.337909Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897199958564640:13756]
2025-09-30T15:00:08.338580Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:08.339136Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:08.339206Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:08.339616Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:08.339714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.339723Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.339724Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.339725Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.339727Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.339729Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.339730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.339731Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.339733Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.339734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.339735Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.339737Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.339738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.339739Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.339741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.339748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.339760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.339765Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.339770Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.339774Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.339779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.339784Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.339789Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.339793Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.339798Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.339802Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.339806Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.339811Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.339831Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.339836Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.339847Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.339859Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.339866Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.339872Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.339878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.339885Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.339890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.339896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.339902Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.339908Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.339913Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.339920Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.339925Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.339930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.339936Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.339942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.339947Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.339952Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.339956Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.339960Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.339966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.339975Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.339980Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.339986Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.339992Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.339998Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.340003Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.340009Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.340015Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.340022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.340083Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:08.347123Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:08.348107Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:08.348115Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:08.348118Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:08.348122Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:08.348130Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3441 [2:7555897199958564640:13756]
2025-09-30T15:00:08.348148Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:08.348164Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:08.348167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:08.348170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:08.348174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:08.348190Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:08.348197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:08.348204Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:08.349233Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3441
2025-09-30T15:00:08.349278Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3441
2025-09-30T15:00:08.348264Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.348281Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.348283Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.348287Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:08.348290Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:08.348377Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:08.348380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.348396Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.348410Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.348429Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:08.348449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048369817:2454], now have 1 active actors on pipe
2025-09-30T15:00:08.348453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048369881:10236], now have 1 active actors on pipe
2025-09-30T15:00:08.348460Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897199958564635:13756]
2025-09-30T15:00:08.348463Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897199958564635:13756]
2025-09-30T15:00:08.348466Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897199958564635:13756]
2025-09-30T15:00:08.348480Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:08.348495Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:08.348511Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:08.348515Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:08.348554Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897199958564635:13756]
2025-09-30T15:00:08.348557Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:08.348609Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:08.348613Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:08.348615Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:08.348622Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:08.349572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.349586Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.349614Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:08.349623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:08.349627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:08.349630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:08.349642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:08.349656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:08.349675Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:08.350199Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.350211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.350230Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:08.350393Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3442 partition: 0 MaxSeqNo: 42 sessionId: src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0
2025-09-30T15:00:08.350832Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|b23adac9-7a8cd34d-2587ad4c-e76263f8_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:08.353841Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0] Write session: try to update token
2025-09-30T15:00:08.353866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:08.373949Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897200048370111:5444]
2025-09-30T15:00:08.374728Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 40 pipe creation result: OK TabletId: 72075186224037892 Generation: 3441, pipe: [1:7555897200048370111:5444]
2025-09-30T15:00:08.377146Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048370111:5444], now have 1 active actors on pipe
2025-09-30T15:00:08.377178Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T15:00:08.377183Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:08.377193Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897199958564635:13756]
2025-09-30T15:00:08.377250Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T15:00:08.377257Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T15:00:08.377452Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T15:00:08.377628Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:08.377792Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:08.377963Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:08.378189Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T15:00:08.378246Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T15:00:08.380806Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:08.380825Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:08.380828Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:08.380831Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:08.380843Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897199958564635:13756]
2025-09-30T15:00:08.380847Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897199958564635:13756]
2025-09-30T15:00:08.380852Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897199958564635:13756]
2025-09-30T15:00:08.380894Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:08.380902Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.380906Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:08.381061Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:08.382772Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:08.382806Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:08.382812Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:08.384600Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3442 sessionId: src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:08.387919Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:08.517079Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:08.517888Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.517903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.519607Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:08.520240Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: status is not ok: tablet will be restarted right now, code: 500001 
2025-09-30T15:00:08.520254Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0] Write session will restart in 0.007729s
2025-09-30T15:00:08.520281Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0] Write session: Do CDS request
2025-09-30T15:00:08.519677Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:08.519743Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T15:00:08.520296Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:08.519856Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3442 reason: status is not ok: tablet will be restarted right now sessionId: src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0
2025-09-30T15:00:08.520041Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3442 sessionId: src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0 is DEAD
2025-09-30T15:00:08.520224Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 40 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897200048370111:5444]
2025-09-30T15:00:08.528859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:08.530193Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:08.530216Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3443
2025-09-30T15:00:08.531002Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3443 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:08.531047Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3443 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:08.531052Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3443 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:08.531057Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:08.531653Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3443 sessionId:  describe result for acl check
2025-09-30T15:00:08.531698Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:08.531701Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:08.531703Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:08.531709Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897200048370159:8082] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:08.532284Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897200048370159:8082] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:08.536642Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897200048370159:8082] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:08.544495Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897200048370159:8082] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:08.544515Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897200048370159:8082] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:08.544519Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897200048370159:8082] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:08.544529Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3443 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:08.556234Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:08.560512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:08.560813Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:08.560834Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:08.560848Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:08.560923Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:08.560980Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897199958564963:13768]
2025-09-30T15:00:08.561699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:08.562103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:08.562173Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:08.562568Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:08.562657Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.562664Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.562665Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.562666Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.562668Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.562669Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.562670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.562672Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.562673Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.562675Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.562676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.562678Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.562680Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.562681Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.562682Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.562689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.562699Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.562703Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.562707Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.562710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.562714Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.562718Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.562722Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.562726Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.562730Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.562734Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.562738Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.562741Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.562745Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.562748Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.562761Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.562769Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.562775Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.562781Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.562785Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.562790Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.562794Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.562799Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.562804Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.562810Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.562814Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.562819Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.562824Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.562830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.562834Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.562839Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.562843Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.562849Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.562853Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.562858Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.562868Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.562874Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.562879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.562884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.562889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.562894Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.562898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.562904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.562911Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.562931Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.562979Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:08.569393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:08.570754Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:08.570775Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:08.570779Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:08.570783Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:08.570790Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3442 [2:7555897199958564963:13768]
2025-09-30T15:00:08.570807Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:08.570825Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:08.570829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:08.570832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:08.570834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:08.570852Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:08.570862Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:08.570869Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:08.570941Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.570955Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.570957Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.570960Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:08.570963Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:08.571038Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:08.571049Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.571063Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.571076Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.571091Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:08.571111Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897199958564958:13768]
2025-09-30T15:00:08.571122Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897199958564958:13768]
2025-09-30T15:00:08.571125Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897199958564958:13768]
2025-09-30T15:00:08.571140Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:08.571155Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:08.571158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048370138:2454], now have 1 active actors on pipe
2025-09-30T15:00:08.571159Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:08.571162Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:08.571166Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048370283:8082], now have 1 active actors on pipe
2025-09-30T15:00:08.571172Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:08.571186Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:08.571197Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:08.571267Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897199958564958:13768]
2025-09-30T15:00:08.571281Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:08.571290Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3442
2025-09-30T15:00:08.571290Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3442
2025-09-30T15:00:08.571304Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:08.571634Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.571649Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.571681Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:08.571694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:08.571698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:08.571701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:08.571714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:08.571728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:08.571747Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:08.572058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.572073Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.572094Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:08.572390Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3443 partition: 0 MaxSeqNo: 42 sessionId: src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0
2025-09-30T15:00:08.572886Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|a05c8b33-c1996cbe-b9759222-da8c877e_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:08.576383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0] Write session: try to update token
2025-09-30T15:00:08.576411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:08.586134Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:08.586156Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:08.586159Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:08.586161Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:08.586174Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897199958564958:13768]
2025-09-30T15:00:08.586179Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897199958564958:13768]
2025-09-30T15:00:08.586184Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897199958564958:13768]
2025-09-30T15:00:08.586235Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:08.586243Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.586246Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:08.586302Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:08.586310Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:08.586316Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:08.586426Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:08.595149Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3443 sessionId: src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:08.598521Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:08.620278Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897200048370438:5444]
2025-09-30T15:00:08.621025Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 41 pipe creation result: OK TabletId: 72075186224037892 Generation: 3442, pipe: [1:7555897200048370438:5444]
2025-09-30T15:00:08.708639Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:08.709413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.709432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.709477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048370438:5444], now have 1 active actors on pipe
2025-09-30T15:00:08.709717Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:08.709753Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 41 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897200048370438:5444]
2025-09-30T15:00:08.709781Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:08.709799Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:08.709895Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3443 reason: error at write: Disconnected sessionId: src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0
2025-09-30T15:00:08.710091Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3443 sessionId: src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0 is DEAD
2025-09-30T15:00:08.710312Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:08.710325Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0] Write session will restart in 0.008598s
2025-09-30T15:00:08.709747Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:08.710366Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0] Write session: Do CDS request
2025-09-30T15:00:08.710407Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:08.719816Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:08.719951Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:08.719970Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3444
2025-09-30T15:00:08.720237Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3444 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:08.720284Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3444 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:08.720295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3444 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:08.720300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:08.720823Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3444 sessionId:  describe result for acl check
2025-09-30T15:00:08.720870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:08.720877Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:08.720880Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:08.720887Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897200048370456:8047] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:08.721479Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897200048370456:8047] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:08.725079Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897200048370456:8047] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:08.734715Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897200048370456:8047] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:08.734741Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897200048370456:8047] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:08.734744Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897200048370456:8047] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:08.734754Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3444 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:08.746233Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:08.749976Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:08.750296Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:08.750311Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:08.750326Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:08.750409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:08.750473Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897199958565264:13774]
2025-09-30T15:00:08.751203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:08.751710Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:08.751759Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:08.752156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:08.752233Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.752235Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.752236Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.752237Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.752239Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.752240Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.752242Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.752243Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.752245Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.752246Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.752247Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.752249Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.752250Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.752251Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.752252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.752259Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.752271Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.752276Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.752282Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.752286Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.752290Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.752294Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.752299Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.752304Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.752310Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.752315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.752319Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.752324Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.752327Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.752349Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.752357Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.752367Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.752374Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.752380Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.752384Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.752390Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.752394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.752399Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.752404Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.752409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.752413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.752418Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.752423Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.752429Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.752433Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.752438Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.752443Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.752447Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.752452Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.752459Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.752464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.752469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.752473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.752479Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.752485Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.752491Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.752497Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.752503Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.752508Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.752516Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.752563Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:08.759402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:08.760833Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:08.760861Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:08.760865Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:08.760869Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:08.760882Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3443 [2:7555897199958565264:13774]
2025-09-30T15:00:08.760900Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:08.760922Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:08.760928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:08.760931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:08.760934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:08.760952Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:08.760966Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:08.760974Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:08.761052Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.761062Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.761065Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.761068Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:08.761071Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:08.761146Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:08.761149Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.761165Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.761184Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.761202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:08.761222Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048370610:8047], now have 1 active actors on pipe
2025-09-30T15:00:08.761235Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048370441:2454], now have 1 active actors on pipe
2025-09-30T15:00:08.761241Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897199958565259:13774]
2025-09-30T15:00:08.761243Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897199958565259:13774]
2025-09-30T15:00:08.761245Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897199958565259:13774]
2025-09-30T15:00:08.761259Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:08.761272Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:08.761289Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:08.761290Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:08.761292Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:08.761295Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:08.761297Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:08.761336Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897199958565259:13774]
2025-09-30T15:00:08.761349Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:08.761364Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:08.761371Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3443
2025-09-30T15:00:08.761464Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3443
2025-09-30T15:00:08.761679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.761697Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.761730Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:08.761750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:08.761755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:08.761757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:08.761773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:08.761786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:08.761817Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:08.762068Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.762092Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.762123Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:08.762288Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3444 partition: 0 MaxSeqNo: 42 sessionId: src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0
2025-09-30T15:00:08.762699Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|cfe098c7-fa0bcef5-6df3ccf6-44fa5494_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:08.766019Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0] Write session: try to update token
2025-09-30T15:00:08.766046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:08.775660Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 1 of 1 from KV. Status 1
2025-09-30T15:00:08.775682Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:08.775693Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 0 count 3 size 8295635 actorID [2:7555897199958565259:13774]
2025-09-30T15:00:08.775743Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T15:00:08.775953Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512009 from pos 0 cbcount 1
2025-09-30T15:00:08.776178Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:08.776419Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:08.776626Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 0 size 512005 from pos 0 cbcount 1
2025-09-30T15:00:08.776962Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 3 count 1 size 717094 from pos 0 cbcount 2
2025-09-30T15:00:08.777040Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818033 queuesize 0 startOffset 0
2025-09-30T15:00:08.777978Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 3 parts 15 suffix '0' size 8295635
2025-09-30T15:00:08.787839Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3444 sessionId: src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:08.791180Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:08.791844Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.791875Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.791900Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:08.791903Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:08.791906Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:08.791908Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:08.791920Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897199958565259:13774]
2025-09-30T15:00:08.791925Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897199958565259:13774]
2025-09-30T15:00:08.791929Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897199958565259:13774]
2025-09-30T15:00:08.791987Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:08.791995Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.791998Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:08.792072Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:08.792088Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:08.792098Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:08.792167Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:08.811555Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897200048370736:5444]
2025-09-30T15:00:08.812080Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 42 pipe creation result: OK TabletId: 72075186224037892 Generation: 3443, pipe: [1:7555897200048370736:5444]
2025-09-30T15:00:08.914485Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:08.915163Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T15:00:08.915196Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048370736:5444], now have 1 active actors on pipe
2025-09-30T15:00:08.915377Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T15:00:08.915576Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:08.915583Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:08.915604Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3444 reason: error at write: Disconnected sessionId: src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0
2025-09-30T15:00:08.915755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3444 sessionId: src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0 is DEAD
2025-09-30T15:00:08.915858Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:08.915925Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 42 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897200048370736:5444]
2025-09-30T15:00:08.916601Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:08.916615Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0] Write session will restart in 0.007377s
2025-09-30T15:00:08.916653Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0] Write session: Do CDS request
2025-09-30T15:00:08.916664Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:08.927724Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:08.931423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:08.931447Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3445
2025-09-30T15:00:08.931657Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3445 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:08.931694Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3445 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:08.931700Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3445 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:08.931704Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:08.932285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3445 sessionId:  describe result for acl check
2025-09-30T15:00:08.932350Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:08.932358Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:08.932360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:08.932367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897200048370775:8049] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:08.932919Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897200048370775:8049] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:08.945132Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897200048370775:8049] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:08.957451Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897200048370775:8049] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:08.957473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897200048370775:8049] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:08.957477Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897200048370775:8049] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:08.957560Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3445 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:08.970410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:08.974780Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:08.975021Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:08.975032Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:08.975043Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:08.975114Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:08.975160Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897199958565554:13776]
2025-09-30T15:00:08.975813Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:08.976292Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:08.976376Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:08.976780Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:08.976871Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.976878Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.976879Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.976881Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.976882Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.976884Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.976886Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.976887Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.976889Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.976890Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.976892Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.976893Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.976895Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.976896Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.976898Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.976905Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.976916Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.976921Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.976926Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.976930Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.976934Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.976939Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.976944Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.976948Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.976953Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.976957Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.976962Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.976966Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.976970Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.976974Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.976984Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.976993Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:08.977000Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.977007Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:08.977013Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.977019Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:08.977026Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.977040Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:08.977046Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.977058Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:08.977064Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.977071Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:08.977076Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.977082Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:08.977087Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.977093Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:08.977103Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.977109Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:08.977120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.977126Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:08.977132Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.977139Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.977150Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.977156Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.977162Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.977181Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.977186Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.977192Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:08.977198Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.977203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:08.977252Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:08.984496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:08.985899Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:08.985924Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:08.985928Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:08.985933Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:08.985941Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3444 [2:7555897199958565554:13776]
2025-09-30T15:00:08.985959Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:08.985979Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:08.985983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:08.985987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:08.985989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:08.986008Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:08.986019Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:08.986035Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:08.986109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.986118Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.986121Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.986125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:08.986128Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:08.986202Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:08.986212Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:08.986229Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:08.986240Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:08.986256Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:08.986275Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897199958565546:13776]
2025-09-30T15:00:08.986278Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897199958565546:13776]
2025-09-30T15:00:08.986281Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897199958565546:13776]
2025-09-30T15:00:08.986292Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:08.986308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048370934:8049], now have 1 active actors on pipe
2025-09-30T15:00:08.986311Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897200048370741:2454], now have 1 active actors on pipe
2025-09-30T15:00:08.986315Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:08.986318Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:08.986319Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:08.986320Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:08.986335Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:08.986338Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:08.986385Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897199958565546:13776]
2025-09-30T15:00:08.986396Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:08.986454Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:08.986715Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3444
2025-09-30T15:00:08.986758Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3444
2025-09-30T15:00:08.989055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.989078Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.989113Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|915e4565-baf3ad86-e1446221-4a686ce9_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:08.989126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:08.989131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:08.989134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:08.989149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:08.989173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:08.989193Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:08.989502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:08.989515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:08.989539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:08.990119Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3445 partition: 0 MaxSeqNo: 42 sessionId: src_id|915e4565-baf3ad86-e1446221-4a686ce9_0
2025-09-30T15:00:08.990580Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|f2282a5d-885b2fc5-ac0be7c0-b48cddac_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|915e4565-baf3ad86-e1446221-4a686ce9_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:08.993763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|915e4565-baf3ad86-e1446221-4a686ce9_0] Write session: try to update token
2025-09-30T15:00:08.993792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|915e4565-baf3ad86-e1446221-4a686ce9_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:09.003429Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:09.003450Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:09.003454Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:09.003456Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:09.003467Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897199958565546:13776]
2025-09-30T15:00:09.003472Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897199958565546:13776]
2025-09-30T15:00:09.003477Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897199958565546:13776]
2025-09-30T15:00:09.003528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:09.003536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:09.003539Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:09.003550Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:09.003558Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:09.003563Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:09.003688Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:09.016030Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897204343338345:5444]
2025-09-30T15:00:09.018947Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3445 sessionId: src_id|915e4565-baf3ad86-e1446221-4a686ce9_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:09.020325Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 43 pipe creation result: OK TabletId: 72075186224037892 Generation: 3444, pipe: [1:7555897204343338345:5444]
2025-09-30T15:00:09.022063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:09.144276Z node 2 :PERSQUEUE CRIT: actor.h:45: [72075186224037892][Partition][0][StateIdle] unhandled exception yexception: ydb/library/actors/core/log.cpp:881: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
??+0 (0x147317FF)
??+0 (0x147317A7)
NActors::TEnsureFormattedRecordWriter::~TEnsureFormattedRecordWriter()+429 (0x15496E0D)
NKikimr::NPQ::TPartitionedBlob::TPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, NKikimr::NPQ::THead&, NKikimr::NPQ::THead&, bool, bool, unsigned int, unsigned short, bool)+1074 (0x240C6252)
NKikimr::NPQ::TPartitionBlobEncoder::NewPartitionedBlob(NKikimr::NPQ::TPartitionId const&, unsigned long, TBasicString<char, std::__y1::char_traits<char>> const&, unsigned long, unsigned short, unsigned int, bool, bool, unsigned int, unsigned short)+94 (0x240C046E)
NKikimr::NPQ::TPartition::CompactRequestedBlob(NKikimr::NPQ::TRequestedBlob const&, NKikimr::NPQ::TPartition::TProcessParametersBase&, bool, NKikimr::TEvKeyValue::TEvRequest*, TInstant&, bool)+330 (0x241B488A)
NKikimr::NPQ::TPartition::BlobsForCompactionWereRead(TVector<NKikimr::NPQ::TRequestedBlob, std::__y1::allocator<NKikimr::NPQ::TRequestedBlob>> const&)+3341 (0x241B5E3D)
NKikimr::NPQ::TPartition::StateIdle(TAutoPtr<NActors::IEventHandle, TDelete>&)+7753 (0x24065769)
NActors::IActor::Receive(TAutoPtr<NActors::IEventHandle, TDelete>&)+216 (0x15442988)
2025-09-30T15:00:09.144915Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897204343338345:5444], now have 1 active actors on pipe
2025-09-30T15:00:09.144955Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:09.144962Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:09.145242Z node 2 :PERSQUEUE ERROR: pq_impl.cpp:200: Answer error topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0 requestId: <none> error: tablet will be restarted right now
2025-09-30T15:00:09.145370Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:310: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) schedule pipe restart attempt 43 reason: pipe to tablet is dead 72075186224037892, current pipe: [1:7555897204343338345:5444]
2025-09-30T15:00:09.145407Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvTabletPipe::TEvClientDestroyed
2025-09-30T15:00:09.145411Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:852: TPartitionWriter 72075186224037892 (partition=0) received TEvClientDestroyed
2025-09-30T15:00:09.145800Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915e4565-baf3ad86-e1446221-4a686ce9_0] Got error. Status: UNAVAILABLE, Description: <main>: Error: error at write: Disconnected, code: 500100 
2025-09-30T15:00:09.145811Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915e4565-baf3ad86-e1446221-4a686ce9_0] Write session will restart in 0.007537s
2025-09-30T15:00:09.145835Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915e4565-baf3ad86-e1446221-4a686ce9_0] Write session: Do CDS request
2025-09-30T15:00:09.145842Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915e4565-baf3ad86-e1446221-4a686ce9_0] Start write session. Will connect to endpoint: localhost:64460
2025-09-30T15:00:09.145477Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:815: session v1 error cookie: 3445 reason: error at write: Disconnected sessionId: src_id|915e4565-baf3ad86-e1446221-4a686ce9_0
2025-09-30T15:00:09.145593Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:374: [72075186224037893][rt3.dc1--test-topic] TEvClientDestroyed 72075186224037892
2025-09-30T15:00:09.145658Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3445 sessionId: src_id|915e4565-baf3ad86-e1446221-4a686ce9_0 is DEAD
2025-09-30T15:00:09.154762Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|915e4565-baf3ad86-e1446221-4a686ce9_0] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:09.154875Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T15:00:09.154899Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3446
2025-09-30T15:00:09.155131Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3446 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T15:00:09.155161Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3446 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:54586
2025-09-30T15:00:09.155166Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3446 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:54586 proto=v1  topic=test-topic durationSec=0
2025-09-30T15:00:09.155171Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T15:00:09.155768Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3446 sessionId:  describe result for acl check
2025-09-30T15:00:09.155809Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T15:00:09.155813Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T15:00:09.155816Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T15:00:09.155823Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555897204343338362:8030] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T15:00:09.156396Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555897204343338362:8030] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T15:00:09.161286Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555897204343338362:8030] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T15:00:09.165459Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555897204343338362:8030] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T15:00:09.165483Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555897204343338362:8030] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T15:00:09.165486Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555897204343338362:8030] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T15:00:09.165496Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3446 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T15:00:09.177911Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T15:00:09.182893Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T15:00:09.183160Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T15:00:09.183173Z node 2 :PERSQUEUE INFO: pq_impl.cpp:596: [PQ: 72075186224037892] has a tx writes info
2025-09-30T15:00:09.183185Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T15:00:09.183449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T15:00:09.183501Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555897204253533139:13778]
2025-09-30T15:00:09.184203Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDiskStatusStep
2025-09-30T15:00:09.184764Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitMetaStep
2025-09-30T15:00:09.184850Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInfoRangeStep
2025-09-30T15:00:09.185289Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataRangeStep
2025-09-30T15:00:09.185383Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[0]: d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:09.185393Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[1]: d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:09.185394Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[2]: d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:09.185396Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[3]: d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:09.185397Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[4]: d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:09.185400Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[5]: d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:09.185402Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[6]: d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:09.185403Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[7]: d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:09.185405Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[8]: d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:09.185406Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[9]: d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:09.185408Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[10]: d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:09.185409Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[11]: d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:09.185411Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[12]: d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:09.185413Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[13]: d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:09.185414Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:555: key[14]: d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:09.185422Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:563: add key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:09.185434Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:09.185439Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:09.185445Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:09.185449Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:09.185454Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:09.185460Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:09.185464Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:09.185469Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:09.185473Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:09.185478Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:09.185483Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:09.185487Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:09.185492Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:09.185496Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:596: add key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:09.185506Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:09.185515Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 0 count 3 size 8295635 so 0 eo 3 d0000000000_00000000000000000000_00000_0000000003_00015
2025-09-30T15:00:09.185522Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:09.185529Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 3 count 4 size 7988778 so 0 eo 7 d0000000000_00000000000000000003_00003_0000000004_00014
2025-09-30T15:00:09.185534Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:09.185540Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 7 count 3 size 8295601 so 0 eo 10 d0000000000_00000000000000000007_00001_0000000003_00015
2025-09-30T15:00:09.185545Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:09.185552Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 10 count 4 size 7988760 so 0 eo 14 d0000000000_00000000000000000010_00004_0000000004_00014
2025-09-30T15:00:09.185558Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:09.185564Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 14 count 4 size 7988778 so 0 eo 18 d0000000000_00000000000000000014_00002_0000000004_00014
2025-09-30T15:00:09.185570Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:09.185576Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 18 count 3 size 8295638 so 0 eo 21 d0000000000_00000000000000000018_00000_0000000003_00015
2025-09-30T15:00:09.185582Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:09.185588Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 21 count 4 size 7988782 so 0 eo 25 d0000000000_00000000000000000021_00003_0000000004_00014
2025-09-30T15:00:09.185594Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:09.185600Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 25 count 3 size 8295604 so 0 eo 28 d0000000000_00000000000000000025_00001_0000000003_00015
2025-09-30T15:00:09.185606Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:09.185613Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 28 count 4 size 7988738 so 0 eo 32 d0000000000_00000000000000000028_00004_0000000004_00014
2025-09-30T15:00:09.185618Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:09.185625Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 32 count 2 size 3482360 so 0 eo 34 d0000000000_00000000000000000032_00002_0000000002_00006|
2025-09-30T15:00:09.185632Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:09.185638Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 34 count 1 size 1741189 so 0 eo 35 d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:09.185644Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:09.185650Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 35 count 1 size 2253220 so 0 eo 36 d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:09.185656Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:09.185670Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 36 count 2 size 4506418 so 0 eo 38 d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:09.185676Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:09.185683Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 38 count 3 size 8295638 so 0 eo 41 d0000000000_00000000000000000038_00000_0000000003_00015?
2025-09-30T15:00:09.185689Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:652: [rt3.dc1--test-topic:0:TInitDataRangeStep] check key d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:09.185696Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:682: [rt3.dc1--test-topic:0:TInitDataRangeStep] Got data offset 41 count 1 size 717135 so 0 eo 42 d0000000000_00000000000000000041_00003_0000000001_00001?
2025-09-30T15:00:09.185760Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitDataStep
2025-09-30T15:00:09.192719Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:904: [rt3.dc1--test-topic:0:TInitDataStep] read res partition offset 32 endOffset 42 key 32,2 valuesize 3482360 expected 3482360
2025-09-30T15:00:09.194022Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitEndWriteTimestampStep
2025-09-30T15:00:09.194044Z node 2 :PERSQUEUE INFO: partition_init.cpp:953: [rt3.dc1--test-topic:0:TInitEndWriteTimestampStep] Initializing EndWriteTimestamp skipped because already initialized.
2025-09-30T15:00:09.194048Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T15:00:09.194052Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T15:00:09.194064Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 3445 [2:7555897204253533139:13778]
2025-09-30T15:00:09.194086Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 42 Head Offset 42 PartNo 0 PackedSize 0 count 0 nextOffset 42 batches 0
SYNC INIT sourceId  src_id seqNo 42 offset 41
SYNC INIT DATA KEY: d0000000000_00000000000000000034_00001_0000000001_00003? size 1741189
SYNC INIT DATA KEY: d0000000000_00000000000000000035_00000_0000000001_00004? size 2253220
SYNC INIT DATA KEY: d0000000000_00000000000000000036_00000_0000000002_00008? size 4506418
SYNC INIT DATA KEY: d0000000000_00000000000000000038_00000_0000000003_00015? size 8295638
SYNC INIT DATA KEY: d0000000000_00000000000000000041_00003_0000000001_00001? size 717135
2025-09-30T15:00:09.194108Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 0
2025-09-30T15:00:09.194112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:09.194115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:09.194118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:09.194138Z node 2 :PERSQUEUE DEBUG: partition.cpp:733: [72075186224037892][Partition][0][StateIdle] Init complete for topic 'rt3.dc1--test-topic' Partition: 0 SourceId:  src_id SeqNo: 42 offset: 41 MaxOffset: 42
2025-09-30T15:00:09.194153Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T15:00:09.194161Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T15:00:09.194244Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:09.194255Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:09.194258Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:09.194262Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 8500827 bytes (8500827)
2025-09-30T15:00:09.194265Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:215: [72075186224037892][Partition][0][StateIdle] Run compaction for 3 blobs
2025-09-30T15:00:09.194361Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:226: [72075186224037892][Partition][0][StateIdle] Begin compaction for 3 blobs
2025-09-30T15:00:09.194365Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:09.194380Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000035_00000_0000000001_00004?
2025-09-30T15:00:09.194391Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:239: [72075186224037892][Partition][0][StateIdle] Request blob key d0000000000_00000000000000000036_00000_0000000002_00008?
2025-09-30T15:00:09.194407Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:263: [72075186224037892][Partition][0][StateIdle] Request 3 blobs for compaction
2025-09-30T15:00:09.194429Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897204343338498:8030], now have 1 active actors on pipe
2025-09-30T15:00:09.194432Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555897204343338347:2454], now have 1 active actors on pipe
2025-09-30T15:00:09.194440Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 34 partno 1 count 1 parts_count 3 actorID [2:7555897204253533134:13778]
2025-09-30T15:00:09.194442Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 35 partno 0 count 1 parts_count 4 actorID [2:7555897204253533134:13778]
2025-09-30T15:00:09.194445Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 36 partno 0 count 2 parts_count 8 actorID [2:7555897204253533134:13778]
2025-09-30T15:00:09.194460Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 0. Have to read 3 of 3 from KV
2025-09-30T15:00:09.194477Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 42 max time lag 0ms effective offset 0
2025-09-30T15:00:09.194494Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 8295635 count 3 last offset 0, current partition end offset: 42
2025-09-30T15:00:09.194497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T15:00:09.194542Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:474: No blob in L1. Partition 0 offset 0 partno 0 count 3 parts_count 15 actorID [2:7555897204253533134:13778]
2025-09-30T15:00:09.194553Z node 2 :PERSQUEUE DEBUG: read.h:142: [72075186224037892][PQCacheProxy]Reading cookie 3. Have to read 1 of 1 from KV
2025-09-30T15:00:09.194713Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 34 partno 1 count 1 parts_count 3
2025-09-30T15:00:09.194705Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 3445
2025-09-30T15:00:09.194756Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 3445
2025-09-30T15:00:09.194717Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 35 partno 0 count 1 parts_count 4
2025-09-30T15:00:09.194719Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 36 partno 0 count 2 parts_count 8
2025-09-30T15:00:09.194725Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:223: PQ Cache (L2). Missed blob. tabletId '72075186224037892' partition 0 offset 0 partno 0 count 3 parts_count 15
2025-09-30T15:00:09.195343Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:09.195365Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:09.195407Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|689217da-ae7ec345-7e3ea253-56b7d7fb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T15:00:09.195419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T15:00:09.195424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T15:00:09.195428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T15:00:09.195442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T15:00:09.195458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T15:00:09.195479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:09.195734Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T15:00:09.195746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T15:00:09.195764Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T15:00:09.195942Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3446 partition: 0 MaxSeqNo: 42 sessionId: src_id|689217da-ae7ec345-7e3ea253-56b7d7fb_0
2025-09-30T15:00:09.196376Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|915e4565-baf3ad86-e1446221-4a686ce9_0] Write session established. Init response: last_sequence_number: 42 session_id: "src_id|689217da-ae7ec345-7e3ea253-56b7d7fb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T15:00:09.199718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|689217da-ae7ec345-7e3ea253-56b7d7fb_0] Write session: try to update token
2025-09-30T15:00:09.199749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|689217da-ae7ec345-7e3ea253-56b7d7fb_0] Send 10 message(s) (0 left), first sequence number is 43
2025-09-30T15:00:09.212637Z node 2 :PERSQUEUE DEBUG: read.h:178: [72075186224037892][PQCacheProxy]Got results. 3 of 3 from KV. Status 1
2025-09-30T15:00:09.212661Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 0 from KV. Status 0
2025-09-30T15:00:09.212665Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 1 from KV. Status 0
2025-09-30T15:00:09.212667Z node 2 :PERSQUEUE DEBUG: read.h:195: [72075186224037892][PQCacheProxy]Got results. result 2 from KV. Status 0
2025-09-30T15:00:09.212678Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 34 count 1 size 1741189 actorID [2:7555897204253533134:13778]
2025-09-30T15:00:09.212684Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 35 count 1 size 2253220 actorID [2:7555897204253533134:13778]
2025-09-30T15:00:09.212688Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:408: Prefetched blob in L1. Partition 0 offset 36 count 2 size 4506418 actorID [2:7555897204253533134:13778]
2025-09-30T15:00:09.212737Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:380: [72075186224037892][Partition][0][StateIdle] Continue blobs compaction
2025-09-30T15:00:09.212745Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:439: [72075186224037892][Partition][0][StateIdle] Append blob for key d0000000000_00000000000000000034_00001_0000000001_00003?
2025-09-30T15:00:09.212748Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:440: [72075186224037892][Partition][0][StateIdle] Need to compact head 0
2025-09-30T15:00:09.212911Z node 2 :GLOBAL ERROR: log.cpp:875: verification=NewHead.Offset == Head.GetNextOffset() && NewHead.PartNo == 0 || headCleared || needCompactHead || Head.PackedSize == 0;fline=blob.cpp:442;Head.NextOffset=34;Head.PackedSize=3482360;NewHead.Offset=34;NewHead.PartNo=1;headCleared=0;needCompactHead=0;
2025-09-30T15:00:09.213715Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 34 partno 1 count 1 parts 3 suffix '63' size 1741189
2025-09-30T15:00:09.213732Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 35 partno 0 count 1 parts 4 suffix '63' size 2253220
2025-09-30T15:00:09.213737Z node 2 :PERSQUEUE WARN: pq_l2_cache.cpp:94: PQ Cache (L2). Same blob insertion. Tablet '72075186224037892' partition 0 offset 36 partno 0 count 2 parts 8 suffix '63' size 4506418
2025-09-30T15:00:09.224096Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3446 sessionId: src_id|689217da-ae7ec345-7e3ea253-56b7d7fb_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T15:00:09.227046Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T15:00:09.245344Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:379: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 RequestInfly 0 ReadOffset 0 EndOffset 42 InitDone 1 WaitForData 0, pipe: [1:7555897204343338644:5444]
2025-09-30T15:00:09.246109Z node 1 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 35 consumer shared/user session shared/user_1_35_3181766952260320716_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 44 pipe creation result: OK TabletId: 72075186224037892 Generation: 3445, pipe: [1:7555897204343338644:5444]

Traceback (most recent call last):
  File "library/python/testing/yatest_common/yatest/common/process.py", line 384, in wait
    wait_for(
  File "library/python/testing/yatest_common/yatest/common/process.py", line 765, in wait_for
    raise TimeoutError(truncate(message, MAX_MESSAGE_LEN))
yatest.common.process.TimeoutError: 600 second(s) wait timeout has expired: Command '['/home/runner/.ya/tools/v4/9824364966/test_tool', 'run_ut', '@/home/runner/.ya/build/build_root/rk13/002667/ydb/public/sdk/cpp/src/client/federated_topic/ut/test-results/unittest/testing_out_stuff/chunk3/testing_out_stuff/test_tool.args']' stopped by 600 seconds timeout

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "devtools/ya/test/programs/test_tool/run_test/run_test.py", line 1770, in main
    res.wait(check_exit_code=False, timeout=current_run_test_timeout, on_timeout=timeout_callback)
  File "library/python/testing/yatest_common/yatest/common/process.py", line 398, in wait
    raise ExecutionTimeoutError(self, str(e))
yatest.common.process.ExecutionTimeoutError: (("600 second(s) wait timeout has expired: Command '['/home/runner/.ya/tools/v4/9824364966/test_tool', 'run_ut', '@/home/runner/.ya/build/build_root/rk13/002667/ydb/public/sdk/cpp/src/client/federated_topic/ut/test-results/unittest/testing_out_stuff/chunk3/testing_out_stuff/test_tool.args']' stopped by 600 seconds timeout",), {})
2025-09-30T14:50:12.635400Z :RetryDiscoveryWithCancel INFO: Random seed for debugging is 1759243812635393
2025-09-30T14:50:12.754418Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7555894642003151186:2156];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:12.754443Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:12.764339Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7555894641491360088:2175];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:12.764394Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:12.764461Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:12.768231Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/0025f7/r3tmp/tmpqpO4xs/pdisk_1.dat
2025-09-30T14:50:12.806969Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:12.807281Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:12.826622Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 32651, node 1
2025-09-30T14:50:12.842447Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/0025f7/r3tmp/yandexOu4QIv.tmp
2025-09-30T14:50:12.842460Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/0025f7/r3tmp/yandexOu4QIv.tmp
2025-09-30T14:50:12.842536Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/0025f7/r3tmp/yandexOu4QIv.tmp
2025-09-30T14:50:12.842576Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:12.847373Z INFO: TTestServer started on Port 8448 GrpcPort 32651
2025-09-30T14:50:12.855485Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:12.855513Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:12.857099Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
TClient is connected to server localhost:8448
PQClient connected to localhost:32651
WaitRootIsUp 'Root'...
TClient::Ls request: Root
2025-09-30T14:50:12.867027Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:12.867051Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:12.868602Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-09-30T14:50:12.868906Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:12.883220Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:50:12.964074Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:13.064156Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:13.190570Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894646298119319:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:13.190602Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894646298119329:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:13.190611Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:13.191089Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894646298119358:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:13.191109Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:13.191143Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894646298119361:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:13.191153Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:13.191589Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:13.196429Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7555894646298119333:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-09-30T14:50:13.240865Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7555894645786327603:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:13.240944Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:13.240983Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=YzFmYmMxYjItYWI3OGQ3NjMtMmVmZWIwOGMtODUyYjI5YmU=, ActorId: [2:7555894645786327562:2294], ActorState: ExecuteState, TraceId: 01k6dhmgaecn1yzc4vqd4htjrd, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:13.241634Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:13.248639Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7555894646298119483:2709] txid# 281474976720663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:13.254023Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7555894646298119503:2341], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:13.254161Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=NDFkMzIxZTUtYzg0YTAyNTItZTQ4NDFiMDItODlhM2UxMA==, ActorId: [1:7555894646298119316:2323], ActorState: ExecuteState, TraceId: 01k6dhmga32qhydv7psp3yn77f, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:13.254334Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:13.269360Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:13.296987Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:32651", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:13.343664Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6dhmge8dek17vfhv7hfm3q2, Database: , SessionId: ydb://session/3?node_id=1&id=OTk3OTIwMTItMTdkZjRlMDctZjU5ZjRjZDMtOTVlMGEwZGU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7555894646298119824:2961] 
2025-09-30T14:50:13.756432Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:13.765127Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:17.754671Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7555894642003151186:2156];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:17.754733Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:17.764353Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7555894641491360088:2175];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:17.764403Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
waiting...
2025-09-30T14:50:18.505054Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:32651
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.551359Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:32651
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:18.573647Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7555894667772956831:3274] connected; active server actors: 1
2025-09-30T14:50:18.573849Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:50:18.574076Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:18.575041Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:50:18.583958Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6dhmnj8fdfjf0c4rkxd4qmm, Database: , SessionId: ydb://session/3?node_id=1&id=OTk1OGNlY2ItNGE0ODk1YTEtYjQ2ZTFkYWQtNjllYzg4YTA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-09-30T14:50:18.584360Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:18.587988Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:18.588086Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:18.588102Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:18.588121Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:18.588203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894667772956829:3273], now have 1 active actors on pipe
2025-09-30T14:50:18.588218Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894667772956852:2453], now have 1 active actors on pipe
2025-09-30T14:50:18.588249Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-09-30T14:50:18.588445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.589777Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--test-topic version0
2025-09-30T14:50:18.598478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894667772956908:3325], now have 1 active actors on pipe
2025-09-30T14:50:18.598639Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.600070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.600316Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:18.600349Z node 2 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:18.600441Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:18.600528Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894667261164633:2394]
2025-09-30T14:50:18.601303Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:18.601315Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:18.601321Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7555894667261164633:2394]
2025-09-30T14:50:18.601329Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:18.601636Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:18.601649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.601679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.601682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.601686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:18.601688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.601689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.601691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:18.601699Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:18.601849Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.601871Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:18.602954Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.602994Z node 2 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243818647, TxId 281474976720679
2025-09-30T14:50:18.603004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.603006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.603049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.603114Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.603800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.603849Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.603860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.603863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.603865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.603870Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:18.603993Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:18.604013Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:18.604058Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.605598Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.605627Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.606263Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.701854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.701870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.701873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.802167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.802189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.802192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.902577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.902595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.902597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.002894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.002906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.002909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759243818647
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759243818647
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:32651
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:19.096069Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:19.103231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.103267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.103270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.203613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.203630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.203633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.303965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.303981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.303985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.404333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.404353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.404357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.504657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.504680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.504683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:32651
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:19.598020Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:19.603750Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:19.603996Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:19.604010Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:32651
2025-09-30T14:50:19.604729Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:19.604746Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:19.605011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.605026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.605029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.606409Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:19.606669Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:19.606755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:46054
2025-09-30T14:50:19.606767Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:46054 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:19.606772Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:19.607307Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:19.607360Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:19.607366Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:19.607368Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:19.607384Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894672067924355:2487] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:19.608139Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894672067924355:2487] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:19.635980Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7555894672067924355:2487] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:19.636272Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894672067924387:2487] connected; active server actors: 1
2025-09-30T14:50:19.636373Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7555894672067924355:2487] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:50:19.636378Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894672067924355:2487] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:19.639437Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894672067924387:2487] disconnected; active server actors: 1
2025-09-30T14:50:19.639452Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894672067924387:2487] disconnected no session
2025-09-30T14:50:19.660985Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894672067924409:2487], now have 1 active actors on pipe
2025-09-30T14:50:19.661241Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.661258Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.661299Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|ca7cca94-2be9e498-5b05a85a-10f782e8_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:19.661317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.661323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.661326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.661340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.661356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:19.661378Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.661795Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.661807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.661836Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.662357Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243819662 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.662411Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|ca7cca94-2be9e498-5b05a85a-10f782e8_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:19.662538Z :INFO: [] MessageGroupId [src] SessionId [src|ca7cca94-2be9e498-5b05a85a-10f782e8_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:19.662546Z :INFO: [] MessageGroupId [src] SessionId [src|ca7cca94-2be9e498-5b05a85a-10f782e8_0] Write session will now close
2025-09-30T14:50:19.662560Z :DEBUG: [] MessageGroupId [src] SessionId [src|ca7cca94-2be9e498-5b05a85a-10f782e8_0] Write session: aborting
2025-09-30T14:50:19.662838Z :INFO: [] MessageGroupId [src] SessionId [src|ca7cca94-2be9e498-5b05a85a-10f782e8_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:19.662843Z :DEBUG: [] MessageGroupId [src] SessionId [src|ca7cca94-2be9e498-5b05a85a-10f782e8_0] Write session is aborting and will not restart
2025-09-30T14:50:19.662873Z :DEBUG: [] MessageGroupId [src] SessionId [src|ca7cca94-2be9e498-5b05a85a-10f782e8_0] Write session: destroy
2025-09-30T14:50:19.660301Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894672067924355:2487] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:19.660317Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894672067924355:2487] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:19.660321Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894672067924355:2487] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:19.660331Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:19.661157Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-09-30T14:50:19.661976Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|ca7cca94-2be9e498-5b05a85a-10f782e8_0
2025-09-30T14:50:19.662841Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|ca7cca94-2be9e498-5b05a85a-10f782e8_0 grpc read done: success: 0 data: 
2025-09-30T14:50:19.662844Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|ca7cca94-2be9e498-5b05a85a-10f782e8_0 grpc read failed
2025-09-30T14:50:19.662953Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:824: session v1 closed cookie: 1 sessionId: src|ca7cca94-2be9e498-5b05a85a-10f782e8_0
2025-09-30T14:50:19.662961Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|ca7cca94-2be9e498-5b05a85a-10f782e8_0 is DEAD
2025-09-30T14:50:19.663063Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:19.664883Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894672067924409:2487] destroyed
2025-09-30T14:50:19.664905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:19.664914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.664917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.664919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.705314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.705330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.705333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-09-30T14:50:19.718975Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:28678 } ]
2025-09-30T14:50:19.811424Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.811440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.811443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.911698Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.911715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.911719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.012121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.012134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.012137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.112415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.112429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.112433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.212746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.212764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.212768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.313113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.313127Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.313130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.415307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.415326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.415329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.515402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.515420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.515423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.615777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.615803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.615807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.716064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.716084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.716088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.816462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.816485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.816488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.916783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.916802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.916805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.017109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.017130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.017133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.117501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.117524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.117527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.217783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.217803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.217807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.318200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.318224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.318227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.420656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.420682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.420686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.526779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.526803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.526806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.626920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.626939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.626948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.727281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.727306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.727308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.827628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.827646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.827649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.927976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.927995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.927999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.030013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.030029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.030032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.130218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.130238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.130240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.230579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.230605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.230609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.330846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.330863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.330867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.431313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.431329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.431332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.531634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.531656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.531660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.632002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.632044Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.632048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.732271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.732284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.732286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.832668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.832684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.832687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.933032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.933061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.933065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.033367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.033385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.033388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.133748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.133768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.133772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.234135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.234171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.234174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.335514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.335536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.335539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.435819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.435839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.435843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.536138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.536155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.536158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.601771Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:23.636506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.636521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.636525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.736872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.736891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.736894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.837203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.837228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.837232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.937554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.937572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.937575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.038762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.038806Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.038811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.139300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.139326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.139329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.239645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.239663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.239666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.339959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.339986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.339989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.440288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.440316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.440318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.540808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.540828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.540831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.641058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.641076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.641079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.741397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.741420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.741423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
E0930 14:50:24.772661565 2223696 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:28678: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-09-30T14:50:24.841798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.841812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.841815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.942107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.942125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.942128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.042433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.042462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.042467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.142802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.142817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.142820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.243171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.243189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.243193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.343502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.343521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.343526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.443880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.443901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.443905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:50:25.544212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.544230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.544233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.644574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.644593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.644595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.744916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.744932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.744934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.845243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.845275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.845278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.945614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.945630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.945634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.045919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.045934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.045936Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.146333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.146350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.146353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.246660Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.246674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.246676Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.347020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.347050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.347053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.447405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.447419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.447421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.547740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.547754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.547756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.651397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.651411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.651413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.751480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.751498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.751501Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.851825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.851839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.851842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.952208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.952224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.952227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.052571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.052601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.052605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.152941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.152960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.152963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.253282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.253300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.253303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.353620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.353639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.353642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.453987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.454009Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.454012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.554290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.554305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.554308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.654693Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.654708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.654723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.759562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.759588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.759593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.804187Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-09-30T14:50:27.804231Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:27.860263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.860287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.860290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.960350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.960368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.960371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.060719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.060736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.060739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.161064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.161081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.161085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.267425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.267446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.267456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.367413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.367436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.367440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.467723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.467747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.467750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.568094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.568113Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.568116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.602651Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:28.668474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.668491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.668495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.768743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.768762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.768766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.869172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.869191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.869194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.969498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.969515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.969518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.069835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.069849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.069852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.170193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.170209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.170212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.270763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.270783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.270786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.370931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.370946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.370949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.471272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.471291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.471294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.571613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.571630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.571633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.671924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.671939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.671943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.772419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.772432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.772435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.872608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.872624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.872627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.973047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.973072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.973075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.073364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.073381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.073384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.173735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.173752Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.173755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.274037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.274054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.274057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.374422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.374435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.374437Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.474754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.474780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.474784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.575126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.575140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.575143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.675432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.675446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.675449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.775809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.775836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.775839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.876184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.876201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.876203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.977018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.977043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.977046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.077376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.077392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.077395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.177749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.177766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.177769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.278117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.278136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.278139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.378459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.378477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.378479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.478827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.478840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.478843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.579153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.579167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.579170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.679514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.679529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.679532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.779845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.779868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.779871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.880207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.880224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.880226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.980541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.980555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.980558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.080918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.080934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.080937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.181252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.181270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.181272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.281657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.281678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.281682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.382016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.382038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.382041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.482274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.482292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.482295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.582661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.582675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.582678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.683008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.683032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.683034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.783380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.783395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.783398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.883741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.883758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.883761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.984090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.984109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.984111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
E0930 14:50:33.011845808 2223696 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:28678: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-09-30T14:50:33.084441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.084461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.084464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.184754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.184770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.184773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.285122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.285136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.285139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.385520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.385537Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.385540Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.485845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.485860Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.485863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.586197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.586212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.586214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.602637Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:33.686569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.686590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.686594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.786877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.786892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.786894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.887230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.887258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.887261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.987605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.987619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.987621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.087950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.087969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.087984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.188328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.188347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.188350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.288665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.288682Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.288684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.389034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.389050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.389053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.489316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.489333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.489348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.589730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.589747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.589750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
E0930 14:50:34.674178898 2214697 chttp2_transport.cc:1143]             ipv4:127.0.0.1:28678: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-09-30T14:50:34.690089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.690105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.690108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.790389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.790404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.790407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.890775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.890793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.890797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.991132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.991143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.991145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.091428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.091440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.091443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.191830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.191848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.191852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.292184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.292199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.292202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.392515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.392536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.392538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.492890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.492905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.492907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.593266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.593294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.593297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.693625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.693645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.693649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.793942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.793966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.793969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.894288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.894308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.894312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.994712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.994730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.994734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.095473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.095492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.095495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.195892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.195914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.195918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.296217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.296232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.296234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.399552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.399572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.399577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.499434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.499453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.499457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.599847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.599866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.599869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.700193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.700212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.700216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.800562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.800581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.800585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.900905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.900924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.900927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.002454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.002473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.002477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.102695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.102718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.102722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.202967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.202983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.202985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.303370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.303393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.303397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.403673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.403691Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.403694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.503999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.504016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.504021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.604404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.604433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.604436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.704743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.704763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.704766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.807341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.807362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.807366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.906518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.906547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.906550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.006832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.006851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.006855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.107203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.107225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.107229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.207515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.207535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.207543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.307930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.307949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.307963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.408256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.408276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.408280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.508576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.508594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.508596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.602862Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:38.608938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.608960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.608964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.709286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.709307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.709311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.809632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.809652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.809656Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.909969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.909988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.909993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.010322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.010343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.010347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.110714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.110735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.110738Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.211036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.211053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.211056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.311406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.311427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.311431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.411747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.411766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.411770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.512116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.512136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.512141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.612429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.612451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.612455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.712815Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.712833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.712837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.813186Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.813204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.813207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.913491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.913514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.913517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.013846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.013866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.013870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.114221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.114242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.114245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.214552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.214582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.214586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.314923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.314945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.314949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.415312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.415331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.415335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.515659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.515680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.515684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.616006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.616025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.616028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.716293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.716313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.716316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.816689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.816709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.816713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.917012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.917034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.917037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.017390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.017423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.017427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.117741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.117761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.117765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.218054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.218070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.218072Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.318409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.318427Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.318430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.418745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.418761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.418764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.519135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.519151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.519154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.623319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.623335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.623337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.723415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.723433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.723436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.823930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.823948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.823950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.924121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.924136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.924139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.024465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.024480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.024483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.124830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.124849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.124852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.225194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.225212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.225215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.325545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.325568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.325572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.425870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.425886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.425889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.526213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.526230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.526233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.626526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.626538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.626541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.726906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.726921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.726924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.827308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.827323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.827326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.928189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.928203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.928206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.028498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.028512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.028516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.128846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.128862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.128865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.229201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.229214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.229216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.329549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.329562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.329565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.429906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.429923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.429925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.530265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.530279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.530282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.603016Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:43.630622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.630641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.630644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.730927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.730942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.730945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.831333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.831350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.831353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.931650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.931666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.931668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.032016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.032034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.032037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.132429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.132443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.132445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.232708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.232724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.232727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.333081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.333099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.333102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.433415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.433430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.433434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.533781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.533796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.533799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.634140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.634155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.634159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.734478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.734492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.734495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.834829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.834844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.834848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.935195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.935211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.935214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.035554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.035573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.035576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.135928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.135949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.135954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.236270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.236291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.236294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.336624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.336645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.336649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.436917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.436934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.436938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.537309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.537325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.537329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.637650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.637667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.637669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.738004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.738024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.738028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.838483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.838506Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.838509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.938718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.938732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.938736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.039011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.039027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.039030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.139413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.139431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.139435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.239775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.239794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.239797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.340131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.340145Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.340148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.443310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.443324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.443327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.543374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.543388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.543391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.643721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.643751Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.643755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.744085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.744103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.744109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.844444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.844458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.844461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.944793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.944810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.944814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.045148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.045161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.045163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.145492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.145505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.145508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.245826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.245838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.245841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.346191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.346208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.346211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.446562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.446578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.446581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.546909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.546924Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.546927Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.647216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.647230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.647234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.747604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.747617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.747620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.847964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.847982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.847985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.948311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.948325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.948329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.048675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.048692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.048695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.148954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.148976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.148979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.249366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.249381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.249383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.349707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.349722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.349724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.450066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.450081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.450084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.550428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.550445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.550448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.574960Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:50:48.574982Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-09-30T14:50:48.575283Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:50:48.575567Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-09-30T14:50:48.575695Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:50:48.575753Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-09-30T14:50:48.603213Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:48.650758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.650773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.650776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.751116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.751130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.751133Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.851481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.851497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.851500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.951830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.951859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.951862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.052193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.052208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.052211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.152544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.152565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.152569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.252945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.252976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.252979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.353234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.353249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.353252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.453590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.453606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.453608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.553941Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.553958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.553961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.654259Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.654275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.654278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.754627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.754651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.754655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.854990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.855003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.855005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.955387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.955414Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.955417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.055685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.055709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.055712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.156054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.156068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.156071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.256423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.256438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.256442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.356760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.356777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.356780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.457087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.457106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.457108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.557469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.557487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.557489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.657825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.657839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.657843Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.758165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.758183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.758187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.858511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.858524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.858527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.958856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.958869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.958872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.059223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.059237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.059240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.159575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.159589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.159593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.259917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.259932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.259935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.360291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.360309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.360312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.460608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.460620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.460622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.560976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.560992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.560995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.661322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.661339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.661342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.761690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.761704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.761707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.862024Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.862038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.862041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.962388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.962403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.962405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.062733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.062757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.062759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.163094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.163114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.163117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.263450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.263464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.263468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.363813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.363832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.363836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.464155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.464174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.464177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.564495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.564511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.564514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.664852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.664866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.664869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.765184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.765198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.765201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.865563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.865577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.865580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.965904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.965920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.965923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.066274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.066290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.066293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.166597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.166616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.166618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.266968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.266983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.266985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.367307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.367319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.367322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.467654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.467668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.467671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.568006Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.568022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.568025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.603397Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:53.668364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.668379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.668381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.768711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.768726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.768728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.869084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.869098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.869101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.969417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.969433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.969436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.069773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.069788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.069791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.170159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.170170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.170171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.270479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.270492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.270495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.370839Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.370855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.370858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.471181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.471195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.471197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.571532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.571551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.571554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.671944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.671958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.671960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.772244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.772258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.772261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.872613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.872642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.872646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.972956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.972971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.972974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.073295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.073313Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.073316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.173632Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.173646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.173648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.274011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.274038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.274042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.374353Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.374368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.374370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.474711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.474726Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.474729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-09-30T14:50:55.508531Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:28678 } ]
2025-09-30T14:50:55.575063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.575077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.575080Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.675407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.675422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.675425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.775768Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.775783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.775786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.876130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.876144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.876147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.976459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.976473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.976475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.076821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.076833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.076836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.177179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.177194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.177196Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.277525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.277538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.277541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.377882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.377904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.377907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.478226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.478241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.478243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.578575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.578588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.578591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.678931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.678947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.678950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.779275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.779289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.779292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.879652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.879669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.879672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.979983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.979995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.979997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.080334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.080348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.080351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.180680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.180694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.180697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.281028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.281040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.281043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.381388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.381404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.381408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.481739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.481758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.481761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.582182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.582198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.582200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.682457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.682470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.682472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.782790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.782804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.782807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.883179Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.883194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.883203Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.983503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.983520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.983523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.083817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.083832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.083835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.184240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.184264Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.184268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.284508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.284526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.284529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.384875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.384890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.384893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.485274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.485288Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.485291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.585599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.585615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.585618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.603585Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:58.685973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.685990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.685993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.786314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.786331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.786334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.886690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.886707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.886710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.987017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.987041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.987043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.087380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.087392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.087394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.187746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.187771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.187774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.288074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.288089Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.288091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.388436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.388451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.388454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.488788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.488817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.488821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.589137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.589151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.589154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.689448Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.689463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.689466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.789846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.789862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.789865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.890212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.890236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.890241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.990543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.990559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.990562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.090917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.090931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.090934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.191271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.191287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.191290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.291593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.291610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.291613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.391903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.391917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.391920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.492312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.492327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.492331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.592663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.592680Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.592683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.693020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.693035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.693038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.793362Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.793376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.793379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.893737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.893757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.893760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.994084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.994102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.994105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.094399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.094417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.094420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.194780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.194802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.194805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.295144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.295159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.295162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.395476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.395491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.395493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.495827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.495845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.495848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.596189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.596205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.596209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.696510Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.696524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.696526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.796836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.796854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.796858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.897251Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.897268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.897270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.997599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.997613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.997617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.097943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.097957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.097959Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.198302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.198318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.198321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.298653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.298672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.298675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.398972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.398989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.398992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.499314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.499332Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.499334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.599706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.599719Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.599722Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.700051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.700069Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.700073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.800387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.800403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.800406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.900749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.900773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.900776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.001107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.001125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.001128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.101442Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.101469Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.101472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.201807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.201823Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.201826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.302159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.302171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.302174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.402514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.402527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.402530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.502872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.502891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.502895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.603232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.603270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.603273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.603792Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:03.703578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.703594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.703598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.803908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.803932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.803935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.904286Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.904301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.904304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.004607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.004625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.004629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.104985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.105000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.105004Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.205366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.205380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.205383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.305672Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.305687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.305689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.405982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.405996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.405998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.506373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.506386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.506389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.606741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.606758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.606760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.707109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.707134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.707138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.807455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.807471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.807474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:51:04.907790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.907807Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.907809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.008128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.008143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.008146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.108509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.108526Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.108548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.208787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.208800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.208804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.309224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.309244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.309247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.409566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.409585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.409587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.509895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.509911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.509914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.610269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.610285Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.610287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.710628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.710646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.710649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.810975Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.810990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.810992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.911326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.911342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.911345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.011677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.011694Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.011697Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.112031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.112047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.112051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.212376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.212391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.212394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.312744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.312763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.312766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.413094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.413114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.413117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.513380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.513397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.513400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.615583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.615597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.615600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.715630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.715647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.715650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.815997Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.816013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.816016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.916372Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.916392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.916395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.016739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.016757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.016761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.117085Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.117104Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.117108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.217421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.217436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.217440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.317792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.317809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.317812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.418130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.418147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.418150Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.518443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.518461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.518464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.618832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.618846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.618848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.719191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.719209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.719212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.819549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.819566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.819569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.919895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.919911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.919915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.020238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.020254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.020256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.120592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.120608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.120611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.220943Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.220957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.220960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.321310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.321327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.321329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.421658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.421675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.421696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.522002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.522017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.522020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.603975Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:08.622364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.622380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.622383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.722721Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.722737Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.722740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.823035Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.823051Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.823054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.923405Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.923419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.923422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.023744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.023772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.023776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.124120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.124137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.124140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.224468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.224487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.224490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.324798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.324825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.324828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.425167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.425181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.425184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.525539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.525554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.525557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.625852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.625882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.625886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.726240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.726257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.726260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.826554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.826580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.826582Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.926917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.926937Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.926940Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.027575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.027594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.027597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.127617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.127635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.127637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.227963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.227980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.227982Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.328361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.328386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.328390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.428712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.428746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.428750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.529049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.529066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.529070Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.629378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.629391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.629393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.729748Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.729764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.729767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.830088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.830111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.830114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.930420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.930432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.930434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.030828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.030844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.030847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.131190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.131206Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.131209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.231471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.231487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.231490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.331862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.331878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.331882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.432199Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.432225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.432227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.532559Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.532572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.532574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.632911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.632928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.632931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.733254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.733266Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.733269Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.833622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.833635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.833637Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.933958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.933979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.933981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.034330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.034345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.034348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.134659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.134684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.134686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.235013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.235030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.235033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.335373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.335385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.335387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.435731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.435744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.435746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.536062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.536075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.536078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.636429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.636447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.636450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.736786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.736800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.736803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.837164Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.837185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.837188Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.937492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.937508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.937511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.037834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.037853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.037855Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.138190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.138205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.138208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.238556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.238584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.238588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.338901Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.338916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.338919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.439275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.439291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.439294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.539590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.539602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.539605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.604151Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:13.639972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.639990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.639993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.740316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.740335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.740337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.840653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.840668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.840671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.941019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.941034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.941037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.041360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.041375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.041378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.141745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.141773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.141777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.242079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.242095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.242098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.342417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.342431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.342434Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.442736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.442759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.442762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.543172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.543187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.543189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.643443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.643456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.643459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.743832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.743848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.743851Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.844192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.844209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.844212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.944535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.944550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.944553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.044856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.044871Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.044873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.145244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.145260Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.145263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.245621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.245638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.245641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.345955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.345973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.345977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.446282Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.446299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.446301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.546604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.546618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.546620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.646976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.646988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.646990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.747305Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.747319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.747322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.847709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.847723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.847725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.948048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.948062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.948064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.048377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.048399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.048401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.148759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.148775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.148779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.249111Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.249129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.249132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.349462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.349476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.349479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.449811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.449826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.449828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.550122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.550136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.550139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.650531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.650560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.650563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.750866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.750880Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.750883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.851213Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.851231Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.851234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.951579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.951597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.951600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.051928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.051944Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.051947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.152236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.152255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.152258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.252620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.252635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.252638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.352985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.353000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.353003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.453327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.453341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.453344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.553690Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.553705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.553708Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.654028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.654045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.654048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.754384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.754397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.754401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.854741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.854759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.854761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.955084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.955099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.955102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.055443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.055459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.055462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.155791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.155809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.155812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.256143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.256157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.256160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.356485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.356498Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.356500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.456845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.456859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.456861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.557207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.557225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.557228Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.575110Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:51:18.575133Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-09-30T14:51:18.575377Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:51:18.575638Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 2 DataSize: 0 UsedReserveSize: 0
2025-09-30T14:51:18.575672Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:51:18.604362Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:18.657550Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.657567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.657570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.758048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.758064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.758067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.858252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.858268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.858271Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.958599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.958614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.958617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.058948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.058966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.058969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.159326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.159345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.159348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.259663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.259683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.259685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.360021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.360037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.360039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.460376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.460394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.460396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.560714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.560727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.560730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.661022Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.661034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.661036Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.761435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.761449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.761452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.861784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.861799Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.861803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.962131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.962146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.962149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.062505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.062524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.062527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.162859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.162877Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.162879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.263160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.263174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.263177Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.363555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.363572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.363575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.463895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.463912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.463915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.564253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.564270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.564274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.664593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.664607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.664611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.764925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.764945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.764948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.865307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.865325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.865328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.965602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.965616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.965619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.066012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.066027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.066029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.166370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.166386Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.166389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.266692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.266707Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.266710Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.367078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.367096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.367099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.467401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.467419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.467422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.567764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.567783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.567786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.668121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.668139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.668142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.768477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.768500Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.768504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.868830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.868842Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.868844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.969180Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.969194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.969197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.069525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.069538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.069541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.169867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.169882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.169885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.270232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.270249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.270252Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.370610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.370631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.370633Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.470942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.470961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.470964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.571307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.571327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.571331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.671654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.671668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.671671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.771990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.772005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.772008Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.872348Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.872366Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.872369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.972685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.972702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.972705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.073038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.073054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.073057Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.173393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.173407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.173410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.273745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.273758Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.273761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.374102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.374116Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.374118Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.474459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.474474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.474477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.574816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.574834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.574837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.604536Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:23.675168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.675181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.675184Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.775528Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.775544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.775547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.875874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.875890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.875893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.976210Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.976227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.976235Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.076560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.076575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.076578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.176938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.176954Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.176958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.277267Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.277284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.277287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.377613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.377626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.377629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.477984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.478001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.478005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.578327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.578344Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.578347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.678651Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.678667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.678670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.778983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.778998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.779001Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.879385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.879401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.879404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.979734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.979750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.979753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.080096Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.080110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.080117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.180445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.180463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.180466Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.280791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.280802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.280804Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.381136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.381151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.381154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.481481Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.481493Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.481495Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.581858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.581873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.581876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.682195Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.682209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.682211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.782551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.782567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.782570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.882902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.882918Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.882921Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.983257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.983273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.983277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.083609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.083624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.083627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.183958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.183970Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.183972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.284316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.284333Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.284336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.384663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.384678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.384681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.485021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.485042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.485045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.585309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.585326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.585329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.685713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.685730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.685733Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.786050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.786064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.786066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.886391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.886416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.886420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.986771Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.986787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.986790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.087119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.087132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.087134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.187478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.187494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.187497Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.287831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.287846Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.287849Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.388168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.388185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.388187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.488554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.488572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.488575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.588893Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.588909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.588912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.689204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.689222Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.689225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.789574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.789588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.789590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.889950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.889965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.889969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.990316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.990347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.990352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.090634Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.090667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.090677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.191018Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.191040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.191048Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.291308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.291326Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.291330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.391692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.391704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.391711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.492047Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.492060Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.492063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.592391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.592404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.592407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.604751Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:28.692717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.692728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.692730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.793088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.793101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.793105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.893443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.893456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.893459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.993832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.993847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.993850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.094147Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.094162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.094165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.194535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.194551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.194553Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.294857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.294872Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.294874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.395241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.395272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.395275Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.495556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.495576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.495579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.595913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.595928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.595931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.696291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.696306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.696310Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.796629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.796646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.796649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.896969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.896981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.896983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.997328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.997354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.997357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.097635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.097650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.097653Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.198025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.198038Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.198041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.298400Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.298418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.298422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.398688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.398700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.398702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.499082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.499095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.499098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.599418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.599444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.599447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.699820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.699850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.699853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.800088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.800103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.800105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.900494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.900513Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.900516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.000841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.000856Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.000859Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.101208Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.101224Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.101227Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.201538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.201549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.201552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.301905Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.301919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.301922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.402244Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.402263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.402265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.502611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.502625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.502628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.602964Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.602977Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.602979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.703320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.703336Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.703339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.803671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.803685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.803688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.904032Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.904046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.904049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.004376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.004392Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.004395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.104715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.104728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.104731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.205090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.205107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.205110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.305447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.305479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.305482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.405788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.405803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.405805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.506138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.506156Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.506158Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.606484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.606511Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.606514Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.706847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.706864Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.706868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.807159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.807173Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.807176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.907546Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.907572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.907575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.007889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.007903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.007906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.108255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.108270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.108273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.208622Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.208645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.208648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.308933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.308946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.308949Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.409295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.409311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.409314Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.509649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.509664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.509666Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.604934Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:33.609995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.610012Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.610015Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.710375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.710393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.710396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.810668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.810683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.810685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.911084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.911100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.911103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.011401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.011416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.011420Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.111755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.111770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.111773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.212095Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.212107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.212109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.312446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.312460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.312462Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.412810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.412825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.412827Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.513174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.513189Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.513192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.613529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.613544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.613548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.713886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.713902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.713904Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.814239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.814254Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.814257Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-09-30T14:51:34.862442Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:28678 } ]
2025-09-30T14:51:34.914567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.914599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.914602Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.014907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.014929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.014931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.115289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.115302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.115304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.215616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.215628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.215630Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.315979Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.315993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.315996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.416339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.416352Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.416354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.516688Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.516702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.516705Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.617054Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.617073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.617076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.717416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.717435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.717438Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.817720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.817732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.817734Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.918084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.918098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.918101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.018490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.018509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.018512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.118782Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.118794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.118796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.219123Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.219136Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.219138Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.319490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.319502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.319505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.419863Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.419878Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.419881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.520209Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.520226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.520229Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.620508Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.620521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.620525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.720886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.720903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.720906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.821232Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.821245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.821247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.921623Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.921638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.921640Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.021967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.021981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.021984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.122322Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.122337Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.122340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.222662Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.222677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.222681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.323025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.323042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.323045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.423368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.423381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.423383Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.523728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.523740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.523742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.624079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.624094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.624097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.724425Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.724451Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.724454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.824729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.824742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.824744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.925148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.925160Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.925163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.025505Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.025518Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.025521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.125870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.125884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.125886Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.226192Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.226205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.226207Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.326515Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.326529Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.326531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.426910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.426928Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.426932Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.527263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.527278Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.527281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.605109Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:38.627592Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.627605Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.627607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.727963Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.727980Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.727983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.828299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.828315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.828319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.928629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.928642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.928643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.029010Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.029025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.029027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.129388Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.129412Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.129416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.229716Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.229728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.229731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.330043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.330056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.330066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.430409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.430426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.430429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.530772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.530788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.530791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.631097Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.631114Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.631117Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.731473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.731489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.731492Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.831785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.831809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.831812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.932175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.932190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.932193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.032521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.032536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.032539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.132892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.132907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.132910Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.233242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.233258Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.233261Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.333591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.333608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.333611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.433942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.433958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.433961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.534296Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.534312Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.534315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.634664Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.634679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.634683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.734998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.735013Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.735016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.835307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.835324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.835327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.935706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.935717Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.935720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.036065Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.036081Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.036083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:51:41.136389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.136403Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.136406Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.236755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.236770Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.236773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.623544Z :RecreateObserver INFO: Random seed for debugging is 1759243901623538
2025-09-30T14:51:41.691477Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7555895021325919880:2164];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:51:41.691493Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:51:41.692959Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7555895022285192609:2162];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:51:41.692979Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:51:41.693016Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:51:41.693093Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/0025f7/r3tmp/tmpeUHc4Q/pdisk_1.dat
2025-09-30T14:51:41.695004Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:51:41.695348Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:51:41.707989Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:51:41.714317Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:51:41.714337Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:51:41.716130Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-09-30T14:51:41.716446Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 29280, node 3
2025-09-30T14:51:41.722687Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/0025f7/r3tmp/yandexMHc52b.tmp
2025-09-30T14:51:41.722698Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/0025f7/r3tmp/yandexMHc52b.tmp
2025-09-30T14:51:41.722766Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/0025f7/r3tmp/yandexMHc52b.tmp
2025-09-30T14:51:41.722814Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:51:41.725651Z INFO: TTestServer started on Port 16980 GrpcPort 29280
TClient is connected to server localhost:16980
PQClient connected to localhost:29280
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:51:41.740046Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:51:41.792992Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:51:41.793030Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:51:41.794622Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-09-30T14:51:41.911962Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:51:41.926985Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:51:42.029068Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555895025620887995:2324], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:51:42.029089Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555895025620888018:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:51:42.029098Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:51:42.030070Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:51:42.034587Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7555895025620888025:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-09-30T14:51:42.035343Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:51:42.050652Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:51:42.067445Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7555895026580160196:2305], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:51:42.067531Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=NWE4ZTIzODAtNWVlYmFmNDItMTQ1ODRjYWQtODRhNjVjYTg=, ActorId: [4:7555895026580160162:2298], ActorState: ExecuteState, TraceId: 01k6dhq73e6wqx0s95aenbtw02, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:51:42.067760Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:51:42.075603Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:29280", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:51:42.095468Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7555895025620888510:2974] txid# 281474976710665, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:51:42.111105Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710666. Ctx: { TraceId: 01k6dhq74cfd9scjpanvr5hah1, Database: , SessionId: ydb://session/3?node_id=3&id=ODQ1ZWVhOWYtZTRlYjkyMi0zNTZhZThjZS02MTg3ZTk3OQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7555895025620888575:3012] 
2025-09-30T14:51:42.692893Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:51:42.694394Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:51:46.691604Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7555895021325919880:2164];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:51:46.691752Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:51:46.693139Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7555895022285192609:2162];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:51:46.693182Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:51:47.370558Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710681:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:29280
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:51:47.387616Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:29280
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710682
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:51:47.394126Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:47.394875Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:47.394948Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:51:47.394960Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:47.394925Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7555895047095725665:3355] connected; active server actors: 1
2025-09-30T14:51:47.394967Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:51:47.395058Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:51:47.395133Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555895047095725663:3353], now have 1 active actors on pipe
2025-09-30T14:51:47.395167Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:51:47.395231Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:51:47.395528Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7555895048054997054:2380], now have 1 active actors on pipe
2025-09-30T14:51:47.395582Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-09-30T14:51:47.395686Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:51:47.396236Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:51:47.397792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555895047095725735:3408], now have 1 active actors on pipe
2025-09-30T14:51:47.397868Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:51:47.398727Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:51:47.398893Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:47.398904Z node 3 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:51:47.398944Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:47.398982Z node 3 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7555895047095725747:2475]
2025-09-30T14:51:47.399566Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:47.399573Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:47.399576Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7555895047095725747:2475]
2025-09-30T14:51:47.399582Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:51:47.399788Z node 3 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:51:47.399797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.399807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.399809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:47.399811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:51:47.399812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.399813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.399814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:51:47.399818Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:47.399871Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:51:47.399892Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:47.400810Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:51:47.400855Z node 3 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243907442, TxId 281474976710682
2025-09-30T14:51:47.400864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.400866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.400901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.400940Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:47.401391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:47.401442Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:47.401455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.401457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.401459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.401464Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:47.401580Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:51:47.401600Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:47.401649Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:51:47.402388Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:51:47.402421Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:51:47.402798Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:51:47.407722Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710683. Ctx: { TraceId: 01k6dhqca04w84x53749sx5rbd, Database: , SessionId: ydb://session/3?node_id=3&id=YzJmYWVkNTEtNjVmMGRlOTgtYzc0M2ZjNTQtZGJjY2FmNGQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710682
    CreateStep: 1759243907442
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710682
    CreateStep: 1759243907442
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:29280
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:51:47.413766Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:51:47.500007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.500024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.500028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.600399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.600413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.600416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.700744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.700756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.700759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.801051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.801065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.801068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.901400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.901418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.901421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:29280
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:51:47.915006Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:51:48.001819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.001834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.001837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.102134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.102148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.102150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.202500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.202513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.202515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.302848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.302862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.302864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.403195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.403226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.403228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:29280
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:51:48.416776Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:51:48.418143Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:51:48.418425Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:51:48.418442Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:29280
2025-09-30T14:51:48.418799Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:51:48.418975Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:48.418988Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:51:48.419293Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:51:48.419348Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:58238
2025-09-30T14:51:48.419360Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58238 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:48.419364Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:48.419807Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:51:48.419839Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:48.419845Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:48.419847Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:48.419852Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7555895051390693250:2514] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:48.420386Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7555895051390693250:2514] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:48.441257Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7555895051390693250:2514] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:51:48.441385Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555895051390693282:2514] connected; active server actors: 1
2025-09-30T14:51:48.441542Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7555895051390693250:2514] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:51:48.441550Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555895051390693250:2514] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:48.441644Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555895051390693282:2514] disconnected; active server actors: 1
2025-09-30T14:51:48.441651Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555895051390693282:2514] disconnected no session
2025-09-30T14:51:48.459259Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555895051390693250:2514] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:48.459278Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7555895051390693250:2514] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:51:48.459282Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555895051390693250:2514] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:48.459289Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:48.459446Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-09-30T14:51:48.459452Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555895051390693302:2514], now have 1 active actors on pipe
2025-09-30T14:51:48.459459Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.459466Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.459500Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|69d691ef-abafa027-6000b5b0-c05d15be_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:51:48.459514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.459522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.459525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:48.459535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.459557Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:48.459576Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.459615Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:48.459622Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:48.459633Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:48.459665Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|69d691ef-abafa027-6000b5b0-c05d15be_0
2025-09-30T14:51:48.460091Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243908460 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:48.460131Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|69d691ef-abafa027-6000b5b0-c05d15be_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:48.460237Z :INFO: [] MessageGroupId [src] SessionId [src|69d691ef-abafa027-6000b5b0-c05d15be_0] Write session: close. Timeout = 0 ms
2025-09-30T14:51:48.460244Z :INFO: [] MessageGroupId [src] SessionId [src|69d691ef-abafa027-6000b5b0-c05d15be_0] Write session will now close
2025-09-30T14:51:48.460250Z :DEBUG: [] MessageGroupId [src] SessionId [src|69d691ef-abafa027-6000b5b0-c05d15be_0] Write session: aborting
2025-09-30T14:51:48.460408Z :INFO: [] MessageGroupId [src] SessionId [src|69d691ef-abafa027-6000b5b0-c05d15be_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:51:48.460413Z :DEBUG: [] MessageGroupId [src] SessionId [src|69d691ef-abafa027-6000b5b0-c05d15be_0] Write session: destroy
2025-09-30T14:51:48.460540Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|69d691ef-abafa027-6000b5b0-c05d15be_0 grpc read done: success: 0 data: 
2025-09-30T14:51:48.460549Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|69d691ef-abafa027-6000b5b0-c05d15be_0 grpc read failed
2025-09-30T14:51:48.460556Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|69d691ef-abafa027-6000b5b0-c05d15be_0 grpc closed
2025-09-30T14:51:48.460561Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|69d691ef-abafa027-6000b5b0-c05d15be_0 is DEAD
2025-09-30T14:51:48.460809Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:51:48.460859Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7555895051390693302:2514] destroyed
2025-09-30T14:51:48.460871Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:51:48.460876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.460880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.460882Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-09-30T14:51:48.503570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.503584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.503586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.603917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.603930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.603933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.704277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.704291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.704294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.804641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.804657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.804661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.904971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.904987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.904989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.005288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.005301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.005305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.105626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.105643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.105646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.206014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.206026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.206027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.306384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.306401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.306404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.406698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.406711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.406713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: err
2025-09-30T14:51:49.464203Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: TRANSPORT_UNAVAILABLE. Description: [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:26128 } ]
2025-09-30T14:51:49.464228Z :ERROR: [/Root] [] [89cf5354-2d1f1793-95833457-7a86485b] Federated state update failed. FederationState: { Status: TRANSPORT_UNAVAILABLE SelfLocation: "" Issues: { [ { <main>: Error: GRpc error: (14): mock 'unavailable' } { <main>: Error: Grpc error response on endpoint localhost:26128 } ] } }
>>> Got event: SessionClosed { Status: TRANSPORT_UNAVAILABLE Issues: "<main>: Error: GRpc error: (14): mock 'unavailable' <main>: Error: Grpc error response on endpoint localhost:26128 " }
Session2 was created
2025-09-30T14:51:49.507099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.507115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.507118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.607443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.607455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.607458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.707771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.707784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.707787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.808151Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.808165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.808168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.908520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.908535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.908537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.008849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.008863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.008866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.109188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.109200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.109202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.209575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.209592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.209595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.309926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.309945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.309948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.410258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.410275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.410278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:51:50.464916Z :INFO: [/Root] [] [3bf424c3-2ed126a0-17c15e30-6baa6576] Open read subsessions to databases: { name: dc1, endpoint: localhost:29280, path: /Root }, { name: dc2, endpoint: localhost:29280, path: /Root }, { name: dc3, endpoint: localhost:29280, path: /Root }
2025-09-30T14:51:50.467106Z :INFO: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] Starting read session
2025-09-30T14:51:50.467117Z :DEBUG: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] Starting single session
2025-09-30T14:51:50.467356Z :DEBUG: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:50.467363Z :DEBUG: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:50.467367Z :DEBUG: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] [] Reconnecting session to cluster  in 0.000000s
2025-09-30T14:51:50.468024Z :INFO: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] Starting read session
2025-09-30T14:51:50.468031Z :DEBUG: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] Starting single session
2025-09-30T14:51:50.468056Z :DEBUG: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:50.468059Z :DEBUG: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:50.468063Z :DEBUG: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] [] Reconnecting session to cluster  in 0.000000s
2025-09-30T14:51:50.468138Z :INFO: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] Starting read session
2025-09-30T14:51:50.468141Z :DEBUG: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] Starting single session
2025-09-30T14:51:50.468212Z :DEBUG: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:50.468215Z :DEBUG: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:50.468218Z :DEBUG: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] [] Reconnecting session to cluster  in 0.000000s
2025-09-30T14:51:50.468932Z :DEBUG: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] [] Successfully connected. Initializing session
2025-09-30T14:51:50.469014Z :DEBUG: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] [] Successfully connected. Initializing session
2025-09-30T14:51:50.469023Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:51:50.469038Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-09-30T14:51:50.469075Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:51:50.469077Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-09-30T14:51:50.469070Z :DEBUG: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] [] Successfully connected. Initializing session
2025-09-30T14:51:50.469084Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:51:50.469085Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-09-30T14:51:50.471727Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:50.471812Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_4615774092475185717_v1 read init: from# ipv6:[::1]:52566, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:50.471915Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_4615774092475185717_v1 auth for : user
2025-09-30T14:51:50.471937Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:50.471962Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_4985458326270941207_v1 read init: from# ipv6:[::1]:52566, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:50.472001Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_4985458326270941207_v1 auth for : user
2025-09-30T14:51:50.472016Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:50.472031Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 read init: from# ipv6:[::1]:52566, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:50.472063Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 auth for : user
2025-09-30T14:51:50.472258Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 Handle describe topics response
2025-09-30T14:51:50.472280Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 auth is DEAD
2025-09-30T14:51:50.472297Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_4985458326270941207_v1 Handle describe topics response
2025-09-30T14:51:50.472308Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_4985458326270941207_v1 auth is DEAD
2025-09-30T14:51:50.472314Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:51:50.472597Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:51:50.472629Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_4985458326270941207_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:51:50.472721Z :INFO: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] [] Got InitResponse. ReadSessionId: shared/user_3_3_14901596075915687644_v1
2025-09-30T14:51:50.472729Z :DEBUG: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:50.472767Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_4985458326270941207_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:51:50.472801Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_4615774092475185717_v1 Handle describe topics response
2025-09-30T14:51:50.472811Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_4615774092475185717_v1 auth is DEAD
2025-09-30T14:51:50.472822Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_4615774092475185717_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:51:50.472839Z :DEBUG: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:50.472942Z :INFO: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] [] Got InitResponse. ReadSessionId: shared/user_3_1_4985458326270941207_v1
2025-09-30T14:51:50.472960Z :DEBUG: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:50.472977Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_4615774092475185717_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:51:50.473013Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-09-30T14:51:50.473027Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 got read request: guid# 6352434d-348f507d-fb8a116-90e65b94
2025-09-30T14:51:50.473077Z :DEBUG: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:50.473088Z :INFO: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] [] Got InitResponse. ReadSessionId: shared/user_3_2_4615774092475185717_v1
2025-09-30T14:51:50.473098Z :DEBUG: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:50.473181Z :DEBUG: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:50.473165Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555895059980628059:2557] connected; active server actors: 1
2025-09-30T14:51:50.473186Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555895059980628061:2556] connected; active server actors: 1
2025-09-30T14:51:50.473189Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555895059980628060:2555] connected; active server actors: 1
2025-09-30T14:51:50.473213Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_4985458326270941207_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-09-30T14:51:50.473258Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_4985458326270941207_v1 got read request: guid# a14fed79-543db15a-48de72a3-641b6361
2025-09-30T14:51:50.473269Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_4615774092475185717_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-09-30T14:51:50.473275Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_4615774092475185717_v1 got read request: guid# b3b42b25-cf80bc77-a6b075c6-51249329
2025-09-30T14:51:50.473283Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7555895059980628059:2557] session shared/user_3_3_14901596075915687644_v1
2025-09-30T14:51:50.473298Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:51:50.473309Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:51:50.473316Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_3_14901596075915687644_v1" (Sender=[3:7555895059980628052:2557], Pipe=[3:7555895059980628059:2557], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:50.473320Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:51:50.473335Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7555895059980628061:2556] session shared/user_3_2_4615774092475185717_v1
2025-09-30T14:51:50.473346Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_2_4615774092475185717_v1" (Sender=[3:7555895059980628051:2556], Pipe=[3:7555895059980628061:2556], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:50.473350Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7555895059980628060:2555] session shared/user_3_1_4985458326270941207_v1
2025-09-30T14:51:50.473353Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_4985458326270941207_v1" (Sender=[3:7555895059980628050:2555], Pipe=[3:7555895059980628060:2555], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:50.473359Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:51:50.473366Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_3_14901596075915687644_v1" (Sender=[3:7555895059980628052:2557], Pipe=[3:7555895059980628059:2557], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:50.473382Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_3_14901596075915687644_v1" sender [3:7555895059980628052:2557] lock partition 0 for ReadingSession "shared/user_3_3_14901596075915687644_v1" (Sender=[3:7555895059980628052:2557], Pipe=[3:7555895059980628059:2557], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-09-30T14:51:50.473395Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-09-30T14:51:50.473400Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000038s
2025-09-30T14:51:50.473659Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_3_14901596075915687644_v1" ClientId: "user" PipeClient { RawX1: 7555895059980628059 RawX2: 4503612512274941 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:51:50.473682Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:51:50.473742Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7555895059980628063:2564]
2025-09-30T14:51:50.473760Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555895059980628063:2564], now have 1 active actors on pipe
2025-09-30T14:51:50.473766Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:50.473772Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:50.473783Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_3_14901596075915687644_v1 on pipe: [3:7555895059980628063:2564]
2025-09-30T14:51:50.473801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.473809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.473811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:50.473828Z node 3 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_3_14901596075915687644_v1
2025-09-30T14:51:50.473835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.473863Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:50.474029Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_3_14901596075915687644_v1:1 with generation 1
2025-09-30T14:51:50.474722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:50.474750Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:50.474758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.474760Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.474762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.474768Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:50.474779Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:51:50.474821Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759243910410 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:51:50.474833Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-09-30T14:51:50.474847Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 sending to client partition status
>>> Got event: StartPartitionSession { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc3 Database path: /Root Database id: account-dc3 CommittedOffset: 0 EndOffset: 0 }
2025-09-30T14:51:50.475161Z :INFO: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] Closing read session. Close timeout: 0.000000s
2025-09-30T14:51:50.475171Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-09-30T14:51:50.475177Z :INFO: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 8 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:50.475192Z :NOTICE: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-09-30T14:51:50.475199Z :DEBUG: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] [] Abort session to cluster
2025-09-30T14:51:50.475326Z :INFO: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] Closing read session. Close timeout: 0.000000s
2025-09-30T14:51:50.475335Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-09-30T14:51:50.475340Z :INFO: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 7 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:50.475348Z :NOTICE: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-09-30T14:51:50.475351Z :DEBUG: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] [] Abort session to cluster
2025-09-30T14:51:50.475371Z :INFO: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] Closing read session. Close timeout: 0.000000s
2025-09-30T14:51:50.475376Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-09-30T14:51:50.475381Z :INFO: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] Counters: { Errors: 0 CurrentSessionLifetimeMs: 7 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:50.475384Z :NOTICE: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Close with zero timeout " }
2025-09-30T14:51:50.475386Z :DEBUG: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] [] Abort session to cluster
2025-09-30T14:51:50.475398Z :INFO: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] Closing read session. Close timeout: 0.000000s
2025-09-30T14:51:50.475402Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:0:0
2025-09-30T14:51:50.475405Z :INFO: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] Counters: { Errors: 0 CurrentSessionLifetimeMs: 7 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:50.475408Z :NOTICE: [/Root] [/Root] [34302724-6c1483e5-e8abdeda-42e25edb] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:51:50.475423Z :INFO: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] Closing read session. Close timeout: 0.000000s
2025-09-30T14:51:50.475425Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-09-30T14:51:50.475427Z :INFO: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] Counters: { Errors: 0 CurrentSessionLifetimeMs: 7 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:50.475429Z :NOTICE: [/Root] [/Root] [898f582a-cc3fa046-2956e888-71e19a3f] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:51:50.475436Z :INFO: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] Closing read session. Close timeout: 0.000000s
2025-09-30T14:51:50.475437Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-09-30T14:51:50.475439Z :INFO: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] Counters: { Errors: 0 CurrentSessionLifetimeMs: 8 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:50.475442Z :NOTICE: [/Root] [/Root] [a41849d4-91409220-dc1a40e0-8c565e6a] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:51:50.475476Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_4985458326270941207_v1 grpc read done: success# 0, data# {  }
2025-09-30T14:51:50.475486Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_4985458326270941207_v1 grpc read failed
2025-09-30T14:51:50.475490Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_4985458326270941207_v1 grpc closed
2025-09-30T14:51:50.475493Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_4985458326270941207_v1 is DEAD
2025-09-30T14:51:50.475806Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555895059980628060:2555] disconnected; active server actors: 1
2025-09-30T14:51:50.475817Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555895059980628060:2555] client user disconnected session shared/user_3_1_4985458326270941207_v1
2025-09-30T14:51:50.475824Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:51:50.475835Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-09-30T14:51:50.475839Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-09-30T14:51:50.475842Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000005s
2025-09-30T14:51:50.475879Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_4615774092475185717_v1 grpc read done: success# 0, data# {  }
2025-09-30T14:51:50.475890Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_3_2_4615774092475185717_v1 grpc read failed
2025-09-30T14:51:50.475894Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1666: session cookie 2 consumer shared/user session shared/user_3_2_4615774092475185717_v1 closed
2025-09-30T14:51:50.475981Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_4615774092475185717_v1 is DEAD
2025-09-30T14:51:50.476147Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555895059980628061:2556] disconnected; active server actors: 1
2025-09-30T14:51:50.476158Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555895059980628061:2556] client user disconnected session shared/user_3_2_4615774092475185717_v1
2025-09-30T14:51:50.476172Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:51:50.476183Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-09-30T14:51:50.476187Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:51:50.476191Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000005s
2025-09-30T14:51:50.476338Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555895059980628059:2557] disconnected; active server actors: 1
2025-09-30T14:51:50.476348Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555895059980628059:2557] client user disconnected session shared/user_3_3_14901596075915687644_v1
2025-09-30T14:51:50.476074Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 grpc read done: success# 0, data# {  }
2025-09-30T14:51:50.476078Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 grpc read failed
2025-09-30T14:51:50.476082Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 grpc closed
2025-09-30T14:51:50.476087Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_3_3_14901596075915687644_v1 is DEAD
2025-09-30T14:51:50.476305Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_3_14901596075915687644_v1
2025-09-30T14:51:50.476311Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7555895059980628063:2564] destroyed
2025-09-30T14:51:50.476322Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_3_14901596075915687644_v1
2025-09-30T14:51:50.510613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.510629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.510632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.610929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.610944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.610947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:12.459277Z :WaitEventBlocksBeforeDiscovery INFO: Random seed for debugging is 1759243812459270
2025-09-30T14:50:12.564354Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7555894641148613708:2078];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:12.565177Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/002603/r3tmp/tmpjT45WR/pdisk_1.dat
2025-09-30T14:50:12.571659Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7555894638310528537:2154];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:12.571709Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:12.570893Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:12.576504Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:12.621425Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:12.632262Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:12.633178Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 11883, node 1
2025-09-30T14:50:12.652029Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/002603/r3tmp/yandex68t2ps.tmp
2025-09-30T14:50:12.652042Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/002603/r3tmp/yandex68t2ps.tmp
2025-09-30T14:50:12.652114Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/002603/r3tmp/yandex68t2ps.tmp
2025-09-30T14:50:12.652178Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:12.655912Z INFO: TTestServer started on Port 13427 GrpcPort 11883
2025-09-30T14:50:12.666563Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:12.666598Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
TClient is connected to server localhost:13427
2025-09-30T14:50:12.668332Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
PQClient connected to localhost:11883
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: 2025-09-30T14:50:12.676136Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:12.676165Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:12.677757Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-09-30T14:50:12.678164Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:12.681103Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:50:12.788237Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:12.928550Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:12.993067Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894638310528743:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.993100Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894638310528768:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.993135Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.994778Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:12.996070Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894638310528799:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.996101Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.996165Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894638310528801:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.996187Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:13.001643Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7555894638310528772:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-09-30T14:50:13.075912Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7555894645443582002:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:13.076028Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=NDk0OWIyYi00YjI1ZjhlLTExMDY0NmM4LTdjM2MyNWJm, ActorId: [1:7555894645443581960:2322], ActorState: ExecuteState, TraceId: 01k6dhmg593skc8vhe2jt5f7x7, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:13.076548Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:13.076854Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:13.095091Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7555894642605496141:2163] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:13.101199Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7555894642605496166:2309], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:13.101293Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=NWU5NzIzZDUtZmFkNjFiZTYtNzVkODUzZDgtN2QzZDRmN2M=, ActorId: [2:7555894638310528740:2294], ActorState: ExecuteState, TraceId: 01k6dhmg408qdq0apacvg9g17c, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:13.101478Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:13.106801Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:13.139573Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:11883", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:13.185688Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6dhmg9b8s1bffv0ve5w1rx3, Database: , SessionId: ydb://session/3?node_id=1&id=MWMxYTJiMjEtNDNiOWU1M2ItODUwMTg1NTktOTZhYjZkNzk=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7555894645443582387:2942] 
2025-09-30T14:50:13.567418Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:13.573042Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:17.567151Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7555894641148613708:2078];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:17.567216Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:17.571732Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7555894638310528537:2154];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:17.571767Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:50:18.350893Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:11883
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.376411Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:11883
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:18.386168Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7555894666918419387:3252] connected; active server actors: 1
2025-09-30T14:50:18.386308Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:50:18.386419Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:18.386708Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:50:18.388938Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:18.392158Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:18.392280Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:18.392293Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:18.392309Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:18.392416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894666918419386:3251], now have 1 active actors on pipe
2025-09-30T14:50:18.392425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894666918419415:2446], now have 1 active actors on pipe
2025-09-30T14:50:18.392451Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-09-30T14:50:18.392665Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.394521Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.397179Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894666918419444:3298], now have 1 active actors on pipe
2025-09-30T14:50:18.397281Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.398684Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.399615Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6dhmnce3bw3zcswkda29qbt, Database: , SessionId: ydb://session/3?node_id=1&id=OGQzY2YyYmYtN2MzNWYwYzktMmYxMTEzNDYtYjdmZjBjZDI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-09-30T14:50:18.398942Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:18.398982Z node 2 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:18.399045Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:18.399105Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894664080333145:2402]
2025-09-30T14:50:18.399900Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:18.399904Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:18.399909Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7555894664080333145:2402]
2025-09-30T14:50:18.399917Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:18.400230Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:18.400238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.400270Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.400273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.400277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:18.400279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.400281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.400283Z node 2 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:18.400293Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:18.400430Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.400455Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:18.401600Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.401636Z node 2 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243818444, TxId 281474976720677
2025-09-30T14:50:18.401641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.401643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.401667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.401723Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.402471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.402528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.402544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.402547Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.402549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.402555Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:18.402670Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:18.402696Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:18.402739Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-09-30T14:50:18.403922Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.403943Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.404392Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759243818444
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759243818444
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:11883
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.405691Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:18.498461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.498487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.498490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.598867Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.598883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.598887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.699182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.699197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.699200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.799548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.799565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.799568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.899866Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.899887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.899890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:11883
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.906895Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:19.000292Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.000318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.000321Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.100593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.100610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.100612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.200938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.200953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.200956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.302175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.302198Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.302201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.402643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.402655Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.402657Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:11883
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:19.408751Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:19.410203Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:19.410405Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:19.410410Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:11883
2025-09-30T14:50:19.411423Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:19.411437Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:19.412169Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:19.412355Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:19.412401Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:33588
2025-09-30T14:50:19.412408Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:33588 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:19.412410Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:19.412755Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:19.412796Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:19.412802Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:19.412804Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:19.412818Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894671213386916:2480] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:19.413250Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894671213386916:2480] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:19.440724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7555894671213386916:2480] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:19.440839Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894671213386947:2480] connected; active server actors: 1
2025-09-30T14:50:19.440870Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7555894671213386916:2480] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:50:19.440875Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894671213386916:2480] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:19.440953Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894671213386947:2480] disconnected; active server actors: 1
2025-09-30T14:50:19.440960Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894671213386947:2480] disconnected no session
2025-09-30T14:50:19.460615Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894671213386916:2480] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:19.460633Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894671213386916:2480] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:19.460638Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894671213386916:2480] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:19.460647Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:19.460903Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894671213386970:2480], now have 1 active actors on pipe
2025-09-30T14:50:19.460985Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-09-30T14:50:19.461055Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.461070Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.461118Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|39e8156f-d84cb661-b18d5bfb-20d40118_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:19.461140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.461146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.461148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.461162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.461182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:19.461211Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.461785Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.461798Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.461822Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.461938Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|39e8156f-d84cb661-b18d5bfb-20d40118_0
2025-09-30T14:50:19.462263Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243819462 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.462316Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|39e8156f-d84cb661-b18d5bfb-20d40118_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:19.462458Z :INFO: [] MessageGroupId [src] SessionId [src|39e8156f-d84cb661-b18d5bfb-20d40118_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:19.462466Z :INFO: [] MessageGroupId [src] SessionId [src|39e8156f-d84cb661-b18d5bfb-20d40118_0] Write session will now close
2025-09-30T14:50:19.462472Z :DEBUG: [] MessageGroupId [src] SessionId [src|39e8156f-d84cb661-b18d5bfb-20d40118_0] Write session: aborting
2025-09-30T14:50:19.462624Z :INFO: [] MessageGroupId [src] SessionId [src|39e8156f-d84cb661-b18d5bfb-20d40118_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:19.462630Z :DEBUG: [] MessageGroupId [src] SessionId [src|39e8156f-d84cb661-b18d5bfb-20d40118_0] Write session: destroy
2025-09-30T14:50:19.462813Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|39e8156f-d84cb661-b18d5bfb-20d40118_0 grpc read done: success: 0 data: 
2025-09-30T14:50:19.462824Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|39e8156f-d84cb661-b18d5bfb-20d40118_0 grpc read failed
2025-09-30T14:50:19.462832Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|39e8156f-d84cb661-b18d5bfb-20d40118_0 grpc closed
2025-09-30T14:50:19.462837Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|39e8156f-d84cb661-b18d5bfb-20d40118_0 is DEAD
2025-09-30T14:50:19.463122Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:19.463270Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894671213386970:2480] destroyed
2025-09-30T14:50:19.463287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:19.463295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.463298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.463300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Before ReadSession was created
Session was created
Returned from WaitEvent
2025-09-30T14:50:19.503367Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.503380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.503384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.603873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.603889Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.603892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.704239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.704253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.704256Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.804593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.804610Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.804613Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.904956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.904971Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.904973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.005274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.005291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.005295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.105652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.105665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.105668Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.206049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.206063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.206066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.306370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.306387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.306390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.406713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.406731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.406756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Session blocked successfully
Session closed gracefully
2025-09-30T14:50:20.507074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.507091Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.507094Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.607416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.607430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.607433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.707760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.707775Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.707779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.808125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.808141Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.808144Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.908468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.908484Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.908486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.008881Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.008897Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.008900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.109175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.109191Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.109194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.209516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.209532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.209535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.311375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.311410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.311413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.411779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.411797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.411801Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.515382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.515398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.515402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.617247Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.617277Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.617280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.717439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.717453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.717456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.817797Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.817816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.817818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.918143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.918172Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.918176Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.018453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.018471Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.018474Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.118836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.118854Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.118857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.219154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.219168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.219170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.319549Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.319568Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.319571Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.419899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.419917Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.419920Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.520242Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.520274Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.520276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.620588Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.620604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.620607Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.720969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.720986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.720989Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.821301Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.821317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.821320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:22.921700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:22.921718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:22.921720Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.022003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.022020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.022023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.122379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.122393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.122397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.222679Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.222703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.222706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.323361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.323377Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.323380Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.399405Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:23.423922Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.423942Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.423946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.524276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.524294Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.524298Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.624618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.624647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.624650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.727503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.727521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.727524Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.827926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.827947Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.827951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:23.928249Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:23.928265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:23.928268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.028625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.028643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.028646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.129100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.129119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.129122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.229338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.229360Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.229363Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.329638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.329658Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.329661Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.430067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.430084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.430101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.530415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.530429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.530433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.630776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.630792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.630795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.731083Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.731103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.731106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.831460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.831477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.831480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:24.931754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:24.931773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:24.931776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.032143Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.032163Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.032167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.132490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.132516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.132519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.236112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.236139Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.236142Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.336255Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.336273Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.336276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.436624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.436639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.436643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.539355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.539371Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.539375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.639882Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.639900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.639903Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.740230Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.740245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.740248Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.840591Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.840608Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.840611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.940931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.940957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.940961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.041304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.041320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.041324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.141652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.141671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.141675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.242005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.242025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.242028Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.343374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.343391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.343395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.443696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.443711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.443714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.544112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.544129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.544132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.647316Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.647340Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.647343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.747404Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.747421Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.747423Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.847659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.847689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.847692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.948100Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.948120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.948124Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.048375Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.048393Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.048396Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.148714Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.148731Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.148735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.249724Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.249740Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.249742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.351381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.351399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.351402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.451875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.451894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.451898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.552220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.552239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.552243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.610033Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-09-30T14:50:27.610049Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:27.652560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.652576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.652580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.753494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.753509Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.753512Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.853753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.853773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.853777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.954101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.954119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.954122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.054454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.054475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.054478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.154814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.154831Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.154834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.255168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.255185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.255187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.358532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.358551Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.358554Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.400125Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:28.458409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.458432Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.458435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.558792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.558809Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.558813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.660389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.660407Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.660410Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.760499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.760523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.760525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.860868Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.860888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.860891Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.961194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.961212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.961215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.061596Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.061612Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.061615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.161908Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.161926Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.161929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.262369Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.262387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.262390Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.362627Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.362649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.362652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.463003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.463025Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.463029Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.563429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.563445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.563449Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.663667Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.663683Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.663686Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.764121Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.764137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.764140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.864354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.864370Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.864373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.964763Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.964781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.964784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.065063Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.065098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.065101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.165467Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.165482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.165486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.265769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.265786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.265788Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.366137Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.366153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.366157Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.466478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.466499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.466503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.566800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.566830Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.566834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.667202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.667220Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.667223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.767555Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.767575Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.767579Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.867894Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.867911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.867914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.968284Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.968381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.968384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.068593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.068615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.068619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.168945Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.168966Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.168969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.269272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.269289Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.269293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.369615Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.369639Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.369643Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.470016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.470033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.470037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.570368Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.570384Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.570387Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.670723Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.670743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.670747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.771090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.771108Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.771112Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.871374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.871394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.871398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.971784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.971800Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.971803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.075440Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.075460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.075463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.175056Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.175076Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.175079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.275558Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.275581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.275584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.375812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.375832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.375836Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.476105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.476126Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.476130Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.576450Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.576465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.576468Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.676772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.676792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.676794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.777140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.777155Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.777159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.877544Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.877566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.877569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.977876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.977896Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.977899Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.078216Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.078241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.078245Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.178567Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.178584Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.178587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.278898Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.278915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.278919Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.379436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.379460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.379463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.400313Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:33.479626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.479642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.479645Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.579965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.579983Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.579986Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.680297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.680315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.680319Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.780626Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.780644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.780647Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.881034Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.881050Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.881053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.981382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.981399Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.981402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.081727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.081746Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.081749Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.182128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.182146Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.182149Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.282443Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.282461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.282464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.382792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.382811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.382814Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.483148Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.483168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.483171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.583552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.583572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.583576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.683973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.683993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.683996Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.787805Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.787828Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.787832Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.888140Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.888167Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.888170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.988503Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.988527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.988530Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.088810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.088829Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.088833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.189197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.189223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.189226Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.289673Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.289692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.289696Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.389913Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.389929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.389931Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.490253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.490276Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.490279Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.590594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.590617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.590621Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.690957Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.690974Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.690978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.791315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.791334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.791338Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.891659Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.891681Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.891684Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.994359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.994382Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.994385Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.094907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.094933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.094948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.195300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.195317Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.195320Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.295599Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.295616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.295619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.395981Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.395999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.396002Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.499411Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.499426Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.499430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.599741Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.599759Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.599762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.700088Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.700107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.700110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.800463Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.800480Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.800483Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.900825Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.900844Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.900848Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.002735Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.002754Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.002757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.102993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.103011Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.103016Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.203379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.203397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.203401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.303750Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.303769Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.303772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.404079Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.404106Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.404109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.504441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.504457Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.504461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.604755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.604774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.604777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.711325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.711346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.711349Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.815356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.815373Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.815376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.915743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.915762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.915765Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.017816Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.017837Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.017840Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.119359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.119378Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.119381Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.219687Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.219706Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.219709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.321773Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.321791Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.321794Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.400511Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:38.421939Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.421955Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.421958Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.522295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.522315Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.522318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.622670Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.622711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.622715Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.723005Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.723026Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.723030Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.823323Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.823341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.823345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.923711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.923728Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.923732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.024045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.024061Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.024064Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.124374Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.124391Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.124395Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.224767Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.224783Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.224786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.325165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.325185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.325190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.425459Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.425479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.425482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.525810Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.525838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.525841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.626153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.626170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.626175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.726521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.726538Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.726542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.826876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.826902Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.826906Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.927272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.927293Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.927297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.031334Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.031351Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.031354Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.131580Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.131600Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.131604Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.231892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.231911Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.231914Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.332221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.332250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.332253Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.432557Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.432577Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.432581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.533000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.533019Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.533023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.633265Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.633291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.633295Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.733597Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.733617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.733620Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.833967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.833985Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.833988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.934331Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.934347Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.934350Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.034712Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.034732Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.034736Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.135039Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.135058Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.135062Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.235409Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.235428Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.235431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.335753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.335785Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.335789Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.436084Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.436099Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.436102Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.536453Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.536473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.536477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.636756Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.636774Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.636777Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.737169Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.737187Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.737190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.837516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.837531Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.837534Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.937865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.937885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.937888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.038200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.038217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.038221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.138570Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.138598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.138601Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.238915Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.238934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.238938Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.339290Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.339304Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.339308Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.439609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.439625Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.439628Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.539956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.539973Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.539976Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.640268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.640302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.640306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.740654Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.740675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.740678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.841031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.841046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.841049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.941325Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.941342Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.941346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.041727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.041757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.041761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.142087Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.142115Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.142119Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.242422Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.242439Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.242444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.342793Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.342818Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.342820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.400698Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:43.443162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.443181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.443185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.543465Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.543486Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.543489Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.643847Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.643870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.643875Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.744181Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.744200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.744204Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.844545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.844573Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.844576Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.944892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.944909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.944923Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.045250Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.045268Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.045272Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.145536Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.145552Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.145556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.245929Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.245948Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.245951Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.346330Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.346356Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.346359Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.446646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.446674Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.446677Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.547014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.547033Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.547037Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.647328Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.647343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.647345Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.747718Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.747742Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.747745Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.848090Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.848107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.848110Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.948416Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.948444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.948447Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.048790Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.048808Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.048812Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.149135Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.149159Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.149162Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.249475Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.249491Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.249494Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.349833Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.349858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.349861Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.450194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.450211Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.450214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.550541Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.550560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.550563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.650865Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.650885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.650888Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.751218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.751236Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.751240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.851590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.851614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.851618Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.951968Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.951987Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.951990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.052287Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.052307Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.052311Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.152631Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.152649Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.152652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.253007Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.253027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.253031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.353376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.353398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.353402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.453689Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.453709Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.453713Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.554053Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.554068Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.554071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.654408Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.654429Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.654431Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.754778Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.754795Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.754798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.855105Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.855122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.855125Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.955444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.955461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.955464Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.055796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.055811Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.055813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.156153Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.156168Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.156170Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.256470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.256482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.256485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.356852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.356870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.356873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.457201Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.457233Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.457238Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.557556Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.557574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.557578Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.657925Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.657950Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.657953Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.759598Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.759616Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.759619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.859652Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.859671Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.859675Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.959998Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.960014Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.960017Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.060341Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.060361Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.060364Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.160702Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.160727Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.160730Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.261055Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.261073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.261077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.361389Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.361413Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.361417Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.386471Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:50:48.386520Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-09-30T14:50:48.386980Z node 2 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:50:48.387350Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-09-30T14:50:48.387506Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:50:48.387598Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 1, Generation 2
2025-09-30T14:50:48.400876Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:48.461761Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.461776Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.461779Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.562134Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.562151Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.562154Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.662456Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.662473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.662476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.762817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.762841Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.762845Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.863165Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.863182Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.863185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.963516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.963532Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.963543Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.063862Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.063879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.063883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.164193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.164212Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.164215Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.264572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.264589Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.264593Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.364912Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.364930Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.364933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.465280Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.465297Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.465300Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.565624Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.565641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.565663Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.665967Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.665990Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.665993Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.766329Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.766343Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.766346Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.868545Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.868560Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.868563Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.969066Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.969082Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.969086Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.069444Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.069473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.069477Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.169826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.169852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.169857Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.270174Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.270194Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.270197Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.370470Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.370487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.370490Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.470850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.470879Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.470883Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.571171Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.571190Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.571193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.671548Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.671566Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.671569Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.771916Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.771933Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.771935Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.872281Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.872299Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.872302Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.972603Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.972617Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.972619Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.072960Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.072988Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.072992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.173291Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.173306Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.173309Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.273646Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.273665Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.273669Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.373978Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.373992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.373995Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.474376Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.474394Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.474397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.574772Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.574792Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.574796Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.675052Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.675071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.675074Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.775418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.775433Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.775436Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.875787Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.875813Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.875817Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.976103Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.976120Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.976122Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.076478Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.076496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.076499Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.176780Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.176798Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.176802Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.277193Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.277214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.277218Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.377502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.377516Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.377519Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.477884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.477900Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.477909Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.578225Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.578240Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.578243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.678572Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.678587Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.678590Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.778934Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.778952Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.778956Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.879318Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.879335Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.879339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.979629Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.979642Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.979644Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.080027Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.080046Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.080049Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.180339Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.180355Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.180357Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.280685Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.280701Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.280704Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.381003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.381020Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.381023Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.401126Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:53.481402Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.481415Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.481418Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.581729Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.581744Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.581747Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.682109Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.682129Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.682132Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.782452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.782472Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.782476Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.882819Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.882835Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.882838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.983161Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.983175Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.983178Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.083502Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.083520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.083523Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.183874Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.183892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.183895Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.284221Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.284241Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.284243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.384565Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.384581Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.384585Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.484870Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.484885Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.484887Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.850523Z :SimpleHandlers INFO: Random seed for debugging is 1759243854850513
2025-09-30T14:50:54.929886Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7555894819653987094:2082];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:54.929911Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:54.931873Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7555894822274351081:2152];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:54.931980Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/002603/r3tmp/tmpxMKVb1/pdisk_1.dat
2025-09-30T14:50:54.932509Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:54.933006Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:54.933621Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:54.934046Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:54.947674Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:54.951750Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:54.951775Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:54.952885Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-09-30T14:50:54.953106Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 2699, node 3
2025-09-30T14:50:54.960651Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/002603/r3tmp/yandexy9dTx0.tmp
2025-09-30T14:50:54.960662Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/002603/r3tmp/yandexy9dTx0.tmp
2025-09-30T14:50:54.960713Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/002603/r3tmp/yandexy9dTx0.tmp
2025-09-30T14:50:54.960771Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:54.964280Z INFO: TTestServer started on Port 16022 GrpcPort 2699
TClient is connected to server localhost:16022
PQClient connected to localhost:2699
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:54.983370Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:50:55.031925Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:55.031962Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:55.033425Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-09-30T14:50:55.088543Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:55.157190Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:55.347749Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7555894826569318626:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:55.347781Z node 4 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [4:7555894826569318600:2295], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:55.347797Z node 4 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:55.349123Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:55.350706Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894823948955311:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:55.350730Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:55.353664Z node 4 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [4:7555894826569318630:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720657 completed, doublechecking }
2025-09-30T14:50:55.355141Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7555894823948955359:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:55.355853Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=ZmIwN2ZjNzgtNjk0NWZiZDQtYWUwMTM2YzAtMjBiMGZkNGQ=, ActorId: [3:7555894823948955292:2322], ActorState: ExecuteState, TraceId: 01k6dhnsfp7pstszdmm84b08ys, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:55.356064Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:55.357932Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:55.375152Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:55.399885Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:2699", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:55.424084Z node 4 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [4:7555894826569318732:2176] txid# 281474976720658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:55.435346Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710664. Ctx: { TraceId: 01k6dhnsht8etvqj78y5yyq3dm, Database: , SessionId: ydb://session/3?node_id=3&id=OGM5Zjk0YjQtN2RlMDg2ZDctMzJmNzdkNWUtYTAzNmQ1Yg==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7555894823948955837:2994] 
2025-09-30T14:50:55.932325Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:55.933351Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:59.930022Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7555894819653987094:2082];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:59.930062Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:59.932089Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7555894822274351081:2152];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:59.932124Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:51:00.564324Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:2699
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:51:00.581834Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:2699
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:51:00.589302Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:51:00.589896Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7555894845423792887:3324] connected; active server actors: 1
2025-09-30T14:51:00.589987Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:51:00.590040Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:51:00.590056Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:00.590063Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:51:00.590128Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894845423792886:3323], now have 1 active actors on pipe
2025-09-30T14:51:00.590142Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:51:00.590250Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:51:00.590263Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:51:00.590562Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7555894848044155613:2384], now have 1 active actors on pipe
2025-09-30T14:51:00.590584Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-09-30T14:51:00.590792Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:51:00.591313Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:51:00.592882Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894845423792958:3379], now have 1 active actors on pipe
2025-09-30T14:51:00.592981Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:51:00.593794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:51:00.593996Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:51:00.594014Z node 3 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:51:00.594082Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:51:00.594128Z node 3 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7555894845423792970:2463]
2025-09-30T14:51:00.594893Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:51:00.594905Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:51:00.594911Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7555894845423792970:2463]
2025-09-30T14:51:00.594919Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:51:00.595217Z node 3 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:51:00.595230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.595265Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.595274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:00.595278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:51:00.595280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.595282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.595284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:51:00.595292Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:00.595370Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:51:00.595399Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:00.596338Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:51:00.596396Z node 3 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243860640, TxId 281474976710677
2025-09-30T14:51:00.596407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.596408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.596432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.596464Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:00.596920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:00.596970Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:00.596982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.596983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.596985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.596989Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:00.597108Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:51:00.597131Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:51:00.597174Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:51:00.598033Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:51:00.598058Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:51:00.598451Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:51:00.603482Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710678. Ctx: { TraceId: 01k6dhnykb8rj4f3yqcghr1vqj, Database: , SessionId: ydb://session/3?node_id=3&id=MjkyMmMzNzktYjk3MjQ0YzgtNjMxNjM0YjctNTdkNDk1ODU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710677
    CreateStep: 1759243860640
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710677
    CreateStep: 1759243860640
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:2699
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:51:00.610772Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:51:00.695489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.695518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.695522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.795827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.795845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.795849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.896187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.896205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.896208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.996511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.996530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.996533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.096898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.096923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.096926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:2699
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:51:01.112214Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:51:01.197247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.197264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.197267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.297604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.297626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.297630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.397954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.397972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.397975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.498321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.498341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.498344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.598664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.598680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.598682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:2699
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:51:01.614378Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:51:01.615769Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:51:01.615995Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:51:01.616000Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:2699
2025-09-30T14:51:01.616354Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:51:01.616452Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:01.616474Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:51:01.616682Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:51:01.616717Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:42278
2025-09-30T14:51:01.616730Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:42278 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:01.616733Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:01.617252Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:51:01.617312Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:01.617322Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:01.617325Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:01.617334Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7555894849718760471:2502] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:01.618003Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7555894849718760471:2502] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:01.640249Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7555894849718760471:2502] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:51:01.640422Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760502:2502] connected; active server actors: 1
2025-09-30T14:51:01.640529Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7555894849718760471:2502] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:51:01.640540Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555894849718760471:2502] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:01.640640Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760502:2502] disconnected; active server actors: 1
2025-09-30T14:51:01.640647Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760502:2502] disconnected no session
2025-09-30T14:51:01.660001Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555894849718760471:2502] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:01.660023Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7555894849718760471:2502] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:51:01.660027Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555894849718760471:2502] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:01.660036Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:01.660196Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-09-30T14:51:01.660219Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894849718760523:2502], now have 1 active actors on pipe
2025-09-30T14:51:01.660228Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.660236Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.660271Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|c0bad59d-a408aecc-da2c3f09-daf2fecb_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:51:01.660288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.660297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.660301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.660316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.660343Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:01.660368Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.660426Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.660433Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.660455Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.660495Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|c0bad59d-a408aecc-da2c3f09-daf2fecb_0
2025-09-30T14:51:01.660900Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243861660 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:01.660976Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|c0bad59d-a408aecc-da2c3f09-daf2fecb_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:01.661115Z :INFO: [] MessageGroupId [src] SessionId [src|c0bad59d-a408aecc-da2c3f09-daf2fecb_0] Write session: close. Timeout = 0 ms
2025-09-30T14:51:01.661128Z :INFO: [] MessageGroupId [src] SessionId [src|c0bad59d-a408aecc-da2c3f09-daf2fecb_0] Write session will now close
2025-09-30T14:51:01.661135Z :DEBUG: [] MessageGroupId [src] SessionId [src|c0bad59d-a408aecc-da2c3f09-daf2fecb_0] Write session: aborting
2025-09-30T14:51:01.661304Z :INFO: [] MessageGroupId [src] SessionId [src|c0bad59d-a408aecc-da2c3f09-daf2fecb_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:51:01.661309Z :DEBUG: [] MessageGroupId [src] SessionId [src|c0bad59d-a408aecc-da2c3f09-daf2fecb_0] Write session: destroy
2025-09-30T14:51:01.661411Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|c0bad59d-a408aecc-da2c3f09-daf2fecb_0 grpc read done: success: 0 data: 
2025-09-30T14:51:01.661421Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|c0bad59d-a408aecc-da2c3f09-daf2fecb_0 grpc read failed
2025-09-30T14:51:01.661428Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|c0bad59d-a408aecc-da2c3f09-daf2fecb_0 grpc closed
2025-09-30T14:51:01.661433Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|c0bad59d-a408aecc-da2c3f09-daf2fecb_0 is DEAD
2025-09-30T14:51:01.661680Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:51:01.661736Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7555894849718760523:2502] destroyed
2025-09-30T14:51:01.661752Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:51:01.661759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.661761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.661764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Session was created
2025-09-30T14:51:01.698999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.699016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.699020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:51:01.723393Z :INFO: [/Root] [] [64f565a2-2460d9bf-3986ad40-1db934e4] Open read subsessions to databases: { name: dc1, endpoint: localhost:2699, path: /Root }, { name: dc2, endpoint: localhost:2699, path: /Root }, { name: dc3, endpoint: localhost:2699, path: /Root }
2025-09-30T14:51:01.725592Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: try to update token
2025-09-30T14:51:01.725690Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session: Do CDS request
2025-09-30T14:51:01.725694Z :INFO: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] Starting read session
2025-09-30T14:51:01.725710Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Start write session. Will connect to endpoint: localhost:2699
2025-09-30T14:51:01.725731Z :DEBUG: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] Starting single session
2025-09-30T14:51:01.726039Z :DEBUG: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:01.726045Z :DEBUG: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:01.726051Z :DEBUG: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] [] Reconnecting session to cluster  in 0.000000s
2025-09-30T14:51:01.726853Z :INFO: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] Starting read session
2025-09-30T14:51:01.726861Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] Starting single session
2025-09-30T14:51:01.726909Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:01.726913Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:01.726916Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Reconnecting session to cluster  in 0.000000s
2025-09-30T14:51:01.727001Z :INFO: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] Starting read session
2025-09-30T14:51:01.727005Z :DEBUG: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] Starting single session
2025-09-30T14:51:01.727028Z :DEBUG: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] [] In Reconnect, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:01.727031Z :DEBUG: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] [] New values: ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:01.727034Z :DEBUG: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] [] Reconnecting session to cluster  in 0.000000s
2025-09-30T14:51:01.768254Z :DEBUG: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] [] Successfully connected. Initializing session
2025-09-30T14:51:01.768265Z :DEBUG: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] [] Successfully connected. Initializing session
2025-09-30T14:51:01.768407Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Successfully connected. Initializing session
2025-09-30T14:51:01.768544Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.768663Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:01.768679Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:51:01.768683Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 1
2025-09-30T14:51:01.768686Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-09-30T14:51:01.768718Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:51:01.768719Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 2
2025-09-30T14:51:01.768728Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:111: new grpc connection
2025-09-30T14:51:01.768730Z node 3 :PQ_READ_PROXY DEBUG: grpc_pq_read.h:133: new session created cookie 3
2025-09-30T14:51:01.768923Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:01.768966Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 topic: "test-topic" message_group_id: "src_id" from ipv6:[::1]:48840
2025-09-30T14:51:01.768976Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:48840 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:51:01.768980Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:01.771279Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:01.771283Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:01.771381Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 1 consumer shared/user session shared/user_3_1_13398544198722215142_v1 read init: from# ipv6:[::1]:48840, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:01.771385Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read init: from# ipv6:[::1]:48840, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:01.771559Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 auth for : user
2025-09-30T14:51:01.771573Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer  session  grpc read done: success# 1, data# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:01.771600Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:929: session cookie 2 consumer shared/user session shared/user_3_2_2210329730288990884_v1 read init: from# ipv6:[::1]:48840, request# { init_request { topics_read_settings { path: "test-topic" } consumer: "shared/user" } }
2025-09-30T14:51:01.771648Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 1 consumer shared/user session shared/user_3_1_13398544198722215142_v1 auth for : user
2025-09-30T14:51:01.771671Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:41: session cookie 2 consumer shared/user session shared/user_3_2_2210329730288990884_v1 auth for : user
2025-09-30T14:51:01.771838Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Handle describe topics response
2025-09-30T14:51:01.771865Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 auth is DEAD
2025-09-30T14:51:01.771883Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 2 consumer shared/user session shared/user_3_2_2210329730288990884_v1 Handle describe topics response
2025-09-30T14:51:01.771896Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 2 consumer shared/user session shared/user_3_2_2210329730288990884_v1 auth is DEAD
2025-09-30T14:51:01.771905Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:51:01.772059Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-09-30T14:51:01.772096Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:01.772102Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:01.772104Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:01.772111Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7555894849718760555:2522] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:01.772124Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:131: session cookie 1 consumer shared/user session shared/user_3_1_13398544198722215142_v1 Handle describe topics response
2025-09-30T14:51:01.772138Z node 3 :PQ_READ_PROXY DEBUG: read_init_auth_actor.cpp:68: session cookie 1 consumer shared/user session shared/user_3_1_13398544198722215142_v1 auth is DEAD
2025-09-30T14:51:01.772153Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 2 consumer shared/user session shared/user_3_2_2210329730288990884_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:51:01.772257Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:51:01.772405Z :INFO: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got InitResponse. ReadSessionId: shared/user_3_3_3107435870535710504_v1
2025-09-30T14:51:01.772415Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:01.772395Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 2 consumer shared/user session shared/user_3_2_2210329730288990884_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:51:01.772431Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1046: session cookie 1 consumer shared/user session shared/user_3_1_13398544198722215142_v1 auth ok: topics# 1, initDone# 0
2025-09-30T14:51:01.772529Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:01.772563Z :INFO: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] [] Got InitResponse. ReadSessionId: shared/user_3_2_2210329730288990884_v1
2025-09-30T14:51:01.772582Z :DEBUG: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:01.772613Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1217: session cookie 1 consumer shared/user session shared/user_3_1_13398544198722215142_v1 register session: topic# rt3.dc1--test-topic
2025-09-30T14:51:01.772664Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-09-30T14:51:01.772682Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 8a31049a-f89895e8-6fdb5a60-6f70dbc4
2025-09-30T14:51:01.772697Z :INFO: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] [] Got InitResponse. ReadSessionId: shared/user_3_1_13398544198722215142_v1
2025-09-30T14:51:01.772709Z :DEBUG: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] [] In ContinueReadingDataImpl, ReadSizeBudget = 524288, ReadSizeServerDelta = 0
2025-09-30T14:51:01.772733Z :DEBUG: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:01.772764Z :DEBUG: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:01.772873Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_2210329730288990884_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-09-30T14:51:01.772888Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 2 consumer shared/user session shared/user_3_2_2210329730288990884_v1 got read request: guid# 1a700539-ee586789-30b523f8-661c9348
2025-09-30T14:51:01.772905Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760556:2524] connected; active server actors: 1
2025-09-30T14:51:01.772957Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_13398544198722215142_v1 grpc read done: success# 1, data# { read_request { bytes_size: 524288 } }
2025-09-30T14:51:01.772965Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7555894849718760555:2522] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:01.772969Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 1 consumer shared/user session shared/user_3_1_13398544198722215142_v1 got read request: guid# 38adf55f-3db5f2d1-a0829601-b181584e
2025-09-30T14:51:01.772928Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760557:2523] connected; active server actors: 1
2025-09-30T14:51:01.772932Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760558:2521] connected; active server actors: 1
2025-09-30T14:51:01.773065Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7555894849718760556:2524] session shared/user_3_3_3107435870535710504_v1
2025-09-30T14:51:01.773094Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:637: [72075186224037893][rt3.dc1--test-topic] consumer user register readable partition 0
2025-09-30T14:51:01.773109Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:667: [72075186224037893][rt3.dc1--test-topic] consumer user family created family=1 (Status=Free, Partitions=[0])
2025-09-30T14:51:01.773116Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_3_3107435870535710504_v1" (Sender=[3:7555894849718760547:2524], Pipe=[3:7555894849718760556:2524], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:01.773121Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:51:01.773131Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7555894849718760558:2521] session shared/user_3_1_13398544198722215142_v1
2025-09-30T14:51:01.773136Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_1_13398544198722215142_v1" (Sender=[3:7555894849718760544:2521], Pipe=[3:7555894849718760558:2521], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:01.773142Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1700: [72075186224037893][rt3.dc1--test-topic] consumer "user" register session for pipe [3:7555894849718760557:2523] session shared/user_3_2_2210329730288990884_v1
2025-09-30T14:51:01.773147Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:869: [72075186224037893][rt3.dc1--test-topic] consumer user register reading session ReadingSession "shared/user_3_2_2210329730288990884_v1" (Sender=[3:7555894849718760546:2523], Pipe=[3:7555894849718760557:2523], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:01.773156Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=3, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:51:01.773167Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_3_3107435870535710504_v1" (Sender=[3:7555894849718760547:2524], Pipe=[3:7555894849718760556:2524], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:01.773178Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_3_3107435870535710504_v1" sender [3:7555894849718760547:2524] lock partition 0 for ReadingSession "shared/user_3_3_3107435870535710504_v1" (Sender=[3:7555894849718760547:2524], Pipe=[3:7555894849718760556:2524], Partitions=[], ActiveFamilyCount=1) generation 1 step 1
2025-09-30T14:51:01.773197Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=3, desiredFamilyCount=0, allowPlusOne=1
2025-09-30T14:51:01.773207Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000048s
2025-09-30T14:51:01.773506Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:1335: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 assign: record# { Partition: 0 TabletId: 72075186224037892 Topic: "rt3.dc1--test-topic" Generation: 1 Step: 1 Session: "shared/user_3_3_3107435870535710504_v1" ClientId: "user" PipeClient { RawX1: 7555894849718760556 RawX2: 4503612512274908 } Path: "/Root/PQ/rt3.dc1--test-topic" }
2025-09-30T14:51:01.773533Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1143: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 INITING TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)
2025-09-30T14:51:01.773607Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:983: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) pipe restart attempt 0 pipe creation result: OK TabletId: 72075186224037892 Generation: 1, pipe: [3:7555894849718760566:2533]
2025-09-30T14:51:01.773612Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894849718760566:2533], now have 1 active actors on pipe
2025-09-30T14:51:01.773621Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.773629Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.773646Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1744: [PQ: 72075186224037892] Created session shared/user_3_3_3107435870535710504_v1 on pipe: [3:7555894849718760566:2533]
2025-09-30T14:51:01.773675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.773685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.773687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.773690Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:283: Direct read cache: registered server session: shared/user_3_3_3107435870535710504_v1:1 with generation 1
2025-09-30T14:51:01.773710Z node 3 :PERSQUEUE DEBUG: partition.cpp:3695: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user session is set to 0 (startOffset 0) session shared/user_3_3_3107435870535710504_v1
2025-09-30T14:51:01.773718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.773757Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.774717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.774755Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.774765Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.774772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.774774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.774782Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:51:01.774797Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 18446744073709551615
2025-09-30T14:51:01.774859Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 0 event { CmdGetClientOffsetResult { Offset: 0 EndOffset: 0 SizeLag: 0 WriteTimestampEstimateMS: 1759243861698 ClientHasAnyCommits: false } Cookie: 18446744073709551615 }
2025-09-30T14:51:01.774875Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:694: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 INIT DONE TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0
2025-09-30T14:51:01.774905Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1434: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 sending to client partition status
2025-09-30T14:51:01.775304Z :INFO: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Confirm partition stream create. Partition stream id: 1. Cluster: "-". Topic: "test-topic". Partition: 0. Read offset: (NULL)
2025-09-30T14:51:01.775699Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { start_partition_session_response { partition_session_id: 1 } }
2025-09-30T14:51:01.775778Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:539: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got StartRead from client: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, commitOffset# (empty maybe)
2025-09-30T14:51:01.775805Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7555894849718760555:2522] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:51:01.775838Z node 3 :PQ_READ_PROXY INFO: partition_actor.cpp:1023: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Start reading TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 0 readOffset 0 committedOffset 0 clientCommitOffset (empty maybe) clientReadOffset 0
2025-09-30T14:51:01.775848Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 1 from offset 0
2025-09-30T14:51:01.775996Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760585:2522] connected; active server actors: 1
2025-09-30T14:51:01.776207Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7555894849718760555:2522] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-09-30T14:51:01.776229Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555894849718760555:2522] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:01.776400Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760585:2522] disconnected; active server actors: 1
2025-09-30T14:51:01.776407Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760585:2522] disconnected no session
2025-09-30T14:51:01.779714Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555894849718760555:2522] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:01.779731Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7555894849718760555:2522] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:51:01.779735Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555894849718760555:2522] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:01.779744Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:01.779900Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-09-30T14:51:01.779923Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894849718760599:2522], now have 1 active actors on pipe
2025-09-30T14:51:01.779931Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.779943Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.779979Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|19efaaa7-86563d97-33872e1-808c28ef_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:01.779997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.780002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.780005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.780021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.780045Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:01.780066Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.780220Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.780229Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.780246Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.780281Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0
2025-09-30T14:51:01.780732Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243861780 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:01.780793Z :INFO: [/Root] MessageGroupId [src_id] SessionId [] Write session established. Init response: session_id: "src_id|19efaaa7-86563d97-33872e1-808c28ef_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:51:01.780920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 1 to 1
2025-09-30T14:51:01.780950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.780958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 1
2025-09-30T14:51:01.781057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 2 to 2
2025-09-30T14:51:01.781064Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781066Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 2
2025-09-30T14:51:01.781104Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 3 to 3
2025-09-30T14:51:01.781108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 3
2025-09-30T14:51:01.781188Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 4 to 4
2025-09-30T14:51:01.781193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781194Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 4
2025-09-30T14:51:01.781233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 5 to 5
2025-09-30T14:51:01.781236Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 5
2025-09-30T14:51:01.781261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 6 to 6
2025-09-30T14:51:01.781264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 6
2025-09-30T14:51:01.781241Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.781287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 7 to 7
2025-09-30T14:51:01.781291Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 7
2025-09-30T14:51:01.781313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 8 to 8
2025-09-30T14:51:01.781317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 8
2025-09-30T14:51:01.781345Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 9 to 9
2025-09-30T14:51:01.781348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 9
2025-09-30T14:51:01.781354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 10 to 10
2025-09-30T14:51:01.781358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 10
2025-09-30T14:51:01.781333Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.781353Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.781410Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.781427Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.781436Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.781467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 11 to 11
2025-09-30T14:51:01.781471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781473Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 11
2025-09-30T14:51:01.781453Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.781460Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.781476Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.781486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:01.781503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 12 to 12
2025-09-30T14:51:01.781496Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 2
2025-09-30T14:51:01.781508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781497Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.781511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 12
2025-09-30T14:51:01.781518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 13 to 13
2025-09-30T14:51:01.781523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781514Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.781525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 13
2025-09-30T14:51:01.781529Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.781549Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.781557Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.781558Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.781637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 14 to 14
2025-09-30T14:51:01.781646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 14
2025-09-30T14:51:01.781645Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.781668Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.781677Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 2 size 82 offset: -1
2025-09-30T14:51:01.781684Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.781694Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 15 to 15
2025-09-30T14:51:01.781687Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.781700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781692Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size 192 offset: -1
2025-09-30T14:51:01.781703Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 15
2025-09-30T14:51:01.781696Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.781697Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.781705Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.781715Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.781720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.781744Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 16 to 16
2025-09-30T14:51:01.781734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.781751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 16
2025-09-30T14:51:01.781737Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.781741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.781763Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.781769Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.781775Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-09-30T14:51:01.781796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 17 to 17
2025-09-30T14:51:01.781802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 17
2025-09-30T14:51:01.781798Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.781808Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.781835Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 156 count 1 nextOffset 1 batches 1
2025-09-30T14:51:01.781845Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.781847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.781853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 18 to 18
2025-09-30T14:51:01.781860Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 18
2025-09-30T14:51:01.781872Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.781908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 19 to 19
2025-09-30T14:51:01.781914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781903Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 142 WTime 1759243861781
2025-09-30T14:51:01.781917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 19
2025-09-30T14:51:01.781923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 20 to 20
2025-09-30T14:51:01.781928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.781930Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 20
2025-09-30T14:51:01.781930Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.781932Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.781935Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.781941Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.781948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.781955Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.781961Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.781966Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.781966Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.781968Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.781971Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.781973Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.781980Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.781992Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 142
2025-09-30T14:51:01.781994Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782009Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-09-30T14:51:01.782022Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782030Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782056Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 21 to 21
2025-09-30T14:51:01.782065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.782056Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 21
2025-09-30T14:51:01.782064Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 4
2025-09-30T14:51:01.782067Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 5
2025-09-30T14:51:01.782073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 22 to 22
2025-09-30T14:51:01.782071Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 6
2025-09-30T14:51:01.782072Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.782074Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 8  requestId: <none> cookie: 7
2025-09-30T14:51:01.782084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 22
2025-09-30T14:51:01.782078Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782079Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782086Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 9 size 303 offset: -1
2025-09-30T14:51:01.782089Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782093Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782104Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782105Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782108Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782111Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782117Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782125Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782131Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782137Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782149Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 23 to 23
2025-09-30T14:51:01.782154Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.782146Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 23
2025-09-30T14:51:01.782179Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782211Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782239Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 24 to 24
2025-09-30T14:51:01.782264Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.782267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 24
2025-09-30T14:51:01.782277Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782280Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782283Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782289Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 11 size 413 offset: -1
2025-09-30T14:51:01.782297Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782299Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782303Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 12 size 523 offset: -1
2025-09-30T14:51:01.782307Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782309Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782313Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 13 size 633 offset: -1
2025-09-30T14:51:01.782317Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782319Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782322Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782324Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 14 size 743 offset: -1
2025-09-30T14:51:01.782328Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782331Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782335Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782337Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782341Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782343Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782347Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782349Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782352Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782361Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 10  requestId: <none> cookie: 8
2025-09-30T14:51:01.782366Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782368Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782370Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782375Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782377Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782384Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782384Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 15  requestId: <none> cookie: 9
2025-09-30T14:51:01.782388Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 16  requestId: <none> cookie: 10
2025-09-30T14:51:01.782391Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 17  requestId: <none> cookie: 11
2025-09-30T14:51:01.782395Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782397Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782402Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 19 size 853 offset: -1
2025-09-30T14:51:01.782406Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 18  requestId: <none> cookie: 12
2025-09-30T14:51:01.782412Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 25 to 25
2025-09-30T14:51:01.782434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.782410Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782440Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 25
2025-09-30T14:51:01.782412Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782414Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782416Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782419Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782422Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 20  requestId: <none> cookie: 13
2025-09-30T14:51:01.782423Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782428Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782444Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782451Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782459Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782465Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782467Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782469Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782473Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 21 size 963 offset: -1
2025-09-30T14:51:01.782488Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 26 to 26
2025-09-30T14:51:01.782477Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782478Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.782514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 26
2025-09-30T14:51:01.782481Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 22 size 1073 offset: -1
2025-09-30T14:51:01.782504Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782506Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782511Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 23 size 1183 offset: -1
2025-09-30T14:51:01.782515Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782516Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782517Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782522Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 24 size 1293 offset: -1
2025-09-30T14:51:01.782525Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782557Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 27 to 27
2025-09-30T14:51:01.782566Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.782538Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 27
2025-09-30T14:51:01.782540Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782544Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 25 size 1403 offset: -1
2025-09-30T14:51:01.782548Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782555Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782557Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782561Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782563Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782566Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782572Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782577Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782578Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782579Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782583Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782586Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782590Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782593Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782609Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782615Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 28 to 28
2025-09-30T14:51:01.782613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782619Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782659Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.782619Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 28
2025-09-30T14:51:01.782622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782630Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 26  requestId: <none> cookie: 14
2025-09-30T14:51:01.782633Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 27  requestId: <none> cookie: 15
2025-09-30T14:51:01.782636Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 28  requestId: <none> cookie: 16
2025-09-30T14:51:01.782637Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782639Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 29  requestId: <none> cookie: 17
2025-09-30T14:51:01.782642Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 30  requestId: <none> cookie: 18
2025-09-30T14:51:01.782643Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782647Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782657Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782659Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782661Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782661Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782665Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 31 size 1513 offset: -1
2025-09-30T14:51:01.782705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 29 to 29
2025-09-30T14:51:01.782669Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782669Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.782720Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 29
2025-09-30T14:51:01.782670Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782675Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 32 size 1623 offset: -1
2025-09-30T14:51:01.782679Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782681Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782682Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782686Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 33 size 1733 offset: -1
2025-09-30T14:51:01.782688Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782689Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782694Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782696Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 30 to 30
2025-09-30T14:51:01.782698Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.782763Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 30
2025-09-30T14:51:01.782702Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782704Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782705Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782708Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 34 size 1843 offset: -1
2025-09-30T14:51:01.782713Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782716Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782720Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 35 size 1953 offset: -1
2025-09-30T14:51:01.782724Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782730Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782732Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782735Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 31 to 31
2025-09-30T14:51:01.782737Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782741Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.782744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782807Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 31
2025-09-30T14:51:01.782747Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782749Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782753Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782759Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782761Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782765Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782767Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782771Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782776Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 36  requestId: <none> cookie: 19
2025-09-30T14:51:01.782779Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 37  requestId: <none> cookie: 20
2025-09-30T14:51:01.782783Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 38  requestId: <none> cookie: 21
2025-09-30T14:51:01.782785Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 39  requestId: <none> cookie: 22
2025-09-30T14:51:01.782843Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 32 to 32
2025-09-30T14:51:01.782789Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 40  requestId: <none> cookie: 23
2025-09-30T14:51:01.782805Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782812Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782850Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.782855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 32
2025-09-30T14:51:01.782816Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782820Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782824Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.782839Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782847Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782854Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782868Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782871Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782876Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 41 size 2063 offset: -1
2025-09-30T14:51:01.782881Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782887Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782887Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782891Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 42 size 2173 offset: -1
2025-09-30T14:51:01.782893Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 33 to 33
2025-09-30T14:51:01.782895Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782898Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782908Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.784565Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 171, now ReadSizeBudget = 0, ReadSizeServerDelta = 524117
2025-09-30T14:51:01.782902Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 43 size 2283 offset: -1
2025-09-30T14:51:01.877247Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 33
2025-09-30T14:51:01.877300Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 524117
2025-09-30T14:51:01.782903Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782906Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782906Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.782908Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782912Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 44 size 2393 offset: -1
2025-09-30T14:51:01.782915Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782932Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782936Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 45 size 2503 offset: -1
2025-09-30T14:51:01.782941Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.877394Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 34 to 34
2025-09-30T14:51:01.782945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782948Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782953Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.782958Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782961Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782965Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.877418Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.782967Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782970Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.877435Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 34
2025-09-30T14:51:01.782972Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.877450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 35 to 35
2025-09-30T14:51:01.782975Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.877457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.877460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 35
2025-09-30T14:51:01.782981Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.782983Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782985Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.782988Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.877469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 36 to 36
2025-09-30T14:51:01.782990Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.782993Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.782996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.783004Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 46  requestId: <none> cookie: 24
2025-09-30T14:51:01.783008Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 47  requestId: <none> cookie: 25
2025-09-30T14:51:01.877477Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (0-0)
2025-09-30T14:51:01.783011Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 48  requestId: <none> cookie: 26
2025-09-30T14:51:01.783012Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.783014Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 49  requestId: <none> cookie: 27
2025-09-30T14:51:01.877481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783017Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 50  requestId: <none> cookie: 28
2025-09-30T14:51:01.783018Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.783022Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.877500Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 171 to budget
2025-09-30T14:51:01.783025Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.877512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 36
2025-09-30T14:51:01.877522Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 171, ReadSizeServerDelta = 524117
2025-09-30T14:51:01.877526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 37 to 37
2025-09-30T14:51:01.783031Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.877532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783036Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.877536Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 37
2025-09-30T14:51:01.783065Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.783074Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.877542Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 38 to 38
2025-09-30T14:51:01.783082Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.783087Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.877547Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783089Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.877550Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 38
2025-09-30T14:51:01.783091Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.783097Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 51 size 2613 offset: -1
2025-09-30T14:51:01.783101Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.877558Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 39 to 39
2025-09-30T14:51:01.783104Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.783108Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 52 size 2723 offset: -1
2025-09-30T14:51:01.783120Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 142 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.877565Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783136Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.877578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 39
2025-09-30T14:51:01.783138Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.783139Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.877591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 40 to 40
2025-09-30T14:51:01.783142Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 53 size 2833 offset: -1
2025-09-30T14:51:01.783150Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.877597Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783151Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.877600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 40
2025-09-30T14:51:01.783153Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 142
2025-09-30T14:51:01.783155Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 54 size 2943 offset: -1
2025-09-30T14:51:01.877608Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 41 to 41
2025-09-30T14:51:01.783158Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.877613Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.877620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 41
2025-09-30T14:51:01.783160Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.783164Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 55 size 3053 offset: -1
2025-09-30T14:51:01.783167Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.877626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 42 to 42
2025-09-30T14:51:01.783169Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.783173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.783176Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.877646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783179Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.877649Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 42
2025-09-30T14:51:01.783184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.877653Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:01.877655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 43 to 43
2025-09-30T14:51:01.877666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.877668Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 43
2025-09-30T14:51:01.783186Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.877674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 44 to 44
2025-09-30T14:51:01.877672Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 34353, now ReadSizeBudget = 0, ReadSizeServerDelta = 489935
2025-09-30T14:51:01.783189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.877687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.877690Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 44
2025-09-30T14:51:01.783212Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 89 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.783220Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.877698Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 45 to 45
2025-09-30T14:51:01.783229Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-09-30T14:51:01.877705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783298Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:51:01.783305Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:51:01.877677Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (0-0)
2025-09-30T14:51:01.877708Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 45
2025-09-30T14:51:01.877742Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 46 to 46
2025-09-30T14:51:01.783310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.877750Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.877753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 46
2025-09-30T14:51:01.783321Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 0 EndOffset 0 newEndOffset 1 commitOffset 0 clientCommitOffset 0 cookie 1 readingFinished 0 firstRead 1
2025-09-30T14:51:01.783325Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 0 endOffset 1
2025-09-30T14:51:01.877759Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 47 to 47
2025-09-30T14:51:01.877758Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 489935
2025-09-30T14:51:01.877764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.877766Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 47
2025-09-30T14:51:01.783330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.877772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 48 to 48
>>> event from dataHandler: 2025-09-30T14:51:01.783332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (24)
2025-09-30T14:51:01.783349Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 0, endOffset# 1, WTime# 0, sizeLag# 142
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..11 bytes.. Information: { Offset: 0 ProducerId: "src_id" SeqNo: 1 CreateTime: 2025-09-30T14:51:01.780000Z WriteTime: 2025-09-30T14:51:01.781000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }2025-09-30T14:51:01.783352Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-09-30T14:51:01.877779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783352Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.783368Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 15b344e5-78d94962-45a8df2b-8d60a50a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 170, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.783381Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 266 count 1 nextOffset 2 batches 1
2025-09-30T14:51:01.783389Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-09-30T14:51:01.783393Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 611 count 2 nextOffset 3 batches 1
2025-09-30T14:51:01.783396Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-09-30T14:51:01.877845Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 22015, now ReadSizeBudget = 0, ReadSizeServerDelta = 467920
2025-09-30T14:51:01.783401Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1066 count 3 nextOffset 4 batches 1
2025-09-30T14:51:01.783404Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-09-30T14:51:01.783408Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 170 maxTimeLagMs 0 readTimestampMs 0 readOffset 0 EndOffset 1 ClientCommitOffset 0 committedOffset 0 Guid 15b344e5-78d94962-45a8df2b-8d60a50a
2025-09-30T14:51:01.783409Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 1631 count 4 nextOffset 5 batches 1
2025-09-30T14:51:01.877860Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 1, size 11 bytes
2025-09-30T14:51:01.877865Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 467920
2025-09-30T14:51:01.877846Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (1-24)
2025-09-30T14:51:01.783412Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-09-30T14:51:01.877863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 48
2025-09-30T14:51:01.783418Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 2306 count 5 nextOffset 6 batches 1
2025-09-30T14:51:01.783421Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-09-30T14:51:01.783425Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 3091 count 6 nextOffset 7 batches 1
2025-09-30T14:51:01.877877Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 34353 to budget
2025-09-30T14:51:01.877903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 49 to 49
2025-09-30T14:51:01.877905Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 34353, ReadSizeServerDelta = 467920
2025-09-30T14:51:01.877909Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (25-31)
2025-09-30T14:51:01.877925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783429Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-09-30T14:51:01.877928Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 49
2025-09-30T14:51:01.783433Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 3986 count 7 nextOffset 8 batches 1
2025-09-30T14:51:01.877935Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 50 to 50
2025-09-30T14:51:01.783436Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-09-30T14:51:01.783440Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 4991 count 8 nextOffset 9 batches 1
2025-09-30T14:51:01.783444Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-09-30T14:51:01.877944Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.877953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 50
2025-09-30T14:51:01.783451Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 6106 count 9 nextOffset 10 batches 1
2025-09-30T14:51:01.783454Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-09-30T14:51:01.783458Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 7331 count 10 nextOffset 11 batches 1
2025-09-30T14:51:01.877960Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 51 to 51
2025-09-30T14:51:01.783461Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-09-30T14:51:01.783465Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 8666 count 11 nextOffset 12 batches 1
2025-09-30T14:51:01.783469Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-09-30T14:51:01.877970Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.877976Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 51
2025-09-30T14:51:01.783473Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 10111 count 12 nextOffset 13 batches 1
2025-09-30T14:51:01.783477Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-09-30T14:51:01.783480Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 11666 count 13 nextOffset 14 batches 1
2025-09-30T14:51:01.877985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 52 to 52
2025-09-30T14:51:01.877991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783484Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-09-30T14:51:01.877994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 52
2025-09-30T14:51:01.877996Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 502273
2025-09-30T14:51:01.878014Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (1-1)
2025-09-30T14:51:01.878014Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.783489Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 13331 count 14 nextOffset 15 batches 1
2025-09-30T14:51:01.783493Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-09-30T14:51:01.878024Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 22015 to budget
2025-09-30T14:51:01.783496Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 15106 count 15 nextOffset 16 batches 1
2025-09-30T14:51:01.783500Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-09-30T14:51:01.783503Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 16991 count 16 nextOffset 17 batches 1
2025-09-30T14:51:01.783506Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-09-30T14:51:01.878000Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 53 to 53
2025-09-30T14:51:01.878039Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (2-2)
2025-09-30T14:51:01.783512Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 18986 count 17 nextOffset 18 batches 1
2025-09-30T14:51:01.878046Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (3-3)
2025-09-30T14:51:01.878056Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (4-4)
2025-09-30T14:51:01.783515Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-09-30T14:51:01.878068Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (5-5)
2025-09-30T14:51:01.783519Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 21091 count 18 nextOffset 19 batches 1
2025-09-30T14:51:01.878073Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (6-6)
2025-09-30T14:51:01.783522Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-09-30T14:51:01.878078Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (7-7)
2025-09-30T14:51:01.878088Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (8-8)
2025-09-30T14:51:01.783526Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 23306 count 19 nextOffset 20 batches 1
2025-09-30T14:51:01.878090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.878100Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (9-9)
2025-09-30T14:51:01.878121Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (10-10)
2025-09-30T14:51:01.878105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 53
2025-09-30T14:51:01.878129Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (11-11)
2025-09-30T14:51:01.878131Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 54 to 54
2025-09-30T14:51:01.878137Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783533Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-09-30T14:51:01.878140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 54
2025-09-30T14:51:01.783537Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 25631 count 20 nextOffset 21 batches 1
2025-09-30T14:51:01.783541Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-09-30T14:51:01.783546Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 28066 count 21 nextOffset 22 batches 1
2025-09-30T14:51:01.783549Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-09-30T14:51:01.878152Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 55 to 55
2025-09-30T14:51:01.783553Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 30611 count 22 nextOffset 23 batches 1
2025-09-30T14:51:01.878140Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (12-12)
2025-09-30T14:51:01.783556Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-09-30T14:51:01.783560Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 33266 count 23 nextOffset 24 batches 1
2025-09-30T14:51:01.878160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783563Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-09-30T14:51:01.783567Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 36031 count 24 nextOffset 25 batches 1
2025-09-30T14:51:01.878167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 55
2025-09-30T14:51:01.783570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.878160Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (13-13)
2025-09-30T14:51:01.878175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 56 to 56
2025-09-30T14:51:01.783669Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,24 HeadOffset 1 endOffset 1 curOffset 25 d0000000000_00000000000000000001_00000_0000000024_00000? size 35324 WTime 1759243861783
2025-09-30T14:51:01.878183Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.878186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 56
2025-09-30T14:51:01.783722Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.783725Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 142 bytes (142)
2025-09-30T14:51:01.878180Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (14-14)
2025-09-30T14:51:01.783730Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 142 (8388608)
2025-09-30T14:51:01.783742Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.783746Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.783755Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.878203Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (15-15)
2025-09-30T14:51:01.783762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.878218Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 14} (16-16)
2025-09-30T14:51:01.783767Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.783769Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.783773Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.878193Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 57 to 57
2025-09-30T14:51:01.783775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.783778Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.783781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.878241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.878245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 57
2025-09-30T14:51:01.783792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 1
2025-09-30T14:51:01.878246Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 15} (17-17)
2025-09-30T14:51:01.783816Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.878252Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 16} (18-18)
2025-09-30T14:51:01.878262Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 17} (19-19)
2025-09-30T14:51:01.878252Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 58 to 58
2025-09-30T14:51:01.878267Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 18} (20-20)
2025-09-30T14:51:01.878272Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 19} (21-21)
2025-09-30T14:51:01.878274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.878277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 58
2025-09-30T14:51:01.783820Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.878289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 59 to 59
2025-09-30T14:51:01.878277Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 20} (22-22)
2025-09-30T14:51:01.878311Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.878316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 59
2025-09-30T14:51:01.878317Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 21} (23-23)
2025-09-30T14:51:01.783823Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.878324Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 60 to 60
2025-09-30T14:51:01.878324Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 22} (24-24)
2025-09-30T14:51:01.878333Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (25-25)
2025-09-30T14:51:01.878333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.878338Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 60
2025-09-30T14:51:01.783832Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.878344Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 61 to 61
2025-09-30T14:51:01.878350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783843Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 24 size 35324
2025-09-30T14:51:01.783854Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 56  requestId: <none> cookie: 29
2025-09-30T14:51:01.783859Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 57  requestId: <none> cookie: 30
2025-09-30T14:51:01.878339Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (26-26)
2025-09-30T14:51:01.878382Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (27-27)
2025-09-30T14:51:01.783892Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.783896Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.783915Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 58  requestId: <none> cookie: 31
2025-09-30T14:51:01.878392Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (28-28)
2025-09-30T14:51:01.783919Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 59  requestId: <none> cookie: 32
2025-09-30T14:51:01.783920Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.783924Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.878352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 61
2025-09-30T14:51:01.783929Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-09-30T14:51:01.783944Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 142 count 1 last offset 0, current partition end offset: 1
2025-09-30T14:51:01.878411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 62 to 62
2025-09-30T14:51:01.783948Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:51:01.878416Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.783977Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.878419Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 62
2025-09-30T14:51:01.783979Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.783990Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 60 size 3163 offset: -1
2025-09-30T14:51:01.878425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 63 to 63
2025-09-30T14:51:01.783995Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.783997Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.878438Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (29-29)
2025-09-30T14:51:01.878432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.878444Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 63
2025-09-30T14:51:01.784001Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 61 size 3273 offset: -1
2025-09-30T14:51:01.784005Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.878444Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (30-30)
2025-09-30T14:51:01.878461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 64 to 64
2025-09-30T14:51:01.878468Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.878471Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 64
2025-09-30T14:51:01.878472Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (31-31)
2025-09-30T14:51:01.784007Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.878477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 65 to 65
2025-09-30T14:51:01.784011Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 62 size 3383 offset: -1
2025-09-30T14:51:01.878484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.784016Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.878487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 65
2025-09-30T14:51:01.784018Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.878492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 66 to 66
2025-09-30T14:51:01.784022Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 63 size 3493 offset: -1
2025-09-30T14:51:01.784031Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 142 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.878500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.784036Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-09-30T14:51:01.878503Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 66
2025-09-30T14:51:01.784044Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 4 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 170 endOffset 1 max time lag 0ms effective offset 0
2025-09-30T14:51:01.878510Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 67 to 67
2025-09-30T14:51:01.784046Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:51:01.878515Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.784057Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 4 added 1 blobs, size 142 count 1 last offset 0, current partition end offset: 1
2025-09-30T14:51:01.878518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 67
2025-09-30T14:51:01.784058Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 4. Send blob request.
2025-09-30T14:51:01.784061Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.878524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 68 to 68
2025-09-30T14:51:01.784066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.784068Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.784071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.784073Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.784075Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.784077Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.784081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.878546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.784089Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.878549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 68
2025-09-30T14:51:01.784103Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 124 from pos 0 cbcount 1
2025-09-30T14:51:01.784121Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 142 accessed 1 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.784124Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 4. All 1 blobs are from cache.
2025-09-30T14:51:01.878555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 69 to 69
2025-09-30T14:51:01.784128Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243861781 queuesize 0 startOffset 0
2025-09-30T14:51:01.878574Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.784133Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:51:01.784136Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
>>> event from dataHandler: 2025-09-30T14:51:01.881842Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 69
2025-09-30T14:51:01.881328Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 3696, now ReadSizeBudget = 22015, ReadSizeServerDelta = 498577
2025-09-30T14:51:01.784143Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 124 from pos 0 cbcount 1
2025-09-30T14:51:01.784160Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:01.784261Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 1 Result { Offset: 0 Data: "... 82 bytes ..." SourceId: "\000src_id" SeqNo: 1 WriteTimestampMS: 1759243861781 CreateTimestampMS: 1759243861780 UncompressedSize: 11 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18 RealReadOffset: 0 WaitQuotaTimeMs: 0 EndOffset: 1 StartOffset: 0 } Cookie: 0 }
2025-09-30T14:51:01.881886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 70 to 70
2025-09-30T14:51:01.881899Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 22015, ReadSizeServerDelta = 498577
2025-09-30T14:51:01.784315Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 2 from offset 1
2025-09-30T14:51:01.784324Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 1 ReadOffset 1 ReadGuid 15b344e5-78d94962-45a8df2b-8d60a50a has messages 1
2025-09-30T14:51:01.784356Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 15b344e5-78d94962-45a8df2b-8d60a50a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 171
2025-09-30T14:51:01.784365Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 15b344e5-78d94962-45a8df2b-8d60a50a
2025-09-30T14:51:01.881927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.784437Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.881932Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 70
2025-09-30T14:51:01.785199Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 24 size 35324 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.785215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.881943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 71 to 71
2025-09-30T14:51:01.785230Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 35159 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.881953Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.881956Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 71
2025-09-30T14:51:01.785231Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 24 parts 0 suffix '63' size 35324
2025-09-30T14:51:01.785238Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.881968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 72 to 72
2025-09-30T14:51:01.785248Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-09-30T14:51:01.785253Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785256Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-09-30T14:51:01.785259Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785264Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-09-30T14:51:01.785266Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785269Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-09-30T14:51:01.785271Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785274Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-09-30T14:51:01.785276Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..121 bytes.. Information: { Offset: 1 ProducerId: "src_id" SeqNo: 2 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.782000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..231 bytes.. Information: { Offset: 2 ProducerId: "src_id" SeqNo: 3 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..341 bytes.. Information: { Offset: 3 ProducerId: "src_id" SeqNo: 4 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..451 bytes.. Information: { Offset: 4 ProducerId: "src_id" SeqNo: 5 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..561 bytes.. Information: { Offset: 5 ProducerId: "src_id" SeqNo: 6 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..671 bytes.. Information: { Offset: 6 ProducerId: "src_id" SeqNo: 7 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..781 bytes.. Information: { Offset: 7 ProducerId: "src_id" SeqNo: 8 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..891 bytes.. Information: { Offset: 8 ProducerId: "src_id" SeqNo: 9 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1001 bytes.. Information: { Offset: 9 ProducerId: "src_id" SeqNo: 10 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1111 bytes.. Information: { Offset: 10 ProducerId: "src_id" SeqNo: 11 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1221 bytes.. Information: { Offset: 11 ProducerId: "src_id" SeqNo: 12 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1331 bytes.. Information: { Offset: 12 ProducerId: "src_id" SeqNo: 13 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1441 bytes.. Information: { Offset: 13 ProducerId: "src_id" SeqNo: 14 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1551 bytes.. Information: { Offset: 14 ProducerId: "src_id" SeqNo: 15 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1661 bytes.. Information: { Offset: 15 ProducerId: "src_id" SeqNo: 16 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1771 bytes.. Information: { Offset: 16 ProducerId: "src_id" SeqNo: 17 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1881 bytes.. Information: { Offset: 17 ProducerId: "src_id" SeqNo: 18 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..1991 bytes.. Information: { Offset: 18 ProducerId: "src_id" SeqNo: 19 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2101 bytes.. Information: { Offset: 19 ProducerId: "src_id" SeqNo: 20 CreateTime: 2025-09-30T14:51:01.781000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2211 bytes.. Information: { Offset: 20 ProducerId: "src_id" SeqNo: 21 CreateTime: 2025-09-30T14:51:01.782000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2321 bytes.. Information: { Offset: 21 ProducerId: "src_id" SeqNo: 22 CreateTime: 2025-09-30T14:51:01.782000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2431 bytes.. Information: { Offset: 22 ProducerId: "src_id" SeqNo: 23 CreateTime: 2025-09-30T14:51:01.782000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2541 bytes.. Information: { Offset: 23 ProducerId: "src_id" SeqNo: 24 CreateTime: 2025-09-30T14:51:01.782000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2651 bytes.. Information: { Offset: 24 ProducerId: "src_id" SeqNo: 25 CreateTime: 2025-09-30T14:51:01.782000Z WriteTime: 2025-09-30T14:51:01.783000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2761 bytes.. Information: { Offset: 25 ProducerId: "src_id" SeqNo: 26 CreateTime: 2025-09-30T14:51:01.782000Z WriteTime: 2025-09-30T14:51:01.785000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2871 bytes.. Information: { Offset: 26 ProducerId: "src_id" SeqNo: 27 CreateTime: 2025-09-30T14:51:01.782000Z WriteTime: 2025-09-30T14:51:01.785000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..2981 bytes.. Information: { Offset: 27 ProducerId: "src_id" SeqNo: 28 CreateTime: 2025-09-30T14:51:01.782000Z WriteTime: 2025-09-30T14:51:01.785000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3091 bytes.. Information: { Offset: 28 ProducerId: "src_id" SeqNo: 29 CreateTime: 2025-09-30T14:51:01.782000Z WriteTime: 2025-09-30T14:51:01.785000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3201 bytes.. Information: { Offset: 29 ProducerId: "src_id" SeqNo: 30 CreateTime: 2025-09-30T14:51:01.782000Z WriteTime: 2025-09-30T14:51:01.785000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3311 bytes.. Information: { Offset: 30 ProducerId: "src_id" SeqNo: 31 CreateTime: 2025-09-30T14:51:01.782000Z WriteTime: 2025-09-30T14:51:01.785000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3421 bytes.. Information: { Offset: 31 ProducerId: "src_id" SeqNo: 32 CreateTime: 2025-09-30T14:51:01.782000Z WriteTime: 2025-09-30T14:51:01.785000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.882004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.882037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 72
2025-09-30T14:51:01.785280Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-09-30T14:51:01.785282Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.882042Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 520592
2025-09-30T14:51:01.882047Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 73 to 73
2025-09-30T14:51:01.785285Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-09-30T14:51:01.882059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.785287Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.882062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 73
2025-09-30T14:51:01.785292Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-09-30T14:51:01.785295Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785299Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-09-30T14:51:01.882072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 74 to 74
2025-09-30T14:51:01.882081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.882084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 74
2025-09-30T14:51:01.785301Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785305Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-09-30T14:51:01.882093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 75 to 75
2025-09-30T14:51:01.785307Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785313Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-09-30T14:51:01.882097Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (32-32)
2025-09-30T14:51:01.882102Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 7, size 21637 bytes
2025-09-30T14:51:01.785321Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.882102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.882119Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 24, size 33264 bytes
2025-09-30T14:51:01.882122Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 3696 to budget
2025-09-30T14:51:01.882119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 75
2025-09-30T14:51:01.882137Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (32-32)
2025-09-30T14:51:01.882144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 76 to 76
2025-09-30T14:51:01.785326Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-09-30T14:51:01.882157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.785328Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.882160Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 76
2025-09-30T14:51:01.882131Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.785332Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-09-30T14:51:01.785335Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.882196Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 77 to 77
2025-09-30T14:51:01.785338Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-09-30T14:51:01.882205Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.882209Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.882216Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 77
2025-09-30T14:51:01.785341Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785344Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-09-30T14:51:01.882224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 78 to 78
2025-09-30T14:51:01.785347Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785351Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-09-30T14:51:01.785353Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785357Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-09-30T14:51:01.882246Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.882250Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 78
2025-09-30T14:51:01.785360Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785363Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-09-30T14:51:01.785366Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785371Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-09-30T14:51:01.882266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 79 to 79
2025-09-30T14:51:01.785373Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785378Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-09-30T14:51:01.882275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.785380Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.882278Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 79
2025-09-30T14:51:01.785383Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-09-30T14:51:01.785386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785390Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-09-30T14:51:01.882288Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 80 to 80
2025-09-30T14:51:01.785392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.785396Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-09-30T14:51:01.785398Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.882298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.785403Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-09-30T14:51:01.882301Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 80
2025-09-30T14:51:01.785441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..3531 bytes.. Information: { Offset: 32 ProducerId: "src_id" SeqNo: 33 CreateTime: 2025-09-30T14:51:01.782000Z WriteTime: 2025-09-30T14:51:01.878000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.785453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.785454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (7)
2025-09-30T14:51:01.882313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 81 to 81
2025-09-30T14:51:01.785466Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 1 EndOffset 1 newEndOffset 25 commitOffset 0 clientCommitOffset 0 cookie 2 readingFinished 0 firstRead 0
2025-09-30T14:51:01.882331Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 1, size 3531 bytes
2025-09-30T14:51:01.882338Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.785472Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 1 endOffset 25
2025-09-30T14:51:01.785473Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-09-30T14:51:01.882332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.785484Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 1, endOffset# 25, WTime# 1759243861781, sizeLag# 35324
2025-09-30T14:51:01.882352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 81
2025-09-30T14:51:01.785486Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.785498Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 2907 count 1 nextOffset 26 batches 1
2025-09-30T14:51:01.785498Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 60fd8ba2-3221adf5-54c2ec3a-976f0b16, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 28, size# 42388, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.785504Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-09-30T14:51:01.882366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 82 to 82
2025-09-30T14:51:01.785510Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 5892 count 2 nextOffset 27 batches 1
2025-09-30T14:51:01.882378Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.882381Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 82
2025-09-30T14:51:01.785513Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 28 maxSize 42388 maxTimeLagMs 0 readTimestampMs 0 readOffset 1 EndOffset 25 ClientCommitOffset 0 committedOffset 0 Guid 60fd8ba2-3221adf5-54c2ec3a-976f0b16
2025-09-30T14:51:01.882392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 83 to 83
2025-09-30T14:51:01.785513Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-09-30T14:51:01.882399Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.882401Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 83
2025-09-30T14:51:01.785517Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 8987 count 3 nextOffset 28 batches 1
2025-09-30T14:51:01.785522Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-09-30T14:51:01.882408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 84 to 84
2025-09-30T14:51:01.785526Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 12192 count 4 nextOffset 29 batches 1
2025-09-30T14:51:01.785530Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-09-30T14:51:01.785535Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 15507 count 5 nextOffset 30 batches 1
2025-09-30T14:51:01.785538Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-09-30T14:51:01.785542Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 18932 count 6 nextOffset 31 batches 1
2025-09-30T14:51:01.785545Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-09-30T14:51:01.785550Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 25 PartNo 0 PackedSize 22467 count 7 nextOffset 32 batches 1
2025-09-30T14:51:01.785553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.882436Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.785621Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 25,7 HeadOffset 25 endOffset 25 curOffset 32 d0000000000_00000000000000000025_00000_0000000007_00000? size 22305 WTime 1759243861785
2025-09-30T14:51:01.882439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 84
2025-09-30T14:51:01.785643Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.785645Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.882452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 85 to 85
2025-09-30T14:51:01.785649Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 35466 bytes (35466)
2025-09-30T14:51:01.785652Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 35466 (8388608)
2025-09-30T14:51:01.785666Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-09-30T14:51:01.785683Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 9  requestId: <none> cookie: 3
2025-09-30T14:51:01.882463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.785687Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 11  requestId: <none> cookie: 4
2025-09-30T14:51:01.882466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 85
2025-09-30T14:51:01.785691Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 12  requestId: <none> cookie: 5
2025-09-30T14:51:01.785696Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.882474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 86 to 86
2025-09-30T14:51:01.785696Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 13  requestId: <none> cookie: 6
2025-09-30T14:51:01.785701Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 14  requestId: <none> cookie: 7
2025-09-30T14:51:01.785703Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.882484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.785706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 19  requestId: <none> cookie: 8
2025-09-30T14:51:01.882487Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 86
2025-09-30T14:51:01.785707Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.785711Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.882495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 87 to 87
2025-09-30T14:51:01.785711Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 21  requestId: <none> cookie: 9
2025-09-30T14:51:01.882502Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.785715Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.882505Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 87
2025-09-30T14:51:01.785717Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 22  requestId: <none> cookie: 10
2025-09-30T14:51:01.785722Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 23  requestId: <none> cookie: 11
2025-09-30T14:51:01.882512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 88 to 88
2025-09-30T14:51:01.785723Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.785727Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 24  requestId: <none> cookie: 12
2025-09-30T14:51:01.882519Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.882522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 88
2025-09-30T14:51:01.785728Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.785732Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 25  requestId: <none> cookie: 13
2025-09-30T14:51:01.785733Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.785737Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 31  requestId: <none> cookie: 14
2025-09-30T14:51:01.882532Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 89 to 89
2025-09-30T14:51:01.785738Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.785742Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 32  requestId: <none> cookie: 15
2025-09-30T14:51:01.785746Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 33  requestId: <none> cookie: 16
2025-09-30T14:51:01.882540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.785750Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 34  requestId: <none> cookie: 17
2025-09-30T14:51:01.882553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 89
2025-09-30T14:51:01.785755Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 35  requestId: <none> cookie: 18
2025-09-30T14:51:01.785760Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 41  requestId: <none> cookie: 19
2025-09-30T14:51:01.785766Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 42  requestId: <none> cookie: 20
2025-09-30T14:51:01.785771Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 43  requestId: <none> cookie: 21
2025-09-30T14:51:01.882568Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 90 to 90
2025-09-30T14:51:01.785776Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 44  requestId: <none> cookie: 22
2025-09-30T14:51:01.785781Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 45  requestId: <none> cookie: 23
2025-09-30T14:51:01.785787Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 51  requestId: <none> cookie: 24
2025-09-30T14:51:01.882578Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.785793Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 52  requestId: <none> cookie: 25
2025-09-30T14:51:01.882582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 90
2025-09-30T14:51:01.785805Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.785810Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.785823Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.785835Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 25 partNo 0 count 7 size 22305
2025-09-30T14:51:01.785838Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.785888Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.785905Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 5 Topic 'rt3.dc1--test-topic' partition 0 user user offset 1 count 28 size 42388 endOffset 25 max time lag 0ms effective offset 1
2025-09-30T14:51:01.785922Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 5 added 1 blobs, size 35324 count 24 last offset 1, current partition end offset: 25
2025-09-30T14:51:01.785925Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 5. Send blob request.
2025-09-30T14:51:01.882620Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 91 to 91
2025-09-30T14:51:01.785935Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 1 partno 0 count 24 parts_count 0 source 1 size 35324 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.785944Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 5. All 1 blobs are from cache.
2025-09-30T14:51:01.882626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.882635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 91
2025-09-30T14:51:01.785953Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.785953Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 24 parts 0 suffix '63'
2025-09-30T14:51:01.882647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 92 to 92
2025-09-30T14:51:01.785964Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.882657Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.882660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 92
2025-09-30T14:51:01.786007Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.786012Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.786015Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.786019Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.786024Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.786028Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.882691Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 93 to 93
2025-09-30T14:51:01.786032Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.786037Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.786041Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.882699Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.786045Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.882718Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 93
2025-09-30T14:51:01.786050Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.786054Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.786078Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 1 totakecount 24 count 24 size 35302 from pos 0 cbcount 24
2025-09-30T14:51:01.786132Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:01.882730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 94 to 94
2025-09-30T14:51:01.882746Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.882749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 94
2025-09-30T14:51:01.786366Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 25 Result { Offset: 1 Data: "... 192 bytes ..." SourceId: "\000src_id" SeqNo: 2 WriteTimestampMS: 1759243861782 CreateTimestampMS: 1759243861781 UncompressedSize: 121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 2 Data: "... 303 bytes ..." SourceId: "\000src_id" SeqNo: 3 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 3 Data: "... 413 bytes ..." SourceId: "\000src_id" SeqNo: 4 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 4 Data: "... 523 bytes ..." SourceId: "\000src_id" SeqNo: 5 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 5 Data: "... 633 bytes ..." SourceId: "\000src_id" SeqNo: 6 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 6 Data: "... 743 bytes ..." SourceId: "\000src_id" SeqNo: 7 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 7 Data: "... 853 bytes ..." SourceId: "\000src_id" SeqNo: 8 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 8 Data: "... 963 bytes ..." SourceId: "\000src_id" SeqNo: 9 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 9 Data: "... 1073 bytes ..." SourceId: "\000src_id" SeqNo: 10 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 1001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 10 Data: "... 1183 bytes ..." SourceId: "\000src_id" SeqNo: 11 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 1111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 11 Data: "... 1293 bytes ..." SourceId: "\000src_id" SeqNo: 12 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 1221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 12 Data: "... 1403 bytes ..." SourceId: "\000src_id" SeqNo: 13 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 1331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 13 Data: "... 1513 bytes ..." SourceId: "\000src_id" SeqNo: 14 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 1441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 14 Data: "... 1623 bytes ..." SourceId: "\000src_id" SeqNo: 15 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 1551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 15 Data: "... 1733 bytes ..." SourceId: "\000src_id" SeqNo: 16 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 1661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 16 Data: "... 1843 bytes ..." SourceId: "\000src_id" SeqNo: 17 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 1771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 17 Data: "... 1953 bytes ..." SourceId: "\000src_id" SeqNo: 18 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 1881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 18 Data: "... 2063 bytes ..." SourceId: "\000src_id" SeqNo: 19 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 1991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 19 Data: "... 2173 bytes ..." SourceId: "\000src_id" SeqNo: 20 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861781 UncompressedSize: 2101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 20 Data: "... 2283 bytes ..." SourceId: "\000src_id" SeqNo: 21 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861782 UncompressedSize: 2211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 21 Data: "... 2393 bytes ..." SourceId: "\000src_id" SeqNo: 22 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861782 UncompressedSize: 2321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 22 Data: "... 2503 bytes ..." SourceId: "\000src_id" SeqNo: 23 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861782 UncompressedSize: 2431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 23 Data: "... 2613 bytes ..." SourceId: "\000src_id" SeqNo: 24 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861782 UncompressedSize: 2541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 24 Data: "... 2723 bytes ..." SourceId: "\000src_id" SeqNo: 25 WriteTimestampMS: 1759243861783 CreateTimestampMS: 1759243861782 UncompressedSize: 2651 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709550941 RealReadOffset: 24 WaitQuotaTimeMs: 0 EndOffset: 25 StartOffset: 0 } Cookie: 1 }
2025-09-30T14:51:01.882773Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 95 to 95
2025-09-30T14:51:01.786458Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 3 from offset 25
2025-09-30T14:51:01.786467Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 25 ReadOffset 25 ReadGuid 60fd8ba2-3221adf5-54c2ec3a-976f0b16 has messages 1
2025-09-30T14:51:01.786490Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 60fd8ba2-3221adf5-54c2ec3a-976f0b16, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 34353
2025-09-30T14:51:01.786501Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 60fd8ba2-3221adf5-54c2ec3a-976f0b16
2025-09-30T14:51:01.786626Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.786939Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 25 count 7 size 22305 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.786954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.786964Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 7 parts 0 suffix '63' size 22305
2025-09-30T14:51:01.786968Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 22190 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.786975Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.886687Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.786983Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-09-30T14:51:01.786987Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.786990Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-09-30T14:51:01.886702Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 95
2025-09-30T14:51:01.786992Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.786996Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-09-30T14:51:01.786999Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.787006Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-09-30T14:51:01.787009Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.787012Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-09-30T14:51:01.886740Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 96 to 96
2025-09-30T14:51:01.886748Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.886751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 96
2025-09-30T14:51:01.787014Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.787016Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-09-30T14:51:01.787017Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.886765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 97 to 97
2025-09-30T14:51:01.787020Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-09-30T14:51:01.886772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.886776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 97
2025-09-30T14:51:01.787046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.787048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.787049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.787056Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.886789Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 98 to 98
2025-09-30T14:51:01.787058Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.886797Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.886800Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 98
2025-09-30T14:51:01.787059Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.787061Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 57771 bytes (57771)
2025-09-30T14:51:01.787064Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 3, size 57771 (8388608)
2025-09-30T14:51:01.886823Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 99 to 99
2025-09-30T14:51:01.787067Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 25 EndOffset 25 newEndOffset 32 commitOffset 0 clientCommitOffset 0 cookie 3 readingFinished 0 firstRead 0
2025-09-30T14:51:01.787071Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 25 endOffset 32
2025-09-30T14:51:01.886830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.787071Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 53  requestId: <none> cookie: 26
2025-09-30T14:51:01.787079Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 54  requestId: <none> cookie: 27
2025-09-30T14:51:01.787081Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 25, endOffset# 32, WTime# 1759243861783, sizeLag# 22305
2025-09-30T14:51:01.787082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 55  requestId: <none> cookie: 28
2025-09-30T14:51:01.886833Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 99
2025-09-30T14:51:01.787083Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.787085Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 60  requestId: <none> cookie: 29
2025-09-30T14:51:01.787090Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 61  requestId: <none> cookie: 30
2025-09-30T14:51:01.787091Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# dd2c55aa-df27a722-d4fa6fd4-9bf0b673, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 26766, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.787094Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 62  requestId: <none> cookie: 31
2025-09-30T14:51:01.787097Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 63  requestId: <none> cookie: 32
2025-09-30T14:51:01.787105Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.886863Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 100 to 100
2025-09-30T14:51:01.787107Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 26766 maxTimeLagMs 0 readTimestampMs 0 readOffset 25 EndOffset 32 ClientCommitOffset 0 committedOffset 0 Guid dd2c55aa-df27a722-d4fa6fd4-9bf0b673
2025-09-30T14:51:01.886896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.886899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 100
2025-09-30T14:51:01.886913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 101 to 101
2025-09-30T14:51:01.787112Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.787116Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.787120Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.787124Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.787127Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.886925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.886929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 101
2025-09-30T14:51:01.787131Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.886942Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 102 to 102
2025-09-30T14:51:01.787132Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.787136Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.787152Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 6 Topic 'rt3.dc1--test-topic' partition 0 user user offset 25 count 8 size 26766 endOffset 32 max time lag 0ms effective offset 25
2025-09-30T14:51:01.787161Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 6 added 1 blobs, size 22305 count 7 last offset 25, current partition end offset: 32
2025-09-30T14:51:01.886955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.886967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 102
2025-09-30T14:51:01.787162Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 6. Send blob request.
2025-09-30T14:51:01.787170Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 25 partno 0 count 7 parts_count 0 source 1 size 22305 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.787177Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 6. All 1 blobs are from cache.
2025-09-30T14:51:01.787183Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 25 partno 0 count 7 parts 0 suffix '63'
2025-09-30T14:51:01.787186Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.787224Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 25 totakecount 7 count 7 size 22283 from pos 0 cbcount 7
2025-09-30T14:51:01.787273Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 25
2025-09-30T14:51:01.887007Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 103 to 103
2025-09-30T14:51:01.787357Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 32 Result { Offset: 25 Data: "... 2833 bytes ..." SourceId: "\000src_id" SeqNo: 26 WriteTimestampMS: 1759243861785 CreateTimestampMS: 1759243861782 UncompressedSize: 2761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 26 Data: "... 2943 bytes ..." SourceId: "\000src_id" SeqNo: 27 WriteTimestampMS: 1759243861785 CreateTimestampMS: 1759243861782 UncompressedSize: 2871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 27 Data: "... 3053 bytes ..." SourceId: "\000src_id" SeqNo: 28 WriteTimestampMS: 1759243861785 CreateTimestampMS: 1759243861782 UncompressedSize: 2981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 28 Data: "... 3163 bytes ..." SourceId: "\000src_id" SeqNo: 29 WriteTimestampMS: 1759243861785 CreateTimestampMS: 1759243861782 UncompressedSize: 3091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 29 Data: "... 3273 bytes ..." SourceId: "\000src_id" SeqNo: 30 WriteTimestampMS: 1759243861785 CreateTimestampMS: 1759243861782 UncompressedSize: 3201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 30 Data: "... 3383 bytes ..." SourceId: "\000src_id" SeqNo: 31 WriteTimestampMS: 1759243861785 CreateTimestampMS: 1759243861782 UncompressedSize: 3311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 31 Data: "... 3493 bytes ..." SourceId: "\000src_id" SeqNo: 32 WriteTimestampMS: 1759243861785 CreateTimestampMS: 1759243861782 UncompressedSize: 3421 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551486 RealReadOffset: 31 WaitQuotaTimeMs: 0 EndOffset: 32 StartOffset: 0 } Cookie: 25 }
2025-09-30T14:51:01.787390Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 4 from offset 32
2025-09-30T14:51:01.887020Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.787396Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 32 ReadOffset 32 ReadGuid dd2c55aa-df27a722-d4fa6fd4-9bf0b673 has messages 1
2025-09-30T14:51:01.887023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 103
2025-09-30T14:51:01.787415Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# dd2c55aa-df27a722-d4fa6fd4-9bf0b673, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 22015
2025-09-30T14:51:01.787422Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# dd2c55aa-df27a722-d4fa6fd4-9bf0b673
2025-09-30T14:51:01.787497Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.887034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 104 to 104
2025-09-30T14:51:01.799318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.799329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.887059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.887062Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 104
2025-09-30T14:51:01.799331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.877737Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.877812Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 171 } }
2025-09-30T14:51:01.887075Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 105 to 105
2025-09-30T14:51:01.877866Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 1dfb0741-bc7a0fef-d8a75d5b-dde5b6f3
2025-09-30T14:51:01.877902Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.877999Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.878011Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.878052Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 64  requestId: <none> cookie: 33
2025-09-30T14:51:01.887099Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.887102Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 105
2025-09-30T14:51:01.878076Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.878135Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.878142Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 34353 } }
2025-09-30T14:51:01.878146Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.887113Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 106 to 106
2025-09-30T14:51:01.878177Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 65 size 3603 offset: -1
2025-09-30T14:51:01.887128Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.878195Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.878200Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 367eb764-247b1e15-3cd87d54-967d0f8d
2025-09-30T14:51:01.878219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.887142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 106
2025-09-30T14:51:01.878230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.878233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.878281Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-09-30T14:51:01.878332Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 32 PartNo 0 PackedSize 3677 count 1 nextOffset 33 batches 1
2025-09-30T14:51:01.878341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.878412Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 32,1 HeadOffset 32 endOffset 32 curOffset 33 d0000000000_00000000000000000032_00000_0000000001_00000? size 3665 WTime 1759243861878
2025-09-30T14:51:01.878445Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.878477Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 32 partNo 0 count 1 size 3665
2025-09-30T14:51:01.880292Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 32 count 1 size 3665 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.880315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.880325Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 0 suffix '63' size 3665
2025-09-30T14:51:01.880341Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 3610 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.887186Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 107 to 107
2025-09-30T14:51:01.880355Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.880366Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-09-30T14:51:01.880416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.887201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.880419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.887204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 107
2025-09-30T14:51:01.880422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.880434Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.880437Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.880439Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.887220Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 108 to 108
2025-09-30T14:51:01.880444Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.880447Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 4 keys were taken away. Let's read 61436 bytes (61436)
2025-09-30T14:51:01.880449Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 32 EndOffset 32 newEndOffset 33 commitOffset 0 clientCommitOffset 0 cookie 4 readingFinished 0 firstRead 0
2025-09-30T14:51:01.880451Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 4, size 61436 (8388608)
2025-09-30T14:51:01.887235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.880456Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 32 endOffset 33
2025-09-30T14:51:01.887238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 108
2025-09-30T14:51:01.880464Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 65  requestId: <none> cookie: 33
2025-09-30T14:51:01.880475Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 32, endOffset# 33, WTime# 1759243861785, sizeLag# 3665
2025-09-30T14:51:01.880478Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.880487Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.887265Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 109 to 109
2025-09-30T14:51:01.880496Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# c58c7a87-f0b9cb99-bc365851-70d53f16, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 4398, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.880516Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 4398 maxTimeLagMs 0 readTimestampMs 0 readOffset 32 EndOffset 33 ClientCommitOffset 0 committedOffset 0 Guid c58c7a87-f0b9cb99-bc365851-70d53f16
2025-09-30T14:51:01.880578Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.880596Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.887284Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.880642Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 7 Topic 'rt3.dc1--test-topic' partition 0 user user offset 32 count 1 size 4398 endOffset 33 max time lag 0ms effective offset 32
2025-09-30T14:51:01.887286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 109
2025-09-30T14:51:01.880668Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 7 added 1 blobs, size 3665 count 1 last offset 32, current partition end offset: 33
2025-09-30T14:51:01.880673Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 7. Send blob request.
2025-09-30T14:51:01.880686Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 32 partno 0 count 1 parts_count 0 source 1 size 3665 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.880701Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 7. All 1 blobs are from cache.
2025-09-30T14:51:01.887300Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 110 to 110
2025-09-30T14:51:01.880717Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.880737Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 32 totakecount 1 count 1 size 3645 from pos 0 cbcount 1
2025-09-30T14:51:01.880740Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 32 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:51:01.880782Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 32
2025-09-30T14:51:01.887313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.880882Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 33 Result { Offset: 32 Data: "... 3603 bytes ..." SourceId: "\000src_id" SeqNo: 33 WriteTimestampMS: 1759243861878 CreateTimestampMS: 1759243861782 UncompressedSize: 3531 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 32 WaitQuotaTimeMs: 0 EndOffset: 33 StartOffset: 0 } Cookie: 32 }
2025-09-30T14:51:01.887316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 110
2025-09-30T14:51:01.880920Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 5 from offset 33
2025-09-30T14:51:01.880929Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 33 ReadOffset 33 ReadGuid c58c7a87-f0b9cb99-bc365851-70d53f16 has messages 1
2025-09-30T14:51:01.880980Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# c58c7a87-f0b9cb99-bc365851-70d53f16, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 3696
2025-09-30T14:51:01.881009Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# c58c7a87-f0b9cb99-bc365851-70d53f16
2025-09-30T14:51:01.881181Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.882170Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 22015 } }
2025-09-30T14:51:01.887339Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 111 to 111
2025-09-30T14:51:01.882243Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 9a73ed2f-f5de3580-16844384-ad6d4273
2025-09-30T14:51:01.887351Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.887354Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 111
2025-09-30T14:51:01.887367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 112 to 112
2025-09-30T14:51:01.887393Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.887395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 112
2025-09-30T14:51:01.887410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 113 to 113
2025-09-30T14:51:01.887432Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.887434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 113
2025-09-30T14:51:01.887480Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 114 to 114
2025-09-30T14:51:01.887492Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.887495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 114
2025-09-30T14:51:01.887729Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 115 to 115
2025-09-30T14:51:01.887755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.887760Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 115
2025-09-30T14:51:01.887875Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 116 to 116
2025-09-30T14:51:01.887893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.887896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 116
2025-09-30T14:51:01.887896Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.887999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 117 to 117
2025-09-30T14:51:01.888023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.888026Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 117
2025-09-30T14:51:01.888028Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888055Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 118 to 118
2025-09-30T14:51:01.888068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.888071Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 118
2025-09-30T14:51:01.888073Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 119 to 119
2025-09-30T14:51:01.888105Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.888108Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 119
2025-09-30T14:51:01.888112Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888125Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888162Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888175Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888185Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888199Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888210Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888215Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888223Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888225Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888230Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888232Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888241Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888246Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888263Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888271Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888289Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 66  requestId: <none> cookie: 34
2025-09-30T14:51:01.888319Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.888315Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 67  requestId: <none> cookie: 35
2025-09-30T14:51:01.888331Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888335Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 68  requestId: <none> cookie: 36
2025-09-30T14:51:01.888339Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888342Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888345Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 69  requestId: <none> cookie: 37
2025-09-30T14:51:01.888351Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888353Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888357Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.888362Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888370Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.888376Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 71 size 3713 offset: -1
2025-09-30T14:51:01.888380Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.888382Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 70  requestId: <none> cookie: 38
2025-09-30T14:51:01.888387Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.888397Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.888401Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.888407Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.888422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.888455Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888464Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-09-30T14:51:01.888477Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888489Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888512Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 33 PartNo 0 PackedSize 3787 count 1 nextOffset 34 batches 1
2025-09-30T14:51:01.888521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.888555Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888594Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888602Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 33,1 HeadOffset 33 endOffset 33 curOffset 34 d0000000000_00000000000000000033_00000_0000000001_00000? size 3775 WTime 1759243861888
2025-09-30T14:51:01.888609Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888630Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888640Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888649Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 72 size 3823 offset: -1
2025-09-30T14:51:01.888655Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888665Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888670Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888672Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888678Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 74 size 3933 offset: -1
2025-09-30T14:51:01.888682Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888684Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888689Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 75 size 4043 offset: -1
2025-09-30T14:51:01.888695Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888698Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888702Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 76 size 4153 offset: -1
2025-09-30T14:51:01.888705Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888708Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888712Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888714Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888716Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888719Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888721Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888725Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888727Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888734Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.888748Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 33 partNo 0 count 1 size 3775
2025-09-30T14:51:01.888757Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.888763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.888767Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.888770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.888772Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.888775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.888777Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.888780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.888814Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 120 to 120
2025-09-30T14:51:01.888841Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 73  requestId: <none> cookie: 39
2025-09-30T14:51:01.888850Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 77  requestId: <none> cookie: 40
2025-09-30T14:51:01.888852Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.888853Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 78  requestId: <none> cookie: 41
2025-09-30T14:51:01.888855Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 79  requestId: <none> cookie: 42
2025-09-30T14:51:01.888864Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.888858Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 80  requestId: <none> cookie: 43
2025-09-30T14:51:01.888871Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 120
2025-09-30T14:51:01.888860Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.888865Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.888878Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.888881Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.888889Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888891Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888893Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888896Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888900Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 81 size 4263 offset: -1
2025-09-30T14:51:01.888903Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888904Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888906Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888911Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 82 size 4373 offset: -1
2025-09-30T14:51:01.888915Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.888918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.888921Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888924Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888928Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 83 size 4483 offset: -1
2025-09-30T14:51:01.888932Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888934Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 121 to 121
2025-09-30T14:51:01.890665Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.890674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 121
2025-09-30T14:51:01.888938Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 84 size 4593 offset: -1
2025-09-30T14:51:01.888942Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888944Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888948Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 85 size 4703 offset: -1
2025-09-30T14:51:01.888949Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888952Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888955Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888959Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.888960Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.888963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.888965Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.888968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.888970Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.888974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.888976Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.888979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.888980Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.888984Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888986Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.888996Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.888998Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889002Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889004Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889008Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 86  requestId: <none> cookie: 44
2025-09-30T14:51:01.889015Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 87  requestId: <none> cookie: 45
2025-09-30T14:51:01.889018Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.889018Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 88  requestId: <none> cookie: 46
2025-09-30T14:51:01.889021Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 89  requestId: <none> cookie: 47
2025-09-30T14:51:01.889023Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889028Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.889033Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.889043Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.889049Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889051Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889055Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 90 size 4813 offset: -1
2025-09-30T14:51:01.889058Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.889064Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.890813Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 122 to 122
2025-09-30T14:51:01.889075Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.889077Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 122
2025-09-30T14:51:01.889079Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.889082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 91 size 4923 offset: -1
2025-09-30T14:51:01.889087Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889089Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889094Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 92 size 5033 offset: -1
2025-09-30T14:51:01.889098Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889100Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889104Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 93 size 5143 offset: -1
2025-09-30T14:51:01.889108Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889110Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889114Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889116Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889119Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.889124Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.889129Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.889135Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 94  requestId: <none> cookie: 48
2025-09-30T14:51:01.889139Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 95  requestId: <none> cookie: 49
2025-09-30T14:51:01.889145Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889158Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.890900Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 123 to 123
2025-09-30T14:51:01.889167Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.890907Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.889220Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.890910Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 123
2025-09-30T14:51:01.889230Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889233Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889253Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 96 size 5253 offset: -1
2025-09-30T14:51:01.889262Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889264Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889268Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889270Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 97 size 5363 offset: -1
2025-09-30T14:51:01.889272Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.889277Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889279Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889287Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.890962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 124 to 124
2025-09-30T14:51:01.889302Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.890969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.889305Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.890972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 124
2025-09-30T14:51:01.889310Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889323Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889325Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889329Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889331Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889333Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.889339Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 98  requestId: <none> cookie: 50
2025-09-30T14:51:01.889346Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.889350Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889351Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889353Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889357Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 99  requestId: <none> cookie: 51
2025-09-30T14:51:01.889360Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 100  requestId: <none> cookie: 52
2025-09-30T14:51:01.889364Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889365Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.889366Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889369Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.891023Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 125 to 125
2025-09-30T14:51:01.889372Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 102 size 5473 offset: -1
2025-09-30T14:51:01.891028Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.889376Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.891031Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 125
2025-09-30T14:51:01.889378Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889380Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889385Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 103 size 5583 offset: -1
2025-09-30T14:51:01.889389Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.889405Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889407Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889412Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 104 size 5693 offset: -1
2025-09-30T14:51:01.889416Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 101  requestId: <none> cookie: 53
2025-09-30T14:51:01.889424Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889425Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889427Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.889428Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889431Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.891073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 126 to 126
2025-09-30T14:51:01.889433Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.889441Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 105  requestId: <none> cookie: 54
2025-09-30T14:51:01.889471Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.889475Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889493Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889495Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889501Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 106 size 5803 offset: -1
2025-09-30T14:51:01.889505Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.891100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.889509Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.891103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 126
2025-09-30T14:51:01.889513Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 107 size 5913 offset: -1
2025-09-30T14:51:01.889515Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.889517Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.889523Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889523Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.889528Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.889531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889533Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889540Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 108  requestId: <none> cookie: 55
2025-09-30T14:51:01.889561Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.891144Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 127 to 127
2025-09-30T14:51:01.889569Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.891167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.891181Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 127
2025-09-30T14:51:01.889571Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889573Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889577Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889579Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889584Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889585Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 110 size 6023 offset: -1
2025-09-30T14:51:01.889592Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889593Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889599Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889599Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.889603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.889607Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 109  requestId: <none> cookie: 56
2025-09-30T14:51:01.891224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 128 to 128
2025-09-30T14:51:01.889612Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.891231Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.891237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 128
2025-09-30T14:51:01.889628Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 111  requestId: <none> cookie: 57
2025-09-30T14:51:01.889633Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.889745Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889805Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889812Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889814Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889824Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 113 size 6133 offset: -1
2025-09-30T14:51:01.889828Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889829Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889830Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889836Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 114 size 6243 offset: -1
2025-09-30T14:51:01.889845Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.891313Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 129 to 129
2025-09-30T14:51:01.891320Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.889854Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.891322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 129
2025-09-30T14:51:01.889855Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.889862Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 112  requestId: <none> cookie: 58
2025-09-30T14:51:01.889866Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.889872Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.889879Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889882Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889885Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889887Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889891Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889893Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889898Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 117 size 6353 offset: -1
2025-09-30T14:51:01.889903Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.889907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.889910Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 115  requestId: <none> cookie: 59
2025-09-30T14:51:01.891376Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 130 to 130
2025-09-30T14:51:01.889920Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 116  requestId: <none> cookie: 60
2025-09-30T14:51:01.891382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.891388Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 130
2025-09-30T14:51:01.889926Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.889931Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.889935Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889970Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889975Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889985Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 118 size 6463 offset: -1
2025-09-30T14:51:01.889988Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.889990Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.889992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.889993Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.889997Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 119 size 6573 offset: -1
2025-09-30T14:51:01.890002Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.890008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.891434Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 131 to 131
2025-09-30T14:51:01.890010Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890013Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.891439Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.890017Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.891442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 131
2025-09-30T14:51:01.890019Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.890020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.890025Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.890028Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 120  requestId: <none> cookie: 61
2025-09-30T14:51:01.890034Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.891457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 132 to 132
2025-09-30T14:51:01.890036Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890041Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 121  requestId: <none> cookie: 62
2025-09-30T14:51:01.890051Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.890055Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.891470Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.891476Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 132
2025-09-30T14:51:01.890062Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.890066Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.890096Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.890098Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890105Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890146Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 122 size 6683 offset: -1
2025-09-30T14:51:01.890153Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.890157Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890159Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890164Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 123 size 6793 offset: -1
2025-09-30T14:51:01.890167Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890170Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890174Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890176Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890182Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.890192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.890194Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.890194Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.890198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.890199Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.890211Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 124  requestId: <none> cookie: 63
2025-09-30T14:51:01.890228Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 125  requestId: <none> cookie: 64
2025-09-30T14:51:01.890228Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.890231Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890233Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890234Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.890237Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.890238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 126  requestId: <none> cookie: 65
2025-09-30T14:51:01.890244Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.890247Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890248Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890253Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 127 size 6903 offset: -1
2025-09-30T14:51:01.890256Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.890259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.890261Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.890262Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890264Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890268Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 128 size 7013 offset: -1
2025-09-30T14:51:01.890270Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.890272Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890274Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890277Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.890280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.890282Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890284Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890288Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 130 size 7123 offset: -1
2025-09-30T14:51:01.890293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890295Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890300Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.890302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.890305Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 129  requestId: <none> cookie: 66
2025-09-30T14:51:01.890313Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 131  requestId: <none> cookie: 67
2025-09-30T14:51:01.890328Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.890332Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.890342Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.890361Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.890383Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 33 count 1 size 3775 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.890392Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890394Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890398Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 132 size 7233 offset: -1
2025-09-30T14:51:01.890403Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890404Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890407Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 133 size 7343 offset: -1
2025-09-30T14:51:01.890409Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 1 parts 0 suffix '63' size 3775
2025-09-30T14:51:01.890412Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.890414Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.890418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.890436Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 3720 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.891689Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 133 to 133
2025-09-30T14:51:01.891707Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.890445Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.891712Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 133
2025-09-30T14:51:01.890453Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-09-30T14:51:01.890495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.890516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.890517Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 33 EndOffset 33 newEndOffset 34 commitOffset 0 clientCommitOffset 0 cookie 5 readingFinished 0 firstRead 0
2025-09-30T14:51:01.890519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (31)
2025-09-30T14:51:01.890523Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 33 endOffset 34
2025-09-30T14:51:01.890538Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 33, endOffset# 34, WTime# 1759243861878, sizeLag# 3775
2025-09-30T14:51:01.890541Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.890543Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-09-30T14:51:01.890558Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 30c0b523-fde0edaf-26d2df45-fa81a437, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 4530, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.890570Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.890620Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.891790Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 134 to 134
2025-09-30T14:51:01.890635Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.891796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.891802Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 134
2025-09-30T14:51:01.890665Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 3897 count 1 nextOffset 35 batches 1
2025-09-30T14:51:01.890670Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.890672Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-09-30T14:51:01.890677Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 7872 count 2 nextOffset 36 batches 1
2025-09-30T14:51:01.890680Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-09-30T14:51:01.890684Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 11957 count 3 nextOffset 37 batches 1
2025-09-30T14:51:01.890686Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 4530 maxTimeLagMs 0 readTimestampMs 0 readOffset 33 EndOffset 34 ClientCommitOffset 0 committedOffset 0 Guid 30c0b523-fde0edaf-26d2df45-fa81a437
2025-09-30T14:51:01.890687Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-09-30T14:51:01.890691Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 16152 count 4 nextOffset 38 batches 1
2025-09-30T14:51:01.890695Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-09-30T14:51:01.890697Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.890698Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 20457 count 5 nextOffset 39 batches 1
2025-09-30T14:51:01.890702Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-09-30T14:51:01.890706Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 24872 count 6 nextOffset 40 batches 1
2025-09-30T14:51:01.890709Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-09-30T14:51:01.890724Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 29397 count 7 nextOffset 41 batches 1
2025-09-30T14:51:01.890728Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-09-30T14:51:01.891855Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 135 to 135
2025-09-30T14:51:01.890731Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 34032 count 8 nextOffset 42 batches 1
2025-09-30T14:51:01.890734Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-09-30T14:51:01.891877Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.890737Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.891879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 135
2025-09-30T14:51:01.890741Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 38777 count 9 nextOffset 43 batches 1
2025-09-30T14:51:01.890744Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-09-30T14:51:01.890748Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 43632 count 10 nextOffset 44 batches 1
2025-09-30T14:51:01.890751Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-09-30T14:51:01.890755Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.890755Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 48597 count 11 nextOffset 45 batches 1
2025-09-30T14:51:01.890758Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-09-30T14:51:01.890761Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 53672 count 12 nextOffset 46 batches 1
2025-09-30T14:51:01.891929Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 136 to 136
2025-09-30T14:51:01.890765Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-09-30T14:51:01.890769Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 58857 count 13 nextOffset 47 batches 1
2025-09-30T14:51:01.892384Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 3806, now ReadSizeBudget = 3696, ReadSizeServerDelta = 516786
2025-09-30T14:51:01.890772Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-09-30T14:51:01.899334Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.899347Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 136
2025-09-30T14:51:01.890776Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 64152 count 14 nextOffset 48 batches 1
2025-09-30T14:51:01.890780Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-09-30T14:51:01.890783Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 69557 count 15 nextOffset 49 batches 1
2025-09-30T14:51:01.890786Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-09-30T14:51:01.899365Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 3696, ReadSizeServerDelta = 516786
2025-09-30T14:51:01.890791Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 75072 count 16 nextOffset 50 batches 1
2025-09-30T14:51:01.890794Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-09-30T14:51:01.890798Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 80697 count 17 nextOffset 51 batches 1
2025-09-30T14:51:01.890801Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-09-30T14:51:01.890805Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 86432 count 18 nextOffset 52 batches 1
2025-09-30T14:51:01.890808Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-09-30T14:51:01.890811Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 92277 count 19 nextOffset 53 batches 1
2025-09-30T14:51:01.890814Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-09-30T14:51:01.890816Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.890818Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 98232 count 20 nextOffset 54 batches 1
2025-09-30T14:51:01.899426Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 520482
2025-09-30T14:51:01.890822Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-09-30T14:51:01.890825Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 104297 count 21 nextOffset 55 batches 1
2025-09-30T14:51:01.890829Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-09-30T14:51:01.890832Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 110472 count 22 nextOffset 56 batches 1
2025-09-30T14:51:01.890833Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.890835Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-09-30T14:51:01.890839Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 116757 count 23 nextOffset 57 batches 1
2025-09-30T14:51:01.890842Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-09-30T14:51:01.890845Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 123152 count 24 nextOffset 58 batches 1
2025-09-30T14:51:01.890848Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-09-30T14:51:01.890851Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 129657 count 25 nextOffset 59 batches 1
2025-09-30T14:51:01.890854Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-09-30T14:51:01.890857Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 136272 count 26 nextOffset 60 batches 1
2025-09-30T14:51:01.890860Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-09-30T14:51:01.890861Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.899491Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (33-33)
2025-09-30T14:51:01.899494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 137 to 137
2025-09-30T14:51:01.899513Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 3806 to budget
2025-09-30T14:51:01.890864Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 142997 count 27 nextOffset 61 batches 1
2025-09-30T14:51:01.899517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.899522Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 137
2025-09-30T14:51:01.890866Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-09-30T14:51:01.890871Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 149832 count 28 nextOffset 62 batches 1
2025-09-30T14:51:01.899529Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 138 to 138
2025-09-30T14:51:01.890874Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-09-30T14:51:01.890878Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 156777 count 29 nextOffset 63 batches 1
2025-09-30T14:51:01.899537Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.899534Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (33-33)
2025-09-30T14:51:01.899555Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 138
2025-09-30T14:51:01.899564Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 139 to 139
2025-09-30T14:51:01.890881Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-09-30T14:51:01.890884Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 163832 count 30 nextOffset 64 batches 1
2025-09-30T14:51:01.890887Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-09-30T14:51:01.890890Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 34 PartNo 0 PackedSize 170997 count 31 nextOffset 65 batches 1
2025-09-30T14:51:01.890893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.890896Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.890964Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.891005Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.899600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.891034Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.899603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 139
2025-09-30T14:51:01.891077Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.891177Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.891229Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: 2025-09-30T14:51:01.899619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 140 to 140
2025-09-30T14:51:01.899635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.891269Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.899638Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 140
2025-09-30T14:51:01.891313Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.891341Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.899654Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 141 to 141
2025-09-30T14:51:01.891377Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..3641 bytes.. Information: { Offset: 33 ProducerId: "src_id" SeqNo: 34 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.888000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.891413Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 34,31 HeadOffset 34 endOffset 34 curOffset 65 d0000000000_00000000000000000034_00000_0000000031_00000? size 170067 WTime 1759243861890
2025-09-30T14:51:01.891417Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.899660Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.899683Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 1, size 3641 bytes
2025-09-30T14:51:01.891444Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.891470Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.891508Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.899701Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.899701Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 141
2025-09-30T14:51:01.899711Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 168649, now ReadSizeBudget = 3806, ReadSizeServerDelta = 351833
2025-09-30T14:51:01.891534Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.891559Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.891568Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.891570Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.891572Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.891574Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.891576Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.891579Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 5 keys were taken away. Let's read 65211 bytes (65211)
2025-09-30T14:51:01.891584Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 5, size 65211 (8388608)
2025-09-30T14:51:01.891593Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.891604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.899763Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 3806, ReadSizeServerDelta = 351833
2025-09-30T14:51:01.891607Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.891609Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.891621Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.891623Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 71  requestId: <none> cookie: 34
2025-09-30T14:51:01.891636Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.891639Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.891647Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.891649Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.891651Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.891659Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.891660Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.891661Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.891670Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.891672Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.891676Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.891677Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.899798Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 355639
2025-09-30T14:51:01.891682Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.891694Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 34 partNo 0 count 31 size 170067
2025-09-30T14:51:01.899827Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 142 to 142
2025-09-30T14:51:01.891703Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 134  requestId: <none> cookie: 68
2025-09-30T14:51:01.891752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 135  requestId: <none> cookie: 69
2025-09-30T14:51:01.891756Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 136  requestId: <none> cookie: 70
2025-09-30T14:51:01.891769Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 137  requestId: <none> cookie: 71
2025-09-30T14:51:01.891772Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 138  requestId: <none> cookie: 72
2025-09-30T14:51:01.899893Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.899899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 142
2025-09-30T14:51:01.899906Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (34-64)
2025-09-30T14:51:01.899917Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 143 to 143
2025-09-30T14:51:01.899925Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 168649 to budget
2025-09-30T14:51:01.899933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.899937Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 143
2025-09-30T14:51:01.899960Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (34-34)
2025-09-30T14:51:01.899972Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (35-35)
2025-09-30T14:51:01.899980Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (36-36)
2025-09-30T14:51:01.899985Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (37-37)
2025-09-30T14:51:01.900021Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (38-38)
2025-09-30T14:51:01.900031Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (39-39)
2025-09-30T14:51:01.900037Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (40-40)
2025-09-30T14:51:01.900043Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (41-41)
2025-09-30T14:51:01.900079Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (42-42)
2025-09-30T14:51:01.900085Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (43-43)
2025-09-30T14:51:01.900090Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (44-44)
2025-09-30T14:51:01.891779Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.891785Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.900095Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (45-45)
2025-09-30T14:51:01.891792Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.900118Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (46-46)
2025-09-30T14:51:01.891796Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.900119Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 144 to 144
2025-09-30T14:51:01.891800Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.900127Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (47-47)
2025-09-30T14:51:01.891805Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 8 Topic 'rt3.dc1--test-topic' partition 0 user user offset 33 count 1 size 4530 endOffset 34 max time lag 0ms effective offset 33
2025-09-30T14:51:01.900134Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (48-48)
2025-09-30T14:51:01.900134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.900158Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 144
2025-09-30T14:51:01.891819Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 8 added 1 blobs, size 3775 count 1 last offset 33, current partition end offset: 34
2025-09-30T14:51:01.891821Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.891822Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 8. Send blob request.
2025-09-30T14:51:01.900206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 145 to 145
2025-09-30T14:51:01.900148Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (49-49)
2025-09-30T14:51:01.891827Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.900240Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.900245Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 145
2025-09-30T14:51:01.891835Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 33 partno 0 count 1 parts_count 0 source 1 size 3775 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.891836Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.891839Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 8. All 1 blobs are from cache.
2025-09-30T14:51:01.891841Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.891846Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.891846Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.891848Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.891857Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 139 size 7453 offset: -1
2025-09-30T14:51:01.891860Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 33 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:51:01.891861Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.891863Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.891867Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 140 size 7563 offset: -1
2025-09-30T14:51:01.891870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.891872Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.891876Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 141 size 7673 offset: -1
2025-09-30T14:51:01.891879Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.891880Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.900314Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (50-50)
2025-09-30T14:51:01.891885Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 142 size 7783 offset: -1
2025-09-30T14:51:01.900330Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (51-51)
2025-09-30T14:51:01.891889Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.900336Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (52-52)
2025-09-30T14:51:01.891891Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.900346Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (53-53)
2025-09-30T14:51:01.891894Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 143 size 7893 offset: -1
2025-09-30T14:51:01.900352Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 20} (54-54)
2025-09-30T14:51:01.900352Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 146 to 146
2025-09-30T14:51:01.891898Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.891901Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.900361Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.891914Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.900364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 146
2025-09-30T14:51:01.891923Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 33 totakecount 1 count 1 size 3755 from pos 0 cbcount 1
2025-09-30T14:51:01.900369Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 21} (55-55)
2025-09-30T14:51:01.891944Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.891949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.900376Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 22} (56-56)
2025-09-30T14:51:01.891951Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.891953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.900381Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 23} (57-57)
2025-09-30T14:51:01.891954Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.891957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.891958Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.900394Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 24} (58-58)
2025-09-30T14:51:01.891960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.891963Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.891965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.891968Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.891970Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.891974Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.900414Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 147 to 147
2025-09-30T14:51:01.891975Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.891978Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.891980Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.891984Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.900415Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 25} (59-59)
2025-09-30T14:51:01.891986Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.891989Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.900438Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 26} (60-60)
2025-09-30T14:51:01.891991Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.900443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.900444Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 27} (61-61)
2025-09-30T14:51:01.900450Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 28} (62-62)
2025-09-30T14:51:01.900452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 147
2025-09-30T14:51:01.900456Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 29} (63-63)
2025-09-30T14:51:01.900462Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 30} (64-64)
2025-09-30T14:51:01.891997Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 33
2025-09-30T14:51:01.892006Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892020Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 144  requestId: <none> cookie: 73
2025-09-30T14:51:01.892022Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 145  requestId: <none> cookie: 74
2025-09-30T14:51:01.892025Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 146  requestId: <none> cookie: 75
2025-09-30T14:51:01.892027Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 147  requestId: <none> cookie: 76
2025-09-30T14:51:01.892030Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 148  requestId: <none> cookie: 77
2025-09-30T14:51:01.892057Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892062Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892066Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892069Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892074Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892079Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.900514Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 148 to 148
2025-09-30T14:51:01.892099Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 34 Result { Offset: 33 Data: "... 3713 bytes ..." SourceId: "\000src_id" SeqNo: 34 WriteTimestampMS: 1759243861888 CreateTimestampMS: 1759243861877 UncompressedSize: 3641 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 20 RealReadOffset: 33 WaitQuotaTimeMs: 0 EndOffset: 34 StartOffset: 0 } Cookie: 33 }
2025-09-30T14:51:01.892123Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.900524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.892129Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 6 from offset 34
2025-09-30T14:51:01.900527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 148
2025-09-30T14:51:01.892130Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892137Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892137Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 34 ReadOffset 34 ReadGuid 30c0b523-fde0edaf-26d2df45-fa81a437 has messages 1
2025-09-30T14:51:01.892142Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892147Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892154Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892155Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892156Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892160Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 149 size 8003 offset: -1
2025-09-30T14:51:01.892165Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892166Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892169Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 150 size 8113 offset: -1
2025-09-30T14:51:01.892173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892175Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892178Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 151 size 8223 offset: -1
2025-09-30T14:51:01.892181Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892186Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 152 size 8333 offset: -1
2025-09-30T14:51:01.892189Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.900591Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 149 to 149
2025-09-30T14:51:01.892191Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892194Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 153 size 8443 offset: -1
2025-09-30T14:51:01.900599Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.892199Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.900602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 149
2025-09-30T14:51:01.892201Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892205Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892205Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 30c0b523-fde0edaf-26d2df45-fa81a437, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 3806
2025-09-30T14:51:01.892206Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892210Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892211Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892214Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.900627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 150 to 150
2025-09-30T14:51:01.900644Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.900647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 150
2025-09-30T14:51:01.892215Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 30c0b523-fde0edaf-26d2df45-fa81a437
2025-09-30T14:51:01.892216Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892220Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
>>> event from dataHandler: 2025-09-30T14:51:01.892223Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892226Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892231Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892235Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892238Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892243Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892256Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 154  requestId: <none> cookie: 78
2025-09-30T14:51:01.892259Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 155  requestId: <none> cookie: 79
2025-09-30T14:51:01.892261Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 156  requestId: <none> cookie: 80
2025-09-30T14:51:01.892264Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 157  requestId: <none> cookie: 81
2025-09-30T14:51:01.892266Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 158  requestId: <none> cookie: 82
2025-09-30T14:51:01.892272Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892280Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892286Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892289Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892292Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892293Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.892295Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892378Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892384Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892391Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892394Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892395Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892399Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..3751 bytes.. Information: { Offset: 34 ProducerId: "src_id" SeqNo: 35 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3861 bytes.. Information: { Offset: 35 ProducerId: "src_id" SeqNo: 36 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..3971 bytes.. Information: { Offset: 36 ProducerId: "src_id" SeqNo: 37 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4081 bytes.. Information: { Offset: 37 ProducerId: "src_id" SeqNo: 38 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4191 bytes.. Information: { Offset: 38 ProducerId: "src_id" SeqNo: 39 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4301 bytes.. Information: { Offset: 39 ProducerId: "src_id" SeqNo: 40 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4411 bytes.. Information: { Offset: 40 ProducerId: "src_id" SeqNo: 41 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4521 bytes.. Information: { Offset: 41 ProducerId: "src_id" SeqNo: 42 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4631 bytes.. Information: { Offset: 42 ProducerId: "src_id" SeqNo: 43 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4741 bytes.. Information: { Offset: 43 ProducerId: "src_id" SeqNo: 44 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4851 bytes.. Information: { Offset: 44 ProducerId: "src_id" SeqNo: 45 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..4961 bytes.. Information: { Offset: 45 ProducerId: "src_id" SeqNo: 46 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5071 bytes.. Information: { Offset: 46 ProducerId: "src_id" SeqNo: 47 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5181 bytes.. Information: { Offset: 47 ProducerId: "src_id" SeqNo: 48 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5291 bytes.. Information: { Offset: 48 ProducerId: "src_id" SeqNo: 49 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5401 bytes.. Information: { Offset: 49 ProducerId: "src_id" SeqNo: 50 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5511 bytes.. Information: { Offset: 50 ProducerId: "src_id" SeqNo: 51 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5621 bytes.. Information: { Offset: 51 ProducerId: "src_id" SeqNo: 52 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5731 bytes.. Information: { Offset: 52 ProducerId: "src_id" SeqNo: 53 CreateTime: 2025-09-30T14:51:01.877000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5841 bytes.. Information: { Offset: 53 ProducerId: "src_id" SeqNo: 54 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..5951 bytes.. Information: { Offset: 54 ProducerId: "src_id" SeqNo: 55 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6061 bytes.. Information: { Offset: 55 ProducerId: "src_id" SeqNo: 56 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6171 bytes.. Information: { Offset: 56 ProducerId: "src_id" SeqNo: 57 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6281 bytes.. Information: { Offset: 57 ProducerId: "src_id" SeqNo: 58 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6391 bytes.. Information: { Offset: 58 ProducerId: "src_id" SeqNo: 59 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6501 bytes.. Information: { Offset: 59 ProducerId: "src_id" SeqNo: 60 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6611 bytes.. Information: { Offset: 60 ProducerId: "src_id" SeqNo: 61 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6721 bytes.. Information: { Offset: 61 ProducerId: "src_id" SeqNo: 62 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6831 bytes.. Information: { Offset: 62 ProducerId: "src_id" SeqNo: 63 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..6941 bytes.. Information: { Offset: 63 ProducerId: "src_id" SeqNo: 64 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7051 bytes.. Information: { Offset: 64 ProducerId: "src_id" SeqNo: 65 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.890000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.900867Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 151 to 151
2025-09-30T14:51:01.892399Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.901010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.892404Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.901018Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 151
2025-09-30T14:51:01.892409Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 159 size 8553 offset: -1
2025-09-30T14:51:01.892415Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892417Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892421Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 160 size 8663 offset: -1
2025-09-30T14:51:01.892424Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892426Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892429Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 161 size 8773 offset: -1
2025-09-30T14:51:01.892433Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892439Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 162 size 8883 offset: -1
2025-09-30T14:51:01.892442Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892444Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892447Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 163 size 8993 offset: -1
2025-09-30T14:51:01.892449Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892453Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892464Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892469Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892474Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892479Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892480Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892485Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892489Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892491Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892494Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892495Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892496Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892500Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892503Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892520Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 164  requestId: <none> cookie: 83
2025-09-30T14:51:01.892525Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 165  requestId: <none> cookie: 84
2025-09-30T14:51:01.892529Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 166  requestId: <none> cookie: 85
2025-09-30T14:51:01.892532Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892534Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 167  requestId: <none> cookie: 86
2025-09-30T14:51:01.892536Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892536Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 168  requestId: <none> cookie: 87
2025-09-30T14:51:01.892551Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892574Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892577Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892582Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892582Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 169 size 9103 offset: -1
2025-09-30T14:51:01.892585Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892587Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892591Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892593Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892595Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892598Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892598Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 170 size 9213 offset: -1
2025-09-30T14:51:01.892602Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892602Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892604Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892607Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 171 size 9323 offset: -1
2025-09-30T14:51:01.892609Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892611Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892616Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892618Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892621Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 172 size 9433 offset: -1
2025-09-30T14:51:01.892624Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892626Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892629Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 173 size 9543 offset: -1
2025-09-30T14:51:01.892633Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892640Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892642Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892644Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892646Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892651Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892653Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892658Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892658Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 174  requestId: <none> cookie: 88
2025-09-30T14:51:01.892664Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892665Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892669Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892670Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892674Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892675Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892680Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892681Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892681Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892687Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892688Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 175  requestId: <none> cookie: 89
2025-09-30T14:51:01.892690Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892690Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 176  requestId: <none> cookie: 90
2025-09-30T14:51:01.892693Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 177  requestId: <none> cookie: 91
2025-09-30T14:51:01.892696Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 178  requestId: <none> cookie: 92
2025-09-30T14:51:01.892711Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892713Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892714Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892717Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 179 size 9653 offset: -1
2025-09-30T14:51:01.892718Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892720Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892723Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892726Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892726Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892728Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892730Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892733Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 180  requestId: <none> cookie: 93
2025-09-30T14:51:01.892738Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892740Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892744Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 181 size 9763 offset: -1
2025-09-30T14:51:01.892748Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892750Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892753Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 182 size 9873 offset: -1
2025-09-30T14:51:01.892757Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892759Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892760Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892762Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 183 size 9983 offset: -1
2025-09-30T14:51:01.892766Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892766Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.892769Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892770Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892772Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 184 size 10093 offset: -1
2025-09-30T14:51:01.892775Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892776Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892780Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892780Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892785Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892787Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892792Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.892801Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892806Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892808Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892811Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892814Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892818Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 186 size 10203 offset: -1
2025-09-30T14:51:01.892822Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892824Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892827Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892828Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892829Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892833Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892836Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892890Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892955Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.892975Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.892978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.892981Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.892984Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.892992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 185  requestId: <none> cookie: 94
2025-09-30T14:51:01.892997Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 187  requestId: <none> cookie: 95
2025-09-30T14:51:01.892998Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893000Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 188  requestId: <none> cookie: 96
2025-09-30T14:51:01.893003Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893004Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 189  requestId: <none> cookie: 97
2025-09-30T14:51:01.893006Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893006Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 190  requestId: <none> cookie: 98
2025-09-30T14:51:01.893011Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893015Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893017Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893019Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893022Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 191 size 10313 offset: -1
2025-09-30T14:51:01.893025Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893031Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893033Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893037Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 192 size 10423 offset: -1
2025-09-30T14:51:01.893039Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893050Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893053Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893066Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893075Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893081Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893084Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893085Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893087Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893090Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893092Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 193 size 10533 offset: -1
2025-09-30T14:51:01.893097Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893098Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893103Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 194 size 10643 offset: -1
2025-09-30T14:51:01.893107Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893112Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893116Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 195 size 10753 offset: -1
2025-09-30T14:51:01.893120Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893122Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893125Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893125Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893127Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893130Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893135Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893137Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893140Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893145Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893151Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893153Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893157Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893159Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893167Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 196  requestId: <none> cookie: 99
2025-09-30T14:51:01.893172Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 197  requestId: <none> cookie: 100
2025-09-30T14:51:01.893177Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 198  requestId: <none> cookie: 101
2025-09-30T14:51:01.893178Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893180Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 199  requestId: <none> cookie: 102
2025-09-30T14:51:01.893182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 200  requestId: <none> cookie: 103
2025-09-30T14:51:01.893186Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893188Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893189Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893193Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 201 size 10863 offset: -1
2025-09-30T14:51:01.893194Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893196Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893197Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893198Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893201Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 202 size 10973 offset: -1
2025-09-30T14:51:01.893204Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893204Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893210Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893211Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893212Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893215Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893217Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893217Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893221Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 101 partNo : 0 messageNo: 204 size 11083 offset: -1
2025-09-30T14:51:01.893221Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893225Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893226Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893231Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893233Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 102 partNo : 0 messageNo: 205 size 11193 offset: -1
2025-09-30T14:51:01.893241Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893243Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893247Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 103 partNo : 0 messageNo: 206 size 11303 offset: -1
2025-09-30T14:51:01.893251Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893253Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893256Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893261Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893263Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893265Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893269Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893274Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 203  requestId: <none> cookie: 104
2025-09-30T14:51:01.893280Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 207  requestId: <none> cookie: 105
2025-09-30T14:51:01.893281Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893283Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 208  requestId: <none> cookie: 106
2025-09-30T14:51:01.893286Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893290Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893292Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893293Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893299Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893299Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893303Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893305Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893307Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893311Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 104 partNo : 0 messageNo: 211 size 11413 offset: -1
2025-09-30T14:51:01.893313Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893316Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893317Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893319Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893323Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 105 partNo : 0 messageNo: 212 size 11523 offset: -1
2025-09-30T14:51:01.893328Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893329Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893333Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 106 partNo : 0 messageNo: 213 size 11633 offset: -1
2025-09-30T14:51:01.893337Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893342Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 209  requestId: <none> cookie: 107
2025-09-30T14:51:01.893347Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893349Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893352Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893354Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893355Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893359Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893361Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893364Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 210  requestId: <none> cookie: 108
2025-09-30T14:51:01.893364Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893367Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893374Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893375Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893380Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893382Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893386Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 107 partNo : 0 messageNo: 217 size 11743 offset: -1
2025-09-30T14:51:01.893389Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 214  requestId: <none> cookie: 109
2025-09-30T14:51:01.893394Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 215  requestId: <none> cookie: 110
2025-09-30T14:51:01.893396Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893398Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893403Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 216  requestId: <none> cookie: 111
2025-09-30T14:51:01.893403Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893408Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893414Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.893421Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893423Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893430Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893436Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893448Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893450Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893453Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893455Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893460Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 108 partNo : 0 messageNo: 219 size 11853 offset: -1
2025-09-30T14:51:01.893463Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893466Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893470Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 109 partNo : 0 messageNo: 220 size 11963 offset: -1
2025-09-30T14:51:01.893473Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893475Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893480Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 110 partNo : 0 messageNo: 221 size 12073 offset: -1
2025-09-30T14:51:01.893493Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 34 count 31 size 170067 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.893494Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.893501Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893510Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.893513Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.893517Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 111 partNo : 0 messageNo: 222 size 12183 offset: -1
2025-09-30T14:51:01.893523Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893525Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 31 parts 0 suffix '63' size 170067
2025-09-30T14:51:01.893527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893529Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893533Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.893536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.893538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.893553Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893554Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 169880 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.893563Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893569Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-09-30T14:51:01.893573Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893577Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-09-30T14:51:01.893580Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893583Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-09-30T14:51:01.893585Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893588Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-09-30T14:51:01.893589Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893591Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893594Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-09-30T14:51:01.893596Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893600Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-09-30T14:51:01.893602Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893607Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-09-30T14:51:01.893609Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893612Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-09-30T14:51:01.893614Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893618Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-09-30T14:51:01.893618Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893619Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893625Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-09-30T14:51:01.893627Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893630Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-09-30T14:51:01.893632Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.901142Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 152 to 152
2025-09-30T14:51:01.893634Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-09-30T14:51:01.901079Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 31, size 167431 bytes
2025-09-30T14:51:01.893636Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893640Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-09-30T14:51:01.902563Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 432972, now ReadSizeBudget = 168649, ReadSizeServerDelta = -77333
2025-09-30T14:51:01.893642Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893645Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-09-30T14:51:01.893647Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893650Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-09-30T14:51:01.893651Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893654Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-09-30T14:51:01.906267Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.893657Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893658Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.906282Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 152
2025-09-30T14:51:01.893660Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-09-30T14:51:01.893662Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893667Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-09-30T14:51:01.893669Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893672Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-09-30T14:51:01.893675Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893678Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-09-30T14:51:01.893680Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893683Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-09-30T14:51:01.893684Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893687Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-09-30T14:51:01.906323Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 168649, ReadSizeServerDelta = -77333
2025-09-30T14:51:01.893689Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893692Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-09-30T14:51:01.893694Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893695Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893696Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-09-30T14:51:01.893698Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893702Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-09-30T14:51:01.893704Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893710Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-09-30T14:51:01.893713Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893717Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-09-30T14:51:01.893719Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893724Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-09-30T14:51:01.906374Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 91316
2025-09-30T14:51:01.893726Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893728Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893729Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-09-30T14:51:01.893731Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893736Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-09-30T14:51:01.893738Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.893741Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-09-30T14:51:01.893766Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.906404Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.893774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.906411Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 153 to 153
2025-09-30T14:51:01.893799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.893800Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 34 EndOffset 34 newEndOffset 65 commitOffset 0 clientCommitOffset 0 cookie 6 readingFinished 0 firstRead 0
2025-09-30T14:51:01.906420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.893801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (45)
2025-09-30T14:51:01.906424Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 153
2025-09-30T14:51:01.893803Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 34 endOffset 65
2025-09-30T14:51:01.893814Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 34, endOffset# 65, WTime# 1759243861888, sizeLag# 170067
2025-09-30T14:51:01.893816Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.893823Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-09-30T14:51:01.906436Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (65-109)
2025-09-30T14:51:01.893827Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 3f814d6a-9022d5a8-35c09165-fc0076fe, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 37, size# 204080, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.893838Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893851Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 7307 count 1 nextOffset 66 batches 1
2025-09-30T14:51:01.906452Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 432972 to budget
2025-09-30T14:51:01.893860Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-09-30T14:51:01.893864Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 14692 count 2 nextOffset 67 batches 1
2025-09-30T14:51:01.906461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 154 to 154
2025-09-30T14:51:01.893867Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-09-30T14:51:01.893869Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 37 maxSize 204080 maxTimeLagMs 0 readTimestampMs 0 readOffset 34 EndOffset 65 ClientCommitOffset 0 committedOffset 0 Guid 3f814d6a-9022d5a8-35c09165-fc0076fe
2025-09-30T14:51:01.893871Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 22187 count 3 nextOffset 68 batches 1
2025-09-30T14:51:01.906472Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (65-65)
2025-09-30T14:51:01.893874Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-09-30T14:51:01.906469Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.893879Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 29792 count 4 nextOffset 69 batches 1
2025-09-30T14:51:01.893882Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-09-30T14:51:01.906490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 154
2025-09-30T14:51:01.893883Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893886Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 37507 count 5 nextOffset 70 batches 1
2025-09-30T14:51:01.893889Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-09-30T14:51:01.906509Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (66-66)
2025-09-30T14:51:01.893892Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 45332 count 6 nextOffset 71 batches 1
2025-09-30T14:51:01.893895Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-09-30T14:51:01.893899Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 53267 count 7 nextOffset 72 batches 1
2025-09-30T14:51:01.893902Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-09-30T14:51:01.893907Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 61312 count 8 nextOffset 73 batches 1
2025-09-30T14:51:01.906527Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (67-67)
2025-09-30T14:51:01.906532Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (68-68)
2025-09-30T14:51:01.893910Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-09-30T14:51:01.893919Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 69467 count 9 nextOffset 74 batches 1
2025-09-30T14:51:01.893922Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-09-30T14:51:01.893925Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 77732 count 10 nextOffset 75 batches 1
2025-09-30T14:51:01.906547Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (69-69)
2025-09-30T14:51:01.893926Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893928Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-09-30T14:51:01.906552Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (70-70)
2025-09-30T14:51:01.893932Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 86107 count 11 nextOffset 76 batches 1
2025-09-30T14:51:01.906558Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (71-71)
2025-09-30T14:51:01.893934Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-09-30T14:51:01.906563Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (72-72)
2025-09-30T14:51:01.893939Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 94592 count 12 nextOffset 77 batches 1
2025-09-30T14:51:01.893942Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-09-30T14:51:01.893945Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 103187 count 13 nextOffset 78 batches 1
2025-09-30T14:51:01.893948Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-09-30T14:51:01.893952Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 111892 count 14 nextOffset 79 batches 1
2025-09-30T14:51:01.893955Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-09-30T14:51:01.893956Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.893958Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 120707 count 15 nextOffset 80 batches 1
2025-09-30T14:51:01.893961Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-09-30T14:51:01.906620Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (73-73)
2025-09-30T14:51:01.893965Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 129632 count 16 nextOffset 81 batches 1
2025-09-30T14:51:01.906625Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (74-74)
2025-09-30T14:51:01.893968Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-09-30T14:51:01.893972Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 138667 count 17 nextOffset 82 batches 1
2025-09-30T14:51:01.906631Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (75-75)
2025-09-30T14:51:01.893975Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-09-30T14:51:01.893978Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 147812 count 18 nextOffset 83 batches 1
2025-09-30T14:51:01.906638Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (76-76)
2025-09-30T14:51:01.893981Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-09-30T14:51:01.893985Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 157067 count 19 nextOffset 84 batches 1
2025-09-30T14:51:01.906647Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (77-77)
2025-09-30T14:51:01.906647Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 155 to 155
2025-09-30T14:51:01.893988Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-09-30T14:51:01.906685Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.906693Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 155
2025-09-30T14:51:01.893992Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 166432 count 20 nextOffset 85 batches 1
2025-09-30T14:51:01.893994Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-09-30T14:51:01.893998Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 175907 count 21 nextOffset 86 batches 1
2025-09-30T14:51:01.894001Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-09-30T14:51:01.906704Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (78-78)
2025-09-30T14:51:01.894005Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.894004Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 185492 count 22 nextOffset 87 batches 1
2025-09-30T14:51:01.894007Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-09-30T14:51:01.894011Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 195187 count 23 nextOffset 88 batches 1
2025-09-30T14:51:01.906718Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (79-79)
2025-09-30T14:51:01.894014Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-09-30T14:51:01.894018Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 204992 count 24 nextOffset 89 batches 1
2025-09-30T14:51:01.894021Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-09-30T14:51:01.894025Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 214907 count 25 nextOffset 90 batches 1
2025-09-30T14:51:01.894028Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-09-30T14:51:01.906735Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (80-80)
2025-09-30T14:51:01.894032Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 224932 count 26 nextOffset 91 batches 1
2025-09-30T14:51:01.894034Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-09-30T14:51:01.894040Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 235067 count 27 nextOffset 92 batches 1
2025-09-30T14:51:01.894043Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-09-30T14:51:01.894048Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 245312 count 28 nextOffset 93 batches 1
2025-09-30T14:51:01.894051Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-09-30T14:51:01.894055Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.894055Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 255667 count 29 nextOffset 94 batches 1
2025-09-30T14:51:01.894059Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-09-30T14:51:01.894063Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 266132 count 30 nextOffset 95 batches 1
2025-09-30T14:51:01.906768Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 156 to 156
2025-09-30T14:51:01.894066Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-09-30T14:51:01.894070Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 276707 count 31 nextOffset 96 batches 1
2025-09-30T14:51:01.906776Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.894073Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-09-30T14:51:01.906779Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 156
2025-09-30T14:51:01.894077Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 287392 count 32 nextOffset 97 batches 1
2025-09-30T14:51:01.894080Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-09-30T14:51:01.894087Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 298187 count 33 nextOffset 98 batches 1
2025-09-30T14:51:01.894089Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.894090Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-09-30T14:51:01.894094Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 309092 count 34 nextOffset 99 batches 1
2025-09-30T14:51:01.894097Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-09-30T14:51:01.894101Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 320107 count 35 nextOffset 100 batches 1
2025-09-30T14:51:01.894104Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 101 partNo 0
2025-09-30T14:51:01.894109Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 101 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 331232 count 36 nextOffset 101 batches 1
2025-09-30T14:51:01.894112Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 102 partNo 0
2025-09-30T14:51:01.894115Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 102 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 342467 count 37 nextOffset 102 batches 1
2025-09-30T14:51:01.894118Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 103 partNo 0
2025-09-30T14:51:01.894122Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 103 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 353812 count 38 nextOffset 103 batches 1
2025-09-30T14:51:01.894123Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.894125Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 104 partNo 0
2025-09-30T14:51:01.894128Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 104 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 365267 count 39 nextOffset 104 batches 1
2025-09-30T14:51:01.894132Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 105 partNo 0
2025-09-30T14:51:01.894136Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 105 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 376832 count 40 nextOffset 105 batches 1
2025-09-30T14:51:01.894140Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 106 partNo 0
2025-09-30T14:51:01.894143Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 106 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 388507 count 41 nextOffset 106 batches 1
2025-09-30T14:51:01.906846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 157 to 157
2025-09-30T14:51:01.906853Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (81-81)
2025-09-30T14:51:01.906856Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.906860Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (82-82)
2025-09-30T14:51:01.906861Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 157
2025-09-30T14:51:01.894147Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 107 partNo 0
2025-09-30T14:51:01.906865Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (83-83)
2025-09-30T14:51:01.894150Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 107 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 400292 count 42 nextOffset 107 batches 1
2025-09-30T14:51:01.906870Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (84-84)
2025-09-30T14:51:01.894154Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 108 partNo 0
2025-09-30T14:51:01.894157Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 108 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 412187 count 43 nextOffset 108 batches 1
2025-09-30T14:51:01.894161Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 109 partNo 0
2025-09-30T14:51:01.894165Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.894166Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 109 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 424192 count 44 nextOffset 109 batches 1
2025-09-30T14:51:01.906886Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 20} (85-85)
2025-09-30T14:51:01.894169Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 110 partNo 0
2025-09-30T14:51:01.894173Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 110 partNo 0 FormedBlobsCount 0 NewHead: Offset 65 PartNo 0 PackedSize 436307 count 45 nextOffset 110 batches 1
2025-09-30T14:51:01.894176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.894818Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 65,45 HeadOffset 65 endOffset 65 curOffset 110 d0000000000_00000000000000000065_00000_0000000045_00000? size 434929 WTime 1759243861894
2025-09-30T14:51:01.906899Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 21} (86-86)
2025-09-30T14:51:01.895195Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.895197Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.895199Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.895201Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.906910Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 22} (87-87)
2025-09-30T14:51:01.895203Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.906914Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 158 to 158
2025-09-30T14:51:01.895205Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.895209Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 6 keys were taken away. Let's read 235278 bytes (235278)
2025-09-30T14:51:01.906920Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.895214Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 6, size 235278 (8388608)
2025-09-30T14:51:01.906922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 158
2025-09-30T14:51:01.906925Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (88-88)
2025-09-30T14:51:01.895228Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.895233Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.895329Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.906941Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (89-89)
2025-09-30T14:51:01.895331Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.895337Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.895340Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.895349Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.895351Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.906957Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (90-90)
2025-09-30T14:51:01.895355Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.895365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.895373Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 218  requestId: <none> cookie: 112
2025-09-30T14:51:01.895391Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 72  requestId: <none> cookie: 35
2025-09-30T14:51:01.895399Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 74  requestId: <none> cookie: 36
2025-09-30T14:51:01.895404Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 75  requestId: <none> cookie: 37
2025-09-30T14:51:01.906977Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (91-91)
2025-09-30T14:51:01.895408Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895410Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 76  requestId: <none> cookie: 38
2025-09-30T14:51:01.895415Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 81  requestId: <none> cookie: 39
2025-09-30T14:51:01.906986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 159 to 159
2025-09-30T14:51:01.895419Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.906988Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (92-92)
2025-09-30T14:51:01.895425Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.906992Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.895425Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 82  requestId: <none> cookie: 40
2025-09-30T14:51:01.906996Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 159
2025-09-30T14:51:01.906998Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (93-93)
2025-09-30T14:51:01.895429Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895432Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 83  requestId: <none> cookie: 41
2025-09-30T14:51:01.907015Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (94-94)
2025-09-30T14:51:01.895433Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895437Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 84  requestId: <none> cookie: 42
2025-09-30T14:51:01.895443Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 85  requestId: <none> cookie: 43
2025-09-30T14:51:01.895450Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 90  requestId: <none> cookie: 44
2025-09-30T14:51:01.895455Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 91  requestId: <none> cookie: 45
2025-09-30T14:51:01.895459Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 92  requestId: <none> cookie: 46
2025-09-30T14:51:01.895461Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895464Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 93  requestId: <none> cookie: 47
2025-09-30T14:51:01.907037Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 160 to 160
2025-09-30T14:51:01.907038Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (95-95)
2025-09-30T14:51:01.895467Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.907043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.895471Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 96  requestId: <none> cookie: 48
2025-09-30T14:51:01.907046Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 160
2025-09-30T14:51:01.895473Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.907050Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (96-96)
2025-09-30T14:51:01.895476Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 97  requestId: <none> cookie: 49
2025-09-30T14:51:01.895477Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895481Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895481Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 102  requestId: <none> cookie: 50
2025-09-30T14:51:01.895485Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.895486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 103  requestId: <none> cookie: 51
2025-09-30T14:51:01.895492Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 104  requestId: <none> cookie: 52
2025-09-30T14:51:01.895497Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 106  requestId: <none> cookie: 53
2025-09-30T14:51:01.895498Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.907085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 161 to 161
2025-09-30T14:51:01.895502Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.907090Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.895502Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 107  requestId: <none> cookie: 54
2025-09-30T14:51:01.907261Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 9} (97-97)
2025-09-30T14:51:01.912084Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 161
2025-09-30T14:51:01.909086Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 336798, now ReadSizeBudget = 432972, ReadSizeServerDelta = -245482
2025-09-30T14:51:01.895505Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895510Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 110  requestId: <none> cookie: 55
2025-09-30T14:51:01.912124Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 10} (98-98)
2025-09-30T14:51:01.912134Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 11} (99-99)
2025-09-30T14:51:01.895515Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 113  requestId: <none> cookie: 56
2025-09-30T14:51:01.895521Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 114  requestId: <none> cookie: 57
2025-09-30T14:51:01.912142Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 12} (100-100)
2025-09-30T14:51:01.895526Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 117  requestId: <none> cookie: 58
2025-09-30T14:51:01.895531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 118  requestId: <none> cookie: 59
2025-09-30T14:51:01.912149Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 13} (101-101)
2025-09-30T14:51:01.895536Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 119  requestId: <none> cookie: 60
2025-09-30T14:51:01.895540Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 122  requestId: <none> cookie: 61
2025-09-30T14:51:01.895545Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 123  requestId: <none> cookie: 62
2025-09-30T14:51:01.895552Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 127  requestId: <none> cookie: 63
2025-09-30T14:51:01.912155Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 14} (102-102)
2025-09-30T14:51:01.895556Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 128  requestId: <none> cookie: 64
2025-09-30T14:51:01.912182Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 15} (103-103)
2025-09-30T14:51:01.895561Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 130  requestId: <none> cookie: 65
2025-09-30T14:51:01.895573Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.895576Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.895587Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.895601Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 65 partNo 0 count 45 size 434929
2025-09-30T14:51:01.912201Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 16} (104-104)
2025-09-30T14:51:01.895616Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 162 to 162
2025-09-30T14:51:01.895618Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.895630Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 112 partNo : 0 messageNo: 227 size 12293 offset: -1
2025-09-30T14:51:01.895668Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912218Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 17} (105-105)
2025-09-30T14:51:01.895677Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 223  requestId: <none> cookie: 113
2025-09-30T14:51:01.895681Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 224  requestId: <none> cookie: 114
2025-09-30T14:51:01.912224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.895684Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 225  requestId: <none> cookie: 115
2025-09-30T14:51:01.912227Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 162
2025-09-30T14:51:01.895687Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 226  requestId: <none> cookie: 116
2025-09-30T14:51:01.895690Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.912236Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 18} (106-106)
2025-09-30T14:51:01.895701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.895718Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895730Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895736Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895742Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 9 Topic 'rt3.dc1--test-topic' partition 0 user user offset 34 count 37 size 204080 endOffset 65 max time lag 0ms effective offset 34
2025-09-30T14:51:01.895750Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912255Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 19} (107-107)
2025-09-30T14:51:01.895757Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 9 added 1 blobs, size 170067 count 31 last offset 34, current partition end offset: 65
2025-09-30T14:51:01.895761Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 9. Send blob request.
2025-09-30T14:51:01.895762Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895766Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895774Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912272Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 163 to 163
2025-09-30T14:51:01.895774Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 34 partno 0 count 31 parts_count 0 source 1 size 170067 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.912277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.895778Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 9. All 1 blobs are from cache.
2025-09-30T14:51:01.895785Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912286Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 163
2025-09-30T14:51:01.912277Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 20} (108-108)
2025-09-30T14:51:01.895785Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.895787Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.895789Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912304Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 21} (109-109)
2025-09-30T14:51:01.895792Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895794Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 34 partno 0 count 31 parts 0 suffix '63'
2025-09-30T14:51:01.895796Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895796Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.895799Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895803Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912325Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 164 to 164
2025-09-30T14:51:01.895807Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895810Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.895814Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912333Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 164
2025-09-30T14:51:01.895818Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895821Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895834Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895838Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895844Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895848Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.895943Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 34 totakecount 31 count 31 size 170045 from pos 0 cbcount 31
2025-09-30T14:51:01.895994Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.895996Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896003Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.896004Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 113 partNo : 0 messageNo: 229 size 12403 offset: -1
2025-09-30T14:51:01.896008Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896010Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896011Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.896014Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 114 partNo : 0 messageNo: 230 size 12513 offset: -1
2025-09-30T14:51:01.896017Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.896018Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896019Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912402Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (110-134)
2025-09-30T14:51:01.896022Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.896023Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 115 partNo : 0 messageNo: 231 size 12623 offset: -1
2025-09-30T14:51:01.896027Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896030Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912424Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 336798 to budget
2025-09-30T14:51:01.896035Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 116 partNo : 0 messageNo: 232 size 12733 offset: -1
2025-09-30T14:51:01.912439Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 769770, ReadSizeServerDelta = -245482
2025-09-30T14:51:01.896050Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 34
2025-09-30T14:51:01.896082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 228  requestId: <none> cookie: 117
2025-09-30T14:51:01.912407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 165 to 165
2025-09-30T14:51:01.896087Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.912457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.912464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 165
2025-09-30T14:51:01.896092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.896093Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.896096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.896098Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.896101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.896103Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.896105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.896108Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912489Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:01.896109Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896115Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896117Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896122Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896124Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896127Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896129Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896182Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 233  requestId: <none> cookie: 118
2025-09-30T14:51:01.896185Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 234  requestId: <none> cookie: 119
2025-09-30T14:51:01.896189Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 235  requestId: <none> cookie: 120
2025-09-30T14:51:01.912523Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 166 to 166
2025-09-30T14:51:01.896192Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 236  requestId: <none> cookie: 121
2025-09-30T14:51:01.912527Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (110-110)
2025-09-30T14:51:01.896201Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.896209Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912528Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.896215Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912541Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 166
2025-09-30T14:51:01.896219Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.896222Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.896248Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.896257Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.896263Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.896268Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.896275Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.912573Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (111-111)
2025-09-30T14:51:01.912590Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 167 to 167
2025-09-30T14:51:01.912595Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.912598Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 167
2025-09-30T14:51:01.896495Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 65 Result { Offset: 34 Data: "... 3823 bytes ..." SourceId: "\000src_id" SeqNo: 35 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 3751 PartitionKey: "" ExplicitHash: "" } Result { Offset: 35 Data: "... 3933 bytes ..." SourceId: "\000src_id" SeqNo: 36 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 3861 PartitionKey: "" ExplicitHash: "" } Result { Offset: 36 Data: "... 4043 bytes ..." SourceId: "\000src_id" SeqNo: 37 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 3971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 37 Data: "... 4153 bytes ..." SourceId: "\000src_id" SeqNo: 38 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 4081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 38 Data: "... 4263 bytes ..." SourceId: "\000src_id" SeqNo: 39 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 4191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 39 Data: "... 4373 bytes ..." SourceId: "\000src_id" SeqNo: 40 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 4301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 40 Data: "... 4483 bytes ..." SourceId: "\000src_id" SeqNo: 41 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 4411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 41 Data: "... 4593 bytes ..." SourceId: "\000src_id" SeqNo: 42 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 4521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 42 Data: "... 4703 bytes ..." SourceId: "\000src_id" SeqNo: 43 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 4631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 43 Data: "... 4813 bytes ..." SourceId: "\000src_id" SeqNo: 44 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 4741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 44 Data: "... 4923 bytes ..." SourceId: "\000src_id" SeqNo: 45 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 4851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 45 Data: "... 5033 bytes ..." SourceId: "\000src_id" SeqNo: 46 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 4961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 46 Data: "... 5143 bytes ..." SourceId: "\000src_id" SeqNo: 47 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 5071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 47 Data: "... 5253 bytes ..." SourceId: "\000src_id" SeqNo: 48 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 5181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 48 Data: "... 5363 bytes ..." SourceId: "\000src_id" SeqNo: 49 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 5291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 49 Data: "... 5473 bytes ..." SourceId: "\000src_id" SeqNo: 50 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 5401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 50 Data: "... 5583 bytes ..." SourceId: "\000src_id" SeqNo: 51 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 5511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 51 Data: "... 5693 bytes ..." SourceId: "\000src_id" SeqNo: 52 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 5621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 52 Data: "... 5803 bytes ..." SourceId: "\000src_id" SeqNo: 53 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861877 UncompressedSize: 5731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 53 Data: "... 5913 bytes ..." SourceId: "\000src_id" SeqNo: 54 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861878 UncompressedSize: 5841 PartitionKey: "" ExplicitHash: "" } Result { Offset: 54 Data: "... 6023 bytes ..." SourceId: "\000src_id" SeqNo: 55 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861878 UncompressedSize: 5951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 55 Data: "... 6133 bytes ..." SourceId: "\000src_id" SeqNo: 56 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861878 UncompressedSize: 6061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 56 Data: "... 6243 bytes ..." SourceId: "\000src_id" SeqNo: 57 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861878 UncompressedSize: 6171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 57 Data: "... 6353 bytes ..." SourceId: "\000src_id" SeqNo: 58 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861878 UncompressedSize: 6281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 58 Data: "... 6463 bytes ..." SourceId: "\000src_id" SeqNo: 59 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861878 UncompressedSize: 6391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 59 Data: "... 6573 bytes ..." SourceId: "\000src_id" SeqNo: 60 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861878 UncompressedSize: 6501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 60 Data: "... 6683 bytes ..." SourceId: "\000src_id" SeqNo: 61 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861878 UncompressedSize: 6611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 61 Data: "... 6793 bytes ..." SourceId: "\000src_id" SeqNo: 62 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861878 UncompressedSize: 6721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 62 Data: "... 6903 bytes ..." SourceId: "\000src_id" SeqNo: 63 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861878 UncompressedSize: 6831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 63 Data: "... 7013 bytes ..." SourceId: "\000src_id" SeqNo: 64 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861878 UncompressedSize: 6941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 64 Data: "... 7123 bytes ..." SourceId: "\000src_id" SeqNo: 65 WriteTimestampMS: 1759243861890 CreateTimestampMS: 1759243861878 UncompressedSize: 7051 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709550718 RealReadOffset: 64 WaitQuotaTimeMs: 0 EndOffset: 65 StartOffset: 0 } Cookie: 34 }
2025-09-30T14:51:01.912612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 168 to 168
2025-09-30T14:51:01.896676Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 7 from offset 65
2025-09-30T14:51:01.912621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.912624Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 168
2025-09-30T14:51:01.896685Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 65 ReadOffset 65 ReadGuid 3f814d6a-9022d5a8-35c09165-fc0076fe has messages 1
2025-09-30T14:51:01.896715Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896718Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896727Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 117 partNo : 0 messageNo: 237 size 12843 offset: -1
2025-09-30T14:51:01.896732Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912638Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (112-112)
2025-09-30T14:51:01.896734Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896738Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 118 partNo : 0 messageNo: 238 size 12953 offset: -1
2025-09-30T14:51:01.912646Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (113-113)
2025-09-30T14:51:01.896741Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896743Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896746Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 119 partNo : 0 messageNo: 239 size 13063 offset: -1
2025-09-30T14:51:01.896750Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896751Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896755Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 120 partNo : 0 messageNo: 240 size 13173 offset: -1
2025-09-30T14:51:01.896759Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896760Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896766Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 121 partNo : 0 messageNo: 241 size 13283 offset: -1
2025-09-30T14:51:01.896769Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896771Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896776Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896778Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896781Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896783Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.896786Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896788Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912695Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (114-114)
2025-09-30T14:51:01.896792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.896794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912704Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (115-115)
2025-09-30T14:51:01.896798Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.896803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.912710Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (116-116)
2025-09-30T14:51:01.896807Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.896810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.896811Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.912716Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (117-117)
2025-09-30T14:51:01.896813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.896815Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.896817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.896819Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.896822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.896837Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 242  requestId: <none> cookie: 122
2025-09-30T14:51:01.896841Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 243  requestId: <none> cookie: 123
2025-09-30T14:51:01.896844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 244  requestId: <none> cookie: 124
2025-09-30T14:51:01.896847Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 245  requestId: <none> cookie: 125
2025-09-30T14:51:01.896849Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 246  requestId: <none> cookie: 126
2025-09-30T14:51:01.896863Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.896869Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.896873Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.896879Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.896883Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.896904Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.896911Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.896915Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.896920Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.896925Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.912787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 169 to 169
2025-09-30T14:51:01.896952Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 3f814d6a-9022d5a8-35c09165-fc0076fe, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 168649
2025-09-30T14:51:01.896964Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 3f814d6a-9022d5a8-35c09165-fc0076fe
2025-09-30T14:51:01.912809Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.897193Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.912818Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 169
2025-09-30T14:51:01.897338Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897342Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897351Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 122 partNo : 0 messageNo: 247 size 13393 offset: -1
2025-09-30T14:51:01.897356Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897358Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897362Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 123 partNo : 0 messageNo: 248 size 13503 offset: -1
2025-09-30T14:51:01.897365Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897367Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897371Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 124 partNo : 0 messageNo: 249 size 13613 offset: -1
2025-09-30T14:51:01.897374Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897376Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897381Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 125 partNo : 0 messageNo: 250 size 13723 offset: -1
2025-09-30T14:51:01.897384Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912874Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (118-118)
2025-09-30T14:51:01.912879Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 170 to 170
2025-09-30T14:51:01.912885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.897385Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912889Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 170
2025-09-30T14:51:01.897392Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 126 partNo : 0 messageNo: 251 size 13833 offset: -1
2025-09-30T14:51:01.897397Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912890Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (119-119)
2025-09-30T14:51:01.897398Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897403Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912906Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (120-120)
2025-09-30T14:51:01.897404Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897407Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912912Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (121-121)
2025-09-30T14:51:01.897409Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897412Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912919Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (122-122)
2025-09-30T14:51:01.912926Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 171 to 171
2025-09-30T14:51:01.897414Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912930Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (123-123)
2025-09-30T14:51:01.897419Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897421Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.912937Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (124-124)
2025-09-30T14:51:01.897438Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.912946Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (125-125)
2025-09-30T14:51:01.897445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.897447Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.897449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.912940Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 171
2025-09-30T14:51:01.897450Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.897452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.897454Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.912968Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 172 to 172
2025-09-30T14:51:01.897456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.897458Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.897460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.897616Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 252  requestId: <none> cookie: 127
2025-09-30T14:51:01.912980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.912983Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 172
2025-09-30T14:51:01.897621Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 253  requestId: <none> cookie: 128
2025-09-30T14:51:01.912991Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 173 to 173
2025-09-30T14:51:01.897623Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 254  requestId: <none> cookie: 129
>>> event from dataHandler: 2025-09-30T14:51:01.912999Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.913004Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 173
2025-09-30T14:51:01.897626Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 255  requestId: <none> cookie: 130
2025-09-30T14:51:01.897629Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 256  requestId: <none> cookie: 131
2025-09-30T14:51:01.897644Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.897650Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.897655Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.897658Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.897662Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.897682Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.897693Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.897699Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.897705Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.897713Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897715Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897721Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 127 partNo : 0 messageNo: 257 size 13943 offset: -1
2025-09-30T14:51:01.897724Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897727Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897731Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 128 partNo : 0 messageNo: 258 size 14054 offset: -1
2025-09-30T14:51:01.897734Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897736Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897740Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 129 partNo : 0 messageNo: 259 size 14164 offset: -1
2025-09-30T14:51:01.897743Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897745Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897749Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 130 partNo : 0 messageNo: 260 size 14274 offset: -1
2025-09-30T14:51:01.897752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897754Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897758Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 131 partNo : 0 messageNo: 261 size 14384 offset: -1
2025-09-30T14:51:01.897762Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897764Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 174 to 174
2025-09-30T14:51:01.897767Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897770Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.913118Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 174
2025-09-30T14:51:01.897773Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897777Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 175 to 175
2025-09-30T14:51:01.897780Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.913135Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (126-126)
2025-09-30T14:51:01.913140Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.913143Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 175
2025-09-30T14:51:01.897782Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913150Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 17} (127-127)
2025-09-30T14:51:01.897785Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.897788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.897790Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.913158Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 18} (128-128)
2025-09-30T14:51:01.897793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.897794Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.913166Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 19} (129-129)
2025-09-30T14:51:01.897797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.897798Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.897801Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.913174Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 20} (130-130)
2025-09-30T14:51:01.897802Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.897804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.897811Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 262  requestId: <none> cookie: 132
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..7161 bytes.. Information: { Offset: 65 ProducerId: "src_id" SeqNo: 66 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7271 bytes.. Information: { Offset: 66 ProducerId: "src_id" SeqNo: 67 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7381 bytes.. Information: { Offset: 67 ProducerId: "src_id" SeqNo: 68 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7491 bytes.. Information: { Offset: 68 ProducerId: "src_id" SeqNo: 69 CreateTime: 2025-09-30T14:51:01.878000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7601 bytes.. Information: { Offset: 69 ProducerId: "src_id" SeqNo: 70 CreateTime: 2025-09-30T14:51:01.881000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7711 bytes.. Information: { Offset: 70 ProducerId: "src_id" SeqNo: 71 CreateTime: 2025-09-30T14:51:01.881000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7821 bytes.. Information: { Offset: 71 ProducerId: "src_id" SeqNo: 72 CreateTime: 2025-09-30T14:51:01.881000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..7931 bytes.. Information: { Offset: 72 ProducerId: "src_id" SeqNo: 73 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8041 bytes.. Information: { Offset: 73 ProducerId: "src_id" SeqNo: 74 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8151 bytes.. Information: { Offset: 74 ProducerId: "src_id" SeqNo: 75 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8261 bytes.. Information: { Offset: 75 ProducerId: "src_id" SeqNo: 76 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8371 bytes.. Information: { Offset: 76 ProducerId: "src_id" SeqNo: 77 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8481 bytes.. Information: { Offset: 77 ProducerId: "src_id" SeqNo: 78 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8591 bytes.. Information: { Offset: 78 ProducerId: "src_id" SeqNo: 79 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8701 bytes.. Information: { Offset: 79 ProducerId: "src_id" SeqNo: 80 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8811 bytes.. Information: { Offset: 80 ProducerId: "src_id" SeqNo: 81 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..8921 bytes.. Information: { Offset: 81 ProducerId: "src_id" SeqNo: 82 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9031 bytes.. Information: { Offset: 82 ProducerId: "src_id" SeqNo: 83 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9141 bytes.. Information: { Offset: 83 ProducerId: "src_id" SeqNo: 84 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9251 bytes.. Information: { Offset: 84 ProducerId: "src_id" SeqNo: 85 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9361 bytes.. Information: { Offset: 85 ProducerId: "src_id" SeqNo: 86 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9471 bytes.. Information: { Offset: 86 ProducerId: "src_id" SeqNo: 87 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9581 bytes.. Information: { Offset: 87 ProducerId: "src_id" SeqNo: 88 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.893000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9691 bytes.. Information: { Offset: 88 ProducerId: "src_id" SeqNo: 89 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9801 bytes.. Information: { Offset: 89 ProducerId: "src_id" SeqNo: 90 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..9911 bytes.. Information: { Offset: 90 ProducerId: "src_id" SeqNo: 91 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10021 bytes.. Information: { Offset: 91 ProducerId: "src_id" SeqNo: 92 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10131 bytes.. Information: { Offset: 92 ProducerId: "src_id" SeqNo: 93 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10241 bytes.. Information: { Offset: 93 ProducerId: "src_id" SeqNo: 94 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10351 bytes.. Information: { Offset: 94 ProducerId: "src_id" SeqNo: 95 CreateTime: 2025-09-30T14:51:01.882000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10461 bytes.. Information: { Offset: 95 ProducerId: "src_id" SeqNo: 96 CreateTime: 2025-09-30T14:51:01.886000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10571 bytes.. Information: { Offset: 96 ProducerId: "src_id" SeqNo: 97 CreateTime: 2025-09-30T14:51:01.886000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10681 bytes.. Information: { Offset: 97 ProducerId: "src_id" SeqNo: 98 CreateTime: 2025-09-30T14:51:01.886000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10791 bytes.. Information: { Offset: 98 ProducerId: "src_id" SeqNo: 99 CreateTime: 2025-09-30T14:51:01.886000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..10901 bytes.. Information: { Offset: 99 ProducerId: "src_id" SeqNo: 100 CreateTime: 2025-09-30T14:51:01.886000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11011 bytes.. Information: { Offset: 100 ProducerId: "src_id" SeqNo: 101 CreateTime: 2025-09-30T14:51:01.886000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11121 bytes.. Information: { Offset: 101 ProducerId: "src_id" SeqNo: 102 CreateTime: 2025-09-30T14:51:01.886000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11231 bytes.. Information: { Offset: 102 ProducerId: "src_id" SeqNo: 103 CreateTime: 2025-09-30T14:51:01.886000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11341 bytes.. Information: { Offset: 103 ProducerId: "src_id" SeqNo: 104 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11451 bytes.. Information: { Offset: 104 ProducerId: "src_id" SeqNo: 105 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11561 bytes.. Information: { Offset: 105 ProducerId: "src_id" SeqNo: 106 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11671 bytes.. Information: { Offset: 106 ProducerId: "src_id" SeqNo: 107 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11781 bytes.. Information: { Offset: 107 ProducerId: "src_id" SeqNo: 108 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..11891 bytes.. Information: { Offset: 108 ProducerId: "src_id" SeqNo: 109 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12001 bytes.. Information: { Offset: 109 ProducerId: "src_id" SeqNo: 110 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.894000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.897815Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 263  requestId: <none> cookie: 133
2025-09-30T14:51:01.913194Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 21} (131-131)
2025-09-30T14:51:01.897818Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 264  requestId: <none> cookie: 134
2025-09-30T14:51:01.897822Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 265  requestId: <none> cookie: 135
2025-09-30T14:51:01.913375Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 176 to 176
2025-09-30T14:51:01.917221Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 45, size 431145 bytes
2025-09-30T14:51:01.915540Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 302377, now ReadSizeBudget = 0, ReadSizeServerDelta = 221911
2025-09-30T14:51:01.917241Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 22} (132-132)
2025-09-30T14:51:01.897826Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917259Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 23} (133-133)
2025-09-30T14:51:01.917258Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.897830Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 176
2025-09-30T14:51:01.897833Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.897837Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.897847Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897849Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897854Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 132 partNo : 0 messageNo: 266 size 14494 offset: -1
2025-09-30T14:51:01.897857Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897859Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897862Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 133 partNo : 0 messageNo: 267 size 14604 offset: -1
2025-09-30T14:51:01.897865Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897867Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897871Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 134 partNo : 0 messageNo: 268 size 14714 offset: -1
2025-09-30T14:51:01.897874Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.897878Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.897881Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 135 partNo : 0 messageNo: 269 size 14824 offset: -1
2025-09-30T14:51:01.897884Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.897887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.897889Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.897891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.897893Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.897895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.897897Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.897899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.898207Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 65 count 45 size 434929 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.898220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.917275Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 24} (134-134)
2025-09-30T14:51:01.898234Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 65 partno 0 count 45 parts 0 suffix '63' size 434929
2025-09-30T14:51:01.898247Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 434700 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.898257Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898264Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-09-30T14:51:01.898269Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898272Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-09-30T14:51:01.898274Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898277Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-09-30T14:51:01.917409Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 177 to 177
2025-09-30T14:51:01.898281Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.898283Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-09-30T14:51:01.917422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 177
2025-09-30T14:51:01.898285Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898288Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-09-30T14:51:01.898291Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898295Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-09-30T14:51:01.898297Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898300Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-09-30T14:51:01.917440Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 221911
2025-09-30T14:51:01.898302Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 178 to 178
2025-09-30T14:51:01.898305Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-09-30T14:51:01.898308Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.898311Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-09-30T14:51:01.917456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 178
2025-09-30T14:51:01.898314Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898317Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-09-30T14:51:01.898319Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917465Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.898322Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-09-30T14:51:01.917469Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 221911
2025-09-30T14:51:01.898324Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898327Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-09-30T14:51:01.917475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 179 to 179
2025-09-30T14:51:01.898329Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898332Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-09-30T14:51:01.917483Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.898335Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917486Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 179
2025-09-30T14:51:01.917485Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (135-153)
2025-09-30T14:51:01.898339Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-09-30T14:51:01.898342Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898346Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-09-30T14:51:01.917504Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 302377 to budget
2025-09-30T14:51:01.898348Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898351Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-09-30T14:51:01.917512Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 302377, ReadSizeServerDelta = 221911
2025-09-30T14:51:01.898353Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898358Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-09-30T14:51:01.898359Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917525Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 180 to 180
2025-09-30T14:51:01.898363Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-09-30T14:51:01.898365Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917540Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.898368Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-09-30T14:51:01.917543Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 180
2025-09-30T14:51:01.898370Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898373Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-09-30T14:51:01.898375Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898379Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-09-30T14:51:01.917555Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:01.898381Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898385Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-09-30T14:51:01.898387Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-09-30T14:51:01.917573Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (135-135)
2025-09-30T14:51:01.898394Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898397Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-09-30T14:51:01.917565Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 121499, now ReadSizeBudget = 0, ReadSizeServerDelta = 402789
2025-09-30T14:51:01.917602Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 181 to 181
2025-09-30T14:51:01.917611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.917614Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 181
2025-09-30T14:51:01.917585Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (136-136)
2025-09-30T14:51:01.898400Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898404Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-09-30T14:51:01.917637Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 182 to 182
2025-09-30T14:51:01.917643Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (137-137)
2025-09-30T14:51:01.917645Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.917648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 182
2025-09-30T14:51:01.917651Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (138-138)
2025-09-30T14:51:01.898407Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898410Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-09-30T14:51:01.898412Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898415Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-09-30T14:51:01.898416Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898420Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-09-30T14:51:01.898422Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917680Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 183 to 183
2025-09-30T14:51:01.898425Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-09-30T14:51:01.898427Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898432Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-09-30T14:51:01.898434Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898438Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-09-30T14:51:01.898440Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898443Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-09-30T14:51:01.898446Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898451Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-09-30T14:51:01.917709Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.898452Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 183
2025-09-30T14:51:01.898456Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-09-30T14:51:01.898458Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898462Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-09-30T14:51:01.917720Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (139-139)
2025-09-30T14:51:01.898465Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898468Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 101, partNo: 0, Offset: 100 is stored on disk
2025-09-30T14:51:01.917728Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (140-140)
2025-09-30T14:51:01.898471Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898474Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 102, partNo: 0, Offset: 101 is stored on disk
2025-09-30T14:51:01.917735Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (141-141)
2025-09-30T14:51:01.898476Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898479Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 103, partNo: 0, Offset: 102 is stored on disk
2025-09-30T14:51:01.917742Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (142-142)
2025-09-30T14:51:01.917753Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 184 to 184
2025-09-30T14:51:01.898481Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898484Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 104, partNo: 0, Offset: 103 is stored on disk
2025-09-30T14:51:01.898486Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898489Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 105, partNo: 0, Offset: 104 is stored on disk
2025-09-30T14:51:01.898492Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898495Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 106, partNo: 0, Offset: 105 is stored on disk
2025-09-30T14:51:01.898498Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898501Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 107, partNo: 0, Offset: 106 is stored on disk
2025-09-30T14:51:01.898503Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898507Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 108, partNo: 0, Offset: 107 is stored on disk
2025-09-30T14:51:01.898509Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917798Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.917804Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 184
2025-09-30T14:51:01.898512Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 109, partNo: 0, Offset: 108 is stored on disk
2025-09-30T14:51:01.898515Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.898521Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 110, partNo: 0, Offset: 109 is stored on disk
2025-09-30T14:51:01.898562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.898579Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.898581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (25)
2025-09-30T14:51:01.898593Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 65 EndOffset 65 newEndOffset 110 commitOffset 0 clientCommitOffset 0 cookie 7 readingFinished 0 firstRead 0
2025-09-30T14:51:01.898618Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 111 partNo 0
2025-09-30T14:51:01.898621Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 65 endOffset 110
2025-09-30T14:51:01.898639Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 65, endOffset# 110, WTime# 1759243861890, sizeLag# 434929
2025-09-30T14:51:01.898641Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.917847Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (143-143)
2025-09-30T14:51:01.898646Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 111 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 12257 count 1 nextOffset 111 batches 1
>>> event from dataHandler: 2025-09-30T14:51:01.917855Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (144-144)
2025-09-30T14:51:01.917862Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 3} (145-145)
2025-09-30T14:51:01.898653Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 112 partNo 0
2025-09-30T14:51:01.917868Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 4} (146-146)
2025-09-30T14:51:01.898655Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 46646b6a-6474682a-46cca2f0-747a7db7, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 54, size# 348137, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.898657Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 112 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 24592 count 2 nextOffset 112 batches 1
2025-09-30T14:51:01.917874Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 5} (147-147)
2025-09-30T14:51:01.898661Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 113 partNo 0
2025-09-30T14:51:01.898670Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 113 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 37037 count 3 nextOffset 113 batches 1
2025-09-30T14:51:01.898672Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 114 partNo 0
2025-09-30T14:51:01.898676Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 114 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 49592 count 4 nextOffset 114 batches 1
2025-09-30T14:51:01.917887Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 185 to 185
2025-09-30T14:51:01.917895Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 6} (148-148)
2025-09-30T14:51:01.898680Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 54 maxSize 348137 maxTimeLagMs 0 readTimestampMs 0 readOffset 65 EndOffset 110 ClientCommitOffset 0 committedOffset 0 Guid 46646b6a-6474682a-46cca2f0-747a7db7
2025-09-30T14:51:01.898693Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 115 partNo 0
2025-09-30T14:51:01.898697Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 115 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 62257 count 5 nextOffset 115 batches 1
2025-09-30T14:51:01.898700Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 116 partNo 0
2025-09-30T14:51:01.917914Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 7} (149-149)
2025-09-30T14:51:01.898703Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 116 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 75032 count 6 nextOffset 116 batches 1
2025-09-30T14:51:01.898706Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 117 partNo 0
2025-09-30T14:51:01.898709Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 117 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 87917 count 7 nextOffset 117 batches 1
2025-09-30T14:51:01.898711Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 118 partNo 0
2025-09-30T14:51:01.917927Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.898715Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 118 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 100912 count 8 nextOffset 118 batches 1
2025-09-30T14:51:01.898717Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 119 partNo 0
2025-09-30T14:51:01.917933Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 185
2025-09-30T14:51:01.898722Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 119 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 114017 count 9 nextOffset 119 batches 1
2025-09-30T14:51:01.917936Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 8} (150-150)
2025-09-30T14:51:01.898725Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 120 partNo 0
2025-09-30T14:51:01.898728Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 120 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 127232 count 10 nextOffset 120 batches 1
2025-09-30T14:51:01.898731Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 121 partNo 0
2025-09-30T14:51:01.898734Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 121 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 140557 count 11 nextOffset 121 batches 1
2025-09-30T14:51:01.898737Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 122 partNo 0
2025-09-30T14:51:01.898739Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 122 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 153992 count 12 nextOffset 122 batches 1
2025-09-30T14:51:01.898742Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 123 partNo 0
2025-09-30T14:51:01.898745Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 123 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 167537 count 13 nextOffset 123 batches 1
2025-09-30T14:51:01.898748Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 124 partNo 0
2025-09-30T14:51:01.898752Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 124 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 181192 count 14 nextOffset 124 batches 1
2025-09-30T14:51:01.898754Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 125 partNo 0
2025-09-30T14:51:01.898759Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 125 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 194957 count 15 nextOffset 125 batches 1
2025-09-30T14:51:01.898763Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 126 partNo 0
2025-09-30T14:51:01.898776Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 126 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 208832 count 16 nextOffset 126 batches 1
2025-09-30T14:51:01.898781Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 127 partNo 0
2025-09-30T14:51:01.898785Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 127 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 222817 count 17 nextOffset 127 batches 1
2025-09-30T14:51:01.898788Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 128 partNo 0
2025-09-30T14:51:01.898791Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 128 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 236913 count 18 nextOffset 128 batches 1
2025-09-30T14:51:01.898794Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 129 partNo 0
2025-09-30T14:51:01.898796Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 129 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 251119 count 19 nextOffset 129 batches 1
2025-09-30T14:51:01.898799Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 130 partNo 0
2025-09-30T14:51:01.898803Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 130 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 265435 count 20 nextOffset 130 batches 1
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..12111 bytes.. Information: { Offset: 110 ProducerId: "src_id" SeqNo: 111 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12221 bytes.. Information: { Offset: 111 ProducerId: "src_id" SeqNo: 112 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12331 bytes.. Information: { Offset: 112 ProducerId: "src_id" SeqNo: 113 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12441 bytes.. Information: { Offset: 113 ProducerId: "src_id" SeqNo: 114 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12551 bytes.. Information: { Offset: 114 ProducerId: "src_id" SeqNo: 115 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12661 bytes.. Information: { Offset: 115 ProducerId: "src_id" SeqNo: 116 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12771 bytes.. Information: { Offset: 116 ProducerId: "src_id" SeqNo: 117 CreateTime: 2025-09-30T14:51:01.887000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12881 bytes.. Information: { Offset: 117 ProducerId: "src_id" SeqNo: 118 CreateTime: 2025-09-30T14:51:01.888000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..12991 bytes.. Information: { Offset: 118 ProducerId: "src_id" SeqNo: 119 CreateTime: 2025-09-30T14:51:01.888000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13101 bytes.. Information: { Offset: 119 ProducerId: "src_id" SeqNo: 120 CreateTime: 2025-09-30T14:51:01.888000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13211 bytes.. Information: { Offset: 120 ProducerId: "src_id" SeqNo: 121 CreateTime: 2025-09-30T14:51:01.889000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13321 bytes.. Information: { Offset: 121 ProducerId: "src_id" SeqNo: 122 CreateTime: 2025-09-30T14:51:01.890000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13431 bytes.. Information: { Offset: 122 ProducerId: "src_id" SeqNo: 123 CreateTime: 2025-09-30T14:51:01.890000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13541 bytes.. Information: { Offset: 123 ProducerId: "src_id" SeqNo: 124 CreateTime: 2025-09-30T14:51:01.890000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13651 bytes.. Information: { Offset: 124 ProducerId: "src_id" SeqNo: 125 CreateTime: 2025-09-30T14:51:01.891000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13761 bytes.. Information: { Offset: 125 ProducerId: "src_id" SeqNo: 126 CreateTime: 2025-09-30T14:51:01.891000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13871 bytes.. Information: { Offset: 126 ProducerId: "src_id" SeqNo: 127 CreateTime: 2025-09-30T14:51:01.891000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..13981 bytes.. Information: { Offset: 127 ProducerId: "src_id" SeqNo: 128 CreateTime: 2025-09-30T14:51:01.891000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14091 bytes.. Information: { Offset: 128 ProducerId: "src_id" SeqNo: 129 CreateTime: 2025-09-30T14:51:01.891000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14201 bytes.. Information: { Offset: 129 ProducerId: "src_id" SeqNo: 130 CreateTime: 2025-09-30T14:51:01.891000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14311 bytes.. Information: { Offset: 130 ProducerId: "src_id" SeqNo: 131 CreateTime: 2025-09-30T14:51:01.891000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14421 bytes.. Information: { Offset: 131 ProducerId: "src_id" SeqNo: 132 CreateTime: 2025-09-30T14:51:01.891000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14531 bytes.. Information: { Offset: 132 ProducerId: "src_id" SeqNo: 133 CreateTime: 2025-09-30T14:51:01.891000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14641 bytes.. Information: { Offset: 133 ProducerId: "src_id" SeqNo: 134 CreateTime: 2025-09-30T14:51:01.891000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14751 bytes.. Information: { Offset: 134 ProducerId: "src_id" SeqNo: 135 CreateTime: 2025-09-30T14:51:01.891000Z WriteTime: 2025-09-30T14:51:01.898000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.898807Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 131 partNo 0
2025-09-30T14:51:01.918073Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 186 to 186
2025-09-30T14:51:01.918116Z :DEBUG: [/Root] Take Data. Partition 0. Read: {2, 0} (151-151)
2025-09-30T14:51:01.898811Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 131 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 279861 count 21 nextOffset 131 batches 1
2025-09-30T14:51:01.898814Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 132 partNo 0
2025-09-30T14:51:01.898817Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 132 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 294397 count 22 nextOffset 132 batches 1
2025-09-30T14:51:01.898820Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 133 partNo 0
2025-09-30T14:51:01.898823Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 133 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 309043 count 23 nextOffset 133 batches 1
2025-09-30T14:51:01.898826Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 134 partNo 0
2025-09-30T14:51:01.921749Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 0} (152-152)
2025-09-30T14:51:01.898829Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 134 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 323799 count 24 nextOffset 134 batches 1
2025-09-30T14:51:01.898832Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 135 partNo 0
2025-09-30T14:51:01.898835Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 135 partNo 0 FormedBlobsCount 0 NewHead: Offset 110 PartNo 0 PackedSize 338665 count 25 nextOffset 135 batches 1
2025-09-30T14:51:01.921762Z :DEBUG: [/Root] Take Data. Partition 0. Read: {3, 1} (153-153)
2025-09-30T14:51:01.921765Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.898838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.921777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 186
2025-09-30T14:51:01.899057Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 110,25 HeadOffset 110 endOffset 110 curOffset 135 d0000000000_00000000000000000110_00000_0000000025_00000? size 337927 WTime 1759243861898
2025-09-30T14:51:01.899126Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.899128Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.899131Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.921792Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 25, size 335775 bytes
2025-09-30T14:51:01.899133Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.899134Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.899136Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.899138Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.899141Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 7 keys were taken away. Let's read 670207 bytes (670207)
2025-09-30T14:51:01.899147Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 7, size 670207 (8388608)
2025-09-30T14:51:01.899168Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 132  requestId: <none> cookie: 66
2025-09-30T14:51:01.899187Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 133  requestId: <none> cookie: 67
2025-09-30T14:51:01.899192Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 139  requestId: <none> cookie: 68
2025-09-30T14:51:01.899202Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 140  requestId: <none> cookie: 69
2025-09-30T14:51:01.899203Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899209Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 141  requestId: <none> cookie: 70
2025-09-30T14:51:01.921835Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 402789
2025-09-30T14:51:01.899213Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899214Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 142  requestId: <none> cookie: 71
2025-09-30T14:51:01.899218Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.921859Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 402789
2025-09-30T14:51:01.899220Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 143  requestId: <none> cookie: 72
2025-09-30T14:51:01.899222Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899225Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 149  requestId: <none> cookie: 73
2025-09-30T14:51:01.899230Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 150  requestId: <none> cookie: 74
2025-09-30T14:51:01.899232Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899235Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 151  requestId: <none> cookie: 75
2025-09-30T14:51:01.921884Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.921894Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 402789
2025-09-30T14:51:01.899236Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899240Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 152  requestId: <none> cookie: 76
2025-09-30T14:51:01.899255Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.921903Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (154-160)
2025-09-30T14:51:01.921924Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 121499 to budget
2025-09-30T14:51:01.921940Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 121499, ReadSizeServerDelta = 402789
2025-09-30T14:51:01.921958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 187 to 187
2025-09-30T14:51:01.899261Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.921969Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.899263Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 153  requestId: <none> cookie: 77
2025-09-30T14:51:01.921973Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 187
2025-09-30T14:51:01.899269Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 159  requestId: <none> cookie: 78
2025-09-30T14:51:01.899274Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 160  requestId: <none> cookie: 79
2025-09-30T14:51:01.921981Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:01.899286Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 161  requestId: <none> cookie: 80
2025-09-30T14:51:01.921986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 188 to 188
2025-09-30T14:51:01.899292Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 162  requestId: <none> cookie: 81
2025-09-30T14:51:01.899298Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 163  requestId: <none> cookie: 82
2025-09-30T14:51:01.899303Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 169  requestId: <none> cookie: 83
2025-09-30T14:51:01.899308Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 170  requestId: <none> cookie: 84
2025-09-30T14:51:01.899314Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 171  requestId: <none> cookie: 85
2025-09-30T14:51:01.922000Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (154-154)
2025-09-30T14:51:01.899320Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 172  requestId: <none> cookie: 86
2025-09-30T14:51:01.922011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.922013Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (155-155)
2025-09-30T14:51:01.899325Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 173  requestId: <none> cookie: 87
2025-09-30T14:51:01.922016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 188
2025-09-30T14:51:01.899330Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 179  requestId: <none> cookie: 88
2025-09-30T14:51:01.899336Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 181  requestId: <none> cookie: 89
2025-09-30T14:51:01.899341Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 182  requestId: <none> cookie: 90
2025-09-30T14:51:01.899346Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 183  requestId: <none> cookie: 91
2025-09-30T14:51:01.899351Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 184  requestId: <none> cookie: 92
2025-09-30T14:51:01.899356Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 186  requestId: <none> cookie: 93
2025-09-30T14:51:01.899361Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 191  requestId: <none> cookie: 94
2025-09-30T14:51:01.899366Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 192  requestId: <none> cookie: 95
2025-09-30T14:51:01.899370Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 193  requestId: <none> cookie: 96
2025-09-30T14:51:01.899376Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 194  requestId: <none> cookie: 97
2025-09-30T14:51:01.899384Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 195  requestId: <none> cookie: 98
2025-09-30T14:51:01.899389Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 201  requestId: <none> cookie: 99
2025-09-30T14:51:01.899394Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 202  requestId: <none> cookie: 100
2025-09-30T14:51:01.899401Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 204  requestId: <none> cookie: 101
2025-09-30T14:51:01.899405Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899406Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 205  requestId: <none> cookie: 102
2025-09-30T14:51:01.899410Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 206  requestId: <none> cookie: 103
2025-09-30T14:51:01.899411Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899416Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 211  requestId: <none> cookie: 104
2025-09-30T14:51:01.899422Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 212  requestId: <none> cookie: 105
2025-09-30T14:51:01.899427Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 213  requestId: <none> cookie: 106
2025-09-30T14:51:01.899432Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 217  requestId: <none> cookie: 107
2025-09-30T14:51:01.899437Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 219  requestId: <none> cookie: 108
2025-09-30T14:51:01.899442Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 220  requestId: <none> cookie: 109
2025-09-30T14:51:01.899448Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 221  requestId: <none> cookie: 110
2025-09-30T14:51:01.922092Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (156-156)
2025-09-30T14:51:01.899462Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.899466Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.922102Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (157-157)
2025-09-30T14:51:01.899477Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.899491Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 110 partNo 0 count 25 size 337927
2025-09-30T14:51:01.899506Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899510Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899514Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899518Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899522Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899526Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922123Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 258797, now ReadSizeBudget = 0, ReadSizeServerDelta = 265491
2025-09-30T14:51:01.899529Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899533Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899537Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899541Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922181Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (158-158)
2025-09-30T14:51:01.922190Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 189 to 189
2025-09-30T14:51:01.922194Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (159-159)
2025-09-30T14:51:01.899545Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922202Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (160-160)
2025-09-30T14:51:01.899549Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899553Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899557Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899560Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.899564Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922221Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 189
2025-09-30T14:51:01.899568Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899573Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899577Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899582Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 10 Topic 'rt3.dc1--test-topic' partition 0 user user offset 65 count 54 size 348137 endOffset 110 max time lag 0ms effective offset 65
2025-09-30T14:51:01.899597Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 10 added 1 blobs, size 434929 count 45 last offset 65, current partition end offset: 110
2025-09-30T14:51:01.899601Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
>>> event from dataHandler: 2025-09-30T14:51:01.922253Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 265491
2025-09-30T14:51:01.899601Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 10. Send blob request.
2025-09-30T14:51:01.922263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 190 to 190
2025-09-30T14:51:01.899605Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.922277Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 190
2025-09-30T14:51:01.899609Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899613Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 65 partno 0 count 45 parts_count 0 source 1 size 434929 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.899613Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899617Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 10. All 1 blobs are from cache.
2025-09-30T14:51:01.899617Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899621Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899624Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899627Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.899628Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899655Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899666Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 191 to 191
2025-09-30T14:51:01.899680Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 65 partno 0 count 45 parts 0 suffix '63'
2025-09-30T14:51:01.899683Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899687Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922331Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..14861 bytes.. Information: { Offset: 135 ProducerId: "src_id" SeqNo: 136 CreateTime: 2025-09-30T14:51:01.891000Z WriteTime: 2025-09-30T14:51:01.902000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..14971 bytes.. Information: { Offset: 136 ProducerId: "src_id" SeqNo: 137 CreateTime: 2025-09-30T14:51:01.899000Z WriteTime: 2025-09-30T14:51:01.902000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15081 bytes.. Information: { Offset: 137 ProducerId: "src_id" SeqNo: 138 CreateTime: 2025-09-30T14:51:01.899000Z WriteTime: 2025-09-30T14:51:01.902000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15191 bytes.. Information: { Offset: 138 ProducerId: "src_id" SeqNo: 139 CreateTime: 2025-09-30T14:51:01.899000Z WriteTime: 2025-09-30T14:51:01.902000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15301 bytes.. Information: { Offset: 139 ProducerId: "src_id" SeqNo: 140 CreateTime: 2025-09-30T14:51:01.899000Z WriteTime: 2025-09-30T14:51:01.902000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15411 bytes.. Information: { Offset: 140 ProducerId: "src_id" SeqNo: 141 CreateTime: 2025-09-30T14:51:01.899000Z WriteTime: 2025-09-30T14:51:01.902000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15521 bytes.. Information: { Offset: 141 ProducerId: "src_id" SeqNo: 142 CreateTime: 2025-09-30T14:51:01.899000Z WriteTime: 2025-09-30T14:51:01.902000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15631 bytes.. Information: { Offset: 142 ProducerId: "src_id" SeqNo: 143 CreateTime: 2025-09-30T14:51:01.899000Z WriteTime: 2025-09-30T14:51:01.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15741 bytes.. Information: { Offset: 143 ProducerId: "src_id" SeqNo: 144 CreateTime: 2025-09-30T14:51:01.900000Z WriteTime: 2025-09-30T14:51:01.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15851 bytes.. Information: { Offset: 144 ProducerId: "src_id" SeqNo: 145 CreateTime: 2025-09-30T14:51:01.900000Z WriteTime: 2025-09-30T14:51:01.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..15961 bytes.. Information: { Offset: 145 ProducerId: "src_id" SeqNo: 146 CreateTime: 2025-09-30T14:51:01.900000Z WriteTime: 2025-09-30T14:51:01.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16071 bytes.. Information: { Offset: 146 ProducerId: "src_id" SeqNo: 147 CreateTime: 2025-09-30T14:51:01.900000Z WriteTime: 2025-09-30T14:51:01.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16181 bytes.. Information: { Offset: 147 ProducerId: "src_id" SeqNo: 148 CreateTime: 2025-09-30T14:51:01.900000Z WriteTime: 2025-09-30T14:51:01.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16291 bytes.. Information: { Offset: 148 ProducerId: "src_id" SeqNo: 149 CreateTime: 2025-09-30T14:51:01.900000Z WriteTime: 2025-09-30T14:51:01.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16401 bytes.. Information: { Offset: 149 ProducerId: "src_id" SeqNo: 150 CreateTime: 2025-09-30T14:51:01.900000Z WriteTime: 2025-09-30T14:51:01.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16511 bytes.. Information: { Offset: 150 ProducerId: "src_id" SeqNo: 151 CreateTime: 2025-09-30T14:51:01.900000Z WriteTime: 2025-09-30T14:51:01.904000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16621 bytes.. Information: { Offset: 151 ProducerId: "src_id" SeqNo: 152 CreateTime: 2025-09-30T14:51:01.901000Z WriteTime: 2025-09-30T14:51:01.907000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16731 bytes.. Information: { Offset: 152 ProducerId: "src_id" SeqNo: 153 CreateTime: 2025-09-30T14:51:01.906000Z WriteTime: 2025-09-30T14:51:01.908000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..16841 bytes.. Information: { Offset: 153 ProducerId: "src_id" SeqNo: 154 CreateTime: 2025-09-30T14:51:01.906000Z WriteTime: 2025-09-30T14:51:01.908000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }2025-09-30T14:51:01.922343Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (161-174)
2025-09-30T14:51:01.922340Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 191
2025-09-30T14:51:01.922350Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 19434, now ReadSizeBudget = 0, ReadSizeServerDelta = 246057
2025-09-30T14:51:01.922383Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 246057
2025-09-30T14:51:01.899690Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922389Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 258797 to budget
2025-09-30T14:51:01.922395Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 258797, ReadSizeServerDelta = 246057
2025-09-30T14:51:01.899694Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899698Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.899702Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922408Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 192 to 192
2025-09-30T14:51:01.922417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.922426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 192
2025-09-30T14:51:01.922418Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 504854
2025-09-30T14:51:01.922429Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 19, size 301169 bytes
2025-09-30T14:51:01.922441Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 193 to 193
2025-09-30T14:51:01.922443Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.922449Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.922452Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 193
2025-09-30T14:51:01.922452Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (175-175)
2025-09-30T14:51:01.922454Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (161-161)
2025-09-30T14:51:01.922466Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 19434 to budget
2025-09-30T14:51:01.922464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 194 to 194
2025-09-30T14:51:01.922480Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (162-162)
2025-09-30T14:51:01.922481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.922485Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 194
2025-09-30T14:51:01.922491Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (163-163)
2025-09-30T14:51:01.922495Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 195 to 195
2025-09-30T14:51:01.922498Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (164-164)
2025-09-30T14:51:01.922506Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.922509Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 195
2025-09-30T14:51:01.922513Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (165-165)
2025-09-30T14:51:01.922518Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 196 to 196
2025-09-30T14:51:01.922519Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (166-166)
2025-09-30T14:51:01.922526Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.922533Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 196
2025-09-30T14:51:01.922526Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (167-167)
2025-09-30T14:51:01.922541Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (168-168)
>>> event from dataHandler: 2025-09-30T14:51:01.922575Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (169-169)
2025-09-30T14:51:01.922582Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (170-170)
2025-09-30T14:51:01.922584Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 197 to 197
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..16951 bytes.. Information: { Offset: 154 ProducerId: "src_id" SeqNo: 155 CreateTime: 2025-09-30T14:51:01.906000Z WriteTime: 2025-09-30T14:51:01.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17061 bytes.. Information: { Offset: 155 ProducerId: "src_id" SeqNo: 156 CreateTime: 2025-09-30T14:51:01.906000Z WriteTime: 2025-09-30T14:51:01.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17171 bytes.. Information: { Offset: 156 ProducerId: "src_id" SeqNo: 157 CreateTime: 2025-09-30T14:51:01.906000Z WriteTime: 2025-09-30T14:51:01.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17281 bytes.. Information: { Offset: 157 ProducerId: "src_id" SeqNo: 158 CreateTime: 2025-09-30T14:51:01.906000Z WriteTime: 2025-09-30T14:51:01.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17391 bytes.. Information: { Offset: 158 ProducerId: "src_id" SeqNo: 159 CreateTime: 2025-09-30T14:51:01.906000Z WriteTime: 2025-09-30T14:51:01.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17501 bytes.. Information: { Offset: 159 ProducerId: "src_id" SeqNo: 160 CreateTime: 2025-09-30T14:51:01.907000Z WriteTime: 2025-09-30T14:51:01.908000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17611 bytes.. Information: { Offset: 160 ProducerId: "src_id" SeqNo: 161 CreateTime: 2025-09-30T14:51:01.907000Z WriteTime: 2025-09-30T14:51:01.912000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }2025-09-30T14:51:01.922593Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.922589Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (171-171)
2025-09-30T14:51:01.922611Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 197
2025-09-30T14:51:01.922618Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (172-172)
2025-09-30T14:51:01.922623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 198 to 198
2025-09-30T14:51:01.922631Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.922635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 198
2025-09-30T14:51:01.922637Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 7, size 120967 bytes
2025-09-30T14:51:01.922643Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.922646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 199 to 199
2025-09-30T14:51:01.922649Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (173-173)
2025-09-30T14:51:01.922658Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.922661Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 199
2025-09-30T14:51:01.922667Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (174-174)
2025-09-30T14:51:01.922670Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 200 to 200
2025-09-30T14:51:01.922681Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.899735Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.922684Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 200
2025-09-30T14:51:01.900044Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.922690Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (175-175)
2025-09-30T14:51:01.900082Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.900101Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.900153Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 3696 } }
2025-09-30T14:51:01.900169Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 11c1dd52-36265859-d7510c8b-9e14fa51
2025-09-30T14:51:01.922713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 201 to 201
2025-09-30T14:51:01.900213Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 65 totakecount 45 count 45 size 434907 from pos 0 cbcount 45
2025-09-30T14:51:01.900227Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.900275Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.922723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.900277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.922727Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 201
2025-09-30T14:51:01.900283Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.900287Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.900293Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 3806 } }
2025-09-30T14:51:01.900295Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.900297Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.900303Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# fc65061e-311ce23a-cdf113fe-19c76936
2025-09-30T14:51:01.900308Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.900322Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 65
2025-09-30T14:51:01.900332Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.900352Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.900354Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.900425Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 270  requestId: <none> cookie: 136
2025-09-30T14:51:01.900428Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 271  requestId: <none> cookie: 137
2025-09-30T14:51:01.900433Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.900435Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.900438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 272  requestId: <none> cookie: 138
2025-09-30T14:51:01.900442Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 273  requestId: <none> cookie: 139
2025-09-30T14:51:01.900457Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922788Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 178792, now ReadSizeBudget = 19434, ReadSizeServerDelta = 326062
2025-09-30T14:51:01.900463Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922807Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 19434, ReadSizeServerDelta = 326062
2025-09-30T14:51:01.900469Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922846Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 202 to 202
2025-09-30T14:51:01.900472Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.900477Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
>>> event from dataHandler: 2025-09-30T14:51:01.900763Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 110 Result { Offset: 65 Data: "... 7233 bytes ..." SourceId: "\000src_id" SeqNo: 66 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861878 UncompressedSize: 7161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 66 Data: "... 7343 bytes ..." SourceId: "\000src_id" SeqNo: 67 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861878 UncompressedSize: 7271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 67 Data: "... 7453 bytes ..." SourceId: "\000src_id" SeqNo: 68 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861878 UncompressedSize: 7381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 68 Data: "... 7563 bytes ..." SourceId: "\000src_id" SeqNo: 69 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861878 UncompressedSize: 7491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 69 Data: "... 7673 bytes ..." SourceId: "\000src_id" SeqNo: 70 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861881 UncompressedSize: 7601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 70 Data: "... 7783 bytes ..." SourceId: "\000src_id" SeqNo: 71 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861881 UncompressedSize: 7711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 71 Data: "... 7893 bytes ..." SourceId: "\000src_id" SeqNo: 72 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861881 UncompressedSize: 7821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 72 Data: "... 8003 bytes ..." SourceId: "\000src_id" SeqNo: 73 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 7931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 73 Data: "... 8113 bytes ..." SourceId: "\000src_id" SeqNo: 74 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 8041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 74 Data: "... 8223 bytes ..." SourceId: "\000src_id" SeqNo: 75 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 8151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 75 Data: "... 8333 bytes ..." SourceId: "\000src_id" SeqNo: 76 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 8261 PartitionKey: "" ExplicitHash: "" } Result { Offset: 76 Data: "... 8443 bytes ..." SourceId: "\000src_id" SeqNo: 77 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 8371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 77 Data: "... 8553 bytes ..." SourceId: "\000src_id" SeqNo: 78 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 8481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 78 Data: "... 8663 bytes ..." SourceId: "\000src_id" SeqNo: 79 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 8591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 79 Data: "... 8773 bytes ..." SourceId: "\000src_id" SeqNo: 80 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 8701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 80 Data: "... 8883 bytes ..." SourceId: "\000src_id" SeqNo: 81 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 8811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 81 Data: "... 8993 bytes ..." SourceId: "\000src_id" SeqNo: 82 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 8921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 82 Data: "... 9103 bytes ..." SourceId: "\000src_id" SeqNo: 83 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 9031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 83 Data: "... 9213 bytes ..." SourceId: "\000src_id" SeqNo: 84 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 9141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 84 Data: "... 9323 bytes ..." SourceId: "\000src_id" SeqNo: 85 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 9251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 85 Data: "... 9433 bytes ..." SourceId: "\000src_id" SeqNo: 86 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 9361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 86 Data: "... 9543 bytes ..." SourceId: "\000src_id" SeqNo: 87 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 9471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 87 Data: "... 9653 bytes ..." SourceId: "\000src_id" SeqNo: 88 WriteTimestampMS: 1759243861893 CreateTimestampMS: 1759243861882 UncompressedSize: 9581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 88 Data: "... 9763 bytes ..." SourceId: "\000src_id" SeqNo: 89 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861882 UncompressedSize: 9691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 89 Data: "... 9873 bytes ..." SourceId: "\000src_id" SeqNo: 90 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861882 UncompressedSize: 9801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 90 Data: "... 9983 bytes ..." SourceId: "\000src_id" SeqNo: 91 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861882 UncompressedSize: 9911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 91 Data: "... 10093 bytes ..." SourceId: "\000src_id" SeqNo: 92 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861882 UncompressedSize: 10021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 92 Data: "... 10203 bytes ..." SourceId: "\000src_id" SeqNo: 93 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861882 UncompressedSize: 10131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 93 Data: "... 10313 bytes ..." SourceId: "\000src_id" SeqNo: 94 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861882 UncompressedSize: 10241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 94 Data: "... 10423 bytes ..." SourceId: "\000src_id" SeqNo: 95 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861882 UncompressedSize: 10351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 95 Data: "... 10533 bytes ..." SourceId: "\000src_id" SeqNo: 96 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861886 UncompressedSize: 10461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 96 Data: "... 10643 bytes ..." SourceId: "\000src_id" SeqNo: 97 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861886 UncompressedSize: 10571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 97 Data: "... 10753 bytes ..." SourceId: "\000src_id" SeqNo: 98 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861886 UncompressedSize: 10681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 98 Data: "... 10863 bytes ..." SourceId: "\000src_id" SeqNo: 99 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861886 UncompressedSize: 10791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 99 Data: "... 10973 bytes ..." SourceId: "\000src_id" SeqNo: 100 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861886 UncompressedSize: 10901 PartitionKey: "" ExplicitHash: "" } Result { Offset: 100 Data: "... 11083 bytes ..." SourceId: "\000src_id" SeqNo: 101 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861886 UncompressedSize: 11011 PartitionKey: "" ExplicitHash: "" } Result { Offset: 101 Data: "... 11193 bytes ..." SourceId: "\000src_id" SeqNo: 102 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861886 UncompressedSize: 11121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 102 Data: "... 11303 bytes ..." SourceId: "\000src_id" SeqNo: 103 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861886 UncompressedSize: 11231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 103 Data: "... 11413 bytes ..." SourceId: "\000src_id" SeqNo: 104 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861887 UncompressedSize: 11341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 104 Data: "... 11523 bytes ..." SourceId: "\000src_id" SeqNo: 105 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861887 UncompressedSize: 11451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 105 Data: "... 11633 bytes ..." SourceId: "\000src_id" SeqNo: 106 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861887 UncompressedSize: 11561 PartitionKey: "" ExplicitHash: "" } Result { Offset: 106 Data: "... 11743 bytes ..." SourceId: "\000src_id" SeqNo: 107 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861887 UncompressedSize: 11671 PartitionKey: "" ExplicitHash: "" } Result { Offset: 107 Data: "... 11853 bytes ..." SourceId: "\000src_id" SeqNo: 108 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861887 UncompressedSize: 11781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 108 Data: "... 11963 bytes ..." SourceId: "\000src_id" SeqNo: 109 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861887 UncompressedSize: 11891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 109 Data: "... 12073 bytes ..." SourceId: "\000src_id" SeqNo: 110 WriteTimestampMS: 1759243861894 CreateTimestampMS: 1759243861887 UncompressedSize: 12001 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709550270 RealReadOffset: 109 WaitQuotaTimeMs: 0 EndOffset: 110 StartOffset: 0 } Cookie: 65 }
2025-09-30T14:51:01.901018Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 8 from offset 110
2025-09-30T14:51:01.901028Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 110 ReadOffset 110 ReadGuid 46646b6a-6474682a-46cca2f0-747a7db7 has messages 1
2025-09-30T14:51:01.901207Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.901217Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.925183Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 345496
2025-09-30T14:51:01.901279Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.901296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.925201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.901301Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.901316Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 136 partNo : 0 messageNo: 274 size 14934 offset: -1
2025-09-30T14:51:01.925210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 202
2025-09-30T14:51:01.901323Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.901325Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.901329Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 137 partNo : 0 messageNo: 275 size 15044 offset: -1
2025-09-30T14:51:01.901335Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.901346Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.901350Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 138 partNo : 0 messageNo: 276 size 15154 offset: -1
2025-09-30T14:51:01.901354Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.901356Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.901360Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 139 partNo : 0 messageNo: 277 size 15264 offset: -1
2025-09-30T14:51:01.901378Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.901380Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.901384Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.901386Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.901390Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.901400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.901402Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.925266Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (176-184)
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..17721 bytes.. Information: { Offset: 161 ProducerId: "src_id" SeqNo: 162 CreateTime: 2025-09-30T14:51:01.912000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17831 bytes.. Information: { Offset: 162 ProducerId: "src_id" SeqNo: 163 CreateTime: 2025-09-30T14:51:01.912000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..17941 bytes.. Information: { Offset: 163 ProducerId: "src_id" SeqNo: 164 CreateTime: 2025-09-30T14:51:01.912000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18051 bytes.. Information: { Offset: 164 ProducerId: "src_id" SeqNo: 165 CreateTime: 2025-09-30T14:51:01.912000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18161 bytes.. Information: { Offset: 165 ProducerId: "src_id" SeqNo: 166 CreateTime: 2025-09-30T14:51:01.912000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18271 bytes.. Information: { Offset: 166 ProducerId: "src_id" SeqNo: 167 CreateTime: 2025-09-30T14:51:01.912000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18381 bytes.. Information: { Offset: 167 ProducerId: "src_id" SeqNo: 168 CreateTime: 2025-09-30T14:51:01.912000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18491 bytes.. Information: { Offset: 168 ProducerId: "src_id" SeqNo: 169 CreateTime: 2025-09-30T14:51:01.912000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18601 bytes.. Information: { Offset: 169 ProducerId: "src_id" SeqNo: 170 CreateTime: 2025-09-30T14:51:01.912000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18711 bytes.. Information: { Offset: 170 ProducerId: "src_id" SeqNo: 171 CreateTime: 2025-09-30T14:51:01.912000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18821 bytes.. Information: { Offset: 171 ProducerId: "src_id" SeqNo: 172 CreateTime: 2025-09-30T14:51:01.912000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..18931 bytes.. Information: { Offset: 172 ProducerId: "src_id" SeqNo: 173 CreateTime: 2025-09-30T14:51:01.912000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19041 bytes.. Information: { Offset: 173 ProducerId: "src_id" SeqNo: 174 CreateTime: 2025-09-30T14:51:01.913000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19151 bytes.. Information: { Offset: 174 ProducerId: "src_id" SeqNo: 175 CreateTime: 2025-09-30T14:51:01.913000Z WriteTime: 2025-09-30T14:51:01.914000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19261 bytes.. Information: { Offset: 175 ProducerId: "src_id" SeqNo: 176 CreateTime: 2025-09-30T14:51:01.913000Z WriteTime: 2025-09-30T14:51:01.918000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.901404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.925289Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 20534, now ReadSizeBudget = 0, ReadSizeServerDelta = 324962
2025-09-30T14:51:01.901406Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.901408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.901410Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.901412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.901585Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 278  requestId: <none> cookie: 140
2025-09-30T14:51:01.901591Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 279  requestId: <none> cookie: 141
2025-09-30T14:51:01.925324Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 324962
2025-09-30T14:51:01.901620Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 46646b6a-6474682a-46cca2f0-747a7db7, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 432972
2025-09-30T14:51:01.901633Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 46646b6a-6474682a-46cca2f0-747a7db7
2025-09-30T14:51:01.901780Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.901790Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.901798Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.925344Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 178792 to budget
2025-09-30T14:51:01.901854Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.925349Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 178792, ReadSizeServerDelta = 324962
2025-09-30T14:51:01.901871Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.901874Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.901886Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 140 partNo : 0 messageNo: 280 size 15374 offset: -1
2025-09-30T14:51:01.901891Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.901893Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.901899Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 141 partNo : 0 messageNo: 281 size 15484 offset: -1
2025-09-30T14:51:01.925367Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (185-185)
2025-09-30T14:51:01.925383Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 14, size 258104 bytes
2025-09-30T14:51:01.901903Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.901905Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.901918Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.901926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.901928Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.925370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 203 to 203
2025-09-30T14:51:01.901930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.901937Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 282  requestId: <none> cookie: 142
2025-09-30T14:51:01.901944Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.901971Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.901973Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.901977Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 142 partNo : 0 messageNo: 283 size 15594 offset: -1
2025-09-30T14:51:01.925430Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 503754
2025-09-30T14:51:01.901980Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.901982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.902002Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.925429Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.925442Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 20534 to budget
2025-09-30T14:51:01.925451Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 1, size 19261 bytes
2025-09-30T14:51:01.925453Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 203
2025-09-30T14:51:01.925455Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (176-176)
2025-09-30T14:51:01.925463Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.925467Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (177-177)
2025-09-30T14:51:01.902060Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.902138Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.925478Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.902158Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.925481Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (178-178)
2025-09-30T14:51:01.902191Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.902200Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.925489Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (179-179)
2025-09-30T14:51:01.902204Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.902226Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.902281Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.902283Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.925503Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (180-180)
2025-09-30T14:51:01.902298Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.902302Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 110 count 25 size 337927 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.925510Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (181-181)
2025-09-30T14:51:01.902319Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.902319Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 284  requestId: <none> cookie: 143
2025-09-30T14:51:01.925517Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (182-182)
2025-09-30T14:51:01.902326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.902342Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 337758 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.925525Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (183-183)
2025-09-30T14:51:01.902345Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 110 partno 0 count 25 parts 0 suffix '63' size 337927
2025-09-30T14:51:01.902352Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902360Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 111, partNo: 0, Offset: 110 is stored on disk
2025-09-30T14:51:01.902364Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902369Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 112, partNo: 0, Offset: 111 is stored on disk
2025-09-30T14:51:01.902372Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902375Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 113, partNo: 0, Offset: 112 is stored on disk
2025-09-30T14:51:01.902377Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.925557Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (184-184)
2025-09-30T14:51:01.902380Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 114, partNo: 0, Offset: 113 is stored on disk
2025-09-30T14:51:01.902382Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.925565Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (185-185)
2025-09-30T14:51:01.902386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 115, partNo: 0, Offset: 114 is stored on disk
2025-09-30T14:51:01.902389Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 116, partNo: 0, Offset: 115 is stored on disk
2025-09-30T14:51:01.902395Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902397Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 117, partNo: 0, Offset: 116 is stored on disk
2025-09-30T14:51:01.902399Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902400Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.925588Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 204 to 204
2025-09-30T14:51:01.902402Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 118, partNo: 0, Offset: 117 is stored on disk
2025-09-30T14:51:01.902405Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.925606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.902409Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 119, partNo: 0, Offset: 118 is stored on disk
2025-09-30T14:51:01.902411Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.925612Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 204
2025-09-30T14:51:01.902415Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 120, partNo: 0, Offset: 119 is stored on disk
2025-09-30T14:51:01.902417Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902419Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.902423Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 121, partNo: 0, Offset: 120 is stored on disk
2025-09-30T14:51:01.902425Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902428Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 122, partNo: 0, Offset: 121 is stored on disk
2025-09-30T14:51:01.902430Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902431Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.902434Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 123, partNo: 0, Offset: 122 is stored on disk
2025-09-30T14:51:01.902436Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902439Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 124, partNo: 0, Offset: 123 is stored on disk
2025-09-30T14:51:01.902442Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902446Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 125, partNo: 0, Offset: 124 is stored on disk
2025-09-30T14:51:01.902449Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902453Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 126, partNo: 0, Offset: 125 is stored on disk
2025-09-30T14:51:01.902455Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902458Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 127, partNo: 0, Offset: 126 is stored on disk
2025-09-30T14:51:01.902460Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902463Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 128, partNo: 0, Offset: 127 is stored on disk
2025-09-30T14:51:01.902465Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902468Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 129, partNo: 0, Offset: 128 is stored on disk
2025-09-30T14:51:01.902468Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.902470Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902473Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 130, partNo: 0, Offset: 129 is stored on disk
2025-09-30T14:51:01.902474Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.902475Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902479Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 131, partNo: 0, Offset: 130 is stored on disk
2025-09-30T14:51:01.902481Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902484Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 132, partNo: 0, Offset: 131 is stored on disk
2025-09-30T14:51:01.902486Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902490Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 133, partNo: 0, Offset: 132 is stored on disk
2025-09-30T14:51:01.902492Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902495Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 134, partNo: 0, Offset: 133 is stored on disk
2025-09-30T14:51:01.925743Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 205 to 205
2025-09-30T14:51:01.902497Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.902501Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 135, partNo: 0, Offset: 134 is stored on disk
2025-09-30T14:51:01.925755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.925764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 205
2025-09-30T14:51:01.902509Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.902519Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.902538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.902548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.902552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (7)
2025-09-30T14:51:01.902556Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 110 EndOffset 110 newEndOffset 135 commitOffset 0 clientCommitOffset 0 cookie 8 readingFinished 0 firstRead 0
2025-09-30T14:51:01.902560Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 110 endOffset 135
2025-09-30T14:51:01.902565Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.902578Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 136 partNo 0
2025-09-30T14:51:01.902610Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.902623Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 136 partNo 0 FormedBlobsCount 0 NewHead: Offset 135 PartNo 0 PackedSize 15008 count 1 nextOffset 136 batches 1
2025-09-30T14:51:01.902631Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 137 partNo 0
2025-09-30T14:51:01.902637Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 137 partNo 0 FormedBlobsCount 0 NewHead: Offset 135 PartNo 0 PackedSize 30094 count 2 nextOffset 137 batches 1
2025-09-30T14:51:01.902640Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 138 partNo 0
2025-09-30T14:51:01.902643Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 138 partNo 0 FormedBlobsCount 0 NewHead: Offset 135 PartNo 0 PackedSize 45290 count 3 nextOffset 138 batches 1
2025-09-30T14:51:01.902646Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 139 partNo 0
2025-09-30T14:51:01.902649Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 139 partNo 0 FormedBlobsCount 0 NewHead: Offset 135 PartNo 0 PackedSize 60596 count 4 nextOffset 139 batches 1
2025-09-30T14:51:01.902652Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 140 partNo 0
2025-09-30T14:51:01.902655Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 140 partNo 0 FormedBlobsCount 0 NewHead: Offset 135 PartNo 0 PackedSize 76012 count 5 nextOffset 140 batches 1
2025-09-30T14:51:01.902658Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 141 partNo 0
2025-09-30T14:51:01.902661Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 141 partNo 0 FormedBlobsCount 0 NewHead: Offset 135 PartNo 0 PackedSize 91538 count 6 nextOffset 141 batches 1
2025-09-30T14:51:01.902664Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 142 partNo 0
2025-09-30T14:51:01.902668Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 142 partNo 0 FormedBlobsCount 0 NewHead: Offset 135 PartNo 0 PackedSize 107174 count 7 nextOffset 142 batches 1
2025-09-30T14:51:01.902670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.902683Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 110, endOffset# 135, WTime# 1759243861894, sizeLag# 337927
2025-09-30T14:51:01.902686Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.902814Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 135,7 HeadOffset 135 endOffset 135 curOffset 142 d0000000000_00000000000000000135_00000_0000000007_00000? size 107014 WTime 1759243861902
2025-09-30T14:51:01.902904Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.902909Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
>>> event from dataHandler: 2025-09-30T14:51:01.902912Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.925891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 206 to 206
2025-09-30T14:51:01.902914Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.925901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.902915Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.925905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 206
2025-09-30T14:51:01.902917Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.902919Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.902921Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.902924Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 8 keys were taken away. Let's read 1008134 bytes (1008134)
2025-09-30T14:51:01.902928Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 8, size 1008134 (8388608)
2025-09-30T14:51:01.902940Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 285  requestId: <none> cookie: 144
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..19371 bytes.. Information: { Offset: 176 ProducerId: "src_id" SeqNo: 177 CreateTime: 2025-09-30T14:51:01.917000Z WriteTime: 2025-09-30T14:51:01.919000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19481 bytes.. Information: { Offset: 177 ProducerId: "src_id" SeqNo: 178 CreateTime: 2025-09-30T14:51:01.917000Z WriteTime: 2025-09-30T14:51:01.919000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19591 bytes.. Information: { Offset: 178 ProducerId: "src_id" SeqNo: 179 CreateTime: 2025-09-30T14:51:01.917000Z WriteTime: 2025-09-30T14:51:01.919000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19701 bytes.. Information: { Offset: 179 ProducerId: "src_id" SeqNo: 180 CreateTime: 2025-09-30T14:51:01.917000Z WriteTime: 2025-09-30T14:51:01.919000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19811 bytes.. Information: { Offset: 180 ProducerId: "src_id" SeqNo: 181 CreateTime: 2025-09-30T14:51:01.917000Z WriteTime: 2025-09-30T14:51:01.919000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..19921 bytes.. Information: { Offset: 181 ProducerId: "src_id" SeqNo: 182 CreateTime: 2025-09-30T14:51:01.917000Z WriteTime: 2025-09-30T14:51:01.919000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20031 bytes.. Information: { Offset: 182 ProducerId: "src_id" SeqNo: 183 CreateTime: 2025-09-30T14:51:01.917000Z WriteTime: 2025-09-30T14:51:01.919000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20141 bytes.. Information: { Offset: 183 ProducerId: "src_id" SeqNo: 184 CreateTime: 2025-09-30T14:51:01.917000Z WriteTime: 2025-09-30T14:51:01.919000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20251 bytes.. Information: { Offset: 184 ProducerId: "src_id" SeqNo: 185 CreateTime: 2025-09-30T14:51:01.917000Z WriteTime: 2025-09-30T14:51:01.919000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20361 bytes.. Information: { Offset: 185 ProducerId: "src_id" SeqNo: 186 CreateTime: 2025-09-30T14:51:01.918000Z WriteTime: 2025-09-30T14:51:01.922000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.902958Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.925977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 207 to 207
2025-09-30T14:51:01.927736Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 167301, now ReadSizeBudget = 20534, ReadSizeServerDelta = 336453
2025-09-30T14:51:01.902962Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.928886Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.902971Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 222  requestId: <none> cookie: 111
2025-09-30T14:51:01.902971Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.928896Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 207
2025-09-30T14:51:01.902980Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 227  requestId: <none> cookie: 112
2025-09-30T14:51:01.928898Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 9, size 178299 bytes
2025-09-30T14:51:01.928907Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 20534, ReadSizeServerDelta = 336453
2025-09-30T14:51:01.902985Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.902986Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 229  requestId: <none> cookie: 113
2025-09-30T14:51:01.902992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 230  requestId: <none> cookie: 114
2025-09-30T14:51:01.902997Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 231  requestId: <none> cookie: 115
2025-09-30T14:51:01.903000Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903004Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 232  requestId: <none> cookie: 116
2025-09-30T14:51:01.903004Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.928943Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 356987
2025-09-30T14:51:01.903009Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 237  requestId: <none> cookie: 117
2025-09-30T14:51:01.903014Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 238  requestId: <none> cookie: 118
2025-09-30T14:51:01.903015Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.928974Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 1, size 20361 bytes
2025-09-30T14:51:01.928980Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.903019Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 239  requestId: <none> cookie: 119
2025-09-30T14:51:01.928995Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (186-193)
2025-09-30T14:51:01.903022Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903024Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 240  requestId: <none> cookie: 120
2025-09-30T14:51:01.903026Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903029Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 241  requestId: <none> cookie: 121
2025-09-30T14:51:01.903030Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929011Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 167301 to budget
2025-09-30T14:51:01.903033Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.929015Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.903035Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.903040Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903043Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 143 partNo : 0 messageNo: 287 size 15704 offset: -1
2025-09-30T14:51:01.903044Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929029Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (186-186)
2025-09-30T14:51:01.903049Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.903051Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.903056Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 247  requestId: <none> cookie: 122
2025-09-30T14:51:01.929041Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (187-187)
2025-09-30T14:51:01.903062Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 248  requestId: <none> cookie: 123
2025-09-30T14:51:01.929053Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (188-188)
2025-09-30T14:51:01.903067Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 249  requestId: <none> cookie: 124
2025-09-30T14:51:01.903072Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 250  requestId: <none> cookie: 125
2025-09-30T14:51:01.929058Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (189-189)
2025-09-30T14:51:01.903078Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 251  requestId: <none> cookie: 126
2025-09-30T14:51:01.903083Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 257  requestId: <none> cookie: 127
2025-09-30T14:51:01.903088Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 258  requestId: <none> cookie: 128
2025-09-30T14:51:01.903093Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 259  requestId: <none> cookie: 129
2025-09-30T14:51:01.903098Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 260  requestId: <none> cookie: 130
2025-09-30T14:51:01.929077Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (190-190)
2025-09-30T14:51:01.903104Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 261  requestId: <none> cookie: 131
2025-09-30T14:51:01.903110Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 266  requestId: <none> cookie: 132
2025-09-30T14:51:01.929083Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (191-191)
2025-09-30T14:51:01.903116Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 267  requestId: <none> cookie: 133
2025-09-30T14:51:01.903121Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 268  requestId: <none> cookie: 134
2025-09-30T14:51:01.929100Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (192-192)
2025-09-30T14:51:01.903126Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 269  requestId: <none> cookie: 135
2025-09-30T14:51:01.929106Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (193-193)
2025-09-30T14:51:01.903130Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.903132Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.903135Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.903137Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.903144Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.903157Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 135 partNo 0 count 7 size 107014
2025-09-30T14:51:01.903170Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.903171Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.903176Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 144 partNo : 0 messageNo: 291 size 15814 offset: -1
2025-09-30T14:51:01.929147Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 208 to 208
2025-09-30T14:51:01.903177Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903180Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.903181Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.929169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.903184Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929176Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 208
2025-09-30T14:51:01.903185Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.903192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.903238Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903239Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 286  requestId: <none> cookie: 145
2025-09-30T14:51:01.903260Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.903263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.929206Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 209 to 209
2025-09-30T14:51:01.903266Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 288  requestId: <none> cookie: 146
2025-09-30T14:51:01.903270Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 289  requestId: <none> cookie: 147
2025-09-30T14:51:01.903273Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 290  requestId: <none> cookie: 148
2025-09-30T14:51:01.903273Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903277Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
>>> event from dataHandler: 2025-09-30T14:51:01.903283Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903287Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.903291Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 209
2025-09-30T14:51:01.903295Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 292  requestId: <none> cookie: 149
2025-09-30T14:51:01.903295Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903299Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903303Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903307Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903311Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929273Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 210 to 210
2025-09-30T14:51:01.903315Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..20471 bytes.. Information: { Offset: 186 ProducerId: "src_id" SeqNo: 187 CreateTime: 2025-09-30T14:51:01.921000Z WriteTime: 2025-09-30T14:51:01.923000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20581 bytes.. Information: { Offset: 187 ProducerId: "src_id" SeqNo: 188 CreateTime: 2025-09-30T14:51:01.921000Z WriteTime: 2025-09-30T14:51:01.923000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20691 bytes.. Information: { Offset: 188 ProducerId: "src_id" SeqNo: 189 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.923000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20801 bytes.. Information: { Offset: 189 ProducerId: "src_id" SeqNo: 190 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.923000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..20911 bytes.. Information: { Offset: 190 ProducerId: "src_id" SeqNo: 191 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.923000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21021 bytes.. Information: { Offset: 191 ProducerId: "src_id" SeqNo: 192 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.923000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21131 bytes.. Information: { Offset: 192 ProducerId: "src_id" SeqNo: 193 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.923000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21241 bytes.. Information: { Offset: 193 ProducerId: "src_id" SeqNo: 194 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.923000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }2025-09-30T14:51:01.929284Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 152180, now ReadSizeBudget = 167301, ReadSizeServerDelta = 204807
2025-09-30T14:51:01.903319Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903323Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903327Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903347Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929305Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 167301, ReadSizeServerDelta = 204807
2025-09-30T14:51:01.903370Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929316Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.903392Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 210
2025-09-30T14:51:01.903397Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903404Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903454Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.903457Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.903465Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 145 partNo : 0 messageNo: 293 size 15924 offset: -1
2025-09-30T14:51:01.903471Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.903473Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.903477Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 146 partNo : 0 messageNo: 294 size 16034 offset: -1
2025-09-30T14:51:01.903481Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.903482Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.903487Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 147 partNo : 0 messageNo: 295 size 16144 offset: -1
2025-09-30T14:51:01.903491Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.903494Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.903498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 148 partNo : 0 messageNo: 296 size 16254 offset: -1
2025-09-30T14:51:01.929365Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 8, size 166848 bytes
2025-09-30T14:51:01.903500Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.929371Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 372108
2025-09-30T14:51:01.903502Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.929384Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.929387Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 211 to 211
2025-09-30T14:51:01.929397Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (194-200)
2025-09-30T14:51:01.903504Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.929403Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 152180 to budget
2025-09-30T14:51:01.929417Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.929420Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 211
2025-09-30T14:51:01.903508Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 149 partNo : 0 messageNo: 297 size 16364 offset: -1
2025-09-30T14:51:01.929424Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (194-194)
2025-09-30T14:51:01.929443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 212 to 212
2025-09-30T14:51:01.929446Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (195-195)
2025-09-30T14:51:01.903511Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.903511Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.929463Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (196-196)
2025-09-30T14:51:01.903517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.929469Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (197-197)
2025-09-30T14:51:01.929474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.929477Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 212
2025-09-30T14:51:01.903519Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.903522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.903523Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.903525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.903527Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.903530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.903532Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.903534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.903537Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.903539Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.903544Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.903546Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.903553Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 298  requestId: <none> cookie: 150
2025-09-30T14:51:01.903562Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 299  requestId: <none> cookie: 151
2025-09-30T14:51:01.903571Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.903587Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929537Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (198-198)
2025-09-30T14:51:01.903609Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.903611Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.903616Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 150 partNo : 0 messageNo: 300 size 16475 offset: -1
2025-09-30T14:51:01.903619Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.903623Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.903627Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 151 partNo : 0 messageNo: 301 size 16585 offset: -1
2025-09-30T14:51:01.903630Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.903633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.929570Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (199-199)
2025-09-30T14:51:01.903635Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.903637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.904665Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 135 count 7 size 107014 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.904683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.929593Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (200-200)
2025-09-30T14:51:01.904700Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 106897 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.904703Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 135 partno 0 count 7 parts 0 suffix '63' size 107014
2025-09-30T14:51:01.904709Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.929639Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 213 to 213
2025-09-30T14:51:01.904718Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 136, partNo: 0, Offset: 135 is stored on disk
2025-09-30T14:51:01.929648Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.904722Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.929651Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 213
2025-09-30T14:51:01.904726Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 137, partNo: 0, Offset: 136 is stored on disk
2025-09-30T14:51:01.904728Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.904732Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 138, partNo: 0, Offset: 137 is stored on disk
2025-09-30T14:51:01.904736Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.904740Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 139, partNo: 0, Offset: 138 is stored on disk
2025-09-30T14:51:01.904742Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.904746Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 140, partNo: 0, Offset: 139 is stored on disk
2025-09-30T14:51:01.904749Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.904752Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 141, partNo: 0, Offset: 140 is stored on disk
2025-09-30T14:51:01.904755Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.904759Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 142, partNo: 0, Offset: 141 is stored on disk
2025-09-30T14:51:01.904785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.904797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.904799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (9)
2025-09-30T14:51:01.904837Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 143 partNo 0
2025-09-30T14:51:01.904868Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 143 partNo 0 FormedBlobsCount 0 NewHead: Offset 142 PartNo 0 PackedSize 15778 count 1 nextOffset 143 batches 1
2025-09-30T14:51:01.904875Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 144 partNo 0
2025-09-30T14:51:01.904882Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 144 partNo 0 FormedBlobsCount 0 NewHead: Offset 142 PartNo 0 PackedSize 31634 count 2 nextOffset 144 batches 1
2025-09-30T14:51:01.929713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 214 to 214
2025-09-30T14:51:01.904886Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 145 partNo 0
2025-09-30T14:51:01.929719Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.904890Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 145 partNo 0 FormedBlobsCount 0 NewHead: Offset 142 PartNo 0 PackedSize 47600 count 3 nextOffset 145 batches 1
2025-09-30T14:51:01.929722Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 214
2025-09-30T14:51:01.904893Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 146 partNo 0
2025-09-30T14:51:01.904897Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 146 partNo 0 FormedBlobsCount 0 NewHead: Offset 142 PartNo 0 PackedSize 63676 count 4 nextOffset 146 batches 1
2025-09-30T14:51:01.904902Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 147 partNo 0
2025-09-30T14:51:01.904906Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 147 partNo 0 FormedBlobsCount 0 NewHead: Offset 142 PartNo 0 PackedSize 79862 count 5 nextOffset 147 batches 1
2025-09-30T14:51:01.904909Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 148 partNo 0
2025-09-30T14:51:01.904913Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 148 partNo 0 FormedBlobsCount 0 NewHead: Offset 142 PartNo 0 PackedSize 96158 count 6 nextOffset 148 batches 1
2025-09-30T14:51:01.904918Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 149 partNo 0
2025-09-30T14:51:01.904921Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 149 partNo 0 FormedBlobsCount 0 NewHead: Offset 142 PartNo 0 PackedSize 112564 count 7 nextOffset 149 batches 1
2025-09-30T14:51:01.904925Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 150 partNo 0
2025-09-30T14:51:01.904930Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 150 partNo 0 FormedBlobsCount 0 NewHead: Offset 142 PartNo 0 PackedSize 129081 count 8 nextOffset 150 batches 1
2025-09-30T14:51:01.904933Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 151 partNo 0
2025-09-30T14:51:01.904939Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 151 partNo 0 FormedBlobsCount 0 NewHead: Offset 142 PartNo 0 PackedSize 145708 count 9 nextOffset 151 batches 1
2025-09-30T14:51:01.904941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.905070Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 142,9 HeadOffset 142 endOffset 142 curOffset 151 d0000000000_00000000000000000142_00000_0000000009_00000? size 145486 WTime 1759243861904
2025-09-30T14:51:01.905206Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.905208Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.905210Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.905212Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.905214Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.905217Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.929787Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 215 to 215
>>> event from dataHandler: 2025-09-30T14:51:01.929793Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.929796Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 215
2025-09-30T14:51:01.905219Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.905221Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.905222Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.905225Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 9 keys were taken away. Let's read 1115148 bytes (1115148)
2025-09-30T14:51:01.905229Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 9, size 1115148 (8388608)
2025-09-30T14:51:01.905243Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 274  requestId: <none> cookie: 136
2025-09-30T14:51:01.905259Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 275  requestId: <none> cookie: 137
2025-09-30T14:51:01.905265Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 276  requestId: <none> cookie: 138
2025-09-30T14:51:01.905270Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 277  requestId: <none> cookie: 139
2025-09-30T14:51:01.905276Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 280  requestId: <none> cookie: 140
2025-09-30T14:51:01.905281Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 281  requestId: <none> cookie: 141
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..21351 bytes.. Information: { Offset: 194 ProducerId: "src_id" SeqNo: 195 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21461 bytes.. Information: { Offset: 195 ProducerId: "src_id" SeqNo: 196 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21571 bytes.. Information: { Offset: 196 ProducerId: "src_id" SeqNo: 197 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21681 bytes.. Information: { Offset: 197 ProducerId: "src_id" SeqNo: 198 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21791 bytes.. Information: { Offset: 198 ProducerId: "src_id" SeqNo: 199 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..21901 bytes.. Information: { Offset: 199 ProducerId: "src_id" SeqNo: 200 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..22011 bytes.. Information: { Offset: 200 ProducerId: "src_id" SeqNo: 201 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.925000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }2025-09-30T14:51:01.929859Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 216 to 216
2025-09-30T14:51:01.929865Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.905281Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 216
2025-09-30T14:51:01.905286Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 283  requestId: <none> cookie: 142
2025-09-30T14:51:01.905290Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.905292Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.905294Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.905298Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929906Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 7, size 151767 bytes
2025-09-30T14:51:01.905302Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.905306Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 142 partNo 0 count 9 size 145486
2025-09-30T14:51:01.929915Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.905306Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.905313Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.906580Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 142 count 9 size 145486 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.906607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.906622Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 145361 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.906621Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.906625Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 142 partno 0 count 9 parts 0 suffix '63' size 145486
2025-09-30T14:51:01.929958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 217 to 217
2025-09-30T14:51:01.929964Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.929967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 217
2025-09-30T14:51:01.906630Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.906640Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 143, partNo: 0, Offset: 142 is stored on disk
2025-09-30T14:51:01.906646Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.906650Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 144, partNo: 0, Offset: 143 is stored on disk
2025-09-30T14:51:01.906653Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.906657Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 145, partNo: 0, Offset: 144 is stored on disk
2025-09-30T14:51:01.906659Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.906663Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 146, partNo: 0, Offset: 145 is stored on disk
2025-09-30T14:51:01.906665Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.906670Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 147, partNo: 0, Offset: 146 is stored on disk
2025-09-30T14:51:01.906673Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.906676Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 148, partNo: 0, Offset: 147 is stored on disk
2025-09-30T14:51:01.906679Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.930014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 218 to 218
2025-09-30T14:51:01.930029Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.906682Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 149, partNo: 0, Offset: 148 is stored on disk
2025-09-30T14:51:01.930032Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 218
2025-09-30T14:51:01.906683Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.906685Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.906688Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 150, partNo: 0, Offset: 149 is stored on disk
2025-09-30T14:51:01.906691Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.906703Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 151, partNo: 0, Offset: 150 is stored on disk
2025-09-30T14:51:01.906729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.906731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.930080Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 219 to 219
2025-09-30T14:51:01.906733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.930972Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 112038, now ReadSizeBudget = 152180, ReadSizeServerDelta = 260070
2025-09-30T14:51:01.906742Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.906745Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.906746Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.906748Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.906750Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.932358Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.906751Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.932368Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 219
2025-09-30T14:51:01.906753Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.906755Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.932370Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 152180, ReadSizeServerDelta = 260070
2025-09-30T14:51:01.906756Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.906758Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.906760Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 10 keys were taken away. Let's read 1260634 bytes (1260634)
2025-09-30T14:51:01.906764Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 10, size 1260634 (8388608)
2025-09-30T14:51:01.906774Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 287  requestId: <none> cookie: 143
2025-09-30T14:51:01.906788Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 291  requestId: <none> cookie: 144
2025-09-30T14:51:01.906792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 293  requestId: <none> cookie: 145
2025-09-30T14:51:01.906803Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.906806Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 294  requestId: <none> cookie: 146
2025-09-30T14:51:01.932419Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 412250
2025-09-30T14:51:01.906808Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.906811Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 295  requestId: <none> cookie: 147
2025-09-30T14:51:01.906812Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.906816Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 296  requestId: <none> cookie: 148
2025-09-30T14:51:01.906817Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.906820Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 297  requestId: <none> cookie: 149
2025-09-30T14:51:01.906822Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.906825Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 300  requestId: <none> cookie: 150
2025-09-30T14:51:01.906827Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.906831Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 301  requestId: <none> cookie: 151
2025-09-30T14:51:01.906831Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.906837Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.932457Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (201-205)
2025-09-30T14:51:01.906843Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.932477Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 112038 to budget
2025-09-30T14:51:01.906862Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 302  requestId: <none> cookie: 152
2025-09-30T14:51:01.906902Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 168649 } }
2025-09-30T14:51:01.906960Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# ab6ef79c-6c3906a8-a7250a6e-bea8f461
2025-09-30T14:51:01.906975Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 3254ccd1-d85a861e-c2c54129-8728417c, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 30, size# 91316, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.932508Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 220 to 220
2025-09-30T14:51:01.906991Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 30 maxSize 91316 maxTimeLagMs 0 readTimestampMs 0 readOffset 110 EndOffset 135 ClientCommitOffset 0 committedOffset 0 Guid 3254ccd1-d85a861e-c2c54129-8728417c
2025-09-30T14:51:01.907049Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.932520Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.907052Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.932524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 220
2025-09-30T14:51:01.907083Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 11 Topic 'rt3.dc1--test-topic' partition 0 user user offset 110 count 30 size 91316 endOffset 151 max time lag 0ms effective offset 110
2025-09-30T14:51:01.907100Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 11 added 1 blobs, size 337927 count 25 last offset 110, current partition end offset: 151
2025-09-30T14:51:01.932533Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (201-201)
2025-09-30T14:51:01.932538Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 22844, now ReadSizeBudget = 112038, ReadSizeServerDelta = 389406
2025-09-30T14:51:01.907104Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 11. Send blob request.
2025-09-30T14:51:01.907117Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 110 partno 0 count 25 parts_count 0 source 1 size 337927 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.907127Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 11. All 1 blobs are from cache.
2025-09-30T14:51:01.932553Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 221 to 221
2025-09-30T14:51:01.907140Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.932580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.932583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 221
2025-09-30T14:51:01.932589Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (202-202)
2025-09-30T14:51:01.907146Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 110 partno 0 count 25 parts 0 suffix '63'
2025-09-30T14:51:01.907342Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.907378Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.907413Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.907419Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.907424Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.907499Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.907522Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.907588Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 110 totakecount 25 count 25 size 337905 from pos 0 cbcount 25
2025-09-30T14:51:01.907604Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.932632Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (203-203)
2025-09-30T14:51:01.907620Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.932642Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (204-204)
2025-09-30T14:51:01.907640Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.907643Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.907659Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 152 partNo : 0 messageNo: 303 size 16695 offset: -1
2025-09-30T14:51:01.907665Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.907668Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.907672Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.907674Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.907690Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 110
2025-09-30T14:51:01.907703Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.907704Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.907704Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.907715Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.907717Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.907728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.907735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.907737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.907756Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.907761Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 152 partNo 0
2025-09-30T14:51:01.907768Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.907785Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 152 partNo 0 FormedBlobsCount 0 NewHead: Offset 151 PartNo 0 PackedSize 16769 count 1 nextOffset 152 batches 1
2025-09-30T14:51:01.907786Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.907791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.932736Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (205-205)
2025-09-30T14:51:01.907863Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 151,1 HeadOffset 151 endOffset 151 curOffset 152 d0000000000_00000000000000000151_00000_0000000001_00000? size 16760 WTime 1759243861907
2025-09-30T14:51:01.907871Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.907936Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.907939Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.907944Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.907946Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.932756Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 112038, ReadSizeServerDelta = 389406
2025-09-30T14:51:01.907951Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.907962Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 151 partNo 0 count 1 size 16760
2025-09-30T14:51:01.907971Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 304  requestId: <none> cookie: 153
2025-09-30T14:51:01.907976Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 305  requestId: <none> cookie: 154
2025-09-30T14:51:01.907978Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 306  requestId: <none> cookie: 155
2025-09-30T14:51:01.932774Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 501444
2025-09-30T14:51:01.908017Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 307  requestId: <none> cookie: 156
2025-09-30T14:51:01.908020Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 308  requestId: <none> cookie: 157
2025-09-30T14:51:01.908043Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.908052Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.908058Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.932796Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (206-206)
2025-09-30T14:51:01.908062Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.932805Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 222 to 222
2025-09-30T14:51:01.908065Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.908069Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.932829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.932820Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 22844 to budget
2025-09-30T14:51:01.908113Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 151 Result { Offset: 110 Data: "... 12183 bytes ..." SourceId: "\000src_id" SeqNo: 111 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861887 UncompressedSize: 12111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 111 Data: "... 12293 bytes ..." SourceId: "\000src_id" SeqNo: 112 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861887 UncompressedSize: 12221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 112 Data: "... 12403 bytes ..." SourceId: "\000src_id" SeqNo: 113 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861887 UncompressedSize: 12331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 113 Data: "... 12513 bytes ..." SourceId: "\000src_id" SeqNo: 114 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861887 UncompressedSize: 12441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 114 Data: "... 12623 bytes ..." SourceId: "\000src_id" SeqNo: 115 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861887 UncompressedSize: 12551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 115 Data: "... 12733 bytes ..." SourceId: "\000src_id" SeqNo: 116 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861887 UncompressedSize: 12661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 116 Data: "... 12843 bytes ..." SourceId: "\000src_id" SeqNo: 117 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861887 UncompressedSize: 12771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 117 Data: "... 12953 bytes ..." SourceId: "\000src_id" SeqNo: 118 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861888 UncompressedSize: 12881 PartitionKey: "" ExplicitHash: "" } Result { Offset: 118 Data: "... 13063 bytes ..." SourceId: "\000src_id" SeqNo: 119 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861888 UncompressedSize: 12991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 119 Data: "... 13173 bytes ..." SourceId: "\000src_id" SeqNo: 120 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861888 UncompressedSize: 13101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 120 Data: "... 13283 bytes ..." SourceId: "\000src_id" SeqNo: 121 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861889 UncompressedSize: 13211 PartitionKey: "" ExplicitHash: "" } Result { Offset: 121 Data: "... 13393 bytes ..." SourceId: "\000src_id" SeqNo: 122 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861890 UncompressedSize: 13321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 122 Data: "... 13503 bytes ..." SourceId: "\000src_id" SeqNo: 123 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861890 UncompressedSize: 13431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 123 Data: "... 13613 bytes ..." SourceId: "\000src_id" SeqNo: 124 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861890 UncompressedSize: 13541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 124 Data: "... 13723 bytes ..." SourceId: "\000src_id" SeqNo: 125 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861891 UncompressedSize: 13651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 125 Data: "... 13833 bytes ..." SourceId: "\000src_id" SeqNo: 126 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861891 UncompressedSize: 13761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 126 Data: "... 13943 bytes ..." SourceId: "\000src_id" SeqNo: 127 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861891 UncompressedSize: 13871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 127 Data: "... 14054 bytes ..." SourceId: "\000src_id" SeqNo: 128 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861891 UncompressedSize: 13981 PartitionKey: "" ExplicitHash: "" } Result { Offset: 128 Data: "... 14164 bytes ..." SourceId: "\000src_id" SeqNo: 129 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861891 UncompressedSize: 14091 PartitionKey: "" ExplicitHash: "" } Result { Offset: 129 Data: "... 14274 bytes ..." SourceId: "\000src_id" SeqNo: 130 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861891 UncompressedSize: 14201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 130 Data: "... 14384 bytes ..." SourceId: "\000src_id" SeqNo: 131 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861891 UncompressedSize: 14311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 131 Data: "... 14494 bytes ..." SourceId: "\000src_id" SeqNo: 132 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861891 UncompressedSize: 14421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 132 Data: "... 14604 bytes ..." SourceId: "\000src_id" SeqNo: 133 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861891 UncompressedSize: 14531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 133 Data: "... 14714 bytes ..." SourceId: "\000src_id" SeqNo: 134 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861891 UncompressedSize: 14641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 134 Data: "... 14824 bytes ..." SourceId: "\000src_id" SeqNo: 135 WriteTimestampMS: 1759243861898 CreateTimestampMS: 1759243861891 UncompressedSize: 14751 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 444235 RealReadOffset: 134 WaitQuotaTimeMs: 0 EndOffset: 151 StartOffset: 0 } Cookie: 110 }
2025-09-30T14:51:01.932845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 222
2025-09-30T14:51:01.908127Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.908135Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.908142Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.932867Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (206-206)
2025-09-30T14:51:01.908149Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.908151Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.908159Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 153 partNo : 0 messageNo: 309 size 16805 offset: -1
2025-09-30T14:51:01.908163Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
>>> event from dataHandler: 2025-09-30T14:51:01.908165Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.908169Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 154 partNo : 0 messageNo: 310 size 16915 offset: -1
2025-09-30T14:51:01.908172Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.908174Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.908179Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 155 partNo : 0 messageNo: 311 size 17025 offset: -1
2025-09-30T14:51:01.908183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.908184Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.908188Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 156 partNo : 0 messageNo: 312 size 17135 offset: -1
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..22121 bytes.. Information: { Offset: 201 ProducerId: "src_id" SeqNo: 202 CreateTime: 2025-09-30T14:51:01.922000Z WriteTime: 2025-09-30T14:51:01.927000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..22231 bytes.. Information: { Offset: 202 ProducerId: "src_id" SeqNo: 203 CreateTime: 2025-09-30T14:51:01.925000Z WriteTime: 2025-09-30T14:51:01.927000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..22341 bytes.. Information: { Offset: 203 ProducerId: "src_id" SeqNo: 204 CreateTime: 2025-09-30T14:51:01.925000Z WriteTime: 2025-09-30T14:51:01.927000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..22451 bytes.. Information: { Offset: 204 ProducerId: "src_id" SeqNo: 205 CreateTime: 2025-09-30T14:51:01.925000Z WriteTime: 2025-09-30T14:51:01.927000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..22561 bytes.. Information: { Offset: 205 ProducerId: "src_id" SeqNo: 206 CreateTime: 2025-09-30T14:51:01.925000Z WriteTime: 2025-09-30T14:51:01.927000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.908191Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.908193Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.908197Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 157 partNo : 0 messageNo: 313 size 17245 offset: -1
2025-09-30T14:51:01.908201Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.908202Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.932967Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 5, size 111705 bytes
2025-09-30T14:51:01.908206Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.932972Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 223 to 223
2025-09-30T14:51:01.932977Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.908207Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.908211Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
>>> event from dataHandler: DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..22671 bytes.. Information: { Offset: 206 ProducerId: "src_id" SeqNo: 207 CreateTime: 2025-09-30T14:51:01.925000Z WriteTime: 2025-09-30T14:51:01.929000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.908213Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.933003Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.908218Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.933024Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 1, size 22671 bytes
2025-09-30T14:51:01.908224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.933027Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.908226Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.933030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 223
2025-09-30T14:51:01.908228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.908230Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.908232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.908233Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.908236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.908238Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.908240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.908245Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 135 endOffset 151
2025-09-30T14:51:01.908247Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 314  requestId: <none> cookie: 158
2025-09-30T14:51:01.908252Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 315  requestId: <none> cookie: 159
2025-09-30T14:51:01.908253Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 151 ReadOffset 135 ReadGuid 3254ccd1-d85a861e-c2c54129-8728417c has messages 1
2025-09-30T14:51:01.908255Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 316  requestId: <none> cookie: 160
2025-09-30T14:51:01.908265Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 135, endOffset# 151, WTime# 1759243861898, sizeLag# 444235
2025-09-30T14:51:01.933095Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 224 to 224
2025-09-30T14:51:01.908267Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 0
2025-09-30T14:51:01.933114Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.933117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 224
2025-09-30T14:51:01.908273Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.908278Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.908282Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.908294Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 3254ccd1-d85a861e-c2c54129-8728417c, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 336798
2025-09-30T14:51:01.908303Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.908304Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 3254ccd1-d85a861e-c2c54129-8728417c
2025-09-30T14:51:01.908307Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.908320Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 158 partNo : 0 messageNo: 317 size 17355 offset: -1
2025-09-30T14:51:01.933153Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 225 to 225
2025-09-30T14:51:01.908326Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.933172Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.908327Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.933175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 225
2025-09-30T14:51:01.908332Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 159 partNo : 0 messageNo: 318 size 17465 offset: -1
2025-09-30T14:51:01.908335Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.908337Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.908341Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 160 partNo : 0 messageNo: 319 size 17575 offset: -1
2025-09-30T14:51:01.908345Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.908354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.908356Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.908359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.908361Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.908363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.908782Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 1
2025-09-30T14:51:01.909127Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 151 count 1 size 16760 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.909142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.909155Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 151 partno 0 count 1 parts 0 suffix '63' size 16760
2025-09-30T14:51:01.909156Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 16702 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.909163Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.909170Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 152, partNo: 0, Offset: 151 is stored on disk
2025-09-30T14:51:01.909194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.909203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.909205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (8)
2025-09-30T14:51:01.909221Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 153 partNo 0
2025-09-30T14:51:01.909246Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 153 partNo 0 FormedBlobsCount 0 NewHead: Offset 152 PartNo 0 PackedSize 16879 count 1 nextOffset 153 batches 1
2025-09-30T14:51:01.909254Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 154 partNo 0
2025-09-30T14:51:01.909259Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 154 partNo 0 FormedBlobsCount 0 NewHead: Offset 152 PartNo 0 PackedSize 33836 count 2 nextOffset 154 batches 1
2025-09-30T14:51:01.909263Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 155 partNo 0
2025-09-30T14:51:01.909268Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 155 partNo 0 FormedBlobsCount 0 NewHead: Offset 152 PartNo 0 PackedSize 50903 count 3 nextOffset 155 batches 1
2025-09-30T14:51:01.909271Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 156 partNo 0
2025-09-30T14:51:01.909274Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 156 partNo 0 FormedBlobsCount 0 NewHead: Offset 152 PartNo 0 PackedSize 68080 count 4 nextOffset 156 batches 1
2025-09-30T14:51:01.909278Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 157 partNo 0
2025-09-30T14:51:01.909291Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 157 partNo 0 FormedBlobsCount 0 NewHead: Offset 152 PartNo 0 PackedSize 85367 count 5 nextOffset 157 batches 1
2025-09-30T14:51:01.909296Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 158 partNo 0
2025-09-30T14:51:01.909301Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 158 partNo 0 FormedBlobsCount 0 NewHead: Offset 152 PartNo 0 PackedSize 102764 count 6 nextOffset 158 batches 1
2025-09-30T14:51:01.909304Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 159 partNo 0
2025-09-30T14:51:01.933289Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 226 to 226
2025-09-30T14:51:01.909308Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 159 partNo 0 FormedBlobsCount 0 NewHead: Offset 152 PartNo 0 PackedSize 120271 count 7 nextOffset 159 batches 1
2025-09-30T14:51:01.909311Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 160 partNo 0
2025-09-30T14:51:01.909315Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 160 partNo 0 FormedBlobsCount 0 NewHead: Offset 152 PartNo 0 PackedSize 137888 count 8 nextOffset 160 batches 1
2025-09-30T14:51:01.909318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.933302Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.909426Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 152,8 HeadOffset 152 endOffset 152 curOffset 160 d0000000000_00000000000000000152_00000_0000000008_00000? size 137704 WTime 1759243861909
2025-09-30T14:51:01.933319Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 226
2025-09-30T14:51:01.909459Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.909461Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.909464Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.909466Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.909468Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.909469Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.909471Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.909473Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.909475Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.909477Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.909478Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.909481Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 11 keys were taken away. Let's read 1277394 bytes (1277394)
2025-09-30T14:51:01.909484Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 11, size 1277394 (8388608)
2025-09-30T14:51:01.909495Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 303  requestId: <none> cookie: 152
2025-09-30T14:51:01.909512Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.909522Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 152 partNo 0 count 8 size 137704
2025-09-30T14:51:01.909531Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.910723Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 152 count 8 size 137704 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.910736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.910748Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 137576 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.933395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 227 to 227
2025-09-30T14:51:01.910748Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 152 partno 0 count 8 parts 0 suffix '63' size 137704
2025-09-30T14:51:01.933402Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.933405Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 227
2025-09-30T14:51:01.910754Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.910764Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 153, partNo: 0, Offset: 152 is stored on disk
2025-09-30T14:51:01.910779Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.910783Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 154, partNo: 0, Offset: 153 is stored on disk
2025-09-30T14:51:01.910786Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.910790Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 155, partNo: 0, Offset: 154 is stored on disk
2025-09-30T14:51:01.910793Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.910797Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 156, partNo: 0, Offset: 155 is stored on disk
2025-09-30T14:51:01.910799Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.910803Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 157, partNo: 0, Offset: 156 is stored on disk
2025-09-30T14:51:01.910805Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.910810Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 158, partNo: 0, Offset: 157 is stored on disk
2025-09-30T14:51:01.910812Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.910815Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 159, partNo: 0, Offset: 158 is stored on disk
2025-09-30T14:51:01.910819Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.910823Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 160, partNo: 0, Offset: 159 is stored on disk
2025-09-30T14:51:01.910846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.910848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.910850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.933474Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 228 to 228
2025-09-30T14:51:01.910858Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.910860Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.933481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.910862Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.910864Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.910866Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.933484Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 228
2025-09-30T14:51:01.910868Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.910870Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.910874Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.910876Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.910878Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.933572Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 229 to 229
2025-09-30T14:51:01.934834Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 257333, now ReadSizeBudget = 22844, ReadSizeServerDelta = 244111
2025-09-30T14:51:01.910880Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.910882Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.910884Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 12 keys were taken away. Let's read 1415098 bytes (1415098)
2025-09-30T14:51:01.910887Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 12, size 1415098 (8388608)
2025-09-30T14:51:01.910896Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 309  requestId: <none> cookie: 153
2025-09-30T14:51:01.910908Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 310  requestId: <none> cookie: 154
2025-09-30T14:51:01.910914Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 311  requestId: <none> cookie: 155
2025-09-30T14:51:01.910918Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 312  requestId: <none> cookie: 156
2025-09-30T14:51:01.937422Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.910919Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.910922Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 313  requestId: <none> cookie: 157
2025-09-30T14:51:01.937438Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 22844, ReadSizeServerDelta = 244111
2025-09-30T14:51:01.910927Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.910927Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 317  requestId: <none> cookie: 158
2025-09-30T14:51:01.910931Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.910932Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 318  requestId: <none> cookie: 159
2025-09-30T14:51:01.910935Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.910937Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 319  requestId: <none> cookie: 160
2025-09-30T14:51:01.937456Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 229
2025-09-30T14:51:01.910942Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.910947Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.910952Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.910957Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912331Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.912428Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.912455Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.912479Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.912500Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912508Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912523Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912525Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912527Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.912544Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 320  requestId: <none> cookie: 161
2025-09-30T14:51:01.912551Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 321  requestId: <none> cookie: 162
2025-09-30T14:51:01.912583Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912591Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912604Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.912644Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912648Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.912648Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912657Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.912665Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.912666Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 161 partNo : 0 messageNo: 322 size 17685 offset: -1
2025-09-30T14:51:01.912672Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912674Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912679Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 162 partNo : 0 messageNo: 323 size 17795 offset: -1
2025-09-30T14:51:01.937550Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 266955
2025-09-30T14:51:01.912683Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912686Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912693Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.912697Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.912706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.912713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.912715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.937587Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 230 to 230
2025-09-30T14:51:01.912741Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 161 partNo 0
2025-09-30T14:51:01.912747Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 769770 } }
2025-09-30T14:51:01.912805Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# c9431216-5ab898b3-baa741bd-98634772
2025-09-30T14:51:01.937600Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.912806Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 161 partNo 0 FormedBlobsCount 0 NewHead: Offset 160 PartNo 0 PackedSize 17759 count 1 nextOffset 161 batches 1
2025-09-30T14:51:01.937604Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 230
2025-09-30T14:51:01.912813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.912821Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 9eec5643-7a1a39ee-715b71c9-38cd6d83, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 19, size# 524288, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.937609Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (207-217)
2025-09-30T14:51:01.937621Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 231 to 231
2025-09-30T14:51:01.912829Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.912860Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.912867Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.937636Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.912881Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 160,1 HeadOffset 160 endOffset 160 curOffset 161 d0000000000_00000000000000000160_00000_0000000001_00000? size 17750 WTime 1759243861912
2025-09-30T14:51:01.937641Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 231
2025-09-30T14:51:01.937640Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 257333 to budget
2025-09-30T14:51:01.912899Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.912901Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.912907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.937660Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 72675, now ReadSizeBudget = 257333, ReadSizeServerDelta = 194280
2025-09-30T14:51:01.912913Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 19 maxSize 524288 maxTimeLagMs 0 readTimestampMs 0 readOffset 135 EndOffset 151 ClientCommitOffset 0 committedOffset 0 Guid 9eec5643-7a1a39ee-715b71c9-38cd6d83
2025-09-30T14:51:01.937665Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (207-207)
2025-09-30T14:51:01.912913Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912915Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912921Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912923Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912926Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.937681Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (208-208)
2025-09-30T14:51:01.912928Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912929Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.937695Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (209-209)
2025-09-30T14:51:01.912934Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.912946Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 160 partNo 0 count 1 size 17750
2025-09-30T14:51:01.912955Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.937702Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (210-210)
2025-09-30T14:51:01.912956Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.912964Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 324  requestId: <none> cookie: 163
2025-09-30T14:51:01.912979Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.912986Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.912994Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.937728Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (211-211)
2025-09-30T14:51:01.912997Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.912999Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.937734Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (212-212)
2025-09-30T14:51:01.913047Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 325  requestId: <none> cookie: 164
2025-09-30T14:51:01.913051Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 326  requestId: <none> cookie: 165
2025-09-30T14:51:01.937741Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (213-213)
2025-09-30T14:51:01.913051Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.913056Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.913056Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.913057Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913063Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 163 partNo : 0 messageNo: 329 size 17905 offset: -1
2025-09-30T14:51:01.913063Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.937758Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (214-214)
2025-09-30T14:51:01.913071Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 327  requestId: <none> cookie: 166
2025-09-30T14:51:01.913076Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.913099Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 328  requestId: <none> cookie: 167
2025-09-30T14:51:01.913103Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.913103Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.913104Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913108Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.913110Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913114Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 164 partNo : 0 messageNo: 331 size 18015 offset: -1
2025-09-30T14:51:01.913117Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.913120Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.937791Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (215-215)
2025-09-30T14:51:01.913124Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 165 partNo : 0 messageNo: 332 size 18125 offset: -1
2025-09-30T14:51:01.913127Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.937798Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (216-216)
2025-09-30T14:51:01.913131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.913144Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.937805Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 2} (217-217)
2025-09-30T14:51:01.913146Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913151Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.913153Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913159Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 166 partNo : 0 messageNo: 334 size 18235 offset: -1
2025-09-30T14:51:01.913163Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.913164Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.913166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.913168Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.913171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.937831Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 257333, ReadSizeServerDelta = 194280
2025-09-30T14:51:01.913173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.913175Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913179Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 167 partNo : 0 messageNo: 335 size 18345 offset: -1
2025-09-30T14:51:01.913187Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 12 Topic 'rt3.dc1--test-topic' partition 0 user user offset 135 count 19 size 524288 endOffset 160 max time lag 0ms effective offset 135
2025-09-30T14:51:01.913239Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.913242Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 12 added 4 blobs, size 406964 count 25 last offset 152, current partition end offset: 160
2025-09-30T14:51:01.937851Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 451613
2025-09-30T14:51:01.913247Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 12. Send blob request.
2025-09-30T14:51:01.913248Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.913252Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.913256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.913259Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 330  requestId: <none> cookie: 168
2025-09-30T14:51:01.913262Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.913264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.913274Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 135 partno 0 count 7 parts_count 0 source 1 size 107014 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.913278Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 142 partno 0 count 9 parts_count 0 source 1 size 145486 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.913281Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 151 partno 0 count 1 parts_count 0 source 1 size 16760 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.913284Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 152 partno 0 count 8 parts_count 0 source 1 size 137704 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.937882Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (218-220)
2025-09-30T14:51:01.913290Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 12. All 4 blobs are from cache.
2025-09-30T14:51:01.913299Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.937900Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 72675 to budget
2025-09-30T14:51:01.913299Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 333  requestId: <none> cookie: 169
2025-09-30T14:51:01.913301Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 135 partno 0 count 7 parts 0 suffix '63'
2025-09-30T14:51:01.913304Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 142 partno 0 count 9 parts 0 suffix '63'
2025-09-30T14:51:01.913307Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.913308Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 151 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:51:01.913311Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.913310Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 152 partno 0 count 8 parts 0 suffix '63'
2025-09-30T14:51:01.913323Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.913325Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.937936Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (218-218)
2025-09-30T14:51:01.937936Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 232 to 232
2025-09-30T14:51:01.913333Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 4 blobs
2025-09-30T14:51:01.913365Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.937963Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.913378Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.937967Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 232
2025-09-30T14:51:01.913413Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.937970Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (219-219)
2025-09-30T14:51:01.913421Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.913423Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 135 totakecount 7 count 7 size 106991 from pos 0 cbcount 7
2025-09-30T14:51:01.913429Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.913478Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.913485Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.913553Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 142 totakecount 9 count 9 size 145463 from pos 0 cbcount 9
2025-09-30T14:51:01.913577Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 151 totakecount 1 count 1 size 16737 from pos 0 cbcount 1
2025-09-30T14:51:01.913641Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 152 totakecount 8 count 8 size 137681 from pos 0 cbcount 8
2025-09-30T14:51:01.913669Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.913672Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913681Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 168 partNo : 0 messageNo: 337 size 18455 offset: -1
2025-09-30T14:51:01.913690Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.913692Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913696Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 169 partNo : 0 messageNo: 338 size 18565 offset: -1
2025-09-30T14:51:01.913699Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.913701Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913705Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.913709Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913713Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938037Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 1} (220-220)
2025-09-30T14:51:01.913714Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938050Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 172970, now ReadSizeBudget = 72675, ReadSizeServerDelta = 278643
>>> event from dataHandler: 2025-09-30T14:51:01.938072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 233 to 233
2025-09-30T14:51:01.938073Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 72675, ReadSizeServerDelta = 278643
2025-09-30T14:51:01.938078Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.913718Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 233
2025-09-30T14:51:01.913720Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.913748Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 135
2025-09-30T14:51:01.913764Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.913769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.913772Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 336  requestId: <none> cookie: 170
2025-09-30T14:51:01.913784Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.913787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.913798Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.913812Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.913972Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 339  requestId: <none> cookie: 171
2025-09-30T14:51:01.913976Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 340  requestId: <none> cookie: 172
2025-09-30T14:51:01.938121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 234 to 234
2025-09-30T14:51:01.913979Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 341  requestId: <none> cookie: 173
2025-09-30T14:51:01.913982Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 342  requestId: <none> cookie: 174
2025-09-30T14:51:01.938127Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..22781 bytes.. Information: { Offset: 207 ProducerId: "src_id" SeqNo: 208 CreateTime: 2025-09-30T14:51:01.929000Z WriteTime: 2025-09-30T14:51:01.930000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..22891 bytes.. Information: { Offset: 208 ProducerId: "src_id" SeqNo: 209 CreateTime: 2025-09-30T14:51:01.929000Z WriteTime: 2025-09-30T14:51:01.930000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23001 bytes.. Information: { Offset: 209 ProducerId: "src_id" SeqNo: 210 CreateTime: 2025-09-30T14:51:01.929000Z WriteTime: 2025-09-30T14:51:01.930000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23111 bytes.. Information: { Offset: 210 ProducerId: "src_id" SeqNo: 211 CreateTime: 2025-09-30T14:51:01.929000Z WriteTime: 2025-09-30T14:51:01.930000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23221 bytes.. Information: { Offset: 211 ProducerId: "src_id" SeqNo: 212 CreateTime: 2025-09-30T14:51:01.929000Z WriteTime: 2025-09-30T14:51:01.930000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23331 bytes.. Information: { Offset: 212 ProducerId: "src_id" SeqNo: 213 CreateTime: 2025-09-30T14:51:01.929000Z WriteTime: 2025-09-30T14:51:01.930000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23441 bytes.. Information: { Offset: 213 ProducerId: "src_id" SeqNo: 214 CreateTime: 2025-09-30T14:51:01.929000Z WriteTime: 2025-09-30T14:51:01.930000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23551 bytes.. Information: { Offset: 214 ProducerId: "src_id" SeqNo: 215 CreateTime: 2025-09-30T14:51:01.929000Z WriteTime: 2025-09-30T14:51:01.930000Z MessageGroupId: "src_id" Meta: { "server": "ipv6:[::1]:48840", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23661 bytes.. Information: { Offset: 215 ProducerId: "src_id" SeqNo: 216 CreateTime: 2025-09-30T14:51:01.929000Z WriteTime: 2025-09-30T14:51:01.931000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23771 bytes.. Information: { Offset: 216 ProducerId: "src_id" SeqNo: 217 CreateTime: 2025-09-30T14:51:01.929000Z WriteTime: 2025-09-30T14:51:01.931000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..23881 bytes.. Information: { Offset: 217 ProducerId: "src_id" SeqNo: 218 CreateTime: 2025-09-30T14:51:01.929000Z WriteTime: 2025-09-30T14:51:01.931000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.913986Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.913989Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938138Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 351318
2025-09-30T14:51:01.938129Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 234
2025-09-30T14:51:01.913996Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 170 partNo : 0 messageNo: 343 size 18675 offset: -1
2025-09-30T14:51:01.914000Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.914002Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.914006Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.938180Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (221-227)
2025-09-30T14:51:01.914011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.914015Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 344  requestId: <none> cookie: 175
2025-09-30T14:51:01.938197Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 172970 to budget
2025-09-30T14:51:01.914027Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.914035Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.938207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 235 to 235
2025-09-30T14:51:01.938212Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (221-221)
2025-09-30T14:51:01.938216Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 11, size 256641 bytes
2025-09-30T14:51:01.914040Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.938224Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (222-222)
2025-09-30T14:51:01.938228Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.914044Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.938233Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.938237Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 235
2025-09-30T14:51:01.938239Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (223-223)
2025-09-30T14:51:01.938246Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (224-224)
2025-09-30T14:51:01.914048Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.914072Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938263Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (225-225)
2025-09-30T14:51:01.914074Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.914079Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 171 partNo : 0 messageNo: 345 size 18785 offset: -1
2025-09-30T14:51:01.938274Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (226-226)
2025-09-30T14:51:01.914082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938282Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (227-227)
2025-09-30T14:51:01.914083Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.914087Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 172 partNo : 0 messageNo: 346 size 18895 offset: -1
2025-09-30T14:51:01.914090Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.914092Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
>>> event from dataHandler: 2025-09-30T14:51:01.914096Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 173 partNo : 0 messageNo: 347 size 19005 offset: -1
2025-09-30T14:51:01.914099Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.914101Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.914105Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 174 partNo : 0 messageNo: 348 size 19115 offset: -1
2025-09-30T14:51:01.914109Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..23991 bytes.. Information: { Offset: 218 ProducerId: "src_id" SeqNo: 219 CreateTime: 2025-09-30T14:51:01.930000Z WriteTime: 2025-09-30T14:51:01.932000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24101 bytes.. Information: { Offset: 219 ProducerId: "src_id" SeqNo: 220 CreateTime: 2025-09-30T14:51:01.932000Z WriteTime: 2025-09-30T14:51:01.933000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24211 bytes.. Information: { Offset: 220 ProducerId: "src_id" SeqNo: 221 CreateTime: 2025-09-30T14:51:01.932000Z WriteTime: 2025-09-30T14:51:01.933000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.914111Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.914115Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 175 partNo : 0 messageNo: 349 size 19225 offset: -1
2025-09-30T14:51:01.914118Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.914121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.914123Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.914125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.914126Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.914129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.914130Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.914133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.914135Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.914137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.914154Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 160 Result { Offset: 135 Data: "... 14934 bytes ..." SourceId: "\000src_id" SeqNo: 136 WriteTimestampMS: 1759243861902 CreateTimestampMS: 1759243861891 UncompressedSize: 14861 PartitionKey: "" ExplicitHash: "" } Result { Offset: 136 Data: "... 15044 bytes ..." SourceId: "\000src_id" SeqNo: 137 WriteTimestampMS: 1759243861902 CreateTimestampMS: 1759243861899 UncompressedSize: 14971 PartitionKey: "" ExplicitHash: "" } Result { Offset: 137 Data: "... 15154 bytes ..." SourceId: "\000src_id" SeqNo: 138 WriteTimestampMS: 1759243861902 CreateTimestampMS: 1759243861899 UncompressedSize: 15081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 138 Data: "... 15264 bytes ..." SourceId: "\000src_id" SeqNo: 139 WriteTimestampMS: 1759243861902 CreateTimestampMS: 1759243861899 UncompressedSize: 15191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 139 Data: "... 15374 bytes ..." SourceId: "\000src_id" SeqNo: 140 WriteTimestampMS: 1759243861902 CreateTimestampMS: 1759243861899 UncompressedSize: 15301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 140 Data: "... 15484 bytes ..." SourceId: "\000src_id" SeqNo: 141 WriteTimestampMS: 1759243861902 CreateTimestampMS: 1759243861899 UncompressedSize: 15411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 141 Data: "... 15594 bytes ..." SourceId: "\000src_id" SeqNo: 142 WriteTimestampMS: 1759243861902 CreateTimestampMS: 1759243861899 UncompressedSize: 15521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 142 Data: "... 15704 bytes ..." SourceId: "\000src_id" SeqNo: 143 WriteTimestampMS: 1759243861904 CreateTimestampMS: 1759243861899 UncompressedSize: 15631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 143 Data: "... 15814 bytes ..." SourceId: "\000src_id" SeqNo: 144 WriteTimestampMS: 1759243861904 CreateTimestampMS: 1759243861900 UncompressedSize: 15741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 144 Data: "... 15924 bytes ..." SourceId: "\000src_id" SeqNo: 145 WriteTimestampMS: 1759243861904 CreateTimestampMS: 1759243861900 UncompressedSize: 15851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 145 Data: "... 16034 bytes ..." SourceId: "\000src_id" SeqNo: 146 WriteTimestampMS: 1759243861904 CreateTimestampMS: 1759243861900 UncompressedSize: 15961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 146 Data: "... 16144 bytes ..." SourceId: "\000src_id" SeqNo: 147 WriteTimestampMS: 1759243861904 CreateTimestampMS: 1759243861900 UncompressedSize: 16071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 147 Data: "... 16254 bytes ..." SourceId: "\000src_id" SeqNo: 148 WriteTimestampMS: 1759243861904 CreateTimestampMS: 1759243861900 UncompressedSize: 16181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 148 Data: "... 16364 bytes ..." SourceId: "\000src_id" SeqNo: 149 WriteTimestampMS: 1759243861904 CreateTimestampMS: 1759243861900 UncompressedSize: 16291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 149 Data: "... 16475 bytes ..." SourceId: "\000src_id" SeqNo: 150 WriteTimestampMS: 1759243861904 CreateTimestampMS: 1759243861900 UncompressedSize: 16401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 150 Data: "... 16585 bytes ..." SourceId: "\000src_id" SeqNo: 151 WriteTimestampMS: 1759243861904 CreateTimestampMS: 1759243861900 UncompressedSize: 16511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 151 Data: "... 16695 bytes ..." SourceId: "\000src_id" SeqNo: 152 WriteTimestampMS: 1759243861907 CreateTimestampMS: 1759243861901 UncompressedSize: 16621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 152 Data: "... 16805 bytes ..." SourceId: "\000src_id" SeqNo: 153 WriteTimestampMS: 1759243861908 CreateTimestampMS: 1759243861906 UncompressedSize: 16731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 153 Data: "... 16915 bytes ..." SourceId: "\000src_id" SeqNo: 154 WriteTimestampMS: 1759243861908 CreateTimestampMS: 1759243861906 UncompressedSize: 16841 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 4 SizeLag: 72915 RealReadOffset: 153 WaitQuotaTimeMs: 0 EndOffset: 160 StartOffset: 0 } Cookie: 135 }
2025-09-30T14:51:01.914326Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 154 endOffset 160
2025-09-30T14:51:01.914341Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 160 ReadOffset 154 ReadGuid 9eec5643-7a1a39ee-715b71c9-38cd6d83 has messages 1
2025-09-30T14:51:01.914359Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 154, endOffset# 160, WTime# 1759243861908, sizeLag# 72915
2025-09-30T14:51:01.914362Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 0
2025-09-30T14:51:01.914386Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 9eec5643-7a1a39ee-715b71c9-38cd6d83, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 302377
2025-09-30T14:51:01.914398Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 9eec5643-7a1a39ee-715b71c9-38cd6d83
2025-09-30T14:51:01.914489Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 160 count 1 size 17750 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.914505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.914521Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 17692 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.914522Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 160 partno 0 count 1 parts 0 suffix '63' size 17750
2025-09-30T14:51:01.914530Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.914538Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 161, partNo: 0, Offset: 160 is stored on disk
2025-09-30T14:51:01.914566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.914579Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.914582Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (14)
2025-09-30T14:51:01.914613Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 162 partNo 0
2025-09-30T14:51:01.914633Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 162 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 17869 count 1 nextOffset 162 batches 1
2025-09-30T14:51:01.914639Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 163 partNo 0
2025-09-30T14:51:01.914643Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 163 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 35816 count 2 nextOffset 163 batches 1
2025-09-30T14:51:01.914646Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 164 partNo 0
2025-09-30T14:51:01.938500Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 1 offsets: 0 already_written: false write_statistics { persist_duration_ms: 1 }
2025-09-30T14:51:01.940775Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 25264, now ReadSizeBudget = 172970, ReadSizeServerDelta = 326054
2025-09-30T14:51:01.914649Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 164 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 53873 count 3 nextOffset 164 batches 1
2025-09-30T14:51:01.942330Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 3, size 72303 bytes
2025-09-30T14:51:01.942330Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 1
2025-09-30T14:51:01.914652Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 165 partNo 0
2025-09-30T14:51:01.914654Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 165 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 72040 count 4 nextOffset 165 batches 1
2025-09-30T14:51:01.914656Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 166 partNo 0
2025-09-30T14:51:01.942353Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 172970, ReadSizeServerDelta = 326054
2025-09-30T14:51:01.914659Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 166 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 90317 count 5 nextOffset 166 batches 1
2025-09-30T14:51:01.914661Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 167 partNo 0
2025-09-30T14:51:01.914664Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 167 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 108704 count 6 nextOffset 167 batches 1
2025-09-30T14:51:01.914666Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 168 partNo 0
2025-09-30T14:51:01.914669Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 168 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 127201 count 7 nextOffset 168 batches 1
2025-09-30T14:51:01.914673Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 169 partNo 0
2025-09-30T14:51:01.914675Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 169 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 145808 count 8 nextOffset 169 batches 1
2025-09-30T14:51:01.914677Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 170 partNo 0
2025-09-30T14:51:01.914681Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 170 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 164525 count 9 nextOffset 170 batches 1
2025-09-30T14:51:01.914683Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 171 partNo 0
2025-09-30T14:51:01.914686Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 171 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 183352 count 10 nextOffset 171 batches 1
2025-09-30T14:51:01.914689Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 172 partNo 0
2025-09-30T14:51:01.914691Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 172 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 202289 count 11 nextOffset 172 batches 1
2025-09-30T14:51:01.914693Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 173 partNo 0
2025-09-30T14:51:01.914696Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 173 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 221336 count 12 nextOffset 173 batches 1
2025-09-30T14:51:01.914698Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 174 partNo 0
2025-09-30T14:51:01.914700Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 174 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 240493 count 13 nextOffset 174 batches 1
2025-09-30T14:51:01.914702Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 175 partNo 0
2025-09-30T14:51:01.914704Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 175 partNo 0 FormedBlobsCount 0 NewHead: Offset 161 PartNo 0 PackedSize 259760 count 14 nextOffset 175 batches 1
2025-09-30T14:51:01.942437Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 499024
2025-09-30T14:51:01.914706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.914922Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 1
2025-09-30T14:51:01.914937Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 978f5cb3-549394be-db5817f7-119f88be, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 7, size# 87498, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.942463Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 2 offsets: 1 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.942481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 2
2025-09-30T14:51:01.914998Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 87498 maxTimeLagMs 0 readTimestampMs 0 readOffset 154 EndOffset 160 ClientCommitOffset 0 committedOffset 0 Guid 978f5cb3-549394be-db5817f7-119f88be
2025-09-30T14:51:01.915138Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 161,14 HeadOffset 161 endOffset 161 curOffset 175 d0000000000_00000000000000000161_00000_0000000014_00000? size 259390 WTime 1759243861915
2025-09-30T14:51:01.915322Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.915323Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.942506Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (228-228)
2025-09-30T14:51:01.915325Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.942466Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.942541Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 25264 to budget
2025-09-30T14:51:01.915326Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.942548Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 153229, now ReadSizeBudget = 25264, ReadSizeServerDelta = 345795
2025-09-30T14:51:01.942551Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 3 offsets: 2 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.942564Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (228-228)
2025-09-30T14:51:01.942559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 3
2025-09-30T14:51:01.915328Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.915329Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.915331Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.915332Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.915333Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.942591Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 25264, ReadSizeServerDelta = 345795
2025-09-30T14:51:01.942610Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 4 offsets: 3 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.942619Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 4
2025-09-30T14:51:01.915335Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.915336Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.915337Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.915338Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.915340Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 13 keys were taken away. Let's read 1432848 bytes (1432848)
2025-09-30T14:51:01.915343Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 13, size 1432848 (8388608)
2025-09-30T14:51:01.915356Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 322  requestId: <none> cookie: 161
2025-09-30T14:51:01.915378Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.915381Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.915382Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.942661Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 371059
>>> event from dataHandler: 2025-09-30T14:51:01.915392Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.942707Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (229-234)
2025-09-30T14:51:01.915400Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 161 partNo 0 count 14 size 259390
2025-09-30T14:51:01.942721Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 153229 to budget
2025-09-30T14:51:01.915468Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 13 Topic 'rt3.dc1--test-topic' partition 0 user user offset 154 count 7 size 87498 endOffset 161 max time lag 0ms effective offset 154
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..24321 bytes.. Information: { Offset: 221 ProducerId: "src_id" SeqNo: 222 CreateTime: 2025-09-30T14:51:01.932000Z WriteTime: 2025-09-30T14:51:01.934000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24431 bytes.. Information: { Offset: 222 ProducerId: "src_id" SeqNo: 223 CreateTime: 2025-09-30T14:51:01.932000Z WriteTime: 2025-09-30T14:51:01.934000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24541 bytes.. Information: { Offset: 223 ProducerId: "src_id" SeqNo: 224 CreateTime: 2025-09-30T14:51:01.933000Z WriteTime: 2025-09-30T14:51:01.934000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24651 bytes.. Information: { Offset: 224 ProducerId: "src_id" SeqNo: 225 CreateTime: 2025-09-30T14:51:01.933000Z WriteTime: 2025-09-30T14:51:01.934000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24761 bytes.. Information: { Offset: 225 ProducerId: "src_id" SeqNo: 226 CreateTime: 2025-09-30T14:51:01.933000Z WriteTime: 2025-09-30T14:51:01.934000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24871 bytes.. Information: { Offset: 226 ProducerId: "src_id" SeqNo: 227 CreateTime: 2025-09-30T14:51:01.933000Z WriteTime: 2025-09-30T14:51:01.934000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..24981 bytes.. Information: { Offset: 227 ProducerId: "src_id" SeqNo: 228 CreateTime: 2025-09-30T14:51:01.933000Z WriteTime: 2025-09-30T14:51:01.934000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.942739Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (229-229)
2025-09-30T14:51:01.942738Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 5 offsets: 4 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.915491Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 13 added 2 blobs, size 17750 count 7 last offset 160, current partition end offset: 161
2025-09-30T14:51:01.942749Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 5
2025-09-30T14:51:01.942754Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (230-230)
2025-09-30T14:51:01.915494Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 13. Send blob request.
2025-09-30T14:51:01.915512Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 152 partno 0 count 8 parts_count 0 source 1 size 137704 accessed 1 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.915516Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 160 partno 0 count 1 parts_count 0 source 1 size 17750 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.942773Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (231-231)
2025-09-30T14:51:01.915526Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 13. All 2 blobs are from cache.
2025-09-30T14:51:01.915537Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 2 blobs
2025-09-30T14:51:01.942778Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 7, size 172557 bytes
2025-09-30T14:51:01.942780Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (232-232)
2025-09-30T14:51:01.915540Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 152 partno 0 count 8 parts 0 suffix '63'
2025-09-30T14:51:01.915543Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 160 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:51:01.942785Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.915890Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 152 totakecount 8 count 8 size 137681 from pos 2 cbcount 8
2025-09-30T14:51:01.915912Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 160 totakecount 1 count 1 size 17727 from pos 0 cbcount 1
2025-09-30T14:51:01.915938Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 154
2025-09-30T14:51:01.942799Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (233-233)
2025-09-30T14:51:01.916041Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 161 Result { Offset: 154 Data: "... 17025 bytes ..." SourceId: "\000src_id" SeqNo: 155 WriteTimestampMS: 1759243861908 CreateTimestampMS: 1759243861906 UncompressedSize: 16951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 155 Data: "... 17135 bytes ..." SourceId: "\000src_id" SeqNo: 156 WriteTimestampMS: 1759243861908 CreateTimestampMS: 1759243861906 UncompressedSize: 17061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 156 Data: "... 17245 bytes ..." SourceId: "\000src_id" SeqNo: 157 WriteTimestampMS: 1759243861908 CreateTimestampMS: 1759243861906 UncompressedSize: 17171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 157 Data: "... 17355 bytes ..." SourceId: "\000src_id" SeqNo: 158 WriteTimestampMS: 1759243861908 CreateTimestampMS: 1759243861906 UncompressedSize: 17281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 158 Data: "... 17465 bytes ..." SourceId: "\000src_id" SeqNo: 159 WriteTimestampMS: 1759243861908 CreateTimestampMS: 1759243861906 UncompressedSize: 17391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 159 Data: "... 17575 bytes ..." SourceId: "\000src_id" SeqNo: 160 WriteTimestampMS: 1759243861908 CreateTimestampMS: 1759243861907 UncompressedSize: 17501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 160 Data: "... 17685 bytes ..." SourceId: "\000src_id" SeqNo: 161 WriteTimestampMS: 1759243861912 CreateTimestampMS: 1759243861907 UncompressedSize: 17611 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 153629 RealReadOffset: 160 WaitQuotaTimeMs: 0 EndOffset: 161 StartOffset: 0 } Cookie: 154 }
2025-09-30T14:51:01.942816Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (234-234)
2025-09-30T14:51:01.916098Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 9 from offset 161
2025-09-30T14:51:01.916108Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 161 ReadOffset 161 ReadGuid 978f5cb3-549394be-db5817f7-119f88be has messages 1
>>> event from dataHandler: 2025-09-30T14:51:01.916150Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 978f5cb3-549394be-db5817f7-119f88be, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 121499
2025-09-30T14:51:01.916161Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 978f5cb3-549394be-db5817f7-119f88be
2025-09-30T14:51:01.942834Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 6 offsets: 5 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.916330Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.917021Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 161 count 14 size 259390 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.942845Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 6
2025-09-30T14:51:01.917037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.917054Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 259238 WriteNewSizeFromSupportivePartitions# 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..25091 bytes.. Information: { Offset: 228 ProducerId: "src_id" SeqNo: 229 CreateTime: 2025-09-30T14:51:01.933000Z WriteTime: 2025-09-30T14:51:01.938000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840", "logtype": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }2025-09-30T14:51:01.917060Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 161 partno 0 count 14 parts 0 suffix '63' size 259390
2025-09-30T14:51:01.917064Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917072Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 162, partNo: 0, Offset: 161 is stored on disk
2025-09-30T14:51:01.917076Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917080Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 163, partNo: 0, Offset: 162 is stored on disk
2025-09-30T14:51:01.942880Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 7 offsets: 6 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.917082Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.942885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 7
2025-09-30T14:51:01.942872Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 1, size 25091 bytes
2025-09-30T14:51:01.917090Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 164, partNo: 0, Offset: 163 is stored on disk
2025-09-30T14:51:01.942897Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.917093Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917097Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 165, partNo: 0, Offset: 164 is stored on disk
2025-09-30T14:51:01.917099Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917103Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 166, partNo: 0, Offset: 165 is stored on disk
2025-09-30T14:51:01.942911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 8 offsets: 7 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.942923Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 8
2025-09-30T14:51:01.917106Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917110Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 167, partNo: 0, Offset: 166 is stored on disk
2025-09-30T14:51:01.942943Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 9 offsets: 8 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.942946Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 9
>>> event from dataHandler: 2025-09-30T14:51:01.917112Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917116Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 168, partNo: 0, Offset: 167 is stored on disk
2025-09-30T14:51:01.917119Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917124Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 169, partNo: 0, Offset: 168 is stored on disk
2025-09-30T14:51:01.917126Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..25201 bytes.. Information: { Offset: 229 ProducerId: "src_id" SeqNo: 230 CreateTime: 2025-09-30T14:51:01.937000Z WriteTime: 2025-09-30T14:51:01.939000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..25311 bytes.. Information: { Offset: 230 ProducerId: "src_id" SeqNo: 231 CreateTime: 2025-09-30T14:51:01.937000Z WriteTime: 2025-09-30T14:51:01.939000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..25421 bytes.. Information: { Offset: 231 ProducerId: "src_id" SeqNo: 232 CreateTime: 2025-09-30T14:51:01.937000Z WriteTime: 2025-09-30T14:51:01.939000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..25531 bytes.. Information: { Offset: 232 ProducerId: "src_id" SeqNo: 233 CreateTime: 2025-09-30T14:51:01.938000Z WriteTime: 2025-09-30T14:51:01.939000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..25641 bytes.. Information: { Offset: 233 ProducerId: "src_id" SeqNo: 234 CreateTime: 2025-09-30T14:51:01.938000Z WriteTime: 2025-09-30T14:51:01.939000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..25751 bytes.. Information: { Offset: 234 ProducerId: "src_id" SeqNo: 235 CreateTime: 2025-09-30T14:51:01.938000Z WriteTime: 2025-09-30T14:51:01.939000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.942979Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 10 offsets: 9 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.942985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 10
2025-09-30T14:51:01.917130Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 170, partNo: 0, Offset: 169 is stored on disk
2025-09-30T14:51:01.917132Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917137Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 171, partNo: 0, Offset: 170 is stored on disk
2025-09-30T14:51:01.917139Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.943005Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 11 offsets: 10 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.917144Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 172, partNo: 0, Offset: 171 is stored on disk
2025-09-30T14:51:01.943008Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 6, size 152856 bytes
2025-09-30T14:51:01.917147Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917151Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 173, partNo: 0, Offset: 172 is stored on disk
2025-09-30T14:51:01.943016Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.917153Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.943008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 11
2025-09-30T14:51:01.917158Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 174, partNo: 0, Offset: 173 is stored on disk
2025-09-30T14:51:01.917162Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.917166Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 175, partNo: 0, Offset: 174 is stored on disk
2025-09-30T14:51:01.917247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.917250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.943040Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 12 offsets: 11 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.917252Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.943043Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 12
2025-09-30T14:51:01.917263Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.917265Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.917268Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.943065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 13 offsets: 12 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.943072Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 13
2025-09-30T14:51:01.917270Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.917271Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 161 EndOffset 161 newEndOffset 175 commitOffset 0 clientCommitOffset 0 cookie 9 readingFinished 0 firstRead 0
2025-09-30T14:51:01.917276Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 161 endOffset 175
2025-09-30T14:51:01.917283Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.917285Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.917287Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.917288Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 161, endOffset# 175, WTime# 1759243861912, sizeLag# 259390
2025-09-30T14:51:01.917289Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.917290Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.917291Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.943110Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 236 to 236
2025-09-30T14:51:01.917296Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.917298Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.943139Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.917299Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.917301Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.943146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 236
2025-09-30T14:51:01.917303Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.917306Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 14 keys were taken away. Let's read 1692238 bytes (1692238)
2025-09-30T14:51:01.917309Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 14, size 1692238 (8388608)
2025-09-30T14:51:01.917318Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 8c17a6d2-c059da9c-f9751e14-3cbf730a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 16, size# 100412, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.917322Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 323  requestId: <none> cookie: 162
2025-09-30T14:51:01.917331Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 16 maxSize 100412 maxTimeLagMs 0 readTimestampMs 0 readOffset 161 EndOffset 175 ClientCommitOffset 0 committedOffset 0 Guid 8c17a6d2-c059da9c-f9751e14-3cbf730a
2025-09-30T14:51:01.917332Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 329  requestId: <none> cookie: 163
2025-09-30T14:51:01.917337Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 331  requestId: <none> cookie: 164
2025-09-30T14:51:01.917342Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 332  requestId: <none> cookie: 165
2025-09-30T14:51:01.917348Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 334  requestId: <none> cookie: 166
2025-09-30T14:51:01.917353Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 335  requestId: <none> cookie: 167
2025-09-30T14:51:01.917355Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917359Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 337  requestId: <none> cookie: 168
2025-09-30T14:51:01.917363Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917364Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 338  requestId: <none> cookie: 169
2025-09-30T14:51:01.917367Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917369Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 343  requestId: <none> cookie: 170
2025-09-30T14:51:01.917371Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917374Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 345  requestId: <none> cookie: 171
2025-09-30T14:51:01.917375Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917378Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917380Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 346  requestId: <none> cookie: 172
2025-09-30T14:51:01.917386Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 347  requestId: <none> cookie: 173
2025-09-30T14:51:01.917387Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917390Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917390Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 348  requestId: <none> cookie: 174
2025-09-30T14:51:01.917396Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 349  requestId: <none> cookie: 175
2025-09-30T14:51:01.917396Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917400Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917405Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917408Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.917413Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.917442Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 14 Topic 'rt3.dc1--test-topic' partition 0 user user offset 161 count 16 size 100412 endOffset 175 max time lag 0ms effective offset 161
2025-09-30T14:51:01.917443Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917447Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917458Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 14 added 1 blobs, size 259390 count 14 last offset 161, current partition end offset: 175
2025-09-30T14:51:01.917461Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 14. Send blob request.
2025-09-30T14:51:01.917464Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.917471Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 161 partno 0 count 14 parts_count 0 source 1 size 259390 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.943295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 237 to 237
2025-09-30T14:51:01.917485Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 14. All 1 blobs are from cache.
2025-09-30T14:51:01.943317Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.917497Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.943322Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 237
2025-09-30T14:51:01.917504Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 161 partno 0 count 14 parts 0 suffix '63'
2025-09-30T14:51:01.917540Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.917587Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.917621Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 161 totakecount 14 count 14 size 259367 from pos 0 cbcount 14
2025-09-30T14:51:01.917657Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.917661Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.917678Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 161
2025-09-30T14:51:01.943348Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 238 to 238
2025-09-30T14:51:01.917737Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 350  requestId: <none> cookie: 176
2025-09-30T14:51:01.943362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.917753Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.943364Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 238
2025-09-30T14:51:01.917784Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.917830Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.917853Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 175 Result { Offset: 161 Data: "... 17795 bytes ..." SourceId: "\000src_id" SeqNo: 162 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861912 UncompressedSize: 17721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 162 Data: "... 17905 bytes ..." SourceId: "\000src_id" SeqNo: 163 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861912 UncompressedSize: 17831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 163 Data: "... 18015 bytes ..." SourceId: "\000src_id" SeqNo: 164 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861912 UncompressedSize: 17941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 164 Data: "... 18125 bytes ..." SourceId: "\000src_id" SeqNo: 165 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861912 UncompressedSize: 18051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 165 Data: "... 18235 bytes ..." SourceId: "\000src_id" SeqNo: 166 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861912 UncompressedSize: 18161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 166 Data: "... 18345 bytes ..." SourceId: "\000src_id" SeqNo: 167 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861912 UncompressedSize: 18271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 167 Data: "... 18455 bytes ..." SourceId: "\000src_id" SeqNo: 168 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861912 UncompressedSize: 18381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 168 Data: "... 18565 bytes ..." SourceId: "\000src_id" SeqNo: 169 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861912 UncompressedSize: 18491 PartitionKey: "" ExplicitHash: "" } Result { Offset: 169 Data: "... 18675 bytes ..." SourceId: "\000src_id" SeqNo: 170 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861912 UncompressedSize: 18601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 170 Data: "... 18785 bytes ..." SourceId: "\000src_id" SeqNo: 171 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861912 UncompressedSize: 18711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 171 Data: "... 18895 bytes ..." SourceId: "\000src_id" SeqNo: 172 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861912 UncompressedSize: 18821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 172 Data: "... 19005 bytes ..." SourceId: "\000src_id" SeqNo: 173 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861912 UncompressedSize: 18931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 173 Data: "... 19115 bytes ..." SourceId: "\000src_id" SeqNo: 174 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861913 UncompressedSize: 19041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 174 Data: "... 19225 bytes ..." SourceId: "\000src_id" SeqNo: 175 WriteTimestampMS: 1759243861914 CreateTimestampMS: 1759243861913 UncompressedSize: 19151 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551278 RealReadOffset: 174 WaitQuotaTimeMs: 0 EndOffset: 175 StartOffset: 0 } Cookie: 161 }
2025-09-30T14:51:01.943395Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 239 to 239
2025-09-30T14:51:01.945647Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 26034, now ReadSizeBudget = 153229, ReadSizeServerDelta = 345025
2025-09-30T14:51:01.918011Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 10 from offset 175
2025-09-30T14:51:01.918019Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 175 ReadOffset 175 ReadGuid 8c17a6d2-c059da9c-f9751e14-3cbf730a has messages 1
2025-09-30T14:51:01.918045Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.947556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.918049Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.918065Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 176 partNo : 0 messageNo: 351 size 19335 offset: -1
2025-09-30T14:51:01.947569Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 239
2025-09-30T14:51:01.918073Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.918074Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.947579Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 153229, ReadSizeServerDelta = 345025
2025-09-30T14:51:01.918083Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.918096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.918103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.918105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.918132Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 176 partNo 0
2025-09-30T14:51:01.918162Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 176 partNo 0 FormedBlobsCount 0 NewHead: Offset 175 PartNo 0 PackedSize 19409 count 1 nextOffset 176 batches 1
2025-09-30T14:51:01.918168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.918229Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 175,1 HeadOffset 175 endOffset 175 curOffset 176 d0000000000_00000000000000000175_00000_0000000001_00000? size 19400 WTime 1759243861918
2025-09-30T14:51:01.918257Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.918267Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 175 partNo 0 count 1 size 19400
2025-09-30T14:51:01.918278Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 352  requestId: <none> cookie: 177
2025-09-30T14:51:01.918360Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 302377 } }
2025-09-30T14:51:01.918377Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 8c17a6d2-c059da9c-f9751e14-3cbf730a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 258797
2025-09-30T14:51:01.918387Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 8c17a6d2-c059da9c-f9751e14-3cbf730a
2025-09-30T14:51:01.918678Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.947635Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 240 to 240
2025-09-30T14:51:01.918712Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# f0fe4c08-7b427081-cad2b407-4868e51e
2025-09-30T14:51:01.918725Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.918735Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.918817Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.918832Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.918862Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.918867Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.918894Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.947663Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.918899Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.947666Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 240
2025-09-30T14:51:01.918926Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.918936Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.918940Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.918953Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 177 partNo : 0 messageNo: 353 size 19445 offset: -1
2025-09-30T14:51:01.918959Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.918961Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.947696Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 498254
2025-09-30T14:51:01.918965Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.947700Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 241 to 241
2025-09-30T14:51:01.918967Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.918970Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.918972Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.947710Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.918990Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.947713Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 241
2025-09-30T14:51:01.918998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.919001Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.919003Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.919106Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.919144Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 354  requestId: <none> cookie: 178
2025-09-30T14:51:01.919150Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 355  requestId: <none> cookie: 179
2025-09-30T14:51:01.919153Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 356  requestId: <none> cookie: 180
2025-09-30T14:51:01.947733Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (235-235)
2025-09-30T14:51:01.919156Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 357  requestId: <none> cookie: 181
2025-09-30T14:51:01.947739Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 242 to 242
2025-09-30T14:51:01.919203Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.919212Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.947745Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 26034 to budget
2025-09-30T14:51:01.919216Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.947751Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.919220Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.947754Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 242
2025-09-30T14:51:01.919234Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.919276Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.919280Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.919291Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 178 partNo : 0 messageNo: 358 size 19555 offset: -1
2025-09-30T14:51:01.947766Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (235-235)
2025-09-30T14:51:01.919297Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.919299Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.919303Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 179 partNo : 0 messageNo: 359 size 19665 offset: -1
2025-09-30T14:51:01.947794Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 243 to 243
2025-09-30T14:51:01.919306Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.919309Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.919315Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 180 partNo : 0 messageNo: 360 size 19775 offset: -1
2025-09-30T14:51:01.919319Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.947810Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
>>> event from dataHandler: 2025-09-30T14:51:01.947822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 243
2025-09-30T14:51:01.919321Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..25861 bytes.. Information: { Offset: 235 ProducerId: "src_id" SeqNo: 236 CreateTime: 2025-09-30T14:51:01.938000Z WriteTime: 2025-09-30T14:51:01.943000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }2025-09-30T14:51:01.919324Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 181 partNo : 0 messageNo: 361 size 19885 offset: -1
2025-09-30T14:51:01.947854Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 244 to 244
2025-09-30T14:51:01.919327Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.947866Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.919328Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.947869Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 244
2025-09-30T14:51:01.919330Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.919336Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.947888Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 1, size 25861 bytes
2025-09-30T14:51:01.919344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.919347Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.947904Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.947911Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 245 to 245
2025-09-30T14:51:01.919349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.947922Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.919350Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.947925Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 245
2025-09-30T14:51:01.919353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.919354Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.919357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.919365Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 362  requestId: <none> cookie: 182
2025-09-30T14:51:01.919385Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.919395Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.947950Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 246 to 246
2025-09-30T14:51:01.919406Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.919437Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.919439Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.919444Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.947977Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.947980Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 246
2025-09-30T14:51:01.919444Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 182 partNo : 0 messageNo: 363 size 19995 offset: -1
2025-09-30T14:51:01.919448Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.919450Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.919454Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.919459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.919461Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.919463Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.919469Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 364  requestId: <none> cookie: 183
2025-09-30T14:51:01.919476Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 365  requestId: <none> cookie: 184
2025-09-30T14:51:01.948009Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 247 to 247
2025-09-30T14:51:01.919480Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.919485Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.919488Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.919524Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.919527Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.919531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 183 partNo : 0 messageNo: 366 size 20105 offset: -1
2025-09-30T14:51:01.919535Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.948033Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.948041Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 247
2025-09-30T14:51:01.919537Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.919539Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.919540Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 184 partNo : 0 messageNo: 367 size 20215 offset: -1
2025-09-30T14:51:01.919543Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.919546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.919548Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.919550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.919554Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.919555Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.919561Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 368  requestId: <none> cookie: 185
2025-09-30T14:51:01.919575Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.948083Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 248 to 248
2025-09-30T14:51:01.919588Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.919590Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.919594Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 185 partNo : 0 messageNo: 369 size 20325 offset: -1
2025-09-30T14:51:01.919642Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.919645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.919658Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 175 count 1 size 19400 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.919669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.919685Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 19342 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.919685Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 175 partno 0 count 1 parts 0 suffix '63' size 19400
2025-09-30T14:51:01.948111Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.919693Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.948116Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 248
2025-09-30T14:51:01.919700Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 176, partNo: 0, Offset: 175 is stored on disk
2025-09-30T14:51:01.919734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.919744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.919746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (9)
2025-09-30T14:51:01.919753Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 175 EndOffset 175 newEndOffset 176 commitOffset 0 clientCommitOffset 0 cookie 10 readingFinished 0 firstRead 0
2025-09-30T14:51:01.919756Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 175 endOffset 176
2025-09-30T14:51:01.919765Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 177 partNo 0
2025-09-30T14:51:01.919766Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 175, endOffset# 176, WTime# 1759243861914, sizeLag# 19400
2025-09-30T14:51:01.919768Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.919780Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# b9a9e6d9-35ce393a-683f0f17-3d2b42a8, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 23280, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.919791Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 177 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 19519 count 1 nextOffset 177 batches 1
2025-09-30T14:51:01.919794Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 23280 maxTimeLagMs 0 readTimestampMs 0 readOffset 175 EndOffset 176 ClientCommitOffset 0 committedOffset 0 Guid b9a9e6d9-35ce393a-683f0f17-3d2b42a8
2025-09-30T14:51:01.948157Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 249 to 249
2025-09-30T14:51:01.919797Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 178 partNo 0
2025-09-30T14:51:01.919802Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 178 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 39116 count 2 nextOffset 178 batches 1
2025-09-30T14:51:01.919806Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 179 partNo 0
2025-09-30T14:51:01.919810Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 179 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 58823 count 3 nextOffset 179 batches 1
2025-09-30T14:51:01.919813Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 180 partNo 0
2025-09-30T14:51:01.919818Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 180 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 78640 count 4 nextOffset 180 batches 1
2025-09-30T14:51:01.948177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.919822Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 181 partNo 0
2025-09-30T14:51:01.948180Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 249
2025-09-30T14:51:01.919825Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 181 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 98567 count 5 nextOffset 181 batches 1
2025-09-30T14:51:01.919828Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 182 partNo 0
2025-09-30T14:51:01.919832Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 182 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 118604 count 6 nextOffset 182 batches 1
2025-09-30T14:51:01.919835Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 183 partNo 0
2025-09-30T14:51:01.919840Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 183 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 138751 count 7 nextOffset 183 batches 1
2025-09-30T14:51:01.919845Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 184 partNo 0
2025-09-30T14:51:01.919849Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 184 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 159008 count 8 nextOffset 184 batches 1
2025-09-30T14:51:01.948208Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 250 to 250
2025-09-30T14:51:01.919853Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 185 partNo 0
2025-09-30T14:51:01.919859Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 185 partNo 0 FormedBlobsCount 0 NewHead: Offset 176 PartNo 0 PackedSize 179375 count 9 nextOffset 185 batches 1
2025-09-30T14:51:01.919861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.920068Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 176,9 HeadOffset 176 endOffset 176 curOffset 185 d0000000000_00000000000000000176_00000_0000000009_00000? size 179160 WTime 1759243861919
2025-09-30T14:51:01.920111Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.920113Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.920122Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.920124Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.920126Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.920128Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.920130Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.948241Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.920133Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.948243Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 250
2025-09-30T14:51:01.920135Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.920137Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.920139Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.920141Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.948269Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 251 to 251
2025-09-30T14:51:01.920143Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.920144Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.920146Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.920149Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 15 keys were taken away. Let's read 1711638 bytes (1711638)
2025-09-30T14:51:01.920152Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 15, size 1711638 (8388608)
2025-09-30T14:51:01.920164Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 351  requestId: <none> cookie: 176
2025-09-30T14:51:01.920187Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.948304Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.948307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 251
2025-09-30T14:51:01.920187Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.920190Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.920203Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.920215Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 176 partNo 0 count 9 size 179160
2025-09-30T14:51:01.920285Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 15 Topic 'rt3.dc1--test-topic' partition 0 user user offset 175 count 1 size 23280 endOffset 176 max time lag 0ms effective offset 175
2025-09-30T14:51:01.920297Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 15 added 1 blobs, size 19400 count 1 last offset 175, current partition end offset: 176
2025-09-30T14:51:01.920300Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 15. Send blob request.
2025-09-30T14:51:01.920312Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 175 partno 0 count 1 parts_count 0 source 1 size 19400 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.948329Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 252 to 252
2025-09-30T14:51:01.920316Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 15. All 1 blobs are from cache.
2025-09-30T14:51:01.920324Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.920334Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 175 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:51:01.920339Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 175 totakecount 1 count 1 size 19377 from pos 0 cbcount 1
2025-09-30T14:51:01.920358Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 175
2025-09-30T14:51:01.920430Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 176 Result { Offset: 175 Data: "... 19335 bytes ..." SourceId: "\000src_id" SeqNo: 176 WriteTimestampMS: 1759243861918 CreateTimestampMS: 1759243861913 UncompressedSize: 19261 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 175 WaitQuotaTimeMs: 0 EndOffset: 176 StartOffset: 0 } Cookie: 175 }
2025-09-30T14:51:01.920454Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 11 from offset 176
2025-09-30T14:51:01.920461Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 176 ReadOffset 176 ReadGuid b9a9e6d9-35ce393a-683f0f17-3d2b42a8 has messages 1
2025-09-30T14:51:01.920484Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# b9a9e6d9-35ce393a-683f0f17-3d2b42a8, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 19434
2025-09-30T14:51:01.920490Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# b9a9e6d9-35ce393a-683f0f17-3d2b42a8
2025-09-30T14:51:01.920584Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.921448Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 176 count 9 size 179160 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.921462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.921471Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 176 partno 0 count 9 parts 0 suffix '63' size 179160
2025-09-30T14:51:01.921476Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 179028 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.921484Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.948382Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.921491Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 177, partNo: 0, Offset: 176 is stored on disk
2025-09-30T14:51:01.948392Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 252
2025-09-30T14:51:01.921495Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.921499Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 178, partNo: 0, Offset: 177 is stored on disk
2025-09-30T14:51:01.921501Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.921508Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 179, partNo: 0, Offset: 178 is stored on disk
2025-09-30T14:51:01.921510Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.921517Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 180, partNo: 0, Offset: 179 is stored on disk
2025-09-30T14:51:01.921519Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.921524Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 181, partNo: 0, Offset: 180 is stored on disk
2025-09-30T14:51:01.921526Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.921529Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 182, partNo: 0, Offset: 181 is stored on disk
2025-09-30T14:51:01.921532Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.921535Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 183, partNo: 0, Offset: 182 is stored on disk
2025-09-30T14:51:01.948426Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 253 to 253
2025-09-30T14:51:01.921537Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.921541Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 184, partNo: 0, Offset: 183 is stored on disk
2025-09-30T14:51:01.921543Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.921555Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 185, partNo: 0, Offset: 184 is stored on disk
2025-09-30T14:51:01.921594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.921596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.921598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.921605Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.948447Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.921607Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.948457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 253
2025-09-30T14:51:01.921610Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.921612Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.921612Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 176 EndOffset 176 newEndOffset 185 commitOffset 0 clientCommitOffset 0 cookie 11 readingFinished 0 firstRead 0
2025-09-30T14:51:01.921614Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.921616Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.921617Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 176 endOffset 185
2025-09-30T14:51:01.921618Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.921620Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.948481Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 254 to 254
2025-09-30T14:51:01.921622Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.921623Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.921625Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.921626Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 176, endOffset# 185, WTime# 1759243861918, sizeLag# 179160
2025-09-30T14:51:01.921627Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.921628Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.921629Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.921631Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.921635Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.921637Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.948511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.921640Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 16 keys were taken away. Let's read 1890798 bytes (1890798)
2025-09-30T14:51:01.948516Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 254
2025-09-30T14:51:01.921642Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 285ab2be-876189d8-38bba97b-d90437f5, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 10, size# 124558, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.921643Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 16, size 1890798 (8388608)
2025-09-30T14:51:01.921652Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 353  requestId: <none> cookie: 177
2025-09-30T14:51:01.921657Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 10 maxSize 124558 maxTimeLagMs 0 readTimestampMs 0 readOffset 176 EndOffset 185 ClientCommitOffset 0 committedOffset 0 Guid 285ab2be-876189d8-38bba97b-d90437f5
2025-09-30T14:51:01.921660Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 358  requestId: <none> cookie: 178
2025-09-30T14:51:01.921664Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 359  requestId: <none> cookie: 179
2025-09-30T14:51:01.921669Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 360  requestId: <none> cookie: 180
2025-09-30T14:51:01.921674Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 361  requestId: <none> cookie: 181
2025-09-30T14:51:01.921679Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 363  requestId: <none> cookie: 182
2025-09-30T14:51:01.921680Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.921684Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 366  requestId: <none> cookie: 183
2025-09-30T14:51:01.921688Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 367  requestId: <none> cookie: 184
2025-09-30T14:51:01.948552Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 255 to 255
2025-09-30T14:51:01.921689Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.921693Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 369  requestId: <none> cookie: 185
2025-09-30T14:51:01.921693Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.921698Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.921702Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.921705Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.921707Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.921708Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.921716Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.948576Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.921720Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.948585Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 255
2025-09-30T14:51:01.921725Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.921732Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 16 Topic 'rt3.dc1--test-topic' partition 0 user user offset 176 count 10 size 124558 endOffset 185 max time lag 0ms effective offset 176
2025-09-30T14:51:01.921746Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 16 added 1 blobs, size 179160 count 9 last offset 176, current partition end offset: 185
2025-09-30T14:51:01.921750Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 16. Send blob request.
2025-09-30T14:51:01.921760Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 176 partno 0 count 9 parts_count 0 source 1 size 179160 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.921769Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 16. All 1 blobs are from cache.
2025-09-30T14:51:01.921780Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.921782Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 176 partno 0 count 9 parts 0 suffix '63'
2025-09-30T14:51:01.921922Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 176 totakecount 9 count 9 size 179137 from pos 0 cbcount 9
2025-09-30T14:51:01.948862Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 256 to 256
2025-09-30T14:51:01.921951Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 176
2025-09-30T14:51:01.922046Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.922089Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 185 Result { Offset: 176 Data: "... 19445 bytes ..." SourceId: "\000src_id" SeqNo: 177 WriteTimestampMS: 1759243861919 CreateTimestampMS: 1759243861917 UncompressedSize: 19371 PartitionKey: "" ExplicitHash: "" } Result { Offset: 177 Data: "... 19555 bytes ..." SourceId: "\000src_id" SeqNo: 178 WriteTimestampMS: 1759243861919 CreateTimestampMS: 1759243861917 UncompressedSize: 19481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 178 Data: "... 19665 bytes ..." SourceId: "\000src_id" SeqNo: 179 WriteTimestampMS: 1759243861919 CreateTimestampMS: 1759243861917 UncompressedSize: 19591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 179 Data: "... 19775 bytes ..." SourceId: "\000src_id" SeqNo: 180 WriteTimestampMS: 1759243861919 CreateTimestampMS: 1759243861917 UncompressedSize: 19701 PartitionKey: "" ExplicitHash: "" } Result { Offset: 180 Data: "... 19885 bytes ..." SourceId: "\000src_id" SeqNo: 181 WriteTimestampMS: 1759243861919 CreateTimestampMS: 1759243861917 UncompressedSize: 19811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 181 Data: "... 19995 bytes ..." SourceId: "\000src_id" SeqNo: 182 WriteTimestampMS: 1759243861919 CreateTimestampMS: 1759243861917 UncompressedSize: 19921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 182 Data: "... 20105 bytes ..." SourceId: "\000src_id" SeqNo: 183 WriteTimestampMS: 1759243861919 CreateTimestampMS: 1759243861917 UncompressedSize: 20031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 183 Data: "... 20215 bytes ..." SourceId: "\000src_id" SeqNo: 184 WriteTimestampMS: 1759243861919 CreateTimestampMS: 1759243861917 UncompressedSize: 20141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 184 Data: "... 20325 bytes ..." SourceId: "\000src_id" SeqNo: 185 WriteTimestampMS: 1759243861919 CreateTimestampMS: 1759243861917 UncompressedSize: 20251 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551433 RealReadOffset: 184 WaitQuotaTimeMs: 0 EndOffset: 185 StartOffset: 0 } Cookie: 176 }
2025-09-30T14:51:01.922128Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.922163Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.922182Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.922192Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 12 from offset 185
2025-09-30T14:51:01.922201Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 185 ReadOffset 185 ReadGuid 285ab2be-876189d8-38bba97b-d90437f5 has messages 1
2025-09-30T14:51:01.922203Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 370  requestId: <none> cookie: 186
2025-09-30T14:51:01.922228Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922232Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 285ab2be-876189d8-38bba97b-d90437f5, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 178792
2025-09-30T14:51:01.922240Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 285ab2be-876189d8-38bba97b-d90437f5
2025-09-30T14:51:01.951534Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.922243Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.922246Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.922260Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 186 partNo : 0 messageNo: 371 size 20435 offset: -1
2025-09-30T14:51:01.951549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 256
2025-09-30T14:51:01.922272Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.922284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.922292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.922295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.922305Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.922324Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 186 partNo 0
2025-09-30T14:51:01.922340Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 121499 } }
2025-09-30T14:51:01.922355Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 538e2de-3f405f48-3c8c59c5-8841e29c
2025-09-30T14:51:01.922358Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 186 partNo 0 FormedBlobsCount 0 NewHead: Offset 185 PartNo 0 PackedSize 20509 count 1 nextOffset 186 batches 1
2025-09-30T14:51:01.922366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.951772Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 257 to 257
2025-09-30T14:51:01.951783Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.951785Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 257
2025-09-30T14:51:01.951815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 258 to 258
2025-09-30T14:51:01.951822Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.951824Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 258
2025-09-30T14:51:01.922381Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.922420Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.922422Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 185,1 HeadOffset 185 endOffset 185 curOffset 186 d0000000000_00000000000000000185_00000_0000000001_00000? size 20500 WTime 1759243861922
2025-09-30T14:51:01.922444Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.922457Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 185 partNo 0 count 1 size 20500
2025-09-30T14:51:01.922465Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.922468Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.922536Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 372  requestId: <none> cookie: 187
2025-09-30T14:51:01.922552Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922559Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.922579Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.922581Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.922585Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.922590Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 187 partNo : 0 messageNo: 373 size 20545 offset: -1
2025-09-30T14:51:01.922614Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.922616Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.922621Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.922628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.922632Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 374  requestId: <none> cookie: 188
2025-09-30T14:51:01.922650Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922664Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.922666Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.922672Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 188 partNo : 0 messageNo: 375 size 20655 offset: -1
2025-09-30T14:51:01.922676Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.922681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.922749Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.922780Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 258797 } }
2025-09-30T14:51:01.922798Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 5f6b2193-e5babfbb-e2f72be5-f22da484
2025-09-30T14:51:01.922810Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.922838Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.922841Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.922850Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 376  requestId: <none> cookie: 189
2025-09-30T14:51:01.922862Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.922878Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.922880Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.922899Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 189 partNo : 0 messageNo: 377 size 20765 offset: -1
2025-09-30T14:51:01.922903Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.922908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.922954Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.922983Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.922992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.922994Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.923000Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 378  requestId: <none> cookie: 190
2025-09-30T14:51:01.923010Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.952067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 259 to 259
2025-09-30T14:51:01.923019Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.923020Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.923026Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 190 partNo : 0 messageNo: 379 size 20875 offset: -1
2025-09-30T14:51:01.923029Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.952086Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.923034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.923039Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.952091Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 259
2025-09-30T14:51:01.923077Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.923118Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.923168Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.923168Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.923170Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.923176Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 380  requestId: <none> cookie: 191
2025-09-30T14:51:01.923181Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.923181Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.923183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.923188Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 381  requestId: <none> cookie: 192
2025-09-30T14:51:01.952125Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 260 to 260
2025-09-30T14:51:01.923192Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.923192Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.952135Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.952146Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 260
2025-09-30T14:51:01.923193Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.923199Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 191 partNo : 0 messageNo: 382 size 20985 offset: -1
2025-09-30T14:51:01.923202Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.923204Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.923208Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 192 partNo : 0 messageNo: 383 size 21095 offset: -1
2025-09-30T14:51:01.923211Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.952191Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 261 to 261
2025-09-30T14:51:01.923214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.923218Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.923221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.923304Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.923363Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.923372Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.923376Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.923383Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 384  requestId: <none> cookie: 193
2025-09-30T14:51:01.923394Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.952219Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.923412Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.952224Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 261
2025-09-30T14:51:01.923414Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.923419Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 193 partNo : 0 messageNo: 385 size 21205 offset: -1
2025-09-30T14:51:01.923419Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.923422Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.952253Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 262 to 262
2025-09-30T14:51:01.923426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.923475Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.923495Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.923497Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.923502Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 386  requestId: <none> cookie: 194
2025-09-30T14:51:01.923509Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.923515Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.952283Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.952287Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 262
2025-09-30T14:51:01.923521Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.923525Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.923539Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 194 partNo : 0 messageNo: 387 size 21315 offset: -1
2025-09-30T14:51:01.923546Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.923551Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.923555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.923572Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.923603Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.923605Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.923619Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 185 count 1 size 20500 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.923632Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.952327Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 263 to 263
2025-09-30T14:51:01.923642Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.923646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.923651Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 185 partno 0 count 1 parts 0 suffix '63' size 20500
2025-09-30T14:51:01.923660Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 20442 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.923667Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.923675Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 186, partNo: 0, Offset: 185 is stored on disk
2025-09-30T14:51:01.923680Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.923705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.923714Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 185 EndOffset 185 newEndOffset 186 commitOffset 0 clientCommitOffset 0 cookie 12 readingFinished 0 firstRead 0
2025-09-30T14:51:01.923717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.923717Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 185 endOffset 186
2025-09-30T14:51:01.952367Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.923719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (8)
2025-09-30T14:51:01.952370Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 263
2025-09-30T14:51:01.923722Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.923737Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 187 partNo 0
2025-09-30T14:51:01.923780Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.923784Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 187 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 20619 count 1 nextOffset 187 batches 1
2025-09-30T14:51:01.923791Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 188 partNo 0
2025-09-30T14:51:01.923795Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 188 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 41316 count 2 nextOffset 188 batches 1
2025-09-30T14:51:01.923799Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 189 partNo 0
2025-09-30T14:51:01.952397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 264 to 264
2025-09-30T14:51:01.923803Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 189 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 62123 count 3 nextOffset 189 batches 1
2025-09-30T14:51:01.923807Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 190 partNo 0
2025-09-30T14:51:01.923810Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.952407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.923810Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 190 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 83040 count 4 nextOffset 190 batches 1
2025-09-30T14:51:01.952410Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 264
2025-09-30T14:51:01.923814Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 191 partNo 0
2025-09-30T14:51:01.923818Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 191 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 104067 count 5 nextOffset 191 batches 1
2025-09-30T14:51:01.923821Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 192 partNo 0
2025-09-30T14:51:01.923822Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.923827Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 192 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 125204 count 6 nextOffset 192 batches 1
2025-09-30T14:51:01.923830Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 193 partNo 0
2025-09-30T14:51:01.952443Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 265 to 265
2025-09-30T14:51:01.923834Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 185, endOffset# 186, WTime# 1759243861919, sizeLag# 20500
2025-09-30T14:51:01.923834Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 193 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 146451 count 7 nextOffset 193 batches 1
2025-09-30T14:51:01.923836Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.923837Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 194 partNo 0
2025-09-30T14:51:01.952457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.923840Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 194 partNo 0 FormedBlobsCount 0 NewHead: Offset 186 PartNo 0 PackedSize 167808 count 8 nextOffset 194 batches 1
2025-09-30T14:51:01.952461Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 265
2025-09-30T14:51:01.923843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.923848Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 142e7d5d-9f476024-b064fac9-c026621f, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 24600, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.923858Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.923892Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 24600 maxTimeLagMs 0 readTimestampMs 0 readOffset 185 EndOffset 186 ClientCommitOffset 0 committedOffset 0 Guid 142e7d5d-9f476024-b064fac9-c026621f
2025-09-30T14:51:01.923915Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.924103Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 186,8 HeadOffset 186 endOffset 186 curOffset 194 d0000000000_00000000000000000186_00000_0000000008_00000? size 167624 WTime 1759243861923
2025-09-30T14:51:01.924147Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.924149Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.924151Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.924153Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.924156Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.952498Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 266 to 266
2025-09-30T14:51:01.924159Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.924161Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.924167Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.924170Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.924171Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.924173Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.924175Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.924178Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.952524Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.924180Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.952527Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 266
2025-09-30T14:51:01.924182Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.924184Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.924186Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.924188Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 17 keys were taken away. Let's read 1911298 bytes (1911298)
2025-09-30T14:51:01.924192Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 17, size 1911298 (8388608)
2025-09-30T14:51:01.924205Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 388  requestId: <none> cookie: 195
2025-09-30T14:51:01.924218Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924221Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.924226Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.924230Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 371  requestId: <none> cookie: 186
2025-09-30T14:51:01.952562Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 267 to 267
2025-09-30T14:51:01.924236Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924237Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.952603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.952607Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 267
2025-09-30T14:51:01.924242Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.924244Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924246Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.924247Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.924250Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924253Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.924264Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924267Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.924276Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.952642Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 268 to 268
2025-09-30T14:51:01.924289Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 186 partNo 0 count 8 size 167624
2025-09-30T14:51:01.924306Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924308Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.924317Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 195 partNo : 0 messageNo: 393 size 21425 offset: -1
2025-09-30T14:51:01.924322Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924323Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.924362Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 389  requestId: <none> cookie: 196
2025-09-30T14:51:01.924366Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 390  requestId: <none> cookie: 197
2025-09-30T14:51:01.924369Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.924370Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 391  requestId: <none> cookie: 198
2025-09-30T14:51:01.924373Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 392  requestId: <none> cookie: 199
2025-09-30T14:51:01.924375Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.924377Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.924381Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.924382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.952672Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.924391Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.924397Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.924403Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 394  requestId: <none> cookie: 200
2025-09-30T14:51:01.924411Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 17 Topic 'rt3.dc1--test-topic' partition 0 user user offset 185 count 1 size 24600 endOffset 186 max time lag 0ms effective offset 185
2025-09-30T14:51:01.924413Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.952730Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 268
2025-09-30T14:51:01.924423Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 17 added 1 blobs, size 20500 count 1 last offset 185, current partition end offset: 186
2025-09-30T14:51:01.924427Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 17. Send blob request.
2025-09-30T14:51:01.924432Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924433Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.924438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 196 partNo : 0 messageNo: 395 size 21535 offset: -1
2025-09-30T14:51:01.924443Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924445Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.924449Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 197 partNo : 0 messageNo: 396 size 21645 offset: -1
2025-09-30T14:51:01.924453Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924454Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.924458Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 198 partNo : 0 messageNo: 397 size 21755 offset: -1
2025-09-30T14:51:01.924461Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924464Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.924468Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 199 partNo : 0 messageNo: 398 size 21865 offset: -1
2025-09-30T14:51:01.924472Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924473Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.924477Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924479Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.924483Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 200 partNo : 0 messageNo: 400 size 21975 offset: -1
2025-09-30T14:51:01.924492Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 185 partno 0 count 1 parts_count 0 source 1 size 20500 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.952795Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 269 to 269
2025-09-30T14:51:01.924502Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 17. All 1 blobs are from cache.
2025-09-30T14:51:01.924508Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.924512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.924514Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.924517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.924519Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.924519Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 185 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:51:01.924524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.924526Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.924529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.952830Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.924532Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.952835Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 269
2025-09-30T14:51:01.924534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.924539Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.924555Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 185 totakecount 1 count 1 size 20477 from pos 0 cbcount 1
2025-09-30T14:51:01.924572Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 399  requestId: <none> cookie: 201
2025-09-30T14:51:01.924582Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 185
2025-09-30T14:51:01.924590Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.924617Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.924624Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.924635Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 201 partNo : 0 messageNo: 401 size 22085 offset: -1
2025-09-30T14:51:01.924641Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.924647Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 186 Result { Offset: 185 Data: "... 20435 bytes ..." SourceId: "\000src_id" SeqNo: 186 WriteTimestampMS: 1759243861922 CreateTimestampMS: 1759243861918 UncompressedSize: 20361 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 185 WaitQuotaTimeMs: 0 EndOffset: 186 StartOffset: 0 } Cookie: 185 }
2025-09-30T14:51:01.924649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.924669Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 13 from offset 186
2025-09-30T14:51:01.924676Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 186 ReadOffset 186 ReadGuid 142e7d5d-9f476024-b064fac9-c026621f has messages 1
2025-09-30T14:51:01.924700Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 142e7d5d-9f476024-b064fac9-c026621f, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 20534
2025-09-30T14:51:01.924707Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 142e7d5d-9f476024-b064fac9-c026621f
2025-09-30T14:51:01.924800Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.925298Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 19434 } }
2025-09-30T14:51:01.925357Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# e87fa2b6-57b12f0c-db43329f-e3151499
2025-09-30T14:51:01.925483Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.925502Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 178792 } }
2025-09-30T14:51:01.925520Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 8da1f229-8ded2954-6c4cd1ef-edf4941e
2025-09-30T14:51:01.925588Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.925610Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.925641Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.925648Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.925656Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.925721Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 186 count 8 size 167624 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.925734Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.925736Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.952998Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 270 to 270
2025-09-30T14:51:01.925743Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 402  requestId: <none> cookie: 202
2025-09-30T14:51:01.925745Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 186 partno 0 count 8 parts 0 suffix '63' size 167624
2025-09-30T14:51:01.925753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.925761Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.925767Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 167496 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.925777Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.925785Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 187, partNo: 0, Offset: 186 is stored on disk
2025-09-30T14:51:01.925789Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.925805Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 188, partNo: 0, Offset: 187 is stored on disk
2025-09-30T14:51:01.925807Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.925812Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 189, partNo: 0, Offset: 188 is stored on disk
2025-09-30T14:51:01.957202Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.925814Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.925818Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 190, partNo: 0, Offset: 189 is stored on disk
2025-09-30T14:51:01.925820Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.957223Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 270
2025-09-30T14:51:01.925823Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 191, partNo: 0, Offset: 190 is stored on disk
2025-09-30T14:51:01.925825Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.925828Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 192, partNo: 0, Offset: 191 is stored on disk
2025-09-30T14:51:01.925831Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.925834Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 193, partNo: 0, Offset: 192 is stored on disk
2025-09-30T14:51:01.925836Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.925840Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 194, partNo: 0, Offset: 193 is stored on disk
2025-09-30T14:51:01.925870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.925881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.953765Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 26144, now ReadSizeBudget = 26034, ReadSizeServerDelta = 472110
2025-09-30T14:51:01.925883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (7)
2025-09-30T14:51:01.925903Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 195 partNo 0
2025-09-30T14:51:01.925930Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 195 partNo 0 FormedBlobsCount 0 NewHead: Offset 194 PartNo 0 PackedSize 21499 count 1 nextOffset 195 batches 1
2025-09-30T14:51:01.925937Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 196 partNo 0
2025-09-30T14:51:01.925942Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 196 partNo 0 FormedBlobsCount 0 NewHead: Offset 194 PartNo 0 PackedSize 43076 count 2 nextOffset 196 batches 1
2025-09-30T14:51:01.925945Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 197 partNo 0
2025-09-30T14:51:01.925949Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 197 partNo 0 FormedBlobsCount 0 NewHead: Offset 194 PartNo 0 PackedSize 64763 count 3 nextOffset 197 batches 1
2025-09-30T14:51:01.925952Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 198 partNo 0
2025-09-30T14:51:01.925956Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 198 partNo 0 FormedBlobsCount 0 NewHead: Offset 194 PartNo 0 PackedSize 86560 count 4 nextOffset 198 batches 1
2025-09-30T14:51:01.925959Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 199 partNo 0
2025-09-30T14:51:01.957314Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 26034, ReadSizeServerDelta = 472110
2025-09-30T14:51:01.925959Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.925964Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 199 partNo 0 FormedBlobsCount 0 NewHead: Offset 194 PartNo 0 PackedSize 108467 count 5 nextOffset 199 batches 1
2025-09-30T14:51:01.925967Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 200 partNo 0
2025-09-30T14:51:01.925971Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 200 partNo 0 FormedBlobsCount 0 NewHead: Offset 194 PartNo 0 PackedSize 130484 count 6 nextOffset 200 batches 1
2025-09-30T14:51:01.925974Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 201 partNo 0
2025-09-30T14:51:01.925978Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 201 partNo 0 FormedBlobsCount 0 NewHead: Offset 194 PartNo 0 PackedSize 152611 count 7 nextOffset 201 batches 1
2025-09-30T14:51:01.925980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.926048Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.926100Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.957350Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 271 to 271
2025-09-30T14:51:01.926117Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.926117Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 194,7 HeadOffset 194 endOffset 194 curOffset 201 d0000000000_00000000000000000194_00000_0000000007_00000? size 152458 WTime 1759243861925
2025-09-30T14:51:01.926122Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.926157Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.957362Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.957366Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 271
2025-09-30T14:51:01.926159Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.926162Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.926164Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.926165Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.926167Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.926169Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.926171Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.926175Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.926177Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.926179Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.926179Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.926180Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.926183Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.957407Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 272 to 272
2025-09-30T14:51:01.926186Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.926188Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.926190Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.926192Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.957416Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 498144
2025-09-30T14:51:01.926195Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.926197Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 18 keys were taken away. Let's read 2078922 bytes (2078922)
2025-09-30T14:51:01.926201Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 18, size 2078922 (8388608)
2025-09-30T14:51:01.926202Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 186 EndOffset 186 newEndOffset 194 commitOffset 0 clientCommitOffset 0 cookie 13 readingFinished 0 firstRead 0
2025-09-30T14:51:01.926205Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 186 endOffset 194
2025-09-30T14:51:01.926214Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 186, endOffset# 194, WTime# 1759243861922, sizeLag# 167624
2025-09-30T14:51:01.926215Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.926216Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.926219Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.926228Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 59676715-c87d58ec-ec76256b-58735179, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 9, size# 201148, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.957460Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.926230Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 202 partNo : 0 messageNo: 404 size 22195 offset: -1
2025-09-30T14:51:01.957464Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 272
2025-09-30T14:51:01.926240Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 373  requestId: <none> cookie: 187
2025-09-30T14:51:01.926242Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 9 maxSize 201148 maxTimeLagMs 0 readTimestampMs 0 readOffset 186 EndOffset 194 ClientCommitOffset 0 committedOffset 0 Guid 59676715-c87d58ec-ec76256b-58735179
2025-09-30T14:51:01.926249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 375  requestId: <none> cookie: 188
2025-09-30T14:51:01.926254Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 377  requestId: <none> cookie: 189
2025-09-30T14:51:01.926257Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.926259Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 379  requestId: <none> cookie: 190
2025-09-30T14:51:01.957491Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (236-236)
2025-09-30T14:51:01.957512Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 273 to 273
2025-09-30T14:51:01.926265Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 382  requestId: <none> cookie: 191
2025-09-30T14:51:01.957526Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 26144 to budget
2025-09-30T14:51:01.926265Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.957546Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.926269Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.957549Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 273
2025-09-30T14:51:01.957552Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (236-236)
2025-09-30T14:51:01.926269Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 383  requestId: <none> cookie: 192
2025-09-30T14:51:01.926274Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 385  requestId: <none> cookie: 193
2025-09-30T14:51:01.926276Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.926279Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 387  requestId: <none> cookie: 194
2025-09-30T14:51:01.957580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 274 to 274
2025-09-30T14:51:01.926282Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.926284Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.926285Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.926287Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.926289Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.926292Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
>>> event from dataHandler: 2025-09-30T14:51:01.957623Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.957626Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 274
2025-09-30T14:51:01.926296Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.926307Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 194 partNo 0 count 7 size 152458
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..25971 bytes.. Information: { Offset: 236 ProducerId: "src_id" SeqNo: 237 CreateTime: 2025-09-30T14:51:01.943000Z WriteTime: 2025-09-30T14:51:01.948000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.926314Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.926316Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.957664Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 1, size 25971 bytes
2025-09-30T14:51:01.926319Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 403  requestId: <none> cookie: 203
2025-09-30T14:51:01.957675Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.926323Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.926331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.926339Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.926341Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.926365Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.926371Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.926386Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 405  requestId: <none> cookie: 204
2025-09-30T14:51:01.926389Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 406  requestId: <none> cookie: 205
2025-09-30T14:51:01.926409Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 407  requestId: <none> cookie: 206
2025-09-30T14:51:01.926422Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 18 Topic 'rt3.dc1--test-topic' partition 0 user user offset 186 count 9 size 201148 endOffset 194 max time lag 0ms effective offset 186
2025-09-30T14:51:01.926436Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 18 added 1 blobs, size 167624 count 8 last offset 186, current partition end offset: 194
2025-09-30T14:51:01.926439Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 18. Send blob request.
2025-09-30T14:51:01.926449Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 186 partno 0 count 8 parts_count 0 source 1 size 167624 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.926451Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.926453Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 18. All 1 blobs are from cache.
2025-09-30T14:51:01.926460Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 186 partno 0 count 8 parts 0 suffix '63'
2025-09-30T14:51:01.926461Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.926502Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.926507Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.926510Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.926784Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 186 totakecount 8 count 8 size 167601 from pos 0 cbcount 8
2025-09-30T14:51:01.926814Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.926817Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.926827Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 203 partNo : 0 messageNo: 408 size 22305 offset: -1
2025-09-30T14:51:01.926834Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.926836Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.926840Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 204 partNo : 0 messageNo: 409 size 22415 offset: -1
2025-09-30T14:51:01.926844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.926846Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.926850Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 205 partNo : 0 messageNo: 410 size 22525 offset: -1
2025-09-30T14:51:01.926854Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.926855Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.926860Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 206 partNo : 0 messageNo: 411 size 22635 offset: -1
2025-09-30T14:51:01.926870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 186
2025-09-30T14:51:01.957820Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 275 to 275
2025-09-30T14:51:01.926882Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.926887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.926889Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.926892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.926894Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.926896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.926898Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.926900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.927020Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 194 Result { Offset: 186 Data: "... 20545 bytes ..." SourceId: "\000src_id" SeqNo: 187 WriteTimestampMS: 1759243861923 CreateTimestampMS: 1759243861921 UncompressedSize: 20471 PartitionKey: "" ExplicitHash: "" } Result { Offset: 187 Data: "... 20655 bytes ..." SourceId: "\000src_id" SeqNo: 188 WriteTimestampMS: 1759243861923 CreateTimestampMS: 1759243861921 UncompressedSize: 20581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 188 Data: "... 20765 bytes ..." SourceId: "\000src_id" SeqNo: 189 WriteTimestampMS: 1759243861923 CreateTimestampMS: 1759243861922 UncompressedSize: 20691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 189 Data: "... 20875 bytes ..." SourceId: "\000src_id" SeqNo: 190 WriteTimestampMS: 1759243861923 CreateTimestampMS: 1759243861922 UncompressedSize: 20801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 190 Data: "... 20985 bytes ..." SourceId: "\000src_id" SeqNo: 191 WriteTimestampMS: 1759243861923 CreateTimestampMS: 1759243861922 UncompressedSize: 20911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 191 Data: "... 21095 bytes ..." SourceId: "\000src_id" SeqNo: 192 WriteTimestampMS: 1759243861923 CreateTimestampMS: 1759243861922 UncompressedSize: 21021 PartitionKey: "" ExplicitHash: "" } Result { Offset: 192 Data: "... 21205 bytes ..." SourceId: "\000src_id" SeqNo: 193 WriteTimestampMS: 1759243861923 CreateTimestampMS: 1759243861922 UncompressedSize: 21131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 193 Data: "... 21315 bytes ..." SourceId: "\000src_id" SeqNo: 194 WriteTimestampMS: 1759243861923 CreateTimestampMS: 1759243861922 UncompressedSize: 21241 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551464 RealReadOffset: 193 WaitQuotaTimeMs: 0 EndOffset: 194 StartOffset: 0 } Cookie: 186 }
2025-09-30T14:51:01.927093Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 14 from offset 194
2025-09-30T14:51:01.927101Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 194 ReadOffset 194 ReadGuid 59676715-c87d58ec-ec76256b-58735179 has messages 1
2025-09-30T14:51:01.957868Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.927151Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 59676715-c87d58ec-ec76256b-58735179, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 167301
2025-09-30T14:51:01.927160Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 59676715-c87d58ec-ec76256b-58735179
2025-09-30T14:51:01.927448Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.957874Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 275
2025-09-30T14:51:01.927755Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 194 count 7 size 152458 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.927774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.927779Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 194 partno 0 count 7 parts 0 suffix '63' size 152458
2025-09-30T14:51:01.927788Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 152334 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.927796Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.927805Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 195, partNo: 0, Offset: 194 is stored on disk
2025-09-30T14:51:01.927809Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.927814Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 196, partNo: 0, Offset: 195 is stored on disk
2025-09-30T14:51:01.927816Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.927820Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 197, partNo: 0, Offset: 196 is stored on disk
2025-09-30T14:51:01.927822Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.927828Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 198, partNo: 0, Offset: 197 is stored on disk
2025-09-30T14:51:01.927831Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.927834Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 199, partNo: 0, Offset: 198 is stored on disk
2025-09-30T14:51:01.927837Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.927840Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 200, partNo: 0, Offset: 199 is stored on disk
2025-09-30T14:51:01.927843Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.927846Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 201, partNo: 0, Offset: 200 is stored on disk
2025-09-30T14:51:01.927879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.927889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.927891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-09-30T14:51:01.927899Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 194 EndOffset 194 newEndOffset 201 commitOffset 0 clientCommitOffset 0 cookie 14 readingFinished 0 firstRead 0
2025-09-30T14:51:01.927905Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 194 endOffset 201
2025-09-30T14:51:01.958002Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 276 to 276
2025-09-30T14:51:01.927912Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 202 partNo 0
2025-09-30T14:51:01.927916Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 194, endOffset# 201, WTime# 1759243861923, sizeLag# 152458
2025-09-30T14:51:01.958011Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.927919Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.958014Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 276
2025-09-30T14:51:01.927929Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# c1dd9027-5960da86-1ef5f474-d5e13501, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 182949, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.927937Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 202 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 22269 count 1 nextOffset 202 batches 1
2025-09-30T14:51:01.927941Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 182949 maxTimeLagMs 0 readTimestampMs 0 readOffset 194 EndOffset 201 ClientCommitOffset 0 committedOffset 0 Guid c1dd9027-5960da86-1ef5f474-d5e13501
2025-09-30T14:51:01.958025Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 277 to 277
2025-09-30T14:51:01.927944Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 203 partNo 0
2025-09-30T14:51:01.958034Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.958044Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 277
2025-09-30T14:51:01.927950Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 203 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 44616 count 2 nextOffset 203 batches 1
2025-09-30T14:51:01.927954Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 204 partNo 0
2025-09-30T14:51:01.927958Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 204 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 67073 count 3 nextOffset 204 batches 1
2025-09-30T14:51:01.927961Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 205 partNo 0
2025-09-30T14:51:01.927966Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 205 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 89640 count 4 nextOffset 205 batches 1
2025-09-30T14:51:01.958057Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 278 to 278
2025-09-30T14:51:01.927969Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 206 partNo 0
2025-09-30T14:51:01.927974Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 206 partNo 0 FormedBlobsCount 0 NewHead: Offset 201 PartNo 0 PackedSize 112317 count 5 nextOffset 206 batches 1
2025-09-30T14:51:01.927976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.928086Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 201,5 HeadOffset 201 endOffset 201 curOffset 206 d0000000000_00000000000000000201_00000_0000000005_00000? size 112226 WTime 1759243861927
2025-09-30T14:51:01.928125Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.958096Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.928127Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.958103Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 278
2025-09-30T14:51:01.928129Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.928131Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.928133Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.928135Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.928137Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.928139Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.928141Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.928143Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.928145Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.928146Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.928148Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.928154Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.928157Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.928159Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.928163Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.928165Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.928167Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.928176Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 19 keys were taken away. Let's read 2231380 bytes (2231380)
2025-09-30T14:51:01.928179Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 19, size 2231380 (8388608)
2025-09-30T14:51:01.928194Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 393  requestId: <none> cookie: 195
2025-09-30T14:51:01.928211Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 395  requestId: <none> cookie: 196
2025-09-30T14:51:01.928217Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 396  requestId: <none> cookie: 197
2025-09-30T14:51:01.928217Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.928222Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 397  requestId: <none> cookie: 198
2025-09-30T14:51:01.928225Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.928227Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 398  requestId: <none> cookie: 199
2025-09-30T14:51:01.928230Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.928232Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 400  requestId: <none> cookie: 200
2025-09-30T14:51:01.928237Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 401  requestId: <none> cookie: 201
2025-09-30T14:51:01.928240Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.928246Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.928249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.928254Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.928259Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.928265Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.928275Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 201 partNo 0 count 5 size 112226
2025-09-30T14:51:01.928336Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 19 Topic 'rt3.dc1--test-topic' partition 0 user user offset 194 count 8 size 182949 endOffset 201 max time lag 0ms effective offset 194
2025-09-30T14:51:01.928349Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 19 added 1 blobs, size 152458 count 7 last offset 194, current partition end offset: 201
2025-09-30T14:51:01.958238Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 279 to 279
2025-09-30T14:51:01.928351Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 19. Send blob request.
2025-09-30T14:51:01.928356Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.958248Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.928361Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 194 partno 0 count 7 parts_count 0 source 1 size 152458 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.958251Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 279
2025-09-30T14:51:01.928364Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 19. All 1 blobs are from cache.
2025-09-30T14:51:01.928373Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.928386Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 194 partno 0 count 7 parts 0 suffix '63'
2025-09-30T14:51:01.928461Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 194 totakecount 7 count 7 size 152435 from pos 0 cbcount 7
2025-09-30T14:51:01.928489Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 194
2025-09-30T14:51:01.928586Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 201 Result { Offset: 194 Data: "... 21425 bytes ..." SourceId: "\000src_id" SeqNo: 195 WriteTimestampMS: 1759243861925 CreateTimestampMS: 1759243861922 UncompressedSize: 21351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 195 Data: "... 21535 bytes ..." SourceId: "\000src_id" SeqNo: 196 WriteTimestampMS: 1759243861925 CreateTimestampMS: 1759243861922 UncompressedSize: 21461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 196 Data: "... 21645 bytes ..." SourceId: "\000src_id" SeqNo: 197 WriteTimestampMS: 1759243861925 CreateTimestampMS: 1759243861922 UncompressedSize: 21571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 197 Data: "... 21755 bytes ..." SourceId: "\000src_id" SeqNo: 198 WriteTimestampMS: 1759243861925 CreateTimestampMS: 1759243861922 UncompressedSize: 21681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 198 Data: "... 21865 bytes ..." SourceId: "\000src_id" SeqNo: 199 WriteTimestampMS: 1759243861925 CreateTimestampMS: 1759243861922 UncompressedSize: 21791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 199 Data: "... 21975 bytes ..." SourceId: "\000src_id" SeqNo: 200 WriteTimestampMS: 1759243861925 CreateTimestampMS: 1759243861922 UncompressedSize: 21901 PartitionKey: "" ExplicitHash: "" } Result { Offset: 200 Data: "... 22085 bytes ..." SourceId: "\000src_id" SeqNo: 201 WriteTimestampMS: 1759243861925 CreateTimestampMS: 1759243861922 UncompressedSize: 22011 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551495 RealReadOffset: 200 WaitQuotaTimeMs: 0 EndOffset: 201 StartOffset: 0 } Cookie: 194 }
2025-09-30T14:51:01.928654Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 15 from offset 201
2025-09-30T14:51:01.928661Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 201 ReadOffset 201 ReadGuid c1dd9027-5960da86-1ef5f474-d5e13501 has messages 1
2025-09-30T14:51:01.928691Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# c1dd9027-5960da86-1ef5f474-d5e13501, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 152180
2025-09-30T14:51:01.928701Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# c1dd9027-5960da86-1ef5f474-d5e13501
2025-09-30T14:51:01.928984Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.929224Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.929287Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.929336Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.958318Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 280 to 280
2025-09-30T14:51:01.929341Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.958328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.929353Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 20534 } }
2025-09-30T14:51:01.958332Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 280
2025-09-30T14:51:01.929358Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 412  requestId: <none> cookie: 207
2025-09-30T14:51:01.929367Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929370Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# d1cfc679-90c36034-6f3d4061-c76e7e8c
2025-09-30T14:51:01.929424Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.929426Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.929437Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 207 partNo : 0 messageNo: 413 size 22745 offset: -1
2025-09-30T14:51:01.929449Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 201 count 5 size 112226 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.929464Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.929467Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.929473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.929477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.929490Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 112110 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.929494Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 201 partno 0 count 5 parts 0 suffix '63' size 112226
2025-09-30T14:51:01.958467Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 281 to 281
2025-09-30T14:51:01.958838Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 459150, now ReadSizeBudget = 26144, ReadSizeServerDelta = 38994
2025-09-30T14:51:01.929497Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.929504Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 202, partNo: 0, Offset: 201 is stored on disk
2025-09-30T14:51:01.929510Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.929513Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 203, partNo: 0, Offset: 202 is stored on disk
2025-09-30T14:51:01.929516Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.929520Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 204, partNo: 0, Offset: 203 is stored on disk
2025-09-30T14:51:01.929522Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.929526Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 205, partNo: 0, Offset: 204 is stored on disk
2025-09-30T14:51:01.929528Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.929532Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 206, partNo: 0, Offset: 205 is stored on disk
2025-09-30T14:51:01.929548Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.929557Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.929558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.929564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.929566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.962117Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.962124Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 26144, ReadSizeServerDelta = 38994
2025-09-30T14:51:01.929582Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 207 partNo 0
2025-09-30T14:51:01.962134Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 281
2025-09-30T14:51:01.929601Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.929605Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 207 partNo 0 FormedBlobsCount 0 NewHead: Offset 206 PartNo 0 PackedSize 22819 count 1 nextOffset 207 batches 1
2025-09-30T14:51:01.929610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.929615Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.929644Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.929670Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 167301 } }
2025-09-30T14:51:01.929696Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 206,1 HeadOffset 206 endOffset 206 curOffset 207 d0000000000_00000000000000000206_00000_0000000001_00000? size 22810 WTime 1759243861929
2025-09-30T14:51:01.929714Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.929716Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.929718Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.962175Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 65138
2025-09-30T14:51:01.929720Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 894f0c16-94477722-4db72a7f-f19f7cb5
2025-09-30T14:51:01.929720Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.929722Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.929727Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.929729Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.929731Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.929732Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.929734Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 201 EndOffset 201 newEndOffset 206 commitOffset 0 clientCommitOffset 0 cookie 15 readingFinished 0 firstRead 0
2025-09-30T14:51:01.962204Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 282 to 282
2025-09-30T14:51:01.929734Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.929736Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.929737Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 201 endOffset 206
2025-09-30T14:51:01.929738Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.929740Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.929742Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.929744Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.962215Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.929745Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.962225Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (237-253)
2025-09-30T14:51:01.962229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 282
2025-09-30T14:51:01.962248Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 459150 to budget
2025-09-30T14:51:01.929747Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.962261Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 283 to 283
2025-09-30T14:51:01.929749Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.929751Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.929752Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.962270Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.962271Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (237-237)
2025-09-30T14:51:01.929754Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.929756Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 20 keys were taken away. Let's read 2343606 bytes (2343606)
2025-09-30T14:51:01.962274Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 283
2025-09-30T14:51:01.929759Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 20, size 2343606 (8388608)
2025-09-30T14:51:01.962296Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (238-238)
2025-09-30T14:51:01.929768Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 404  requestId: <none> cookie: 202
2025-09-30T14:51:01.929775Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 408  requestId: <none> cookie: 203
2025-09-30T14:51:01.929780Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 409  requestId: <none> cookie: 204
2025-09-30T14:51:01.929785Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 410  requestId: <none> cookie: 205
2025-09-30T14:51:01.962312Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (239-239)
2025-09-30T14:51:01.929789Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 411  requestId: <none> cookie: 206
2025-09-30T14:51:01.929794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.962319Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (240-240)
2025-09-30T14:51:01.929794Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929796Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.929801Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929801Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.929803Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.929805Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929807Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.929808Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929810Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.929814Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929815Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.929822Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.929825Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 206 partNo 0 count 1 size 22810
2025-09-30T14:51:01.929829Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.929861Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 414  requestId: <none> cookie: 208
2025-09-30T14:51:01.929865Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 415  requestId: <none> cookie: 209
2025-09-30T14:51:01.929868Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 416  requestId: <none> cookie: 210
2025-09-30T14:51:01.929896Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 201, endOffset# 206, WTime# 1759243861925, sizeLag# 112226
2025-09-30T14:51:01.929898Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.929908Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 33b09b44-6aa4fa46-897c2fb3-93f6dc59, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 134671, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.929920Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 134671 maxTimeLagMs 0 readTimestampMs 0 readOffset 201 EndOffset 206 ClientCommitOffset 0 committedOffset 0 Guid 33b09b44-6aa4fa46-897c2fb3-93f6dc59
2025-09-30T14:51:01.929930Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.929932Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.929941Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.929942Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.929945Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929951Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.962425Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 284 to 284
2025-09-30T14:51:01.962432Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (241-241)
2025-09-30T14:51:01.929953Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 417  requestId: <none> cookie: 211
2025-09-30T14:51:01.962439Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (242-242)
2025-09-30T14:51:01.929956Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.929966Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 20 Topic 'rt3.dc1--test-topic' partition 0 user user offset 201 count 6 size 134671 endOffset 206 max time lag 0ms effective offset 201
2025-09-30T14:51:01.962449Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (243-243)
2025-09-30T14:51:01.929968Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.962457Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (244-244)
2025-09-30T14:51:01.929973Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.962450Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.929981Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.962466Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 284
2025-09-30T14:51:01.929981Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 20 added 1 blobs, size 112226 count 5 last offset 201, current partition end offset: 206
2025-09-30T14:51:01.929984Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 20. Send blob request.
2025-09-30T14:51:01.929989Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.929991Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.929998Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 208 partNo : 0 messageNo: 418 size 22855 offset: -1
2025-09-30T14:51:01.962480Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 431548, now ReadSizeBudget = 459150, ReadSizeServerDelta = -366410
2025-09-30T14:51:01.930002Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930005Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930012Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 209 partNo : 0 messageNo: 419 size 22965 offset: -1
2025-09-30T14:51:01.930015Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930017Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930021Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 210 partNo : 0 messageNo: 420 size 23075 offset: -1
2025-09-30T14:51:01.930025Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.962516Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (245-245)
2025-09-30T14:51:01.930026Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930030Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 211 partNo : 0 messageNo: 421 size 23185 offset: -1
2025-09-30T14:51:01.930039Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 201 partno 0 count 5 parts_count 0 source 1 size 112226 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.962523Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (246-246)
2025-09-30T14:51:01.930043Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 20. All 1 blobs are from cache.
2025-09-30T14:51:01.930050Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930051Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.962546Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (247-247)
2025-09-30T14:51:01.930055Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.930058Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 201 partno 0 count 5 parts 0 suffix '63'
2025-09-30T14:51:01.930061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.962553Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (248-248)
2025-09-30T14:51:01.930063Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.930066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.930066Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.930068Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.962570Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (249-249)
2025-09-30T14:51:01.930070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.962586Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (250-250)
2025-09-30T14:51:01.930073Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.930085Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.962594Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (251-251)
2025-09-30T14:51:01.930088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.962621Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 15} (252-252)
2025-09-30T14:51:01.930093Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.930104Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.930202Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 201 totakecount 5 count 5 size 112203 from pos 0 cbcount 5
2025-09-30T14:51:01.962632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 285 to 285
2025-09-30T14:51:01.930218Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.962646Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.930224Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930228Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.962650Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 285
2025-09-30T14:51:01.930234Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930236Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930243Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 201
2025-09-30T14:51:01.930246Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.930251Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 422  requestId: <none> cookie: 212
2025-09-30T14:51:01.930261Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.930286Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 423  requestId: <none> cookie: 213
2025-09-30T14:51:01.930291Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 424  requestId: <none> cookie: 214
2025-09-30T14:51:01.930294Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930301Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930303Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930309Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 212 partNo : 0 messageNo: 426 size 23295 offset: -1
2025-09-30T14:51:01.930314Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.930318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.930321Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 425  requestId: <none> cookie: 215
2025-09-30T14:51:01.930331Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.930337Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.962723Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 286 to 286
2025-09-30T14:51:01.930343Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.962735Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.962752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 286
2025-09-30T14:51:01.930343Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 206 Result { Offset: 201 Data: "... 22195 bytes ..." SourceId: "\000src_id" SeqNo: 202 WriteTimestampMS: 1759243861927 CreateTimestampMS: 1759243861922 UncompressedSize: 22121 PartitionKey: "" ExplicitHash: "" } Result { Offset: 202 Data: "... 22305 bytes ..." SourceId: "\000src_id" SeqNo: 203 WriteTimestampMS: 1759243861927 CreateTimestampMS: 1759243861925 UncompressedSize: 22231 PartitionKey: "" ExplicitHash: "" } Result { Offset: 203 Data: "... 22415 bytes ..." SourceId: "\000src_id" SeqNo: 204 WriteTimestampMS: 1759243861927 CreateTimestampMS: 1759243861925 UncompressedSize: 22341 PartitionKey: "" ExplicitHash: "" } Result { Offset: 204 Data: "... 22525 bytes ..." SourceId: "\000src_id" SeqNo: 205 WriteTimestampMS: 1759243861927 CreateTimestampMS: 1759243861925 UncompressedSize: 22451 PartitionKey: "" ExplicitHash: "" } Result { Offset: 205 Data: "... 22635 bytes ..." SourceId: "\000src_id" SeqNo: 206 WriteTimestampMS: 1759243861927 CreateTimestampMS: 1759243861925 UncompressedSize: 22561 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551557 RealReadOffset: 205 WaitQuotaTimeMs: 0 EndOffset: 206 StartOffset: 0 } Cookie: 201 }
2025-09-30T14:51:01.930360Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.930440Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.930446Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.930464Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 16 from offset 206
2025-09-30T14:51:01.930471Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 206 ReadOffset 206 ReadGuid 33b09b44-6aa4fa46-897c2fb3-93f6dc59 has messages 1
2025-09-30T14:51:01.930499Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930504Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930508Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.930516Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 213 partNo : 0 messageNo: 427 size 23405 offset: -1
2025-09-30T14:51:01.930522Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930524Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930530Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 214 partNo : 0 messageNo: 428 size 23515 offset: -1
2025-09-30T14:51:01.930534Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930537Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930541Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 215 partNo : 0 messageNo: 429 size 23625 offset: -1
2025-09-30T14:51:01.962815Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 287 to 287
2025-09-30T14:51:01.930545Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.962826Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.930547Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930576Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.962829Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 287
2025-09-30T14:51:01.930592Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.930624Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 33b09b44-6aa4fa46-897c2fb3-93f6dc59, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 112038
2025-09-30T14:51:01.930630Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 33b09b44-6aa4fa46-897c2fb3-93f6dc59
2025-09-30T14:51:01.930688Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.930697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.930699Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.930702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.930704Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.930708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.930719Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930722Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930727Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930729Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930735Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 430  requestId: <none> cookie: 216
2025-09-30T14:51:01.962890Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 288 to 288
2025-09-30T14:51:01.962898Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 16} (253-253)
2025-09-30T14:51:01.962901Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.962905Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 288
2025-09-30T14:51:01.930745Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 431  requestId: <none> cookie: 217
2025-09-30T14:51:01.930745Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.930748Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 432  requestId: <none> cookie: 218
2025-09-30T14:51:01.930760Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.930766Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.930771Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.930812Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930816Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930826Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 216 partNo : 0 messageNo: 433 size 23735 offset: -1
2025-09-30T14:51:01.930832Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930834Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.930838Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 217 partNo : 0 messageNo: 434 size 23845 offset: -1
2025-09-30T14:51:01.962948Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 289 to 289
2025-09-30T14:51:01.930842Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.930844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.962955Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.930849Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 218 partNo : 0 messageNo: 435 size 23955 offset: -1
2025-09-30T14:51:01.930853Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.962958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 289
2025-09-30T14:51:01.930860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.930863Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.930865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.962988Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (254-268)
2025-09-30T14:51:01.930867Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.963007Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 431548 to budget
2025-09-30T14:51:01.930870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.931187Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 206 count 1 size 22810 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.931199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.931211Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 22752 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.963016Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 890698, ReadSizeServerDelta = -366410
2025-09-30T14:51:01.931217Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.931217Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 206 partno 0 count 1 parts 0 suffix '63' size 22810
2025-09-30T14:51:01.931224Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 207, partNo: 0, Offset: 206 is stored on disk
2025-09-30T14:51:01.931277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.931289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.931291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (11)
2025-09-30T14:51:01.931298Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 206 EndOffset 206 newEndOffset 207 commitOffset 0 clientCommitOffset 0 cookie 16 readingFinished 0 firstRead 0
2025-09-30T14:51:01.931304Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 206 endOffset 207
2025-09-30T14:51:01.931308Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 208 partNo 0
2025-09-30T14:51:01.931316Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 206, endOffset# 207, WTime# 1759243861927, sizeLag# 22810
2025-09-30T14:51:01.963070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 290 to 290
2025-09-30T14:51:01.931319Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.963081Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.931329Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 208 partNo 0 FormedBlobsCount 0 NewHead: Offset 207 PartNo 0 PackedSize 22929 count 1 nextOffset 208 batches 1
2025-09-30T14:51:01.963085Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 290
2025-09-30T14:51:01.931330Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 25608725-20eccad7-eaa83818-6480cfb5, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 27372, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.931336Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 209 partNo 0
2025-09-30T14:51:01.931342Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 27372 maxTimeLagMs 0 readTimestampMs 0 readOffset 206 EndOffset 207 ClientCommitOffset 0 committedOffset 0 Guid 25608725-20eccad7-eaa83818-6480cfb5
2025-09-30T14:51:01.931342Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 209 partNo 0 FormedBlobsCount 0 NewHead: Offset 207 PartNo 0 PackedSize 45936 count 2 nextOffset 209 batches 1
2025-09-30T14:51:01.931346Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 210 partNo 0
2025-09-30T14:51:01.931350Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 210 partNo 0 FormedBlobsCount 0 NewHead: Offset 207 PartNo 0 PackedSize 69053 count 3 nextOffset 210 batches 1
2025-09-30T14:51:01.963105Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:01.931354Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 211 partNo 0
2025-09-30T14:51:01.931358Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 211 partNo 0 FormedBlobsCount 0 NewHead: Offset 207 PartNo 0 PackedSize 92280 count 4 nextOffset 211 batches 1
2025-09-30T14:51:01.931361Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 212 partNo 0
2025-09-30T14:51:01.931365Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 212 partNo 0 FormedBlobsCount 0 NewHead: Offset 207 PartNo 0 PackedSize 115617 count 5 nextOffset 212 batches 1
2025-09-30T14:51:01.931369Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 213 partNo 0
2025-09-30T14:51:01.931374Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 213 partNo 0 FormedBlobsCount 0 NewHead: Offset 207 PartNo 0 PackedSize 139064 count 6 nextOffset 213 batches 1
2025-09-30T14:51:01.931378Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 214 partNo 0
2025-09-30T14:51:01.931382Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 214 partNo 0 FormedBlobsCount 0 NewHead: Offset 207 PartNo 0 PackedSize 162621 count 7 nextOffset 214 batches 1
2025-09-30T14:51:01.963143Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (254-254)
2025-09-30T14:51:01.931385Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 215 partNo 0
2025-09-30T14:51:01.931392Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 215 partNo 0 FormedBlobsCount 0 NewHead: Offset 207 PartNo 0 PackedSize 186288 count 8 nextOffset 215 batches 1
2025-09-30T14:51:01.931395Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 216 partNo 0
2025-09-30T14:51:01.931401Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 216 partNo 0 FormedBlobsCount 0 NewHead: Offset 207 PartNo 0 PackedSize 210065 count 9 nextOffset 216 batches 1
2025-09-30T14:51:01.931405Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 217 partNo 0
2025-09-30T14:51:01.963169Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 291 to 291
2025-09-30T14:51:01.931408Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 217 partNo 0 FormedBlobsCount 0 NewHead: Offset 207 PartNo 0 PackedSize 233952 count 10 nextOffset 217 batches 1
2025-09-30T14:51:01.963175Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.963182Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 291
2025-09-30T14:51:01.931411Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 218 partNo 0
2025-09-30T14:51:01.931415Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 218 partNo 0 FormedBlobsCount 0 NewHead: Offset 207 PartNo 0 PackedSize 257949 count 11 nextOffset 218 batches 1
2025-09-30T14:51:01.931418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.931562Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 207,11 HeadOffset 207 endOffset 207 curOffset 218 d0000000000_00000000000000000207_00000_0000000011_00000? size 257672 WTime 1759243861931
2025-09-30T14:51:01.931616Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.931619Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.931622Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.963208Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (255-255)
2025-09-30T14:51:01.931624Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.931626Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.931628Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.931630Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.931633Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.931635Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.931636Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.931641Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.931644Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.931646Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.931648Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.931651Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.931653Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.931655Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.931657Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.963298Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 292 to 292
2025-09-30T14:51:01.931659Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.963307Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.931661Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.963309Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (256-256)
2025-09-30T14:51:01.931663Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.963320Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (257-257)
2025-09-30T14:51:01.963310Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 292
2025-09-30T14:51:01.931667Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 21 keys were taken away. Let's read 2366416 bytes (2366416)
2025-09-30T14:51:01.931673Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 21, size 2366416 (8388608)
2025-09-30T14:51:01.931684Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 413  requestId: <none> cookie: 207
2025-09-30T14:51:01.931709Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.931713Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.931723Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.931734Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 207 partNo 0 count 11 size 257672
2025-09-30T14:51:01.931737Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.931792Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 21 Topic 'rt3.dc1--test-topic' partition 0 user user offset 206 count 1 size 27372 endOffset 207 max time lag 0ms effective offset 206
2025-09-30T14:51:01.931806Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 21 added 1 blobs, size 22810 count 1 last offset 206, current partition end offset: 207
2025-09-30T14:51:01.963397Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 293 to 293
2025-09-30T14:51:01.931809Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 21. Send blob request.
2025-09-30T14:51:01.931824Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 206 partno 0 count 1 parts_count 0 source 1 size 22810 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.931837Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 21. All 1 blobs are from cache.
2025-09-30T14:51:01.963420Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (258-258)
2025-09-30T14:51:01.931846Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.931860Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 206 partno 0 count 1 parts 0 suffix '63'
>>> event from dataHandler: 2025-09-30T14:51:01.931862Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 206 totakecount 1 count 1 size 22787 from pos 0 cbcount 1
2025-09-30T14:51:01.931879Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 206
2025-09-30T14:51:01.965755Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.965757Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (259-259)
2025-09-30T14:51:01.965764Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 293
2025-09-30T14:51:01.931939Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 207 Result { Offset: 206 Data: "... 22745 bytes ..." SourceId: "\000src_id" SeqNo: 207 WriteTimestampMS: 1759243861929 CreateTimestampMS: 1759243861925 UncompressedSize: 22671 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 206 WaitQuotaTimeMs: 0 EndOffset: 207 StartOffset: 0 } Cookie: 206 }
2025-09-30T14:51:01.931962Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 17 from offset 207
2025-09-30T14:51:01.965774Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (260-260)
2025-09-30T14:51:01.931969Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 207 ReadOffset 207 ReadGuid 25608725-20eccad7-eaa83818-6480cfb5 has messages 1
2025-09-30T14:51:01.931991Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 25608725-20eccad7-eaa83818-6480cfb5, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 22844
2025-09-30T14:51:01.965784Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (261-261)
2025-09-30T14:51:01.931997Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 25608725-20eccad7-eaa83818-6480cfb5
2025-09-30T14:51:01.932077Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.932595Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.932660Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.932746Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.932752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.932763Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 152180 } }
2025-09-30T14:51:01.932770Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 436  requestId: <none> cookie: 219
2025-09-30T14:51:01.932776Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# d2915c7c-7d7a597d-ce731830-6824cf44
2025-09-30T14:51:01.932785Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.932813Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.932821Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.932825Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.965836Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 8} (262-262)
2025-09-30T14:51:01.932838Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 219 partNo : 0 messageNo: 437 size 24065 offset: -1
2025-09-30T14:51:01.932844Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.932854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.965848Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 9} (263-263)
2025-09-30T14:51:01.932860Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.932871Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.965856Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 10} (264-264)
2025-09-30T14:51:01.932872Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.932876Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.932901Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 438  requestId: <none> cookie: 220
2025-09-30T14:51:01.932912Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 112038 } }
2025-09-30T14:51:01.932920Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# ef5c9211-9e585d53-82e5f0d5-40d8b9e0
2025-09-30T14:51:01.932938Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.932951Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.932958Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.932961Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.965885Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 294 to 294
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..26081 bytes.. Information: { Offset: 237 ProducerId: "src_id" SeqNo: 238 CreateTime: 2025-09-30T14:51:01.943000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26191 bytes.. Information: { Offset: 238 ProducerId: "src_id" SeqNo: 239 CreateTime: 2025-09-30T14:51:01.943000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26301 bytes.. Information: { Offset: 239 ProducerId: "src_id" SeqNo: 240 CreateTime: 2025-09-30T14:51:01.947000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26411 bytes.. Information: { Offset: 240 ProducerId: "src_id" SeqNo: 241 CreateTime: 2025-09-30T14:51:01.947000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26521 bytes.. Information: { Offset: 241 ProducerId: "src_id" SeqNo: 242 CreateTime: 2025-09-30T14:51:01.947000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26631 bytes.. Information: { Offset: 242 ProducerId: "src_id" SeqNo: 243 CreateTime: 2025-09-30T14:51:01.947000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26741 bytes.. Information: { Offset: 243 ProducerId: "src_id" SeqNo: 244 CreateTime: 2025-09-30T14:51:01.947000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26851 bytes.. Information: { Offset: 244 ProducerId: "src_id" SeqNo: 245 CreateTime: 2025-09-30T14:51:01.947000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..26961 bytes.. Information: { Offset: 245 ProducerId: "src_id" SeqNo: 246 CreateTime: 2025-09-30T14:51:01.947000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27071 bytes.. Information: { Offset: 246 ProducerId: "src_id" SeqNo: 247 CreateTime: 2025-09-30T14:51:01.947000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27181 bytes.. Information: { Offset: 247 ProducerId: "src_id" SeqNo: 248 CreateTime: 2025-09-30T14:51:01.948000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27291 bytes.. Information: { Offset: 248 ProducerId: "src_id" SeqNo: 249 CreateTime: 2025-09-30T14:51:01.948000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27401 bytes.. Information: { Offset: 249 ProducerId: "src_id" SeqNo: 250 CreateTime: 2025-09-30T14:51:01.948000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27511 bytes.. Information: { Offset: 250 ProducerId: "src_id" SeqNo: 251 CreateTime: 2025-09-30T14:51:01.948000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27621 bytes.. Information: { Offset: 251 ProducerId: "src_id" SeqNo: 252 CreateTime: 2025-09-30T14:51:01.948000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27731 bytes.. Information: { Offset: 252 ProducerId: "src_id" SeqNo: 253 CreateTime: 2025-09-30T14:51:01.948000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..27841 bytes.. Information: { Offset: 253 ProducerId: "src_id" SeqNo: 254 CreateTime: 2025-09-30T14:51:01.948000Z WriteTime: 2025-09-30T14:51:01.951000Z MessageGroupId: "src_id" Meta: { "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.965899Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.965900Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 11} (265-265)
2025-09-30T14:51:01.965903Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 294
2025-09-30T14:51:01.965906Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 240460, now ReadSizeBudget = 0, ReadSizeServerDelta = 283828
2025-09-30T14:51:01.932971Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 220 partNo : 0 messageNo: 439 size 24175 offset: -1
2025-09-30T14:51:01.932977Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.932980Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.932984Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.932987Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.932991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.965950Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 12} (266-266)
2025-09-30T14:51:01.932995Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 440  requestId: <none> cookie: 221
2025-09-30T14:51:01.933045Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933062Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.933094Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.933102Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.933125Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 221 partNo : 0 messageNo: 441 size 24285 offset: -1
2025-09-30T14:51:01.933134Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.933136Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.933144Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.933153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.933162Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 442  requestId: <none> cookie: 222
2025-09-30T14:51:01.965994Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 295 to 295
2025-09-30T14:51:01.933194Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933212Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.965995Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 13} (267-267)
2025-09-30T14:51:01.966006Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.933220Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 207 count 11 size 257672 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.966010Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 295
2025-09-30T14:51:01.933229Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.966014Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 14} (268-268)
2025-09-30T14:51:01.933232Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.933238Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 207 partno 0 count 11 parts 0 suffix '63' size 257672
2025-09-30T14:51:01.933240Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 222 partNo : 0 messageNo: 443 size 24395 offset: -1
2025-09-30T14:51:01.933246Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.933258Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 257532 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.933261Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.933266Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.933273Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 208, partNo: 0, Offset: 207 is stored on disk
2025-09-30T14:51:01.933277Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.933281Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 209, partNo: 0, Offset: 208 is stored on disk
2025-09-30T14:51:01.933283Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.966053Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 17, size 458337 bytes
2025-09-30T14:51:01.933286Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 210, partNo: 0, Offset: 209 is stored on disk
2025-09-30T14:51:01.966059Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 296 to 296
2025-09-30T14:51:01.933289Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.966062Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 283828
2025-09-30T14:51:01.966065Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.966068Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 296
2025-09-30T14:51:01.933292Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 211, partNo: 0, Offset: 210 is stored on disk
2025-09-30T14:51:01.933294Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.933298Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 212, partNo: 0, Offset: 211 is stored on disk
2025-09-30T14:51:01.933300Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.966084Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.933303Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 213, partNo: 0, Offset: 212 is stored on disk
2025-09-30T14:51:01.933305Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.966089Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 283828
2025-09-30T14:51:01.933309Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 214, partNo: 0, Offset: 213 is stored on disk
2025-09-30T14:51:01.966099Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (269-276)
2025-09-30T14:51:01.933312Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.966115Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 297 to 297
2025-09-30T14:51:01.933316Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 215, partNo: 0, Offset: 214 is stored on disk
2025-09-30T14:51:01.933318Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.966121Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.933322Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 216, partNo: 0, Offset: 215 is stored on disk
2025-09-30T14:51:01.966124Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 297
2025-09-30T14:51:01.966124Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 240460 to budget
2025-09-30T14:51:01.933324Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.966131Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 240460, ReadSizeServerDelta = 283828
2025-09-30T14:51:01.933328Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 217, partNo: 0, Offset: 216 is stored on disk
2025-09-30T14:51:01.933331Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.933334Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 218, partNo: 0, Offset: 217 is stored on disk
2025-09-30T14:51:01.933361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.933369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.933371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (3)
2025-09-30T14:51:01.933372Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.933388Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 219 partNo 0
2025-09-30T14:51:01.933412Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 219 partNo 0 FormedBlobsCount 0 NewHead: Offset 218 PartNo 0 PackedSize 24139 count 1 nextOffset 219 batches 1
2025-09-30T14:51:01.933418Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 220 partNo 0
2025-09-30T14:51:01.933419Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.933423Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 220 partNo 0 FormedBlobsCount 0 NewHead: Offset 218 PartNo 0 PackedSize 48356 count 2 nextOffset 220 batches 1
2025-09-30T14:51:01.966177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 298 to 298
2025-09-30T14:51:01.933424Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.933427Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 221 partNo 0
2025-09-30T14:51:01.933433Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 221 partNo 0 FormedBlobsCount 0 NewHead: Offset 218 PartNo 0 PackedSize 72683 count 3 nextOffset 221 batches 1
2025-09-30T14:51:01.933435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.933460Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.933463Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.966207Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.966210Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 298
2025-09-30T14:51:01.966210Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:01.933527Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 218,3 HeadOffset 218 endOffset 218 curOffset 221 d0000000000_00000000000000000218_00000_0000000003_00000? size 72654 WTime 1759243861933
2025-09-30T14:51:01.933555Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.933556Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.966229Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 299 to 299
2025-09-30T14:51:01.933559Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.933560Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.933564Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.933566Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.933569Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.933571Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.933573Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.933575Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.933576Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.966261Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (269-269)
2025-09-30T14:51:01.933578Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.966266Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.966275Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 299
2025-09-30T14:51:01.933579Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.933581Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.933583Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.933586Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.933599Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.933600Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.933602Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.933604Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.933605Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.933607Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.933607Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.933609Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 22 keys were taken away. Let's read 2624088 bytes (2624088)
2025-09-30T14:51:01.966318Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (270-270)
2025-09-30T14:51:01.933612Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 22, size 2624088 (8388608)
2025-09-30T14:51:01.933622Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.933629Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 207 EndOffset 207 newEndOffset 218 commitOffset 0 clientCommitOffset 0 cookie 17 readingFinished 0 firstRead 0
2025-09-30T14:51:01.933630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.933632Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 207 endOffset 218
2025-09-30T14:51:01.933639Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 418  requestId: <none> cookie: 208
2025-09-30T14:51:01.933648Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.933654Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.933662Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 419  requestId: <none> cookie: 209
2025-09-30T14:51:01.933667Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 420  requestId: <none> cookie: 210
2025-09-30T14:51:01.933673Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 421  requestId: <none> cookie: 211
2025-09-30T14:51:01.933677Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 426  requestId: <none> cookie: 212
>>> event from dataHandler: 2025-09-30T14:51:01.933682Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 427  requestId: <none> cookie: 213
2025-09-30T14:51:01.933687Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 428  requestId: <none> cookie: 214
2025-09-30T14:51:01.933693Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 429  requestId: <none> cookie: 215
2025-09-30T14:51:01.933698Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 433  requestId: <none> cookie: 216
2025-09-30T14:51:01.933702Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 434  requestId: <none> cookie: 217
2025-09-30T14:51:01.933706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 435  requestId: <none> cookie: 218
2025-09-30T14:51:01.933712Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.933714Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.966391Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (271-271)
2025-09-30T14:51:01.933726Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.933738Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 218 partNo 0 count 3 size 72654
2025-09-30T14:51:01.966398Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (272-272)
2025-09-30T14:51:01.933746Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.933748Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.933749Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 207, endOffset# 218, WTime# 1759243861929, sizeLag# 257672
2025-09-30T14:51:01.933751Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.933752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.933754Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.933762Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# e0194dd4-cf9dfbcd-6428f1bc-3bf5617e, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 13, size# 309206, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.933777Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933787Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933789Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 444  requestId: <none> cookie: 223
2025-09-30T14:51:01.933792Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.933793Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 445  requestId: <none> cookie: 224
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..27951 bytes.. Information: { Offset: 254 ProducerId: "src_id" SeqNo: 255 CreateTime: 2025-09-30T14:51:01.948000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28061 bytes.. Information: { Offset: 255 ProducerId: "src_id" SeqNo: 256 CreateTime: 2025-09-30T14:51:01.948000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28171 bytes.. Information: { Offset: 256 ProducerId: "src_id" SeqNo: 257 CreateTime: 2025-09-30T14:51:01.951000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28281 bytes.. Information: { Offset: 257 ProducerId: "src_id" SeqNo: 258 CreateTime: 2025-09-30T14:51:01.951000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28391 bytes.. Information: { Offset: 258 ProducerId: "src_id" SeqNo: 259 CreateTime: 2025-09-30T14:51:01.952000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28501 bytes.. Information: { Offset: 259 ProducerId: "src_id" SeqNo: 260 CreateTime: 2025-09-30T14:51:01.952000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28611 bytes.. Information: { Offset: 260 ProducerId: "src_id" SeqNo: 261 CreateTime: 2025-09-30T14:51:01.952000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28721 bytes.. Information: { Offset: 261 ProducerId: "src_id" SeqNo: 262 CreateTime: 2025-09-30T14:51:01.952000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28831 bytes.. Information: { Offset: 262 ProducerId: "src_id" SeqNo: 263 CreateTime: 2025-09-30T14:51:01.952000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..28941 bytes.. Information: { Offset: 263 ProducerId: "src_id" SeqNo: 264 CreateTime: 2025-09-30T14:51:01.952000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29051 bytes.. Information: { Offset: 264 ProducerId: "src_id" SeqNo: 265 CreateTime: 2025-09-30T14:51:01.952000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29161 bytes.. Information: { Offset: 265 ProducerId: "src_id" SeqNo: 266 CreateTime: 2025-09-30T14:51:01.952000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29271 bytes.. Information: { Offset: 266 ProducerId: "src_id" SeqNo: 267 CreateTime: 2025-09-30T14:51:01.952000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29381 bytes.. Information: { Offset: 267 ProducerId: "src_id" SeqNo: 268 CreateTime: 2025-09-30T14:51:01.952000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29491 bytes.. Information: { Offset: 268 ProducerId: "src_id" SeqNo: 269 CreateTime: 2025-09-30T14:51:01.952000Z WriteTime: 2025-09-30T14:51:01.955000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }2025-09-30T14:51:01.966445Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write 1 messages with Id from 300 to 300
2025-09-30T14:51:01.933796Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.966454Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: try to update token
2025-09-30T14:51:01.933800Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.966457Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Send 1 message(s) (0 left), first sequence number is 300
2025-09-30T14:51:01.933804Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933814Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 446  requestId: <none> cookie: 225
2025-09-30T14:51:01.933815Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933817Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 447  requestId: <none> cookie: 226
2025-09-30T14:51:01.933819Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933823Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933827Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933830Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 13 maxSize 309206 maxTimeLagMs 0 readTimestampMs 0 readOffset 207 EndOffset 218 ClientCommitOffset 0 committedOffset 0 Guid e0194dd4-cf9dfbcd-6428f1bc-3bf5617e
2025-09-30T14:51:01.933830Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933835Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933842Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933858Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.933860Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.966503Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (273-273)
2025-09-30T14:51:01.933878Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 22 Topic 'rt3.dc1--test-topic' partition 0 user user offset 207 count 13 size 309206 endOffset 218 max time lag 0ms effective offset 207
2025-09-30T14:51:01.933890Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 22 added 1 blobs, size 257672 count 11 last offset 207, current partition end offset: 218
2025-09-30T14:51:01.966511Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (274-274)
2025-09-30T14:51:01.933893Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933894Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 22. Send blob request.
2025-09-30T14:51:01.966520Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (275-275)
2025-09-30T14:51:01.933898Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933901Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.933903Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 207 partno 0 count 11 parts_count 0 source 1 size 257672 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.966539Z :DEBUG: [/Root] Take Data. Partition 0. Read: {1, 0} (276-276)
2025-09-30T14:51:01.933907Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 22. All 1 blobs are from cache.
2025-09-30T14:51:01.966541Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 15, size 430815 bytes
2025-09-30T14:51:01.933914Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 207 partno 0 count 11 parts 0 suffix '63'
2025-09-30T14:51:01.966553Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.933915Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.933991Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.934035Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 207 totakecount 11 count 11 size 257649 from pos 0 cbcount 11
2025-09-30T14:51:01.934076Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.934088Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.934092Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.934102Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 223 partNo : 0 messageNo: 448 size 24505 offset: -1
2025-09-30T14:51:01.934106Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.934108Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.934110Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.934114Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 224 partNo : 0 messageNo: 449 size 24615 offset: -1
2025-09-30T14:51:01.934118Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.934121Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.934124Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 225 partNo : 0 messageNo: 450 size 24725 offset: -1
2025-09-30T14:51:01.934128Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.934130Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.934134Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 226 partNo : 0 messageNo: 451 size 24835 offset: -1
2025-09-30T14:51:01.934147Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 207
2025-09-30T14:51:01.934160Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.934168Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.934170Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
>>> event from dataHandler: 2025-09-30T14:51:01.967050Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 92026, now ReadSizeBudget = 0, ReadSizeServerDelta = 432262
2025-09-30T14:51:01.969812Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 14 offsets: 13 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.934173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.934176Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.934178Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.971203Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 14
2025-09-30T14:51:01.934183Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.971213Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 432262
2025-09-30T14:51:01.934186Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.934189Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.934191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.934193Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.934196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.934226Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 452  requestId: <none> cookie: 227
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..29601 bytes.. Information: { Offset: 269 ProducerId: "src_id" SeqNo: 270 CreateTime: 2025-09-30T14:51:01.952000Z WriteTime: 2025-09-30T14:51:01.959000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29711 bytes.. Information: { Offset: 270 ProducerId: "src_id" SeqNo: 271 CreateTime: 2025-09-30T14:51:01.957000Z WriteTime: 2025-09-30T14:51:01.959000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29821 bytes.. Information: { Offset: 271 ProducerId: "src_id" SeqNo: 272 CreateTime: 2025-09-30T14:51:01.957000Z WriteTime: 2025-09-30T14:51:01.959000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..29931 bytes.. Information: { Offset: 272 ProducerId: "src_id" SeqNo: 273 CreateTime: 2025-09-30T14:51:01.957000Z WriteTime: 2025-09-30T14:51:01.959000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30041 bytes.. Information: { Offset: 273 ProducerId: "src_id" SeqNo: 274 CreateTime: 2025-09-30T14:51:01.957000Z WriteTime: 2025-09-30T14:51:01.959000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30151 bytes.. Information: { Offset: 274 ProducerId: "src_id" SeqNo: 275 CreateTime: 2025-09-30T14:51:01.957000Z WriteTime: 2025-09-30T14:51:01.959000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30261 bytes.. Information: { Offset: 275 ProducerId: "src_id" SeqNo: 276 CreateTime: 2025-09-30T14:51:01.957000Z WriteTime: 2025-09-30T14:51:01.959000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30371 bytes.. Information: { Offset: 276 ProducerId: "src_id" SeqNo: 277 CreateTime: 2025-09-30T14:51:01.958000Z WriteTime: 2025-09-30T14:51:01.961000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.934230Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 453  requestId: <none> cookie: 228
2025-09-30T14:51:01.934327Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 218 Result { Offset: 207 Data: "... 22855 bytes ..." SourceId: "\000src_id" SeqNo: 208 WriteTimestampMS: 1759243861930 CreateTimestampMS: 1759243861929 UncompressedSize: 22781 PartitionKey: "" ExplicitHash: "" } Result { Offset: 208 Data: "... 22965 bytes ..." SourceId: "\000src_id" SeqNo: 209 WriteTimestampMS: 1759243861930 CreateTimestampMS: 1759243861929 UncompressedSize: 22891 PartitionKey: "" ExplicitHash: "" } Result { Offset: 209 Data: "... 23075 bytes ..." SourceId: "\000src_id" SeqNo: 210 WriteTimestampMS: 1759243861930 CreateTimestampMS: 1759243861929 UncompressedSize: 23001 PartitionKey: "" ExplicitHash: "" } Result { Offset: 210 Data: "... 23185 bytes ..." SourceId: "\000src_id" SeqNo: 211 WriteTimestampMS: 1759243861930 CreateTimestampMS: 1759243861929 UncompressedSize: 23111 PartitionKey: "" ExplicitHash: "" } Result { Offset: 211 Data: "... 23295 bytes ..." SourceId: "\000src_id" SeqNo: 212 WriteTimestampMS: 1759243861930 CreateTimestampMS: 1759243861929 UncompressedSize: 23221 PartitionKey: "" ExplicitHash: "" } Result { Offset: 212 Data: "... 23405 bytes ..." SourceId: "\000src_id" SeqNo: 213 WriteTimestampMS: 1759243861930 CreateTimestampMS: 1759243861929 UncompressedSize: 23331 PartitionKey: "" ExplicitHash: "" } Result { Offset: 213 Data: "... 23515 bytes ..." SourceId: "\000src_id" SeqNo: 214 WriteTimestampMS: 1759243861930 CreateTimestampMS: 1759243861929 UncompressedSize: 23441 PartitionKey: "" ExplicitHash: "" } Result { Offset: 214 Data: "... 23625 bytes ..." SourceId: "\000src_id" SeqNo: 215 WriteTimestampMS: 1759243861930 CreateTimestampMS: 1759243861929 UncompressedSize: 23551 PartitionKey: "" ExplicitHash: "" } Result { Offset: 215 Data: "... 23735 bytes ..." SourceId: "\000src_id" SeqNo: 216 WriteTimestampMS: 1759243861931 CreateTimestampMS: 1759243861929 UncompressedSize: 23661 PartitionKey: "" ExplicitHash: "" } Result { Offset: 216 Data: "... 23845 bytes ..." SourceId: "\000src_id" SeqNo: 217 WriteTimestampMS: 1759243861931 CreateTimestampMS: 1759243861929 UncompressedSize: 23771 PartitionKey: "" ExplicitHash: "" } Result { Offset: 217 Data: "... 23955 bytes ..." SourceId: "\000src_id" SeqNo: 218 WriteTimestampMS: 1759243861931 CreateTimestampMS: 1759243861929 UncompressedSize: 23881 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551371 RealReadOffset: 217 WaitQuotaTimeMs: 0 EndOffset: 218 StartOffset: 0 } Cookie: 207 }
2025-09-30T14:51:01.934348Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.934354Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.934383Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.934387Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.934394Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 227 partNo : 0 messageNo: 454 size 24945 offset: -1
2025-09-30T14:51:01.971321Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 15 offsets: 14 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.971321Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (277-279)
2025-09-30T14:51:01.971328Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 15
2025-09-30T14:51:01.934397Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.971343Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 92026 to budget
2025-09-30T14:51:01.971350Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 92026, ReadSizeServerDelta = 432262
2025-09-30T14:51:01.971341Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 8, size 239888 bytes
2025-09-30T14:51:01.971356Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 16 offsets: 15 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.971360Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 16
2025-09-30T14:51:01.934399Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.934403Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 228 partNo : 0 messageNo: 455 size 25055 offset: -1
2025-09-30T14:51:01.934406Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.934410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.934412Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.971383Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 17 offsets: 16 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.971390Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 17
2025-09-30T14:51:01.934416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.934422Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 18 from offset 218
2025-09-30T14:51:01.934429Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 218 ReadOffset 218 ReadGuid e0194dd4-cf9dfbcd-6428f1bc-3bf5617e has messages 1
2025-09-30T14:51:01.934445Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# e0194dd4-cf9dfbcd-6428f1bc-3bf5617e, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 257333
2025-09-30T14:51:01.934452Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# e0194dd4-cf9dfbcd-6428f1bc-3bf5617e
2025-09-30T14:51:01.934669Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.934794Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 218 count 3 size 72654 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.934806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.934817Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 72546 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.934818Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 218 partno 0 count 3 parts 0 suffix '63' size 72654
2025-09-30T14:51:01.971436Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:01.934824Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.934830Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 219, partNo: 0, Offset: 218 is stored on disk
2025-09-30T14:51:01.934832Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.934834Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 220, partNo: 0, Offset: 219 is stored on disk
2025-09-30T14:51:01.971451Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.934836Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.934838Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 221, partNo: 0, Offset: 220 is stored on disk
2025-09-30T14:51:01.971460Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (277-277)
2025-09-30T14:51:01.934859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.971487Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (278-278)
2025-09-30T14:51:01.971490Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 18 offsets: 17 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.971493Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 18
2025-09-30T14:51:01.934866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.971501Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 218400, now ReadSizeBudget = 0, ReadSizeServerDelta = 305888
2025-09-30T14:51:01.934868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (7)
2025-09-30T14:51:01.971517Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 19 offsets: 18 already_written: false write_statistics { persist_duration_ms: 1 }
2025-09-30T14:51:01.934874Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 218 EndOffset 218 newEndOffset 221 commitOffset 0 clientCommitOffset 0 cookie 18 readingFinished 0 firstRead 0
2025-09-30T14:51:01.934879Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 218 endOffset 221
2025-09-30T14:51:01.934881Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 222 partNo 0
2025-09-30T14:51:01.971521Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 19
2025-09-30T14:51:01.934888Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 218, endOffset# 221, WTime# 1759243861931, sizeLag# 72654
2025-09-30T14:51:01.934890Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.971503Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (279-279)
2025-09-30T14:51:01.934900Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 222 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 24469 count 1 nextOffset 222 batches 1
2025-09-30T14:51:01.971556Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 20 offsets: 19 already_written: false write_statistics { persist_duration_ms: 1 }
2025-09-30T14:51:01.934900Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 20055f0d-15ac77f4-b222e3e2-7c4b56e4, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 87184, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.971559Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 20
2025-09-30T14:51:01.934904Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 223 partNo 0
2025-09-30T14:51:01.934911Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 87184 maxTimeLagMs 0 readTimestampMs 0 readOffset 218 EndOffset 221 ClientCommitOffset 0 committedOffset 0 Guid 20055f0d-15ac77f4-b222e3e2-7c4b56e4
2025-09-30T14:51:01.934915Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 223 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 49016 count 2 nextOffset 223 batches 1
2025-09-30T14:51:01.934917Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 224 partNo 0
2025-09-30T14:51:01.934922Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 224 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 73673 count 3 nextOffset 224 batches 1
2025-09-30T14:51:01.971580Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 21 offsets: 20 already_written: false write_statistics { persist_duration_ms: 1 }
2025-09-30T14:51:01.971582Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 305888
2025-09-30T14:51:01.971583Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 21
2025-09-30T14:51:01.934925Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 225 partNo 0
2025-09-30T14:51:01.934929Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 225 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 98440 count 4 nextOffset 225 batches 1
2025-09-30T14:51:01.934933Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 226 partNo 0
2025-09-30T14:51:01.971603Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 22 offsets: 21 already_written: false write_statistics { persist_duration_ms: 1 }
2025-09-30T14:51:01.934936Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 226 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 123317 count 5 nextOffset 226 batches 1
2025-09-30T14:51:01.971606Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 22
2025-09-30T14:51:01.934939Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 227 partNo 0
2025-09-30T14:51:01.934943Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 227 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 148304 count 6 nextOffset 227 batches 1
>>> event from dataHandler: 2025-09-30T14:51:01.934946Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 228 partNo 0
2025-09-30T14:51:01.934949Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 228 partNo 0 FormedBlobsCount 0 NewHead: Offset 221 PartNo 0 PackedSize 173401 count 7 nextOffset 228 batches 1
2025-09-30T14:51:01.934952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.935029Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 221,7 HeadOffset 221 endOffset 221 curOffset 228 d0000000000_00000000000000000221_00000_0000000007_00000? size 173248 WTime 1759243861934
2025-09-30T14:51:01.971627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 23 offsets: 22 already_written: false write_statistics { persist_duration_ms: 1 }
2025-09-30T14:51:01.935084Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.971633Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 23
2025-09-30T14:51:01.935086Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..30481 bytes.. Information: { Offset: 277 ProducerId: "src_id" SeqNo: 278 CreateTime: 2025-09-30T14:51:01.958000Z WriteTime: 2025-09-30T14:51:01.961000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30591 bytes.. Information: { Offset: 278 ProducerId: "src_id" SeqNo: 279 CreateTime: 2025-09-30T14:51:01.958000Z WriteTime: 2025-09-30T14:51:01.961000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30701 bytes.. Information: { Offset: 279 ProducerId: "src_id" SeqNo: 280 CreateTime: 2025-09-30T14:51:01.958000Z WriteTime: 2025-09-30T14:51:01.961000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }
2025-09-30T14:51:01.971643Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (280-286)
2025-09-30T14:51:01.971652Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 24 offsets: 23 already_written: false write_statistics { persist_duration_ms: 1 }
2025-09-30T14:51:01.971655Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 24
2025-09-30T14:51:01.935089Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.935091Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.971663Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 218400 to budget
2025-09-30T14:51:01.935093Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.935095Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.971674Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 3, size 91773 bytes
2025-09-30T14:51:01.935096Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.935099Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.971670Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 218400, ReadSizeServerDelta = 305888
2025-09-30T14:51:01.935100Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.935100Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.935101Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.935102Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.935104Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.935105Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.935106Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.935107Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.935108Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.935109Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.935112Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.935113Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.935114Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.935115Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.935116Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000218_00000_0000000003_00000?
2025-09-30T14:51:01.971752Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 25 offsets: 24 already_written: false write_statistics { persist_duration_ms: 1 }
2025-09-30T14:51:01.971772Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:01.935118Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 23 keys were taken away. Let's read 2696742 bytes (2696742)
2025-09-30T14:51:01.971779Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 159338, now ReadSizeBudget = 0, ReadSizeServerDelta = 364950
2025-09-30T14:51:01.935120Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 23, size 2696742 (8388608)
2025-09-30T14:51:01.971778Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 25
2025-09-30T14:51:01.935128Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 437  requestId: <none> cookie: 219
2025-09-30T14:51:01.935143Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 439  requestId: <none> cookie: 220
2025-09-30T14:51:01.971791Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (280-280)
2025-09-30T14:51:01.935148Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 441  requestId: <none> cookie: 221
2025-09-30T14:51:01.935156Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.935158Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.935160Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.971806Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (281-281)
2025-09-30T14:51:01.935165Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.935170Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.935172Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 221 partNo 0 count 7 size 173248
2025-09-30T14:51:01.935174Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.935216Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 23 Topic 'rt3.dc1--test-topic' partition 0 user user offset 218 count 3 size 87184 endOffset 221 max time lag 0ms effective offset 218
2025-09-30T14:51:01.935224Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 23 added 1 blobs, size 72654 count 3 last offset 218, current partition end offset: 221
2025-09-30T14:51:01.935226Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 23. Send blob request.
2025-09-30T14:51:01.935232Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 218 partno 0 count 3 parts_count 0 source 1 size 72654 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.971836Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (282-282)
2025-09-30T14:51:01.935238Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 23. All 1 blobs are from cache.
2025-09-30T14:51:01.971849Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 26 offsets: 25 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 2 }
2025-09-30T14:51:01.971853Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 26
2025-09-30T14:51:01.971846Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (283-283)
2025-09-30T14:51:01.935260Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.935261Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 218 partno 0 count 3 parts 0 suffix '63'
2025-09-30T14:51:01.935310Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 218 totakecount 3 count 3 size 72631 from pos 0 cbcount 3
2025-09-30T14:51:01.971884Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 27 offsets: 26 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 2 }
2025-09-30T14:51:01.971891Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 27
2025-09-30T14:51:01.971892Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (284-284)
2025-09-30T14:51:01.935323Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 218
2025-09-30T14:51:01.971903Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (285-285)
2025-09-30T14:51:01.935384Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 221 Result { Offset: 218 Data: "... 24065 bytes ..." SourceId: "\000src_id" SeqNo: 219 WriteTimestampMS: 1759243861932 CreateTimestampMS: 1759243861930 UncompressedSize: 23991 PartitionKey: "" ExplicitHash: "" } Result { Offset: 219 Data: "... 24175 bytes ..." SourceId: "\000src_id" SeqNo: 220 WriteTimestampMS: 1759243861933 CreateTimestampMS: 1759243861932 UncompressedSize: 24101 PartitionKey: "" ExplicitHash: "" } Result { Offset: 220 Data: "... 24285 bytes ..." SourceId: "\000src_id" SeqNo: 221 WriteTimestampMS: 1759243861933 CreateTimestampMS: 1759243861932 UncompressedSize: 24211 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 3 RealReadOffset: 220 WaitQuotaTimeMs: 0 EndOffset: 221 StartOffset: 0 } Cookie: 218 }
2025-09-30T14:51:01.971910Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (286-286)
2025-09-30T14:51:01.935418Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 19 from offset 221
2025-09-30T14:51:01.971913Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 28 offsets: 27 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 2 }
2025-09-30T14:51:01.971916Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 28
2025-09-30T14:51:01.935424Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 221 ReadOffset 221 ReadGuid 20055f0d-15ac77f4-b222e3e2-7c4b56e4 has messages 1
2025-09-30T14:51:01.935453Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 20055f0d-15ac77f4-b222e3e2-7c4b56e4, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 72675
2025-09-30T14:51:01.935460Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 20055f0d-15ac77f4-b222e3e2-7c4b56e4
2025-09-30T14:51:01.971929Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 364950
2025-09-30T14:51:01.935544Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.936508Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 221 count 7 size 173248 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.971947Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 364950
2025-09-30T14:51:01.936524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.936536Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 173124 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.971952Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 29 offsets: 28 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.936538Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 221 partno 0 count 7 parts 0 suffix '63' size 173248
2025-09-30T14:51:01.971962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 29
2025-09-30T14:51:01.971953Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.936543Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.971977Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 364950
2025-09-30T14:51:01.936553Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 222, partNo: 0, Offset: 221 is stored on disk
2025-09-30T14:51:01.936558Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.971986Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 30 offsets: 29 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.971988Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (287-291)
2025-09-30T14:51:01.971993Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 30
2025-09-30T14:51:01.936562Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 223, partNo: 0, Offset: 222 is stored on disk
2025-09-30T14:51:01.971997Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 159338 to budget
2025-09-30T14:51:01.936565Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.972006Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 159338, ReadSizeServerDelta = 364950
2025-09-30T14:51:01.936569Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 224, partNo: 0, Offset: 223 is stored on disk
2025-09-30T14:51:01.936571Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.972016Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 31 offsets: 30 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.972022Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 31
2025-09-30T14:51:01.936575Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 225, partNo: 0, Offset: 224 is stored on disk
2025-09-30T14:51:01.936577Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.936580Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 226, partNo: 0, Offset: 225 is stored on disk
2025-09-30T14:51:01.936582Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.972037Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:01.936586Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 227, partNo: 0, Offset: 226 is stored on disk
2025-09-30T14:51:01.936589Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.936594Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 228, partNo: 0, Offset: 227 is stored on disk
2025-09-30T14:51:01.936625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.972050Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (287-287)
2025-09-30T14:51:01.936627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.936629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> event from dataHandler: 2025-09-30T14:51:01.936637Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.972065Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (288-288)
2025-09-30T14:51:01.936639Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.936641Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 221 EndOffset 221 newEndOffset 228 commitOffset 0 clientCommitOffset 0 cookie 19 readingFinished 0 firstRead 0
2025-09-30T14:51:01.936643Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.972083Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (289-289)
2025-09-30T14:51:01.936645Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.936645Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 221 endOffset 228
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..30811 bytes.. Information: { Offset: 280 ProducerId: "src_id" SeqNo: 281 CreateTime: 2025-09-30T14:51:01.958000Z WriteTime: 2025-09-30T14:51:01.963000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..30921 bytes.. Information: { Offset: 281 ProducerId: "src_id" SeqNo: 282 CreateTime: 2025-09-30T14:51:01.962000Z WriteTime: 2025-09-30T14:51:01.963000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31031 bytes.. Information: { Offset: 282 ProducerId: "src_id" SeqNo: 283 CreateTime: 2025-09-30T14:51:01.962000Z WriteTime: 2025-09-30T14:51:01.963000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31141 bytes.. Information: { Offset: 283 ProducerId: "src_id" SeqNo: 284 CreateTime: 2025-09-30T14:51:01.962000Z WriteTime: 2025-09-30T14:51:01.963000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31251 bytes.. Information: { Offset: 284 ProducerId: "src_id" SeqNo: 285 CreateTime: 2025-09-30T14:51:01.962000Z WriteTime: 2025-09-30T14:51:01.963000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31361 bytes.. Information: { Offset: 285 ProducerId: "src_id" SeqNo: 286 CreateTime: 2025-09-30T14:51:01.962000Z WriteTime: 2025-09-30T14:51:01.963000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31471 bytes.. Information: { Offset: 286 ProducerId: "src_id" SeqNo: 287 CreateTime: 2025-09-30T14:51:01.962000Z WriteTime: 2025-09-30T14:51:01.963000Z MessageGroupId: "src_id" Meta: { "logtype": "unknown", "_ip": "ipv6:[::1]:48840", "server": "ipv6:[::1]:48840", "ident": "unknown" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }2025-09-30T14:51:01.972093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 32 offsets: 31 already_written: false write_statistics { persist_duration_ms: 1 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.972097Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 32
2025-09-30T14:51:01.972089Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (290-290)
2025-09-30T14:51:01.936647Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.936648Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.936650Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.936652Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.936654Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 221, endOffset# 228, WTime# 1759243861933, sizeLag# 173248
2025-09-30T14:51:01.972128Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (291-291)
2025-09-30T14:51:01.936655Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.936657Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.972132Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 33 offsets: 32 already_written: false write_statistics { persist_duration_ms: 2 }
2025-09-30T14:51:01.936658Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.972145Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 33
2025-09-30T14:51:01.936660Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.936662Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.936665Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.936667Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 6f4dacb8-57a47528-e9c7ee3b-37761eaa, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 171436, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.972155Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Got ReadResponse, serverBytesSize = 260581, now ReadSizeBudget = 0, ReadSizeServerDelta = 263707
2025-09-30T14:51:01.972167Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 34 offsets: 33 already_written: false write_statistics { persist_duration_ms: 2 }
2025-09-30T14:51:01.972171Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 34
2025-09-30T14:51:01.936667Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.936669Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.972185Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 7, size 217987 bytes
2025-09-30T14:51:01.936671Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.936673Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.972186Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 263707
2025-09-30T14:51:01.972195Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 35 offsets: 34 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-09-30T14:51:01.974461Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 263707
2025-09-30T14:51:01.936675Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.974473Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.936678Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.974476Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 0, ReadSizeServerDelta = 263707
2025-09-30T14:51:01.974475Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 35
2025-09-30T14:51:01.936680Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.936682Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.936683Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.936685Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 171436 maxTimeLagMs 0 readTimestampMs 0 readOffset 221 EndOffset 228 ClientCommitOffset 0 committedOffset 0 Guid 6f4dacb8-57a47528-e9c7ee3b-37761eaa
2025-09-30T14:51:01.936685Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000218_00000_0000000003_00000?
2025-09-30T14:51:01.936687Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000221_00000_0000000007_00000?
2025-09-30T14:51:01.974503Z :DEBUG: [/Root] Decompression task done. Partition/PartitionSessionId: 1 (292-299)
2025-09-30T14:51:01.936689Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 24 keys were taken away. Let's read 2869990 bytes (2869990)
2025-09-30T14:51:01.936692Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 24, size 2869990 (8388608)
2025-09-30T14:51:01.974521Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 260581 to budget
2025-09-30T14:51:01.936704Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 443  requestId: <none> cookie: 222
2025-09-30T14:51:01.974527Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] In ContinueReadingDataImpl, ReadSizeBudget = 260581, ReadSizeServerDelta = 263707
2025-09-30T14:51:01.936712Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 448  requestId: <none> cookie: 223
2025-09-30T14:51:01.936714Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.936717Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 449  requestId: <none> cookie: 224
2025-09-30T14:51:01.936720Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.936722Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 450  requestId: <none> cookie: 225
2025-09-30T14:51:01.936726Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 451  requestId: <none> cookie: 226
2025-09-30T14:51:01.936727Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.936730Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 454  requestId: <none> cookie: 227
2025-09-30T14:51:01.936735Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 455  requestId: <none> cookie: 228
2025-09-30T14:51:01.936735Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.936744Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.936748Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.936767Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 24 Topic 'rt3.dc1--test-topic' partition 0 user user offset 221 count 8 size 171436 endOffset 228 max time lag 0ms effective offset 221
2025-09-30T14:51:01.936781Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 24 added 1 blobs, size 173248 count 7 last offset 221, current partition end offset: 228
2025-09-30T14:51:01.936784Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 24. Send blob request.
2025-09-30T14:51:01.974582Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 36 offsets: 35 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-09-30T14:51:01.974623Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] After sending read request: ReadSizeBudget = 0, ReadSizeServerDelta = 524288
2025-09-30T14:51:01.974625Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 36
2025-09-30T14:51:01.936792Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 221 partno 0 count 7 parts_count 0 source 1 size 173248 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
>>> event from dataHandler: 2025-09-30T14:51:01.936803Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 24. All 1 blobs are from cache.
2025-09-30T14:51:01.936812Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.974647Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 0} (292-292)
2025-09-30T14:51:01.936813Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 221 partno 0 count 7 parts 0 suffix '63'
2025-09-30T14:51:01.936838Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.936883Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 221 totakecount 7 count 7 size 173225 from pos 0 cbcount 7
2025-09-30T14:51:01.936884Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.936888Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.974697Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 37 offsets: 36 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-09-30T14:51:01.974693Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 1} (293-293)
2025-09-30T14:51:01.974705Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 37
2025-09-30T14:51:01.936910Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 221
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..31581 bytes.. Information: { Offset: 287 ProducerId: "src_id" SeqNo: 288 CreateTime: 2025-09-30T14:51:01.962000Z WriteTime: 2025-09-30T14:51:01.965000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31691 bytes.. Information: { Offset: 288 ProducerId: "src_id" SeqNo: 289 CreateTime: 2025-09-30T14:51:01.962000Z WriteTime: 2025-09-30T14:51:01.965000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31801 bytes.. Information: { Offset: 289 ProducerId: "src_id" SeqNo: 290 CreateTime: 2025-09-30T14:51:01.963000Z WriteTime: 2025-09-30T14:51:01.965000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..31911 bytes.. Information: { Offset: 290 ProducerId: "src_id" SeqNo: 291 CreateTime: 2025-09-30T14:51:01.963000Z WriteTime: 2025-09-30T14:51:01.965000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32021 bytes.. Information: { Offset: 291 ProducerId: "src_id" SeqNo: 292 CreateTime: 2025-09-30T14:51:01.963000Z WriteTime: 2025-09-30T14:51:01.965000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "_ip": "ipv6:[::1]:48840", "logtype": "unknown", "server": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }2025-09-30T14:51:01.974717Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 2} (294-294)
2025-09-30T14:51:01.937014Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 228 Result { Offset: 221 Data: "... 24395 bytes ..." SourceId: "\000src_id" SeqNo: 222 WriteTimestampMS: 1759243861934 CreateTimestampMS: 1759243861932 UncompressedSize: 24321 PartitionKey: "" ExplicitHash: "" } Result { Offset: 222 Data: "... 24505 bytes ..." SourceId: "\000src_id" SeqNo: 223 WriteTimestampMS: 1759243861934 CreateTimestampMS: 1759243861932 UncompressedSize: 24431 PartitionKey: "" ExplicitHash: "" } Result { Offset: 223 Data: "... 24615 bytes ..." SourceId: "\000src_id" SeqNo: 224 WriteTimestampMS: 1759243861934 CreateTimestampMS: 1759243861933 UncompressedSize: 24541 PartitionKey: "" ExplicitHash: "" } Result { Offset: 224 Data: "... 24725 bytes ..." SourceId: "\000src_id" SeqNo: 225 WriteTimestampMS: 1759243861934 CreateTimestampMS: 1759243861933 UncompressedSize: 24651 PartitionKey: "" ExplicitHash: "" } Result { Offset: 225 Data: "... 24835 bytes ..." SourceId: "\000src_id" SeqNo: 226 WriteTimestampMS: 1759243861934 CreateTimestampMS: 1759243861933 UncompressedSize: 24761 PartitionKey: "" ExplicitHash: "" } Result { Offset: 226 Data: "... 24945 bytes ..." SourceId: "\000src_id" SeqNo: 227 WriteTimestampMS: 1759243861934 CreateTimestampMS: 1759243861933 UncompressedSize: 24871 PartitionKey: "" ExplicitHash: "" } Result { Offset: 227 Data: "... 25055 bytes ..." SourceId: "\000src_id" SeqNo: 228 WriteTimestampMS: 1759243861934 CreateTimestampMS: 1759243861933 UncompressedSize: 24981 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551495 RealReadOffset: 227 WaitQuotaTimeMs: 0 EndOffset: 228 StartOffset: 0 } Cookie: 221 }
2025-09-30T14:51:01.974734Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 38 offsets: 37 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 2 }
2025-09-30T14:51:01.974724Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 3} (295-295)
2025-09-30T14:51:01.974741Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 38
2025-09-30T14:51:01.937076Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 20 from offset 228
2025-09-30T14:51:01.937082Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 228 ReadOffset 228 ReadGuid 6f4dacb8-57a47528-e9c7ee3b-37761eaa has messages 1
2025-09-30T14:51:01.937097Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 6f4dacb8-57a47528-e9c7ee3b-37761eaa, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 172970
2025-09-30T14:51:01.937104Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 6f4dacb8-57a47528-e9c7ee3b-37761eaa
2025-09-30T14:51:01.937388Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.937640Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 22844 } }
2025-09-30T14:51:01.974766Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 4} (296-296)
2025-09-30T14:51:01.937693Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 7d85ecdf-193d3047-20fd6529-7f9c27a8
2025-09-30T14:51:01.974763Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 5, size 159005 bytes
2025-09-30T14:51:01.974777Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 39 offsets: 38 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.974774Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 5} (297-297)
2025-09-30T14:51:01.937719Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.974784Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.937845Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.937927Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.974780Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 39
2025-09-30T14:51:01.937948Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.937999Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938005Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938015Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938017Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938032Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 456  requestId: <none> cookie: 229
2025-09-30T14:51:01.938046Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 457  requestId: <none> cookie: 230
2025-09-30T14:51:01.938062Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.974825Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 6} (298-298)
2025-09-30T14:51:01.938065Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 257333 } }
2025-09-30T14:51:01.938074Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.938078Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.938099Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 2fd45720-84896383-cd7ee9aa-8310302b
2025-09-30T14:51:01.938109Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938111Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938129Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 229 partNo : 0 messageNo: 458 size 25165 offset: -1
2025-09-30T14:51:01.938135Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.938148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.938157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.974863Z :DEBUG: [/Root] Take Data. Partition 0. Read: {0, 7} (299-299)
2025-09-30T14:51:01.938159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.938180Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.938202Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 229 partNo 0
2025-09-30T14:51:01.938204Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 72675 } }
2025-09-30T14:51:01.938232Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 229 partNo 0 FormedBlobsCount 0 NewHead: Offset 228 PartNo 0 PackedSize 25239 count 1 nextOffset 229 batches 1
2025-09-30T14:51:01.974888Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 40 offsets: 39 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.974902Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 40
2025-09-30T14:51:01.938238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.938286Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# c526781f-ddca5e5c-92077ed7-99de3790
2025-09-30T14:51:01.938296Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.938327Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.938334Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 228,1 HeadOffset 228 endOffset 228 curOffset 229 d0000000000_00000000000000000228_00000_0000000001_00000? size 25230 WTime 1759243861938
2025-09-30T14:51:01.938359Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.938360Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938363Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938370Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 230 partNo : 0 messageNo: 459 size 25275 offset: -1
2025-09-30T14:51:01.938375Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938378Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938383Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.938394Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.938395Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 228 partNo 0 count 1 size 25230
2025-09-30T14:51:01.938401Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.974958Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 41 offsets: 40 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.938404Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.974962Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 41
2025-09-30T14:51:01.938409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.938451Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.938464Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 460  requestId: <none> cookie: 231
2025-09-30T14:51:01.938470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.938568Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.938631Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.938689Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.974985Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 42 offsets: 41 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.975008Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 42
2025-09-30T14:51:01.938715Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938716Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938720Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938721Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938725Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938728Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938740Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 231 partNo : 0 messageNo: 464 size 25385 offset: -1
2025-09-30T14:51:01.975030Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 43 offsets: 42 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
>>> event from dataHandler: 2025-09-30T14:51:01.938745Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.975045Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 43
2025-09-30T14:51:01.938747Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938759Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.938777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.938784Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 461  requestId: <none> cookie: 232
2025-09-30T14:51:01.938796Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 462  requestId: <none> cookie: 233
2025-09-30T14:51:01.938799Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 463  requestId: <none> cookie: 234
2025-09-30T14:51:01.975067Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 44 offsets: 43 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.938802Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 465  requestId: <none> cookie: 235
2025-09-30T14:51:01.975070Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 44
2025-09-30T14:51:01.938806Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.938813Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.938817Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.938821Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
DataReceived { Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 Message { Data: ..32131 bytes.. Information: { Offset: 292 ProducerId: "src_id" SeqNo: 293 CreateTime: 2025-09-30T14:51:01.963000Z WriteTime: 2025-09-30T14:51:01.967000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32241 bytes.. Information: { Offset: 293 ProducerId: "src_id" SeqNo: 294 CreateTime: 2025-09-30T14:51:01.965000Z WriteTime: 2025-09-30T14:51:01.967000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32351 bytes.. Information: { Offset: 294 ProducerId: "src_id" SeqNo: 295 CreateTime: 2025-09-30T14:51:01.965000Z WriteTime: 2025-09-30T14:51:01.967000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32461 bytes.. Information: { Offset: 295 ProducerId: "src_id" SeqNo: 296 CreateTime: 2025-09-30T14:51:01.966000Z WriteTime: 2025-09-30T14:51:01.967000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32571 bytes.. Information: { Offset: 296 ProducerId: "src_id" SeqNo: 297 CreateTime: 2025-09-30T14:51:01.966000Z WriteTime: 2025-09-30T14:51:01.967000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32681 bytes.. Information: { Offset: 297 ProducerId: "src_id" SeqNo: 298 CreateTime: 2025-09-30T14:51:01.966000Z WriteTime: 2025-09-30T14:51:01.967000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32791 bytes.. Information: { Offset: 298 ProducerId: "src_id" SeqNo: 299 CreateTime: 2025-09-30T14:51:01.966000Z WriteTime: 2025-09-30T14:51:01.967000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } Message { Data: ..32901 bytes.. Information: { Offset: 299 ProducerId: "src_id" SeqNo: 300 CreateTime: 2025-09-30T14:51:01.966000Z WriteTime: 2025-09-30T14:51:01.967000Z MessageGroupId: "src_id" Meta: { "ident": "unknown", "logtype": "unknown", "server": "ipv6:[::1]:48840", "_ip": "ipv6:[::1]:48840" } MessageMeta: { } } Partition session id: 1 Topic: "test-topic" Partition: 0 Database name: dc2 Database path: /Root Database id: account-dc2 } }2025-09-30T14:51:01.975093Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 45 offsets: 44 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.938844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.975100Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 45
2025-09-30T14:51:01.938848Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938860Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 232 partNo : 0 messageNo: 466 size 25495 offset: -1
2025-09-30T14:51:01.938866Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.975120Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 46 offsets: 45 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.938867Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938871Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 233 partNo : 0 messageNo: 467 size 25605 offset: -1
2025-09-30T14:51:01.938874Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.975123Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 46
2025-09-30T14:51:01.938876Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938880Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 234 partNo : 0 messageNo: 468 size 25715 offset: -1
2025-09-30T14:51:01.938884Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.938888Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.938892Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 235 partNo : 0 messageNo: 469 size 25825 offset: -1
2025-09-30T14:51:01.938897Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.975174Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 47 offsets: 46 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.938906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.975177Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 47
2025-09-30T14:51:01.975180Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] The application data is transferred to the client. Number of messages 8, size 260128 bytes
2025-09-30T14:51:01.938908Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.975192Z :DEBUG: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] [] Returning serverBytesSize = 0 to budget
2025-09-30T14:51:01.938911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.975198Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 48 offsets: 47 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.938913Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.975201Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 48
2025-09-30T14:51:01.975198Z :INFO: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] Closing read session. Close timeout: 18446744073709.551615s
2025-09-30T14:51:01.938918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.938920Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.938922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.939650Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 228 count 1 size 25230 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.975223Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-09-30T14:51:01.939664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.939667Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 228 partno 0 count 1 parts 0 suffix '63' size 25230
2025-09-30T14:51:01.939679Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 25172 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.975235Z :INFO: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] Counters: { Errors: 0 CurrentSessionLifetimeMs: 249 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:01.939689Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.939698Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 229, partNo: 0, Offset: 228 is stored on disk
2025-09-30T14:51:01.939736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.975235Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 49 offsets: 48 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.939746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.975263Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 49
2025-09-30T14:51:01.939748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (6)
2025-09-30T14:51:01.939762Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 228 EndOffset 228 newEndOffset 229 commitOffset 0 clientCommitOffset 0 cookie 20 readingFinished 0 firstRead 0
2025-09-30T14:51:01.939764Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 230 partNo 0
2025-09-30T14:51:01.939768Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 228 endOffset 229
2025-09-30T14:51:01.939780Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 228, endOffset# 229, WTime# 1759243861934, sizeLag# 25230
2025-09-30T14:51:01.939783Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.939789Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 230 partNo 0 FormedBlobsCount 0 NewHead: Offset 229 PartNo 0 PackedSize 25349 count 1 nextOffset 230 batches 1
2025-09-30T14:51:01.975292Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 50 offsets: 49 already_written: false write_statistics { persist_duration_ms: 3 queued_in_partition_duration_ms: 1 }
2025-09-30T14:51:01.939796Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 66509e45-5a12e8c7-a0169849-ab0b4395, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 30276, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.975295Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 50
2025-09-30T14:51:01.939806Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 231 partNo 0
2025-09-30T14:51:01.939812Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 231 partNo 0 FormedBlobsCount 0 NewHead: Offset 229 PartNo 0 PackedSize 50776 count 2 nextOffset 231 batches 1
2025-09-30T14:51:01.939813Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 30276 maxTimeLagMs 0 readTimestampMs 0 readOffset 228 EndOffset 229 ClientCommitOffset 0 committedOffset 0 Guid 66509e45-5a12e8c7-a0169849-ab0b4395
2025-09-30T14:51:01.939815Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 232 partNo 0
2025-09-30T14:51:01.939821Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 232 partNo 0 FormedBlobsCount 0 NewHead: Offset 229 PartNo 0 PackedSize 76313 count 3 nextOffset 232 batches 1
2025-09-30T14:51:01.939824Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 233 partNo 0
2025-09-30T14:51:01.939828Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 233 partNo 0 FormedBlobsCount 0 NewHead: Offset 229 PartNo 0 PackedSize 101960 count 4 nextOffset 233 batches 1
2025-09-30T14:51:01.939831Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 234 partNo 0
2025-09-30T14:51:01.939836Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 234 partNo 0 FormedBlobsCount 0 NewHead: Offset 229 PartNo 0 PackedSize 127717 count 5 nextOffset 234 batches 1
2025-09-30T14:51:01.939840Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 235 partNo 0
2025-09-30T14:51:01.939843Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 235 partNo 0 FormedBlobsCount 0 NewHead: Offset 229 PartNo 0 PackedSize 153584 count 6 nextOffset 235 batches 1
2025-09-30T14:51:01.939846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.939950Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 229,6 HeadOffset 229 endOffset 229 curOffset 235 d0000000000_00000000000000000229_00000_0000000006_00000? size 153462 WTime 1759243861939
2025-09-30T14:51:01.940084Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.940087Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.940089Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.940091Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.940093Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.940096Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.940098Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.940100Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.940104Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.940107Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.940110Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.940113Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.940115Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.940117Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.940119Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.940121Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.940123Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.940125Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.940128Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.940131Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.940133Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.940135Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.940137Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000218_00000_0000000003_00000?
2025-09-30T14:51:01.940139Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000221_00000_0000000007_00000?
2025-09-30T14:51:01.940142Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000228_00000_0000000001_00000?
2025-09-30T14:51:01.940145Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 25 keys were taken away. Let's read 2895220 bytes (2895220)
2025-09-30T14:51:01.975427Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 51 offsets: 50 already_written: false write_statistics { persist_duration_ms: 3 }
2025-09-30T14:51:01.975439Z :INFO: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] Closing read session. Close timeout: 18446744073709.551615s
2025-09-30T14:51:01.975442Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 51
2025-09-30T14:51:01.940149Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 25, size 2895220 (8388608)
2025-09-30T14:51:01.975452Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-09-30T14:51:01.940164Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 458  requestId: <none> cookie: 229
2025-09-30T14:51:01.940192Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.940196Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.976220Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760557:2523] disconnected; active server actors: 1
2025-09-30T14:51:01.977445Z :INFO: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 248 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:01.940195Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.976238Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760557:2523] client user disconnected session shared/user_3_2_2210329730288990884_v1
2025-09-30T14:51:01.940206Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.940217Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 229 partNo 0 count 6 size 153462
2025-09-30T14:51:01.976261Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:51:01.940289Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 25 Topic 'rt3.dc1--test-topic' partition 0 user user offset 228 count 1 size 30276 endOffset 229 max time lag 0ms effective offset 228
2025-09-30T14:51:01.976276Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=2, Families=1, UnradableFamilies=0 [], RequireBalancing=0 []
2025-09-30T14:51:01.940305Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 25 added 1 blobs, size 25230 count 1 last offset 228, current partition end offset: 229
2025-09-30T14:51:01.976284Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=2, desiredFamilyCount=0, allowPlusOne=1
2025-09-30T14:51:01.940308Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 25. Send blob request.
2025-09-30T14:51:01.976289Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000009s
2025-09-30T14:51:01.940319Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 228 partno 0 count 1 parts_count 0 source 1 size 25230 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.940330Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 25. All 1 blobs are from cache.
2025-09-30T14:51:01.977494Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 52 offsets: 51 already_written: false write_statistics { persist_duration_ms: 3 }
2025-09-30T14:51:01.940340Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 228 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:51:01.977511Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 52
2025-09-30T14:51:01.940342Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.940360Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 228 totakecount 1 count 1 size 25207 from pos 0 cbcount 1
2025-09-30T14:51:01.940394Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 228
2025-09-30T14:51:01.940489Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 229 Result { Offset: 228 Data: "... 25165 bytes ..." SourceId: "\000src_id" SeqNo: 229 WriteTimestampMS: 1759243861938 CreateTimestampMS: 1759243861933 UncompressedSize: 25091 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 228 WaitQuotaTimeMs: 0 EndOffset: 229 StartOffset: 0 } Cookie: 228 }
2025-09-30T14:51:01.940522Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 21 from offset 229
2025-09-30T14:51:01.940530Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 229 ReadOffset 229 ReadGuid 66509e45-5a12e8c7-a0169849-ab0b4395 has messages 1
2025-09-30T14:51:01.940574Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 66509e45-5a12e8c7-a0169849-ab0b4395, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 25264
2025-09-30T14:51:01.940584Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 66509e45-5a12e8c7-a0169849-ab0b4395
2025-09-30T14:51:01.940671Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.941434Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 229 count 6 size 153462 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.941456Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 229 partno 0 count 6 parts 0 suffix '63' size 153462
2025-09-30T14:51:01.941462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.941476Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 153342 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.941483Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.941493Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 230, partNo: 0, Offset: 229 is stored on disk
2025-09-30T14:51:01.941497Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.941501Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 231, partNo: 0, Offset: 230 is stored on disk
2025-09-30T14:51:01.941503Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.941507Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 232, partNo: 0, Offset: 231 is stored on disk
2025-09-30T14:51:01.941509Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.941514Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 233, partNo: 0, Offset: 232 is stored on disk
2025-09-30T14:51:01.941517Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.941521Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 234, partNo: 0, Offset: 233 is stored on disk
2025-09-30T14:51:01.941524Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.941528Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 235, partNo: 0, Offset: 234 is stored on disk
2025-09-30T14:51:01.941562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.977621Z :INFO: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] Closing read session. Close timeout: 18446744073709.551615s
2025-09-30T14:51:01.941564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.941565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.977627Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 53 offsets: 52 already_written: false write_statistics { persist_duration_ms: 3 }
2025-09-30T14:51:01.941571Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.977632Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 53
2025-09-30T14:51:01.977633Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-09-30T14:51:01.941573Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.941574Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.977640Z :INFO: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] Counters: { Errors: 0 CurrentSessionLifetimeMs: 250 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:01.941576Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.941578Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.941579Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.941581Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.941582Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.941584Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.941585Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.941586Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.977674Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 54 offsets: 53 already_written: false write_statistics { persist_duration_ms: 3 }
2025-09-30T14:51:01.941588Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.977677Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 54
2025-09-30T14:51:01.941590Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.941592Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.941594Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.941597Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.941600Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.941602Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.941604Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.941604Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 229 EndOffset 229 newEndOffset 235 commitOffset 0 clientCommitOffset 0 cookie 21 readingFinished 0 firstRead 0
2025-09-30T14:51:01.941606Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.941608Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.941609Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 229 endOffset 235
2025-09-30T14:51:01.941610Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.941612Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000218_00000_0000000003_00000?
2025-09-30T14:51:01.941614Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000221_00000_0000000007_00000?
2025-09-30T14:51:01.941617Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000228_00000_0000000001_00000?
2025-09-30T14:51:01.941619Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000229_00000_0000000006_00000?
2025-09-30T14:51:01.941620Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 229, endOffset# 235, WTime# 1759243861938, sizeLag# 153462
2025-09-30T14:51:01.941621Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 26 keys were taken away. Let's read 3048682 bytes (3048682)
2025-09-30T14:51:01.941623Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.941624Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 26, size 3048682 (8388608)
2025-09-30T14:51:01.941634Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 459  requestId: <none> cookie: 230
2025-09-30T14:51:01.941640Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# c78cc551-7bd085d8-692d861d-33e99f4b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 7, size# 184154, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.941645Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 464  requestId: <none> cookie: 231
2025-09-30T14:51:01.941649Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 466  requestId: <none> cookie: 232
2025-09-30T14:51:01.977756Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 55 offsets: 54 already_written: false write_statistics { persist_duration_ms: 3 }
2025-09-30T14:51:01.941653Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 467  requestId: <none> cookie: 233
2025-09-30T14:51:01.941658Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.941658Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 468  requestId: <none> cookie: 234
2025-09-30T14:51:01.977770Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: close. Timeout = 0 ms
2025-09-30T14:51:01.941662Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 469  requestId: <none> cookie: 235
2025-09-30T14:51:01.941666Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.977792Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 55
2025-09-30T14:51:01.977802Z :INFO: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session will now close
2025-09-30T14:51:01.941671Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.941674Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 7 maxSize 184154 maxTimeLagMs 0 readTimestampMs 0 readOffset 229 EndOffset 235 ClientCommitOffset 0 committedOffset 0 Guid c78cc551-7bd085d8-692d861d-33e99f4b
2025-09-30T14:51:01.941675Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.977811Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: aborting
2025-09-30T14:51:01.941691Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.941699Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.941706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.941711Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.941733Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 26 Topic 'rt3.dc1--test-topic' partition 0 user user offset 229 count 7 size 184154 endOffset 235 max time lag 0ms effective offset 229
2025-09-30T14:51:01.941747Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 26 added 1 blobs, size 153462 count 6 last offset 229, current partition end offset: 235
2025-09-30T14:51:01.941750Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 26. Send blob request.
2025-09-30T14:51:01.941758Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 229 partno 0 count 6 parts_count 0 source 1 size 153462 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.941766Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 26. All 1 blobs are from cache.
2025-09-30T14:51:01.941774Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 229 partno 0 count 6 parts 0 suffix '63'
2025-09-30T14:51:01.977863Z :WARNING: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: could not confirm all writes in time or session aborted, perform hard shutdown
2025-09-30T14:51:01.941776Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.941844Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 229 totakecount 6 count 6 size 153439 from pos 0 cbcount 6
2025-09-30T14:51:01.941870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 229
2025-09-30T14:51:01.941968Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 235 Result { Offset: 229 Data: "... 25275 bytes ..." SourceId: "\000src_id" SeqNo: 230 WriteTimestampMS: 1759243861939 CreateTimestampMS: 1759243861937 UncompressedSize: 25201 PartitionKey: "" ExplicitHash: "" } Result { Offset: 230 Data: "... 25385 bytes ..." SourceId: "\000src_id" SeqNo: 231 WriteTimestampMS: 1759243861939 CreateTimestampMS: 1759243861937 UncompressedSize: 25311 PartitionKey: "" ExplicitHash: "" } Result { Offset: 231 Data: "... 25495 bytes ..." SourceId: "\000src_id" SeqNo: 232 WriteTimestampMS: 1759243861939 CreateTimestampMS: 1759243861937 UncompressedSize: 25421 PartitionKey: "" ExplicitHash: "" } Result { Offset: 232 Data: "... 25605 bytes ..." SourceId: "\000src_id" SeqNo: 233 WriteTimestampMS: 1759243861939 CreateTimestampMS: 1759243861938 UncompressedSize: 25531 PartitionKey: "" ExplicitHash: "" } Result { Offset: 233 Data: "... 25715 bytes ..." SourceId: "\000src_id" SeqNo: 234 WriteTimestampMS: 1759243861939 CreateTimestampMS: 1759243861938 UncompressedSize: 25641 PartitionKey: "" ExplicitHash: "" } Result { Offset: 234 Data: "... 25825 bytes ..." SourceId: "\000src_id" SeqNo: 235 WriteTimestampMS: 1759243861939 CreateTimestampMS: 1759243861938 UncompressedSize: 25751 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551526 RealReadOffset: 234 WaitQuotaTimeMs: 0 EndOffset: 235 StartOffset: 0 } Cookie: 229 }
2025-09-30T14:51:01.942024Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 22 from offset 235
2025-09-30T14:51:01.942031Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 235 ReadOffset 235 ReadGuid c78cc551-7bd085d8-692d861d-33e99f4b has messages 1
2025-09-30T14:51:01.977882Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session got write response: sequence_numbers: 56 offsets: 55 already_written: false write_statistics { persist_duration_ms: 3 }
2025-09-30T14:51:01.942050Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# c78cc551-7bd085d8-692d861d-33e99f4b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 153229
2025-09-30T14:51:01.977909Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: acknoledged message 56
2025-09-30T14:51:01.942057Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# c78cc551-7bd085d8-692d861d-33e99f4b
2025-09-30T14:51:01.942207Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.942710Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 172970 } }
2025-09-30T14:51:01.942747Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# cd26aee6-c16bde11-de44955f-6dff6b0a
2025-09-30T14:51:01.942771Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 25264 } }
2025-09-30T14:51:01.942811Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 4f83d53-cbce5a0d-a0215c3d-17e42753
2025-09-30T14:51:01.943378Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.943487Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.943517Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.943523Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.943546Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 470  requestId: <none> cookie: 236
2025-09-30T14:51:01.943560Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.943593Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.943600Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.943619Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 236 partNo : 0 messageNo: 471 size 25935 offset: -1
2025-09-30T14:51:01.943630Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.943645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.943653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.943656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.943703Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 236 partNo 0
2025-09-30T14:51:01.943731Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 236 partNo 0 FormedBlobsCount 0 NewHead: Offset 235 PartNo 0 PackedSize 26009 count 1 nextOffset 236 batches 1
2025-09-30T14:51:01.943752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.943862Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 235,1 HeadOffset 235 endOffset 235 curOffset 236 d0000000000_00000000000000000235_00000_0000000001_00000? size 26000 WTime 1759243861943
2025-09-30T14:51:01.943891Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.943903Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 235 partNo 0 count 1 size 26000
2025-09-30T14:51:01.945005Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 235 count 1 size 26000 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.945021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.945031Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 235 partno 0 count 1 parts 0 suffix '63' size 26000
2025-09-30T14:51:01.945036Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 25942 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.945044Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.945054Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 236, partNo: 0, Offset: 235 is stored on disk
2025-09-30T14:51:01.945092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.945105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.945109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.945117Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.945117Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 235 EndOffset 235 newEndOffset 236 commitOffset 0 clientCommitOffset 0 cookie 22 readingFinished 0 firstRead 0
2025-09-30T14:51:01.945119Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.945122Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 235 endOffset 236
2025-09-30T14:51:01.945122Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.945124Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.945128Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.945131Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.945134Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.945135Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 235, endOffset# 236, WTime# 1759243861939, sizeLag# 26000
2025-09-30T14:51:01.945136Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.945137Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.945139Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.945140Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.945143Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.945151Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 90180116-4b7f9618-ae2b3c98-9b85afc9, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 31200, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.945154Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.945157Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.945158Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.945160Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.945161Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.945163Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.945165Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.945166Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 31200 maxTimeLagMs 0 readTimestampMs 0 readOffset 235 EndOffset 236 ClientCommitOffset 0 committedOffset 0 Guid 90180116-4b7f9618-ae2b3c98-9b85afc9
2025-09-30T14:51:01.945168Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.945170Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.945172Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.945174Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.945176Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000218_00000_0000000003_00000?
2025-09-30T14:51:01.945178Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000221_00000_0000000007_00000?
2025-09-30T14:51:01.945180Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000228_00000_0000000001_00000?
2025-09-30T14:51:01.945182Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000229_00000_0000000006_00000?
2025-09-30T14:51:01.978117Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760556:2524] disconnected; active server actors: 1
2025-09-30T14:51:01.945183Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000235_00000_0000000001_00000?
2025-09-30T14:51:01.945186Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 27 keys were taken away. Let's read 3074682 bytes (3074682)
2025-09-30T14:51:01.978127Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760556:2524] client user disconnected session shared/user_3_3_3107435870535710504_v1
2025-09-30T14:51:01.945189Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 27, size 3074682 (8388608)
2025-09-30T14:51:01.945199Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 471  requestId: <none> cookie: 236
2025-09-30T14:51:01.978144Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1184: [72075186224037893][rt3.dc1--test-topic] consumer user rebalancing was scheduled
2025-09-30T14:51:01.978158Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1256: [72075186224037893][rt3.dc1--test-topic] consumer user balancing. Sessions=1, Families=1, UnradableFamilies=1 [1 (0), ], RequireBalancing=0 []
2025-09-30T14:51:01.978171Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1303: [72075186224037893][rt3.dc1--test-topic] consumer user balancing family=1 (Status=Free, Partitions=[0]) for ReadingSession "shared/user_3_1_13398544198722215142_v1" (Sender=[3:7555894849718760544:2521], Pipe=[3:7555894849718760558:2521], Partitions=[], ActiveFamilyCount=0)
2025-09-30T14:51:01.945219Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.978183Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:547: [72075186224037893][rt3.dc1--test-topic] consumer user family 1 status Active partitions [0] session "shared/user_3_1_13398544198722215142_v1" sender [3:7555894849718760544:2521] lock partition 0 for ReadingSession "shared/user_3_1_13398544198722215142_v1" (Sender=[3:7555894849718760544:2521], Pipe=[3:7555894849718760558:2521], Partitions=[], ActiveFamilyCount=1) generation 1 step 2
2025-09-30T14:51:01.978200Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1323: [72075186224037893][rt3.dc1--test-topic] consumer user start rebalancing. familyCount=1, sessionCount=1, desiredFamilyCount=1, allowPlusOne=0
2025-09-30T14:51:01.945220Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.945224Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.978204Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1400: [72075186224037893][rt3.dc1--test-topic] consumer user balancing duration: 0.000043s
2025-09-30T14:51:01.945249Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 27 Topic 'rt3.dc1--test-topic' partition 0 user user offset 235 count 1 size 31200 endOffset 236 max time lag 0ms effective offset 235
2025-09-30T14:51:01.945264Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 27 added 1 blobs, size 26000 count 1 last offset 235, current partition end offset: 236
2025-09-30T14:51:01.945267Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 27. Send blob request.
2025-09-30T14:51:01.945276Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 235 partno 0 count 1 parts_count 0 source 1 size 26000 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.945294Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 27. All 1 blobs are from cache.
2025-09-30T14:51:01.945304Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.945314Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 235 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:51:01.945326Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 235 totakecount 1 count 1 size 25977 from pos 0 cbcount 1
2025-09-30T14:51:01.945344Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 235
2025-09-30T14:51:01.945417Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 236 Result { Offset: 235 Data: "... 25935 bytes ..." SourceId: "\000src_id" SeqNo: 236 WriteTimestampMS: 1759243861943 CreateTimestampMS: 1759243861938 UncompressedSize: 25861 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 235 WaitQuotaTimeMs: 0 EndOffset: 236 StartOffset: 0 } Cookie: 235 }
2025-09-30T14:51:01.945448Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 23 from offset 236
2025-09-30T14:51:01.945454Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 236 ReadOffset 236 ReadGuid 90180116-4b7f9618-ae2b3c98-9b85afc9 has messages 1
2025-09-30T14:51:01.945477Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 90180116-4b7f9618-ae2b3c98-9b85afc9, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 26034
2025-09-30T14:51:01.945484Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 90180116-4b7f9618-ae2b3c98-9b85afc9
2025-09-30T14:51:01.945548Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.947814Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 153229 } }
2025-09-30T14:51:01.947882Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# c84a8b5-6ab2073f-f4e869df-5bd4300e
2025-09-30T14:51:01.948717Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.948857Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.948897Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.948905Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.948932Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.948936Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 472  requestId: <none> cookie: 237
2025-09-30T14:51:01.949023Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.949054Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.949070Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.949084Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949087Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949108Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 237 partNo : 0 messageNo: 473 size 26045 offset: -1
2025-09-30T14:51:01.949116Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.949135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.949141Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.949144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.949146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:01.949147Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.949182Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.949182Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 237 partNo 0
2025-09-30T14:51:01.949188Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.949218Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.949224Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 237 partNo 0 FormedBlobsCount 0 NewHead: Offset 236 PartNo 0 PackedSize 26119 count 1 nextOffset 237 batches 1
2025-09-30T14:51:01.949231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.949247Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.949282Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.949301Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.949301Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 236,1 HeadOffset 236 endOffset 236 curOffset 237 d0000000000_00000000000000000236_00000_0000000001_00000? size 26110 WTime 1759243861949
2025-09-30T14:51:01.949332Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949335Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949342Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949343Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949348Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949350Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949354Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949356Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949359Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949361Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949368Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.978404Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760558:2521] disconnected; active server actors: 1
2025-09-30T14:51:01.949382Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 236 partNo 0 count 1 size 26110
2025-09-30T14:51:01.978413Z node 4 :PERSQUEUE_READ_BALANCER NOTICE: read_balancer__balancing.cpp:1674: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894849718760558:2521] client user disconnected session shared/user_3_1_13398544198722215142_v1
2025-09-30T14:51:01.949384Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.949455Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 474  requestId: <none> cookie: 238
2025-09-30T14:51:01.949459Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.949460Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 475  requestId: <none> cookie: 239
2025-09-30T14:51:01.949463Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 476  requestId: <none> cookie: 240
2025-09-30T14:51:01.949466Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 477  requestId: <none> cookie: 241
2025-09-30T14:51:01.949466Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.949469Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 478  requestId: <none> cookie: 242
2025-09-30T14:51:01.949507Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.949514Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.949519Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.949527Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.949541Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.949547Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.949570Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949574Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949583Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.949585Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 238 partNo : 0 messageNo: 479 size 26155 offset: -1
2025-09-30T14:51:01.949588Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.949591Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949593Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949597Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 239 partNo : 0 messageNo: 480 size 26265 offset: -1
2025-09-30T14:51:01.949598Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.949601Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.949602Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949604Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949608Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 240 partNo : 0 messageNo: 481 size 26375 offset: -1
2025-09-30T14:51:01.949612Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949614Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949620Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 241 partNo : 0 messageNo: 482 size 26485 offset: -1
2025-09-30T14:51:01.949625Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.978530Z :DEBUG: [/Root] MessageGroupId [src_id] SessionId [src_id|19efaaa7-86563d97-33872e1-808c28ef_0] Write session: destroy
2025-09-30T14:51:01.949626Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.979236Z :INFO: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] Closing read session. Close timeout: 0.000000s
2025-09-30T14:51:01.949632Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 242 partNo : 0 messageNo: 483 size 26595 offset: -1
2025-09-30T14:51:01.949637Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.949647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.949649Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.980627Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-09-30T14:51:01.949653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.980637Z :INFO: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] Counters: { Errors: 0 CurrentSessionLifetimeMs: 254 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:01.980645Z :INFO: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] Closing read session. Close timeout: 0.000000s
2025-09-30T14:51:01.949656Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949656Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.980651Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-09-30T14:51:01.949657Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.980675Z :INFO: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 253 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:01.980681Z :INFO: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] Closing read session. Close timeout: 0.000000s
2025-09-30T14:51:01.949660Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.980687Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-09-30T14:51:01.949668Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.980692Z :INFO: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] Counters: { Errors: 0 CurrentSessionLifetimeMs: 253 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:01.949670Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949674Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.980699Z :INFO: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] Closing read session. Close timeout: 0.000000s
2025-09-30T14:51:01.980720Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-09-30T14:51:01.980721Z :INFO: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] Counters: { Errors: 0 CurrentSessionLifetimeMs: 253 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:01.949675Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949678Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.949683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.949685Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.949689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.980736Z :NOTICE: [/Root] [/Root] [cccbb961-e018a368-137c63a0-e428b1c1] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:51:01.949691Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.949693Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.949696Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949697Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949704Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949705Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949715Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 484  requestId: <none> cookie: 243
2025-09-30T14:51:01.949722Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.949722Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 485  requestId: <none> cookie: 244
2025-09-30T14:51:01.949725Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 486  requestId: <none> cookie: 245
2025-09-30T14:51:01.949728Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.949728Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 487  requestId: <none> cookie: 246
2025-09-30T14:51:01.949731Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 488  requestId: <none> cookie: 247
2025-09-30T14:51:01.949734Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.949737Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949739Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949739Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.949743Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.949744Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 243 partNo : 0 messageNo: 489 size 26705 offset: -1
2025-09-30T14:51:01.949747Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.949748Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.949751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.949753Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.949756Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949758Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949762Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 244 partNo : 0 messageNo: 490 size 26815 offset: -1
2025-09-30T14:51:01.949767Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949768Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949772Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.980841Z :INFO: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] Closing read session. Close timeout: 0.000000s
2025-09-30T14:51:01.949774Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.980844Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset): -:test-topic:0:1:299:0
2025-09-30T14:51:01.949777Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 245 partNo : 0 messageNo: 492 size 26925 offset: -1
2025-09-30T14:51:01.980847Z :INFO: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] Counters: { Errors: 0 CurrentSessionLifetimeMs: 253 BytesRead: 4936800 MessagesRead: 300 BytesReadCompressed: 4936800 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:01.949782Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.980852Z :NOTICE: [/Root] [/Root] [9ebe4fd5-75151040-106b83da-8ff1643b] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:51:01.949784Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949788Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 246 partNo : 0 messageNo: 493 size 27035 offset: -1
2025-09-30T14:51:01.949793Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949794Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949798Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 247 partNo : 0 messageNo: 494 size 27145 offset: -1
2025-09-30T14:51:01.949801Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.949805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.949809Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.949811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.949813Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.949817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.949819Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.949823Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.949826Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 491  requestId: <none> cookie: 248
2025-09-30T14:51:01.949834Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.949838Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.949892Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.980910Z :INFO: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] Closing read session. Close timeout: 0.000000s
2025-09-30T14:51:01.949899Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.980914Z :INFO: [/Root] Read/commit by partition streams (cluster:topic:partition:stream-id:read-offset:committed-offset):
2025-09-30T14:51:01.980918Z :INFO: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] Counters: { Errors: 0 CurrentSessionLifetimeMs: 255 BytesRead: 0 MessagesRead: 0 BytesReadCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:01.980923Z :NOTICE: [/Root] [/Root] [4022cec9-b00d5aee-44c63b7-1ad5e045] Aborting read session. Description: SessionClosed { Status: ABORTED Issues: "<main>: Error: Aborted " }
2025-09-30T14:51:01.949908Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949915Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949919Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.949929Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 248 partNo : 0 messageNo: 495 size 27255 offset: -1
2025-09-30T14:51:01.949935Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949937Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949942Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.949943Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.949949Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.949960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.949971Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 496  requestId: <none> cookie: 249
2025-09-30T14:51:01.949978Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 497  requestId: <none> cookie: 250
2025-09-30T14:51:01.950042Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.950052Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.950056Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.950116Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.950122Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.950136Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 249 partNo : 0 messageNo: 498 size 27365 offset: -1
2025-09-30T14:51:01.950143Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.950145Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.950147Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.950152Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 250 partNo : 0 messageNo: 499 size 27475 offset: -1
2025-09-30T14:51:01.950158Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.950158Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.950162Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.950167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.950169Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.950173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.950175Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.950177Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.950187Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 500  requestId: <none> cookie: 251
2025-09-30T14:51:01.950222Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.950229Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.950243Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.950249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.950257Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.950262Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.950272Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 251 partNo : 0 messageNo: 502 size 27585 offset: -1
2025-09-30T14:51:01.950292Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.950294Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.950296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.950306Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.950313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.950363Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.950481Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 501  requestId: <none> cookie: 252
2025-09-30T14:51:01.950487Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.950490Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.950494Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 503  requestId: <none> cookie: 253
2025-09-30T14:51:01.950499Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 504  requestId: <none> cookie: 254
2025-09-30T14:51:01.950511Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.950517Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.950521Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.950546Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.950549Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.950556Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 252 partNo : 0 messageNo: 505 size 27695 offset: -1
2025-09-30T14:51:01.950560Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.950562Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.950566Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 253 partNo : 0 messageNo: 506 size 27805 offset: -1
2025-09-30T14:51:01.950569Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.950571Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.950577Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 254 partNo : 0 messageNo: 507 size 27915 offset: -1
2025-09-30T14:51:01.950585Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.950591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.950593Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.950611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.950612Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.950617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.951118Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.951262Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 236 count 1 size 26110 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.951265Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.951283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.951302Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 26052 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.951313Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.951312Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 236 partno 0 count 1 parts 0 suffix '63' size 26110
2025-09-30T14:51:01.951324Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 237, partNo: 0, Offset: 236 is stored on disk
2025-09-30T14:51:01.951372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.951392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.951395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (17)
2025-09-30T14:51:01.951405Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 236 EndOffset 236 newEndOffset 237 commitOffset 0 clientCommitOffset 0 cookie 23 readingFinished 0 firstRead 0
2025-09-30T14:51:01.951412Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 236 endOffset 237
2025-09-30T14:51:01.951421Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 238 partNo 0
2025-09-30T14:51:01.951429Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 236, endOffset# 237, WTime# 1759243861943, sizeLag# 26110
2025-09-30T14:51:01.951432Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.951451Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 765ab642-4d9890ae-d23bec24-1daccf42, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 1, size# 31332, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.951474Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 238 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 26229 count 1 nextOffset 238 batches 1
2025-09-30T14:51:01.951483Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 239 partNo 0
2025-09-30T14:51:01.951488Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 239 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 52536 count 2 nextOffset 239 batches 1
2025-09-30T14:51:01.951493Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 240 partNo 0
2025-09-30T14:51:01.951496Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 240 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 78953 count 3 nextOffset 240 batches 1
2025-09-30T14:51:01.951500Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 241 partNo 0
2025-09-30T14:51:01.951505Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 241 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 105480 count 4 nextOffset 241 batches 1
2025-09-30T14:51:01.951521Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 242 partNo 0
2025-09-30T14:51:01.951525Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 242 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 132117 count 5 nextOffset 242 batches 1
2025-09-30T14:51:01.951529Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 243 partNo 0
2025-09-30T14:51:01.951532Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 243 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 158864 count 6 nextOffset 243 batches 1
2025-09-30T14:51:01.951536Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 244 partNo 0
2025-09-30T14:51:01.951538Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 1 maxSize 31332 maxTimeLagMs 0 readTimestampMs 0 readOffset 236 EndOffset 237 ClientCommitOffset 0 committedOffset 0 Guid 765ab642-4d9890ae-d23bec24-1daccf42
2025-09-30T14:51:01.951541Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 244 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 185721 count 7 nextOffset 244 batches 1
2025-09-30T14:51:01.951559Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 245 partNo 0
2025-09-30T14:51:01.951562Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 245 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 212688 count 8 nextOffset 245 batches 1
2025-09-30T14:51:01.951566Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 246 partNo 0
2025-09-30T14:51:01.951573Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 246 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 239765 count 9 nextOffset 246 batches 1
2025-09-30T14:51:01.951578Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 247 partNo 0
2025-09-30T14:51:01.951582Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 247 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 266952 count 10 nextOffset 247 batches 1
2025-09-30T14:51:01.951585Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 248 partNo 0
2025-09-30T14:51:01.951589Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 248 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 294249 count 11 nextOffset 248 batches 1
2025-09-30T14:51:01.951592Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 249 partNo 0
2025-09-30T14:51:01.951596Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 249 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 321656 count 12 nextOffset 249 batches 1
2025-09-30T14:51:01.951599Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 250 partNo 0
2025-09-30T14:51:01.951603Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 250 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 349173 count 13 nextOffset 250 batches 1
2025-09-30T14:51:01.951607Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 251 partNo 0
2025-09-30T14:51:01.951612Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 251 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 376800 count 14 nextOffset 251 batches 1
2025-09-30T14:51:01.951617Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 252 partNo 0
2025-09-30T14:51:01.951621Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 252 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 404537 count 15 nextOffset 252 batches 1
2025-09-30T14:51:01.951624Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 253 partNo 0
2025-09-30T14:51:01.951628Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 253 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 432384 count 16 nextOffset 253 batches 1
2025-09-30T14:51:01.951631Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 254 partNo 0
2025-09-30T14:51:01.951635Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 254 partNo 0 FormedBlobsCount 0 NewHead: Offset 237 PartNo 0 PackedSize 460341 count 17 nextOffset 254 batches 1
2025-09-30T14:51:01.951638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.952218Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.952342Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.952386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 237,17 HeadOffset 237 endOffset 237 curOffset 254 d0000000000_00000000000000000237_00000_0000000017_00000? size 459878 WTime 1759243861952
2025-09-30T14:51:01.952444Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.952470Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.952831Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.952834Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.952836Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.952838Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.952840Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.952843Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.952846Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.952847Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.952850Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.952852Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.952855Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.952857Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.952859Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.952861Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.952863Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.952865Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.952867Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.952869Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.952872Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.952873Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.952876Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.952878Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.952880Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000218_00000_0000000003_00000?
2025-09-30T14:51:01.952879Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.952881Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000221_00000_0000000007_00000?
2025-09-30T14:51:01.952884Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000228_00000_0000000001_00000?
2025-09-30T14:51:01.952886Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000229_00000_0000000006_00000?
2025-09-30T14:51:01.952888Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000235_00000_0000000001_00000?
2025-09-30T14:51:01.952890Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000236_00000_0000000001_00000?
2025-09-30T14:51:01.952893Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 28 keys were taken away. Let's read 3100792 bytes (3100792)
2025-09-30T14:51:01.952897Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 28, size 3100792 (8388608)
2025-09-30T14:51:01.952913Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.952919Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.952939Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 473  requestId: <none> cookie: 237
2025-09-30T14:51:01.952962Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.952964Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.952971Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.952974Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.952976Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.952979Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.952980Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.952986Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.952988Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.952999Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 237 partNo 0 count 17 size 459878
2025-09-30T14:51:01.953068Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 508  requestId: <none> cookie: 255
2025-09-30T14:51:01.953076Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.953082Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 509  requestId: <none> cookie: 256
2025-09-30T14:51:01.953085Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 510  requestId: <none> cookie: 257
2025-09-30T14:51:01.953087Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.953092Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.953112Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953113Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953123Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 28 Topic 'rt3.dc1--test-topic' partition 0 user user offset 236 count 1 size 31332 endOffset 237 max time lag 0ms effective offset 236
2025-09-30T14:51:01.953136Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 28 added 1 blobs, size 26110 count 1 last offset 236, current partition end offset: 237
2025-09-30T14:51:01.953140Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 28. Send blob request.
2025-09-30T14:51:01.953144Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953146Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953151Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.953156Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 255 partNo : 0 messageNo: 512 size 28025 offset: -1
2025-09-30T14:51:01.953162Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953163Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953169Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 256 partNo : 0 messageNo: 513 size 28135 offset: -1
2025-09-30T14:51:01.953172Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953173Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953177Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 257 partNo : 0 messageNo: 514 size 28245 offset: -1
2025-09-30T14:51:01.953190Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 236 partno 0 count 1 parts_count 0 source 1 size 26110 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.953194Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 28. All 1 blobs are from cache.
2025-09-30T14:51:01.953201Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.953210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.953212Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.953214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.953214Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 236 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:51:01.953216Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.953219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.953222Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 511  requestId: <none> cookie: 258
2025-09-30T14:51:01.953230Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.953233Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.953238Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.953269Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 236 totakecount 1 count 1 size 26087 from pos 0 cbcount 1
2025-09-30T14:51:01.953272Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.953282Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.953291Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953299Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 258 partNo : 0 messageNo: 515 size 28355 offset: -1
2025-09-30T14:51:01.953305Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 236
2025-09-30T14:51:01.953313Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953314Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953318Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953320Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953323Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.953326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.953340Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.953342Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 516  requestId: <none> cookie: 259
2025-09-30T14:51:01.953345Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 517  requestId: <none> cookie: 260
2025-09-30T14:51:01.953389Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.953395Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.953398Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.953417Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 237 Result { Offset: 236 Data: "... 26045 bytes ..." SourceId: "\000src_id" SeqNo: 237 WriteTimestampMS: 1759243861948 CreateTimestampMS: 1759243861943 UncompressedSize: 25971 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 23 RealReadOffset: 236 WaitQuotaTimeMs: 0 EndOffset: 237 StartOffset: 0 } Cookie: 236 }
2025-09-30T14:51:01.953434Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.953451Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.953453Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 24 from offset 237
2025-09-30T14:51:01.953456Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.953462Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 237 ReadOffset 237 ReadGuid 765ab642-4d9890ae-d23bec24-1daccf42 has messages 1
2025-09-30T14:51:01.953472Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953474Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953475Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.953478Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 259 partNo : 0 messageNo: 518 size 28465 offset: -1
2025-09-30T14:51:01.953482Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953484Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953488Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 260 partNo : 0 messageNo: 519 size 28575 offset: -1
2025-09-30T14:51:01.953491Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953494Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953498Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953499Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953501Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 765ab642-4d9890ae-d23bec24-1daccf42, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 26144
2025-09-30T14:51:01.953503Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.953506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.953508Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.953510Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 765ab642-4d9890ae-d23bec24-1daccf42
2025-09-30T14:51:01.953511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.953515Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953518Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 520  requestId: <none> cookie: 261
2025-09-30T14:51:01.953534Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 521  requestId: <none> cookie: 262
2025-09-30T14:51:01.953537Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 522  requestId: <none> cookie: 263
2025-09-30T14:51:01.953547Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.953556Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.953559Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.953563Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.953622Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.953630Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.953634Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953637Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953642Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 261 partNo : 0 messageNo: 523 size 28685 offset: -1
2025-09-30T14:51:01.953646Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953648Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953651Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 262 partNo : 0 messageNo: 524 size 28795 offset: -1
2025-09-30T14:51:01.953655Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953657Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953660Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 263 partNo : 0 messageNo: 525 size 28905 offset: -1
2025-09-30T14:51:01.953665Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953666Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953669Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.953673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.953674Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.953677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.953678Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.953681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.953684Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 526  requestId: <none> cookie: 264
2025-09-30T14:51:01.953695Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.953703Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.953719Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953725Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953739Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 264 partNo : 0 messageNo: 527 size 29015 offset: -1
2025-09-30T14:51:01.953747Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.953754Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.953757Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.953782Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.953787Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.953796Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.953811Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953813Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953824Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 528  requestId: <none> cookie: 265
2025-09-30T14:51:01.953827Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.953831Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953832Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.953832Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953838Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 529  requestId: <none> cookie: 266
2025-09-30T14:51:01.953842Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953843Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.953844Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953848Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953848Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.953850Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953855Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 265 partNo : 0 messageNo: 531 size 29125 offset: -1
2025-09-30T14:51:01.953860Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953862Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953867Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 266 partNo : 0 messageNo: 532 size 29235 offset: -1
2025-09-30T14:51:01.953870Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.953876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.953879Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 530  requestId: <none> cookie: 267
2025-09-30T14:51:01.953881Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.953884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.953912Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.953917Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.953940Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.953942Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.953948Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 267 partNo : 0 messageNo: 533 size 29345 offset: -1
2025-09-30T14:51:01.953952Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.953955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.953994Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.954009Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.954025Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.954029Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.954035Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.954039Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.954050Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 534  requestId: <none> cookie: 268
2025-09-30T14:51:01.954060Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 535  requestId: <none> cookie: 269
2025-09-30T14:51:01.954066Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.954073Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.954104Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.954106Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.954111Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 268 partNo : 0 messageNo: 536 size 29455 offset: -1
2025-09-30T14:51:01.954114Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.954116Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.954119Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 269 partNo : 0 messageNo: 537 size 29565 offset: -1
2025-09-30T14:51:01.954123Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.954126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.954128Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.954131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.955413Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 237 count 17 size 459878 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.955437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.955445Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 237 partno 0 count 17 parts 0 suffix '63' size 459878
2025-09-30T14:51:01.955457Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 459714 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.955468Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955478Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 238, partNo: 0, Offset: 237 is stored on disk
2025-09-30T14:51:01.955483Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955487Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 239, partNo: 0, Offset: 238 is stored on disk
2025-09-30T14:51:01.955489Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955493Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 240, partNo: 0, Offset: 239 is stored on disk
2025-09-30T14:51:01.955496Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955502Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 241, partNo: 0, Offset: 240 is stored on disk
2025-09-30T14:51:01.955504Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955508Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 242, partNo: 0, Offset: 241 is stored on disk
2025-09-30T14:51:01.955510Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955514Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 243, partNo: 0, Offset: 242 is stored on disk
2025-09-30T14:51:01.955516Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955521Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 244, partNo: 0, Offset: 243 is stored on disk
2025-09-30T14:51:01.955523Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955534Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 245, partNo: 0, Offset: 244 is stored on disk
2025-09-30T14:51:01.955536Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955542Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 246, partNo: 0, Offset: 245 is stored on disk
2025-09-30T14:51:01.955544Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955548Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 247, partNo: 0, Offset: 246 is stored on disk
2025-09-30T14:51:01.955550Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955554Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 248, partNo: 0, Offset: 247 is stored on disk
2025-09-30T14:51:01.955556Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955561Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 249, partNo: 0, Offset: 248 is stored on disk
2025-09-30T14:51:01.955563Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955567Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 250, partNo: 0, Offset: 249 is stored on disk
2025-09-30T14:51:01.955569Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955576Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 251, partNo: 0, Offset: 250 is stored on disk
2025-09-30T14:51:01.955578Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955584Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 252, partNo: 0, Offset: 251 is stored on disk
2025-09-30T14:51:01.955586Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955591Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 253, partNo: 0, Offset: 252 is stored on disk
2025-09-30T14:51:01.955593Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.955598Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 254, partNo: 0, Offset: 253 is stored on disk
2025-09-30T14:51:01.955659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.955678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.955681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (15)
2025-09-30T14:51:01.955683Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 237 EndOffset 237 newEndOffset 254 commitOffset 0 clientCommitOffset 0 cookie 24 readingFinished 0 firstRead 0
2025-09-30T14:51:01.955689Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 237 endOffset 254
2025-09-30T14:51:01.955704Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 237, endOffset# 254, WTime# 1759243861948, sizeLag# 459878
2025-09-30T14:51:01.955707Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.955708Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 255 partNo 0
2025-09-30T14:51:01.955722Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 16ddf813-18b108ee-183f6388-20e5f72b, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 20, size# 472110, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.955737Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 20 maxSize 472110 maxTimeLagMs 0 readTimestampMs 0 readOffset 237 EndOffset 254 ClientCommitOffset 0 committedOffset 0 Guid 16ddf813-18b108ee-183f6388-20e5f72b
2025-09-30T14:51:01.955742Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 255 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 28099 count 1 nextOffset 255 batches 1
2025-09-30T14:51:01.955750Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 256 partNo 0
2025-09-30T14:51:01.955756Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 256 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 56276 count 2 nextOffset 256 batches 1
2025-09-30T14:51:01.955760Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 257 partNo 0
2025-09-30T14:51:01.955764Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 257 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 84563 count 3 nextOffset 257 batches 1
2025-09-30T14:51:01.955767Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 258 partNo 0
2025-09-30T14:51:01.955775Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 258 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 112960 count 4 nextOffset 258 batches 1
2025-09-30T14:51:01.955778Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 259 partNo 0
2025-09-30T14:51:01.955783Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 259 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 141467 count 5 nextOffset 259 batches 1
2025-09-30T14:51:01.955786Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 260 partNo 0
2025-09-30T14:51:01.955792Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 260 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 170084 count 6 nextOffset 260 batches 1
2025-09-30T14:51:01.955795Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 261 partNo 0
2025-09-30T14:51:01.955799Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 261 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 198811 count 7 nextOffset 261 batches 1
2025-09-30T14:51:01.955802Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 262 partNo 0
2025-09-30T14:51:01.955807Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 262 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 227648 count 8 nextOffset 262 batches 1
2025-09-30T14:51:01.955810Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 263 partNo 0
2025-09-30T14:51:01.955815Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 263 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 256595 count 9 nextOffset 263 batches 1
2025-09-30T14:51:01.955818Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 264 partNo 0
2025-09-30T14:51:01.955824Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 264 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 285652 count 10 nextOffset 264 batches 1
2025-09-30T14:51:01.955828Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 265 partNo 0
2025-09-30T14:51:01.955832Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 265 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 314819 count 11 nextOffset 265 batches 1
2025-09-30T14:51:01.955837Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 266 partNo 0
2025-09-30T14:51:01.955841Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 266 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 344096 count 12 nextOffset 266 batches 1
2025-09-30T14:51:01.955843Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 267 partNo 0
2025-09-30T14:51:01.955849Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 267 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 373483 count 13 nextOffset 267 batches 1
2025-09-30T14:51:01.955853Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 268 partNo 0
2025-09-30T14:51:01.955856Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 268 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 402980 count 14 nextOffset 268 batches 1
2025-09-30T14:51:01.955859Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 269 partNo 0
2025-09-30T14:51:01.955863Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 269 partNo 0 FormedBlobsCount 0 NewHead: Offset 254 PartNo 0 PackedSize 432587 count 15 nextOffset 269 batches 1
2025-09-30T14:51:01.955866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.956094Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 254,15 HeadOffset 254 endOffset 254 curOffset 269 d0000000000_00000000000000000254_00000_0000000015_00000? size 432186 WTime 1759243861955
2025-09-30T14:51:01.956169Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.956172Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.956174Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.956177Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.956179Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.956182Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.956184Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.956186Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.956189Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.956192Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.956195Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.956197Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.956200Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.956205Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.956207Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.956209Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.956212Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.956215Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.956220Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.956224Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.956226Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.956228Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.956230Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000218_00000_0000000003_00000?
2025-09-30T14:51:01.956234Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000221_00000_0000000007_00000?
2025-09-30T14:51:01.956237Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000228_00000_0000000001_00000?
2025-09-30T14:51:01.956239Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000229_00000_0000000006_00000?
2025-09-30T14:51:01.956241Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000235_00000_0000000001_00000?
2025-09-30T14:51:01.956243Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000236_00000_0000000001_00000?
2025-09-30T14:51:01.956245Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000237_00000_0000000017_00000?
2025-09-30T14:51:01.956248Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 29 keys were taken away. Let's read 3560670 bytes (3560670)
2025-09-30T14:51:01.956253Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 29, size 3560670 (8388608)
2025-09-30T14:51:01.956275Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 479  requestId: <none> cookie: 238
2025-09-30T14:51:01.956302Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 480  requestId: <none> cookie: 239
2025-09-30T14:51:01.956309Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 481  requestId: <none> cookie: 240
2025-09-30T14:51:01.956314Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 482  requestId: <none> cookie: 241
2025-09-30T14:51:01.956316Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956319Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 483  requestId: <none> cookie: 242
2025-09-30T14:51:01.956325Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 489  requestId: <none> cookie: 243
2025-09-30T14:51:01.956327Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956331Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956331Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 490  requestId: <none> cookie: 244
2025-09-30T14:51:01.956335Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956337Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 492  requestId: <none> cookie: 245
2025-09-30T14:51:01.956339Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956343Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 493  requestId: <none> cookie: 246
2025-09-30T14:51:01.956348Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956349Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 494  requestId: <none> cookie: 247
2025-09-30T14:51:01.956352Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956355Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 495  requestId: <none> cookie: 248
2025-09-30T14:51:01.956357Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956361Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 498  requestId: <none> cookie: 249
2025-09-30T14:51:01.956363Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956367Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 499  requestId: <none> cookie: 250
2025-09-30T14:51:01.956373Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 502  requestId: <none> cookie: 251
2025-09-30T14:51:01.956378Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 505  requestId: <none> cookie: 252
2025-09-30T14:51:01.956384Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 506  requestId: <none> cookie: 253
2025-09-30T14:51:01.956390Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 507  requestId: <none> cookie: 254
2025-09-30T14:51:01.956406Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.956412Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.956428Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.956445Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 254 partNo 0 count 15 size 432186
2025-09-30T14:51:01.956490Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956520Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956532Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956536Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956539Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956543Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956546Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956546Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 29 Topic 'rt3.dc1--test-topic' partition 0 user user offset 237 count 20 size 472110 endOffset 254 max time lag 0ms effective offset 237
2025-09-30T14:51:01.956549Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.956562Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 29 added 1 blobs, size 459878 count 17 last offset 237, current partition end offset: 254
2025-09-30T14:51:01.956566Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 29. Send blob request.
2025-09-30T14:51:01.956580Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 237 partno 0 count 17 parts_count 0 source 1 size 459878 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.956585Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 29. All 1 blobs are from cache.
2025-09-30T14:51:01.956596Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.956603Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 237 partno 0 count 17 parts 0 suffix '63'
2025-09-30T14:51:01.957232Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 237 totakecount 17 count 17 size 459855 from pos 0 cbcount 17
2025-09-30T14:51:01.957303Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 237
2025-09-30T14:51:01.957447Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.957518Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.957545Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 254 Result { Offset: 237 Data: "... 26155 bytes ..." SourceId: "\000src_id" SeqNo: 238 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861943 UncompressedSize: 26081 PartitionKey: "" ExplicitHash: "" } Result { Offset: 238 Data: "... 26265 bytes ..." SourceId: "\000src_id" SeqNo: 239 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861943 UncompressedSize: 26191 PartitionKey: "" ExplicitHash: "" } Result { Offset: 239 Data: "... 26375 bytes ..." SourceId: "\000src_id" SeqNo: 240 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861947 UncompressedSize: 26301 PartitionKey: "" ExplicitHash: "" } Result { Offset: 240 Data: "... 26485 bytes ..." SourceId: "\000src_id" SeqNo: 241 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861947 UncompressedSize: 26411 PartitionKey: "" ExplicitHash: "" } Result { Offset: 241 Data: "... 26595 bytes ..." SourceId: "\000src_id" SeqNo: 242 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861947 UncompressedSize: 26521 PartitionKey: "" ExplicitHash: "" } Result { Offset: 242 Data: "... 26705 bytes ..." SourceId: "\000src_id" SeqNo: 243 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861947 UncompressedSize: 26631 PartitionKey: "" ExplicitHash: "" } Result { Offset: 243 Data: "... 26815 bytes ..." SourceId: "\000src_id" SeqNo: 244 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861947 UncompressedSize: 26741 PartitionKey: "" ExplicitHash: "" } Result { Offset: 244 Data: "... 26925 bytes ..." SourceId: "\000src_id" SeqNo: 245 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861947 UncompressedSize: 26851 PartitionKey: "" ExplicitHash: "" } Result { Offset: 245 Data: "... 27035 bytes ..." SourceId: "\000src_id" SeqNo: 246 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861947 UncompressedSize: 26961 PartitionKey: "" ExplicitHash: "" } Result { Offset: 246 Data: "... 27145 bytes ..." SourceId: "\000src_id" SeqNo: 247 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861947 UncompressedSize: 27071 PartitionKey: "" ExplicitHash: "" } Result { Offset: 247 Data: "... 27255 bytes ..." SourceId: "\000src_id" SeqNo: 248 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861948 UncompressedSize: 27181 PartitionKey: "" ExplicitHash: "" } Result { Offset: 248 Data: "... 27365 bytes ..." SourceId: "\000src_id" SeqNo: 249 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861948 UncompressedSize: 27291 PartitionKey: "" ExplicitHash: "" } Result { Offset: 249 Data: "... 27475 bytes ..." SourceId: "\000src_id" SeqNo: 250 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861948 UncompressedSize: 27401 PartitionKey: "" ExplicitHash: "" } Result { Offset: 250 Data: "... 27585 bytes ..." SourceId: "\000src_id" SeqNo: 251 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861948 UncompressedSize: 27511 PartitionKey: "" ExplicitHash: "" } Result { Offset: 251 Data: "... 27695 bytes ..." SourceId: "\000src_id" SeqNo: 252 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861948 UncompressedSize: 27621 PartitionKey: "" ExplicitHash: "" } Result { Offset: 252 Data: "... 27805 bytes ..." SourceId: "\000src_id" SeqNo: 253 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861948 UncompressedSize: 27731 PartitionKey: "" ExplicitHash: "" } Result { Offset: 253 Data: "... 27915 bytes ..." SourceId: "\000src_id" SeqNo: 254 WriteTimestampMS: 1759243861951 CreateTimestampMS: 1759243861948 UncompressedSize: 27841 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551185 RealReadOffset: 253 WaitQuotaTimeMs: 0 EndOffset: 254 StartOffset: 0 } Cookie: 237 }
2025-09-30T14:51:01.957564Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 26034 } }
2025-09-30T14:51:01.957619Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# aaf0c160-b3914dc9-54869420-269c671c
2025-09-30T14:51:01.957630Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.957635Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.957654Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 538  requestId: <none> cookie: 270
2025-09-30T14:51:01.957664Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.957693Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.957702Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 25 from offset 254
2025-09-30T14:51:01.957712Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 254 ReadOffset 254 ReadGuid 16ddf813-18b108ee-183f6388-20e5f72b has messages 1
2025-09-30T14:51:01.957750Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.957755Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.957779Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 270 partNo : 0 messageNo: 539 size 29675 offset: -1
2025-09-30T14:51:01.957791Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.957803Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.957805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.957827Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.957829Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 16ddf813-18b108ee-183f6388-20e5f72b, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 459150
2025-09-30T14:51:01.957838Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 16ddf813-18b108ee-183f6388-20e5f72b
2025-09-30T14:51:01.957880Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.957888Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.957946Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.957958Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.957964Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.957971Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.957973Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.957977Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.957980Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.957993Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 540  requestId: <none> cookie: 271
2025-09-30T14:51:01.957998Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 541  requestId: <none> cookie: 272
2025-09-30T14:51:01.958001Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 542  requestId: <none> cookie: 273
2025-09-30T14:51:01.958006Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.958010Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.958015Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.958018Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.958075Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.958082Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.958162Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.958189Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.958192Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.958206Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 271 partNo : 0 messageNo: 543 size 29785 offset: -1
2025-09-30T14:51:01.958211Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.958213Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.958217Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 272 partNo : 0 messageNo: 544 size 29895 offset: -1
2025-09-30T14:51:01.958222Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.958224Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.958228Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 273 partNo : 0 messageNo: 545 size 30005 offset: -1
2025-09-30T14:51:01.958232Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.958234Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.958238Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.958240Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.958402Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.958412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.958415Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.958418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.958420Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.958423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.958432Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 546  requestId: <none> cookie: 274
2025-09-30T14:51:01.958438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 547  requestId: <none> cookie: 275
2025-09-30T14:51:01.958445Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.958452Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.958458Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.958491Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.958501Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.958512Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.958515Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.958524Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 274 partNo : 0 messageNo: 548 size 30115 offset: -1
2025-09-30T14:51:01.958529Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.958531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.958535Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 275 partNo : 0 messageNo: 549 size 30225 offset: -1
2025-09-30T14:51:01.958538Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.958540Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.958544Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.958548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.958550Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.958552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.958558Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 550  requestId: <none> cookie: 276
2025-09-30T14:51:01.958573Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.958583Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.958586Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.958590Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 276 partNo : 0 messageNo: 551 size 30335 offset: -1
2025-09-30T14:51:01.958593Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.958611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.958734Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.958826Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.958869Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.958878Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.958883Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.958907Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.958912Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.958919Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.958922Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.958978Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.958980Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.958990Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.958995Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 254 count 15 size 432186 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.959011Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 552  requestId: <none> cookie: 277
2025-09-30T14:51:01.959018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.959019Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959034Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 432030 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.959040Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 254 partno 0 count 15 parts 0 suffix '63' size 432186
2025-09-30T14:51:01.959044Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959053Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 255, partNo: 0, Offset: 254 is stored on disk
2025-09-30T14:51:01.959057Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959061Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 256, partNo: 0, Offset: 255 is stored on disk
2025-09-30T14:51:01.959063Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959067Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 257, partNo: 0, Offset: 256 is stored on disk
2025-09-30T14:51:01.959069Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959076Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 258, partNo: 0, Offset: 257 is stored on disk
2025-09-30T14:51:01.959079Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959083Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 259, partNo: 0, Offset: 258 is stored on disk
2025-09-30T14:51:01.959086Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959091Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 260, partNo: 0, Offset: 259 is stored on disk
2025-09-30T14:51:01.959093Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959098Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 261, partNo: 0, Offset: 260 is stored on disk
2025-09-30T14:51:01.959100Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959105Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 262, partNo: 0, Offset: 261 is stored on disk
2025-09-30T14:51:01.959107Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959111Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 263, partNo: 0, Offset: 262 is stored on disk
2025-09-30T14:51:01.959112Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959115Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 264, partNo: 0, Offset: 263 is stored on disk
2025-09-30T14:51:01.959117Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959120Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 265, partNo: 0, Offset: 264 is stored on disk
2025-09-30T14:51:01.959123Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959126Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 266, partNo: 0, Offset: 265 is stored on disk
2025-09-30T14:51:01.959128Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959131Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 267, partNo: 0, Offset: 266 is stored on disk
2025-09-30T14:51:01.959134Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959138Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 268, partNo: 0, Offset: 267 is stored on disk
2025-09-30T14:51:01.959139Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.959142Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 269, partNo: 0, Offset: 268 is stored on disk
2025-09-30T14:51:01.959198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.959211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.959213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (7)
2025-09-30T14:51:01.959229Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 254 EndOffset 254 newEndOffset 269 commitOffset 0 clientCommitOffset 0 cookie 25 readingFinished 0 firstRead 0
2025-09-30T14:51:01.959234Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 254 endOffset 269
2025-09-30T14:51:01.959238Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 270 partNo 0
2025-09-30T14:51:01.959267Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 254, endOffset# 269, WTime# 1759243861951, sizeLag# 432186
2025-09-30T14:51:01.959270Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.959283Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 270 partNo 0 FormedBlobsCount 0 NewHead: Offset 269 PartNo 0 PackedSize 29749 count 1 nextOffset 270 batches 1
2025-09-30T14:51:01.959283Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 6d0f75ab-414700e5-737c540e-f4d1133f, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 18, size# 38994, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.959290Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 271 partNo 0
2025-09-30T14:51:01.959295Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 271 partNo 0 FormedBlobsCount 0 NewHead: Offset 269 PartNo 0 PackedSize 59576 count 2 nextOffset 271 batches 1
2025-09-30T14:51:01.959298Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 272 partNo 0
2025-09-30T14:51:01.959300Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 18 maxSize 38994 maxTimeLagMs 0 readTimestampMs 0 readOffset 254 EndOffset 269 ClientCommitOffset 0 committedOffset 0 Guid 6d0f75ab-414700e5-737c540e-f4d1133f
2025-09-30T14:51:01.959302Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 272 partNo 0 FormedBlobsCount 0 NewHead: Offset 269 PartNo 0 PackedSize 89513 count 3 nextOffset 272 batches 1
2025-09-30T14:51:01.959305Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 273 partNo 0
2025-09-30T14:51:01.959309Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 273 partNo 0 FormedBlobsCount 0 NewHead: Offset 269 PartNo 0 PackedSize 119560 count 4 nextOffset 273 batches 1
2025-09-30T14:51:01.959312Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 274 partNo 0
2025-09-30T14:51:01.959316Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 274 partNo 0 FormedBlobsCount 0 NewHead: Offset 269 PartNo 0 PackedSize 149717 count 5 nextOffset 274 batches 1
2025-09-30T14:51:01.959319Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 275 partNo 0
2025-09-30T14:51:01.959323Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 275 partNo 0 FormedBlobsCount 0 NewHead: Offset 269 PartNo 0 PackedSize 179984 count 6 nextOffset 275 batches 1
2025-09-30T14:51:01.959326Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 276 partNo 0
2025-09-30T14:51:01.959329Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 276 partNo 0 FormedBlobsCount 0 NewHead: Offset 269 PartNo 0 PackedSize 210361 count 7 nextOffset 276 batches 1
2025-09-30T14:51:01.959332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.959488Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 269,7 HeadOffset 269 endOffset 269 curOffset 276 d0000000000_00000000000000000269_00000_0000000007_00000? size 210208 WTime 1759243861959
2025-09-30T14:51:01.959538Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.959545Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.959547Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.959550Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.959552Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.959554Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.959557Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.959559Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.959561Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.959563Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.959566Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.959568Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.959570Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.959572Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.959574Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.959576Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.959580Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.959583Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.959588Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.959591Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.959593Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.959595Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.959596Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000218_00000_0000000003_00000?
2025-09-30T14:51:01.959598Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000221_00000_0000000007_00000?
2025-09-30T14:51:01.959601Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000228_00000_0000000001_00000?
2025-09-30T14:51:01.959602Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000229_00000_0000000006_00000?
2025-09-30T14:51:01.959604Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000235_00000_0000000001_00000?
2025-09-30T14:51:01.959606Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000236_00000_0000000001_00000?
2025-09-30T14:51:01.959608Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000237_00000_0000000017_00000?
2025-09-30T14:51:01.959609Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000254_00000_0000000015_00000?
2025-09-30T14:51:01.959612Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 30 keys were taken away. Let's read 3992856 bytes (3992856)
2025-09-30T14:51:01.959616Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 30, size 3992856 (8388608)
2025-09-30T14:51:01.959627Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 553  requestId: <none> cookie: 278
2025-09-30T14:51:01.959644Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.959647Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.959653Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.959654Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.959664Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 512  requestId: <none> cookie: 255
2025-09-30T14:51:01.959670Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.959672Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.959672Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959681Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 277 partNo : 0 messageNo: 556 size 30445 offset: -1
2025-09-30T14:51:01.959681Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959686Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 513  requestId: <none> cookie: 256
2025-09-30T14:51:01.959692Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 514  requestId: <none> cookie: 257
2025-09-30T14:51:01.959697Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 515  requestId: <none> cookie: 258
2025-09-30T14:51:01.959702Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 518  requestId: <none> cookie: 259
2025-09-30T14:51:01.959703Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959707Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 519  requestId: <none> cookie: 260
2025-09-30T14:51:01.959711Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959712Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 523  requestId: <none> cookie: 261
2025-09-30T14:51:01.959715Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959717Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 524  requestId: <none> cookie: 262
2025-09-30T14:51:01.959723Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 525  requestId: <none> cookie: 263
2025-09-30T14:51:01.959729Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 527  requestId: <none> cookie: 264
2025-09-30T14:51:01.959734Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 531  requestId: <none> cookie: 265
2025-09-30T14:51:01.959739Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 532  requestId: <none> cookie: 266
2025-09-30T14:51:01.959745Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 533  requestId: <none> cookie: 267
2025-09-30T14:51:01.959752Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 536  requestId: <none> cookie: 268
2025-09-30T14:51:01.959757Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 537  requestId: <none> cookie: 269
2025-09-30T14:51:01.959769Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.959772Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.959781Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.959795Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 269 partNo 0 count 7 size 210208
2025-09-30T14:51:01.959808Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.959814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.959817Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.959819Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.959823Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959824Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 278 partNo : 0 messageNo: 557 size 30555 offset: -1
2025-09-30T14:51:01.959831Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959836Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959841Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959845Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959849Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959853Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959857Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959861Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959865Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959869Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959874Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 554  requestId: <none> cookie: 279
2025-09-30T14:51:01.959878Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 555  requestId: <none> cookie: 280
2025-09-30T14:51:01.959881Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.959884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.959918Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 30 Topic 'rt3.dc1--test-topic' partition 0 user user offset 254 count 18 size 38994 endOffset 269 max time lag 0ms effective offset 254
2025-09-30T14:51:01.959932Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 30 added 1 blobs, size 432186 count 15 last offset 254, current partition end offset: 269
2025-09-30T14:51:01.959935Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 30. Send blob request.
2025-09-30T14:51:01.959945Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 254 partno 0 count 15 parts_count 0 source 1 size 432186 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.959950Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959952Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 30. All 1 blobs are from cache.
2025-09-30T14:51:01.959955Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.959962Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.959985Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 254 partno 0 count 15 parts 0 suffix '63'
2025-09-30T14:51:01.960163Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 254 totakecount 15 count 15 size 432163 from pos 0 cbcount 15
2025-09-30T14:51:01.960200Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.960202Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.960210Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 279 partNo : 0 messageNo: 558 size 30665 offset: -1
2025-09-30T14:51:01.960215Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.960217Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.960222Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 280 partNo : 0 messageNo: 559 size 30775 offset: -1
2025-09-30T14:51:01.960236Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 254
2025-09-30T14:51:01.960248Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.960253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.960255Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.960257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.960445Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 269 Result { Offset: 254 Data: "... 28025 bytes ..." SourceId: "\000src_id" SeqNo: 255 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861948 UncompressedSize: 27951 PartitionKey: "" ExplicitHash: "" } Result { Offset: 255 Data: "... 28135 bytes ..." SourceId: "\000src_id" SeqNo: 256 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861948 UncompressedSize: 28061 PartitionKey: "" ExplicitHash: "" } Result { Offset: 256 Data: "... 28245 bytes ..." SourceId: "\000src_id" SeqNo: 257 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861951 UncompressedSize: 28171 PartitionKey: "" ExplicitHash: "" } Result { Offset: 257 Data: "... 28355 bytes ..." SourceId: "\000src_id" SeqNo: 258 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861951 UncompressedSize: 28281 PartitionKey: "" ExplicitHash: "" } Result { Offset: 258 Data: "... 28465 bytes ..." SourceId: "\000src_id" SeqNo: 259 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861952 UncompressedSize: 28391 PartitionKey: "" ExplicitHash: "" } Result { Offset: 259 Data: "... 28575 bytes ..." SourceId: "\000src_id" SeqNo: 260 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861952 UncompressedSize: 28501 PartitionKey: "" ExplicitHash: "" } Result { Offset: 260 Data: "... 28685 bytes ..." SourceId: "\000src_id" SeqNo: 261 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861952 UncompressedSize: 28611 PartitionKey: "" ExplicitHash: "" } Result { Offset: 261 Data: "... 28795 bytes ..." SourceId: "\000src_id" SeqNo: 262 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861952 UncompressedSize: 28721 PartitionKey: "" ExplicitHash: "" } Result { Offset: 262 Data: "... 28905 bytes ..." SourceId: "\000src_id" SeqNo: 263 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861952 UncompressedSize: 28831 PartitionKey: "" ExplicitHash: "" } Result { Offset: 263 Data: "... 29015 bytes ..." SourceId: "\000src_id" SeqNo: 264 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861952 UncompressedSize: 28941 PartitionKey: "" ExplicitHash: "" } Result { Offset: 264 Data: "... 29125 bytes ..." SourceId: "\000src_id" SeqNo: 265 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861952 UncompressedSize: 29051 PartitionKey: "" ExplicitHash: "" } Result { Offset: 265 Data: "... 29235 bytes ..." SourceId: "\000src_id" SeqNo: 266 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861952 UncompressedSize: 29161 PartitionKey: "" ExplicitHash: "" } Result { Offset: 266 Data: "... 29345 bytes ..." SourceId: "\000src_id" SeqNo: 267 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861952 UncompressedSize: 29271 PartitionKey: "" ExplicitHash: "" } Result { Offset: 267 Data: "... 29455 bytes ..." SourceId: "\000src_id" SeqNo: 268 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861952 UncompressedSize: 29381 PartitionKey: "" ExplicitHash: "" } Result { Offset: 268 Data: "... 29565 bytes ..." SourceId: "\000src_id" SeqNo: 269 WriteTimestampMS: 1759243861955 CreateTimestampMS: 1759243861952 UncompressedSize: 29491 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551247 RealReadOffset: 268 WaitQuotaTimeMs: 0 EndOffset: 269 StartOffset: 0 } Cookie: 254 }
2025-09-30T14:51:01.960608Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 26 from offset 269
2025-09-30T14:51:01.960619Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 269 ReadOffset 269 ReadGuid 6d0f75ab-414700e5-737c540e-f4d1133f has messages 1
2025-09-30T14:51:01.960650Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 6d0f75ab-414700e5-737c540e-f4d1133f, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 431548
2025-09-30T14:51:01.960660Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 6d0f75ab-414700e5-737c540e-f4d1133f
2025-09-30T14:51:01.960972Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.961364Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 269 count 7 size 210208 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.961391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.961394Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 269 partno 0 count 7 parts 0 suffix '63' size 210208
2025-09-30T14:51:01.961410Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 210084 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.961420Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.961428Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 270, partNo: 0, Offset: 269 is stored on disk
2025-09-30T14:51:01.961433Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.961437Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 271, partNo: 0, Offset: 270 is stored on disk
2025-09-30T14:51:01.961439Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.961442Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 272, partNo: 0, Offset: 271 is stored on disk
2025-09-30T14:51:01.961445Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.961449Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 273, partNo: 0, Offset: 272 is stored on disk
2025-09-30T14:51:01.961451Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.961454Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 274, partNo: 0, Offset: 273 is stored on disk
2025-09-30T14:51:01.961457Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.961461Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 275, partNo: 0, Offset: 274 is stored on disk
2025-09-30T14:51:01.961463Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.961467Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 276, partNo: 0, Offset: 275 is stored on disk
2025-09-30T14:51:01.961507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.961518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.961519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (4)
2025-09-30T14:51:01.961531Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 269 EndOffset 269 newEndOffset 276 commitOffset 0 clientCommitOffset 0 cookie 26 readingFinished 0 firstRead 0
2025-09-30T14:51:01.961535Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 269 endOffset 276
2025-09-30T14:51:01.961542Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 277 partNo 0
2025-09-30T14:51:01.961544Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 269, endOffset# 276, WTime# 1759243861955, sizeLag# 210208
2025-09-30T14:51:01.961547Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.961570Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 277 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 30519 count 1 nextOffset 277 batches 1
2025-09-30T14:51:01.961579Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 278 partNo 0
2025-09-30T14:51:01.961584Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 278 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 61116 count 2 nextOffset 278 batches 1
2025-09-30T14:51:01.961588Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 279 partNo 0
2025-09-30T14:51:01.961593Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 279 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 91823 count 3 nextOffset 279 batches 1
2025-09-30T14:51:01.961596Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 280 partNo 0
2025-09-30T14:51:01.961604Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 280 partNo 0 FormedBlobsCount 0 NewHead: Offset 276 PartNo 0 PackedSize 122640 count 4 nextOffset 280 batches 1
2025-09-30T14:51:01.961606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.961705Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 276,4 HeadOffset 276 endOffset 276 curOffset 280 d0000000000_00000000000000000276_00000_0000000004_00000? size 122580 WTime 1759243861961
2025-09-30T14:51:01.961771Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.961773Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.961777Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.961779Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.961781Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.961784Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.961787Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.961789Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.961791Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.961794Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.961796Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.961799Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.961801Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.961804Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.961819Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.961825Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.961827Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.961829Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.961832Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.961835Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.961837Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.961840Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.961842Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000218_00000_0000000003_00000?
2025-09-30T14:51:01.961844Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000221_00000_0000000007_00000?
2025-09-30T14:51:01.961847Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000228_00000_0000000001_00000?
2025-09-30T14:51:01.961849Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000229_00000_0000000006_00000?
2025-09-30T14:51:01.961851Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000235_00000_0000000001_00000?
2025-09-30T14:51:01.961853Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000236_00000_0000000001_00000?
2025-09-30T14:51:01.961856Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000237_00000_0000000017_00000?
2025-09-30T14:51:01.961858Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000254_00000_0000000015_00000?
2025-09-30T14:51:01.961860Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000269_00000_0000000007_00000?
2025-09-30T14:51:01.961864Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 31 keys were taken away. Let's read 4203064 bytes (4203064)
2025-09-30T14:51:01.961868Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 31, size 4203064 (8388608)
2025-09-30T14:51:01.961883Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 539  requestId: <none> cookie: 270
2025-09-30T14:51:01.961904Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 543  requestId: <none> cookie: 271
2025-09-30T14:51:01.961910Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 544  requestId: <none> cookie: 272
2025-09-30T14:51:01.961915Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 545  requestId: <none> cookie: 273
2025-09-30T14:51:01.961916Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.961920Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 548  requestId: <none> cookie: 274
2025-09-30T14:51:01.961924Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.961926Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 549  requestId: <none> cookie: 275
2025-09-30T14:51:01.961929Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.961932Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 551  requestId: <none> cookie: 276
2025-09-30T14:51:01.961933Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.961938Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.961940Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.961944Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.961949Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.961954Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 276 partNo 0 count 4 size 122580
2025-09-30T14:51:01.962426Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.962430Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 26144 } }
2025-09-30T14:51:01.962457Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# cf92a25f-276cb4ea-c3e21404-b529f00c
2025-09-30T14:51:01.962514Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.962592Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.962613Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.962615Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.962640Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 560  requestId: <none> cookie: 281
2025-09-30T14:51:01.962684Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.962696Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.962703Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.962711Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.962714Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.962728Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 281 partNo : 0 messageNo: 561 size 30885 offset: -1
2025-09-30T14:51:01.962760Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.962765Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.962813Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.962864Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.962876Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.962888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.962892Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.962894Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.962896Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.962900Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.962902Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.962905Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.962907Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.962914Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.962916Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.962916Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.962934Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 562  requestId: <none> cookie: 282
2025-09-30T14:51:01.962940Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 563  requestId: <none> cookie: 283
2025-09-30T14:51:01.962944Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 564  requestId: <none> cookie: 284
2025-09-30T14:51:01.962947Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 565  requestId: <none> cookie: 285
2025-09-30T14:51:01.962950Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.962956Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.962962Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.962966Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.962973Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.962987Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.962992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.963005Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.963005Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 282 partNo : 0 messageNo: 566 size 30995 offset: -1
2025-09-30T14:51:01.963010Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.963012Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.963016Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 283 partNo : 0 messageNo: 567 size 31105 offset: -1
2025-09-30T14:51:01.963019Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.963021Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.963025Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 284 partNo : 0 messageNo: 568 size 31215 offset: -1
2025-09-30T14:51:01.963028Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.963030Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.963034Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 285 partNo : 0 messageNo: 569 size 31325 offset: -1
2025-09-30T14:51:01.963037Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.963039Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.963046Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.963054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.963056Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.963059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.963060Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.963063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.963064Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.963069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.963078Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 570  requestId: <none> cookie: 286
2025-09-30T14:51:01.963087Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.963098Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.963139Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.963141Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.963145Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.963151Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.963153Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.963163Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 286 partNo : 0 messageNo: 572 size 31435 offset: -1
2025-09-30T14:51:01.963171Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.963178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.963182Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 571  requestId: <none> cookie: 287
2025-09-30T14:51:01.963207Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 890698 } }
2025-09-30T14:51:01.963209Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.963218Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.963225Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.963285Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# e3429f42-75e4d13e-4519395-ab137365
2025-09-30T14:51:01.963291Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.963299Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.963300Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 2170df73-a7392bda-f0f40e0-8e4ad6bf, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 252249, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.963302Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.963309Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 287 partNo : 0 messageNo: 573 size 31545 offset: -1
2025-09-30T14:51:01.963314Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.963315Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.963319Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 252249 maxTimeLagMs 0 readTimestampMs 0 readOffset 269 EndOffset 276 ClientCommitOffset 0 committedOffset 0 Guid 2170df73-a7392bda-f0f40e0-8e4ad6bf
2025-09-30T14:51:01.963365Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.963366Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.963371Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.963376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.963387Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.963389Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.963395Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.963406Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 276 count 4 size 122580 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.963423Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 574  requestId: <none> cookie: 288
2025-09-30T14:51:01.963433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.963439Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 276 partno 0 count 4 parts 0 suffix '63' size 122580
2025-09-30T14:51:01.963446Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 122468 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.963447Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.963455Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.963461Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 277, partNo: 0, Offset: 276 is stored on disk
2025-09-30T14:51:01.963462Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.963466Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.963469Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 278, partNo: 0, Offset: 277 is stored on disk
2025-09-30T14:51:01.963472Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.963475Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 279, partNo: 0, Offset: 278 is stored on disk
2025-09-30T14:51:01.963477Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.963480Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 280, partNo: 0, Offset: 279 is stored on disk
2025-09-30T14:51:01.963505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.963515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.963517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (7)
2025-09-30T14:51:01.963544Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 281 partNo 0
2025-09-30T14:51:01.963548Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.963570Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 281 partNo 0 FormedBlobsCount 0 NewHead: Offset 280 PartNo 0 PackedSize 30959 count 1 nextOffset 281 batches 1
2025-09-30T14:51:01.963577Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 282 partNo 0
2025-09-30T14:51:01.963581Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 282 partNo 0 FormedBlobsCount 0 NewHead: Offset 280 PartNo 0 PackedSize 61996 count 2 nextOffset 282 batches 1
2025-09-30T14:51:01.963584Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 283 partNo 0
2025-09-30T14:51:01.963590Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 283 partNo 0 FormedBlobsCount 0 NewHead: Offset 280 PartNo 0 PackedSize 93143 count 3 nextOffset 283 batches 1
2025-09-30T14:51:01.963593Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 284 partNo 0
2025-09-30T14:51:01.963596Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 284 partNo 0 FormedBlobsCount 0 NewHead: Offset 280 PartNo 0 PackedSize 124400 count 4 nextOffset 284 batches 1
2025-09-30T14:51:01.963600Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 285 partNo 0
2025-09-30T14:51:01.963604Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 285 partNo 0 FormedBlobsCount 0 NewHead: Offset 280 PartNo 0 PackedSize 155767 count 5 nextOffset 285 batches 1
2025-09-30T14:51:01.963607Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 286 partNo 0
2025-09-30T14:51:01.963610Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 286 partNo 0 FormedBlobsCount 0 NewHead: Offset 280 PartNo 0 PackedSize 187244 count 6 nextOffset 286 batches 1
2025-09-30T14:51:01.963613Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 287 partNo 0
2025-09-30T14:51:01.963617Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 287 partNo 0 FormedBlobsCount 0 NewHead: Offset 280 PartNo 0 PackedSize 218831 count 7 nextOffset 287 batches 1
2025-09-30T14:51:01.963617Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.963619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.963625Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.963688Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.963925Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 280,7 HeadOffset 280 endOffset 280 curOffset 287 d0000000000_00000000000000000280_00000_0000000007_00000? size 218678 WTime 1759243861963
2025-09-30T14:51:01.964109Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.964111Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.964115Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.964119Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.964121Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.964123Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.964124Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.964126Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.964128Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.964129Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.964131Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.964134Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.964136Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.964137Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.964141Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.964142Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.964144Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.964146Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.964149Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.964151Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.964152Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.964154Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.964156Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000218_00000_0000000003_00000?
2025-09-30T14:51:01.964158Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000221_00000_0000000007_00000?
2025-09-30T14:51:01.964160Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000228_00000_0000000001_00000?
2025-09-30T14:51:01.964164Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000229_00000_0000000006_00000?
2025-09-30T14:51:01.964166Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000235_00000_0000000001_00000?
2025-09-30T14:51:01.964167Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000236_00000_0000000001_00000?
2025-09-30T14:51:01.964169Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000237_00000_0000000017_00000?
2025-09-30T14:51:01.964171Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000254_00000_0000000015_00000?
2025-09-30T14:51:01.964173Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000269_00000_0000000007_00000?
2025-09-30T14:51:01.964174Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000276_00000_0000000004_00000?
2025-09-30T14:51:01.964177Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 32 keys were taken away. Let's read 4325644 bytes (4325644)
2025-09-30T14:51:01.964181Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 32, size 4325644 (8388608)
2025-09-30T14:51:01.964193Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 575  requestId: <none> cookie: 289
2025-09-30T14:51:01.964215Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 556  requestId: <none> cookie: 277
2025-09-30T14:51:01.964214Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.964222Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.964225Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.964226Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.964237Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 288 partNo : 0 messageNo: 576 size 31655 offset: -1
2025-09-30T14:51:01.964244Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 557  requestId: <none> cookie: 278
2025-09-30T14:51:01.964247Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.964249Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.964254Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 558  requestId: <none> cookie: 279
2025-09-30T14:51:01.964259Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 559  requestId: <none> cookie: 280
2025-09-30T14:51:01.964263Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.964265Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.964269Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.964270Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.964275Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.964287Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 280 partNo 0 count 7 size 218678
2025-09-30T14:51:01.964300Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 31 Topic 'rt3.dc1--test-topic' partition 0 user user offset 269 count 8 size 252249 endOffset 280 max time lag 0ms effective offset 269
2025-09-30T14:51:01.964324Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 31 added 2 blobs, size 332788 count 11 last offset 276, current partition end offset: 280
2025-09-30T14:51:01.964327Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 31. Send blob request.
2025-09-30T14:51:01.964331Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.964339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.964345Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.964348Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.964350Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.964351Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.964354Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 289 partNo : 0 messageNo: 580 size 31765 offset: -1
2025-09-30T14:51:01.964355Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.964398Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 269 partno 0 count 7 parts_count 0 source 1 size 210208 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.964401Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 276 partno 0 count 4 parts_count 0 source 1 size 122580 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.964417Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 31. All 2 blobs are from cache.
2025-09-30T14:51:01.964426Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 577  requestId: <none> cookie: 290
2025-09-30T14:51:01.964429Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.964433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.964434Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 269 partno 0 count 7 parts 0 suffix '63'
2025-09-30T14:51:01.964435Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 578  requestId: <none> cookie: 291
2025-09-30T14:51:01.964436Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.964437Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 276 partno 0 count 4 parts 0 suffix '63'
2025-09-30T14:51:01.964438Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 579  requestId: <none> cookie: 292
2025-09-30T14:51:01.964442Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.964456Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 2 blobs
2025-09-30T14:51:01.964457Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.964704Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 269 totakecount 7 count 7 size 210185 from pos 0 cbcount 7
2025-09-30T14:51:01.964827Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 276 totakecount 4 count 4 size 122557 from pos 0 cbcount 4
2025-09-30T14:51:01.964848Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.964851Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.964859Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 290 partNo : 0 messageNo: 581 size 31875 offset: -1
2025-09-30T14:51:01.964865Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.964866Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.964870Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 291 partNo : 0 messageNo: 582 size 31985 offset: -1
2025-09-30T14:51:01.964874Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.964876Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.964882Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 292 partNo : 0 messageNo: 583 size 32095 offset: -1
2025-09-30T14:51:01.964893Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 269
2025-09-30T14:51:01.964905Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.964910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.964912Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.964914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.964916Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.964918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.965069Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 280 Result { Offset: 269 Data: "... 29675 bytes ..." SourceId: "\000src_id" SeqNo: 270 WriteTimestampMS: 1759243861959 CreateTimestampMS: 1759243861952 UncompressedSize: 29601 PartitionKey: "" ExplicitHash: "" } Result { Offset: 270 Data: "... 29785 bytes ..." SourceId: "\000src_id" SeqNo: 271 WriteTimestampMS: 1759243861959 CreateTimestampMS: 1759243861957 UncompressedSize: 29711 PartitionKey: "" ExplicitHash: "" } Result { Offset: 271 Data: "... 29895 bytes ..." SourceId: "\000src_id" SeqNo: 272 WriteTimestampMS: 1759243861959 CreateTimestampMS: 1759243861957 UncompressedSize: 29821 PartitionKey: "" ExplicitHash: "" } Result { Offset: 272 Data: "... 30005 bytes ..." SourceId: "\000src_id" SeqNo: 273 WriteTimestampMS: 1759243861959 CreateTimestampMS: 1759243861957 UncompressedSize: 29931 PartitionKey: "" ExplicitHash: "" } Result { Offset: 273 Data: "... 30115 bytes ..." SourceId: "\000src_id" SeqNo: 274 WriteTimestampMS: 1759243861959 CreateTimestampMS: 1759243861957 UncompressedSize: 30041 PartitionKey: "" ExplicitHash: "" } Result { Offset: 274 Data: "... 30225 bytes ..." SourceId: "\000src_id" SeqNo: 275 WriteTimestampMS: 1759243861959 CreateTimestampMS: 1759243861957 UncompressedSize: 30151 PartitionKey: "" ExplicitHash: "" } Result { Offset: 275 Data: "... 30335 bytes ..." SourceId: "\000src_id" SeqNo: 276 WriteTimestampMS: 1759243861959 CreateTimestampMS: 1759243861957 UncompressedSize: 30261 PartitionKey: "" ExplicitHash: "" } Result { Offset: 276 Data: "... 30445 bytes ..." SourceId: "\000src_id" SeqNo: 277 WriteTimestampMS: 1759243861961 CreateTimestampMS: 1759243861958 UncompressedSize: 30371 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 2 SizeLag: 179600 RealReadOffset: 276 WaitQuotaTimeMs: 0 EndOffset: 280 StartOffset: 0 } Cookie: 269 }
2025-09-30T14:51:01.965161Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 277 endOffset 280
2025-09-30T14:51:01.965181Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 280 ReadOffset 277 ReadGuid 2170df73-a7392bda-f0f40e0-8e4ad6bf has messages 1
2025-09-30T14:51:01.965189Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 277, endOffset# 280, WTime# 1759243861961, sizeLag# 179600
2025-09-30T14:51:01.965192Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 0
2025-09-30T14:51:01.965208Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 2170df73-a7392bda-f0f40e0-8e4ad6bf, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 240460
2025-09-30T14:51:01.965217Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 2170df73-a7392bda-f0f40e0-8e4ad6bf
2025-09-30T14:51:01.965452Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 1
2025-09-30T14:51:01.965463Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# d84fa63f-e1bafd57-ffa28b80-3e964754, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 3, size# 215520, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.965506Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 3 maxSize 215520 maxTimeLagMs 0 readTimestampMs 0 readOffset 277 EndOffset 280 ClientCommitOffset 0 committedOffset 0 Guid d84fa63f-e1bafd57-ffa28b80-3e964754
2025-09-30T14:51:01.965531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.965537Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.965561Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 32 Topic 'rt3.dc1--test-topic' partition 0 user user offset 277 count 3 size 215520 endOffset 280 max time lag 0ms effective offset 277
2025-09-30T14:51:01.965580Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 32 added 1 blobs, size 0 count 3 last offset 276, current partition end offset: 280
2025-09-30T14:51:01.965582Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 32. Send blob request.
2025-09-30T14:51:01.965593Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 276 partno 0 count 4 parts_count 0 source 1 size 122580 accessed 1 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.965606Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 32. All 1 blobs are from cache.
2025-09-30T14:51:01.965618Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.965619Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 276 partno 0 count 4 parts 0 suffix '63'
2025-09-30T14:51:01.965671Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 276 totakecount 4 count 4 size 122557 from pos 1 cbcount 4
2025-09-30T14:51:01.965695Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 277
2025-09-30T14:51:01.965791Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 280 count 7 size 218678 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.965802Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 280 Result { Offset: 277 Data: "... 30555 bytes ..." SourceId: "\000src_id" SeqNo: 278 WriteTimestampMS: 1759243861961 CreateTimestampMS: 1759243861958 UncompressedSize: 30481 PartitionKey: "" ExplicitHash: "" } Result { Offset: 278 Data: "... 30665 bytes ..." SourceId: "\000src_id" SeqNo: 279 WriteTimestampMS: 1759243861961 CreateTimestampMS: 1759243861958 UncompressedSize: 30591 PartitionKey: "" ExplicitHash: "" } Result { Offset: 279 Data: "... 30775 bytes ..." SourceId: "\000src_id" SeqNo: 280 WriteTimestampMS: 1759243861961 CreateTimestampMS: 1759243861958 UncompressedSize: 30701 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 30459 RealReadOffset: 279 WaitQuotaTimeMs: 0 EndOffset: 280 StartOffset: 0 } Cookie: 277 }
2025-09-30T14:51:01.965804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.965814Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 280 partno 0 count 7 parts 0 suffix '63' size 218678
2025-09-30T14:51:01.965819Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 218554 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.965829Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.965833Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 27 from offset 280
2025-09-30T14:51:01.965835Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 281, partNo: 0, Offset: 280 is stored on disk
2025-09-30T14:51:01.965839Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 280 ReadOffset 280 ReadGuid d84fa63f-e1bafd57-ffa28b80-3e964754 has messages 1
2025-09-30T14:51:01.965839Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.965843Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 282, partNo: 0, Offset: 281 is stored on disk
2025-09-30T14:51:01.965845Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.965850Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 283, partNo: 0, Offset: 282 is stored on disk
2025-09-30T14:51:01.965852Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.965856Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 284, partNo: 0, Offset: 283 is stored on disk
2025-09-30T14:51:01.965858Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.965858Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# d84fa63f-e1bafd57-ffa28b80-3e964754, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 92026
2025-09-30T14:51:01.965862Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 285, partNo: 0, Offset: 284 is stored on disk
2025-09-30T14:51:01.965863Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# d84fa63f-e1bafd57-ffa28b80-3e964754
2025-09-30T14:51:01.965864Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.965868Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 286, partNo: 0, Offset: 285 is stored on disk
2025-09-30T14:51:01.965871Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.965885Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 287, partNo: 0, Offset: 286 is stored on disk
2025-09-30T14:51:01.965908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.965918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.965922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (5)
2025-09-30T14:51:01.965940Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 288 partNo 0
2025-09-30T14:51:01.965963Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.965990Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 288 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 31729 count 1 nextOffset 288 batches 1
2025-09-30T14:51:01.965997Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 289 partNo 0
2025-09-30T14:51:01.966002Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 289 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 63536 count 2 nextOffset 289 batches 1
2025-09-30T14:51:01.966007Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 290 partNo 0
2025-09-30T14:51:01.966011Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 290 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 95453 count 3 nextOffset 290 batches 1
2025-09-30T14:51:01.966015Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 291 partNo 0
2025-09-30T14:51:01.966018Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 291 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 127480 count 4 nextOffset 291 batches 1
2025-09-30T14:51:01.966021Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 292 partNo 0
2025-09-30T14:51:01.966024Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 292 partNo 0 FormedBlobsCount 0 NewHead: Offset 287 PartNo 0 PackedSize 159617 count 5 nextOffset 292 batches 1
2025-09-30T14:51:01.966027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.966145Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 287,5 HeadOffset 287 endOffset 287 curOffset 292 d0000000000_00000000000000000287_00000_0000000005_00000? size 159526 WTime 1759243861965
2025-09-30T14:51:01.966199Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.966201Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.966206Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.966208Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.966210Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.966213Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.966215Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.966217Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.966219Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.966222Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.966224Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.966228Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.966231Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.966233Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.966235Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.966237Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.966239Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.966243Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.966245Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.966247Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.966250Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.966252Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.966255Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000218_00000_0000000003_00000?
2025-09-30T14:51:01.966257Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000221_00000_0000000007_00000?
2025-09-30T14:51:01.966259Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000228_00000_0000000001_00000?
2025-09-30T14:51:01.966262Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000229_00000_0000000006_00000?
2025-09-30T14:51:01.966263Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000235_00000_0000000001_00000?
2025-09-30T14:51:01.966265Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000236_00000_0000000001_00000?
2025-09-30T14:51:01.966268Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000237_00000_0000000017_00000?
2025-09-30T14:51:01.966270Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000254_00000_0000000015_00000?
2025-09-30T14:51:01.966272Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000269_00000_0000000007_00000?
2025-09-30T14:51:01.966274Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000276_00000_0000000004_00000?
2025-09-30T14:51:01.966276Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000280_00000_0000000007_00000?
2025-09-30T14:51:01.966279Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 33 keys were taken away. Let's read 4544322 bytes (4544322)
2025-09-30T14:51:01.966282Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 33, size 4544322 (8388608)
2025-09-30T14:51:01.966295Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 561  requestId: <none> cookie: 281
2025-09-30T14:51:01.966316Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 566  requestId: <none> cookie: 282
2025-09-30T14:51:01.966322Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 567  requestId: <none> cookie: 283
2025-09-30T14:51:01.966328Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 568  requestId: <none> cookie: 284
2025-09-30T14:51:01.966331Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.966338Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 569  requestId: <none> cookie: 285
2025-09-30T14:51:01.966339Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.966343Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.966343Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 572  requestId: <none> cookie: 286
2025-09-30T14:51:01.966347Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.966349Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 573  requestId: <none> cookie: 287
2025-09-30T14:51:01.966355Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.966356Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.966360Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.966365Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.966368Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 287 partNo 0 count 5 size 159526
2025-09-30T14:51:01.966447Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 280 EndOffset 280 newEndOffset 287 commitOffset 0 clientCommitOffset 0 cookie 27 readingFinished 0 firstRead 0
2025-09-30T14:51:01.966450Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 280 endOffset 287
2025-09-30T14:51:01.966459Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 280, endOffset# 287, WTime# 1759243861961, sizeLag# 218678
2025-09-30T14:51:01.966461Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.966470Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# c05ec9f3-da2fe612-f4b3ad35-b0c210dd, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 8, size# 191802, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.966481Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 8 maxSize 191802 maxTimeLagMs 0 readTimestampMs 0 readOffset 280 EndOffset 287 ClientCommitOffset 0 committedOffset 0 Guid c05ec9f3-da2fe612-f4b3ad35-b0c210dd
2025-09-30T14:51:01.966505Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.966509Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.966527Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 33 Topic 'rt3.dc1--test-topic' partition 0 user user offset 280 count 8 size 191802 endOffset 287 max time lag 0ms effective offset 280
2025-09-30T14:51:01.966542Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 33 added 1 blobs, size 218678 count 7 last offset 280, current partition end offset: 287
2025-09-30T14:51:01.966545Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 33. Send blob request.
2025-09-30T14:51:01.966554Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 280 partno 0 count 7 parts_count 0 source 1 size 218678 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.966558Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 33. All 1 blobs are from cache.
2025-09-30T14:51:01.966566Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.966570Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 280 partno 0 count 7 parts 0 suffix '63'
2025-09-30T14:51:01.966665Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 280 totakecount 7 count 7 size 218655 from pos 0 cbcount 7
2025-09-30T14:51:01.966697Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 280
2025-09-30T14:51:01.966804Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 287 Result { Offset: 280 Data: "... 30885 bytes ..." SourceId: "\000src_id" SeqNo: 281 WriteTimestampMS: 1759243861963 CreateTimestampMS: 1759243861958 UncompressedSize: 30811 PartitionKey: "" ExplicitHash: "" } Result { Offset: 281 Data: "... 30995 bytes ..." SourceId: "\000src_id" SeqNo: 282 WriteTimestampMS: 1759243861963 CreateTimestampMS: 1759243861962 UncompressedSize: 30921 PartitionKey: "" ExplicitHash: "" } Result { Offset: 282 Data: "... 31105 bytes ..." SourceId: "\000src_id" SeqNo: 283 WriteTimestampMS: 1759243861963 CreateTimestampMS: 1759243861962 UncompressedSize: 31031 PartitionKey: "" ExplicitHash: "" } Result { Offset: 283 Data: "... 31215 bytes ..." SourceId: "\000src_id" SeqNo: 284 WriteTimestampMS: 1759243861963 CreateTimestampMS: 1759243861962 UncompressedSize: 31141 PartitionKey: "" ExplicitHash: "" } Result { Offset: 284 Data: "... 31325 bytes ..." SourceId: "\000src_id" SeqNo: 285 WriteTimestampMS: 1759243861963 CreateTimestampMS: 1759243861962 UncompressedSize: 31251 PartitionKey: "" ExplicitHash: "" } Result { Offset: 285 Data: "... 31435 bytes ..." SourceId: "\000src_id" SeqNo: 286 WriteTimestampMS: 1759243861963 CreateTimestampMS: 1759243861962 UncompressedSize: 31361 PartitionKey: "" ExplicitHash: "" } Result { Offset: 286 Data: "... 31545 bytes ..." SourceId: "\000src_id" SeqNo: 287 WriteTimestampMS: 1759243861963 CreateTimestampMS: 1759243861962 UncompressedSize: 31471 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551495 RealReadOffset: 286 WaitQuotaTimeMs: 0 EndOffset: 287 StartOffset: 0 } Cookie: 280 }
2025-09-30T14:51:01.966862Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 28 from offset 287
2025-09-30T14:51:01.966868Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 287 ReadOffset 287 ReadGuid c05ec9f3-da2fe612-f4b3ad35-b0c210dd has messages 1
2025-09-30T14:51:01.966899Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# c05ec9f3-da2fe612-f4b3ad35-b0c210dd, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 218400
2025-09-30T14:51:01.966907Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# c05ec9f3-da2fe612-f4b3ad35-b0c210dd
2025-09-30T14:51:01.966965Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.967082Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.967113Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 240460 } }
2025-09-30T14:51:01.967128Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.967132Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 3358ed26-f1e1c913-50504d14-85c28e66
2025-09-30T14:51:01.967221Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.967275Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.967287Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.967293Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967304Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967306Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967313Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.967318Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.967318Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 584  requestId: <none> cookie: 293
2025-09-30T14:51:01.967324Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 585  requestId: <none> cookie: 294
2025-09-30T14:51:01.967327Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967329Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967335Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 586  requestId: <none> cookie: 295
2025-09-30T14:51:01.967346Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.967353Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.967358Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.967365Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.967371Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.967377Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967382Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967392Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 293 partNo : 0 messageNo: 587 size 32205 offset: -1
2025-09-30T14:51:01.967397Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967399Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967404Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.967404Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 294 partNo : 0 messageNo: 588 size 32315 offset: -1
2025-09-30T14:51:01.967408Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967410Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.967410Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967414Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 295 partNo : 0 messageNo: 589 size 32425 offset: -1
2025-09-30T14:51:01.967419Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.967426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.967429Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.967431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.967434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967434Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.967436Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967440Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967441Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967444Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.967446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.967451Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967452Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967457Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 590  requestId: <none> cookie: 296
2025-09-30T14:51:01.967462Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 591  requestId: <none> cookie: 297
2025-09-30T14:51:01.967462Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.967465Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 592  requestId: <none> cookie: 298
2025-09-30T14:51:01.967468Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.967474Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.967478Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.967480Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967482Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967486Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 296 partNo : 0 messageNo: 593 size 32535 offset: -1
2025-09-30T14:51:01.967491Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967492Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967496Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 297 partNo : 0 messageNo: 594 size 32645 offset: -1
2025-09-30T14:51:01.967499Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.967502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.967504Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.967506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.967520Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.967523Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967525Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967531Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 298 partNo : 0 messageNo: 595 size 32755 offset: -1
2025-09-30T14:51:01.967534Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967536Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967540Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.967542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.967544Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:01.967546Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 596  requestId: <none> cookie: 299
2025-09-30T14:51:01.967601Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.967615Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:01.967635Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967639Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967650Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 299 partNo : 0 messageNo: 597 size 32865 offset: -1
2025-09-30T14:51:01.967654Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967656Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967661Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.967669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.967677Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 598  requestId: <none> cookie: 300
2025-09-30T14:51:01.967689Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.967698Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.967699Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.967706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 300 partNo : 0 messageNo: 599 size 32975 offset: -1
2025-09-30T14:51:01.967708Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:01.967712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:51:01.967776Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 287 count 5 size 159526 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.967787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.967801Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 159410 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.967808Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.967800Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 287 partno 0 count 5 parts 0 suffix '63' size 159526
2025-09-30T14:51:01.967815Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 288, partNo: 0, Offset: 287 is stored on disk
2025-09-30T14:51:01.967819Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.967829Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 289, partNo: 0, Offset: 288 is stored on disk
2025-09-30T14:51:01.967831Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.967834Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 290, partNo: 0, Offset: 289 is stored on disk
2025-09-30T14:51:01.967836Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.967839Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 291, partNo: 0, Offset: 290 is stored on disk
2025-09-30T14:51:01.967845Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.967848Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 292, partNo: 0, Offset: 291 is stored on disk
2025-09-30T14:51:01.967878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.967887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.967890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (8)
2025-09-30T14:51:01.967901Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 287 EndOffset 287 newEndOffset 292 commitOffset 0 clientCommitOffset 0 cookie 28 readingFinished 0 firstRead 0
2025-09-30T14:51:01.967905Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 287 endOffset 292
2025-09-30T14:51:01.967906Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 293 partNo 0
2025-09-30T14:51:01.967914Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 287, endOffset# 292, WTime# 1759243861963, sizeLag# 159526
2025-09-30T14:51:01.967920Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.967928Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# 8c099a8-fc354400-d8733c95-5850678a, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 6, size# 191431, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.967930Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 293 partNo 0 FormedBlobsCount 0 NewHead: Offset 292 PartNo 0 PackedSize 32279 count 1 nextOffset 293 batches 1
2025-09-30T14:51:01.967937Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 294 partNo 0
2025-09-30T14:51:01.967939Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 6 maxSize 191431 maxTimeLagMs 0 readTimestampMs 0 readOffset 287 EndOffset 292 ClientCommitOffset 0 committedOffset 0 Guid 8c099a8-fc354400-d8733c95-5850678a
2025-09-30T14:51:01.967941Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 294 partNo 0 FormedBlobsCount 0 NewHead: Offset 292 PartNo 0 PackedSize 64636 count 2 nextOffset 294 batches 1
2025-09-30T14:51:01.967945Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 295 partNo 0
2025-09-30T14:51:01.967949Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 295 partNo 0 FormedBlobsCount 0 NewHead: Offset 292 PartNo 0 PackedSize 97103 count 3 nextOffset 295 batches 1
2025-09-30T14:51:01.967952Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 296 partNo 0
2025-09-30T14:51:01.967956Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 296 partNo 0 FormedBlobsCount 0 NewHead: Offset 292 PartNo 0 PackedSize 129680 count 4 nextOffset 296 batches 1
2025-09-30T14:51:01.967959Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 297 partNo 0
2025-09-30T14:51:01.967962Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 297 partNo 0 FormedBlobsCount 0 NewHead: Offset 292 PartNo 0 PackedSize 162367 count 5 nextOffset 297 batches 1
2025-09-30T14:51:01.967964Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 298 partNo 0
2025-09-30T14:51:01.967969Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 298 partNo 0 FormedBlobsCount 0 NewHead: Offset 292 PartNo 0 PackedSize 195164 count 6 nextOffset 298 batches 1
2025-09-30T14:51:01.967972Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 299 partNo 0
2025-09-30T14:51:01.967975Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 299 partNo 0 FormedBlobsCount 0 NewHead: Offset 292 PartNo 0 PackedSize 228071 count 7 nextOffset 299 batches 1
2025-09-30T14:51:01.967977Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 300 partNo 0
2025-09-30T14:51:01.967981Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 300 partNo 0 FormedBlobsCount 0 NewHead: Offset 292 PartNo 0 PackedSize 261088 count 8 nextOffset 300 batches 1
2025-09-30T14:51:01.967983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.968099Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 292,8 HeadOffset 292 endOffset 292 curOffset 300 d0000000000_00000000000000000292_00000_0000000008_00000? size 260904 WTime 1759243861967
2025-09-30T14:51:01.968199Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.968200Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.968202Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.968204Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.968206Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.968212Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.968214Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.968215Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.968217Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.968219Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.968221Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.968222Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.968224Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.968226Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.968227Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.968229Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.968231Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.968233Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.968235Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.968237Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.968247Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.968248Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.968250Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000218_00000_0000000003_00000?
2025-09-30T14:51:01.968255Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000221_00000_0000000007_00000?
2025-09-30T14:51:01.968257Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000228_00000_0000000001_00000?
2025-09-30T14:51:01.968259Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000229_00000_0000000006_00000?
2025-09-30T14:51:01.968260Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000235_00000_0000000001_00000?
2025-09-30T14:51:01.968262Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000236_00000_0000000001_00000?
2025-09-30T14:51:01.968263Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000237_00000_0000000017_00000?
2025-09-30T14:51:01.968264Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000254_00000_0000000015_00000?
2025-09-30T14:51:01.968266Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000269_00000_0000000007_00000?
2025-09-30T14:51:01.968268Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000276_00000_0000000004_00000?
2025-09-30T14:51:01.968269Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000280_00000_0000000007_00000?
2025-09-30T14:51:01.968270Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000287_00000_0000000005_00000?
2025-09-30T14:51:01.968272Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 34 keys were taken away. Let's read 4703848 bytes (4703848)
2025-09-30T14:51:01.968275Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 34, size 4703848 (8388608)
2025-09-30T14:51:01.968288Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 576  requestId: <none> cookie: 288
2025-09-30T14:51:01.968306Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 580  requestId: <none> cookie: 289
2025-09-30T14:51:01.968311Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 581  requestId: <none> cookie: 290
2025-09-30T14:51:01.968315Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 582  requestId: <none> cookie: 291
2025-09-30T14:51:01.968319Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 583  requestId: <none> cookie: 292
2025-09-30T14:51:01.968330Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.968333Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.968334Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.968341Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:01.968345Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.968351Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.968352Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 292 partNo 0 count 8 size 260904
2025-09-30T14:51:01.968355Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.968359Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.968418Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 34 Topic 'rt3.dc1--test-topic' partition 0 user user offset 287 count 6 size 191431 endOffset 292 max time lag 0ms effective offset 287
2025-09-30T14:51:01.968428Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 34 added 1 blobs, size 159526 count 5 last offset 287, current partition end offset: 292
2025-09-30T14:51:01.968431Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 34. Send blob request.
2025-09-30T14:51:01.968438Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 287 partno 0 count 5 parts_count 0 source 1 size 159526 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.968442Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 34. All 1 blobs are from cache.
2025-09-30T14:51:01.968450Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.968498Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 287 partno 0 count 5 parts 0 suffix '63'
2025-09-30T14:51:01.968509Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 287 totakecount 5 count 5 size 159503 from pos 0 cbcount 5
2025-09-30T14:51:01.968548Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 287
2025-09-30T14:51:01.968627Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 292 Result { Offset: 287 Data: "... 31655 bytes ..." SourceId: "\000src_id" SeqNo: 288 WriteTimestampMS: 1759243861965 CreateTimestampMS: 1759243861962 UncompressedSize: 31581 PartitionKey: "" ExplicitHash: "" } Result { Offset: 288 Data: "... 31765 bytes ..." SourceId: "\000src_id" SeqNo: 289 WriteTimestampMS: 1759243861965 CreateTimestampMS: 1759243861962 UncompressedSize: 31691 PartitionKey: "" ExplicitHash: "" } Result { Offset: 289 Data: "... 31875 bytes ..." SourceId: "\000src_id" SeqNo: 290 WriteTimestampMS: 1759243861965 CreateTimestampMS: 1759243861963 UncompressedSize: 31801 PartitionKey: "" ExplicitHash: "" } Result { Offset: 290 Data: "... 31985 bytes ..." SourceId: "\000src_id" SeqNo: 291 WriteTimestampMS: 1759243861965 CreateTimestampMS: 1759243861963 UncompressedSize: 31911 PartitionKey: "" ExplicitHash: "" } Result { Offset: 291 Data: "... 32095 bytes ..." SourceId: "\000src_id" SeqNo: 292 WriteTimestampMS: 1759243861965 CreateTimestampMS: 1759243861963 UncompressedSize: 32021 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551557 RealReadOffset: 291 WaitQuotaTimeMs: 0 EndOffset: 292 StartOffset: 0 } Cookie: 287 }
2025-09-30T14:51:01.968676Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 29 from offset 292
2025-09-30T14:51:01.968681Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 292 ReadOffset 292 ReadGuid 8c099a8-fc354400-d8733c95-5850678a has messages 1
2025-09-30T14:51:01.968703Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# 8c099a8-fc354400-d8733c95-5850678a, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 159338
2025-09-30T14:51:01.968709Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# 8c099a8-fc354400-d8733c95-5850678a
2025-09-30T14:51:01.968926Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.969857Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 292 count 8 size 260904 actorID [3:7555894845423792914:2463]
2025-09-30T14:51:01.969872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:01.969882Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 292 partno 0 count 8 parts 0 suffix '63' size 260904
2025-09-30T14:51:01.969885Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 260776 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:01.969893Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.969900Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 293, partNo: 0, Offset: 292 is stored on disk
2025-09-30T14:51:01.969912Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.969915Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 294, partNo: 0, Offset: 293 is stored on disk
2025-09-30T14:51:01.969917Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.969920Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 295, partNo: 0, Offset: 294 is stored on disk
2025-09-30T14:51:01.969922Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.969924Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 296, partNo: 0, Offset: 295 is stored on disk
2025-09-30T14:51:01.969927Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.969932Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 297, partNo: 0, Offset: 296 is stored on disk
2025-09-30T14:51:01.969934Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.969945Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 298, partNo: 0, Offset: 297 is stored on disk
2025-09-30T14:51:01.969948Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.969951Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 299, partNo: 0, Offset: 298 is stored on disk
2025-09-30T14:51:01.969953Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:01.969956Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 300, partNo: 0, Offset: 299 is stored on disk
2025-09-30T14:51:01.969993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.969995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.970001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.970005Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1312: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait for data done:  readOffset 292 EndOffset 292 newEndOffset 300 commitOffset 0 clientCommitOffset 0 cookie 29 readingFinished 0 firstRead 0
2025-09-30T14:51:01.970008Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:01.970009Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:969: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) ready for read with readOffset 292 endOffset 300
2025-09-30T14:51:01.970010Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000024_00000?
2025-09-30T14:51:01.970011Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000025_00000_0000000007_00000?
2025-09-30T14:51:01.970013Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000032_00000_0000000001_00000?
2025-09-30T14:51:01.970015Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000033_00000_0000000001_00000?
2025-09-30T14:51:01.970016Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000034_00000_0000000031_00000?
2025-09-30T14:51:01.970018Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000065_00000_0000000045_00000?
2025-09-30T14:51:01.970019Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000110_00000_0000000025_00000?
2025-09-30T14:51:01.970021Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2332: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 partition ready for read: partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), readOffset# 292, endOffset# 300, WTime# 1759243861965, sizeLag# 260904
2025-09-30T14:51:01.970021Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000135_00000_0000000007_00000?
2025-09-30T14:51:01.970023Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000142_00000_0000000009_00000?
2025-09-30T14:51:01.970024Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2343: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1TEvPartitionReady. Aval parts: 1
2025-09-30T14:51:01.970024Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000151_00000_0000000001_00000?
2025-09-30T14:51:01.970026Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000152_00000_0000000008_00000?
2025-09-30T14:51:01.970028Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000160_00000_0000000001_00000?
2025-09-30T14:51:01.970029Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000161_00000_0000000014_00000?
2025-09-30T14:51:01.970032Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000175_00000_0000000001_00000?
2025-09-30T14:51:01.970033Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2266: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 performing read request: guid# ed6899e2-9207afa1-d61cc8c8-f4440ea6, from# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), count# 9, size# 54524, partitionsAsked# 1, maxTimeLag# 0ms
2025-09-30T14:51:01.970034Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000176_00000_0000000009_00000?
2025-09-30T14:51:01.970035Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000185_00000_0000000001_00000?
2025-09-30T14:51:01.970036Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000186_00000_0000000008_00000?
2025-09-30T14:51:01.970041Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000194_00000_0000000007_00000?
2025-09-30T14:51:01.970042Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1395: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 READ FROM TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1)maxCount 9 maxSize 54524 maxTimeLagMs 0 readTimestampMs 0 readOffset 292 EndOffset 300 ClientCommitOffset 0 committedOffset 0 Guid ed6899e2-9207afa1-d61cc8c8-f4440ea6
2025-09-30T14:51:01.970042Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000201_00000_0000000005_00000?
2025-09-30T14:51:01.970044Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000206_00000_0000000001_00000?
2025-09-30T14:51:01.970046Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000207_00000_0000000011_00000?
2025-09-30T14:51:01.970047Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000218_00000_0000000003_00000?
2025-09-30T14:51:01.970049Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000221_00000_0000000007_00000?
2025-09-30T14:51:01.970050Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000228_00000_0000000001_00000?
2025-09-30T14:51:01.970052Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000229_00000_0000000006_00000?
2025-09-30T14:51:01.970053Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000235_00000_0000000001_00000?
2025-09-30T14:51:01.970055Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000236_00000_0000000001_00000?
2025-09-30T14:51:01.970056Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000237_00000_0000000017_00000?
2025-09-30T14:51:01.970060Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000254_00000_0000000015_00000?
2025-09-30T14:51:01.970062Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000269_00000_0000000007_00000?
2025-09-30T14:51:01.970064Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000276_00000_0000000004_00000?
2025-09-30T14:51:01.970065Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000280_00000_0000000007_00000?
2025-09-30T14:51:01.970066Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000287_00000_0000000005_00000?
2025-09-30T14:51:01.970068Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000292_00000_0000000008_00000?
2025-09-30T14:51:01.970070Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 35 keys were taken away. Let's read 4964752 bytes (4964752)
2025-09-30T14:51:01.970073Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 35, size 4964752 (8388608)
2025-09-30T14:51:01.970080Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 587  requestId: <none> cookie: 293
2025-09-30T14:51:01.970090Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 588  requestId: <none> cookie: 294
2025-09-30T14:51:01.970094Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 589  requestId: <none> cookie: 295
2025-09-30T14:51:01.970097Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 593  requestId: <none> cookie: 296
2025-09-30T14:51:01.970099Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.970101Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 594  requestId: <none> cookie: 297
2025-09-30T14:51:01.970105Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 595  requestId: <none> cookie: 298
2025-09-30T14:51:01.970106Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.970109Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 597  requestId: <none> cookie: 299
2025-09-30T14:51:01.970111Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.970113Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 599  requestId: <none> cookie: 300
2025-09-30T14:51:01.970115Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.970122Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.970122Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:01.970125Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:01.970126Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.970131Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.970135Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:01.970141Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 35 Topic 'rt3.dc1--test-topic' partition 0 user user offset 292 count 9 size 54524 endOffset 300 max time lag 0ms effective offset 292
2025-09-30T14:51:01.970151Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 35 added 1 blobs, size 260904 count 8 last offset 292, current partition end offset: 300
2025-09-30T14:51:01.970153Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 35. Send blob request.
2025-09-30T14:51:01.970162Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 292 partno 0 count 8 parts_count 0 source 1 size 260904 accessed 0 times before, last time 2025-09-30T14:51:01.000000Z
2025-09-30T14:51:01.970169Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 35. All 1 blobs are from cache.
2025-09-30T14:51:01.970177Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:51:01.970182Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 292 partno 0 count 8 parts 0 suffix '63'
2025-09-30T14:51:01.970280Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 292 totakecount 8 count 8 size 260881 from pos 0 cbcount 8
2025-09-30T14:51:01.970306Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 292
2025-09-30T14:51:01.970422Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:663: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) initDone 1 event { CmdReadResult { MaxOffset: 300 Result { Offset: 292 Data: "... 32205 bytes ..." SourceId: "\000src_id" SeqNo: 293 WriteTimestampMS: 1759243861967 CreateTimestampMS: 1759243861963 UncompressedSize: 32131 PartitionKey: "" ExplicitHash: "" } Result { Offset: 293 Data: "... 32315 bytes ..." SourceId: "\000src_id" SeqNo: 294 WriteTimestampMS: 1759243861967 CreateTimestampMS: 1759243861965 UncompressedSize: 32241 PartitionKey: "" ExplicitHash: "" } Result { Offset: 294 Data: "... 32425 bytes ..." SourceId: "\000src_id" SeqNo: 295 WriteTimestampMS: 1759243861967 CreateTimestampMS: 1759243861965 UncompressedSize: 32351 PartitionKey: "" ExplicitHash: "" } Result { Offset: 295 Data: "... 32535 bytes ..." SourceId: "\000src_id" SeqNo: 296 WriteTimestampMS: 1759243861967 CreateTimestampMS: 1759243861966 UncompressedSize: 32461 PartitionKey: "" ExplicitHash: "" } Result { Offset: 296 Data: "... 32645 bytes ..." SourceId: "\000src_id" SeqNo: 297 WriteTimestampMS: 1759243861967 CreateTimestampMS: 1759243861966 UncompressedSize: 32571 PartitionKey: "" ExplicitHash: "" } Result { Offset: 297 Data: "... 32755 bytes ..." SourceId: "\000src_id" SeqNo: 298 WriteTimestampMS: 1759243861967 CreateTimestampMS: 1759243861966 UncompressedSize: 32681 PartitionKey: "" ExplicitHash: "" } Result { Offset: 298 Data: "... 32865 bytes ..." SourceId: "\000src_id" SeqNo: 299 WriteTimestampMS: 1759243861967 CreateTimestampMS: 1759243861966 UncompressedSize: 32791 PartitionKey: "" ExplicitHash: "" } Result { Offset: 299 Data: "... 32975 bytes ..." SourceId: "\000src_id" SeqNo: 300 WriteTimestampMS: 1759243861967 CreateTimestampMS: 1759243861966 UncompressedSize: 32901 PartitionKey: "" ExplicitHash: "" } BlobsFromDisk: 0 BlobsFromCache: 1 SizeLag: 18446744073709551464 RealReadOffset: 299 WaitQuotaTimeMs: 0 EndOffset: 300 StartOffset: 0 } Cookie: 292 }
2025-09-30T14:51:01.970514Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:1277: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) wait data in partition inited, cookie 30 from offset 300
2025-09-30T14:51:01.970519Z node 3 :PQ_READ_PROXY DEBUG: partition_actor.cpp:901: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 after read state TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1) EndOffset 300 ReadOffset 300 ReadGuid ed6899e2-9207afa1-d61cc8c8-f4440ea6 has messages 1
2025-09-30T14:51:01.970533Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1940: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 read done: guid# ed6899e2-9207afa1-d61cc8c8-f4440ea6, partition# TopicId: Topic rt3.dc1--test-topic in dc dc1 in database: Root, partition 0(assignId:1), size# 260581
2025-09-30T14:51:01.970546Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2102: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 response to read: guid# ed6899e2-9207afa1-d61cc8c8-f4440ea6
2025-09-30T14:51:01.970737Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:2145: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 Process answer. Aval parts: 0
2025-09-30T14:51:01.971578Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 92026 } }
2025-09-30T14:51:01.971631Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 610a0b10-2d3e096e-c801ff0f-889dc5f4
2025-09-30T14:51:01.971889Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 218400 } }
2025-09-30T14:51:01.971944Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# ed331de5-159ab8d2-9e9f3112-80534b7d
2025-09-30T14:51:01.972182Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 159338 } }
2025-09-30T14:51:01.972222Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 99d7dc78-4e437844-97754b9b-7776ac14
2025-09-30T14:51:01.974722Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 1, data# { read_request { bytes_size: 260581 } }
2025-09-30T14:51:01.974785Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:1839: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 got read request: guid# 1976583d-21149330-bc8d88af-5186f3d9
2025-09-30T14:51:01.975690Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 2 consumer shared/user session shared/user_3_2_2210329730288990884_v1 grpc read done: success# 0, data# {  }
2025-09-30T14:51:01.975695Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 2 consumer shared/user session shared/user_3_2_2210329730288990884_v1 grpc read failed
2025-09-30T14:51:01.975702Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 2 consumer shared/user session shared/user_3_2_2210329730288990884_v1 grpc closed
2025-09-30T14:51:01.975708Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 2 consumer shared/user session shared/user_3_2_2210329730288990884_v1 is DEAD
2025-09-30T14:51:01.977701Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read done: success# 0, data# {  }
2025-09-30T14:51:01.977706Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc read failed
2025-09-30T14:51:01.977711Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 grpc closed
2025-09-30T14:51:01.977729Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 3 consumer shared/user session shared/user_3_3_3107435870535710504_v1 is DEAD
2025-09-30T14:51:01.977930Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2254: [PQ: 72075186224037892] Destroy direct read session shared/user_3_3_3107435870535710504_v1
2025-09-30T14:51:01.977940Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7555894849718760566:2533] destroyed
2025-09-30T14:51:01.977971Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:139: Direct read cache: server session deregistered: shared/user_3_3_3107435870535710504_v1
2025-09-30T14:51:01.978138Z node 3 :PQ_READ_PROXY DEBUG: read_session_actor.cpp:122: session cookie 1 consumer shared/user session shared/user_3_1_13398544198722215142_v1 grpc read done: success# 0, data# {  }
2025-09-30T14:51:01.978141Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:125: session cookie 1 consumer shared/user session shared/user_3_1_13398544198722215142_v1 grpc read failed
2025-09-30T14:51:01.978144Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:92: session cookie 1 consumer shared/user session shared/user_3_1_13398544198722215142_v1 grpc closed
2025-09-30T14:51:01.978147Z node 3 :PQ_READ_PROXY INFO: read_session_actor.cpp:383: session cookie 1 consumer shared/user session shared/user_3_1_13398544198722215142_v1 is DEAD
2025-09-30T14:51:01.978194Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read done: success: 0 data: 
2025-09-30T14:51:01.978199Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc read failed
2025-09-30T14:51:01.978206Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 grpc closed
2025-09-30T14:51:01.978213Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|19efaaa7-86563d97-33872e1-808c28ef_0 is DEAD
2025-09-30T14:51:01.978540Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:51:01.978584Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7555894849718760599:2522] destroyed
2025-09-30T14:51:01.978607Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:51:01.978616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.978619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.978621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.000565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.000583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.000586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.100937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.100958Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.100961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.201299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.201317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.201321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.301612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.301637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.301641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:12.395063Z :WriteSessionCloseWaitsForWrites INFO: Random seed for debugging is 1759243812395055
2025-09-30T14:50:12.491970Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7555894638730761519:2154];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:12.492007Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:12.501539Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:12.502653Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7555894639743212905:2162];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:12.502779Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/00261e/r3tmp/tmp0CY36K/pdisk_1.dat
2025-09-30T14:50:12.504783Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:12.545720Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:12.546681Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:12.560153Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 3795, node 1
2025-09-30T14:50:12.574504Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/00261e/r3tmp/yandexvrZhz4.tmp
2025-09-30T14:50:12.574517Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/00261e/r3tmp/yandexvrZhz4.tmp
2025-09-30T14:50:12.574592Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/00261e/r3tmp/yandexvrZhz4.tmp
2025-09-30T14:50:12.574637Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:12.581756Z INFO: TTestServer started on Port 3936 GrpcPort 3795
2025-09-30T14:50:12.593740Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:12.593791Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
TClient is connected to server localhost:3936
2025-09-30T14:50:12.595967Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
PQClient connected to localhost:3795
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: 2025-09-30T14:50:12.604530Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:12.604573Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:12.611184Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-09-30T14:50:12.615588Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-09-30T14:50:12.615712Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:50:12.750722Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:12.767338Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:12.955003Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894638730762379:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.955055Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894638730762350:2324], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.955094Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.955234Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894638730762384:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.955275Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.955873Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894638730762411:2332], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.955896Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.956309Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:12.956555Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894638730762415:2333], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.956580Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.961723Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7555894638730762383:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-09-30T14:50:13.004962Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7555894639743213135:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:13.005078Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=YjRmYmU1NzktOTAwZDQwODAtNDA0YjE0NTItODc4NTFiNWM=, ActorId: [2:7555894639743213094:2294], ActorState: ExecuteState, TraceId: 01k6dhmg3cdbp0vqrb4txz6cx8, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:13.005451Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:13.005736Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:13.023256Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7555894643025729833:2724] txid# 281474976720663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:13.028850Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7555894643025729860:2342], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:13.028949Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=NzRkNjAyMGUtMTNmYTA4MjMtZTE0NDliNTgtMjRlYzk0ODc=, ActorId: [1:7555894638730762347:2322], ActorState: ExecuteState, TraceId: 01k6dhmg2tctys820n83geyzdn, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:13.029145Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:13.033766Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:13.058300Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:3795", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:13.102727Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6dhmg6nd2gz0vpqrvn85gys, Database: , SessionId: ydb://session/3?node_id=1&id=YjQ2OTU3OTAtY2M1OTVlMGEtOGYyNTUyMWItNDlhNzkyNTI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7555894643025730167:2968] 
2025-09-30T14:50:13.493972Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:13.503690Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:17.492173Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7555894638730761519:2154];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:17.492217Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:17.502406Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7555894639743212905:2162];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:17.502449Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:50:18.272194Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:3795
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.293473Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:3795
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:18.301147Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7555894664500567172:3282] connected; active server actors: 1
2025-09-30T14:50:18.301294Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:50:18.301521Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:18.301836Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:50:18.305467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:18.306295Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:18.306361Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:18.306374Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:18.306387Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:18.306467Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894664500567171:3281], now have 1 active actors on pipe
2025-09-30T14:50:18.306476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894664500567190:2455], now have 1 active actors on pipe
2025-09-30T14:50:18.306551Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-09-30T14:50:18.306757Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.307913Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.310328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894664500567223:3323], now have 1 active actors on pipe
2025-09-30T14:50:18.310714Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.314926Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6dhmn9veq0cffgnn8wr8cw1, Database: , SessionId: ydb://session/3?node_id=1&id=NjczMWNiMzYtODYxMDk1ZDgtNWQ2YzI0ZjYtNGI3MDdiYTY=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-09-30T14:50:18.316539Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.316830Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:18.316866Z node 2 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:18.316929Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:18.316996Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894665513017468:2394]
2025-09-30T14:50:18.317753Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:18.317762Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:18.317765Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7555894665513017468:2394]
2025-09-30T14:50:18.317770Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:18.318020Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:18.318031Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.318059Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.318067Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.318071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:18.318073Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.318075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.318077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:18.318085Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:18.318206Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:18.318238Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:18.319630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.319687Z node 2 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243818353, TxId 281474976720679
2025-09-30T14:50:18.319700Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.319703Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.319743Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.319817Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.320535Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.320624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.320641Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.320648Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.320650Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.320657Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:18.320821Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:18.320852Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:18.320929Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-09-30T14:50:18.322403Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:18.322431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
TClient::Ls response: 2025-09-30T14:50:18.322940Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759243818353
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759243818353
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:3795
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.324126Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:18.415858Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.415873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.415876Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.516183Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.516202Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.516205Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.616521Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.616539Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.616542Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.716853Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.716869Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.716873Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.817223Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.817239Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.817243Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3795
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.825457Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:18.917678Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.917692Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.917695Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.017946Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.017961Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.017965Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.119606Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.119635Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.119638Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.220725Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.220753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.220757Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.320984Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.321000Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.321003Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:3795
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:19.327611Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:19.329049Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:19.329281Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:19.329288Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:3795
2025-09-30T14:50:19.329907Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:19.329924Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:19.331694Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:19.331928Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:19.331987Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:36872
2025-09-30T14:50:19.331992Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:36872 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:19.331997Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:19.332465Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:19.332508Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:19.332511Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:19.332513Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:19.332528Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894668795534700:2489] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:19.333157Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894668795534700:2489] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:19.375840Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7555894668795534700:2489] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:19.376217Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668795534732:2489] connected; active server actors: 1
2025-09-30T14:50:19.376342Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7555894668795534700:2489] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:50:19.376349Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894668795534700:2489] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:19.379718Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668795534732:2489] disconnected; active server actors: 1
2025-09-30T14:50:19.379736Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668795534732:2489] disconnected no session
2025-09-30T14:50:19.396138Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894668795534700:2489] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:19.396166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894668795534700:2489] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:19.396171Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894668795534700:2489] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:19.396181Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:19.396515Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894668795534754:2489], now have 1 active actors on pipe
2025-09-30T14:50:19.396574Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-09-30T14:50:19.396679Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.396695Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.396737Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|d123213c-1f6cf753-a54038c9-eaa23c4d_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:19.396753Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.396762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.396766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.396781Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.396798Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:19.396823Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.397035Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.397047Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.397184Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|d123213c-1f6cf753-a54038c9-eaa23c4d_0
2025-09-30T14:50:19.397064Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.399520Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243819399 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.399566Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|d123213c-1f6cf753-a54038c9-eaa23c4d_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:19.399695Z :INFO: [] MessageGroupId [src] SessionId [src|d123213c-1f6cf753-a54038c9-eaa23c4d_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:19.399707Z :INFO: [] MessageGroupId [src] SessionId [src|d123213c-1f6cf753-a54038c9-eaa23c4d_0] Write session will now close
2025-09-30T14:50:19.399714Z :DEBUG: [] MessageGroupId [src] SessionId [src|d123213c-1f6cf753-a54038c9-eaa23c4d_0] Write session: aborting
2025-09-30T14:50:19.399879Z :INFO: [] MessageGroupId [src] SessionId [src|d123213c-1f6cf753-a54038c9-eaa23c4d_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:19.399884Z :DEBUG: [] MessageGroupId [src] SessionId [src|d123213c-1f6cf753-a54038c9-eaa23c4d_0] Write session: destroy
2025-09-30T14:50:19.400061Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|d123213c-1f6cf753-a54038c9-eaa23c4d_0 grpc read done: success: 0 data: 
2025-09-30T14:50:19.400070Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|d123213c-1f6cf753-a54038c9-eaa23c4d_0 grpc read failed
2025-09-30T14:50:19.400077Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|d123213c-1f6cf753-a54038c9-eaa23c4d_0 grpc closed
2025-09-30T14:50:19.400084Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|d123213c-1f6cf753-a54038c9-eaa23c4d_0 is DEAD
2025-09-30T14:50:19.400306Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:19.401039Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894668795534754:2489] destroyed
2025-09-30T14:50:19.401062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:19.401071Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.401075Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.401077Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-09-30T14:50:19.421379Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.421398Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.421401Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:50:19.455033Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:3795" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:3795" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:3795" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-09-30T14:50:19.457461Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:50:19.457716Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-09-30T14:50:19.520181Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-09-30T14:50:19.520446Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:19.520472Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-09-30T14:50:19.521764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.521784Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.521786Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.522201Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.522394Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-09-30T14:50:19.522555Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:19.522625Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:47722
2025-09-30T14:50:19.522631Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:47722 proto=topic  topic=test-topic durationSec=0
2025-09-30T14:50:19.522636Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:19.523202Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-09-30T14:50:19.523259Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:19.523266Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:19.523269Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:19.523276Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894668795534771:2504] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:19.523889Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894668795534771:2504] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:19.529567Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7555894668795534771:2504] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:19.529702Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668795534790:2504] connected; active server actors: 1
2025-09-30T14:50:19.529724Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7555894668795534771:2504] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-09-30T14:50:19.529733Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894668795534771:2504] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:19.529799Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668795534790:2504] disconnected; active server actors: 1
2025-09-30T14:50:19.529807Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894668795534790:2504] disconnected no session
2025-09-30T14:50:19.533308Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894668795534771:2504] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:19.533323Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894668795534771:2504] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:19.533327Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894668795534771:2504] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:19.533343Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:19.533672Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894668795534806:2504], now have 1 active actors on pipe
2025-09-30T14:50:19.533719Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-09-30T14:50:19.533807Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.533824Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.533867Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|b7185918-d4952604-affa58eb-503a017f_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:19.533884Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.533890Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.533892Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.533907Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.533926Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:19.533961Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.534133Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.534140Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.534155Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:19.534296Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|b7185918-d4952604-affa58eb-503a017f_0
2025-09-30T14:50:19.534729Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:50:19.534756Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243819534 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:19.534797Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|b7185918-d4952604-affa58eb-503a017f_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-09-30T14:50:19.534880Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-09-30T14:50:19.534912Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 2 to 2
2025-09-30T14:50:19.534924Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 3 to 3
2025-09-30T14:50:19.534931Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 4 to 4
2025-09-30T14:50:19.534940Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 5 to 5
2025-09-30T14:50:19.534945Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 6 to 6
2025-09-30T14:50:19.534951Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 7 to 7
2025-09-30T14:50:19.534957Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 8 to 8
2025-09-30T14:50:19.534964Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 9 to 9
2025-09-30T14:50:19.534970Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 10 to 10
2025-09-30T14:50:19.534978Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 11 to 11
2025-09-30T14:50:19.534984Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 12 to 12
2025-09-30T14:50:19.534991Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 13 to 13
2025-09-30T14:50:19.534996Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 14 to 14
2025-09-30T14:50:19.535002Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 15 to 15
2025-09-30T14:50:19.535008Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 16 to 16
2025-09-30T14:50:19.535041Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 17 to 17
2025-09-30T14:50:19.535047Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 18 to 18
2025-09-30T14:50:19.535054Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 19 to 19
2025-09-30T14:50:19.535064Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 20 to 20
2025-09-30T14:50:19.535070Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 21 to 21
2025-09-30T14:50:19.535076Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 22 to 22
2025-09-30T14:50:19.535081Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 23 to 23
2025-09-30T14:50:19.535086Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 24 to 24
2025-09-30T14:50:19.535092Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 25 to 25
2025-09-30T14:50:19.535099Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 26 to 26
2025-09-30T14:50:19.535105Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 27 to 27
2025-09-30T14:50:19.535112Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 28 to 28
2025-09-30T14:50:19.535119Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 29 to 29
2025-09-30T14:50:19.535126Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 30 to 30
2025-09-30T14:50:19.535131Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 31 to 31
2025-09-30T14:50:19.535146Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 32 to 32
2025-09-30T14:50:19.535153Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 33 to 33
2025-09-30T14:50:19.535160Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 34 to 34
2025-09-30T14:50:19.535165Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 35 to 35
2025-09-30T14:50:19.535171Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 36 to 36
2025-09-30T14:50:19.535178Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 37 to 37
2025-09-30T14:50:19.535184Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 38 to 38
2025-09-30T14:50:19.535190Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 39 to 39
2025-09-30T14:50:19.535196Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 40 to 40
2025-09-30T14:50:19.535204Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 41 to 41
2025-09-30T14:50:19.535210Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 42 to 42
2025-09-30T14:50:19.535216Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 43 to 43
2025-09-30T14:50:19.535221Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 44 to 44
2025-09-30T14:50:19.535227Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 45 to 45
2025-09-30T14:50:19.535233Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 46 to 46
2025-09-30T14:50:19.535239Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 47 to 47
2025-09-30T14:50:19.535264Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 48 to 48
2025-09-30T14:50:19.535270Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 49 to 49
2025-09-30T14:50:19.535276Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 50 to 50
2025-09-30T14:50:19.535281Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 51 to 51
2025-09-30T14:50:19.535287Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 52 to 52
2025-09-30T14:50:19.535293Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 53 to 53
2025-09-30T14:50:19.535299Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 54 to 54
2025-09-30T14:50:19.535305Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 55 to 55
2025-09-30T14:50:19.535311Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 56 to 56
2025-09-30T14:50:19.535316Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 57 to 57
2025-09-30T14:50:19.535323Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 58 to 58
2025-09-30T14:50:19.535329Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 59 to 59
2025-09-30T14:50:19.535335Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 60 to 60
2025-09-30T14:50:19.535342Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 61 to 61
2025-09-30T14:50:19.535348Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 62 to 62
2025-09-30T14:50:19.535399Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:50:19.535411Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Send 19 message(s) (43 left), first sequence number is 1
2025-09-30T14:50:19.535648Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b7185918-d4952604-affa58eb-503a017f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:19.535812Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:19.535981Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.536081Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:50:19.536093Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Send 43 message(s) (0 left), first sequence number is 20
2025-09-30T14:50:19.536002Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.536029Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:19.536143Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:19.536318Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.536328Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.536401Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b7185918-d4952604-affa58eb-503a017f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:19.536436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-09-30T14:50:19.536445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-09-30T14:50:19.536450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-09-30T14:50:19.536454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 4 partNo : 0 messageNo: 1 size 98 offset: -1
2025-09-30T14:50:19.536458Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 5 partNo : 0 messageNo: 1 size 98 offset: -1
2025-09-30T14:50:19.536461Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 6 partNo : 0 messageNo: 1 size 98 offset: -1
2025-09-30T14:50:19.536465Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 7 partNo : 0 messageNo: 1 size 98 offset: -1
2025-09-30T14:50:19.536468Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 8 partNo : 0 messageNo: 1 size 98 offset: -1
2025-09-30T14:50:19.536472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 9 partNo : 0 messageNo: 1 size 98 offset: -1
2025-09-30T14:50:19.536476Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 10 partNo : 0 messageNo: 1 size 98 offset: -1
2025-09-30T14:50:19.536479Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 11 partNo : 0 messageNo: 1 size 99 offset: -1
2025-09-30T14:50:19.536483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 12 partNo : 0 messageNo: 1 size 99 offset: -1
2025-09-30T14:50:19.536486Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 13 partNo : 0 messageNo: 1 size 99 offset: -1
2025-09-30T14:50:19.536489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 14 partNo : 0 messageNo: 1 size 99 offset: -1
2025-09-30T14:50:19.536492Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 15 partNo : 0 messageNo: 1 size 99 offset: -1
2025-09-30T14:50:19.536500Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 16 partNo : 0 messageNo: 1 size 99 offset: -1
2025-09-30T14:50:19.536516Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 17 partNo : 0 messageNo: 1 size 99 offset: -1
2025-09-30T14:50:19.536519Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 18 partNo : 0 messageNo: 1 size 99 offset: -1
2025-09-30T14:50:19.536522Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 19 partNo : 0 messageNo: 1 size 99 offset: -1
2025-09-30T14:50:19.536538Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:19.536574Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.536571Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:19.536586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.536594Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (19)
2025-09-30T14:50:19.536627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-09-30T14:50:19.536647Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 63 to 63
2025-09-30T14:50:19.536682Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 172 count 1 nextOffset 1 batches 1
2025-09-30T14:50:19.536696Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-09-30T14:50:19.536701Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 312 count 2 nextOffset 2 batches 1
2025-09-30T14:50:19.536704Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-09-30T14:50:19.536708Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 452 count 3 nextOffset 3 batches 1
2025-09-30T14:50:19.536711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 4 partNo 0
2025-09-30T14:50:19.536715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 4 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 592 count 4 nextOffset 4 batches 1
2025-09-30T14:50:19.536718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 5 partNo 0
2025-09-30T14:50:19.536722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 5 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 732 count 5 nextOffset 5 batches 1
2025-09-30T14:50:19.536724Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 6 partNo 0
2025-09-30T14:50:19.536727Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 6 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 872 count 6 nextOffset 6 batches 1
2025-09-30T14:50:19.536730Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 7 partNo 0
2025-09-30T14:50:19.536734Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 7 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1012 count 7 nextOffset 7 batches 1
2025-09-30T14:50:19.536737Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 8 partNo 0
2025-09-30T14:50:19.536740Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 8 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1152 count 8 nextOffset 8 batches 1
2025-09-30T14:50:19.536743Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 9 partNo 0
2025-09-30T14:50:19.536749Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 9 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1292 count 9 nextOffset 9 batches 1
2025-09-30T14:50:19.536752Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 10 partNo 0
2025-09-30T14:50:19.536755Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 10 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1432 count 10 nextOffset 10 batches 1
2025-09-30T14:50:19.536758Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 11 partNo 0
2025-09-30T14:50:19.536762Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 11 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1573 count 11 nextOffset 11 batches 1
2025-09-30T14:50:19.536764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 12 partNo 0
2025-09-30T14:50:19.536768Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 12 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1714 count 12 nextOffset 12 batches 1
2025-09-30T14:50:19.536786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 13 partNo 0
2025-09-30T14:50:19.536789Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 13 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1855 count 13 nextOffset 13 batches 1
2025-09-30T14:50:19.536792Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 14 partNo 0
2025-09-30T14:50:19.536796Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 14 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 1996 count 14 nextOffset 14 batches 1
2025-09-30T14:50:19.536799Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 15 partNo 0
2025-09-30T14:50:19.536803Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 15 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2137 count 15 nextOffset 15 batches 1
2025-09-30T14:50:19.536807Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 16 partNo 0
2025-09-30T14:50:19.536810Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 16 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2278 count 16 nextOffset 16 batches 1
2025-09-30T14:50:19.536814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 17 partNo 0
2025-09-30T14:50:19.536819Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 17 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2419 count 17 nextOffset 17 batches 1
2025-09-30T14:50:19.536822Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 18 partNo 0
2025-09-30T14:50:19.536825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 18 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2560 count 18 nextOffset 18 batches 1
2025-09-30T14:50:19.536828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 19 partNo 0
2025-09-30T14:50:19.536831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 19 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 2701 count 19 nextOffset 19 batches 1
2025-09-30T14:50:19.536834Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.536903Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,19 HeadOffset 0 endOffset 0 curOffset 19 d0000000000_00000000000000000000_00000_0000000019_00000? size 2134 WTime 1759243819536
2025-09-30T14:50:19.536941Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.536947Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.536955Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:19.536970Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 19 size 2134
2025-09-30T14:50:19.537030Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-09-30T14:50:19.537126Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:19.537377Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.537388Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.537399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 20 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 21 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 22 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537409Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 23 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537412Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 24 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537415Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 25 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537418Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 26 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537421Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 27 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537425Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 28 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537428Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 29 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 30 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537433Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 31 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537436Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 32 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537439Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 33 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537442Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 34 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537445Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 35 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537449Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 36 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537451Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 37 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537454Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 38 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537457Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 39 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537460Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 40 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537463Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 41 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 42 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 43 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537471Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 44 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537474Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 45 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537477Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 46 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537480Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 47 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537483Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 48 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537485Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 49 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537488Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 50 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537491Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 51 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537496Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 52 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 53 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537502Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 54 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537505Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 55 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537508Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 56 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537511Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 57 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 58 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537517Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 59 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537528Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 60 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537532Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 61 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537535Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 62 partNo : 0 messageNo: 3 size 99 offset: -1
2025-09-30T14:50:19.537553Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:19.537595Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:19.537946Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 64 to 64
2025-09-30T14:50:19.537960Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 65 to 65
2025-09-30T14:50:19.537965Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 66 to 66
2025-09-30T14:50:19.537971Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 67 to 67
2025-09-30T14:50:19.537977Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 68 to 68
2025-09-30T14:50:19.537987Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 69 to 69
2025-09-30T14:50:19.537995Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 70 to 70
2025-09-30T14:50:19.538000Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 71 to 71
2025-09-30T14:50:19.538006Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 72 to 72
2025-09-30T14:50:19.538012Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 73 to 73
2025-09-30T14:50:19.538018Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 74 to 74
2025-09-30T14:50:19.538025Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 75 to 75
2025-09-30T14:50:19.538045Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:50:19.538058Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Send 5 message(s) (8 left), first sequence number is 63
2025-09-30T14:50:19.538219Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b7185918-d4952604-affa58eb-503a017f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:19.538336Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:19.538619Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.538630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.538682Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 76 to 76
2025-09-30T14:50:19.538693Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 77 to 77
2025-09-30T14:50:19.538698Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 78 to 78
2025-09-30T14:50:19.538704Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 79 to 79
2025-09-30T14:50:19.538709Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 80 to 80
2025-09-30T14:50:19.538715Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 81 to 81
2025-09-30T14:50:19.538720Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 82 to 82
2025-09-30T14:50:19.538726Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 83 to 83
2025-09-30T14:50:19.538732Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 84 to 84
2025-09-30T14:50:19.538716Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 19 size 2134 actorID [2:7555894665513017452:2394]
2025-09-30T14:50:19.538744Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 85 to 85
2025-09-30T14:50:19.538751Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 86 to 86
2025-09-30T14:50:19.538756Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 87 to 87
2025-09-30T14:50:19.538763Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 88 to 88
2025-09-30T14:50:19.538769Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 89 to 89
2025-09-30T14:50:19.538775Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 90 to 90
2025-09-30T14:50:19.538780Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 91 to 91
2025-09-30T14:50:19.538746Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 4  requestId: <none> cookie: 3
2025-09-30T14:50:19.538794Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 92 to 92
2025-09-30T14:50:19.538766Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:19.538800Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 93 to 93
2025-09-30T14:50:19.538786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 2004 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:19.538806Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 94 to 94
2025-09-30T14:50:19.538794Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 19 parts 0 suffix '63' size 2134
2025-09-30T14:50:19.538815Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 95 to 95
2025-09-30T14:50:19.538794Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538822Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 96 to 96
2025-09-30T14:50:19.538816Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-09-30T14:50:19.538821Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538828Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 97 to 97
2025-09-30T14:50:19.538825Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-09-30T14:50:19.538827Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538834Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 98 to 98
2025-09-30T14:50:19.538831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-09-30T14:50:19.538833Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538840Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 99 to 99
2025-09-30T14:50:19.538837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 4, partNo: 0, Offset: 3 is stored on disk
2025-09-30T14:50:19.538840Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538843Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 5, partNo: 0, Offset: 4 is stored on disk
2025-09-30T14:50:19.538846Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write 1 messages with Id from 100 to 100
2025-09-30T14:50:19.538845Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538848Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 6, partNo: 0, Offset: 5 is stored on disk
2025-09-30T14:50:19.538850Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538854Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 7, partNo: 0, Offset: 6 is stored on disk
2025-09-30T14:50:19.538856Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538860Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 8, partNo: 0, Offset: 7 is stored on disk
2025-09-30T14:50:19.538862Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538865Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 9, partNo: 0, Offset: 8 is stored on disk
2025-09-30T14:50:19.538867Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538850Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:19.538870Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 10, partNo: 0, Offset: 9 is stored on disk
2025-09-30T14:50:19.538873Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538876Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 11, partNo: 0, Offset: 10 is stored on disk
2025-09-30T14:50:19.538879Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538882Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 12, partNo: 0, Offset: 11 is stored on disk
2025-09-30T14:50:19.538884Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538888Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 13, partNo: 0, Offset: 12 is stored on disk
2025-09-30T14:50:19.538890Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538893Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 14, partNo: 0, Offset: 13 is stored on disk
2025-09-30T14:50:19.538895Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538899Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 15, partNo: 0, Offset: 14 is stored on disk
2025-09-30T14:50:19.538901Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538904Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 16, partNo: 0, Offset: 15 is stored on disk
2025-09-30T14:50:19.538906Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538909Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 17, partNo: 0, Offset: 16 is stored on disk
2025-09-30T14:50:19.538911Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538914Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 18, partNo: 0, Offset: 17 is stored on disk
2025-09-30T14:50:19.538916Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.538920Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 19, partNo: 0, Offset: 18 is stored on disk
2025-09-30T14:50:19.538952Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:19.538965Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:19.538969Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.538992Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.538999Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (43)
2025-09-30T14:50:19.539018Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 20 partNo 0
2025-09-30T14:50:19.539048Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 20 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 173 count 1 nextOffset 20 batches 1
2025-09-30T14:50:19.539058Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 21 partNo 0
2025-09-30T14:50:19.539062Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 21 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 314 count 2 nextOffset 21 batches 1
2025-09-30T14:50:19.539065Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 22 partNo 0
2025-09-30T14:50:19.539070Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 22 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 455 count 3 nextOffset 22 batches 1
2025-09-30T14:50:19.539073Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 23 partNo 0
2025-09-30T14:50:19.539079Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 23 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 596 count 4 nextOffset 23 batches 1
2025-09-30T14:50:19.539082Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 24 partNo 0
2025-09-30T14:50:19.539086Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 24 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 737 count 5 nextOffset 24 batches 1
2025-09-30T14:50:19.539088Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 25 partNo 0
2025-09-30T14:50:19.539092Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 25 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 878 count 6 nextOffset 25 batches 1
2025-09-30T14:50:19.539095Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 26 partNo 0
2025-09-30T14:50:19.539106Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 26 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 1019 count 7 nextOffset 26 batches 1
2025-09-30T14:50:19.539109Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 27 partNo 0
2025-09-30T14:50:19.539125Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 27 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 1160 count 8 nextOffset 27 batches 1
2025-09-30T14:50:19.539133Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 28 partNo 0
2025-09-30T14:50:19.539140Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 28 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 1301 count 9 nextOffset 28 batches 1
2025-09-30T14:50:19.539143Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 29 partNo 0
2025-09-30T14:50:19.539146Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 29 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 1442 count 10 nextOffset 29 batches 1
2025-09-30T14:50:19.539154Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 30 partNo 0
2025-09-30T14:50:19.539157Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 30 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 1583 count 11 nextOffset 30 batches 1
2025-09-30T14:50:19.539160Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 31 partNo 0
2025-09-30T14:50:19.539164Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 31 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 1724 count 12 nextOffset 31 batches 1
2025-09-30T14:50:19.539166Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 32 partNo 0
2025-09-30T14:50:19.539170Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 32 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 1865 count 13 nextOffset 32 batches 1
2025-09-30T14:50:19.539173Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 33 partNo 0
2025-09-30T14:50:19.539182Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 33 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 2006 count 14 nextOffset 33 batches 1
2025-09-30T14:50:19.539185Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 34 partNo 0
2025-09-30T14:50:19.539188Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 34 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 2147 count 15 nextOffset 34 batches 1
2025-09-30T14:50:19.539192Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 35 partNo 0
2025-09-30T14:50:19.539195Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 35 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 2288 count 16 nextOffset 35 batches 1
2025-09-30T14:50:19.539198Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 36 partNo 0
2025-09-30T14:50:19.539202Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 36 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 2429 count 17 nextOffset 36 batches 1
2025-09-30T14:50:19.539205Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 37 partNo 0
2025-09-30T14:50:19.539209Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 37 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 2570 count 18 nextOffset 37 batches 1
2025-09-30T14:50:19.539212Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 38 partNo 0
2025-09-30T14:50:19.539216Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 38 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 2711 count 19 nextOffset 38 batches 1
2025-09-30T14:50:19.539219Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 39 partNo 0
2025-09-30T14:50:19.539222Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 39 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 2852 count 20 nextOffset 39 batches 1
2025-09-30T14:50:19.539225Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 40 partNo 0
2025-09-30T14:50:19.539229Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 40 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 2993 count 21 nextOffset 40 batches 1
2025-09-30T14:50:19.539232Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 41 partNo 0
2025-09-30T14:50:19.539235Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 41 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 3134 count 22 nextOffset 41 batches 1
2025-09-30T14:50:19.539238Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 42 partNo 0
2025-09-30T14:50:19.539241Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 42 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 3275 count 23 nextOffset 42 batches 1
2025-09-30T14:50:19.539257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 43 partNo 0
2025-09-30T14:50:19.539260Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 43 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 3416 count 24 nextOffset 43 batches 1
2025-09-30T14:50:19.539264Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 44 partNo 0
2025-09-30T14:50:19.539268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 44 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 3557 count 25 nextOffset 44 batches 1
2025-09-30T14:50:19.539272Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 45 partNo 0
2025-09-30T14:50:19.539275Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 45 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 3698 count 26 nextOffset 45 batches 1
2025-09-30T14:50:19.539278Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 46 partNo 0
2025-09-30T14:50:19.539281Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 46 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 3839 count 27 nextOffset 46 batches 1
2025-09-30T14:50:19.539284Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 47 partNo 0
2025-09-30T14:50:19.539287Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 47 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 3980 count 28 nextOffset 47 batches 1
2025-09-30T14:50:19.539290Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 48 partNo 0
2025-09-30T14:50:19.539293Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 48 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 4121 count 29 nextOffset 48 batches 1
2025-09-30T14:50:19.539296Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 49 partNo 0
2025-09-30T14:50:19.539299Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 49 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 4262 count 30 nextOffset 49 batches 1
2025-09-30T14:50:19.539301Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 50 partNo 0
2025-09-30T14:50:19.539305Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 50 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 4403 count 31 nextOffset 50 batches 1
2025-09-30T14:50:19.539309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 51 partNo 0
2025-09-30T14:50:19.539312Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 51 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 4544 count 32 nextOffset 51 batches 1
2025-09-30T14:50:19.539316Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 52 partNo 0
2025-09-30T14:50:19.539322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 52 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 4685 count 33 nextOffset 52 batches 1
2025-09-30T14:50:19.539325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 53 partNo 0
2025-09-30T14:50:19.539329Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 53 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 4826 count 34 nextOffset 53 batches 1
2025-09-30T14:50:19.539339Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 54 partNo 0
2025-09-30T14:50:19.539343Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 54 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 4967 count 35 nextOffset 54 batches 1
2025-09-30T14:50:19.539346Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 55 partNo 0
2025-09-30T14:50:19.539348Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:50:19.539350Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 55 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 5108 count 36 nextOffset 55 batches 1
2025-09-30T14:50:19.539361Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Send 33 message(s) (0 left), first sequence number is 68
2025-09-30T14:50:19.539353Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 56 partNo 0
2025-09-30T14:50:19.539356Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 56 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 5249 count 37 nextOffset 56 batches 1
2025-09-30T14:50:19.539359Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 57 partNo 0
2025-09-30T14:50:19.539363Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 57 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 5390 count 38 nextOffset 57 batches 1
2025-09-30T14:50:19.539366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 58 partNo 0
2025-09-30T14:50:19.539369Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 58 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 5531 count 39 nextOffset 58 batches 1
2025-09-30T14:50:19.539372Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 59 partNo 0
2025-09-30T14:50:19.539376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 59 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 5672 count 40 nextOffset 59 batches 1
2025-09-30T14:50:19.539378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 60 partNo 0
2025-09-30T14:50:19.539382Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 60 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 5813 count 41 nextOffset 60 batches 1
2025-09-30T14:50:19.539385Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 61 partNo 0
2025-09-30T14:50:19.539388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 61 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 5954 count 42 nextOffset 61 batches 1
2025-09-30T14:50:19.539391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 62 partNo 0
2025-09-30T14:50:19.539394Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 62 partNo 0 FormedBlobsCount 0 NewHead: Offset 19 PartNo 0 PackedSize 6095 count 43 nextOffset 62 batches 1
2025-09-30T14:50:19.539397Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.539495Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 19,43 HeadOffset 19 endOffset 19 curOffset 62 d0000000000_00000000000000000019_00000_0000000043_00000? size 4736 WTime 1759243819539
2025-09-30T14:50:19.539557Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b7185918-d4952604-affa58eb-503a017f_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:19.539521Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000019_00000?
2025-09-30T14:50:19.539528Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 2134 bytes (2134)
2025-09-30T14:50:19.539533Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 2134 (8388608)
2025-09-30T14:50:19.539572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-09-30T14:50:19.539602Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.539610Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.539622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 63 partNo : 0 messageNo: 5 size 99 offset: -1
2025-09-30T14:50:19.539630Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 64 partNo : 0 messageNo: 5 size 99 offset: -1
2025-09-30T14:50:19.539633Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 65 partNo : 0 messageNo: 5 size 99 offset: -1
2025-09-30T14:50:19.539636Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 66 partNo : 0 messageNo: 5 size 99 offset: -1
2025-09-30T14:50:19.539640Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 67 partNo : 0 messageNo: 5 size 99 offset: -1
2025-09-30T14:50:19.539647Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:19.539663Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 19 partNo 0 count 43 size 4736
2025-09-30T14:50:19.539689Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:19.539711Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:19.539737Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:19.539758Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 19 max time lag 0ms effective offset 0
2025-09-30T14:50:19.539778Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 2134 count 19 last offset 0, current partition end offset: 19
2025-09-30T14:50:19.539785Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:19.539810Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 19 parts_count 0 source 1 size 2134 accessed 0 times before, last time 2025-09-30T14:50:19.000000Z
2025-09-30T14:50:19.539818Z node 2 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-09-30T14:50:19.539829Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:19.539858Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 19 parts 0 suffix '63'
2025-09-30T14:50:19.539918Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:19.539935Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 19 count 19 size 2114 from pos 0 cbcount 19
2025-09-30T14:50:19.539964Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.539968Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.539975Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243819536 queuesize 0 startOffset 0
2025-09-30T14:50:19.539987Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 6  requestId: <none> cookie: 4
2025-09-30T14:50:19.540169Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:50:19.540188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:19.540398Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } acks { seq_no: 2 written { offset: 1 } } acks { seq_no: 3 written { offset: 2 } } acks { seq_no: 4 written { offset: 3 } } acks { seq_no: 5 written { offset: 4 } } acks { seq_no: 6 written { offset: 5 } } acks { seq_no: 7 written { offset: 6 } } acks { seq_no: 8 written { offset: 7 } } acks { seq_no: 9 written { offset: 8 } } acks { seq_no: 10 written { offset: 9 } } acks { seq_no: 11 written { offset: 10 } } acks { seq_no: 12 written { offset: 11 } } acks { seq_no: 13 written { offset: 12 } } acks { seq_no: 14 written { offset: 13 } } acks { seq_no: 15 written { offset: 14 } } acks { seq_no: 16 written { offset: 15 } } acks { seq_no: 17 written { offset: 16 } } acks { seq_no: 18 written { offset: 17 } } acks { seq_no: 19 written { offset: 18 } } write_statistics { persisting_time { nanos: 2000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-09-30T14:50:19.540406Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-09-30T14:50:19.540410Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-09-30T14:50:19.540415Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=2, txId=?
2025-09-30T14:50:19.540418Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 2
2025-09-30T14:50:19.540421Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=3, txId=?
2025-09-30T14:50:19.540425Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 3
2025-09-30T14:50:19.540429Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=4, txId=?
2025-09-30T14:50:19.540431Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 4
2025-09-30T14:50:19.540435Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=5, txId=?
2025-09-30T14:50:19.540437Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 5
2025-09-30T14:50:19.540440Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=6, txId=?
2025-09-30T14:50:19.540442Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 6
2025-09-30T14:50:19.540446Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=7, txId=?
2025-09-30T14:50:19.540448Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 7
2025-09-30T14:50:19.540451Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=8, txId=?
2025-09-30T14:50:19.540454Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 8
2025-09-30T14:50:19.540457Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=9, txId=?
2025-09-30T14:50:19.540460Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 9
2025-09-30T14:50:19.540463Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=10, txId=?
2025-09-30T14:50:19.540465Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 10
2025-09-30T14:50:19.540469Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=11, txId=?
2025-09-30T14:50:19.540471Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 11
2025-09-30T14:50:19.540474Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=12, txId=?
2025-09-30T14:50:19.540476Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 12
2025-09-30T14:50:19.540480Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=13, txId=?
2025-09-30T14:50:19.540482Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 13
2025-09-30T14:50:19.540485Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=14, txId=?
2025-09-30T14:50:19.540488Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 14
2025-09-30T14:50:19.540491Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=15, txId=?
2025-09-30T14:50:19.540494Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 15
2025-09-30T14:50:19.540497Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=16, txId=?
2025-09-30T14:50:19.540500Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 16
2025-09-30T14:50:19.540503Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=17, txId=?
2025-09-30T14:50:19.540505Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 17
2025-09-30T14:50:19.540509Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=18, txId=?
2025-09-30T14:50:19.540511Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 18
2025-09-30T14:50:19.540514Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=19, txId=?
2025-09-30T14:50:19.540516Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 19
2025-09-30T14:50:19.540362Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:19.540371Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:19.540381Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 68 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540384Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 69 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540387Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 70 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540389Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 71 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540393Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 72 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540396Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 73 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540399Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 74 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540402Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 75 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540406Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 76 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540410Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 77 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540413Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 78 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540416Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 79 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540419Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 80 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540422Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 81 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540424Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 82 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540427Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 83 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540431Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 84 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540434Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 85 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540437Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 86 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540440Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 87 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540443Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 88 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540447Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 89 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540450Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 90 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540453Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 91 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540456Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 92 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540459Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 93 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540462Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 94 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540466Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 95 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540469Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 96 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540472Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 97 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540475Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 98 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540478Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 99 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540484Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 100 partNo : 0 messageNo: 7 size 99 offset: -1
2025-09-30T14:50:19.540498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:19.540527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2243: [72075186224037892][Partition][0][StateIdle] Writing. Can't process transactions and user actions
2025-09-30T14:50:19.541181Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 19 count 43 size 4736 actorID [2:7555894665513017452:2394]
2025-09-30T14:50:19.541200Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:19.541210Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 19 partno 0 count 43 parts 0 suffix '63' size 4736
2025-09-30T14:50:19.541213Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4558 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:19.541220Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541227Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 20, partNo: 0, Offset: 19 is stored on disk
2025-09-30T14:50:19.541230Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541234Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 21, partNo: 0, Offset: 20 is stored on disk
2025-09-30T14:50:19.541236Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541239Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 22, partNo: 0, Offset: 21 is stored on disk
2025-09-30T14:50:19.541242Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541246Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 23, partNo: 0, Offset: 22 is stored on disk
2025-09-30T14:50:19.541248Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541252Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 24, partNo: 0, Offset: 23 is stored on disk
2025-09-30T14:50:19.541254Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541257Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 25, partNo: 0, Offset: 24 is stored on disk
2025-09-30T14:50:19.541259Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541263Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 26, partNo: 0, Offset: 25 is stored on disk
2025-09-30T14:50:19.541265Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541268Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 27, partNo: 0, Offset: 26 is stored on disk
2025-09-30T14:50:19.541270Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541273Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 28, partNo: 0, Offset: 27 is stored on disk
2025-09-30T14:50:19.541276Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541289Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 29, partNo: 0, Offset: 28 is stored on disk
2025-09-30T14:50:19.541292Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541295Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 30, partNo: 0, Offset: 29 is stored on disk
2025-09-30T14:50:19.541298Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541302Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 31, partNo: 0, Offset: 30 is stored on disk
2025-09-30T14:50:19.541309Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541314Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 32, partNo: 0, Offset: 31 is stored on disk
2025-09-30T14:50:19.541317Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541320Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 33, partNo: 0, Offset: 32 is stored on disk
2025-09-30T14:50:19.541322Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541325Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 34, partNo: 0, Offset: 33 is stored on disk
2025-09-30T14:50:19.541327Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541330Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 35, partNo: 0, Offset: 34 is stored on disk
2025-09-30T14:50:19.541342Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541345Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 36, partNo: 0, Offset: 35 is stored on disk
2025-09-30T14:50:19.541347Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541351Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 37, partNo: 0, Offset: 36 is stored on disk
2025-09-30T14:50:19.541352Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541355Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 38, partNo: 0, Offset: 37 is stored on disk
2025-09-30T14:50:19.541358Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541361Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 39, partNo: 0, Offset: 38 is stored on disk
2025-09-30T14:50:19.541362Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541366Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 40, partNo: 0, Offset: 39 is stored on disk
2025-09-30T14:50:19.541368Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541371Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 41, partNo: 0, Offset: 40 is stored on disk
2025-09-30T14:50:19.541373Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541376Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 42, partNo: 0, Offset: 41 is stored on disk
2025-09-30T14:50:19.541378Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541381Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 43, partNo: 0, Offset: 42 is stored on disk
2025-09-30T14:50:19.541383Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541386Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 44, partNo: 0, Offset: 43 is stored on disk
2025-09-30T14:50:19.541388Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541391Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 45, partNo: 0, Offset: 44 is stored on disk
2025-09-30T14:50:19.541393Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541396Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 46, partNo: 0, Offset: 45 is stored on disk
2025-09-30T14:50:19.541399Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541402Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 47, partNo: 0, Offset: 46 is stored on disk
2025-09-30T14:50:19.541404Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541408Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 48, partNo: 0, Offset: 47 is stored on disk
2025-09-30T14:50:19.541410Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541413Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 49, partNo: 0, Offset: 48 is stored on disk
2025-09-30T14:50:19.541415Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541418Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 50, partNo: 0, Offset: 49 is stored on disk
2025-09-30T14:50:19.541420Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541423Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 51, partNo: 0, Offset: 50 is stored on disk
2025-09-30T14:50:19.541425Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541429Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 52, partNo: 0, Offset: 51 is stored on disk
2025-09-30T14:50:19.541431Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541435Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 53, partNo: 0, Offset: 52 is stored on disk
2025-09-30T14:50:19.541437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541440Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 54, partNo: 0, Offset: 53 is stored on disk
2025-09-30T14:50:19.541442Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541446Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 55, partNo: 0, Offset: 54 is stored on disk
2025-09-30T14:50:19.541448Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541452Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 56, partNo: 0, Offset: 55 is stored on disk
2025-09-30T14:50:19.541455Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541458Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 57, partNo: 0, Offset: 56 is stored on disk
2025-09-30T14:50:19.541460Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 58, partNo: 0, Offset: 57 is stored on disk
2025-09-30T14:50:19.541465Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541468Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 59, partNo: 0, Offset: 58 is stored on disk
2025-09-30T14:50:19.541470Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541473Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 60, partNo: 0, Offset: 59 is stored on disk
2025-09-30T14:50:19.541474Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541478Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 61, partNo: 0, Offset: 60 is stored on disk
2025-09-30T14:50:19.541479Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.541483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 62, partNo: 0, Offset: 61 is stored on disk
2025-09-30T14:50:19.541507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.541525Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.541527Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (38)
2025-09-30T14:50:19.541544Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 63 partNo 0
2025-09-30T14:50:19.541568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 63 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 173 count 1 nextOffset 63 batches 1
2025-09-30T14:50:19.541573Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 64 partNo 0
2025-09-30T14:50:19.541577Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 64 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 314 count 2 nextOffset 64 batches 1
2025-09-30T14:50:19.541581Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 65 partNo 0
2025-09-30T14:50:19.541585Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 65 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 455 count 3 nextOffset 65 batches 1
2025-09-30T14:50:19.541587Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 66 partNo 0
2025-09-30T14:50:19.541591Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 66 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 596 count 4 nextOffset 66 batches 1
2025-09-30T14:50:19.541594Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 67 partNo 0
2025-09-30T14:50:19.541597Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 67 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 737 count 5 nextOffset 67 batches 1
2025-09-30T14:50:19.541600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 68 partNo 0
2025-09-30T14:50:19.541603Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 68 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 878 count 6 nextOffset 68 batches 1
2025-09-30T14:50:19.541606Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 69 partNo 0
2025-09-30T14:50:19.541610Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 69 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1019 count 7 nextOffset 69 batches 1
2025-09-30T14:50:19.541613Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 70 partNo 0
2025-09-30T14:50:19.541617Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 70 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1160 count 8 nextOffset 70 batches 1
2025-09-30T14:50:19.541620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 71 partNo 0
2025-09-30T14:50:19.541624Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 71 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1301 count 9 nextOffset 71 batches 1
2025-09-30T14:50:19.541627Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 72 partNo 0
2025-09-30T14:50:19.541631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 72 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1442 count 10 nextOffset 72 batches 1
2025-09-30T14:50:19.541633Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 73 partNo 0
2025-09-30T14:50:19.541646Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 73 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1583 count 11 nextOffset 73 batches 1
2025-09-30T14:50:19.541649Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 74 partNo 0
2025-09-30T14:50:19.541653Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 74 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1724 count 12 nextOffset 74 batches 1
2025-09-30T14:50:19.541656Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 75 partNo 0
2025-09-30T14:50:19.541661Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 75 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 1865 count 13 nextOffset 75 batches 1
2025-09-30T14:50:19.541664Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 76 partNo 0
2025-09-30T14:50:19.541668Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 76 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2006 count 14 nextOffset 76 batches 1
2025-09-30T14:50:19.541671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 77 partNo 0
2025-09-30T14:50:19.541674Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 77 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2147 count 15 nextOffset 77 batches 1
2025-09-30T14:50:19.541677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 78 partNo 0
2025-09-30T14:50:19.541681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 78 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2288 count 16 nextOffset 78 batches 1
2025-09-30T14:50:19.542137Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:19.541684Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 79 partNo 0
2025-09-30T14:50:19.541688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 79 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2429 count 17 nextOffset 79 batches 1
2025-09-30T14:50:19.541690Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 80 partNo 0
2025-09-30T14:50:19.541695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 80 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2570 count 18 nextOffset 80 batches 1
2025-09-30T14:50:19.541698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 81 partNo 0
2025-09-30T14:50:19.541702Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 81 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2711 count 19 nextOffset 81 batches 1
2025-09-30T14:50:19.541705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 82 partNo 0
2025-09-30T14:50:19.541709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 82 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2852 count 20 nextOffset 82 batches 1
2025-09-30T14:50:19.541712Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 83 partNo 0
2025-09-30T14:50:19.541715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 83 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 2993 count 21 nextOffset 83 batches 1
2025-09-30T14:50:19.541718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 84 partNo 0
2025-09-30T14:50:19.541722Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 84 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3134 count 22 nextOffset 84 batches 1
2025-09-30T14:50:19.541725Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 85 partNo 0
2025-09-30T14:50:19.541729Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 85 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3275 count 23 nextOffset 85 batches 1
2025-09-30T14:50:19.541732Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 86 partNo 0
2025-09-30T14:50:19.541735Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 86 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3416 count 24 nextOffset 86 batches 1
2025-09-30T14:50:19.541738Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 87 partNo 0
2025-09-30T14:50:19.541742Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 87 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3557 count 25 nextOffset 87 batches 1
2025-09-30T14:50:19.541745Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 88 partNo 0
2025-09-30T14:50:19.541748Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 88 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3698 count 26 nextOffset 88 batches 1
2025-09-30T14:50:19.541751Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 89 partNo 0
2025-09-30T14:50:19.541754Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 89 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3839 count 27 nextOffset 89 batches 1
2025-09-30T14:50:19.541757Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 90 partNo 0
2025-09-30T14:50:19.541761Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 90 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 3980 count 28 nextOffset 90 batches 1
2025-09-30T14:50:19.541764Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 91 partNo 0
2025-09-30T14:50:19.541767Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 91 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4121 count 29 nextOffset 91 batches 1
2025-09-30T14:50:19.541770Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 92 partNo 0
2025-09-30T14:50:19.541773Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 92 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4262 count 30 nextOffset 92 batches 1
2025-09-30T14:50:19.541776Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 93 partNo 0
2025-09-30T14:50:19.541780Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 93 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4403 count 31 nextOffset 93 batches 1
2025-09-30T14:50:19.541783Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 94 partNo 0
2025-09-30T14:50:19.541786Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 94 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4544 count 32 nextOffset 94 batches 1
2025-09-30T14:50:19.541790Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 95 partNo 0
2025-09-30T14:50:19.541805Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 95 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4685 count 33 nextOffset 95 batches 1
2025-09-30T14:50:19.541808Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 96 partNo 0
2025-09-30T14:50:19.542591Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:50:19.542711Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 20 written { offset: 19 } } acks { seq_no: 21 written { offset: 20 } } acks { seq_no: 22 written { offset: 21 } } acks { seq_no: 23 written { offset: 22 } } acks { seq_no: 24 written { offset: 23 } } acks { seq_no: 25 written { offset: 24 } } acks { seq_no: 26 written { offset: 25 } } acks { seq_no: 27 written { offset: 26 } } acks { seq_no: 28 written { offset: 27 } } acks { seq_no: 29 written { offset: 28 } } acks { seq_no: 30 written { offset: 29 } } acks { seq_no: 31 written { offset: 30 } } acks { seq_no: 32 written { offset: 31 } } acks { seq_no: 33 written { offset: 32 } } acks { seq_no: 34 written { offset: 33 } } acks { seq_no: 35 written { offset: 34 } } acks { seq_no: 36 written { offset: 35 } } acks { seq_no: 37 written { offset: 36 } } acks { seq_no: 38 written { offset: 37 } } acks { seq_no: 39 written { offset: 38 } } acks { seq_no: 40 written { offset: 39 } } acks { seq_no: 41 written { offset: 40 } } acks { seq_no: 42 written { offset: 41 } } acks { seq_no: 43 written { offset: 42 } } acks { seq_no: 44 written { offset: 43 } } acks { seq_no: 45 written { offset: 44 } } acks { seq_no: 46 written { offset: 45 } } acks { seq_no: 47 written { offset: 46 } } acks { seq_no: 48 written { offset: 47 } } acks { seq_no: 49 written { offset: 48 } } acks { seq_no: 50 written { offset: 49 } } acks { seq_no: 51 written { offset: 50 } } acks { seq_no: 52 written { offset: 51 } } acks { seq_no: 53 written { offset: 52 } } acks { seq_no: 54 written { offset: 53 } } acks { seq_no: 55 written { offset: 54 } } acks { seq_no: 56 written { offset: 55 } } acks { seq_no: 57 written { offset: 56 } } acks { seq_no: 58 written { offset: 57 } } acks { seq_no: 59 written { offset: 58 } } acks { seq_no: 60 written { offset: 59 } } acks { seq_no: 61 written { offset: 60 } } acks { seq_no: 62 written { offset: 61 } } write_statistics { persisting_time { nanos: 2000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 2000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-09-30T14:50:19.542722Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=20, txId=?
2025-09-30T14:50:19.542726Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 20
2025-09-30T14:50:19.542734Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=21, txId=?
2025-09-30T14:50:19.542736Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 21
2025-09-30T14:50:19.542749Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=22, txId=?
2025-09-30T14:50:19.542751Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 22
2025-09-30T14:50:19.542754Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=23, txId=?
2025-09-30T14:50:19.542756Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 23
2025-09-30T14:50:19.542759Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=24, txId=?
2025-09-30T14:50:19.542761Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 24
2025-09-30T14:50:19.542764Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=25, txId=?
2025-09-30T14:50:19.542766Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 25
2025-09-30T14:50:19.542770Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=26, txId=?
2025-09-30T14:50:19.542772Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 26
2025-09-30T14:50:19.542775Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=27, txId=?
2025-09-30T14:50:19.542777Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 27
2025-09-30T14:50:19.542779Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=28, txId=?
2025-09-30T14:50:19.542781Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 28
2025-09-30T14:50:19.542784Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=29, txId=?
2025-09-30T14:50:19.542786Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 29
2025-09-30T14:50:19.542789Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=30, txId=?
2025-09-30T14:50:19.542791Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 30
2025-09-30T14:50:19.542793Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=31, txId=?
2025-09-30T14:50:19.542795Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 31
2025-09-30T14:50:19.542797Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=32, txId=?
2025-09-30T14:50:19.542799Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 32
2025-09-30T14:50:19.542802Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=33, txId=?
2025-09-30T14:50:19.542803Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 33
2025-09-30T14:50:19.542806Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=34, txId=?
2025-09-30T14:50:19.542808Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 34
2025-09-30T14:50:19.542811Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=35, txId=?
2025-09-30T14:50:19.542813Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 35
2025-09-30T14:50:19.542815Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=36, txId=?
2025-09-30T14:50:19.542817Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 36
2025-09-30T14:50:19.542820Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=37, txId=?
2025-09-30T14:50:19.542822Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 37
2025-09-30T14:50:19.542826Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=38, txId=?
2025-09-30T14:50:19.542828Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 38
2025-09-30T14:50:19.542830Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=39, txId=?
2025-09-30T14:50:19.542832Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 39
2025-09-30T14:50:19.542834Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=40, txId=?
2025-09-30T14:50:19.542836Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 40
2025-09-30T14:50:19.542839Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=41, txId=?
2025-09-30T14:50:19.542841Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 41
2025-09-30T14:50:19.542843Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=42, txId=?
2025-09-30T14:50:19.542845Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 42
2025-09-30T14:50:19.542848Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=43, txId=?
2025-09-30T14:50:19.542850Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 43
2025-09-30T14:50:19.542852Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=44, txId=?
2025-09-30T14:50:19.542854Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 44
2025-09-30T14:50:19.542856Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=45, txId=?
2025-09-30T14:50:19.542858Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 45
2025-09-30T14:50:19.542861Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=46, txId=?
2025-09-30T14:50:19.542863Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 46
2025-09-30T14:50:19.542866Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=47, txId=?
2025-09-30T14:50:19.542867Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 47
2025-09-30T14:50:19.542870Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=48, txId=?
2025-09-30T14:50:19.542872Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 48
2025-09-30T14:50:19.542874Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=49, txId=?
2025-09-30T14:50:19.542876Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 49
2025-09-30T14:50:19.542881Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=50, txId=?
2025-09-30T14:50:19.542883Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 50
2025-09-30T14:50:19.542885Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=51, txId=?
2025-09-30T14:50:19.542887Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 51
2025-09-30T14:50:19.542889Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=52, txId=?
2025-09-30T14:50:19.542891Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 52
2025-09-30T14:50:19.542894Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=53, txId=?
2025-09-30T14:50:19.542896Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 53
2025-09-30T14:50:19.542899Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=54, txId=?
2025-09-30T14:50:19.542901Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 54
2025-09-30T14:50:19.542903Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=55, txId=?
2025-09-30T14:50:19.542905Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 55
2025-09-30T14:50:19.542908Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=56, txId=?
2025-09-30T14:50:19.542909Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 56
2025-09-30T14:50:19.542912Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=57, txId=?
2025-09-30T14:50:19.542914Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 57
2025-09-30T14:50:19.542916Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=58, txId=?
2025-09-30T14:50:19.542918Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 58
2025-09-30T14:50:19.542921Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=59, txId=?
2025-09-30T14:50:19.542923Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 59
2025-09-30T14:50:19.542925Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=60, txId=?
2025-09-30T14:50:19.542927Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 60
2025-09-30T14:50:19.542930Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=61, txId=?
2025-09-30T14:50:19.542932Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 61
2025-09-30T14:50:19.542936Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=62, txId=?
2025-09-30T14:50:19.542938Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 62
2025-09-30T14:50:19.541814Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 96 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4826 count 34 nextOffset 96 batches 1
2025-09-30T14:50:19.541817Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 97 partNo 0
2025-09-30T14:50:19.541820Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 97 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 4967 count 35 nextOffset 97 batches 1
2025-09-30T14:50:19.541823Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 98 partNo 0
2025-09-30T14:50:19.541826Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 98 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 5108 count 36 nextOffset 98 batches 1
2025-09-30T14:50:19.541828Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 99 partNo 0
2025-09-30T14:50:19.541831Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 99 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 5249 count 37 nextOffset 99 batches 1
2025-09-30T14:50:19.541834Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 100 partNo 0
2025-09-30T14:50:19.541837Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 100 partNo 0 FormedBlobsCount 0 NewHead: Offset 62 PartNo 0 PackedSize 5390 count 38 nextOffset 100 batches 1
2025-09-30T14:50:19.541838Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.541905Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 62,38 HeadOffset 62 endOffset 62 curOffset 100 d0000000000_00000000000000000062_00000_0000000038_00000? size 4196 WTime 1759243819541
2025-09-30T14:50:19.541923Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000019_00000?
2025-09-30T14:50:19.541925Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000019_00000_0000000043_00000?
2025-09-30T14:50:19.541928Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 6870 bytes (6870)
2025-09-30T14:50:19.541932Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 6870 (8388608)
2025-09-30T14:50:19.542018Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-09-30T14:50:19.542036Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:19.542047Z node 2 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 62 partNo 0 count 38 size 4196
2025-09-30T14:50:19.543404Z node 2 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 62 count 38 size 4196 actorID [2:7555894665513017452:2394]
2025-09-30T14:50:19.543419Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:19.543445Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 4028 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:19.543457Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543464Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 63, partNo: 0, Offset: 62 is stored on disk
2025-09-30T14:50:19.543471Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543475Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 64, partNo: 0, Offset: 63 is stored on disk
2025-09-30T14:50:19.543477Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543477Z node 2 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 62 partno 0 count 38 parts 0 suffix '63' size 4196
2025-09-30T14:50:19.543481Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 65, partNo: 0, Offset: 64 is stored on disk
2025-09-30T14:50:19.543483Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543486Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 66, partNo: 0, Offset: 65 is stored on disk
2025-09-30T14:50:19.543488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543491Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 67, partNo: 0, Offset: 66 is stored on disk
2025-09-30T14:50:19.543493Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543496Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 68, partNo: 0, Offset: 67 is stored on disk
2025-09-30T14:50:19.543498Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543502Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 69, partNo: 0, Offset: 68 is stored on disk
2025-09-30T14:50:19.543504Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543508Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 70, partNo: 0, Offset: 69 is stored on disk
2025-09-30T14:50:19.543520Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543528Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 71, partNo: 0, Offset: 70 is stored on disk
2025-09-30T14:50:19.543530Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543534Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 72, partNo: 0, Offset: 71 is stored on disk
2025-09-30T14:50:19.543536Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543539Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 73, partNo: 0, Offset: 72 is stored on disk
2025-09-30T14:50:19.543541Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543545Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 74, partNo: 0, Offset: 73 is stored on disk
2025-09-30T14:50:19.543551Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543555Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 75, partNo: 0, Offset: 74 is stored on disk
2025-09-30T14:50:19.543557Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543561Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 76, partNo: 0, Offset: 75 is stored on disk
2025-09-30T14:50:19.543563Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543566Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 77, partNo: 0, Offset: 76 is stored on disk
2025-09-30T14:50:19.543568Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543572Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 78, partNo: 0, Offset: 77 is stored on disk
2025-09-30T14:50:19.543574Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543578Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 79, partNo: 0, Offset: 78 is stored on disk
2025-09-30T14:50:19.543588Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543596Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 80, partNo: 0, Offset: 79 is stored on disk
2025-09-30T14:50:19.543599Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543602Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 81, partNo: 0, Offset: 80 is stored on disk
2025-09-30T14:50:19.543605Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543609Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 82, partNo: 0, Offset: 81 is stored on disk
2025-09-30T14:50:19.543615Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543618Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 83, partNo: 0, Offset: 82 is stored on disk
2025-09-30T14:50:19.543620Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543623Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 84, partNo: 0, Offset: 83 is stored on disk
2025-09-30T14:50:19.543625Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543629Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 85, partNo: 0, Offset: 84 is stored on disk
2025-09-30T14:50:19.543631Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543634Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 86, partNo: 0, Offset: 85 is stored on disk
2025-09-30T14:50:19.543637Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543640Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 87, partNo: 0, Offset: 86 is stored on disk
2025-09-30T14:50:19.543654Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543663Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 88, partNo: 0, Offset: 87 is stored on disk
2025-09-30T14:50:19.543666Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543669Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 89, partNo: 0, Offset: 88 is stored on disk
2025-09-30T14:50:19.543671Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543675Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 90, partNo: 0, Offset: 89 is stored on disk
2025-09-30T14:50:19.543677Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543681Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 91, partNo: 0, Offset: 90 is stored on disk
2025-09-30T14:50:19.543683Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543686Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 92, partNo: 0, Offset: 91 is stored on disk
2025-09-30T14:50:19.543688Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543692Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 93, partNo: 0, Offset: 92 is stored on disk
2025-09-30T14:50:19.543695Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543698Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 94, partNo: 0, Offset: 93 is stored on disk
2025-09-30T14:50:19.543700Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543703Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 95, partNo: 0, Offset: 94 is stored on disk
2025-09-30T14:50:19.543705Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543709Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 96, partNo: 0, Offset: 95 is stored on disk
2025-09-30T14:50:19.543711Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543715Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 97, partNo: 0, Offset: 96 is stored on disk
2025-09-30T14:50:19.543718Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543721Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 98, partNo: 0, Offset: 97 is stored on disk
2025-09-30T14:50:19.543723Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543726Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 99, partNo: 0, Offset: 98 is stored on disk
2025-09-30T14:50:19.543728Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:19.543731Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 100, partNo: 0, Offset: 99 is stored on disk
2025-09-30T14:50:19.543755Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.543762Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.543764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.543772Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000019_00000?
2025-09-30T14:50:19.543778Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000019_00000_0000000043_00000?
2025-09-30T14:50:19.543780Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000062_00000_0000000038_00000?
2025-09-30T14:50:19.543783Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 11066 bytes (11066)
2025-09-30T14:50:19.543786Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 3, size 11066 (8388608)
2025-09-30T14:50:19.543804Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 5  requestId: <none> cookie: 3
2025-09-30T14:50:19.543861Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 7  requestId: <none> cookie: 4
2025-09-30T14:50:19.543922Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:19.544056Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::IEventHandle
2025-09-30T14:50:19.545029Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:50:19.545074Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 63 written { offset: 62 } } acks { seq_no: 64 written { offset: 63 } } acks { seq_no: 65 written { offset: 64 } } acks { seq_no: 66 written { offset: 65 } } acks { seq_no: 67 written { offset: 66 } } write_statistics { persisting_time { nanos: 2000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 1000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-09-30T14:50:19.545082Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=63, txId=?
2025-09-30T14:50:19.545086Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 63
2025-09-30T14:50:19.545090Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=64, txId=?
2025-09-30T14:50:19.545093Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 64
2025-09-30T14:50:19.545096Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=65, txId=?
2025-09-30T14:50:19.545098Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 65
2025-09-30T14:50:19.545101Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=66, txId=?
2025-09-30T14:50:19.545103Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 66
2025-09-30T14:50:19.545106Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=67, txId=?
2025-09-30T14:50:19.545107Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 67
2025-09-30T14:50:19.545169Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:50:19.545248Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 68 written { offset: 67 } } acks { seq_no: 69 written { offset: 68 } } acks { seq_no: 70 written { offset: 69 } } acks { seq_no: 71 written { offset: 70 } } acks { seq_no: 72 written { offset: 71 } } acks { seq_no: 73 written { offset: 72 } } acks { seq_no: 74 written { offset: 73 } } acks { seq_no: 75 written { offset: 74 } } acks { seq_no: 76 written { offset: 75 } } acks { seq_no: 77 written { offset: 76 } } acks { seq_no: 78 written { offset: 77 } } acks { seq_no: 79 written { offset: 78 } } acks { seq_no: 80 written { offset: 79 } } acks { seq_no: 81 written { offset: 80 } } acks { seq_no: 82 written { offset: 81 } } acks { seq_no: 83 written { offset: 82 } } acks { seq_no: 84 written { offset: 83 } } acks { seq_no: 85 written { offset: 84 } } acks { seq_no: 86 written { offset: 85 } } acks { seq_no: 87 written { offset: 86 } } acks { seq_no: 88 written { offset: 87 } } acks { seq_no: 89 written { offset: 88 } } acks { seq_no: 90 written { offset: 89 } } acks { seq_no: 91 written { offset: 90 } } acks { seq_no: 92 written { offset: 91 } } acks { seq_no: 93 written { offset: 92 } } acks { seq_no: 94 written { offset: 93 } } acks { seq_no: 95 written { offset: 94 } } acks { seq_no: 96 written { offset: 95 } } acks { seq_no: 97 written { offset: 96 } } acks { seq_no: 98 written { offset: 97 } } acks { seq_no: 99 written { offset: 98 } } acks { seq_no: 100 written { offset: 99 } } write_statistics { persisting_time { nanos: 2000000 } min_queue_wait_time { nanos: 1000000 } max_queue_wait_time { nanos: 1000000 } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-09-30T14:50:19.545255Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=68, txId=?
2025-09-30T14:50:19.545258Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 68
2025-09-30T14:50:19.545261Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=69, txId=?
2025-09-30T14:50:19.545263Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 69
2025-09-30T14:50:19.545266Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=70, txId=?
2025-09-30T14:50:19.545268Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 70
2025-09-30T14:50:19.545271Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=71, txId=?
2025-09-30T14:50:19.545273Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 71
2025-09-30T14:50:19.545275Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=72, txId=?
2025-09-30T14:50:19.545277Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 72
2025-09-30T14:50:19.545281Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=73, txId=?
2025-09-30T14:50:19.545283Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 73
2025-09-30T14:50:19.545285Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=74, txId=?
2025-09-30T14:50:19.545287Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 74
2025-09-30T14:50:19.545293Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=75, txId=?
2025-09-30T14:50:19.545295Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 75
2025-09-30T14:50:19.545297Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=76, txId=?
2025-09-30T14:50:19.545300Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 76
2025-09-30T14:50:19.545303Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=77, txId=?
2025-09-30T14:50:19.545305Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 77
2025-09-30T14:50:19.545308Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=78, txId=?
2025-09-30T14:50:19.545310Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 78
2025-09-30T14:50:19.545313Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=79, txId=?
2025-09-30T14:50:19.545315Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 79
2025-09-30T14:50:19.545318Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=80, txId=?
2025-09-30T14:50:19.545319Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 80
2025-09-30T14:50:19.545322Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=81, txId=?
2025-09-30T14:50:19.545324Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 81
2025-09-30T14:50:19.545327Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=82, txId=?
2025-09-30T14:50:19.545329Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 82
2025-09-30T14:50:19.545332Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=83, txId=?
2025-09-30T14:50:19.545334Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 83
2025-09-30T14:50:19.545337Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=84, txId=?
2025-09-30T14:50:19.545339Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 84
2025-09-30T14:50:19.545342Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=85, txId=?
2025-09-30T14:50:19.545344Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 85
2025-09-30T14:50:19.545347Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=86, txId=?
2025-09-30T14:50:19.545349Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 86
2025-09-30T14:50:19.545352Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=87, txId=?
2025-09-30T14:50:19.545354Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 87
2025-09-30T14:50:19.545357Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=88, txId=?
2025-09-30T14:50:19.545359Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 88
2025-09-30T14:50:19.545362Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=89, txId=?
2025-09-30T14:50:19.545363Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 89
2025-09-30T14:50:19.545366Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=90, txId=?
2025-09-30T14:50:19.545368Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 90
2025-09-30T14:50:19.545370Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=91, txId=?
2025-09-30T14:50:19.545372Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 91
2025-09-30T14:50:19.545374Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=92, txId=?
2025-09-30T14:50:19.545376Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 92
2025-09-30T14:50:19.545379Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=93, txId=?
2025-09-30T14:50:19.545381Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 93
2025-09-30T14:50:19.545384Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=94, txId=?
2025-09-30T14:50:19.545386Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 94
2025-09-30T14:50:19.545389Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=95, txId=?
2025-09-30T14:50:19.545391Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 95
2025-09-30T14:50:19.545394Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=96, txId=?
2025-09-30T14:50:19.545395Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 96
2025-09-30T14:50:19.545398Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=97, txId=?
2025-09-30T14:50:19.545400Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 97
2025-09-30T14:50:19.545402Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=98, txId=?
2025-09-30T14:50:19.545404Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 98
2025-09-30T14:50:19.545409Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=99, txId=?
2025-09-30T14:50:19.545411Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 99
2025-09-30T14:50:19.545414Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] OnAck: seqNo=100, txId=?
2025-09-30T14:50:19.545416Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: acknoledged message 100
2025-09-30T14:50:19.545567Z :INFO: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-09-30T14:50:19.545581Z :INFO: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session will now close
2025-09-30T14:50:19.545597Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: aborting
2025-09-30T14:50:19.545777Z :INFO: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:19.545782Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|b7185918-d4952604-affa58eb-503a017f_0]  MessageGroupId [src_id] Write session: destroy
2025-09-30T14:50:19.546025Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|b7185918-d4952604-affa58eb-503a017f_0 grpc read done: success: 0 data: 
2025-09-30T14:50:19.546034Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|b7185918-d4952604-affa58eb-503a017f_0 grpc read failed
2025-09-30T14:50:19.546043Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|b7185918-d4952604-affa58eb-503a017f_0 grpc closed
2025-09-30T14:50:19.546048Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|b7185918-d4952604-affa58eb-503a017f_0 is DEAD
2025-09-30T14:50:19.546296Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:19.546572Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894668795534806:2504] destroyed
2025-09-30T14:50:19.546600Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:19.546609Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.546611Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.546614Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.623303Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.623324Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.623327Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.071581Z :WriteSessionCloseIgnoresWrites INFO: Random seed for debugging is 1759243820071572
2025-09-30T14:50:20.148883Z node 3 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[3:7555894675612370190:2156];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:20.148929Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:20.150431Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7555894676871123967:2152];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:20.150495Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:20.151003Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/00261e/r3tmp/tmpYJ9T5L/pdisk_1.dat
2025-09-30T14:50:20.151293Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:20.152524Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:20.152875Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:20.173240Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:20.180028Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:20.180054Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:20.181675Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-09-30T14:50:20.181998Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 23701, node 3
2025-09-30T14:50:20.189163Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/00261e/r3tmp/yandexYAa7Cy.tmp
2025-09-30T14:50:20.189177Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/00261e/r3tmp/yandexYAa7Cy.tmp
2025-09-30T14:50:20.189260Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/00261e/r3tmp/yandexYAa7Cy.tmp
2025-09-30T14:50:20.189339Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:20.192945Z INFO: TTestServer started on Port 16066 GrpcPort 23701
TClient is connected to server localhost:16066
PQClient connected to localhost:23701
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:20.210610Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976715657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:50:20.250083Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:20.250121Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:20.255988Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-09-30T14:50:20.326957Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:20.414186Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:20.592945Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894675612371011:2324], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.593006Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.593219Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894675612371047:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.594239Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:20.597829Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894675612371079:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.597854Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.598542Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894675612371081:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.598562Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:20.605323Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7555894675612371049:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715661 completed, doublechecking }
2025-09-30T14:50:20.606473Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:20.619507Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7555894676871124200:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:20.620380Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=MjAwMmQxYjItZWZhYWIyNzgtNzkzZTBjYjYtZTg5MmQ0MWU=, ActorId: [4:7555894676871124183:2295], ActorState: ExecuteState, TraceId: 01k6dhmqj497675jcb0dv46ynw, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:20.620546Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:20.624552Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:20.662693Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7555894675612371404:2875] txid# 281474976715664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:20.664004Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:20.668448Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7555894675612371423:2358], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:20.668682Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=ZTkwNjhmM2EtZDYzNDE4YjYtOTA0NGE3YmItZjYxMmYwMzY=, ActorId: [3:7555894675612371007:2321], ActorState: ExecuteState, TraceId: 01k6dhmqhf3twph01wmxvw7jva, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:20.669407Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:23701", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:20.705800Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715666. Ctx: { TraceId: 01k6dhmqmd4jcmknbzxek60ena, Database: , SessionId: ydb://session/3?node_id=3&id=YTA1ZjBjMTgtNWFkMGRlZDEtYjZkZmU4NjQtMzM4MGQzODU=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7555894675612371601:3014] 
2025-09-30T14:50:21.150435Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:21.151950Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:25.149127Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[3:7555894675612370190:2156];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:25.149174Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:25.150662Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7555894676871123967:2152];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:25.150695Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:50:25.909671Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976715678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:23701
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:25.927425Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:23701
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976715679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:25.935867Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:25.936456Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7555894697087208655:3346] connected; active server actors: 1
2025-09-30T14:50:25.936811Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:50:25.936815Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:25.936879Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:25.936893Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.936906Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:25.936942Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894697087208654:3345], now have 1 active actors on pipe
2025-09-30T14:50:25.936935Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:25.937127Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.937226Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7555894698345961113:2377], now have 1 active actors on pipe
2025-09-30T14:50:25.937318Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-09-30T14:50:25.937752Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:50:25.938128Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.939434Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894697087208717:3394], now have 1 active actors on pipe
2025-09-30T14:50:25.939559Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.940500Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.940682Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:25.940697Z node 3 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:25.940748Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:25.940785Z node 3 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7555894697087208730:2471]
2025-09-30T14:50:25.941500Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:25.941510Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:25.941516Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7555894697087208730:2471]
2025-09-30T14:50:25.941523Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:25.941791Z node 3 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:25.941804Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.941822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.941829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:25.941833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:25.941835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.941837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.941839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:25.941846Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:25.941914Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.941946Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:25.942854Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.942892Z node 3 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243825983, TxId 281474976715679
2025-09-30T14:50:25.942898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.942899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.942919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.942955Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:25.943434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:25.943485Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:25.943495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:25.943497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:25.943499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:25.943514Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:25.943610Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:25.943630Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:25.943686Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.944539Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.944559Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:25.944963Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:25.951895Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976715680. Ctx: { TraceId: 01k6dhmwrd5832j4gee92048gn, Database: , SessionId: ydb://session/3?node_id=3&id=NmVjYWExOWUtODFhZWZkMC0xZThkMzJlOC02NmQ5NTJjNQ==, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759243825983
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976715679
    CreateStep: 1759243825983
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:23701
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:25.962311Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:26.042084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.042109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.042113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.142425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.142446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.142449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.242738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.242755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.242758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.343137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.343154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.343157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.447326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.447348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.447351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:23701
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:26.464103Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:26.547449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.547470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.547473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.650023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.650046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.650049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.750164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.750178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.750180Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.850475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.850494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.850496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:26.950788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:26.950803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:26.950806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:23701
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:26.966190Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:26.968636Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:26.968867Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:26.968873Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:23701
2025-09-30T14:50:26.969235Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:26.969388Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:26.969406Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:26.969611Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:26.969664Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:56824
2025-09-30T14:50:26.969675Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:56824 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:26.969679Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:26.970185Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:26.970226Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:26.970228Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:26.970253Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:26.970261Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7555894701382176230:2509] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:26.970922Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7555894701382176230:2509] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:26.996304Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7555894701382176230:2509] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:26.996446Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894701382176262:2509] connected; active server actors: 1
2025-09-30T14:50:26.996627Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7555894701382176230:2509] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:50:26.996635Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555894701382176230:2509] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:26.996832Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894701382176262:2509] disconnected; active server actors: 1
2025-09-30T14:50:26.996843Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894701382176262:2509] disconnected no session
2025-09-30T14:50:27.014662Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555894701382176230:2509] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:27.014683Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7555894701382176230:2509] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:27.014687Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555894701382176230:2509] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:27.014696Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:27.014878Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-09-30T14:50:27.014899Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894705677143578:2509], now have 1 active actors on pipe
2025-09-30T14:50:27.014911Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.014919Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.014958Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|aa712669-cdcc5932-bafd172d-651e9824_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:27.014975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.014984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.014987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:27.015000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.015022Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:27.015049Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.015093Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:27.015100Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:27.015115Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:27.015152Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|aa712669-cdcc5932-bafd172d-651e9824_0
2025-09-30T14:50:27.015529Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243827015 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:27.015583Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|aa712669-cdcc5932-bafd172d-651e9824_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:27.015701Z :INFO: [] MessageGroupId [src] SessionId [src|aa712669-cdcc5932-bafd172d-651e9824_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:27.015713Z :INFO: [] MessageGroupId [src] SessionId [src|aa712669-cdcc5932-bafd172d-651e9824_0] Write session will now close
2025-09-30T14:50:27.015720Z :DEBUG: [] MessageGroupId [src] SessionId [src|aa712669-cdcc5932-bafd172d-651e9824_0] Write session: aborting
2025-09-30T14:50:27.015902Z :INFO: [] MessageGroupId [src] SessionId [src|aa712669-cdcc5932-bafd172d-651e9824_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:27.015909Z :DEBUG: [] MessageGroupId [src] SessionId [src|aa712669-cdcc5932-bafd172d-651e9824_0] Write session: destroy
2025-09-30T14:50:27.016075Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|aa712669-cdcc5932-bafd172d-651e9824_0 grpc read done: success: 0 data: 
2025-09-30T14:50:27.016088Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|aa712669-cdcc5932-bafd172d-651e9824_0 grpc read failed
2025-09-30T14:50:27.016096Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|aa712669-cdcc5932-bafd172d-651e9824_0 grpc closed
2025-09-30T14:50:27.016101Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|aa712669-cdcc5932-bafd172d-651e9824_0 is DEAD
2025-09-30T14:50:27.016379Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:27.016426Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7555894705677143578:2509] destroyed
2025-09-30T14:50:27.016440Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:27.016452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.016454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.016456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-09-30T14:50:27.051194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.051216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.051219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:50:27.070844Z :ERROR: [/Root] OnFederationDiscovery: Got error. Status: UNAVAILABLE. Description: 
2025-09-30T14:50:27.151569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.151587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.151590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.251905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.251921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.251924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.352277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.352292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.352295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.452607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.452621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.452624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.552979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.552994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.552997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.653367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.653385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.653389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.753646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.753661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.753664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.858498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.858515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.858518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.958478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.958494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.958497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.058837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.058864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.058867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.159160Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.159176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.159179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.259562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.259578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.259581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.359857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.359872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.359875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.460233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.460255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.460257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.560606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.560625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.560628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.660915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.660928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.660931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.761278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.761293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.761296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.861663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.861680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.861684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.961984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.962007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.962010Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.062380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.062398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.062401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.162748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.162765Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.162769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.263097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.263115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.263118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.363394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.363414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.363418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.463778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.463795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.463798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.564134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.564155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.564166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.664970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.664987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.664989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.765324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.765349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.765353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.865665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.865682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.865684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.966050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.966074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.966077Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.066385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.066404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.066407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.166720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.166736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.166739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.267065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.267081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.267084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.367447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.367463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.367465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:14.045532Z :WriteSessionNoAvailableDatabase INFO: Random seed for debugging is 1759243814045526
2025-09-30T14:50:14.135177Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7555894646835130495:2155];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:14.135301Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:14.138695Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:14.139528Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7555894650203931633:2154];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:14.139573Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/0025ec/r3tmp/tmpz1arH1/pdisk_1.dat
2025-09-30T14:50:14.141786Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:14.180291Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:14.182208Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:14.194555Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
TServer::EnableGrpc on GrpcPort 1359, node 1
2025-09-30T14:50:14.209830Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/0025ec/r3tmp/yandexhKOjHG.tmp
2025-09-30T14:50:14.209842Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/0025ec/r3tmp/yandexhKOjHG.tmp
2025-09-30T14:50:14.209923Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/0025ec/r3tmp/yandexhKOjHG.tmp
2025-09-30T14:50:14.209983Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:14.214628Z INFO: TTestServer started on Port 22665 GrpcPort 1359
TClient is connected to server localhost:22665
PQClient connected to localhost:1359
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: 2025-09-30T14:50:14.236306Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:14.236337Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:14.238455Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:14.244172Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:14.244213Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:14.245105Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-09-30T14:50:14.245698Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-09-30T14:50:14.246005Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:50:14.382208Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:14.464850Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:14.537787Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894650203931860:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:14.537811Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894650203931849:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:14.537831Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:14.539437Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976715657:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:14.541064Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894650203931891:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:14.541104Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:14.541297Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894650203931893:2303], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:14.541318Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:14.544284Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7555894650203931863:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976715657 completed, doublechecking }
2025-09-30T14:50:14.634168Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7555894650203931895:2135] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:14.640237Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7555894646835131411:2330], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:14.640374Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=OWI3NDAyNi1lZjVjYWE1ZC04YTlhMjExNi1iMTE3ZmI3Yw==, ActorId: [1:7555894646835131361:2322], ActorState: ExecuteState, TraceId: 01k6dhmhnj7gn6e1hkne81pbr2, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:14.640839Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720661:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:14.641116Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:14.640527Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7555894650203931910:2306], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:14.640634Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=NzRlNjQ0ZmMtY2Y3NmExYTYtMmNjMGQ0MjctNzcwNjk3ZTM=, ActorId: [2:7555894650203931847:2295], ActorState: ExecuteState, TraceId: 01k6dhmhm9c0xwr0239rj7tsmg, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:14.641133Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:14.685598Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:14.721845Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:1359", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:14.770392Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720664. Ctx: { TraceId: 01k6dhmhtt7jnptvxv7wgncjgb, Database: , SessionId: ydb://session/3?node_id=1&id=ZmEwMTgyN2MtZTk0ZWE2Yy01OTMxNWUyYy1hMWNiYWY2, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7555894646835131801:2953] 
2025-09-30T14:50:15.137165Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:15.141269Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:19.134890Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7555894646835130495:2155];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:19.134933Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:19.139461Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7555894650203931633:2154];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:19.139520Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:50:19.912605Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720676:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:1359
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:19.951719Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:1359
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720677
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:19.967212Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7555894668309968805:3263] connected; active server actors: 1
2025-09-30T14:50:19.967552Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:50:19.967802Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:19.971229Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:50:19.972559Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:19.973203Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:19.973254Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:19.973271Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:19.973283Z node 2 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:19.973489Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894668309968826:2446], now have 1 active actors on pipe
2025-09-30T14:50:19.973499Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894668309968803:3262], now have 1 active actors on pipe
2025-09-30T14:50:19.973563Z node 1 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 2, Generation 1
2025-09-30T14:50:19.973873Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:19.975308Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:19.977411Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894668309968856:3307], now have 1 active actors on pipe
2025-09-30T14:50:19.977512Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:19.978840Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:19.979069Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:19.979102Z node 2 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:19.979164Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:19.979091Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720678. Ctx: { TraceId: 01k6dhmpxv3et49hb7v9dtj5s4, Database: , SessionId: ydb://session/3?node_id=1&id=ZTY4Zjc0Y2UtMjg1MWE4MmEtNTMwNzI0MmMtM2FiYWFhNjQ=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-09-30T14:50:19.979238Z node 2 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [2:7555894671678768946:2401]
2025-09-30T14:50:19.980110Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:19.980120Z node 2 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:19.980125Z node 2 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [2:7555894671678768946:2401]
2025-09-30T14:50:19.980133Z node 2 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:19.980435Z node 2 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:19.980446Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.980473Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.980479Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:19.980482Z node 2 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:19.980485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.980487Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.980488Z node 2 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:19.980497Z node 2 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:19.980622Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:19.980666Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:19.982183Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:19.982226Z node 2 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243820026, TxId 281474976720677
2025-09-30T14:50:19.982234Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.982237Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.982263Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.982318Z node 2 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:19.982972Z node 2 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:19.983032Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:19.983040Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.983042Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.983043Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.983048Z node 2 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:19.983176Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:19.983197Z node 2 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:19.983268Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:19.984745Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:19.984771Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:19.985224Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759243820026
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720677
    CreateStep: 1759243820026
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:1359
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:19.994837Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:20.080021Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.080041Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.080045Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.180485Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.180504Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.180507Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.280739Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.280760Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.280764Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.381107Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.381128Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.381131Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.481430Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.481452Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.481455Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:1359
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:20.496340Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:20.581803Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.581820Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.581826Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.682078Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.682098Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.682101Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.782496Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.782517Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.782520Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.882821Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.882850Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.882852Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:20.983185Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:20.983214Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:20.983217Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:1359
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:20.998228Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:20.999506Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:20.999786Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:20.999792Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:1359
2025-09-30T14:50:21.000332Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:21.000345Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:21.002115Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:21.002361Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:21.002433Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:57710
2025-09-30T14:50:21.002444Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:57710 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:21.002448Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:21.002924Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:21.002969Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:21.002976Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:21.002979Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:21.002993Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894676899903623:2481] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:21.003599Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894676899903623:2481] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:21.029367Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7555894676899903623:2481] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:21.029445Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894676899903655:2481] connected; active server actors: 1
2025-09-30T14:50:21.029467Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7555894676899903623:2481] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:50:21.029473Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894676899903623:2481] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:21.029557Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894676899903655:2481] disconnected; active server actors: 1
2025-09-30T14:50:21.029566Z node 1 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894676899903655:2481] disconnected no session
2025-09-30T14:50:21.048797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894676899903623:2481] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:21.048814Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894676899903623:2481] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:21.048817Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894676899903623:2481] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:21.048824Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:21.049154Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894676899903678:2481], now have 1 active actors on pipe
2025-09-30T14:50:21.049234Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 2, Generation: 1
2025-09-30T14:50:21.049342Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.049369Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.049412Z node 2 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|2b2ba6b4-6bedfbaf-cd79ff11-1ebb93a0_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:21.049435Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.049441Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.049445Z node 2 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:21.049461Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:21.049488Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:21.049514Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.049694Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:21.049702Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:21.049715Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:21.049829Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|2b2ba6b4-6bedfbaf-cd79ff11-1ebb93a0_0
2025-09-30T14:50:21.050262Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243821050 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:21.050303Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|2b2ba6b4-6bedfbaf-cd79ff11-1ebb93a0_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:21.050462Z :INFO: [] MessageGroupId [src] SessionId [src|2b2ba6b4-6bedfbaf-cd79ff11-1ebb93a0_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:21.050472Z :INFO: [] MessageGroupId [src] SessionId [src|2b2ba6b4-6bedfbaf-cd79ff11-1ebb93a0_0] Write session will now close
2025-09-30T14:50:21.050479Z :DEBUG: [] MessageGroupId [src] SessionId [src|2b2ba6b4-6bedfbaf-cd79ff11-1ebb93a0_0] Write session: aborting
2025-09-30T14:50:21.050654Z :INFO: [] MessageGroupId [src] SessionId [src|2b2ba6b4-6bedfbaf-cd79ff11-1ebb93a0_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:21.050659Z :DEBUG: [] MessageGroupId [src] SessionId [src|2b2ba6b4-6bedfbaf-cd79ff11-1ebb93a0_0] Write session: destroy
2025-09-30T14:50:21.050823Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|2b2ba6b4-6bedfbaf-cd79ff11-1ebb93a0_0 grpc read done: success: 0 data: 
2025-09-30T14:50:21.050833Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|2b2ba6b4-6bedfbaf-cd79ff11-1ebb93a0_0 grpc read failed
2025-09-30T14:50:21.050854Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|2b2ba6b4-6bedfbaf-cd79ff11-1ebb93a0_0 grpc closed
2025-09-30T14:50:21.050860Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|2b2ba6b4-6bedfbaf-cd79ff11-1ebb93a0_0 is DEAD
2025-09-30T14:50:21.051272Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:21.051414Z node 2 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894676899903678:2481] destroyed
2025-09-30T14:50:21.051437Z node 2 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:21.051454Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.051458Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.051460Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
Session was created
2025-09-30T14:50:21.083562Z node 2 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:21.083583Z node 2 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:21.083586Z node 2 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Got event: ReadyToAcceptEvent
>>> Ready to answer: ok
2025-09-30T14:50:21.104933Z :ERROR: [/Root] [] [] Failed to select database: no available database. Status: NOT_FOUND
>>> Got event: SessionClosed { Status: NOT_FOUND Issues: "<main>: Error: Failed to select database: no available database " }
2025-09-30T14:50:21.462177Z :WriteSessionSwitchDatabases INFO: Random seed for debugging is 1759243821462170
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/0025ec/r3tmp/tmpvK5XIl/pdisk_1.dat
2025-09-30T14:50:21.539524Z node 4 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[4:7555894680773518092:2098];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:21.539557Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:21.542023Z node 4 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:21.540798Z node 3 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:21.543989Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:21.544254Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: LookupError, path: Root/.metadata/script_executions
2025-09-30T14:50:21.544275Z node 3 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=incorrect path status: LookupError;
2025-09-30T14:50:21.566789Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:21.570875Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:21.570904Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:21.578484Z node 3 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 4 Cookie 4
2025-09-30T14:50:21.579087Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(4, (0,0,0,0)) VolatileState: Connecting -> Connected
TServer::EnableGrpc on GrpcPort 26284, node 3
2025-09-30T14:50:21.592138Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/0025ec/r3tmp/yandex4EJi0p.tmp
2025-09-30T14:50:21.592156Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/0025ec/r3tmp/yandex4EJi0p.tmp
2025-09-30T14:50:21.592222Z node 3 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/0025ec/r3tmp/yandex4EJi0p.tmp
2025-09-30T14:50:21.592249Z node 3 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:21.594917Z INFO: TTestServer started on Port 9918 GrpcPort 26284
TClient is connected to server localhost:9918
PQClient connected to localhost:26284
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:21.642361Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:21.642410Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:21.644047Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976720657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
2025-09-30T14:50:21.644526Z node 3 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(3, (0,0,0,0)) VolatileState: Connecting -> Connected
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:50:21.753986Z node 4 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:21.807466Z node 3 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:21.977260Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894680720348713:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:21.977277Z node 3 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [3:7555894680720348731:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:21.977284Z node 3 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:21.978199Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976720661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:21.983882Z node 3 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [3:7555894680720348734:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976720661 completed, doublechecking }
2025-09-30T14:50:21.990586Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:22.006328Z node 4 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [4:7555894680773518376:2301], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:22.006429Z node 4 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=4&id=ODc0NDFlYmItMmQ2NDcwYjEtNzcxYTE2ZTgtZTYwZWQyMzI=, ActorId: [4:7555894680773518359:2295], ActorState: ExecuteState, TraceId: 01k6dhmrxf7p4ax0pt6g9m1xpy, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:22.006611Z node 4 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:22.011614Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720663:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:22.043473Z node 3 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [3:7555894685015316335:2830] txid# 281474976720664, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:22.050032Z node 3 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [3:7555894685015316367:2348], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:22.050816Z node 3 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=3&id=ZjhhNjk2OTEtY2ZjNjA4ZTItOTI1ZTdhZmYtYTY3MjY1MWU=, ActorId: [3:7555894680720348708:2322], ActorState: ExecuteState, TraceId: 01k6dhmrwr8w4dddrm286r0s17, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:22.050969Z node 3 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:22.061867Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:26284", true, true, 1000);
2025-09-30T14:50:22.104716Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720666. Ctx: { TraceId: 01k6dhms0383neq5t307w9e84y, Database: , SessionId: ydb://session/3?node_id=3&id=ODRkY2UyZGItN2ZjODgyYmYtZDYzZmRjN2ItYmU5NjkwZjc=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [3:7555894685015316572:3000] 
2025-09-30T14:50:22.541701Z node 4 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:22.540693Z node 3 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:26.539894Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[4:7555894680773518092:2098];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:26.539943Z node 4 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:50:27.313587Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976720678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:26284
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:27.352151Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:26284
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976720679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:27.370706Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:27.375368Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:27.375483Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:27.375492Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:27.375511Z node 3 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:27.375645Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894706490153627:3337], now have 1 active actors on pipe
2025-09-30T14:50:27.376237Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:27.378792Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:27.379535Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [3:7555894706490153628:3338] connected; active server actors: 1
2025-09-30T14:50:27.379702Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:50:27.380098Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:27.380921Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:50:27.381657Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 3, Generation 1
2025-09-30T14:50:27.381717Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [4:7555894706543322585:2378], now have 1 active actors on pipe
2025-09-30T14:50:27.383215Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894706490153696:3388], now have 1 active actors on pipe
2025-09-30T14:50:27.383315Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:27.384178Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:27.384346Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:27.384357Z node 3 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:27.384411Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:27.384451Z node 3 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [3:7555894706490153707:2466]
2025-09-30T14:50:27.385253Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:27.385257Z node 3 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:27.385262Z node 3 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [3:7555894706490153707:2466]
2025-09-30T14:50:27.385269Z node 3 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:27.385566Z node 3 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:27.385574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.385593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.385596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:27.385600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:27.385603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.385604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.385606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:27.385615Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:27.385708Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:27.385766Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:27.387992Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:27.388055Z node 3 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243827432, TxId 281474976720679
2025-09-30T14:50:27.388061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.388063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.388095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.388147Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:27.388791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:27.388856Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:27.388872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.388874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.388876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.388885Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:27.389007Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:27.389034Z node 3 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:27.389089Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:27.390062Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:27.390088Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:27.390497Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:27.391442Z node 3 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976720680. Ctx: { TraceId: 01k6dhmy5c30ycxbqghxbwaex7, Database: , SessionId: ydb://session/3?node_id=3&id=ZDMwZjE5NTctYTNlZjMzOWUtZWY1MTgwNGEtZTBlNzA0NDA=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759243827432
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976720679
    CreateStep: 1759243827432
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:26284
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:27.400019Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
2025-09-30T14:50:27.485575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.485590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.485593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.585929Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.585951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.585954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.686332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.686345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.686348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.786644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.786660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.786663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:27.887002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.887021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.887023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:26284
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:27.901585Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:27.987318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:27.987336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:27.987339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.087706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.087723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.087726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.189439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.189468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.189471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.289944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.289964Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.289967Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.390267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.390283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.390287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:26284
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:28.406524Z node 3 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:28.408291Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:28.408544Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:28.408549Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:26284
2025-09-30T14:50:28.408892Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:28.409084Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:28.409100Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:28.409176Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:28.409206Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:58540
2025-09-30T14:50:28.409210Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:58540 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:28.409213Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:28.409649Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:28.409678Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:28.409680Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:28.409682Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:28.409686Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7555894710785121207:2506] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:28.410237Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7555894710785121207:2506] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:28.436934Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7555894710785121207:2506] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:28.437126Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894710785121242:2506] connected; active server actors: 1
2025-09-30T14:50:28.437241Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7555894710785121207:2506] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:50:28.437255Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555894710785121207:2506] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:28.437382Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894710785121242:2506] disconnected; active server actors: 1
2025-09-30T14:50:28.437395Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894710785121242:2506] disconnected no session
2025-09-30T14:50:28.456722Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555894710785121207:2506] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:28.456740Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7555894710785121207:2506] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:28.456744Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555894710785121207:2506] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:28.456753Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:28.456917Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-09-30T14:50:28.456936Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894710785121262:2506], now have 1 active actors on pipe
2025-09-30T14:50:28.456948Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.456955Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.456995Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|f76e7069-68db2089-702f807f-37a6f676_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:28.457016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.457027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.457029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:28.457043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.457065Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:28.457093Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.457136Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.457145Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.457159Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.457195Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|f76e7069-68db2089-702f807f-37a6f676_0
2025-09-30T14:50:28.457570Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243828457 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:28.457614Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|f76e7069-68db2089-702f807f-37a6f676_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:28.457711Z :INFO: [] MessageGroupId [src] SessionId [src|f76e7069-68db2089-702f807f-37a6f676_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:28.457721Z :INFO: [] MessageGroupId [src] SessionId [src|f76e7069-68db2089-702f807f-37a6f676_0] Write session will now close
2025-09-30T14:50:28.457728Z :DEBUG: [] MessageGroupId [src] SessionId [src|f76e7069-68db2089-702f807f-37a6f676_0] Write session: aborting
2025-09-30T14:50:28.457848Z :INFO: [] MessageGroupId [src] SessionId [src|f76e7069-68db2089-702f807f-37a6f676_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:28.457852Z :DEBUG: [] MessageGroupId [src] SessionId [src|f76e7069-68db2089-702f807f-37a6f676_0] Write session: destroy
2025-09-30T14:50:28.458032Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|f76e7069-68db2089-702f807f-37a6f676_0 grpc read done: success: 0 data: 
2025-09-30T14:50:28.458043Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|f76e7069-68db2089-702f807f-37a6f676_0 grpc read failed
2025-09-30T14:50:28.458051Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|f76e7069-68db2089-702f807f-37a6f676_0 grpc closed
2025-09-30T14:50:28.458055Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|f76e7069-68db2089-702f807f-37a6f676_0 is DEAD
2025-09-30T14:50:28.458316Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:28.458365Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7555894710785121262:2506] destroyed
2025-09-30T14:50:28.458379Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:28.458389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.458391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.458393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.490657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.490675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.490678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
>>> Got event: ReadyToAcceptEvent
>>> Got event: ReadyToAcceptEvent
2025-09-30T14:50:28.515146Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:26284" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:26284" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:26284" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-09-30T14:50:28.517714Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:50:28.517988Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-09-30T14:50:28.568101Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-09-30T14:50:28.568477Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:28.568489Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-09-30T14:50:28.569875Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.570074Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-09-30T14:50:28.570234Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:28.570293Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:42020
2025-09-30T14:50:28.570304Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:42020 proto=topic  topic=test-topic durationSec=0
2025-09-30T14:50:28.570310Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:28.570941Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-09-30T14:50:28.570984Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:28.570990Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:28.570992Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:28.570999Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7555894710785121276:2520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:28.571677Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7555894710785121276:2520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:28.574741Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [3:7555894710785121276:2520] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:28.576559Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894710785121295:2520] connected; active server actors: 1
2025-09-30T14:50:28.576783Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [3:7555894710785121276:2520] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-09-30T14:50:28.576798Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555894710785121276:2520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:28.576952Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894710785121295:2520] disconnected; active server actors: 1
2025-09-30T14:50:28.576965Z node 4 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [3:7555894710785121295:2520] disconnected no session
2025-09-30T14:50:28.581326Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555894710785121276:2520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:28.581345Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7555894710785121276:2520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:28.581349Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555894710785121276:2520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:28.581359Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:28.581537Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-09-30T14:50:28.581559Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894710785121309:2520], now have 1 active actors on pipe
2025-09-30T14:50:28.581573Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.581582Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.581623Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:28.581641Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.581652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.581655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:28.581672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.581695Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:28.581722Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.581796Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.581812Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.581840Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:28.581886Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0
2025-09-30T14:50:28.582330Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:50:28.582354Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243828582 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:28.582398Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-09-30T14:50:28.582472Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-09-30T14:50:28.582625Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0]  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:50:28.582652Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-09-30T14:50:28.582890Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:28.583042Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:28.583094Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.583106Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.583138Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:28.583160Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:50:28.583203Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:28.583209Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:28.583330Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 98 offset: -1
2025-09-30T14:50:28.583342Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:28.583358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.583369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.583371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:28.583403Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-09-30T14:50:28.583457Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 172 count 1 nextOffset 1 batches 1
2025-09-30T14:50:28.583468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.583521Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 160 WTime 1759243828583
2025-09-30T14:50:28.583550Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:28.583564Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 160
2025-09-30T14:50:28.584671Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 160 actorID [3:7555894706490153644:2466]
2025-09-30T14:50:28.584692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:28.584715Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:28.584718Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 160
2025-09-30T14:50:28.584723Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:28.584733Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-09-30T14:50:28.584768Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:28.584779Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:28.584783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.584786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.584788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.584796Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:50:28.584803Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-09-30T14:50:28.584807Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-09-30T14:50:28.584818Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-09-30T14:50:28.584854Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:50:28.584860Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-09-30T14:50:28.584875Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 160 count 1 last offset 0, current partition end offset: 1
2025-09-30T14:50:28.584878Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:28.584890Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 160 accessed 0 times before, last time 2025-09-30T14:50:28.000000Z
2025-09-30T14:50:28.584904Z node 3 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-09-30T14:50:28.584918Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:28.584945Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 140 from pos 0 cbcount 1
2025-09-30T14:50:28.584967Z node 3 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243828583 queuesize 0 startOffset 0
2025-09-30T14:50:28.585043Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:50:28.585115Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:50:28.585288Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-09-30T14:50:28.585296Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-09-30T14:50:28.585300Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-09-30T14:50:28.590984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.591000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.591003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.691337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.691353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.691356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.795311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.795331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.795334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.895646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.895684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.895688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:28.995997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:28.996015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:28.996018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.096346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.096367Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.096371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.196716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.196733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.196735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.297009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.297026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.297029Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.397408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.397454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.397458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.497764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.497781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.497785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.582219Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555894710785121276:2520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:29.598453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.598470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.598473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.634888Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555894710785121276:2520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-09-30T14:50:29.634902Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555894710785121276:2520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:29.698466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.698483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.698487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.802128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.802145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.802148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:29.902259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:29.902277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:29.902281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.002581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.002598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.002602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.102942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.102962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.102966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.203306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.203326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.203329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.303634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.303667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.303671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.404004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.404023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.404027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.504353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.504370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.504373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.604700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.604715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.604718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.705054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.705072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.705076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.805393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.805425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.805428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:30.905755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:30.905774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:30.905778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.006111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.006139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.006141Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.106461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.106476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.106480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.206811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.206829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.206833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.307155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.307169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.307172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.407526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.407549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.407552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.507843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.507875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.507877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.608187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.608203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.608206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.708560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.708591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.708594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.808875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.808895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.808898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:31.909307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:31.909326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:31.909330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.009620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.009636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.009639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.109958Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.109975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.109978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.210364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.210387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.210390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.310725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.310747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.310750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
E0930 14:50:32.321465543 2226238 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:9955: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-09-30T14:50:32.387414Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:50:32.387436Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-09-30T14:50:32.387442Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-09-30T14:50:32.411048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.411065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.411069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.511311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.511337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.511339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.611837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.611867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.611870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.712060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.712079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.712082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.812441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.812458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.812462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:32.912795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:32.912812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:32.912815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.015318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.015335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.015338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.115548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.115567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.115570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.215949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.215966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.215969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.319344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.319359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.319362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.419678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.419707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.419710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
E0930 14:50:33.471944412 2226290 chttp2_transport.cc:1143]             ipv4:127.0.0.1:9955: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 1250ms
2025-09-30T14:50:33.519984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.520002Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.520005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.620392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.620411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.620414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.720730Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.720750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.720753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.821259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.821279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.821282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:33.921512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:33.921530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:33.921533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.021781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.021797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.021800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.122110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.122126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.122129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.222504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.222522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.222526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.322837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.322853Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.322855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.423196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.423219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.423223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.523547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.523563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.523567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.623880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.623896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.623898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.727379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.727398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.727400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.827717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.827736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.827740Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:34.928028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:34.928047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:34.928050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.028391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.028406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.028409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.128767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.128786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.128790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.229086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.229125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.229128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.329467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.329487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.329490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.429777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.429796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.429800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.530131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.530148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.530152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.630506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.630529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.630532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.730858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.730875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.730879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.831197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.831216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.831230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:35.931567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:35.931583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:35.931586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.031900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.031921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.031925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.132270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.132288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.132291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.232622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.232653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.232657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.332973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.332991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.332994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.435321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.435343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.435347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.535198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.535217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.535220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.554634Z node 3 :FLAT_TX_SCHEMESHARD WARN: schemeshard_impl.cpp:7721: Cannot get console configs
2025-09-30T14:50:36.554659Z node 3 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:36.635519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.635537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.635540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.735885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.735902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.735905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.836285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.836304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.836320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:36.939314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:36.939334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:36.939338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.039489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.039505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.039508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.139879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.139898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.139902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.240200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.240220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.240223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.340563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.340584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.340587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.387207Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:50:37.387223Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-09-30T14:50:37.387229Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-09-30T14:50:37.440906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.440923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.440927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.541275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.541292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.541295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.641639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.641657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.641659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.741970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.741998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.742001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.842337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.842359Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.842363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:37.942691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:37.942708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:37.942711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.043037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.043055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.043058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.143396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.143421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.143424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.243726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.243745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.243748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.344633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.344649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.344652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.444463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.444481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.444485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.544796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.544815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.544818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.645158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.645174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.645177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.745503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.745524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.745527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.845843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.845862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.845865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:38.946199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:38.946214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:38.946216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.046600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.046615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.046619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.147365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.147388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.147393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.247272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.247289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.247292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.347630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.347644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.347647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.447974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.447992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.447996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.548288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.548315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.548318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.648670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.648684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.648687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.748999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.749016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.749019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.849370Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.849389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.849392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:39.949733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:39.949749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:39.949752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.050090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.050106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.050110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.150465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.150482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.150486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.250766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.250782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.250784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.351133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.351152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.351156Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.451597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.451614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.451617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.551817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.551834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.551837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.652190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.652207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.652210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.752519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.752536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.752540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.852897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.852913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.852917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:40.953228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:40.953244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:40.953247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.053590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.053606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.053610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.153963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.153981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.153984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.254290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.254311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.254315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.354638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.354655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.354659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.454968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.454992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.454996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.555540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.555557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.555560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.655714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.655732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.655735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.756070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.756089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.756092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.856419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.856435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.856439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:41.956751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:41.956767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:41.956770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.057108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.057124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.057128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.157469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.157490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.157493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.257812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.257832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.257837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.358182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.358199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.358202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.387467Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:50:42.387484Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-09-30T14:50:42.387489Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-09-30T14:50:42.458520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.458542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.458545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.558851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.558869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.558873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.659240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.659277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.659280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.759572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.759589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.759593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.859928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.859947Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.859950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:42.960284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:42.960305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:42.960307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.060820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.060862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.060873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.160973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.160991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.160994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.261350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.261365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.261369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.361689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.361707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.361710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.462053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.462081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.462084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.562401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.562421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.562425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.662708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.662733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.662736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.763095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.763118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.763121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.863469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.863491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.863494Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:43.963803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:43.963831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:43.963835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.064161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.064177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.064181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.164497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.164520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.164523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.264860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.264880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.264883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.365206Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.365237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.365241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.465562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.465582Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.465585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.565925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.565946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.565949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.666292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.666314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.666319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.766590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.766612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.766615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.867027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.867046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.867055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:44.967330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:44.967362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:44.967365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.067679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.067698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.067702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.168048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.168069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.168073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.268381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.268399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.268402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.368742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.368761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.368764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.469117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.469135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.469139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.569435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.569451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.569454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.669795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.669823Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.669826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.770110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.770131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.770134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.870519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.870554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.870557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:45.970861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:45.970876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:45.970879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.071197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.071214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.071217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.171552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.171569Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.171572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.271876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.271893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.271896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.372271Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.372290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.372293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.472628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.472648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.472652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.572952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.572970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.572973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.673306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.673325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.673329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.773672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.773688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.773700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.873984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.874004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.874007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:46.974394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:46.974415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:46.974419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.074686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.074702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.074704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.175040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.175056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.175058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.275421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.275452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.275455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.375710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.375725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.375728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.387715Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:50:47.387730Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-09-30T14:50:47.387734Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-09-30T14:50:47.476115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.476132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.476135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.576452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.576467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.576469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.677503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.677539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.677542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.777689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.777707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.777711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.878043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.878060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.878063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:47.978398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:47.978414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:47.978418Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.078754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.078772Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.078775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.179078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.179095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.179098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.279462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.279480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.279483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.379807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.379824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.379828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.480159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.480175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.480179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.580503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.580518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.580521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.680865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.680883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.680886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.781202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.781217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.781221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.881559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.881577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.881580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:48.982163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:48.982181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:48.982184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.082290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.082308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.082311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.182599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.182613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.182615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.282959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.282978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.282981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.383327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.383345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.383347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.483624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.483644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.483647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.584024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.584044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.584047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.684384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.684400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.684404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.784695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.784715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.784719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.885100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.885120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.885123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:49.985425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:49.985443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:49.985447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.085794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.085812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.085816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.186139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.186155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.186157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.286453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.286469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.286472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.386840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.386861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.386864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.487194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.487214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.487217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.587532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.587550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.587553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.687863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.687889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.687893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.788223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.788239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.788243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.888606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.888625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.888628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:50.988961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:50.988982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:50.988995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.089294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.089311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.089315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.189645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.189669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.189672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.290028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.290045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.290049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.390333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.390346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.390349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.490731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.490750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.490754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.591044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.591059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.591063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.691422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.691440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.691443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.791779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.791796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.791799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.892089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.892107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.892110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:51.992465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:51.992484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:51.992486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.092828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.092846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.092850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.193191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.193209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.193212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.293529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.293547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.293550Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.387818Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:50:52.387837Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-09-30T14:50:52.387843Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-09-30T14:50:52.393925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.393940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.393941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.494233Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.494253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.494256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.594565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.594584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.594586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.694942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.694960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.694963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.795318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.795336Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.795341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.895645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.895669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.895673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:52.995996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:52.996014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:52.996018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.096329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.096344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.096347Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.196689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.196705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.196708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.297016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.297032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.297035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.397330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.397346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.397349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.497770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.497788Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.497791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.598110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.598132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.598136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.698479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.698496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.698499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.798808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.798825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.798827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.899161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.899179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.899182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:53.999516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:53.999533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:53.999536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.099868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.099885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.099888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.200210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.200226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.200230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.300580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.300599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.300602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.400920Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.400939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.400942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.501282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.501301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.501305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.601624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.601650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.601652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.701950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.701969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.701972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.802332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.802346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.802349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:54.902705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:54.902724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:54.902728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.003020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.003037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.003041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.103400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.103422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.103425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.203736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.203755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.203759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.304098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.304118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.304121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.404446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.404465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.404468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.504794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.504811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.504813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.605142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.605159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.605162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.705502Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.705531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.705535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.805842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.805870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.805873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:55.906203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:55.906219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:55.906222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.006535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.006553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.006556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.106892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.106909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.106911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.207272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.207294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.207298Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.307601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.307618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.307621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.407938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.407954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.407956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.508314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.508342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.508346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.608663Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.608681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.608685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.709020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.709035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.709038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.809365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.809380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.809383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:56.909731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:56.909748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:56.909751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.010055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.010071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.010074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.110420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.110435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.110438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.210776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.210797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.210800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.311129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.311146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.311148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.380726Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:50:57.380777Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 1
2025-09-30T14:50:57.381159Z node 3 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:50:57.381444Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 1 DataSize: 0 UsedReserveSize: 0
2025-09-30T14:50:57.381626Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:50:57.381903Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72057594046644480, NodeId 3, Generation 2
2025-09-30T14:50:57.387991Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:50:57.388007Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-09-30T14:50:57.388012Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-09-30T14:50:57.411484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.411501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.411505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.511820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.511842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.511846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.612177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.612194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.612197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.712531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.712560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.712564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.812885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.812913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.812916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:57.913244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:57.913260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:57.913264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.013575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.013591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.013594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.113951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.113969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.113973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.214295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.214313Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.214317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.314648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.314673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.314677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.414995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.415015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.415018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.515326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.515346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.515349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:50:58.615699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.615715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.615718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.716069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.716086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.716089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.816407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.816434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.816437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:58.916747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:58.916764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:58.916767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.017091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.017108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.017112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.117480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.117498Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.117501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.217793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.217812Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.217814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.318169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.318197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.318200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.418508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.418523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.418526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.518852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.518872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.518876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.619223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.619257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.619260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.719578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.719601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.719603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.819927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.819946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.819949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:59.920260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:59.920275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:59.920277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.020614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.020631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.020634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.120980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.121018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.121021Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.221351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.221368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.221372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.321703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.321719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.321723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.422037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.422053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.422056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.522421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.522438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.522441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.622756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.622774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.622778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.723060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.723087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.723090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.823443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.823461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.823465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:00.923831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:00.923850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:00.923854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.024136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.024154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.024157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.124519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.124539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.124542Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.224876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.224898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.224902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.325239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.325258Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.325262Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.425560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.425585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.425588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.525949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.525973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.525976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.626260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.626278Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.626282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.726643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.726665Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.726669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.826979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.827004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.827007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:01.927330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:01.927346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:01.927349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.027676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.027704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.027707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.128035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.128055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.128059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.228391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.228410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.228414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.328745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.328763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.328766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.388318Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:02.388341Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-09-30T14:51:02.388347Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-09-30T14:51:02.429107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.429126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.429131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.529447Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.529469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.529473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.629805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.629826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.629829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.730161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.730182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.730186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.830499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.830518Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.830521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:02.930854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:02.930876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:02.930880Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.031217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.031241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.031257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.131572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.131592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.131596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.231879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.231898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.231902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.332272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.332291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.332295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.432605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.432624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.432628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.532962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.532979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.532983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.633312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.633330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.633333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.733674Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.733694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.733698Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.834026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.834046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.834050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:03.934382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:03.934400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:03.934404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.034716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.034734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.034737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.135078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.135099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.135102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.235424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.235443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.235446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.335789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.335807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.335810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.436125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.436145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.436149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.536474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.536493Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.536496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.636836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.636857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.636860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.737171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.737191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.737194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.837531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.837555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.837558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:04.937881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:04.937899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:04.937901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.038230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.038253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.038257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.138607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.138629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.138632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.238950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.238969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.238972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.339299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.339321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.339334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.439676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.439696Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.439700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.540024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.540045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.540048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.640356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.640376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.640381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.740725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.740754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.740758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.841053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.841073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.841075Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:05.941404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:05.941422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:05.941425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
E0930 14:51:06.030734901 2226325 chttp2_transport.cc:1143]             ipv6:%5B::1%5D:9955: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-09-30T14:51:06.041767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.041787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.041791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.142116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.142152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.142155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.242464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.242613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.242621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.342817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.342838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.342842Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.443183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.443209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.443212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.543483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.543503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.543507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.643872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.643897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.643901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.744251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.744283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.744285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.844596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.844617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.844620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:06.944941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:06.944960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:06.944963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.045281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.045300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.045303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.145608Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.145638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.145642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.245986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.246005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.246008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.346360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.346382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.346386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.388469Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:07.388493Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-09-30T14:51:07.388499Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-09-30T14:51:07.446687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.446722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.446725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.547036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.547067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.547071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.647387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.647420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.647425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.747749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.747770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.747774Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.848113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.848132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.848136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:07.948468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:07.948545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:07.948571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.048791Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.048808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.048810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.149152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.149172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.149175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.249484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.249503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.249506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.349840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.349861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.349864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.450213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.450230Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.450235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.522549Z :INFO: [/Root] [] [] Start federated write session to database 'dc2' (previous was dc1) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:26284" location: "dc1" status: UNAVAILABLE weight: 500 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:26284" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:26284" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-09-30T14:51:08.522669Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:51:08.522700Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-09-30T14:51:08.523179Z :INFO: [/Root]  TraceId []  SessionId [src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-09-30T14:51:08.523185Z :INFO: [/Root]  TraceId []  SessionId [src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0]  MessageGroupId [src_id] Write session will now close
2025-09-30T14:51:08.523206Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0]  MessageGroupId [src_id] Write session: aborting
2025-09-30T14:51:08.523205Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-09-30T14:51:08.523285Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.523373Z :INFO: [/Root]  TraceId []  SessionId [src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-09-30T14:51:08.523380Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0]  MessageGroupId [src_id] Write session: destroy
2025-09-30T14:51:08.523626Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-09-30T14:51:08.523673Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0 grpc read done: success: 0 data: 
2025-09-30T14:51:08.523682Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:51:08.523700Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 3
2025-09-30T14:51:08.523704Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0 grpc read failed
2025-09-30T14:51:08.523716Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0 grpc closed
2025-09-30T14:51:08.523724Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|4a5b790f-39a1da0-abbdd104-c84f8fcc_0 is DEAD
2025-09-30T14:51:08.523893Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-09-30T14:51:08.523929Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 3 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:42020
2025-09-30T14:51:08.523936Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=3 sessionId= userAgent="topic server" ip=ipv6:[::1]:42020 proto=topic  topic=test-topic durationSec=0
2025-09-30T14:51:08.523940Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:51:08.524275Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:51:08.524369Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7555894710785121309:2520] destroyed
2025-09-30T14:51:08.524386Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:51:08.524397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.524400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.524403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.524455Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 3 sessionId:  describe result for acl check
2025-09-30T14:51:08.524496Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:51:08.524501Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:51:08.524502Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:51:08.524506Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7555894882583816413:3106] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:51:08.525066Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7555894882583816413:3106] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:51:08.528177Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555894882583816413:3106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:08.532045Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555894882583816413:3106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:51:08.532064Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7555894882583816413:3106] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:51:08.532069Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555894882583816413:3106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:08.532078Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 3 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:51:08.532285Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-09-30T14:51:08.532285Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555894882583816445:3106], now have 1 active actors on pipe
2025-09-30T14:51:08.532296Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.532304Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.532347Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:51:08.532368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.532378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.532381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:08.532398Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.532423Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:51:08.532451Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.532500Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:08.532511Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:08.532537Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:51:08.532579Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 3 partition: 0 MaxSeqNo: 1 sessionId: src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0
2025-09-30T14:51:08.532995Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:51:08.533013Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243868533 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:51:08.533075Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 1 session_id: "src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-09-30T14:51:08.550539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.550553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.550556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.650872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.650895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.650899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.751288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.751314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.751317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.851637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.851658Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.851661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:08.952579Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:08.952611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:08.952614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.052838Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.052858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.052862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.153194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.153216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.153220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.253541Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.253562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.253566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.353892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.353909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.353913Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.454240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.454269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.454273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.533098Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555894882583816413:3106] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:51:09.539409Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555894882583816413:3106] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-09-30T14:51:09.539426Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555894882583816413:3106] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:51:09.554560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.554585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.554597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.654945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.654965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.654968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.755302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.755320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.755324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.855749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.855769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.855773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:09.955992Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:09.956011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:09.956015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.056365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.056386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.056390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.156707Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.156729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.156732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.257070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.257088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.257092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.357413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.357434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.357437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.457773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.457794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.457798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.558114Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.558134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.558139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.658461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.658481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.658484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.758813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.758831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.758833Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.859182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.859208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.859212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:10.959533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:10.959551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:10.959554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.059875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.059903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.059906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.160334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.160399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.160413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.260572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.260594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.260597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.360934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.360949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.360952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.461286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.461316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.461320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.561626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.561648Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.561650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.661980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.662006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.662008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.762330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.762349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.762353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.862677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.862705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.862709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:11.963016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:11.963038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:11.963042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.063395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.063416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.063420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.163734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.163751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.163755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.264109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.264131Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.264139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.364463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.364481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.364483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.388637Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:12.388656Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-09-30T14:51:12.388663Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-09-30T14:51:12.464793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.464810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.464814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.565152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.565171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.565174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.665507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.665529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.665532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.765814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.765835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.765839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.866217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.866236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.866240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:12.966575Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:12.966597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:12.966601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.066895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.066915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.066923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.167281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.167300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.167304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.267598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.267631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.267636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.367959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.367978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.367981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.468329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.468350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.468354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.568662Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.568681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.568685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.669024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.669043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.669047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.769382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.769402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.769406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.869764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.869786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.869790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:13.970080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:13.970101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:13.970103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.070460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.070486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.070490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.170799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.170820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.170824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.271136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.271158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.271162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.371479Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.371499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.371501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.471859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.471896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.471899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.572159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.572184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.572186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.672546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.672563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.672566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.772879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.772908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.772911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.873253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.873272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.873276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:14.973607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:14.973630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:14.973634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.073905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.073923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.073927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.174311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.174331Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.174334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.274654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.274675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.274678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.375020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.375042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.375045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.475327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.475346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.475349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.575722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.575746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.575750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.676036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.676057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.676070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.776417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.776437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.776440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.876763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.876781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.876784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:15.977132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:15.977154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:15.977158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.077472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.077496Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.077499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.177837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.177856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.177860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.278204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.278222Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.278226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.378535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.378567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.378572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.478881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.478903Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.478905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.579235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.579273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.579276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.679578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.679595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.679598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.779924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.779942Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.779945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.880294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.880322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.880326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:16.980639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:16.980660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:16.980664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.080978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.080996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.080999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.181358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.181377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.181381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.281697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.281725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.281728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.382031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.382053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.382069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.388777Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:17.388793Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-09-30T14:51:17.388797Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-09-30T14:51:17.482405Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.482423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.482442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.582759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.582781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.582785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.683105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.683121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.683123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.783443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.783460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.783469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.883798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.883815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.883819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:17.984153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:17.984172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:17.984176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.084504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.084522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.084524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.184855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.184875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.184878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.285198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.285217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.285221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.385509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.385527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.385529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.485911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.485927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.485930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.586263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.586281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.586284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.686599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.686618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.686622Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.786978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.786996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.786999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.887337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.887358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.887361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:18.987689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:18.987711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:18.987715Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.088000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.088016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.088019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.188371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.188386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.188389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.288714Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.288741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.288744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.389079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.389096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.389099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.489429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.489445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.489448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.589773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.589789Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.589792Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.690129Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.690149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.690152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.790495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.790513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.790516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.890839Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.890857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.890860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:19.991200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:19.991220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:19.991224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.091504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.091525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.091529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.191899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.191917Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.191921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.292268Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.292289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.292292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.392632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.392653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.392656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.492954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.492983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.492986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.593274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.593294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.593297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.693656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.693675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.693678Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.794023Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.794043Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.794046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.894379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.894397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.894400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:20.994732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:20.994756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:20.994759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.095064Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.095080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.095083Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.195421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.195441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.195445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.295776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.295794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.295798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.396130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.396160Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.396163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.496489Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.496508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.496512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.596818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.596851Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.596855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.697178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.697201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.697204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.797578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.797593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.797595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.897877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.897905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.897909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:21.998219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:21.998239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:21.998242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.098594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.098611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.098613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.198950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.198974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.198977Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.299293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.299308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.299312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.388969Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:22.388989Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-09-30T14:51:22.388996Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-09-30T14:51:22.399652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.399672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.399675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.500011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.500034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.500038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.600366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.600386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.600390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.700705Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.700738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.700742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.801031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.801050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.801053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:22.901408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:22.901432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:22.901435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.001746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.001763Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.001766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.102116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.102134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.102137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.202469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.202488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.202491Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.302816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.302843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.302847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.403150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.403167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.403170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.503524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.503543Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.503557Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.603887Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.603909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.603914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.704221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.704244Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.704247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.804579Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.804603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.804606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:23.904936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:23.904956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:23.904958Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.005273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.005290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.005293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.105620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.105640Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.105643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.205983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.206004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.206006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.306338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.306361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.306364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.406708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.406728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.406743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.507048Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.507070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.507074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.607385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.607404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.607408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.707731Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.707749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.707754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.808078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.808099Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.808102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:24.908396Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:24.908411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:24.908413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.008794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.008818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.008822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.109150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.109169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.109173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.209509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.209530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.209533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.309850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.309870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.309873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.410216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.410238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.410242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.510565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.510581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.510583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.610914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.610933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.610936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.711285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.711307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.711312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.811605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.811621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.811624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:25.911962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:25.911980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:25.911982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.012303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.012388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.012391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.112681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.112706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.112710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.212996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.213015Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.213018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.313375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.313416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.313419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.413661Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.413677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.413681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.514049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.514067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.514070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.614431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.614454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.614458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.714782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.714817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.714820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.815140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.815158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.815161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:26.915459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:26.915474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:26.915477Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.015817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.015834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.015837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.116181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.116200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.116203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.216534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.216552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.216556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.316855Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.316872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.316876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.380852Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:51:27.380918Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 2
2025-09-30T14:51:27.381290Z node 3 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:51:27.381583Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 2 DataSize: 0 UsedReserveSize: 0
2025-09-30T14:51:27.381628Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:51:27.389241Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:27.389259Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 160 bytes (160)
2025-09-30T14:51:27.389265Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 160 (8388608)
2025-09-30T14:51:27.417220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.417239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.417242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.517568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.517587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.517591Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.617955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.617982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.617985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.718329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.718350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.718354Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.818666Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.818687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.818690Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:27.919025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:27.919042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:27.919044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.019323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.019339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.019346Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.119713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.119733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.119736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.220062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.220080Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.220084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.320412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.320431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.320434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.420758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.420775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.420779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.521104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.521120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.521123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:51:28.569161Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Got event: ReadyToAcceptEvent
2025-09-30T14:51:28.569453Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0]  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:51:28.569471Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 2
2025-09-30T14:51:28.569910Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:51:28.570081Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:51:28.570147Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.570161Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.570203Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:51:28.570247Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:28.570278Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:51:28.570285Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:51:28.570310Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 1 size 98 offset: -1
2025-09-30T14:51:28.570320Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:51:28.570339Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.570351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.570357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:51:28.570387Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-09-30T14:51:28.570435Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 172 count 1 nextOffset 2 batches 1
2025-09-30T14:51:28.570446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.570488Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 160 WTime 1759243888570
2025-09-30T14:51:28.570535Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:51:28.570548Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 160
2025-09-30T14:51:28.571561Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 160 actorID [3:7555894706490153644:2466]
2025-09-30T14:51:28.571582Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:51:28.571601Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 160
2025-09-30T14:51:28.571613Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:51:28.571621Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:51:28.571633Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-09-30T14:51:28.571670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.571675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.571676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.571683Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:28.571685Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:51:28.571688Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-09-30T14:51:28.571691Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-09-30T14:51:28.571698Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 320 CachedBlobs 2
2025-09-30T14:51:28.571704Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-09-30T14:51:28.571731Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:51:28.572020Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:51:28.572197Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 2 written { offset: 1 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-09-30T14:51:28.572217Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-09-30T14:51:28.572221Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-09-30T14:51:28.621453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.621472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.621474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.721817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.721841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.721844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.822172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.822192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.822195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:28.922487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:28.922520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:28.922523Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.022868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.022886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.022889Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.123257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.123275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.123279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.223568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.223586Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.223589Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.323923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.323940Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.323944Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.424280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.424296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.424300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.524626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.524644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.524647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.624983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.625003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.625006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.725352Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.725373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.725377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.825695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.825727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.825730Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:29.926026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:29.926045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:29.926049Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.026369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.026385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.026388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.126771Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.126790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.126793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.227100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.227118Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.227121Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.327464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.327484Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.327488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.427800Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.427817Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.427820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.528155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.528185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.528189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.628455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.628471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.628473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.728861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.728878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.728881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.829231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.829254Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.829257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:30.929581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:30.929601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:30.929605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.029914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.029938Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.029941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.130264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.130284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.130287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.230615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.230634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.230637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.330961Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.330978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.330981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.431333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.431348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.431351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.531668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.531686Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.531688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.632020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.632040Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.632044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.732383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.732401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.732404Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.832737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.832764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.832768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:31.933090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:31.933108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:31.933111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.033417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.033436Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.033439Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.133744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.133764Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.133768Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.234125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.234145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.234148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.334511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.334531Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.334535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.389380Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:32.389399Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:51:32.389404Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-09-30T14:51:32.389409Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-09-30T14:51:32.434824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.434840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.434843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.535194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.535218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.535221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.635547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.635571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.635576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.735891Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.735910Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.735912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.836243Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.836261Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.836264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:32.936581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:32.936596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:32.936599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.036936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.036954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.036957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.137301Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.137318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.137320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.237600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.237616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.237619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.338025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.338042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.338046Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.438355Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.438372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.438375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.538704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.538723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.538726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.639081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.639100Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.639104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.739364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.739381Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.739385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.839762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.839778Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.839781Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:33.940137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:33.940153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:33.940155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.040452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.040482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.040485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.140843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.140861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.140864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.241192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.241211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.241215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.341532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.341551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.341554Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.441885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.441906Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.441909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.542229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.542248Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.542251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.642602Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.642623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.642626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.742933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.742952Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.742955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.843305Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.843326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.843329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:34.943606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:34.943623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:34.943626Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.043988Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.044009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.044012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.144297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.144316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.144319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.244689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.244708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.244711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.345221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.345240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.345242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.445394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.445411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.445414Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.545730Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.545752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.545756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.646116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.646134Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.646138Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.746453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.746471Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.746474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.846810Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.846827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.846829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:35.947153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:35.947178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:35.947181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.047505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.047521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.047524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.147877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.147895Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.147898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.248208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.248232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.248234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.348533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.348549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.348551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.448925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.448956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.448959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.549250Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.549266Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.549269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.649625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.649643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.649645Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.749963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.749980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.749983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.850297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.850324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.850327Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:36.950676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:36.950695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:36.950699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.051025Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.051042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.051045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.151383Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.151400Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.151402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.251726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.251743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.251745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.352092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.352112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.352115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.389532Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:37.389547Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:51:37.389550Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-09-30T14:51:37.389554Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-09-30T14:51:37.452441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.452458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.452461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.552803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.552822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.552825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.653140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.653170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.653174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.753490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.753508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.753511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.853843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.853859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.853862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:37.954193Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:37.954210Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:37.954214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.054555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.054571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.054573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.154908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.154925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.154927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.255275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.255294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.255297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.355606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.355624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.355628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.455936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.455949Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.455951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.556304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.556318Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.556321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.656683Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.656701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.656703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.757018Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.757036Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.757039Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.857357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.857374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.857377Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:38.957699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:38.957717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:38.957720Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.058081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.058104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.058108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.158434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.158456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.158459Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.258777Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.258795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.258798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.359133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.359149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.359152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.459452Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.459469Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.459472Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.559820Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.559835Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.559837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.660182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.660209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.660213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.760535Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.760563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.760566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.860884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.860902Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.860905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:39.961229Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:39.961253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:39.961255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.061598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.061615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.061618Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.161948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.161968Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.161971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.262285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.262300Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.262303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.362664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.362680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.362682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.463009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.463024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.463027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.563308Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.563323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.563325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.663706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.663735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.663739Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.764067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.764084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.764088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.864419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.864440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.864444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:40.964753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:40.964770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:40.964773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.065106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.065124Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.065128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.165468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.165500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.165504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.265779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.265796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.265799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.366175Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.366193Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.366197Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.466492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.466510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.466513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.566840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.566857Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.566859Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.667224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.667256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.667260Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.767561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.767581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.767583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.867953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.867976Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.867979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:41.968275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:41.968291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:41.968294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.068610Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.068625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.068627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.168982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.169004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.169007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.269372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.269389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.269392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.369668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.369685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.369689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.389703Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:42.389719Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:51:42.389722Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-09-30T14:51:42.389726Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-09-30T14:51:42.470041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.470060Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.470062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.570363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.570380Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.570384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.670745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.670762Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.670765Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.771163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.771182Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.771185Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.871446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.871465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.871468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:42.971805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:42.971822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:42.971825Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.072150Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.072170Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.072174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.172481Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.172500Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.172503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.272829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.272848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.272852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.373174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.373191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.373194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.473582Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.473601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.473604Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.573926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.573945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.573950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.674291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.674311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.674315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.774630Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.774651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.774655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.874973Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.874993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.874996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:43.975348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:43.975366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:43.975369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.075681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.075712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.075716Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.176051Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.176072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.176074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.276408Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.276441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.276444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.376719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.376735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.376738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.477128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.477149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.477152Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.577411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.577431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.577434Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.677790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.677814Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.677818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.778167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.778188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.778207Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.878517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.878536Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.878539Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:44.978845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:44.978865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:44.978868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.079201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.079221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.079224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.179553Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.179570Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.179573Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.279898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.279918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.279922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.380245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.380263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.380266Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.480603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.480621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.480623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.580963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.580984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.580987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.681295Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.681319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.681322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.781659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.781680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.781684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.882017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.882052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.882055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:45.982334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:45.982353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:45.982357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.082722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.082743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.082746Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.183086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.183105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.183109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.283425Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.283444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.283448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.383758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.383783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.383786Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.484108Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.484126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.484130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.584451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.584467Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.584470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.684822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.684841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.684845Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.785184Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.785205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.785209Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.885561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.885582Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.885585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:46.985892Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:46.985911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:46.985914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.086257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.086276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.086279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.186594Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.186611Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.186614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.286888Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.286908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.286912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.387287Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.387304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.387307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.389916Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:47.389932Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:51:47.389937Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-09-30T14:51:47.389943Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-09-30T14:51:47.487658Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.487681Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.487685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.587962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.587981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.587984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.688358Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.688378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.688382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.788701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.788723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.788727Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.889074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.889095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.889098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:47.989402Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:47.989421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:47.989424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.089758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.089775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.089780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.190068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.190097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.190101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.290464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.290482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.290485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.390796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.390816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.390819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.491140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.491159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.491161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.591490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.591505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.591507Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.691874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.691894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.691897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.792221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.792241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.792245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.892576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.892595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.892598Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:48.992931Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:48.992951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:48.992954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.093254Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.093273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.093276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.193603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.193623Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.193627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.294000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.294027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.294031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.394317Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.394340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.394343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.494691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.494709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.494712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.595028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.595058Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.595061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.695394Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.695413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.695426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.795748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.795767Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.795770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.896086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.896113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.896116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:49.996463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:49.996480Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:49.996483Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.096805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.096823Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.096827Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.197149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.197169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.197173Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.297501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.297522Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.297526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.397852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.397876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.397879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.498231Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.498257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.498261Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.598564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.598584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.598587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.698884Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.698909Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.698912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.799293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.799314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.799319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.899600Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:50.899621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:50.899625Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:50.999983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.000006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.000009Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.100294Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.100312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.100315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.200672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.200689Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.200692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.301033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.301062Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.301066Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.401351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.401371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.401373Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.501732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.501753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.501756Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.602045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.602067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.602071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.702443Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.702464Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.702468Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.802782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.802802Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.802806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:51.903125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:51.903154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:51.903157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.003466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.003485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.003488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.103836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.103858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.103861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.204189Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.204213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.204216Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.304543Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.304563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.304567Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.390097Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:52.390114Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:51:52.390118Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-09-30T14:51:52.390124Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-09-30T14:51:52.404911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.404930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.404934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.505242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.505262Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.505266Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.605596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.605613Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.605615Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.705950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.705980Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.705983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.806306Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.806326Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.806329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:52.906629Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:52.906650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:52.906653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.007028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.007050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.007054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.107348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.107372Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.107375Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.207713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.207734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.207738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.308084Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.308106Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.308110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.408426Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.408446Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.408449Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.508729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.508748Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.508751Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.609105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.609123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.609127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.709465Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.709485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.709488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.809826Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.809848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.809852Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:53.910183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:53.910202Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:53.910205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.010486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.010504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.010508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.110901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.110925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.110928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.211239Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.211279Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.211282Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.311541Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.311561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.311563Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.411914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.411941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.411945Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.512256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.512275Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.512277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.612636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.612656Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.612660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.713006Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.713026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.713028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.813344Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.813371Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.813374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:54.913677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:54.913699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:54.913702Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.014024Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.014041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.014044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.114423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.114448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.114451Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.214769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.214793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.214796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.315123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.315145Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.315160Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.415435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.415455Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.415458Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.515776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.515794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.515797Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.616110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.616127Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.616130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.716503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.716524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.716527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.816849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.816867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.816869Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:55.917183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:55.917212Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:55.917214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.017559Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.017579Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.017581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.117928Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.117946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.117948Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.218249Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.218269Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.218272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.318624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.318643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.318655Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.418993Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.419014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.419017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.519299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.519321Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.519325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.619679Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.619713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.619717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.720044Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.720070Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.720074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.820366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.820384Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.820392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:56.920718Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:56.920738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:56.920741Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.021096Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.021117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.021120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.121442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.121460Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.121462Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.221775Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.221795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.221798Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.322146Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.322176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.322178Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.380997Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:51:57.381041Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 3
2025-09-30T14:51:57.381381Z node 3 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:51:57.381679Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 3 DataSize: 0 UsedReserveSize: 0
2025-09-30T14:51:57.381722Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:51:57.390290Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:51:57.390325Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:51:57.390329Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-09-30T14:51:57.390334Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-09-30T14:51:57.422501Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.422520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.422524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.522854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.522872Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.522876Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.623200Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.623219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.623223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.723561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.723581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.723584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.823900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.823922Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.823926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:57.924272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:57.924292Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:57.924296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.024614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.024634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.024637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.124955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.124978Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.124982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.225314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.225332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.225335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.325680Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.325700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.325704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.426032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.426050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.426053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.526368Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.526385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.526387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:51:58.626708Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.626725Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.626728Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.727067Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.727086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.727089Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.827410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.827433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.827437Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:58.927761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:58.927783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:58.927787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.028104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.028122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.028125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.128488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.128506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.128509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.228837Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.228858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.228861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.329165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.329191Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.329194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.429515Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.429530Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.429533Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.529879Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.529897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.529901Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.630232Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.630251Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.630253Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.730571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.730592Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.730596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.830950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.830969Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.830971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:51:59.931303Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:51:59.931324Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:51:59.931328Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.031628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.031646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.031650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.132004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.132031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.132034Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.232345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.232366Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.232369Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.332695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.332726Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.332729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.433053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.433073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.433076Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.533420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.533441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.533444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.633770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.633790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.633793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.734115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.734135Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.734140Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.834486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.834508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.834510Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:00.934813Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:00.934831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:00.934834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.035153Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.035172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.035176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.135504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.135534Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.135538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.235890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.235911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.235915Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.336343Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.336428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.336432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.436587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.436631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.436634Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.536934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.536956Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.536959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.637264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.637285Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.637288Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.737617Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.737636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.737639Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.837991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.838014Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.838017Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:01.938349Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:01.938374Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:01.938378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.038784Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.038806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.038809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.139053Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.139107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.139111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.239393Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.239413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.239417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.339780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.339805Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.339808Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.390694Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:52:02.390716Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:52:02.390719Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-09-30T14:52:02.390725Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-09-30T14:52:02.440095Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.440113Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.440116Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.540428Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.540448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.540450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.640886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.640912Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.640916Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.741166Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.741257Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.741304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.841504Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.841599Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.841628Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:02.941866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:02.941954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:02.942013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.042215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.042235Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.042242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.142571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.142593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.142597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.242983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.243030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.243035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.343272Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.343293Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.343296Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.443616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.443637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.443650Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.543970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.543994Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.543998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.644337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.644362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.644365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.744711Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.744742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.744745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.845045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.845068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.845072Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:03.945376Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:03.945410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:03.945413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.045709Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.045729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.045732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.146068Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.146086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.146088Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.246476Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.246499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.246503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.346794Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.346816Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.346819Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.447130Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.447154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.447157Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.547497Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.547521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.547525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.647836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.647858Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.647861Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.748154Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.748174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.748177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.848556Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.848580Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.848583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:04.948911Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:04.948934Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:04.948937Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.049255Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.049274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.049277Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.149605Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.149627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.149631Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.249960Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.249979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.249983Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.350320Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.350341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.350345Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.450668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.450691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.450694Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.551011Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.551033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.551037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.651388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.651412Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.651415Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.751701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.751734Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.751737Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.852079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.852103Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.852107Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:05.952392Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:05.952410Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:05.952413Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.052744Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.052766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.052770Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
E0930 14:52:06.116515469 2226325 chttp2_transport.cc:1143]             ipv4:127.0.0.1:9955: Received a GOAWAY with error code ENHANCE_YOUR_CALM and debug data equal to "too_many_pings". Current keepalive time (before throttling): 2500ms
2025-09-30T14:52:06.153120Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.153143Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.153147Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.253499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.253524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.253528Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.353840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.353866Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.353870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.454177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.454199Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.454203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.554524Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.554545Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.554548Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.654899Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.654924Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.654927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.755256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.755280Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.755283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.855537Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.855558Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.855561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:06.955941Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:06.955966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:06.955970Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.056314Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.056335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.056338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.156654Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.156687Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.156691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.256979Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.257004Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.257007Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.357357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.357378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.357382Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.390722Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:52:07.390743Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:52:07.390748Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-09-30T14:52:07.390755Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-09-30T14:52:07.457712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.457733Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.457736Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.558037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.558057Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.558061Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.658419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.658441Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.658444Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.758779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.758803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.758807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.859136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.859159Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.859163Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:07.959461Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:07.959482Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:07.959485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.059824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.059846Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.059849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.160162Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.160183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.160186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.260525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.260547Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.260551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.360865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.360894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.360897Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.461214Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.461234Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.461237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.528589Z :INFO: [/Root] [] [] Start federated write session to database 'dc1' (previous was dc2) FederationState: { Status: SUCCESS SelfLocation: "fancy_datacenter" DbInfos: [ { name: "dc1" path: "/Root" id: "account-dc1" endpoint: "localhost:26284" location: "dc1" status: AVAILABLE weight: 1000 } { name: "dc2" path: "/Root" id: "account-dc2" endpoint: "localhost:26284" location: "dc2" status: AVAILABLE weight: 500 } { name: "dc3" path: "/Root" id: "account-dc3" endpoint: "localhost:26284" location: "dc3" status: AVAILABLE weight: 500 } ] ControlPlaneEndpoint: cp.logbroker-federation:2135 }
2025-09-30T14:52:08.528725Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:52:08.528750Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-09-30T14:52:08.529099Z :INFO: [/Root]  TraceId []  SessionId [src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-09-30T14:52:08.529105Z :INFO: [/Root]  TraceId []  SessionId [src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0]  MessageGroupId [src_id] Write session will now close
2025-09-30T14:52:08.529114Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-09-30T14:52:08.529124Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0]  MessageGroupId [src_id] Write session: aborting
2025-09-30T14:52:08.529166Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.529254Z :INFO: [/Root]  TraceId []  SessionId [src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0]  MessageGroupId [src_id] Write session: gracefully shut down, all writes complete
2025-09-30T14:52:08.529261Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0]  MessageGroupId [src_id] Write session: destroy
2025-09-30T14:52:08.529522Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-09-30T14:52:08.529685Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:52:08.529702Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 3 sessionId: src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0 grpc read done: success: 0 data: 
2025-09-30T14:52:08.529709Z node 3 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 4
2025-09-30T14:52:08.529712Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 3 sessionId: src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0 grpc read failed
2025-09-30T14:52:08.529726Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 3 sessionId: src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0 grpc closed
2025-09-30T14:52:08.529734Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 3 sessionId: src_id|64e871d9-daca437f-c6c441a6-d7e9292e_0 is DEAD
2025-09-30T14:52:08.529891Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-09-30T14:52:08.529930Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 4 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:42020
2025-09-30T14:52:08.529942Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=4 sessionId= userAgent="topic server" ip=ipv6:[::1]:42020 proto=topic  topic=test-topic durationSec=0
2025-09-30T14:52:08.529947Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:52:08.530153Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:52:08.530283Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7555894882583816445:3106] destroyed
2025-09-30T14:52:08.530308Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:52:08.530323Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.530330Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.530333Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.530502Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 4 sessionId:  describe result for acl check
2025-09-30T14:52:08.530546Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:52:08.530552Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:52:08.530554Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:52:08.530559Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [3:7555895140281859125:3981] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:52:08.531055Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [3:7555895140281859125:3981] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:52:08.533957Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555895140281859125:3981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:08.537866Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555895140281859125:3981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:52:08.537891Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [3:7555895140281859125:3981] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=0
2025-09-30T14:52:08.537895Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555895140281859125:3981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:08.537904Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 4 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:52:08.538129Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [3:7555895140281859157:3981], now have 1 active actors on pipe
2025-09-30T14:52:08.538142Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 3, Generation: 1
2025-09-30T14:52:08.538151Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.538158Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.538186Z node 3 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:52:08.538196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.538201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.538204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:08.538218Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.538233Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:52:08.538252Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.538350Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:08.538375Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:08.538410Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:52:08.538452Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 4 partition: 0 MaxSeqNo: 2 sessionId: src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0
2025-09-30T14:52:08.538788Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:52:08.538813Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243928538 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:52:08.538872Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: last_seq_no: 2 session_id: "src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-09-30T14:52:08.561578Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.561603Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.561607Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.661935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.661959Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.661962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.762289Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.762315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.762319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.862642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.862666Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.862670Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:08.962965Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:08.962995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:08.962998Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.063338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.063361Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.063364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.163799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.163821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.163824Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.264038Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.264059Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.264063Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.364397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.364419Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.364422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.464755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.464776Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.464779Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.538977Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [3:7555895140281859125:3981] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:52:09.547185Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [3:7555895140281859125:3981] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=1 Status=SUCCESS
2025-09-30T14:52:09.547202Z node 3 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [3:7555895140281859125:3981] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:52:09.565074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.565094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.565097Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.665432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.665453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.665457Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.765785Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.765806Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.765809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.866132Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.866164Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.866169Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:09.966487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:09.966512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:09.966516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.066854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.066877Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.066881Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.167201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.167223Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.167226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.267561Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.267583Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.267587Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.367898Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.367918Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.367921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.468270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.468297Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.468302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.568572Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.568593Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.568597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.668975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.668996Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.669000Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.769341Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.769362Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.769365Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.869685Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.869710Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.869713Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:10.970012Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:10.970033Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:10.970037Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.070364Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.070387Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.070389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.170724Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.170745Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.170749Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.271074Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.271098Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.271102Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.371416Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.371435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.371438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.471773Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.471796Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.471799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.572123Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.572144Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.572148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.672431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.672454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.672456Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.772829Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.772847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.772849Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.873171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.873192Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.873195Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:11.973505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:11.973525Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:11.973527Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.073848Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.073870Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.073873Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.174236Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.174270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.174274Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.274596Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.274616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.274620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.374914Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.374933Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.374936Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.390854Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:52:12.390874Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:52:12.390879Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-09-30T14:52:12.390885Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-09-30T14:52:12.475311Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.475335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.475338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.575619Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.575643Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.575647Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.676001Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.676028Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.676032Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.776363Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.776385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.776390Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.876717Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.876738Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.876742Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:12.977050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:12.977069Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:12.977073Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.077409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.077431Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.077435Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.177759Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.177787Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.177790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.278110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.278133Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.278137Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.378466Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.378488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.378492Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.478822Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.478844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.478847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.579110Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.579126Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.579128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.679529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.679546Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.679549Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.779882Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.779904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.779907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.880220Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.880242Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.880245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:13.980677Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:13.980699Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:13.980700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.080939Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.080962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.080966Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.181247Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.181270Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.181273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.281595Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.281621Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.281624Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.381955Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.381972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.381974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.482360Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.482386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.482389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.582682Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.582701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.582704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.683055Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.683079Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.683082Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.783395Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.783421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.783424Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.883735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.883754Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.883757Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:14.984078Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:14.984109Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:14.984112Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.084450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.084470Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.084474Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.184818Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.184840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.184844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.285158Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.285179Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.285183Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.385488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.385509Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.385512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.485867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.485890Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.485894Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.586165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.586187Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.586190Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.686526Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.686541Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.686544Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.786874Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.786893Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.786896Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.887310Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.887332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.887335Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:15.987614Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:15.987635Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:15.987637Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.087957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.087981Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.087985Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.188281Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.188299Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.188302Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.288664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.288688Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.288691Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.389019Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.389039Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.389041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.489378Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.489397Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.489399Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.589684Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.589701Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.589704Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.690027Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.690047Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.690050Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.790421Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.790438Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.790442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.890729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.890750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.890753Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:16.991155Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:16.991174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:16.991177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.091429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.091450Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.091453Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.191821Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.191840Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.191843Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.292188Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.292208Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.292211Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.391046Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:52:17.391067Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:52:17.391071Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-09-30T14:52:17.391076Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-09-30T14:52:17.392506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.392519Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.392521Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.492904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.492923Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.492927Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.593215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.593237Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.593240Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.693576Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.693597Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.693601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.793953Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.793972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.793975Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.894315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.894353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.894356Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:17.994653Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:17.994673Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:17.994676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.094991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.095013Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.095016Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.195357Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.195385Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.195388Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.295700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.295719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.295722Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.396065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.396087Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.396091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.496422Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.496445Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.496448Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.596766Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.596790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.596793Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.697104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.697136Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.697139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.797487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.797513Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.797517Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.897834Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.897856Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.897860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:18.998181Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:18.998213Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:18.998217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.098486Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.098503Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.098505Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.198883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.198905Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.198908Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.299225Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.299263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.299267Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.399541Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.399564Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.399568Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.499935Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.499954Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.499957Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.600264Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.600283Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.600286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.700627Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.700649Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.700652Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.800982Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.801005Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.801008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:19.901304Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:19.901322Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:19.901325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.001672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.001692Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.001695Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.102056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.102081Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.102085Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.202401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.202423Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.202432Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.302761Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.302780Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.302782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.403105Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.403125Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.403128Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.503463Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.503485Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.503487Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.603783Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.603807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.603811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.704149Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.704172Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.704176Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.804506Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.804529Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.804532Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:20.904841Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:20.904860Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:20.904862Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.005205Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.005226Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.005228Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.105560Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.105581Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.105584Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.205863Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.205883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.205885Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.306245Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.306273Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.306276Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.406612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.406632Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.406636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.506962Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.506984Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.506987Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.607329Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.607348Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.607351Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.707675Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.707703Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.707706Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.808035Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.808054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.808056Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:21.908831Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:21.908864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:21.908868Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.009204Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.009221Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.009224Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.109590Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.109612Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.109616Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.209951Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.209972Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.209974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.310290Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.310307Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.310325Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.391270Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:52:22.391292Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:52:22.391295Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-09-30T14:52:22.391299Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-09-30T14:52:22.410633Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.410657Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.410660Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.510963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.510989Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.510991Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.611332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.611350Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.611353Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.711719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.711743Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.711747Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.812065Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.812086Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.812094Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:22.912389Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:22.912409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:22.912411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.012729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.012750Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.012752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.113071Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.113090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.113092Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.213488Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.213508Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.213511Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.313809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.313828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.313830Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.414177Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.414198Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.414201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.514540Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.514562Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.514565Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.614865Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.614883Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.614886Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.715219Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.715238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.715241Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.815571Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.815601Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.815606Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:23.915925Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:23.915946Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:23.915950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.016291Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.016315Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.016319Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.116644Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.116668Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.116672Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.217003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.217026Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.217030Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.317312Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.317332Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.317334Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.417697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.417719Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.417723Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.518031Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.518052Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.518054Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.618391Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.618417Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.618420Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.718769Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.718795Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.718799Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.819090Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.819111Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.819115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:24.919454Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:24.919475Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:24.919478Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.019809Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.019832Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.019836Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.120148Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.120167Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.120171Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.220512Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.220538Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.220541Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.320844Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.320864Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.320867Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.421186Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.421201Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.421203Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.521566Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.521585Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.521588Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.621900Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.621919Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.621921Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.722263Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.722284Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.722286Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.822620Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.822642Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.822646Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:25.922963Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:25.922999Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:25.923003Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.023316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.023337Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.023340Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.123676Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.123697Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.123700Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.224020Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.224042Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.224045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.324379Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.324401Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.324403Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.424712Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.424732Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.424735Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.525091Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.525115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.525119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.625406Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.625429Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.625433Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.725790Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.725811Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.725815Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.826139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.826161Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.826165Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:26.926490Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:26.926514Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:26.926516Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.026854Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.026875Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.026878Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.127196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.127215Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.127217Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.227551Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.227574Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.227577Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.327904Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.327926Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.327930Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.381130Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:155: [72075186224037893][rt3.dc1--test-topic] TPersQueueReadBalancer::HandleWakeup
2025-09-30T14:52:27.381169Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:451: [72075186224037893][rt3.dc1--test-topic] Send TEvPersQueue::TEvStatus TabletId: 72075186224037892 Cookie: 4
2025-09-30T14:52:27.381720Z node 3 :PERSQUEUE DEBUG: partition.cpp:1000: [72075186224037892][Partition][0][StateIdle] Topic PartitionStatus PartitionSize: 0 UsedReserveSize: 0 ReserveSize: 0 PartitionConfig{ LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 }
2025-09-30T14:52:27.382062Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:561: [72075186224037893][rt3.dc1--test-topic] Send TEvPeriodicTopicStats PathId: 13 Generation: 1 StatsReportRound: 4 DataSize: 0 UsedReserveSize: 0
2025-09-30T14:52:27.382118Z node 4 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1824: [72075186224037893][rt3.dc1--test-topic] ProcessPendingStats. PendingUpdates size 1
2025-09-30T14:52:27.391436Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:52:27.391457Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:52:27.391462Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 320 bytes (320)
2025-09-30T14:52:27.391467Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 320 (8388608)
2025-09-30T14:52:27.428238Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.428256Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.428259Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.528638Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.528664Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.528667Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.628950Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.628971Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.628974Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.729316Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.729338Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.729342Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.829651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.829669Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.829671Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:27.930008Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:27.930041Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:27.930045Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.030386Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.030407Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.030409Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.130729Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.130752Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.130755Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.231077Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.231101Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.231104Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.331411Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.331440Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.331442Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.431782Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.431803Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.431807Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.532117Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.532139Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.532142Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.632473Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.632495Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.632499Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
>>> Ready to answer: ok
2025-09-30T14:52:28.649707Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
>>> Got event: ReadyToAcceptEvent
2025-09-30T14:52:28.649979Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0]  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:52:28.649994Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 3
2025-09-30T14:52:28.650298Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:52:28.650411Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:52:28.650457Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.650475Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.650511Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:52:28.650546Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:52:28.650569Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:52:28.650576Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:52:28.650595Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 3 partNo : 0 messageNo: 1 size 98 offset: -1
2025-09-30T14:52:28.650605Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:52:28.650636Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.650651Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.650659Z node 3 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:52:28.650695Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 3 partNo 0
2025-09-30T14:52:28.650746Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 3 partNo 0 FormedBlobsCount 0 NewHead: Offset 2 PartNo 0 PackedSize 172 count 1 nextOffset 3 batches 1
2025-09-30T14:52:28.650758Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.650818Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 2,1 HeadOffset 2 endOffset 2 curOffset 3 d0000000000_00000000000000000002_00000_0000000001_00000? size 160 WTime 1759243948650
2025-09-30T14:52:28.650864Z node 3 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:52:28.650879Z node 3 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 2 partNo 0 count 1 size 160
2025-09-30T14:52:28.651880Z node 3 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 2 count 1 size 160 actorID [3:7555894706490153644:2466]
2025-09-30T14:52:28.651907Z node 3 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:52:28.651926Z node 3 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 2 partno 0 count 1 parts 0 suffix '63' size 160
2025-09-30T14:52:28.651935Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 105 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:52:28.651944Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:52:28.651953Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 3, partNo: 0, Offset: 2 is stored on disk
2025-09-30T14:52:28.651986Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.651995Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.651997Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.652007Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:52:28.652009Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:52:28.652012Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000002_00000_0000000001_00000?
2025-09-30T14:52:28.652015Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 3 keys were taken away. Let's read 480 bytes (480)
2025-09-30T14:52:28.652019Z node 3 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 3, size 480 (8388608)
2025-09-30T14:52:28.652029Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:1181: [PQ: 72075186224037892] Topic 'rt3.dc1--test-topic' counters. CacheSize 480 CachedBlobs 3
2025-09-30T14:52:28.652037Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-09-30T14:52:28.652062Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:52:28.652357Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:52:28.652528Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 3 written { offset: 2 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-09-30T14:52:28.652552Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-09-30T14:52:28.652557Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0]  MessageGroupId [src_id] Write session: acknoledged message 1
2025-09-30T14:52:28.652862Z node 3 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 4 sessionId: src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0 grpc read done: success: 0 data: 
2025-09-30T14:52:28.652871Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 4 sessionId: src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0 grpc read failed
2025-09-30T14:52:28.652879Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 4 sessionId: src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0 grpc closed
2025-09-30T14:52:28.652884Z node 3 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 4 sessionId: src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0 is DEAD
2025-09-30T14:52:28.653041Z node 3 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:52:28.653094Z node 3 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [3:7555895140281859157:3981] destroyed
2025-09-30T14:52:28.653108Z node 3 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:52:28.653115Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.653119Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.653122Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.653135Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 1, Msg: Cancelled on the server side, Details: , InternalError: 0
2025-09-30T14:52:28.653152Z :ERROR: [/Root]  TraceId []  SessionId [src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0]  MessageGroupId [src_id] Got error. Status: CLIENT_CANCELLED, Description: <main>: Error: GRpc error: (1): Cancelled on the server side 
2025-09-30T14:52:28.653156Z :ERROR: [/Root]  TraceId []  SessionId [src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0]  MessageGroupId [src_id] Write session will not restart after a fatal error
2025-09-30T14:52:28.653159Z :INFO: [/Root]  TraceId []  SessionId [src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0]  MessageGroupId [src_id] Write session will now close
2025-09-30T14:52:28.653175Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0]  MessageGroupId [src_id] Write session: aborting
2025-09-30T14:52:28.656990Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|c137e497-9203ddfd-5abd76a3-59bfff5b_0]  MessageGroupId [src_id] Write session: destroy
2025-09-30T14:52:28.732828Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.732847Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.732850Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.833174Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.833194Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.833196Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:52:28.933520Z node 3 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:52:28.933552Z node 3 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:52:28.933555Z node 3 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:11.919671Z :WriteSessionWriteInHandlers INFO: Random seed for debugging is 1759243811919665
2025-09-30T14:50:12.014702Z node 1 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[1:7555894640084956734:2152];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:12.014858Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
test_client.cpp: SetPath # /home/runner/.ya/build/build_root/rk13/002625/r3tmp/tmpsqzSsl/pdisk_1.dat
2025-09-30T14:50:12.023344Z node 1 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:12.021410Z node 2 :METADATA_PROVIDER WARN: log.cpp:841: fline=table_exists.cpp:54;actor=TTableExistsActor;event=undelivered;self_id=[2:7555894641912428179:2199];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:12.023685Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=scheme_cache_undelivered_message;
2025-09-30T14:50:12.024520Z node 2 :PQ_READ_PROXY DEBUG: caching_service.cpp:44: Direct read cache: : Created
2025-09-30T14:50:12.083180Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:12.083207Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:12.085556Z node 1 :HIVE WARN: hive_impl.cpp:811: HIVE#72057594037968897 Handle TEvInterconnect::TEvNodeConnected, NodeId 2 Cookie 2
2025-09-30T14:50:12.086564Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(2, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-09-30T14:50:12.094950Z node 2 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
2025-09-30T14:50:12.100910Z node 1 :IMPORT WARN: schemeshard_import.cpp:307: Table profiles were not loaded
2025-09-30T14:50:12.105294Z node 1 :KQP_PROXY WARN: kqp_finalize_script_service.cpp:135: [ScriptExecutions] [TKqpFinalizeScriptService] Failed to check script execution tables existence, scheme status: PathErrorUnknown, path: Root/.metadata/script_executions
TServer::EnableGrpc on GrpcPort 17055, node 1
2025-09-30T14:50:12.116066Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Unknown -> Disconnected
2025-09-30T14:50:12.116077Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:190: distributable config is empty, broken or outdated, will use file: /home/runner/.ya/build/build_root/rk13/002625/r3tmp/yandexNqz7Ql.tmp
2025-09-30T14:50:12.116092Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:196: will try to initialize from file: /home/runner/.ya/build/build_root/rk13/002625/r3tmp/yandexNqz7Ql.tmp
2025-09-30T14:50:12.116096Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Disconnected -> Connecting
2025-09-30T14:50:12.116180Z node 1 :NET_CLASSIFIER WARN: net_classifier.cpp:202: successfully initialized from file: /home/runner/.ya/build/build_root/rk13/002625/r3tmp/yandexNqz7Ql.tmp
2025-09-30T14:50:12.116242Z node 1 :NET_CLASSIFIER ERROR: net_classifier.cpp:228: got bad distributable configuration
2025-09-30T14:50:12.117215Z node 1 :HIVE WARN: node_info.cpp:25: HIVE#72057594037968897 Node(1, (0,0,0,0)) VolatileState: Connecting -> Connected
2025-09-30T14:50:12.120423Z INFO: TTestServer started on Port 6958 GrpcPort 17055
TClient is connected to server localhost:6958
PQClient connected to localhost:17055
WaitRootIsUp 'Root'...
TClient::Ls request: Root
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "Root"
    PathId: 1
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 1
    CreateStep: 0
    ParentPathId: 1
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 1
      SubDomainVersion: 0
      SecurityStateVersion: 0
    }
    ChildrenExist: false
  }
  Children {
    Name: ".sys"
    PathId: 18446744073709551615
    SchemeshardId: 72057594046644480
    PathType: EPathTypeDir
    CreateFinished: true
    CreateTxId: 0
    CreateStep: 0
    ParentPathId: 18446744073709551615
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 0
      Pl...
(TRUNCATED)
WaitRootIsUp 'Root' success.
2025-09-30T14:50:12.145771Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpAlterSubDomain, opId: 281474976710657:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_alter_subdomain.cpp:311)
waiting...
waiting...
waiting...
waiting...
2025-09-30T14:50:12.467423Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894641912428329:2296], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.467462Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894641912428350:2299], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.467473Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.467882Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894640084957566:2325], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.467904Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894640084957590:2328], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.467912Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.468888Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateResourcePool, opId: 281474976710661:3, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:179)
2025-09-30T14:50:12.469045Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894641912428380:2301], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.469072Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.469186Z node 2 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [2:7555894641912428382:2302], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.469210Z node 2 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.469449Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894640084957627:2330], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.469487Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.469574Z node 1 :KQP_WORKLOAD_SERVICE WARN: scheme_actors.cpp:225: [WorkloadService] [TPoolFetcherActor] ActorId: [1:7555894640084957630:2331], DatabaseId: /Root, PoolId: default, Failed to fetch pool info, NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.469603Z node 1 :KQP_WORKLOAD_SERVICE WARN: kqp_workload_service.cpp:263: [WorkloadService] [Service] Failed to fetch pool default, DatabaseId: /Root, status: NOT_FOUND, issues: { <main>: Error: Resource pool default not found or you don't have access permissions }
2025-09-30T14:50:12.470268Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7555894641912428354:2126] txid# 281474976715657, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exists but creating right now (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateCreate), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:12.474034Z node 1 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [1:7555894640084957595:2329], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-09-30T14:50:12.479372Z node 2 :KQP_WORKLOAD_SERVICE WARN: helpers.h:73: [WorkloadService] [TPoolCreatorActor] ActorId: [2:7555894641912428353:2300], DatabaseId: /Root, PoolId: default, Scheduled retry for error: { <main>: Error: Transaction 281474976710661 completed, doublechecking }
2025-09-30T14:50:12.524485Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710662:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:12.534668Z node 1 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [1:7555894640084957757:2719] txid# 281474976710663, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:12.559314Z node 1 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [1:7555894640084957785:2344], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:3:16: Error: At function: KiReadTable!
        <main>:3:16: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Cluster]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:12.559420Z node 1 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=1&id=MTdjZTM2ZDktYTRkY2ZiMzktZDJmOTRmYjktNWFhNjIxNzI=, ActorId: [1:7555894640084957562:2322], ActorState: ExecuteState, TraceId: 01k6dhmfkh7jx6cnrvqpv68m1t, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:12.566026Z node 1 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 3 column: 16 } message: "At function: KiReadTable!" end_position { row: 3 column: 16 } severity: 1 issues { position { row: 3 column: 16 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Cluster]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 3 column: 16 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:12.569521Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710664:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
2025-09-30T14:50:12.579055Z node 2 :TX_PROXY ERROR: schemereq.cpp:590: Actor# [2:7555894641912428403:2146] txid# 281474976715658, issues: { message: "Check failed: path: \'/Root/.metadata/workload_manager/pools/default\', error: path exist, request accepts it (id: [OwnerId: 72057594046644480, LocalPathId: 8], type: EPathTypeResourcePool, state: EPathStateNoChanges), source_location: ydb/core/tx/schemeshard/schemeshard__operation_create_resource_pool.cpp:92" severity: 1 }
2025-09-30T14:50:12.598890Z node 2 :KQP_COMPILE_ACTOR ERROR: kqp_compile_actor.cpp:568: Compilation failed, self: [2:7555894641912428421:2308], status: SCHEME_ERROR, issues: <main>: Error: Type annotation, code: 1030
    <main>:5:17: Error: At function: KiReadTable!
        <main>:5:17: Error: Cannot find table 'db.[/Root/PQ/Config/V2/Versions]' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions., code: 2003
2025-09-30T14:50:12.599782Z node 2 :KQP_SESSION WARN: kqp_session_actor.cpp:2395: SessionId: ydb://session/3?node_id=2&id=NjFiYzdlOGQtZDAwYjgxZmEtMTUxNWQ3MzMtOWNiZDZjZmE=, ActorId: [2:7555894641912428321:2294], ActorState: ExecuteState, TraceId: 01k6dhmfkh31h0kb787qqssz3k, ReplyQueryCompileError, status SCHEME_ERROR remove tx with tx_id: 
2025-09-30T14:50:12.599999Z node 2 :PERSQUEUE_CLUSTER_TRACKER ERROR: cluster_tracker.cpp:167: failed to list clusters: { Response { QueryIssues { message: "Type annotation" issue_code: 1030 severity: 1 issues { position { row: 5 column: 17 } message: "At function: KiReadTable!" end_position { row: 5 column: 17 } severity: 1 issues { position { row: 5 column: 17 } message: "Cannot find table \'db.[/Root/PQ/Config/V2/Versions]\' because it does not exist or you do not have access permissions. Please check correctness of table path and user permissions." end_position { row: 5 column: 17 } issue_code: 2003 severity: 1 } } } TxMeta { } } YdbStatus: SCHEME_ERROR ConsumedRu: 1 }
2025-09-30T14:50:12.641526Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710665:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
=== Init DC: UPSERT INTO `/Root/PQ/Config/V2/Cluster` (name, balancer, local, enabled, weight) VALUES ("dc1", "localhost:17055", true, true, 1000), ("dc2", "dc2.logbroker.yandex.net", false, false, 1000);
2025-09-30T14:50:12.696906Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710666. Ctx: { TraceId: 01k6dhmft0528khk7fmx8q4f0g, Database: , SessionId: ydb://session/3?node_id=1&id=ZTM3OGY4MDEtYWM1NWU5M2EtYTdkYTE2NWQtNjdkMzJhZWI=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
=== CheckClustersList. Subcribe to ClusterTracker from [1:7555894640084958144:3009] 
2025-09-30T14:50:13.016115Z node 1 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:13.021767Z node 2 :TX_CONVEYOR ERROR: log.cpp:841: fline=service.h:53;problem=unexpected event for task executor;ev_type=NActors::TEvents::TEvWakeup;
2025-09-30T14:50:17.015300Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[1:7555894640084956734:2152];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:17.015348Z node 1 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
2025-09-30T14:50:17.020458Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=table_exists.cpp:59;actor=TTableExistsActor;event=timeout;self_id=[2:7555894641912428179:2199];send_to=[0:7307199536658146131:7762515];
2025-09-30T14:50:17.020501Z node 2 :METADATA_PROVIDER ERROR: log.cpp:841: fline=accessor_snapshot_base.cpp:71;action=cannot detect path existence;path=//Root/.metadata/initialization/migrations;error=timeout;
=== CheckClustersList. Ok
2025-09-30T14:50:17.812765Z node 1 :FLAT_TX_SCHEMESHARD WARN: schemeshard__operation.cpp:183: Operation part proposed ok, but propose itself is undo unsafe, suboperation type: ESchemeOpCreateTable, opId: 281474976710678:0, at schemeshard:  72057594046644480, first GetDB called at:  (GetDB first called at /home/runner/actions_runner/_work/ydb/ydb/ydb/core/tx/schemeshard/schemeshard__operation_create_table.cpp:684)
waiting...
PQ Client: create topic: rt3.dc1--test-topic with 1 partitions
CallPersQueueGRPC request to localhost:17055
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:17.834878Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
CallPersQueueGRPC request to localhost:17055
MetaRequest {
  CmdCreateTopic {
    Topic: "rt3.dc1--test-topic"
    NumPartitions: 1
    Config {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
  }
}
CallPersQueueGRPC response:
Status: 129
ProxyErrorCode: 53
SchemeStatus: 1
FlatTxId {
  TxId: 281474976710679
  SchemeShardTabletId: 72057594046644480
  PathId: 13
}
ErrorCode: OK
AddTopic: rt3.dc1--test-topic
===Run query:``DECLARE $version as Int64; DECLARE $path AS Utf8; DECLARE $cluster as Utf8; UPSERT INTO `/Root/PQ/Config/V2/Topics` (path, dc) VALUES ($path, $cluster); UPSERT INTO `/Root/PQ/Config/V2/Versions` (name, version) VALUES ("Topics", $version);`` with topic = test-topic, dc = dc1
2025-09-30T14:50:17.869376Z node 1 :KQP_EXECUTER ERROR: kqp_planner.cpp:123: TxId: 281474976710680. Ctx: { TraceId: 01k6dhmmvtayxc3bfafwsx9bj0, Database: , SessionId: ydb://session/3?node_id=1&id=YjJhZDgyZGUtZTcxYzk3YTktNjRjOGI3MGQtYTdhMTZmNTk=, PoolId: default, DatabaseId: /Root}. Database not set, use /Root
2025-09-30T14:50:17.872420Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][] pipe [1:7555894661559795200:3340] connected; active server actors: 1
2025-09-30T14:50:17.877395Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer__balancing.cpp:1517: [72075186224037893][rt3.dc1--test-topic] updating configuration. Deleted partitions []. Added partitions [0]
2025-09-30T14:50:17.877647Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:912: [72075186224037893][rt3.dc1--test-topic] Discovered subdomain [OwnerId: 72057594046644480, LocalPathId: 1] state, outOfSpace = 0 at RB 72075186224037893
2025-09-30T14:50:17.879837Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:138: [72075186224037893][rt3.dc1--test-topic] BALANCER INIT DONE for rt3.dc1--test-topic: (0, 72075186224037892) 
2025-09-30T14:50:17.879936Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2957: [PQ: 72075186224037892] Handle TEvInterconnect::TEvNodeInfo
2025-09-30T14:50:17.880788Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2989: [PQ: 72075186224037892] Transactions request. From tx_00000000000000000000, To tx_18446744073709551615
2025-09-30T14:50:17.880849Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:784: [PQ: 72075186224037892] no config, start with empty partitions and default config
2025-09-30T14:50:17.880860Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:17.880868Z node 1 :PERSQUEUE INFO: pq_impl.cpp:609: [PQ: 72075186224037892] doesn't have tx writes info
2025-09-30T14:50:17.881165Z node 2 :PERSQUEUE_READ_BALANCER DEBUG: read_balancer.cpp:402: [72075186224037893][rt3.dc1--test-topic] TEvClientConnected TabletId 72075186224037892, NodeId 1, Generation 1
2025-09-30T14:50:17.881327Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894661559795199:3339], now have 1 active actors on pipe
2025-09-30T14:50:17.881336Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [2:7555894663387265318:2386], now have 1 active actors on pipe
2025-09-30T14:50:17.881471Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
===Query complete
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
2025-09-30T14:50:17.882396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
TClient::Ls response: Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
GetTopicVersionFromPath:  record Status: 128
StatusCode: PATH_NOT_EXIST
Issues {
  message: "Path not exist"
  issue_code: 200200
  severity: 1
}
SchemeStatus: 2
ErrorReason: "Path not found"
 name rt3.dc1--test-topic version0
2025-09-30T14:50:17.883866Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894661559795289:3399], now have 1 active actors on pipe
2025-09-30T14:50:17.883941Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.884702Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.884946Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitConfigStep
2025-09-30T14:50:17.884978Z node 1 :PERSQUEUE DEBUG: partition.cpp:1271: [72075186224037892][Partition][0][StateInit] HandleOnInit TEvPQ::TEvProposePartitionConfig
2025-09-30T14:50:17.885029Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitInternalFieldsStep
2025-09-30T14:50:17.885123Z node 1 :PERSQUEUE INFO: partition_init.cpp:1080: [72075186224037892][Partition][0][StateInit] bootstrapping 0 [1:7555894661559795301:2474]
2025-09-30T14:50:17.885952Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:80: [rt3.dc1--test-topic:0:Initializer] Start initializing step TInitFieldsStep
2025-09-30T14:50:17.885956Z node 1 :PERSQUEUE DEBUG: partition_init.cpp:60: [rt3.dc1--test-topic:0:Initializer] Initializing completed.
2025-09-30T14:50:17.885962Z node 1 :PERSQUEUE INFO: partition.cpp:697: [72075186224037892][Partition][0][StateInit] init complete for topic 'rt3.dc1--test-topic' partition 0 generation 1 [1:7555894661559795301:2474]
2025-09-30T14:50:17.885970Z node 1 :PERSQUEUE DEBUG: partition.cpp:711: [72075186224037892][Partition][0][StateInit] SYNC INIT topic rt3.dc1--test-topic partitition 0 so 0 endOffset 0 Head Offset 0 PartNo 0 PackedSize 0 count 0 nextOffset 0 batches 0
2025-09-30T14:50:17.886299Z node 1 :PERSQUEUE DEBUG: partition.cpp:4296: [72075186224037892][Partition][0][StateIdle] Process pending events. Count 1
2025-09-30T14:50:17.886306Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.886335Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.886338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:17.886341Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:17.886344Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.886346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.886348Z node 1 :PERSQUEUE DEBUG: partition.cpp:2293: [72075186224037892][Partition][0][StateIdle] Still pending for come commits
2025-09-30T14:50:17.886359Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:17.886492Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.886523Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.887478Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.887522Z node 1 :PERSQUEUE DEBUG: partition.cpp:1375: [72075186224037892][Partition][0][StateIdle] Handle TEvPQ::TEvTxCommit Step 1759243817933, TxId 281474976710679
2025-09-30T14:50:17.887527Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.887529Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.887557Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.887621Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:17.888090Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:17.888142Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 0 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:17.888155Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.888158Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.888160Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:17.888166Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:172: [72075186224037892][Partition][0][StateIdle] No data for blobs compaction
2025-09-30T14:50:17.888296Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:395: [PQ: 72075186224037892] Apply new config PartitionConfig { LifetimeSeconds: 86400 LowWatermark: 8388608 SourceIdLifetimeSeconds: 86400 WriteSpeedInBytesPerSecond: 20000000 BurstSize: 20000000 TotalPartitions: 1 SourceIdMaxCounts: 6000000 } PartitionIds: 0 TopicName: "rt3.dc1--test-topic" Version: 0 LocalDC: true Codecs { Ids: 0 Ids: 1 Ids: 2 Codecs: "raw" Codecs: "gzip" Codecs: "lzop" } TopicPath: "/Root/PQ/rt3.dc1--test-topic" YcCloudId: "" YcFolderId: "" YdbDatabaseId: "" YdbDatabasePath: "/Root" Partitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } AllPartitions { PartitionId: 0 Status: Active CreateVersion: 1 TabletId: 0 } Consumers { Name: "user" ReadFromTimestampsMs: 0 FormatVersion: 0 Version: 0 Generation: 0 } MonitoringProjectId: ""
2025-09-30T14:50:17.888320Z node 1 :PERSQUEUE NOTICE: pq_impl.cpp:908: [PQ: 72075186224037892] disable metering: reason# billing is not enabled in BillingMeteringConfig
2025-09-30T14:50:17.888361Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.890207Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.890234Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:3567: [PQ: 72075186224037892] Send TEvKeyValue::TEvRequest (WRITE_TX_COOKIE)
2025-09-30T14:50:17.891412Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:1040: [PQ: 72075186224037892] Handle TEvKeyValue::TEvResponse (WRITE_TX_COOKIE)
2025-09-30T14:50:17.986636Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:17.986654Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:17.986658Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.086989Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.087006Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.087009Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.187327Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.187346Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.187349Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.287704Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.287722Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.287725Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
TClient::Ls request: /Root/PQ/rt3.dc1--test-topic
TClient::Ls response: Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710679
    CreateStep: 1759243817933
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts...
(TRUNCATED)
GetTopicVersionFromPath:  record Status: 1
StatusCode: SUCCESS
SchemeStatus: 0
PathDescription {
  Self {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    SchemeshardId: 72057594046644480
    PathType: EPathTypePersQueueGroup
    CreateFinished: true
    CreateTxId: 281474976710679
    CreateStep: 1759243817933
    ParentPathId: 2
    PathState: EPathStateNoChanges
    Owner: "root@builtin"
    ACL: ""
    EffectiveACL: ""
    PathVersion: 2
    PathSubType: EPathSubTypeEmpty
    Version {
      GeneralVersion: 2
      ACLVersion: 0
      EffectiveACLVersion: 0
      UserAttrsVersion: 1
      ChildrenVersion: 0
      PQVersion: 1
    }
    ChildrenExist: false
  }
  PersQueueGroup {
    Name: "rt3.dc1--test-topic"
    PathId: 13
    TotalGroupCount: 1
    PartitionPerTablet: 5
    PQTabletConfig {
      PartitionConfig {
        LifetimeSeconds: 86400
        LowWatermark: 8388608
        SourceIdLifetimeSeconds: 86400
        WriteSpeedInBytesPerSecond: 20000000
        BurstSize: 20000000
        SourceIdMaxCounts: 6000000
      }
      LocalDC: true
      Codecs {
        Ids: 0
        Ids: 1
        Ids: 2
        Codecs: "raw"
        Codecs: "gzip"
        Codecs: "lzop"
      }
      YdbDatabasePath: "/Root"
      Consumers {
        Name: "user"
        ReadFromTimestampsMs: 0
        FormatVersion: 0
        Version: 0
      }
    }
    Partitions {
      PartitionId: 0
      TabletId: 72075186224037892
      Status: Active
    }
    AlterVersion: 1
    BalancerTabletID: 72075186224037893
    NextPartitionId: 1
  }
  DomainDescription {
    SchemeShardId_Depricated: 72057594046644480
    PathId_Depricated: 1
    ProcessingParams {
      Version: 1
      PlanResolution: 7
      Coordinators: 72057594046316545
      TimeCastBucketsPerMediator: 2
      Mediators: 72057594046382081
    }
    DomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    PathsInside: 12
    PathsLimit: 10000
    ShardsInside: 6
    ShardsLimit: 200000
    ResourcesDomainKey {
      SchemeShard: 72057594046644480
      PathId: 1
    }
    DiskSpaceUsage {
      Tables {
        TotalSize: 0
        DataSize: 0
        IndexSize: 0
      }
      Topics {
        ReserveSize: 0
        AccountSize: 0
        DataSize: 0
        UsedReserveSize: 0
      }
    }
    PQPartitionsInside: 1
    PQPartitionsLimit: 1000000
    SchemeLimits {
      MaxDepth: 32
      MaxPaths: 10000
      MaxChildrenInDir: 100000
      MaxAclBytesSize: 10240
      MaxTableColumns: 200
      MaxTableColumnNameLength: 255
      MaxTableKeyColumns: 30
      MaxTableIndices: 20
      MaxShards: 200000
      MaxShardsInPath: 35000
      MaxConsistentCopyTargets: 10000
      MaxPathElementLength: 255
      ExtraPathSymbolsAllowed: "!\"#$%&\'()*+,-.:;<=>?@[\\]^_`{|}~"
      MaxPQPartitions: 1000000
      MaxTableCdcStreams: 5
      MaxExports: 10
      MaxImports: 10
      MaxColumnTableColumns: 10000
    }
  }
}
Path: "/Root/PQ/rt3.dc1--test-topic"
 name rt3.dc1--test-topic version1
CallPersQueueGRPC request to localhost:17055
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.385643Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 128
ErrorReason: "the following topics are not created: rt3.dc1--test-topic, Marker# PQ95"
ErrorCode: UNKNOWN_TOPIC
2025-09-30T14:50:18.388038Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.388057Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.388060Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.488359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.488381Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.488385Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.588758Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.588776Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.588780Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.689212Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.689229Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.689232Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.793109Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.793128Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.793131Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
CallPersQueueGRPC request to localhost:17055
MetaRequest {
  CmdGetTopicMetadata {
    Topic: "rt3.dc1--test-topic"
  }
}
2025-09-30T14:50:18.887653Z node 1 :PERSQUEUE INFO: msgbus_server_persqueue.cpp:1531: proxy answer <none>
CallPersQueueGRPC response:
Status: 1
ErrorCode: OK
MetaResponse {
  CmdGetTopicMetadataResult {
    TopicInfo {
      Topic: "rt3.dc1--test-topic"
      NumPartitions: 1
      Config {
        PartitionConfig {
          LifetimeSeconds: 86400
          LowWatermark: 8388608
          SourceIdLifetimeSeconds: 86400
          WriteSpeedInBytesPerSecond: 20000000
          BurstSize: 20000000
          SourceIdMaxCounts: 6000000
        }
        Version: 1
        LocalDC: true
        Codecs {
          Ids: 0
          Ids: 1
          Ids: 2
          Codecs: "raw"
          Codecs: "gzip"
          Codecs: "lzop"
        }
        TopicPath: "/Root/PQ/rt3.dc1--test-topic"
        YdbDatabasePath: "/Root"
        Consumers {
          Name: "user"
          ReadFromTimestampsMs: 0
          FormatVersion: 0
          Version: 0
        }
      }
      ErrorCode: OK
    }
  }
}
=== Topic created, have version: 1
2025-09-30T14:50:18.889197Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: try to update token
2025-09-30T14:50:18.889447Z :INFO: [] MessageGroupId [src] SessionId [] Write session: Do CDS request
2025-09-30T14:50:18.889454Z :INFO: [] MessageGroupId [src] SessionId [] Start write session. Will connect to endpoint: localhost:17055
2025-09-30T14:50:18.890112Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:18.890128Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 1
2025-09-30T14:50:18.891937Z :DEBUG: [] MessageGroupId [src] SessionId [] Write session: send init request: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:18.892225Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId:  grpc read done: success: 1 data: init_request { topic: "test-topic" message_group_id: "src" }
2025-09-30T14:50:18.892285Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 1 topic: "test-topic" message_group_id: "src" from ipv6:[::1]:32780
2025-09-30T14:50:18.892295Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=1 sessionId= userAgent="pqv1 server" ip=ipv6:[::1]:32780 proto=v1  topic=test-topic durationSec=0
2025-09-30T14:50:18.892300Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:18.892783Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 1 sessionId:  describe result for acl check
2025-09-30T14:50:18.892839Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:18.892845Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:18.892847Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:18.892865Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894665854762773:2505] (SourceId=src, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:18.893353Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894665854762773:2505] (SourceId=src, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:18.893355Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.893359Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.893360Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.922418Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7555894665854762773:2505] (SourceId=src, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:18.922569Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894665854762805:2505] connected; active server actors: 1
2025-09-30T14:50:18.922684Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7555894665854762773:2505] (SourceId=src, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src
2025-09-30T14:50:18.922692Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894665854762773:2505] (SourceId=src, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:18.922819Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894665854762805:2505] disconnected; active server actors: 1
2025-09-30T14:50:18.922828Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894665854762805:2505] disconnected no session
2025-09-30T14:50:18.939166Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894665854762773:2505] (SourceId=src, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:18.939185Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894665854762773:2505] (SourceId=src, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:18.939189Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894665854762773:2505] (SourceId=src, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:18.939198Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 1 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:18.939483Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1
2025-09-30T14:50:18.939489Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894665854762825:2505], now have 1 active actors on pipe
2025-09-30T14:50:18.939498Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.939507Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.939542Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src|2b39a109-84ac4dc2-3ccdc33d-a78e762e_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src
2025-09-30T14:50:18.939566Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.939576Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.939580Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.939594Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.939616Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:18.939639Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.939688Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.939696Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.939713Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.939752Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 1 partition: 0 MaxSeqNo: 0 sessionId: src|2b39a109-84ac4dc2-3ccdc33d-a78e762e_0
2025-09-30T14:50:18.940176Z :INFO: [] MessageGroupId [src] SessionId [] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243818940 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:18.940219Z :INFO: [] MessageGroupId [src] SessionId [] Write session established. Init response: session_id: "src|2b39a109-84ac4dc2-3ccdc33d-a78e762e_0" topic: "test-topic" cluster: "dc1" supported_codecs: CODEC_RAW supported_codecs: CODEC_GZIP supported_codecs: CODEC_LZOP
2025-09-30T14:50:18.940340Z :INFO: [] MessageGroupId [src] SessionId [src|2b39a109-84ac4dc2-3ccdc33d-a78e762e_0] Write session: close. Timeout = 0 ms
2025-09-30T14:50:18.940347Z :INFO: [] MessageGroupId [src] SessionId [src|2b39a109-84ac4dc2-3ccdc33d-a78e762e_0] Write session will now close
2025-09-30T14:50:18.940355Z :DEBUG: [] MessageGroupId [src] SessionId [src|2b39a109-84ac4dc2-3ccdc33d-a78e762e_0] Write session: aborting
2025-09-30T14:50:18.940542Z :INFO: [] MessageGroupId [src] SessionId [src|2b39a109-84ac4dc2-3ccdc33d-a78e762e_0] Write session: gracefully shut down, all writes complete
2025-09-30T14:50:18.940548Z :DEBUG: [] MessageGroupId [src] SessionId [src|2b39a109-84ac4dc2-3ccdc33d-a78e762e_0] Write session: destroy
2025-09-30T14:50:18.940699Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 1 sessionId: src|2b39a109-84ac4dc2-3ccdc33d-a78e762e_0 grpc read done: success: 0 data: 
2025-09-30T14:50:18.940711Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 1 sessionId: src|2b39a109-84ac4dc2-3ccdc33d-a78e762e_0 grpc read failed
2025-09-30T14:50:18.940719Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 1 sessionId: src|2b39a109-84ac4dc2-3ccdc33d-a78e762e_0 grpc closed
2025-09-30T14:50:18.940725Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 1 sessionId: src|2b39a109-84ac4dc2-3ccdc33d-a78e762e_0 is DEAD
2025-09-30T14:50:18.941001Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:18.941047Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894665854762825:2505] destroyed
2025-09-30T14:50:18.941064Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:18.941070Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.941073Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.941076Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
=== Before CreateWriteSession
=== Inside ReadyToAcceptHandler
=== Session created
=== Inside ReadyToAcceptHandler
2025-09-30T14:50:18.943984Z :INFO: [/Root] OnFederationDiscovery fall back to single mode, database=/Root
2025-09-30T14:50:18.944289Z :INFO: [/Root] [] [] Start federated write session to database '' (previous was <empty>) FederationState: { Status: SUCCESS SelfLocation: "" DbInfos: [ { path: "/Root" endpoint: "localhost:17055" status: AVAILABLE weight: 100 } ] ControlPlaneEndpoint: localhost:17055 }
2025-09-30T14:50:18.944376Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:50:18.944574Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Start write session. Will connect to nodeId: 0
2025-09-30T14:50:18.945673Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: write to message_group: src_id
2025-09-30T14:50:18.945901Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:107: new grpc connection
2025-09-30T14:50:18.945916Z node 1 :PQ_WRITE_PROXY DEBUG: grpc_pq_write.h:141: new session created cookie 2
2025-09-30T14:50:18.947601Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: send init request: init_request { path: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:18.947739Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnWriteDone gRpcStatusCode: 0
2025-09-30T14:50:18.947878Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId:  grpc read done: success: 1 data: init_request { path: "test-topic" message_group_id: "src_id" }
2025-09-30T14:50:18.947932Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:447: session request cookie: 2 path: "test-topic" message_group_id: "src_id" from ipv6:[::1]:51720
2025-09-30T14:50:18.947952Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:1538: write session:  cookie=2 sessionId= userAgent="topic server" ip=ipv6:[::1]:51720 proto=topic  topic=test-topic durationSec=0
2025-09-30T14:50:18.947958Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:571: init check schema
2025-09-30T14:50:18.948473Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:632: session v1 cookie: 2 sessionId:  describe result for acl check
2025-09-30T14:50:18.948516Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:62: TTableHelper SelectQuery: --!syntax_v1
DECLARE $Hash AS Uint32; DECLARE $Topic AS Utf8; DECLARE $SourceId AS Utf8;
SELECT Partition, CreateTime, AccessTime, SeqNo FROM `/Root/PQ/SourceIdMeta2` WHERE Hash == $Hash AND Topic == $Topic AND SourceId == $SourceId;
2025-09-30T14:50:18.948525Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:63: TTableHelper UpdateQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;DECLARE $SeqNo AS Uint64;
UPSERT INTO `/Root/PQ/SourceIdMeta2` (Hash, Topic, SourceId, CreateTime, AccessTime, Partition, SeqNo) VALUES ($Hash, $Topic, $SourceId, $CreateTime, $AccessTime, $Partition, $SeqNo);
2025-09-30T14:50:18.948527Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__table_helper.h:64: TTableHelper UpdateAccessTimeQuery: --!syntax_v1
DECLARE $SourceId AS Utf8; DECLARE $Topic AS Utf8; DECLARE $Hash AS Uint32; DECLARE $Partition AS Uint32; DECLARE $CreateTime AS Uint64; DECLARE $AccessTime AS Uint64;
UPDATE `/Root/PQ/SourceIdMeta2` SET AccessTime = $AccessTime WHERE Hash = $Hash AND Topic = $Topic AND SourceId = $SourceId AND Partition = $Partition;
2025-09-30T14:50:18.948534Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:111: TPartitionChooser [1:7555894665854762833:2520] (SourceId=src_id, PreferedPartition=(NULL)) StartKqpSession
2025-09-30T14:50:18.949133Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:142: TPartitionChooser [1:7555894665854762833:2520] (SourceId=src_id, PreferedPartition=(NULL)) Select from the table
2025-09-30T14:50:18.952797Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:67: TPartitionChooser [1:7555894665854762833:2520] (SourceId=src_id, PreferedPartition=(NULL)) RequestPQRB
2025-09-30T14:50:18.952953Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1653: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894665854762849:2520] connected; active server actors: 1
2025-09-30T14:50:18.953067Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__old_chooser_actor.h:80: TPartitionChooser [1:7555894665854762833:2520] (SourceId=src_id, PreferedPartition=(NULL)) Received partition 0 from PQRB for SourceId=src_id
2025-09-30T14:50:18.953078Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:174: TPartitionChooser [1:7555894665854762833:2520] (SourceId=src_id, PreferedPartition=(NULL)) Update the table
2025-09-30T14:50:18.953179Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1665: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894665854762849:2520] disconnected; active server actors: 1
2025-09-30T14:50:18.953188Z node 2 :PERSQUEUE_READ_BALANCER INFO: read_balancer__balancing.cpp:1689: [72075186224037893][rt3.dc1--test-topic] pipe [1:7555894665854762849:2520] disconnected no session
2025-09-30T14:50:18.956592Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:183: TPartitionChooser [1:7555894665854762833:2520] (SourceId=src_id, PreferedPartition=(NULL)) HandleUpdate PartitionPersisted=0 Status=SUCCESS
2025-09-30T14:50:18.956609Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:305: TPartitionChooser [1:7555894665854762833:2520] (SourceId=src_id, PreferedPartition=(NULL)) ReplyResult: Partition=0, SeqNo=(NULL)
2025-09-30T14:50:18.956614Z node 1 :PQ_PARTITION_CHOOSER DEBUG: partition_chooser_impl__abstract_chooser_actor.h:268: TPartitionChooser [1:7555894665854762833:2520] (SourceId=src_id, PreferedPartition=(NULL)) Start idle
2025-09-30T14:50:18.956623Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:694: ProceedPartition. session cookie: 2 sessionId:  partition: 0 expectedGeneration: (NULL)
2025-09-30T14:50:18.956790Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:822: TPartitionWriter 72075186224037892 (partition=0) TEvClientConnected Status OK, TabletId: 72075186224037892, NodeId 1, Generation: 1
2025-09-30T14:50:18.956812Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2718: [PQ: 72075186224037892] server connected, pipe [1:7555894665854762863:2520], now have 1 active actors on pipe
2025-09-30T14:50:18.956829Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.956839Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.956878Z node 1 :PERSQUEUE INFO: ownerinfo.cpp:30: new Cookie src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0 generated for partition 0 topic 'rt3.dc1--test-topic' owner src_id
2025-09-30T14:50:18.956898Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.956902Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.956906Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.956921Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.956941Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:35: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyOwnerOk. Partition: 0
2025-09-30T14:50:18.956965Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.957038Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.957057Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.957087Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 0
2025-09-30T14:50:18.957136Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:871: session inited cookie: 2 partition: 0 MaxSeqNo: 0 sessionId: src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0
2025-09-30T14:50:18.957559Z :DEBUG: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:50:18.957572Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Counters: { Errors: 0 CurrentSessionLifetimeMs: 1759243818957 BytesWritten: 0 MessagesWritten: 0 BytesWrittenCompressed: 0 BytesInflightUncompressed: 0 BytesInflightCompressed: 0 BytesInflightTotal: 0 MessagesInflight: 0 }
2025-09-30T14:50:18.957613Z :INFO: [/Root]  TraceId []  SessionId []  MessageGroupId [src_id] Write session established. Init response: session_id: "src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0" supported_codecs { codecs: 1 codecs: 2 codecs: 3 }
2025-09-30T14:50:18.957679Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 1 to 1
2025-09-30T14:50:18.957978Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:50:18.957992Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 1
2025-09-30T14:50:18.958210Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.958307Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.958347Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.958359Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.958396Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 0  requestId: <none> cookie: 1
2025-09-30T14:50:18.958418Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:50:18.958453Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.958460Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.958577Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 1 partNo : 0 messageNo: 1 size 115 offset: -1
2025-09-30T14:50:18.958594Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.958615Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.958622Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.958628Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.958664Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 1 partNo 0
2025-09-30T14:50:18.958753Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 1 partNo 0 FormedBlobsCount 0 NewHead: Offset 0 PartNo 0 PackedSize 189 count 1 nextOffset 1 batches 1
2025-09-30T14:50:18.958765Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.958826Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 0,1 HeadOffset 0 endOffset 0 curOffset 1 d0000000000_00000000000000000000_00000_0000000001_00000? size 177 WTime 1759243818958
2025-09-30T14:50:18.958859Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.958878Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 0 partNo 0 count 1 size 177
2025-09-30T14:50:18.959904Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 0 count 1 size 177 actorID [1:7555894661559795244:2474]
2025-09-30T14:50:18.959929Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.959942Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63' size 177
2025-09-30T14:50:18.959963Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 122 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.959976Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.959987Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 1, partNo: 0, Offset: 0 is stored on disk
2025-09-30T14:50:18.960032Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:898: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 0 rrg 0
2025-09-30T14:50:18.960044Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:940: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 user user send read request for offset 0 initiated  queuesize 0 startOffset 0 ReadingTimestamp 1 rrg 0
2025-09-30T14:50:18.960048Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.960051Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.960053Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.960062Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:50:18.960068Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 1 keys were taken away. Let's read 177 bytes (177)
2025-09-30T14:50:18.960072Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 1, size 177 (8388608)
2025-09-30T14:50:18.960083Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 1  requestId: <none> cookie: 1
2025-09-30T14:50:18.960117Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:50:18.960131Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:855: [72075186224037892][Partition][0][StateIdle] read cookie 3 Topic 'rt3.dc1--test-topic' partition 0 user user offset 0 count 1 size 1024000 endOffset 1 max time lag 0ms effective offset 0
2025-09-30T14:50:18.960152Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1069: [72075186224037892][Partition][0][StateIdle] read cookie 3 added 1 blobs, size 177 count 1 last offset 0, current partition end offset: 1
2025-09-30T14:50:18.960159Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:1095: [72075186224037892][Partition][0][StateIdle] Reading cookie 3. Send blob request.
2025-09-30T14:50:18.960170Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:497: Got data from cache. Partition 0 offset 0 partno 0 count 1 parts_count 0 source 1 size 177 accessed 0 times before, last time 2025-09-30T14:50:18.000000Z
2025-09-30T14:50:18.960183Z node 1 :PERSQUEUE DEBUG: read.h:126: [72075186224037892][PQCacheProxy]Reading cookie 3. All 1 blobs are from cache.
2025-09-30T14:50:18.960201Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:561: FormAnswer for 1 blobs
2025-09-30T14:50:18.960202Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:201: PQ Cache (L2). Touched. Tablet '72075186224037892' partition 0 offset 0 partno 0 count 1 parts 0 suffix '63'
2025-09-30T14:50:18.960217Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:487: FormAnswer processing batch offset 0 totakecount 1 count 1 size 157 from pos 0 cbcount 1
2025-09-30T14:50:18.960250Z node 1 :PERSQUEUE DEBUG: partition_read.cpp:990: Topic 'rt3.dc1--test-topic' partition 0 user user readTimeStamp done, result 1759243818958 queuesize 0 startOffset 0
2025-09-30T14:50:18.960354Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:50:18.960548Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 1 written { } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-09-30T14:50:18.960555Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] OnAck: seqNo=1, txId=?
2025-09-30T14:50:18.960560Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 1
=== Inside AcksHandler
2025-09-30T14:50:18.960618Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 2 to 2
=== Inside ReadyToAcceptHandler
=== AcksHandler has written a message, closing the session
2025-09-30T14:50:18.960760Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write session: try to update token
2025-09-30T14:50:18.960773Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Send 1 message(s) (0 left), first sequence number is 2
2025-09-30T14:50:18.960997Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0 grpc read done: success: 1 data:  write_request[data omitted]
2025-09-30T14:50:18.961098Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::NPQ::TEvPartitionWriter::TEvWriteRequest
2025-09-30T14:50:18.961140Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.961150Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.961171Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 2  requestId: <none> cookie: 2
2025-09-30T14:50:18.961188Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:50:18.961213Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:146: Handle TEvRequest topic: 'rt3.dc1--test-topic' requestId: <none>
2025-09-30T14:50:18.961219Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2632: [PQ: 72075186224037892] got client message batch for topic 'rt3.dc1--test-topic' partition 0
2025-09-30T14:50:18.961233Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2007: [PQ: 72075186224037892] got client message topic: rt3.dc1--test-topic partition: 0 SourceId: '\0src_id' SeqNo: 2 partNo : 0 messageNo: 3 size 107 offset: -1
2025-09-30T14:50:18.961242Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:637: [72075186224037892][Partition][0][StateIdle] Received TPartition::TEvWrite
2025-09-30T14:50:18.961252Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.961263Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.961265Z node 1 :PERSQUEUE DEBUG: partition.cpp:2277: [72075186224037892][Partition][0][StateIdle] Batch completed (1)
2025-09-30T14:50:18.961289Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1319: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob processing sourceId '\0src_id' seqNo 2 partNo 0
2025-09-30T14:50:18.961328Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1423: [72075186224037892][Partition][0][StateIdle] Topic 'rt3.dc1--test-topic' partition 0 part blob complete sourceId '\0src_id' seqNo 2 partNo 0 FormedBlobsCount 0 NewHead: Offset 1 PartNo 0 PackedSize 181 count 1 nextOffset 2 batches 1
2025-09-30T14:50:18.961338Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.961383Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:1675: [72075186224037892][Partition][0][StateIdle] Add new write blob: topic 'rt3.dc1--test-topic' partition 0 compactOffset 1,1 HeadOffset 1 endOffset 1 curOffset 2 d0000000000_00000000000000000001_00000_0000000001_00000? size 169 WTime 1759243818960
2025-09-30T14:50:18.961406Z node 1 :PERSQUEUE DEBUG: read.h:275: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough write request to KV
2025-09-30T14:50:18.961435Z node 1 :PERSQUEUE DEBUG: read.h:313: [72075186224037892][PQCacheProxy]CacheProxy. Passthrough blob. Partition 0 offset 1 partNo 0 count 1 size 169
2025-09-30T14:50:18.962231Z node 1 :PERSQUEUE DEBUG: cache_eviction.h:321: Caching head blob in L1. Partition 0 offset 1 count 1 size 169 actorID [1:7555894661559795244:2474]
2025-09-30T14:50:18.962250Z node 1 :PERSQUEUE DEBUG: partition.cpp:2094: [72075186224037892][Partition][0][StateIdle] Received TEvKeyValue::TEvResponse
2025-09-30T14:50:18.962263Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:574: [72075186224037892][Partition][0][StateIdle] TPartition::HandleWriteResponse writeNewSize# 114 WriteNewSizeFromSupportivePartitions# 0
2025-09-30T14:50:18.962263Z node 1 :PERSQUEUE DEBUG: pq_l2_cache.cpp:129: PQ Cache (L2). Adding blob. Tablet '72075186224037892' partition 0 offset 1 partno 0 count 1 parts 0 suffix '63' size 169
2025-09-30T14:50:18.962274Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:58: [72075186224037892][Partition][0][StateIdle] TPartition::ReplyWrite. Partition: 0
2025-09-30T14:50:18.962282Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:361: [72075186224037892][Partition][0][StateIdle] Answering for message sourceid: '\0src_id', Topic: 'rt3.dc1--test-topic', Partition: 0, SeqNo: 2, partNo: 0, Offset: 1 is stored on disk
2025-09-30T14:50:18.962307Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.962313Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.962315Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.962321Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000000_00000_0000000001_00000?
2025-09-30T14:50:18.962323Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:200: [72075186224037892][Partition][0][StateIdle] Blob key for append d0000000000_00000000000000000001_00000_0000000001_00000?
2025-09-30T14:50:18.962334Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:206: [72075186224037892][Partition][0][StateIdle] 2 keys were taken away. Let's read 346 bytes (346)
2025-09-30T14:50:18.962342Z node 1 :PERSQUEUE DEBUG: partition_compaction.cpp:211: [72075186224037892][Partition][0][StateIdle] Need more data for compaction. Blobs 2, size 346 (8388608)
2025-09-30T14:50:18.962350Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:181: Answer ok topic: 'rt3.dc1--test-topic' partition: 0 messageNo: 3  requestId: <none> cookie: 2
2025-09-30T14:50:18.962370Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NKikimr::TEvPersQueue::TEvResponse
2025-09-30T14:50:18.962582Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write session: OnReadDone gRpcStatusCode: 0
2025-09-30T14:50:18.962622Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write session got write response: acks { seq_no: 2 written { offset: 1 } } write_statistics { persisting_time { nanos: 1000000 } min_queue_wait_time { } max_queue_wait_time { } partition_quota_wait_time { } topic_quota_wait_time { } }
2025-09-30T14:50:18.962627Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] OnAck: seqNo=2, txId=?
2025-09-30T14:50:18.962631Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write session: acknoledged message 2
=== Inside AcksHandler
=== Inside SessionClosedHandler
2025-09-30T14:50:18.962733Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write 1 messages with Id from 3 to 3
=== SessionClosedHandler has 'written' a message
2025-09-30T14:50:18.962782Z :INFO: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write session: close. Timeout 0.000000s
2025-09-30T14:50:18.962798Z :INFO: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write session will now close
2025-09-30T14:50:18.962810Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write session: aborting
2025-09-30T14:50:18.962920Z :WARNING: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write session: could not confirm all writes in time or session aborted, perform hard shutdown
2025-09-30T14:50:18.962983Z :DEBUG: [/Root]  TraceId []  SessionId [src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0]  MessageGroupId [src_id] Write session: destroy
2025-09-30T14:50:18.963055Z node 1 :PQ_WRITE_PROXY DEBUG: write_session_actor.cpp:254: session v1 cookie: 2 sessionId: src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0 grpc read done: success: 0 data: 
2025-09-30T14:50:18.963065Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:256: session v1 cookie: 2 sessionId: src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0 grpc read failed
2025-09-30T14:50:18.963074Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:232: session v1 cookie: 2 sessionId: src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0 grpc closed
2025-09-30T14:50:18.963079Z node 1 :PQ_WRITE_PROXY INFO: write_session_actor.cpp:304: session v1 cookie: 2 sessionId: src_id|36332ea0-d0bfa6d1-e99f6b5d-33e7bd64_0 is DEAD
2025-09-30T14:50:18.963410Z node 1 :PQ_WRITE_PROXY DEBUG: writer.cpp:562: TPartitionWriter 72075186224037892 (partition=0) Received event: NActors::TEvents::TEvPoison
2025-09-30T14:50:18.963484Z node 1 :PERSQUEUE DEBUG: pq_impl.cpp:2743: [PQ: 72075186224037892] server disconnected, pipe [1:7555894665854762863:2520] destroyed
2025-09-30T14:50:18.963496Z node 1 :PERSQUEUE DEBUG: partition_write.cpp:138: [72075186224037892][Partition][0][StateIdle] TPartition::DropOwner.
2025-09-30T14:50:18.963502Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.963504Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.963506Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:18.993737Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:18.993754Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:18.993757Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.094087Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.094102Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.094106Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
2025-09-30T14:50:19.194438Z node 1 :PERSQUEUE DEBUG: partition.cpp:2264: [72075186224037892][Partition][0][StateIdle] Batching state before ContinueProcessTxsAndUserActs: 0
2025-09-30T14:50:19.194456Z node 1 :PERSQUEUE DEBUG: partition.cpp:2273: [72075186224037892][Partition][0][StateIdle] Batching state after ContinueProcessTxsAndUserActs: 1
2025-09-30T14:50:19.194460Z node 1 :PERSQUEUE DEBUG: partition.cpp:2296: [72075186224037892][Partition][0][StateIdle] Try persist
